[00:01:00] PROBLEM - swiftobject115 ferm_active on swiftobject115 is UNKNOWN: NRPE: Unable to read output [00:01:02] RECOVERY - swiftobject115 Current Load on swiftobject115 is OK: OK - load average: 1.83, 1.70, 1.17 [00:01:03] RECOVERY - swiftobject115 Disk Space on swiftobject115 is OK: DISK OK - free space: / 887781 MB (99% inode=99%); [00:01:04] PROBLEM - swiftobject115 Puppet on swiftobject115 is UNKNOWN: UNKNOWN: Failed to check. Reason is: no_summary_file [00:01:08] RECOVERY - swiftobject115 NTP time on swiftobject115 is OK: NTP OK: Offset 0.009432435036 secs [00:01:47] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.49, 2.04, 1.86 [00:02:14] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 6.19, 5.39, 5.81 [00:03:00] RECOVERY - swiftobject115 PowerDNS Recursor on swiftobject115 is OK: DNS OK: 1.104 second response time. miraheze.org returns 109.228.51.216,217.174.247.33,2a00:da00:1800:326::1,2a00:da00:1800:328::1 [00:03:10] RECOVERY - swiftobject115 APT on swiftobject115 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [00:03:12] PROBLEM - swiftobject115 conntrack_table_size on swiftobject115 is UNKNOWN: NRPE: Unable to read output [00:03:41] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.40, 1.82, 1.81 [00:04:13] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 2.72, 4.47, 5.43 [00:04:19] PROBLEM - swiftobject114 conntrack_table_size on swiftobject114 is UNKNOWN: NRPE: Unable to read output [00:04:21] RECOVERY - swiftobject114 PowerDNS Recursor on swiftobject114 is OK: DNS OK: 0.685 seconds response time. miraheze.org returns 109.228.51.216,217.174.247.33,2a00:da00:1800:326::1,2a00:da00:1800:328::1 [00:04:23] PROBLEM - swiftobject114 ferm_active on swiftobject114 is UNKNOWN: NRPE: Unable to read output [00:04:24] RECOVERY - swiftobject114 Current Load on swiftobject114 is OK: OK - load average: 1.82, 1.89, 1.40 [00:04:24] PROBLEM - swiftobject114 Puppet on swiftobject114 is UNKNOWN: UNKNOWN: Failed to check. Reason is: no_summary_file [00:04:27] RECOVERY - swiftobject114 NTP time on swiftobject114 is OK: NTP OK: Offset -0.00624704361 secs [00:04:29] RECOVERY - swiftobject114 Disk Space on swiftobject114 is OK: DISK OK - free space: / 887459 MB (99% inode=99%); [00:04:29] RECOVERY - swiftobject114 APT on swiftobject114 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [00:05:36] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 3.02, 2.00, 1.86 [00:06:11] RECOVERY - gluster102 Current Load on gluster102 is OK: OK - load average: 2.03, 3.69, 5.03 [00:06:17] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.35, 2.94, 3.83 [00:06:45] RECOVERY - swiftobject115 ferm_active on swiftobject115 is OK: OK ferm input default policy is set [00:06:55] RECOVERY - swiftobject115 Puppet on swiftobject115 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [00:07:00] RECOVERY - swiftobject115 conntrack_table_size on swiftobject115 is OK: OK: nf_conntrack is 0 % full [00:07:31] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.36, 1.79, 1.80 [00:08:14] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 6.53, 4.30, 4.22 [00:09:25] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.97, 1.50, 1.69 [00:12:14] PROBLEM - bast121 Puppet on bast121 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [00:14:59] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 8.99, 5.93, 5.33 [00:16:01] RECOVERY - swiftobject114 Puppet on swiftobject114 is OK: OK: Puppet is currently enabled, last run 2 seconds ago with 0 failures [00:16:03] RECOVERY - swiftobject114 conntrack_table_size on swiftobject114 is OK: OK: nf_conntrack is 0 % full [00:16:57] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 4.40, 5.50, 5.27 [00:17:46] PROBLEM - swiftobject114 ferm_active on swiftobject114 is CRITICAL: connect to address 2a10:6740::6:206 port 5666: Connection refusedconnect to host 2a10:6740::6:206 port 5666: Connection refused [00:18:55] RECOVERY - gluster102 Current Load on gluster102 is OK: OK - load average: 3.42, 4.90, 5.09 [00:19:40] RECOVERY - swiftobject114 ferm_active on swiftobject114 is OK: OK ferm input default policy is set [00:20:53] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.15, 1.86, 1.70 [00:22:48] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.05, 1.56, 1.61 [00:26:38] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.48, 1.72, 1.70 [00:27:45] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 1.10, 2.47, 3.68 [00:29:42] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.37, 3.51, 3.92 [00:30:07] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 1.97, 2.09, 1.80 [00:30:27] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 3.07, 2.08, 1.83 [00:31:40] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.65, 3.63, 3.92 [00:32:21] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.43, 1.81, 1.76 [00:34:19] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.09, 1.63, 1.70 [00:36:07] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.48, 1.90, 1.83 [00:39:28] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.37, 2.33, 3.16 [00:40:19] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 3.92, 3.01, 2.21 [00:41:45] RECOVERY - bast121 Puppet on bast121 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [00:42:07] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.59, 1.26, 1.58 [00:46:19] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.19, 1.86, 1.95 [00:48:19] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.33, 2.03, 2.00 [00:49:11] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.85, 3.79, 3.38 [00:50:19] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.89, 1.97, 1.98 [00:51:22] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 7.48, 5.64, 4.20 [00:52:07] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.23, 2.03, 1.78 [00:53:05] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.57, 3.67, 3.42 [00:53:22] RECOVERY - gluster102 Current Load on gluster102 is OK: OK - load average: 2.75, 4.52, 3.97 [00:54:07] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.77, 1.95, 1.78 [00:54:19] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 3.86, 2.37, 2.09 [00:55:03] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.13, 3.04, 3.21 [00:56:07] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.52, 2.20, 1.89 [00:58:07] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.56, 1.87, 1.81 [00:58:19] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.17, 1.94, 2.00 [01:04:07] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.48, 1.60, 1.70 [01:04:19] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.19, 1.80, 1.90 [01:08:19] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.47, 1.73, 1.84 [01:14:19] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.26, 1.87, 1.83 [01:16:08] PROBLEM - cp22 APT on cp22 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [01:16:19] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.02, 1.61, 1.75 [01:18:19] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.71, 1.94, 1.84 [01:19:04] PROBLEM - cp22 Current Load on cp22 is CRITICAL: CRITICAL - load average: 9.01, 5.30, 2.48 [01:20:47] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 5.34, 2.52, 1.94 [01:23:30] PROBLEM - cp22 PowerDNS Recursor on cp22 is CRITICAL: CRITICAL - Plugin timed out while executing system call [01:24:38] RECOVERY - cp22 APT on cp22 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [01:25:26] RECOVERY - cp22 PowerDNS Recursor on cp22 is OK: DNS OK: 0.121 seconds response time. miraheze.org returns 109.228.51.216,217.174.247.33,2a00:da00:1800:326::1,2a00:da00:1800:328::1 [01:28:26] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.28, 1.91, 1.92 [01:29:57] PROBLEM - swiftobject114 NTP time on swiftobject114 is CRITICAL: NTP CRITICAL: Offset 0.6563374996 secs [01:31:27] PROBLEM - puppet141 NTP time on puppet141 is CRITICAL: NTP CRITICAL: Offset 0.6560772359 secs [01:32:23] PROBLEM - prometheus131 NTP time on prometheus131 is CRITICAL: NTP CRITICAL: Offset 0.6565640867 secs [01:35:04] PROBLEM - cp22 Current Load on cp22 is WARNING: WARNING - load average: 0.13, 1.87, 3.67 [01:35:21] PROBLEM - matomo131 NTP time on matomo131 is CRITICAL: NTP CRITICAL: Offset 0.6573157907 secs [01:36:07] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.70, 1.78, 1.79 [01:37:04] RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 0.23, 1.32, 3.25 [01:38:07] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.56, 1.58, 1.71 [01:40:07] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.68, 1.59, 1.70 [01:42:19] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.01, 1.61, 1.92 [01:46:19] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.02, 1.64, 1.85 [01:50:19] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.41, 1.62, 1.81 [01:54:19] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.98, 1.28, 1.62 [01:56:21] PROBLEM - mw132 NTP time on mw132 is CRITICAL: NTP CRITICAL: Offset 0.663413465 secs [01:56:32] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.88, 1.61, 1.63 [01:56:45] PROBLEM - mw141 NTP time on mw141 is CRITICAL: NTP CRITICAL: Offset 0.663654238 secs [01:58:27] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.50, 1.53, 1.60 [01:59:39] PROBLEM - cp23 APT on cp23 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [02:00:04] PROBLEM - swiftobject115 NTP time on swiftobject115 is CRITICAL: NTP CRITICAL: Offset 0.6648285091 secs [02:00:05] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 10.37, 4.31, 1.98 [02:02:45] RECOVERY - mw141 NTP time on mw141 is OK: NTP OK: Offset 0.006296694279 secs [02:04:15] RECOVERY - prometheus131 NTP time on prometheus131 is OK: NTP OK: Offset 0.006532967091 secs [02:05:58] RECOVERY - cp23 APT on cp23 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [02:06:12] RECOVERY - matomo131 NTP time on matomo131 is OK: NTP OK: Offset 0.007262051105 secs [02:06:16] RECOVERY - swiftobject115 NTP time on swiftobject115 is OK: NTP OK: Offset 0.007039636374 secs [02:10:04] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 0.45, 3.28, 3.33 [02:10:35] RECOVERY - mw132 NTP time on mw132 is OK: NTP OK: Offset 0.007933199406 secs [02:11:44] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.39, 1.87, 1.68 [02:13:39] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.64, 1.77, 1.66 [02:17:28] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.26, 1.47, 1.55 [02:22:27] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.19, 1.77, 1.61 [02:24:21] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.95, 1.84, 1.65 [02:25:08] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.15, 1.78, 1.65 [02:26:16] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.34, 1.64, 1.60 [02:27:03] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.76, 1.69, 1.63 [02:28:58] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.94, 1.48, 1.56 [02:32:32] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.57, 3.70, 3.18 [02:34:33] RECOVERY - swiftobject114 NTP time on swiftobject114 is OK: NTP OK: Offset 0.01324638724 secs [02:36:26] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.81, 3.08, 3.10 [02:37:27] RECOVERY - puppet141 NTP time on puppet141 is OK: NTP OK: Offset 0.01382648945 secs [02:39:28] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.42, 2.45, 1.98 [02:43:18] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.03, 1.73, 1.79 [02:45:12] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.75, 1.45, 1.69 [02:46:23] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.04, 1.72, 1.63 [02:47:06] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.85, 3.98, 3.37 [02:52:08] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.36, 1.97, 1.82 [02:53:54] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 4.63, 6.07, 4.73 [02:54:07] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.90, 1.59, 1.70 [02:55:52] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 3.34, 5.44, 4.69 [02:57:03] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 1.94, 3.79, 3.78 [02:57:50] RECOVERY - gluster102 Current Load on gluster102 is OK: OK - load average: 1.99, 4.24, 4.33 [02:59:03] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.38, 3.66, 3.71 [03:03:03] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.88, 3.57, 3.69 [03:03:43] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 7.63, 5.72, 4.94 [03:05:41] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 5.47, 5.43, 4.91 [03:07:39] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 6.40, 5.75, 5.08 [03:09:37] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 5.61, 5.70, 5.14 [03:11:03] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.51, 3.75, 3.66 [03:12:09] PROBLEM - swiftobject114 NTP time on swiftobject114 is CRITICAL: NTP CRITICAL: Offset 0.6869217753 secs [03:12:33] PROBLEM - puppet141 NTP time on puppet141 is CRITICAL: NTP CRITICAL: Offset 0.6865665019 secs [03:12:50] PROBLEM - mw141 NTP time on mw141 is CRITICAL: NTP CRITICAL: Offset 0.6866242886 secs [03:13:33] RECOVERY - gluster102 Current Load on gluster102 is OK: OK - load average: 2.94, 4.37, 4.74 [03:14:05] PROBLEM - prometheus131 NTP time on prometheus131 is CRITICAL: NTP CRITICAL: Offset 0.6866024435 secs [03:16:12] PROBLEM - matomo131 NTP time on matomo131 is CRITICAL: NTP CRITICAL: Offset 0.686163187 secs [03:16:36] PROBLEM - swiftobject115 NTP time on swiftobject115 is CRITICAL: NTP CRITICAL: Offset 0.6859854758 secs [03:17:03] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.31, 3.91, 3.84 [03:19:03] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.15, 4.04, 3.90 [03:19:51] PROBLEM - mw132 NTP time on mw132 is CRITICAL: NTP CRITICAL: Offset 0.6851342022 secs [03:21:03] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.14, 3.33, 3.65 [03:23:04] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.01, 2.65, 3.37 [03:24:39] RECOVERY - swiftobject114 NTP time on swiftobject114 is OK: NTP OK: Offset -0.003364741802 secs [03:25:57] RECOVERY - mw132 NTP time on mw132 is OK: NTP OK: Offset -0.003301680088 secs [03:26:50] RECOVERY - mw141 NTP time on mw141 is OK: NTP OK: Offset -0.003613263369 secs [03:26:59] RECOVERY - puppet141 NTP time on puppet141 is OK: NTP OK: Offset -0.003299981356 secs [03:28:00] RECOVERY - prometheus131 NTP time on prometheus131 is OK: NTP OK: Offset -0.003289818764 secs [03:28:07] PROBLEM - cp23 APT on cp23 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [03:30:05] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 12.66, 7.54, 3.43 [03:30:34] RECOVERY - matomo131 NTP time on matomo131 is OK: NTP OK: Offset -0.003391563892 secs [03:31:05] RECOVERY - swiftobject115 NTP time on swiftobject115 is OK: NTP OK: Offset -0.003030270338 secs [03:34:26] RECOVERY - cp23 APT on cp23 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [03:42:04] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 1.06, 2.92, 3.95 [03:43:52] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 6.30, 4.93, 3.57 [03:46:04] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 0.18, 1.43, 3.10 [03:51:41] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.23, 3.69, 3.51 [03:53:38] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.89, 3.08, 3.31 [03:54:07] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.80, 1.70, 1.31 [03:58:07] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.75, 1.75, 1.41 [03:58:47] PROBLEM - cp23 APT on cp23 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [04:00:04] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 11.05, 5.02, 3.33 [04:00:07] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.30, 1.55, 1.37 [04:00:51] RECOVERY - cp23 APT on cp23 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [04:04:04] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 0.92, 3.31, 3.10 [04:04:07] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 1.60, 2.03, 1.63 [04:06:07] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.54, 1.84, 1.61 [04:08:07] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.57, 1.39, 1.47 [04:15:50] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 6.38, 6.14, 4.67 [04:17:48] RECOVERY - gluster102 Current Load on gluster102 is OK: OK - load average: 2.44, 4.75, 4.34 [04:58:47] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/deleteBatch.php --wiki=monstergirlencyclopediawiki --r=Requested at [[phab:T9754 [04:59:06] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:12:24] [02miraheze/ssl] 07Reception123 pushed 032 commits to 03master [+3/-0/±3] 13https://github.com/miraheze/ssl/compare/77bf2068ce6a...b0ab80fc4981 [05:12:24] [url] Comparing 77bf2068ce6a...b0ab80fc4981 · miraheze/ssl · GitHub | github.com [05:12:25] [02miraheze/ssl] 07Reception123 0382d07d3 - add en.pornwiki.org cert [05:12:27] [02miraheze/ssl] 07Reception123 03b0ab80f - add files.pornwiki.org cert [05:13:38] miraheze/ssl - Reception123 the build has errored. [05:16:23] [02miraheze/ssl] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/b0ab80fc4981...e38971bfdb19 [05:16:23] [url] Comparing b0ab80fc4981...e38971bfdb19 · miraheze/ssl · GitHub | github.com [05:16:24] [02miraheze/ssl] 07Reception123 03e38971b - syntax [05:17:28] miraheze/ssl - Reception123 the build has errored. [05:19:05] [02miraheze/ssl] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/e38971bfdb19...c89622286084 [05:19:06] [url] Comparing e38971bfdb19...c89622286084 · miraheze/ssl · GitHub | github.com [05:19:07] [02miraheze/ssl] 07Reception123 03c896222 - attempt fix [05:19:52] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.35, 4.03, 2.89 [05:20:11] miraheze/ssl - Reception123 the build has errored. [05:21:47] [02miraheze/ssl] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/c89622286084...1b2fd09d118b [05:21:48] [url] Comparing c89622286084...1b2fd09d118b · miraheze/ssl · GitHub | github.com [05:21:49] [02miraheze/ssl] 07Reception123 031b2fd09 - syntax (again) [05:21:49] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.41, 3.31, 2.76 [05:22:52] miraheze/ssl - Reception123 the build has errored. [05:23:35] PROBLEM - cp30 Puppet on cp30 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [05:23:53] [02miraheze/ssl] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/1b2fd09d118b...db37e586e241 [05:23:54] [url] Comparing 1b2fd09d118b...db37e586e241 · miraheze/ssl · GitHub | github.com [05:23:54] [02miraheze/ssl] 07Reception123 03db37e58 - Update certs.yaml [05:25:51] PROBLEM - mon141 Puppet on mon141 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [05:28:15] PROBLEM - cp23 Puppet on cp23 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [05:29:02] PROBLEM - test131 Puppet on test131 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [05:29:48] PROBLEM - cp22 Puppet on cp22 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [05:29:55] PROBLEM - mw132 Puppet on mw132 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [05:30:00] PROBLEM - mw141 Puppet on mw141 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [05:30:14] PROBLEM - mw122 Puppet on mw122 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [05:30:17] PROBLEM - mw131 Puppet on mw131 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [05:30:20] PROBLEM - mw121 Puppet on mw121 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [05:30:44] PROBLEM - mwtask141 Puppet on mwtask141 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [05:31:28] PROBLEM - mw142 Puppet on mw142 is CRITICAL: CRITICAL: Puppet has 2 failures. Last run 29 seconds ago with 2 failures. Failed resources (up to 3 shown): File[/etc/ssl/localcerts/www.pornwiki.org.crt],File[/etc/ssl/private/www.pornwiki.org.key] [05:31:32] PROBLEM - cp31 Puppet on cp31 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [05:35:01] PROBLEM - cp22 APT on cp22 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [05:36:35] PROBLEM - cp30 APT on cp30 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [05:37:06] PROBLEM - cp22 Current Load on cp22 is CRITICAL: CRITICAL - load average: 9.91, 4.92, 2.44 [05:38:07] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 3.35, 2.84, 1.79 [05:38:33] RECOVERY - cp30 APT on cp30 is OK: APT OK: 38 packages available for upgrade (0 critical updates). [05:39:08] RECOVERY - cp22 APT on cp22 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [05:42:12] PROBLEM - puppet141 Puppet on puppet141 is CRITICAL: CRITICAL: Puppet has 2 failures. Last run 2 minutes ago with 2 failures. Failed resources (up to 3 shown): File[/etc/ssl/localcerts/www.pornwiki.org.crt],File[/etc/ssl/private/www.pornwiki.org.key] [05:43:04] RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 0.48, 2.83, 2.50 [05:46:07] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.22, 1.96, 1.86 [05:48:16] [02miraheze/ssl] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/db37e586e241...d67b3ad3963c [05:48:17] [url] Comparing db37e586e241...d67b3ad3963c · miraheze/ssl · GitHub | github.com [05:48:17] [02miraheze/ssl] 07Reception123 03d67b3ad - final fix for pornwiki.org certs [05:50:07] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.87, 1.33, 1.62 [05:51:27] RECOVERY - mw142 Puppet on mw142 is OK: OK: Puppet is currently enabled, last run 32 seconds ago with 0 failures [05:51:47] PROBLEM - puppet141 Current Load on puppet141 is WARNING: WARNING - load average: 3.90, 2.90, 2.04 [05:51:55] RECOVERY - mw132 Puppet on mw132 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [05:52:09] RECOVERY - mw141 Puppet on mw141 is OK: OK: Puppet is currently enabled, last run 59 seconds ago with 0 failures [05:52:14] RECOVERY - mw122 Puppet on mw122 is OK: OK: Puppet is currently enabled, last run 51 seconds ago with 0 failures [05:52:20] RECOVERY - mw121 Puppet on mw121 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [05:52:21] RECOVERY - mw131 Puppet on mw131 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [05:52:44] RECOVERY - mwtask141 Puppet on mwtask141 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [05:55:29] RECOVERY - cp23 Puppet on cp23 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [05:55:54] RECOVERY - cp30 Puppet on cp30 is OK: OK: Puppet is currently enabled, last run 3 minutes ago with 0 failures [05:55:58] RECOVERY - mon141 Puppet on mon141 is OK: OK: Puppet is currently enabled, last run 38 seconds ago with 0 failures [05:56:05] RECOVERY - cp22 Puppet on cp22 is OK: OK: Puppet is currently enabled, last run 3 minutes ago with 0 failures [05:56:18] RECOVERY - puppet141 Current Load on puppet141 is OK: OK - load average: 1.81, 2.13, 1.92 [05:57:41] PROBLEM - cp22 NTP time on cp22 is WARNING: NTP WARNING: Offset 0.3156549037 secs [05:58:14] RECOVERY - test131 Puppet on test131 is OK: OK: Puppet is currently enabled, last run 44 seconds ago with 0 failures [06:07:36] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.11, 3.94, 2.92 [06:08:43] PROBLEM - test131 Current Load on test131 is CRITICAL: CRITICAL - load average: 2.20, 1.71, 1.38 [06:09:33] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.63, 3.52, 2.90 [06:10:49] RECOVERY - puppet141 Puppet on puppet141 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [06:11:32] RECOVERY - cp22 NTP time on cp22 is OK: NTP OK: Offset -0.0243062377 secs [06:11:33] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.04, 3.22, 2.87 [06:13:53] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 7.92, 6.31, 4.23 [06:15:48] RECOVERY - gluster102 Current Load on gluster102 is OK: OK - load average: 2.82, 4.79, 3.91 [06:21:33] RECOVERY - cp31 Puppet on cp31 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [06:26:14] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.30, 3.01, 2.71 [06:28:11] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.98, 2.62, 2.61 [06:29:38] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 1.92, 4.14, 2.49 [06:31:38] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 0.64, 2.93, 2.25 [06:33:55] [02miraheze/puppet] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/puppet/commit/558c84d7bc5d [06:33:56] [02miraheze/puppet] 07Universal-Omega 03558c84d - Completely remove blackbox from MediaWiki [06:33:58] [02puppet] 07Universal-Omega created branch 03Universal-Omega-patch-1 - 13https://github.com/miraheze/puppet [06:33:58] [url] Page not found · GitHub · GitHub | github.com [06:33:59] [02puppet] 07Universal-Omega opened pull request 03#2853: Completely remove blackbox from MediaWiki - 13https://github.com/miraheze/puppet/pull/2853 [06:34:00] [url] Page not found · GitHub · GitHub | github.com [06:34:45] [02miraheze/puppet] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/558c84d7bc5d...d507979362ca [06:34:46] [url] Comparing 558c84d7bc5d...d507979362ca · miraheze/puppet · GitHub | github.com [06:34:47] [02miraheze/puppet] 07Universal-Omega 03d507979 - Update prometheus.pp [06:34:48] [02puppet] 07Universal-Omega synchronize pull request 03#2853: Completely remove blackbox from MediaWiki - 13https://github.com/miraheze/puppet/pull/2853 [06:34:49] [url] Page not found · GitHub · GitHub | github.com [06:37:35] [02miraheze/puppet] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/4544b83852d2...e8e377916a36 [06:37:36] [url] Comparing 4544b83852d2...e8e377916a36 · miraheze/puppet · GitHub | github.com [06:37:37] [02miraheze/puppet] 07Universal-Omega 03e8e3779 - remove commented es121 [06:37:51] [02miraheze/puppet] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/e8e377916a36...59cf7e647b1c [06:37:52] [url] Comparing e8e377916a36...59cf7e647b1c · miraheze/puppet · GitHub | github.com [06:37:53] [02miraheze/puppet] 07Universal-Omega 0359cf7e6 - remove commented es121 [06:40:07] [02puppet] 07Universal-Omega closed pull request 03#2853: Completely remove blackbox from MediaWiki - 13https://github.com/miraheze/puppet/pull/2853 [06:40:08] [url] Page not found · GitHub · GitHub | github.com [06:40:09] [02miraheze/puppet] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±2] 13https://github.com/miraheze/puppet/compare/59cf7e647b1c...fe35715fe9df [06:40:09] [url] Comparing 59cf7e647b1c...fe35715fe9df · miraheze/puppet · GitHub | github.com [06:40:10] [02miraheze/puppet] 07Universal-Omega 03fe35715 - Completely remove blackbox from MediaWiki (#2853) [06:40:12] [02puppet] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 - 13https://github.com/miraheze/puppet [06:40:12] [url] Page not found · GitHub · GitHub | github.com [06:40:13] [02miraheze/puppet] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 [07:36:18] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 1.27, 1.44, 1.97 [07:44:18] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 1.06, 1.20, 1.64 [08:14:45] PROBLEM - cp23 NTP time on cp23 is WARNING: NTP WARNING: Offset 0.1161566079 secs [08:30:45] RECOVERY - cp23 NTP time on cp23 is OK: NTP OK: Offset 0.09636852145 secs [08:31:32] PROBLEM - cp22 NTP time on cp22 is WARNING: NTP WARNING: Offset 0.1199840605 secs [08:49:32] RECOVERY - cp22 NTP time on cp22 is OK: NTP OK: Offset 0.08275350928 secs [09:01:59] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.52, 4.67, 3.30 [09:03:55] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.20, 3.88, 3.16 [09:07:48] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.12, 3.07, 3.00 [09:27:33] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.76, 3.70, 2.89 [09:29:33] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 3.08, 3.36, 2.86 [09:41:23] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/deleteBatch.php --wiki=monstergirlencyclopediawiki --r=Requested at [[phab:T9754 [09:41:28] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [09:42:22] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 6.35, 4.19, 1.97 [09:44:20] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 1.05, 2.87, 1.75 [10:15:26] PROBLEM - cp22 APT on cp22 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [10:16:52] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/deleteBatch.php --wiki=monstergirlencyclopediawiki --r=Requested at [[phab:T9754 [10:16:57] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [10:17:28] RECOVERY - cp22 APT on cp22 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [10:17:39] PROBLEM - cp22 Current Load on cp22 is WARNING: WARNING - load average: 3.45, 2.80, 1.67 [10:19:39] RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 1.10, 2.25, 1.61 [10:45:39] PROBLEM - cp22 Current Load on cp22 is CRITICAL: CRITICAL - load average: 7.79, 4.05, 2.22 [10:45:49] PROBLEM - cp22 APT on cp22 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [10:48:29] PROBLEM - cp22 PowerDNS Recursor on cp22 is CRITICAL: CRITICAL - Plugin timed out while executing system call [10:52:37] RECOVERY - cp22 PowerDNS Recursor on cp22 is OK: DNS OK: 1.365 second response time. miraheze.org returns 109.228.51.216,217.174.247.33,2a00:da00:1800:326::1,2a00:da00:1800:328::1 [10:58:40] RECOVERY - cp22 APT on cp22 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [11:05:33] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 7.05, 4.10, 2.41 [11:07:33] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.32, 3.27, 2.30 [11:17:39] PROBLEM - cp22 Current Load on cp22 is WARNING: WARNING - load average: 0.52, 0.99, 3.68 [11:19:39] RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 0.85, 0.90, 3.31 [11:23:32] PROBLEM - cp22 NTP time on cp22 is WARNING: NTP WARNING: Offset 0.1056006849 secs [11:28:15] PROBLEM - roblox-wiki.tk - LetsEncrypt on sslhost is CRITICAL: connect to address roblox-wiki.tk and port 443: Network is unreachableHTTP CRITICAL - Unable to open TCP socket [11:29:03] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 1.78, 1.58, 1.30 [11:31:03] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 1.38, 1.51, 1.31 [11:39:32] RECOVERY - cp22 NTP time on cp22 is OK: NTP OK: Offset -0.02285405993 secs [11:46:23] PROBLEM - wiki.evscope.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.evscope.org' expires in 15 day(s) (Fri 07 Oct 2022 11:21:52 GMT +0000). [11:48:27] PROBLEM - legacygt.wiki - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'legacygt.wiki' expires in 15 day(s) (Fri 07 Oct 2022 11:41:33 GMT +0000). [11:48:32] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/d67b3ad3963c...7487ddba71ef [11:48:33] [url] Comparing d67b3ad3963c...7487ddba71ef · miraheze/ssl · GitHub | github.com [11:48:34] [02miraheze/ssl] 07MirahezeSSLBot 037487ddb - Bot: Update SSL cert for wiki.evscope.org [11:49:18] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/7487ddba71ef...d3e094ab0a90 [11:49:18] [url] Comparing 7487ddba71ef...d3e094ab0a90 · miraheze/ssl · GitHub | github.com [11:49:19] [02miraheze/ssl] 07MirahezeSSLBot 03d3e094a - Bot: Update SSL cert for legacygt.wiki [11:51:34] PROBLEM - wikicompliance.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wikicompliance.com' expires in 15 day(s) (Fri 07 Oct 2022 11:39:30 GMT +0000). [11:52:10] PROBLEM - mariopedia.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'mariopedia.org' expires in 15 day(s) (Fri 07 Oct 2022 11:49:47 GMT +0000). [11:55:54] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/d3e094ab0a90...fd9ea1f59c01 [11:55:55] [url] Comparing d3e094ab0a90...fd9ea1f59c01 · miraheze/ssl · GitHub | github.com [11:55:56] [02miraheze/ssl] 07MirahezeSSLBot 03fd9ea1f - Bot: Update SSL cert for wikicompliance.com [11:57:54] PROBLEM - lgbtqia.wiki - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'www.lgbtqia.wiki' expires in 15 day(s) (Fri 07 Oct 2022 11:35:52 GMT +0000). [11:58:01] RECOVERY - roblox-wiki.tk - LetsEncrypt on sslhost is OK: OK - Certificate 'roblox-wiki.tk' will expire on Thu 27 Oct 2022 15:10:45 GMT +0000. [11:58:40] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/fd9ea1f59c01...ad62dcd232b6 [11:58:41] [url] Comparing fd9ea1f59c01...ad62dcd232b6 · miraheze/ssl · GitHub | github.com [11:58:42] [02miraheze/ssl] 07MirahezeSSLBot 03ad62dcd - Bot: Update SSL cert for mariopedia.org [11:58:54] PROBLEM - test131 Current Load on test131 is CRITICAL: CRITICAL - load average: 2.19, 1.75, 1.42 [12:00:53] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 1.51, 1.62, 1.41 [12:06:33] PROBLEM - www.lgbtqia.wiki - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'www.lgbtqia.wiki' expires in 15 day(s) (Fri 07 Oct 2022 11:35:52 GMT +0000). [12:08:25] PROBLEM - dragdown.wiki - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'dragdown.wiki' expires in 15 day(s) (Fri 07 Oct 2022 12:05:00 GMT +0000). [12:14:32] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/ad62dcd232b6...1257fceee7be [12:14:33] [url] Comparing ad62dcd232b6...1257fceee7be · miraheze/ssl · GitHub | github.com [12:14:34] [02miraheze/ssl] 07MirahezeSSLBot 031257fce - Bot: Update SSL cert for www.lgbtqia.wiki [12:15:50] RECOVERY - wiki.evscope.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.evscope.org' will expire on Tue 20 Dec 2022 10:48:26 GMT +0000. [12:17:13] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/1257fceee7be...8efd9a0d21db [12:17:14] [url] Comparing 1257fceee7be...8efd9a0d21db · miraheze/ssl · GitHub | github.com [12:17:15] [02miraheze/ssl] 07MirahezeSSLBot 038efd9a0 - Bot: Update SSL cert for dragdown.wiki [12:29:44] PROBLEM - test131 Current Load on test131 is CRITICAL: CRITICAL - load average: 2.35, 2.09, 1.74 [12:31:43] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 1.59, 1.89, 1.71 [12:33:42] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 1.10, 1.59, 1.61 [12:46:04] RECOVERY - legacygt.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'legacygt.wiki' will expire on Tue 20 Dec 2022 10:49:12 GMT +0000. [12:47:32] PROBLEM - cp22 NTP time on cp22 is WARNING: NTP WARNING: Offset 0.2553780973 secs [12:50:30] RECOVERY - wikicompliance.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wikicompliance.com' will expire on Tue 20 Dec 2022 10:55:48 GMT +0000. [12:50:43] RECOVERY - mariopedia.org - LetsEncrypt on sslhost is OK: OK - Certificate 'mariopedia.org' will expire on Tue 20 Dec 2022 10:58:35 GMT +0000. [12:51:32] RECOVERY - cp22 NTP time on cp22 is OK: NTP OK: Offset -0.02524611354 secs [12:55:54] RECOVERY - lgbtqia.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'www.lgbtqia.wiki' will expire on Tue 20 Dec 2022 11:14:25 GMT +0000. [12:59:34] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 1.85, 1.63, 1.46 [13:01:34] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 1.41, 1.54, 1.45 [13:04:08] RECOVERY - www.lgbtqia.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'www.lgbtqia.wiki' will expire on Tue 20 Dec 2022 11:14:25 GMT +0000. [13:08:00] RECOVERY - dragdown.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'dragdown.wiki' will expire on Tue 20 Dec 2022 11:17:07 GMT +0000. [13:21:24] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 8.19, 5.18, 3.47 [13:22:43] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 8.51, 6.24, 3.84 [13:22:55] [02miraheze/puppet] 07paladox pushed 031 commit to 03add-swift [+15/-0/±0] 13https://github.com/miraheze/puppet/commit/dc2cf5ece7bd [13:22:55] [url] Page not found · GitHub · GitHub | github.com [13:22:56] [02miraheze/puppet] 07paladox 03dc2cf5e - Add swift module [13:22:58] [02puppet] 07paladox created branch 03add-swift - 13https://github.com/miraheze/puppet [13:22:58] [url] Page not found · GitHub · GitHub | github.com [13:23:04] [02puppet] 07paladox opened pull request 03#2854: Add swift module - 13https://github.com/miraheze/puppet/pull/2854 [13:23:05] [url] Page not found · GitHub · GitHub | github.com [13:23:21] [02puppet] 07paladox commented on pull request 03#2854: Add swift module - 13https://github.com/miraheze/puppet/pull/2854#issuecomment-1253705559 [13:23:21] [url] Add swift module by paladox · Pull Request #2854 · miraheze/puppet · GitHub | github.com [13:28:43] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 3.18, 5.24, 4.26 [13:29:25] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 1.86, 1.72, 1.39 [13:29:38] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 4.66, 2.97, 1.83 [13:31:24] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 1.21, 1.57, 1.38 [13:31:38] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.27, 2.28, 1.72 [13:32:00] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/deleteBatch.php --wiki=monstergirlencyclopediawiki --r=Requested at [[phab:T9754 [13:32:07] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [13:34:43] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 11.86, 7.68, 5.49 [13:40:43] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 4.19, 5.67, 5.47 [13:44:43] RECOVERY - gluster102 Current Load on gluster102 is OK: OK - load average: 2.91, 4.30, 4.97 [13:50:43] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 6.71, 5.10, 4.96 [13:52:43] RECOVERY - gluster102 Current Load on gluster102 is OK: OK - load average: 2.32, 3.89, 4.53 [13:52:43] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.84, 1.50, 1.20 [13:54:43] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.61, 1.45, 1.21 [13:56:22] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.01, 2.83, 3.77 [14:02:11] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.87, 4.19, 4.02 [14:09:12] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 1.83, 1.62, 1.40 [14:11:12] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 1.60, 1.64, 1.44 [14:17:43] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.55, 3.43, 3.90 [14:21:12] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.14, 1.69, 1.50 [14:23:07] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.43, 1.65, 1.52 [14:23:33] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.50, 3.64, 3.81 [14:25:17] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.60, 1.79, 1.39 [14:25:33] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.52, 3.32, 3.68 [14:27:13] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.13, 1.56, 1.35 [14:27:33] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.81, 4.73, 4.18 [14:28:43] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 11.42, 5.94, 4.32 [14:28:54] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.62, 3.12, 2.22 [14:32:43] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 4.16, 5.73, 4.70 [14:34:03] PROBLEM - test131 Disk Space on test131 is CRITICAL: DISK CRITICAL - free space: / 1136 MB (5% inode=67%); [14:34:43] RECOVERY - gluster102 Current Load on gluster102 is OK: OK - load average: 2.65, 4.55, 4.39 [14:34:43] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 0.81, 1.77, 1.92 [14:38:53] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/deleteBatch.php --wiki=monstergirlencyclopediawiki --r=Requested at [[phab:T9754 [14:38:59] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:40:43] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.10, 1.39, 1.69 [14:46:44] PROBLEM - commonwealth.0um.io - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for commonwealth.0um.io could not be found [14:49:45] PROBLEM - commonwealth.0um.io - LetsEncrypt on sslhost is CRITICAL: connect to address commonwealth.0um.io and port 443: Network is unreachableHTTP CRITICAL - Unable to open TCP socket [14:58:57] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 1.84, 1.64, 1.45 [15:00:56] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 1.70, 1.64, 1.47 [15:01:27] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 8.36, 5.91, 4.74 [15:07:11] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 2.63, 5.22, 4.96 [15:09:06] RECOVERY - gluster102 Current Load on gluster102 is OK: OK - load average: 2.56, 4.47, 4.72 [15:12:48] PROBLEM - roblox-wiki.tk - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - roblox-wiki.tk All nameservers failed to answer the query. [15:15:39] PROBLEM - cp22 Current Load on cp22 is CRITICAL: CRITICAL - load average: 4.88, 2.85, 1.67 [15:17:39] RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 2.16, 2.36, 1.63 [15:26:43] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 13.23, 7.99, 5.59 [15:28:47] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 1.92, 1.57, 1.39 [15:30:47] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 1.49, 1.55, 1.41 [15:41:35] RECOVERY - roblox-wiki.tk - reverse DNS on sslhost is OK: SSL OK - roblox-wiki.tk reverse DNS resolves to cp23.miraheze.org - NS RECORDS OK [15:48:43] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 2.43, 4.44, 5.73 [15:52:57] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.68, 3.36, 2.62 [15:53:07] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.07, 1.84, 1.49 [15:54:39] PROBLEM - test131 Current Load on test131 is CRITICAL: CRITICAL - load average: 2.08, 1.75, 1.52 [15:54:57] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 1.85, 2.72, 2.47 [15:55:02] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.53, 1.73, 1.48 [15:56:43] RECOVERY - gluster102 Current Load on gluster102 is OK: OK - load average: 3.21, 3.78, 4.93 [15:56:57] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.44, 1.68, 1.50 [15:58:57] PROBLEM - cp23 APT on cp23 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [16:00:55] RECOVERY - cp23 APT on cp23 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [16:02:37] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 1.24, 1.81, 1.73 [16:04:36] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 1.18, 1.58, 1.65 [16:06:43] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.19, 1.84, 1.60 [16:07:33] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.04, 3.48, 3.97 [16:08:43] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.55, 1.77, 1.60 [16:10:43] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.29, 1.62, 1.57 [16:12:47] PROBLEM - roblox-wiki.tk - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - roblox-wiki.tk All nameservers failed to answer the query. [16:13:33] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.81, 3.39, 3.66 [16:14:43] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.60, 1.83, 1.68 [16:16:43] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.27, 1.62, 1.61 [16:20:43] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 1.86, 2.03, 1.84 [16:25:22] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 7.38, 5.25, 4.41 [16:27:21] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 4.09, 2.00, 1.48 [16:30:43] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.19, 1.92, 1.98 [16:31:13] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.46, 1.84, 1.54 [16:36:50] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 3.89, 5.98, 5.80 [16:37:01] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.27, 1.56, 1.51 [16:38:43] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.01, 1.33, 1.67 [16:40:43] RECOVERY - gluster102 Current Load on gluster102 is OK: OK - load average: 2.40, 4.07, 5.05 [16:41:35] RECOVERY - roblox-wiki.tk - reverse DNS on sslhost is OK: SSL OK - roblox-wiki.tk reverse DNS resolves to cp23.miraheze.org - NS RECORDS OK [16:50:43] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 7.09, 5.29, 5.00 [16:52:43] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 5.48, 5.90, 5.31 [16:56:43] RECOVERY - gluster102 Current Load on gluster102 is OK: OK - load average: 2.57, 4.48, 4.92 [17:02:44] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.75, 1.55, 1.46 [17:04:43] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.30, 1.81, 1.56 [17:05:33] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 1.19, 2.36, 3.96 [17:06:43] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.24, 1.61, 1.52 [17:09:33] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.28, 2.73, 3.69 [17:11:33] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.32, 2.73, 3.56 [17:15:33] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.65, 2.41, 3.25 [17:18:34] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.04, 1.44, 1.22 [17:22:43] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.90, 1.75, 1.56 [17:24:32] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.15, 1.71, 1.46 [17:24:44] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.26, 1.59, 1.52 [17:25:24] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 3.77, 4.09, 3.74 [17:26:32] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.39, 1.61, 1.45 [17:27:21] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.33, 3.34, 3.50 [17:29:17] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.48, 2.69, 3.24 [17:30:32] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.96, 1.82, 1.55 [17:32:32] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.73, 1.43, 1.44 [17:37:06] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.97, 3.60, 3.35 [17:39:02] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.77, 3.18, 3.21 [17:39:21] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 3.26, 2.03, 1.67 [17:41:05] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 1.90, 1.67, 1.48 [17:42:42] PROBLEM - puppet141 Puppet on puppet141 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Package[postgresql-contrib-13] [17:43:05] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 1.55, 1.64, 1.49 [17:43:11] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.25, 1.65, 1.60 [17:44:54] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.07, 3.93, 3.46 [17:46:51] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.59, 3.33, 3.29 [17:50:53] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.18, 1.73, 1.59 [18:03:33] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.14, 3.54, 3.31 [18:05:33] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.84, 3.20, 3.21 [18:06:43] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.53, 1.71, 1.93 [18:08:56] PROBLEM - test131 Current Load on test131 is CRITICAL: CRITICAL - load average: 2.54, 2.03, 1.66 [18:09:33] RECOVERY - puppet141 Puppet on puppet141 is OK: OK: Puppet is currently enabled, last run 54 seconds ago with 0 failures [18:12:20] [02miraheze/puppet] 07paladox pushed 031 commit to 03add-swift [+16/-0/±0] 13https://github.com/miraheze/puppet/compare/dc2cf5ece7bd...d827b9830a2f [18:12:21] [url] Comparing dc2cf5ece7bd...d827b9830a2f · miraheze/puppet · GitHub | github.com [18:12:22] [02miraheze/puppet] 07paladox 03d827b98 - Add swift module [18:12:23] [02puppet] 07paladox synchronize pull request 03#2854: Add swift module - 13https://github.com/miraheze/puppet/pull/2854 [18:12:24] [url] Page not found · GitHub · GitHub | github.com [18:12:43] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.41, 1.36, 1.67 [18:13:21] [02miraheze/puppet] 07paladox pushed 031 commit to 03add-swift [+15/-0/±0] 13https://github.com/miraheze/puppet/compare/d827b9830a2f...68b942da8265 [18:13:21] [url] Comparing d827b9830a2f...68b942da8265 · miraheze/puppet · GitHub | github.com [18:13:22] [02miraheze/puppet] 07paladox 0368b942d - Add swift module [18:13:24] [02puppet] 07paladox synchronize pull request 03#2854: Add swift module - 13https://github.com/miraheze/puppet/pull/2854 [18:13:24] [url] Page not found · GitHub · GitHub | github.com [18:21:33] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.26, 4.52, 3.54 [18:23:35] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.06, 2.14, 1.82 [18:25:30] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.38, 1.87, 1.76 [18:27:25] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.91, 1.55, 1.66 [18:29:43] PROBLEM - cp23 APT on cp23 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [18:31:38] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 6.30, 4.14, 2.27 [18:31:42] RECOVERY - cp23 APT on cp23 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [18:33:38] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.04, 2.85, 2.02 [18:40:44] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 9.19, 6.94, 4.62 [18:47:37] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 1.67, 2.30, 1.85 [18:49:32] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.31, 1.83, 1.72 [18:50:52] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 3.47, 2.29, 1.69 [18:53:22] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.02, 2.06, 1.84 [18:54:44] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.36, 1.86, 1.64 [18:58:36] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.73, 2.35, 1.88 [18:59:24] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.60, 2.70, 2.35 [19:01:03] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.22, 1.85, 1.87 [19:01:21] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 1.77, 2.31, 2.25 [19:02:32] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.26, 2.00, 1.85 [19:04:32] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.80, 1.55, 1.70 [19:06:49] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.07, 1.45, 1.70 [19:09:07] [02puppet] 07Universal-Omega reviewed pull request 03#2854 commit - 13https://github.com/miraheze/puppet/pull/2854#discussion_r976896156 [19:09:08] [url] Add swift module by paladox · Pull Request #2854 · miraheze/puppet · GitHub | github.com [19:12:32] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.70, 1.99, 1.83 [19:12:48] PROBLEM - roblox-wiki.tk - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - roblox-wiki.tk All nameservers failed to answer the query. [19:14:32] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.77, 2.12, 1.88 [19:18:32] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.67, 1.91, 1.85 [19:18:44] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.91, 1.77, 1.66 [19:20:32] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.37, 2.22, 1.99 [19:20:43] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 6.71, 2.92, 2.06 [19:22:32] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.31, 1.93, 1.92 [19:26:44] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.55, 1.91, 1.87 [19:30:32] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.97, 1.24, 1.60 [19:30:43] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.77, 1.30, 1.63 [19:34:43] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.30, 2.07, 1.88 [19:36:30] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 1.02, 1.35, 1.90 [19:38:43] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.65, 1.87, 1.84 [19:40:29] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 0.81, 1.14, 1.69 [19:41:35] RECOVERY - roblox-wiki.tk - reverse DNS on sslhost is OK: SSL OK - roblox-wiki.tk reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [19:42:44] PROBLEM - cp31 Stunnel HTTP for mwtask141 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:42:48] PROBLEM - mwtask141 JobRunner Service on mwtask141 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [19:42:53] PROBLEM - mwtask141 SSH on mwtask141 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:43:12] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 29.25, 14.91, 6.37 [19:43:15] PROBLEM - cp30 Stunnel HTTP for mwtask141 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:43:27] PROBLEM - mwtask141 MediaWiki Rendering on mwtask141 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:43:55] PROBLEM - cp22 Stunnel HTTP for mwtask141 on cp22 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:43:57] PROBLEM - mwtask141 Check Gluster Clients on mwtask141 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [19:43:58] PROBLEM - mwtask141 APT on mwtask141 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [19:44:08] PROBLEM - mwtask141 PowerDNS Recursor on mwtask141 is CRITICAL: CRITICAL - Plugin timed out while executing system call [19:44:47] PROBLEM - mwtask141 conntrack_table_size on mwtask141 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [19:44:56] RECOVERY - mwtask141 JobRunner Service on mwtask141 is OK: PROCS OK: 1 process with args 'redisJobRunnerService' [19:45:11] PROBLEM - cp23 Stunnel HTTP for mwtask141 on cp23 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:45:21] PROBLEM - mwtask141 NTP time on mwtask141 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:45:34] PROBLEM - cp22 APT on cp22 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [19:45:39] PROBLEM - cp22 Current Load on cp22 is CRITICAL: CRITICAL - load average: 8.63, 4.12, 2.07 [19:45:55] PROBLEM - mwtask141 Puppet on mwtask141 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [19:46:08] PROBLEM - mwtask141 ferm_active on mwtask141 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [19:49:26] PROBLEM - mwtask141 HTTPS on mwtask141 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:49:56] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/deleteBatch.php --wiki=monstergirlencyclopediawiki --r=Requested at [[phab:T9754 [19:49:57] RECOVERY - mwtask141 conntrack_table_size on mwtask141 is OK: OK: nf_conntrack is 0 % full [19:50:03] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:50:10] RECOVERY - mwtask141 NTP time on mwtask141 is OK: NTP OK: Offset -0.01605296135 secs [19:50:10] RECOVERY - cp22 Stunnel HTTP for mwtask141 on cp22 is OK: HTTP OK: HTTP/1.1 204 No Content - 356 bytes in 0.062 second response time [19:50:44] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.20, 1.76, 1.76 [19:51:08] RECOVERY - mwtask141 Puppet on mwtask141 is OK: OK: Puppet is currently enabled, last run 40 minutes ago with 0 failures [19:51:12] RECOVERY - mwtask141 SSH on mwtask141 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [19:51:14] RECOVERY - cp31 Stunnel HTTP for mwtask141 on cp31 is OK: HTTP OK: HTTP/1.1 204 No Content - 356 bytes in 0.274 second response time [19:51:15] RECOVERY - mwtask141 Check Gluster Clients on mwtask141 is OK: PROCS OK: 1 process with args '/usr/sbin/glusterfs' [19:51:15] RECOVERY - cp23 Stunnel HTTP for mwtask141 on cp23 is OK: HTTP OK: HTTP/1.1 204 No Content - 356 bytes in 0.028 second response time [19:51:24] RECOVERY - mwtask141 HTTPS on mwtask141 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 553 bytes in 0.011 second response time [19:51:26] RECOVERY - mwtask141 PowerDNS Recursor on mwtask141 is OK: DNS OK: 0.073 seconds response time. miraheze.org returns 109.228.51.216,217.174.247.33,2a00:da00:1800:326::1,2a00:da00:1800:328::1 [19:51:30] RECOVERY - mwtask141 APT on mwtask141 is OK: APT OK: 46 packages available for upgrade (0 critical updates). [19:51:34] RECOVERY - mwtask141 ferm_active on mwtask141 is OK: OK ferm input default policy is set [19:51:37] RECOVERY - mwtask141 MediaWiki Rendering on mwtask141 is OK: HTTP OK: HTTP/1.1 200 OK - 30911 bytes in 0.450 second response time [19:51:40] RECOVERY - cp30 Stunnel HTTP for mwtask141 on cp30 is OK: HTTP OK: HTTP/1.1 204 No Content - 356 bytes in 0.248 second response time [19:51:52] RECOVERY - cp22 APT on cp22 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [19:52:43] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.99, 1.89, 1.81 [19:53:39] PROBLEM - cp22 Current Load on cp22 is WARNING: WARNING - load average: 1.48, 3.48, 2.92 [19:55:39] RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 0.66, 2.47, 2.61 [19:58:23] PROBLEM - test131 Current Load on test131 is CRITICAL: CRITICAL - load average: 2.20, 1.65, 1.55 [19:58:43] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.42, 1.57, 1.69 [19:59:31] PROBLEM - cp23 APT on cp23 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [20:00:23] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 1.43, 1.54, 1.52 [20:01:30] RECOVERY - cp23 APT on cp23 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [20:01:39] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 12.40, 6.91, 3.30 [20:02:08] [02miraheze/puppet] 07paladox pushed 031 commit to 03add-swift [+41/-0/±0] 13https://github.com/miraheze/puppet/compare/68b942da8265...33b412cf7262 [20:02:09] [url] Comparing 68b942da8265...33b412cf7262 · miraheze/puppet · GitHub | github.com [20:02:10] [02miraheze/puppet] 07paladox 0333b412c - Add swift module [20:02:11] [02puppet] 07paladox synchronize pull request 03#2854: Add swift module - 13https://github.com/miraheze/puppet/pull/2854 [20:02:12] [url] Page not found · GitHub · GitHub | github.com [20:04:18] [02miraheze/puppet] 07paladox pushed 031 commit to 03add-swift [+40/-0/±0] 13https://github.com/miraheze/puppet/compare/33b412cf7262...041f330aa91a [20:04:19] [url] Comparing 33b412cf7262...041f330aa91a · miraheze/puppet · GitHub | github.com [20:04:19] [02miraheze/puppet] 07paladox 03041f330 - Add swift module [20:04:21] [02puppet] 07paladox synchronize pull request 03#2854: Add swift module - 13https://github.com/miraheze/puppet/pull/2854 [20:04:22] [url] Page not found · GitHub · GitHub | github.com [20:05:38] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 1.10, 3.55, 2.73 [20:05:42] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.84, 2.04, 1.69 [20:07:38] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 0.43, 2.47, 2.43 [20:07:38] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.44, 1.67, 1.59 [20:08:12] [02miraheze/puppet] 07paladox pushed 031 commit to 03add-swift [+46/-0/±1] 13https://github.com/miraheze/puppet/compare/041f330aa91a...fd70d2719a48 [20:08:13] [url] Comparing 041f330aa91a...fd70d2719a48 · miraheze/puppet · GitHub | github.com [20:08:13] [02miraheze/puppet] 07paladox 03fd70d27 - Add swift module [20:08:15] [02puppet] 07paladox synchronize pull request 03#2854: Add swift module - 13https://github.com/miraheze/puppet/pull/2854 [20:08:16] [url] Page not found · GitHub · GitHub | github.com [20:14:50] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 0.13, 0.61, 3.89 [20:18:47] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 0.28, 0.40, 3.06 [20:22:44] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 3.21, 1.90, 1.57 [20:28:07] [02puppet] 07Universal-Omega reviewed pull request 03#2854 commit - 13https://github.com/miraheze/puppet/pull/2854#discussion_r976956839 [20:28:08] [url] Add swift module by paladox · Pull Request #2854 · miraheze/puppet · GitHub | github.com [20:28:43] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.30, 1.71, 1.64 [20:29:52] [02miraheze/puppet] 07paladox pushed 031 commit to 03add-swift [+46/-0/±1] 13https://github.com/miraheze/puppet/compare/fd70d2719a48...4465b881837c [20:29:53] [url] Comparing fd70d2719a48...4465b881837c · miraheze/puppet · GitHub | github.com [20:29:54] [02miraheze/puppet] 07paladox 034465b88 - Add swift module [20:29:55] [02puppet] 07paladox synchronize pull request 03#2854: Add swift module - 13https://github.com/miraheze/puppet/pull/2854 [20:29:56] [url] Page not found · GitHub · GitHub | github.com [20:30:43] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.42, 1.62, 1.62 [20:36:44] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.83, 1.69, 1.64 [20:38:43] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.39, 1.53, 1.58 [20:42:18] PROBLEM - swiftac111 Puppet on swiftac111 is WARNING: WARNING: Puppet is currently disabled, message: paladox, last run 19 minutes ago with 0 failures [20:42:33] PROBLEM - swiftobject111 Puppet on swiftobject111 is WARNING: WARNING: Puppet is currently disabled, message: paladox, last run 8 minutes ago with 0 failures [20:42:35] PROBLEM - swiftobject114 Puppet on swiftobject114 is WARNING: WARNING: Puppet is currently disabled, message: paladox, last run 24 minutes ago with 0 failures [20:42:41] PROBLEM - swiftobject113 Puppet on swiftobject113 is WARNING: WARNING: Puppet is currently disabled, message: paladox, last run 29 minutes ago with 0 failures [20:43:10] PROBLEM - swiftobject112 Puppet on swiftobject112 is WARNING: WARNING: Puppet is currently disabled, message: paladox, last run 28 minutes ago with 0 failures [20:43:44] PROBLEM - swiftobject115 Puppet on swiftobject115 is WARNING: WARNING: Puppet is currently disabled, message: paladox, last run 14 minutes ago with 0 failures [20:44:06] PROBLEM - cp22 APT on cp22 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [20:45:18] PROBLEM - swiftproxy111 Puppet on swiftproxy111 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [20:45:39] PROBLEM - cp22 Current Load on cp22 is CRITICAL: CRITICAL - load average: 5.06, 3.61, 1.99 [20:46:09] RECOVERY - cp22 APT on cp22 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [20:46:43] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.30, 1.80, 1.62 [20:47:39] RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 1.48, 2.87, 1.93 [20:48:43] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.43, 1.67, 1.60 [20:49:05] [02miraheze/dns] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://github.com/miraheze/dns/commit/e5b99ff20118 [20:49:07] [02miraheze/dns] 07paladox 03e5b99ff - Add swift-lb [20:49:08] [02dns] 07paladox created branch 03paladox-patch-1 - 13https://github.com/miraheze/dns [20:49:09] [url] Page not found · GitHub · GitHub | github.com [20:49:10] [02dns] 07paladox opened pull request 03#358: Add swift-lb - 13https://github.com/miraheze/dns/pull/358 [20:49:11] [url] Page not found · GitHub · GitHub | github.com [20:49:48] [02miraheze/dns] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://github.com/miraheze/dns/compare/e5b99ff20118...d13d703cab07 [20:49:49] [url] Comparing e5b99ff20118...d13d703cab07 · miraheze/dns · GitHub | github.com [20:49:49] [02miraheze/dns] 07paladox 03d13d703 - Update miraheze.org [20:49:51] [02dns] 07paladox synchronize pull request 03#358: Add swift-lb - 13https://github.com/miraheze/dns/pull/358 [20:49:51] [url] Page not found · GitHub · GitHub | github.com [20:49:58] [02miraheze/dns] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://github.com/miraheze/dns/compare/d13d703cab07...78fc15d20568 [20:49:59] [url] Comparing d13d703cab07...78fc15d20568 · miraheze/dns · GitHub | github.com [20:49:59] [02miraheze/dns] 07paladox 0378fc15d - Update config [20:50:01] [02dns] 07paladox synchronize pull request 03#358: Add swift-lb - 13https://github.com/miraheze/dns/pull/358 [20:50:01] [url] Page not found · GitHub · GitHub | github.com [20:50:10] [02dns] 07paladox closed pull request 03#358: Add swift-lb - 13https://github.com/miraheze/dns/pull/358 [20:50:10] ... [20:50:11] [02miraheze/dns] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/dns/compare/67d19a6a545e...43b47c7d7d96 [20:50:12] [url] Comparing 67d19a6a545e...43b47c7d7d96 · miraheze/dns · GitHub | github.com [20:50:13] [02miraheze/dns] 07paladox 0343b47c7 - Add swift-lb (#358) [20:50:14] [02miraheze/dns] 07paladox deleted branch 03paladox-patch-1 [20:50:16] [02dns] 07paladox deleted branch 03paladox-patch-1 - 13https://github.com/miraheze/dns [20:50:16] [url] Page not found · GitHub · GitHub | github.com [20:51:11] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.42, 1.74, 1.42 [20:54:57] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.97, 1.35, 1.33 [20:55:57] PROBLEM - swiftproxy111 memcached on swiftproxy111 is CRITICAL: connect to address 2a10:6740::6:201 and port 11211: Connection refused [20:56:24] PROBLEM - swiftproxy111 HTTPS on swiftproxy111 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:57:41] PROBLEM - ns1 Puppet on ns1 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[gdnsd-syntax] [20:59:16] PROBLEM - test131 Current Load on test131 is CRITICAL: CRITICAL - load average: 2.08, 1.69, 1.47 [21:00:36] paladox: ^ dns syntax? [21:01:10] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 1.12, 1.48, 1.42 [21:01:27] [02miraheze/dns] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/dns/compare/43b47c7d7d96...9e78f712b2c3 [21:01:28] [url] Comparing 43b47c7d7d96...9e78f712b2c3 · miraheze/dns · GitHub | github.com [21:01:29] [02miraheze/dns] 07paladox 039e78f71 - Fix [21:03:19] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.01, 1.80, 1.65 [21:04:03] [02miraheze/dns] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/dns/compare/9e78f712b2c3...eea44ac70e6e [21:04:04] [url] Comparing 9e78f712b2c3...eea44ac70e6e · miraheze/dns · GitHub | github.com [21:04:05] [02miraheze/dns] 07paladox 03eea44ac - Update cache [21:05:20] RECOVERY - ns1 Puppet on ns1 is OK: OK: Puppet is currently enabled, last run 29 seconds ago with 0 failures [21:07:08] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.24, 1.83, 1.74 [21:09:03] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.30, 1.65, 1.68 [21:15:45] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.89, 1.87, 1.77 [21:17:39] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.32, 1.96, 1.81 [21:25:18] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 0.85, 1.59, 1.77 [21:27:13] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.23, 1.79, 1.81 [21:28:39] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 1.82, 1.59, 1.39 [21:30:33] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 1.52, 1.56, 1.39 [21:31:02] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.79, 1.81, 1.82 [21:34:51] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.24, 1.53, 1.70 [21:38:41] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 4.31, 3.06, 2.27 [21:41:53] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.83, 1.40, 1.22 [21:45:48] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.53, 1.58, 1.35 [21:46:20] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.14, 1.79, 1.97 [21:48:15] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.32, 1.80, 1.94 [21:49:41] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 4.23, 2.76, 1.85 [21:55:34] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 0.67, 1.77, 1.77 [21:57:31] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.04, 1.59, 1.70 [21:58:06] PROBLEM - test131 NTP time on test131 is WARNING: NTP WARNING: Offset 0.142306149 secs [22:02:07] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.22, 1.66, 1.93 [22:10:07] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.35, 1.68, 1.80 [22:12:07] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.44, 1.59, 1.75 [22:14:07] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.48, 1.48, 1.69 [22:17:03] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.11, 1.78, 1.65 [22:18:07] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.34, 2.10, 1.92 [22:19:53] PROBLEM - db131 NTP time on db131 is WARNING: NTP WARNING: Offset 0.1578927636 secs [22:20:07] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.86, 1.90, 1.86 [22:20:58] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.33, 1.72, 1.67 [22:22:07] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.08, 2.00, 1.91 [22:22:56] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.72, 2.03, 1.78 [22:24:07] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.84, 1.94, 1.89 [22:24:53] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.92, 1.58, 1.65 [22:30:07] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.98, 1.91, 1.84 [22:32:07] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.01, 1.47, 1.68 [22:34:27] PROBLEM - bast121 NTP time on bast121 is WARNING: NTP WARNING: Offset 0.2225926518 secs [22:50:12] RECOVERY - db131 NTP time on db131 is OK: NTP OK: Offset -0.02075242996 secs [22:54:27] RECOVERY - bast121 NTP time on bast121 is OK: NTP OK: Offset 0.03281381726 secs [22:55:53] [02miraheze/puppet] 07paladox pushed 031 commit to 03add-swift [+46/-0/±1] 13https://github.com/miraheze/puppet/compare/4465b881837c...92a767161b0a [22:55:54] [url] Comparing 4465b881837c...92a767161b0a · miraheze/puppet · GitHub | github.com [22:55:54] [02miraheze/puppet] 07paladox 0392a7671 - Add swift module [22:55:56] [02puppet] 07paladox synchronize pull request 03#2854: Add swift module - 13https://github.com/miraheze/puppet/pull/2854 [22:55:57] [url] Page not found · GitHub · GitHub | github.com [22:57:19] [02miraheze/puppet] 07paladox pushed 031 commit to 03add-swift [+46/-0/±1] 13https://github.com/miraheze/puppet/compare/92a767161b0a...2392fb262d69 [22:57:20] [url] Comparing 92a767161b0a...2392fb262d69 · miraheze/puppet · GitHub | github.com [22:57:20] [02miraheze/puppet] 07paladox 032392fb2 - Add swift module [22:57:22] [02puppet] 07paladox synchronize pull request 03#2854: Add swift module - 13https://github.com/miraheze/puppet/pull/2854 [22:57:22] [url] Page not found · GitHub · GitHub | github.com [22:59:37] RECOVERY - swiftproxy111 Puppet on swiftproxy111 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [23:00:02] PROBLEM - cp23 APT on cp23 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [23:00:11] RECOVERY - swiftac111 Puppet on swiftac111 is OK: OK: Puppet is currently enabled, last run 42 seconds ago with 0 failures [23:00:31] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.97, 1.72, 1.61 [23:00:49] PROBLEM - swiftobject111 Puppet on swiftobject111 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [23:01:29] [02miraheze/puppet] 07paladox pushed 031 commit to 03add-swift [+46/-0/±1] 13https://github.com/miraheze/puppet/compare/2392fb262d69...16988b70fb8a [23:01:29] [url] Comparing 2392fb262d69...16988b70fb8a · miraheze/puppet · GitHub | github.com [23:01:30] [02miraheze/puppet] 07paladox 0316988b7 - Add swift module [23:01:32] [02puppet] 07paladox synchronize pull request 03#2854: Add swift module - 13https://github.com/miraheze/puppet/pull/2854 [23:01:32] [url] Page not found · GitHub · GitHub | github.com [23:01:43] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 4.35, 3.91, 2.13 [23:01:59] RECOVERY - cp23 APT on cp23 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [23:02:34] RECOVERY - test131 NTP time on test131 is OK: NTP OK: Offset -0.01065635681 secs [23:03:43] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 0.99, 2.79, 1.93 [23:04:20] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.63, 1.68, 1.62 [23:04:48] RECOVERY - swiftobject111 Puppet on swiftobject111 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [23:05:26] RECOVERY - swiftobject112 Puppet on swiftobject112 is OK: OK: Puppet is currently enabled, last run 2 seconds ago with 0 failures [23:06:57] RECOVERY - swiftobject113 Puppet on swiftobject113 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [23:09:22] RECOVERY - swiftobject114 Puppet on swiftobject114 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [23:10:07] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 3.46, 2.18, 1.81 [23:10:45] RECOVERY - swiftobject115 Puppet on swiftobject115 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [23:12:35] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 3.03, 4.87, 6.00 [23:13:47] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.30, 2.85, 1.97 [23:14:35] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 13.23, 6.92, 6.55 [23:17:08] [02puppet] 07paladox closed pull request 03#2854: Add swift module - 13https://github.com/miraheze/puppet/pull/2854 [23:17:09] [url] Page not found · GitHub · GitHub | github.com [23:17:10] [02miraheze/puppet] 07paladox deleted branch 03add-swift [23:17:11] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+46/-0/±1] 13https://github.com/miraheze/puppet/compare/fe35715fe9df...264769ef353b [23:17:12] [url] Comparing fe35715fe9df...264769ef353b · miraheze/puppet · GitHub | github.com [23:17:13] [02miraheze/puppet] 07paladox 03264769e - Add swift module (#2854) [23:17:14] [02puppet] 07paladox deleted branch 03add-swift - 13https://github.com/miraheze/puppet [23:17:15] [url] Page not found · GitHub · GitHub | github.com [23:17:42] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 0.74, 1.79, 1.74 [23:18:07] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.65, 1.97, 1.89 [23:23:35] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.12, 1.81, 1.76 [23:26:07] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.89, 2.03, 1.90 [23:28:07] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.73, 1.74, 1.80 [23:29:57] PROBLEM - cp23 APT on cp23 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [23:30:07] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.93, 1.99, 1.88 [23:31:25] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.32, 1.67, 1.75 [23:31:43] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 7.00, 4.61, 2.48 [23:31:54] RECOVERY - cp23 APT on cp23 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [23:32:07] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.58, 1.95, 1.89 [23:33:23] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.17, 1.52, 1.69 [23:33:43] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.27, 3.21, 2.23 [23:34:35] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 3.67, 5.02, 5.90 [23:36:07] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.17, 1.81, 1.82 [23:38:07] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.35, 1.78, 1.82 [23:40:08] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 13.53, 4.19, 2.59 [23:40:35] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 6.32, 4.86, 5.39 [23:42:35] RECOVERY - gluster102 Current Load on gluster102 is OK: OK - load average: 3.42, 4.16, 5.06 [23:42:40] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/264769ef353b...26c2c791551c [23:42:41] [url] Comparing 264769ef353b...26c2c791551c · miraheze/puppet · GitHub | github.com [23:42:42] [02miraheze/puppet] 07paladox 0326c2c79 - swift: minor tweak to proxy file [23:45:14] [02puppet] 07Universal-Omega reviewed pull request 03#2854 commit - 13https://github.com/miraheze/puppet/pull/2854#discussion_r977067607 [23:45:15] [url] Add swift module by paladox · Pull Request #2854 · miraheze/puppet · GitHub | github.com [23:46:05] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/26c2c791551c...6bff268f8577 [23:46:06] [url] Comparing 26c2c791551c...6bff268f8577 · miraheze/puppet · GitHub | github.com [23:46:07] [02miraheze/puppet] 07paladox 036bff268 - Fix [23:46:26] PROBLEM - cp22 APT on cp22 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [23:47:16] PROBLEM - cp22 Current Load on cp22 is CRITICAL: CRITICAL - load average: 5.81, 3.96, 2.06 [23:48:21] RECOVERY - cp22 APT on cp22 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [23:49:16] RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 1.07, 2.78, 1.85 [23:56:51] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.01, 1.56, 1.44 [23:58:49] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.28, 1.45, 1.42