[00:04:19] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.92, 3.70, 2.99 [00:07:38] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 6.82, 4.81, 3.50 [00:08:19] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.76, 3.89, 3.22 [00:10:19] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.44, 3.33, 3.10 [00:11:42] PROBLEM - cp22 Current Load on cp22 is CRITICAL: CRITICAL - load average: 28.07, 14.57, 6.75 [00:12:50] PROBLEM - ns1 GDNSD Datacenters on ns1 is CRITICAL: CRITICAL - 1 datacenter is down: 217.174.247.33/cpweb [00:12:51] PROBLEM - cp22 SSH on cp22 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:14:04] PROBLEM - cp22 Puppet on cp22 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [00:14:33] PROBLEM - cp22 Varnish Backends on cp22 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [00:15:36] PROBLEM - cp22 PowerDNS Recursor on cp22 is CRITICAL: CRITICAL - Plugin timed out while executing system call [00:16:10] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 2.20, 3.59, 2.67 [00:16:50] RECOVERY - ns1 GDNSD Datacenters on ns1 is OK: OK - all datacenters are online [00:17:28] RECOVERY - cp22 Varnish Backends on cp22 is OK: All 14 backends are healthy [00:18:05] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.03, 2.68, 2.44 [00:18:59] RECOVERY - cp22 Puppet on cp22 is OK: OK: Puppet is currently enabled, last run 28 minutes ago with 0 failures [00:19:01] RECOVERY - cp22 SSH on cp22 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [00:19:42] RECOVERY - cp22 PowerDNS Recursor on cp22 is OK: DNS OK: 1.225 second response time. miraheze.org returns 109.228.51.216,217.174.247.33,2a00:da00:1800:326::1,2a00:da00:1800:328::1 [00:23:01] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.42, 3.07, 2.97 [00:23:38] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 0.90, 2.93, 3.64 [00:26:51] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.32, 2.72, 2.92 [00:27:38] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.71, 2.49, 3.30 [00:35:38] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 7.78, 4.67, 3.78 [00:42:01] PROBLEM - mw142 MediaWiki Rendering on mw142 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:42:04] PROBLEM - mw121 MediaWiki Rendering on mw121 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:42:57] PROBLEM - mw142 Current Load on mw142 is WARNING: WARNING - load average: 11.01, 10.12, 7.10 [00:42:57] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 18.93, 16.19, 10.93 [00:43:16] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 7.89, 4.81, 3.08 [00:43:21] PROBLEM - mw142 nutcracker process on mw142 is CRITICAL: PROCS CRITICAL: 0 processes with UID = 115 (nutcracker), command name 'nutcracker' [00:43:34] PROBLEM - mw141 Current Load on mw141 is WARNING: WARNING - load average: 10.31, 9.80, 6.94 [00:44:03] RECOVERY - mw121 MediaWiki Rendering on mw121 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.485 second response time [00:44:23] PROBLEM - mw141 nutcracker process on mw141 is CRITICAL: PROCS CRITICAL: 0 processes with UID = 115 (nutcracker), command name 'nutcracker' [00:44:57] RECOVERY - mw142 Current Load on mw142 is OK: OK - load average: 4.54, 7.98, 6.68 [00:44:57] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.42, 11.49, 9.32 [00:45:33] RECOVERY - mw141 Current Load on mw141 is OK: OK - load average: 8.60, 9.78, 7.32 [00:46:57] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.02, 11.46, 10.12 [00:46:57] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 6.99, 9.95, 9.02 [00:47:07] PROBLEM - cp22 Current Load on cp22 is WARNING: WARNING - load average: 0.43, 1.22, 3.65 [00:48:37] PROBLEM - mw141 MediaWiki Rendering on mw141 is CRITICAL: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - 8191 bytes in 0.226 second response time [00:49:07] RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 0.33, 0.91, 3.24 [00:49:21] RECOVERY - mw142 nutcracker process on mw142 is OK: PROCS OK: 1 process with UID = 115 (nutcracker), command name 'nutcracker' [00:49:38] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.93, 3.96, 3.98 [00:49:53] RECOVERY - mw142 MediaWiki Rendering on mw142 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.336 second response time [00:50:23] RECOVERY - mw141 nutcracker process on mw141 is OK: PROCS OK: 1 process with UID = 115 (nutcracker), command name 'nutcracker' [00:50:35] RECOVERY - mw141 MediaWiki Rendering on mw141 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.233 second response time [00:50:57] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.22, 9.37, 9.57 [00:51:39] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.89, 5.01, 4.38 [01:01:38] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.52, 3.45, 3.96 [01:03:15] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 1.76, 2.93, 3.99 [01:05:38] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.63, 3.77, 3.94 [01:07:15] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 1.13, 1.88, 3.31 [01:07:38] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.43, 3.93, 4.00 [01:19:38] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.77, 2.72, 3.29 [01:24:30] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.68, 3.19, 2.73 [01:26:25] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.82, 3.18, 2.79 [01:27:32] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/972bdbfefc8e...4a6d7623e500 [01:27:34] [02miraheze/mw-config] 07paladox 034a6d762 - Switch wikis beginning with n to swift [01:27:51] !log [paladox@mwtask141] starting deploy of {'pull': 'config', 'config': True} to all [01:27:59] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:27:59] !log [paladox@mwtask141] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 8s [01:28:05] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:28:12] !log [paladox@test131] starting deploy of {'pull': 'config', 'config': True} to all [01:28:13] !log [paladox@test131] DEPLOY ABORTED: Canary check failed for beta.betaheze.org@localhost [01:28:16] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:28:21] !log [paladox@mwtask141] starting deploy of {'config': True} to all [01:28:21] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:28:22] !log [paladox@test131] starting deploy of {'config': True} to all [01:28:23] !log [paladox@test131] DEPLOY ABORTED: Canary check failed for beta.betaheze.org@localhost [01:28:25] !log [paladox@test131] starting deploy of {'pull': 'config', 'config': True, 'force': True} to all [01:28:26] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:28:26] !log [paladox@test131] finished deploy of {'pull': 'config', 'config': True, 'force': True} to all - SUCCESS in 0s [01:28:27] !log [paladox@test131] starting deploy of {'pull': 'config', 'config': True, 'force': True} to all [01:28:28] !log [paladox@mwtask141] finished deploy of {'config': True} to all - SUCCESS in 6s [01:28:29] !log [paladox@test131] finished deploy of {'pull': 'config', 'config': True, 'force': True} to all - SUCCESS in 0s [01:28:31] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:28:32] !log [paladox@test131] starting deploy of {'config': True, 'force': True} to all [01:28:33] !log [paladox@test131] finished deploy of {'config': True, 'force': True} to all - SUCCESS in 0s [01:28:35] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:28:39] miraheze/mw-config - paladox the build passed. [01:28:40] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:28:44] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:28:47] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:28:55] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:28:59] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:29:08] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:29:13] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:31:54] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 6.41, 3.54, 2.08 [01:33:50] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.27, 2.55, 1.89 [01:37:38] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.95, 3.66, 3.31 [01:39:38] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.90, 2.96, 3.10 [02:08:31] PROBLEM - mw121 MediaWiki Rendering on mw121 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [02:08:32] PROBLEM - mw131 MediaWiki Rendering on mw131 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [02:10:27] RECOVERY - mw131 MediaWiki Rendering on mw131 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.198 second response time [02:10:30] RECOVERY - mw121 MediaWiki Rendering on mw121 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.440 second response time [02:15:53] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 6.43, 5.63, 3.95 [02:19:45] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.18, 3.53, 3.48 [02:21:40] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.43, 3.22, 3.37 [02:37:38] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.72, 4.51, 3.82 [02:41:38] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.06, 3.42, 3.56 [02:43:38] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.39, 2.72, 3.29 [02:54:32] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.81, 3.85, 3.51 [02:58:23] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.49, 3.11, 3.27 [03:00:22] PROBLEM - mw122 MediaWiki Rendering on mw122 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [03:04:28] RECOVERY - mw122 MediaWiki Rendering on mw122 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.367 second response time [03:05:13] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 6.83, 4.27, 3.61 [03:09:41] PROBLEM - mw132 MediaWiki Rendering on mw132 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [03:11:36] RECOVERY - mw132 MediaWiki Rendering on mw132 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.190 second response time [03:14:53] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.09, 3.11, 3.55 [03:18:45] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.02, 3.18, 3.46 [03:22:37] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.42, 3.33, 3.45 [03:22:50] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.09, 3.48, 2.79 [03:24:32] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.80, 3.18, 3.39 [03:24:45] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.52, 3.64, 2.94 [03:26:40] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.15, 3.91, 3.12 [03:28:34] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.21, 2.93, 2.86 [03:36:10] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.59, 3.80, 3.29 [03:38:05] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.43, 3.13, 3.10 [03:41:59] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.66, 3.61, 3.32 [03:43:55] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.22, 2.92, 3.11 [04:28:25] PROBLEM - test131 Current Load on test131 is CRITICAL: CRITICAL - load average: 4.51, 3.14, 2.53 [04:32:25] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 2.35, 2.96, 2.62 [04:32:27] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 3.58, 2.89, 1.75 [04:38:14] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 0.97, 2.56, 2.08 [04:41:07] PROBLEM - cp22 Current Load on cp22 is WARNING: WARNING - load average: 3.79, 2.50, 1.74 [04:43:07] RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 2.99, 2.45, 1.81 [04:53:52] PROBLEM - swiftobject114 PowerDNS Recursor on swiftobject114 is CRITICAL: CRITICAL - Plugin timed out while executing system call [04:58:16] RECOVERY - swiftobject114 PowerDNS Recursor on swiftobject114 is OK: DNS OK: 7.290 seconds response time. miraheze.org returns 109.228.51.216,217.174.247.33,2a00:da00:1800:326::1,2a00:da00:1800:328::1 [04:58:36] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 7.65, 4.47, 2.87 [04:59:10] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.43, 3.62, 2.58 [05:00:49] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 6.74, 4.70, 3.13 [05:02:45] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.31, 3.94, 3.05 [05:02:51] PROBLEM - cp33 PowerDNS Recursor on cp33 is CRITICAL: CRITICAL - Plugin timed out while executing system call [05:04:49] RECOVERY - cp33 PowerDNS Recursor on cp33 is OK: DNS OK: 1.305 second response time. miraheze.org returns 108.175.15.182,2607:f1c0:1800:26f::1,2607:f1c0:1800:8100::1,74.208.203.152 [05:06:21] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 1.13, 3.46, 3.16 [05:06:37] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.02, 4.42, 3.41 [05:06:50] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.70, 3.99, 3.44 [05:08:16] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 0.44, 2.44, 2.83 [05:08:45] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 0.87, 2.92, 3.11 [05:10:29] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.79, 3.28, 3.20 [05:25:04] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.20, 3.52, 3.15 [05:26:59] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.06, 3.84, 3.32 [05:28:54] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.21, 3.20, 3.14 [05:30:34] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 5.11, 3.77, 2.84 [05:32:30] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 3.61, 3.73, 2.94 [05:34:25] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.82, 3.01, 2.77 [06:06:42] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.10, 3.54, 2.87 [06:08:37] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.35, 2.72, 2.65 [06:12:25] PROBLEM - test131 Current Load on test131 is CRITICAL: CRITICAL - load average: 6.19, 3.95, 2.75 [06:25:16] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 6.86, 4.44, 3.20 [06:27:02] PROBLEM - wiki.ravynos.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:27:59] PROBLEM - cp23 HTTPS on cp23 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:28:02] PROBLEM - m.miraheze.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:28:02] PROBLEM - cp23 SSH on cp23 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:28:17] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 6.73, 5.33, 3.51 [06:28:17] PROBLEM - studyabroad.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:28:20] PROBLEM - cp22 Current Load on cp22 is CRITICAL: CRITICAL - load average: 45.14, 19.81, 8.45 [06:29:20] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 36.68, 26.74, 12.14 [06:29:22] PROBLEM - gs.sidem.wiki - LetsEncrypt on sslhost is CRITICAL: connect to address gs.sidem.wiki and port 443: Network is unreachableHTTP CRITICAL - Unable to open TCP socket [06:29:22] PROBLEM - cp23 PowerDNS Recursor on cp23 is CRITICAL: CRITICAL - Plugin timed out while executing system call [06:29:57] RECOVERY - cp23 HTTPS on cp23 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 3426 bytes in 0.106 second response time [06:29:58] RECOVERY - cp23 SSH on cp23 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [06:29:58] RECOVERY - m.miraheze.org - LetsEncrypt on sslhost is OK: OK - Certificate 'm.miraheze.org' will expire on Tue 22 Nov 2022 14:02:45 GMT +0000. [06:31:21] RECOVERY - cp23 PowerDNS Recursor on cp23 is OK: DNS OK: 0.220 seconds response time. miraheze.org returns 109.228.51.216,217.174.247.33,2a00:da00:1800:326::1,2a00:da00:1800:328::1 [06:32:08] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.94, 3.76, 3.29 [06:32:57] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.73, 3.69, 3.64 [06:34:08] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 3.09, 3.23, 3.13 [06:34:52] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.09, 2.89, 3.35 [06:48:12] PROBLEM - cp22 Current Load on cp22 is WARNING: WARNING - load average: 2.72, 2.42, 3.89 [06:52:12] RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 0.28, 1.27, 3.08 [06:54:11] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 0.64, 1.14, 3.72 [06:56:35] PROBLEM - wiki.ravynos.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.ravynos.com' expires in 10 day(s) (Mon 14 Nov 2022 00:00:40 GMT +0000). [06:57:00] RECOVERY - studyabroad.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'studyabroad.wiki' will expire on Sat 14 Jan 2023 15:15:01 GMT +0000. [06:58:20] RECOVERY - gs.sidem.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'gs.sidem.wiki' will expire on Wed 18 Jan 2023 11:59:32 GMT +0000. [07:02:01] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.50, 2.11, 3.22 [07:03:06] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/57c1bb7a2d8a...61f035ddfcbe [07:03:06] [02miraheze/ssl] 07MirahezeSSLBot 0361f035d - Bot: Update SSL cert for wiki.ravynos.com [07:05:34] PROBLEM - cp22 NTP time on cp22 is WARNING: NTP WARNING: Offset 0.1302171946 secs [07:08:00] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 2.23, 2.84, 3.94 [07:16:00] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 2.69, 2.65, 3.38 [07:23:16] RECOVERY - cp22 NTP time on cp22 is OK: NTP OK: Offset 0.0764670372 secs [07:25:16] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.83, 3.03, 2.37 [07:26:08] RECOVERY - wiki.ravynos.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.ravynos.com' will expire on Wed 01 Feb 2023 06:02:59 GMT +0000. [07:27:11] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.41, 2.37, 2.20 [07:30:01] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 3.56, 2.96, 2.27 [07:34:01] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.73, 2.74, 2.39 [07:44:16] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.92, 3.66, 2.73 [07:46:12] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.60, 3.03, 2.62 [07:47:00] [023d2png-deploy] 07TrellixVulnTeam opened pull request 03#1: CVE-2007-4559 Patch - 13https://github.com/miraheze/3d2png-deploy/pull/1 [07:56:32] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.20, 3.81, 2.44 [08:00:32] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.39, 3.85, 2.81 [08:02:08] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.43, 2.42, 2.08 [08:02:32] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 0.81, 2.78, 2.54 [08:04:08] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.12, 1.90, 1.93 [08:14:01] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 4.22, 3.20, 2.17 [08:16:01] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.95, 2.71, 2.11 [08:21:35] PROBLEM - swiftproxy111 PowerDNS Recursor on swiftproxy111 is CRITICAL: CRITICAL - Plugin timed out while executing system call [08:22:50] PROBLEM - swiftproxy111 Current Load on swiftproxy111 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [08:23:50] PROBLEM - swiftproxy111 HTTP on swiftproxy111 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:24:23] PROBLEM - swiftproxy111 HTTPS on swiftproxy111 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:25:26] PROBLEM - swiftproxy111 SSH on swiftproxy111 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:26:32] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 7.04, 4.92, 2.89 [08:27:32] PROBLEM - swiftproxy111 conntrack_table_size on swiftproxy111 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [08:27:36] PROBLEM - swiftproxy111 ferm_active on swiftproxy111 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [08:27:59] PROBLEM - swiftproxy111 NTP time on swiftproxy111 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [08:28:24] PROBLEM - swiftproxy111 Puppet on swiftproxy111 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [08:29:53] RECOVERY - swiftproxy111 ferm_active on swiftproxy111 is OK: OK ferm input default policy is set [08:29:54] RECOVERY - swiftproxy111 conntrack_table_size on swiftproxy111 is OK: OK: nf_conntrack is 0 % full [08:30:03] RECOVERY - swiftproxy111 NTP time on swiftproxy111 is OK: NTP OK: Offset -0.0009060204029 secs [08:30:23] RECOVERY - swiftproxy111 Puppet on swiftproxy111 is OK: OK: Puppet is currently enabled, last run 44 minutes ago with 0 failures [08:30:36] RECOVERY - swiftproxy111 HTTPS on swiftproxy111 is OK: HTTP OK: Status line output matched "HTTP/1.1 404" - 367 bytes in 0.048 second response time [08:31:36] RECOVERY - swiftproxy111 PowerDNS Recursor on swiftproxy111 is OK: DNS OK: 0.037 seconds response time. miraheze.org returns 109.228.51.216,217.174.247.33,2a00:da00:1800:326::1,2a00:da00:1800:328::1 [08:31:41] RECOVERY - swiftproxy111 SSH on swiftproxy111 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [08:31:59] RECOVERY - swiftproxy111 HTTP on swiftproxy111 is OK: HTTP OK: Status line output matched "HTTP/1.1 404" - 400 bytes in 0.026 second response time [08:34:32] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.25, 3.18, 3.03 [08:39:03] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.37, 3.63, 2.29 [08:44:51] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.27, 3.99, 3.05 [08:46:47] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.82, 4.93, 3.51 [08:48:43] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.50, 3.70, 3.23 [08:49:21] PROBLEM - swiftproxy111 Current Load on swiftproxy111 is WARNING: WARNING - load average: 0.12, 1.26, 7.49 [08:50:38] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 0.76, 2.69, 2.91 [08:51:19] RECOVERY - swiftproxy111 Current Load on swiftproxy111 is OK: OK - load average: 0.58, 1.02, 6.64 [09:03:08] PROBLEM - mw141 MediaWiki Rendering on mw141 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:03:30] PROBLEM - mw142 Current Load on mw142 is CRITICAL: CRITICAL - load average: 30.36, 17.38, 9.86 [09:04:11] PROBLEM - mw141 Current Load on mw141 is CRITICAL: CRITICAL - load average: 18.37, 14.93, 8.69 [09:05:08] RECOVERY - mw141 MediaWiki Rendering on mw141 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.247 second response time [09:05:15] PROBLEM - cp23 Varnish Backends on cp23 is CRITICAL: 2 backends are down. mw141 mw142 [09:05:18] PROBLEM - cp22 Varnish Backends on cp22 is CRITICAL: 2 backends are down. mw141 mw142 [09:05:37] PROBLEM - cp32 Varnish Backends on cp32 is CRITICAL: 1 backends are down. mw141 [09:06:11] PROBLEM - mw141 Current Load on mw141 is WARNING: WARNING - load average: 3.34, 10.30, 7.75 [09:06:14] PROBLEM - cp33 Varnish Backends on cp33 is CRITICAL: 2 backends are down. mw141 mw142 [09:07:15] RECOVERY - cp23 Varnish Backends on cp23 is OK: All 14 backends are healthy [09:07:16] RECOVERY - cp22 Varnish Backends on cp22 is OK: All 14 backends are healthy [09:07:28] RECOVERY - mw142 Current Load on mw142 is OK: OK - load average: 4.14, 9.38, 8.24 [09:07:37] RECOVERY - cp32 Varnish Backends on cp32 is OK: All 14 backends are healthy [09:08:10] RECOVERY - mw141 Current Load on mw141 is OK: OK - load average: 2.91, 7.71, 7.10 [09:08:13] RECOVERY - cp33 Varnish Backends on cp33 is OK: All 14 backends are healthy [09:23:36] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.03, 10.52, 8.24 [09:25:15] PROBLEM - cp23 Varnish Backends on cp23 is CRITICAL: 1 backends are down. mw121 [09:25:36] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 5.13, 8.34, 7.70 [09:27:15] RECOVERY - cp23 Varnish Backends on cp23 is OK: All 14 backends are healthy [09:46:01] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 4.42, 2.83, 1.92 [09:48:01] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.73, 2.44, 1.90 [09:56:32] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 6.66, 3.97, 2.44 [10:06:32] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 0.54, 3.25, 3.44 [10:08:32] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 0.28, 2.24, 3.04 [10:14:21] PROBLEM - cp22 Current Load on cp22 is CRITICAL: CRITICAL - load average: 5.37, 3.84, 2.78 [10:18:12] PROBLEM - cp22 Current Load on cp22 is WARNING: WARNING - load average: 3.12, 3.68, 2.96 [10:20:12] RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 1.31, 2.79, 2.72 [10:28:52] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 4.45, 3.72, 2.66 [10:29:13] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 4.63, 3.38, 1.83 [10:30:08] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.49, 4.32, 2.40 [10:30:46] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.20, 2.86, 2.47 [10:31:11] RECOVERY - gluster102 Current Load on gluster102 is OK: OK - load average: 1.47, 2.74, 1.79 [10:32:06] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 0.97, 3.08, 2.18 [11:30:01] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 5.37, 4.56, 3.09 [11:32:01] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 2.01, 3.82, 3.01 [11:34:01] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 0.44, 2.63, 2.67 [11:38:08] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.25, 3.20, 2.04 [11:42:08] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.32, 3.55, 2.48 [11:44:08] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.75, 4.16, 2.83 [11:48:08] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.83, 3.53, 2.96 [11:50:08] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.37, 3.84, 3.11 [11:52:08] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.64, 2.91, 2.86 [11:56:32] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.03, 3.61, 2.37 [12:00:02] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 4.77, 4.27, 3.02 [12:02:32] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.08, 2.84, 2.53 [12:04:26] PROBLEM - cloud11 SMART on cloud11 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [12:05:24] PROBLEM - swiftobject114 PowerDNS Recursor on swiftobject114 is CRITICAL: CRITICAL - Plugin timed out while executing system call [12:06:01] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 1.10, 3.80, 3.45 [12:08:01] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 0.50, 2.67, 3.08 [12:09:02] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.52, 3.42, 2.94 [12:10:12] PROBLEM - cp22 Current Load on cp22 is WARNING: WARNING - load average: 3.45, 2.76, 2.29 [12:10:41] [02miraheze/CustomHeader] 07translatewiki pushed 031 commit to 03master [+1/-0/±0] 13https://github.com/miraheze/CustomHeader/compare/52acca2b91b7...6426617c90fc [12:10:44] [02miraheze/CustomHeader] 07translatewiki 036426617 - Localisation updates from https://translatewiki.net. [12:10:47] [02miraheze/CreateWiki] 07translatewiki pushed 031 commit to 03master [+0/-0/±4] 13https://github.com/miraheze/CreateWiki/compare/b19f1f763246...f003b762ad92 [12:10:50] [02miraheze/CreateWiki] 07translatewiki 03f003b76 - Localisation updates from https://translatewiki.net. [12:10:53] [02miraheze/ErrorPages] 07translatewiki pushed 031 commit to 03master [+0/-0/±3] 13https://github.com/miraheze/ErrorPages/compare/ed98d057f900...02c5a08044b6 [12:10:54] [02miraheze/ErrorPages] 07translatewiki 0302c5a08 - Localisation updates from https://translatewiki.net. [12:10:56] [02miraheze/ImportDump] 07translatewiki pushed 031 commit to 03master [+1/-0/±1] 13https://github.com/miraheze/ImportDump/compare/b6f5da326d34...6c3a23d8206c [12:10:58] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 7.95, 4.31, 3.27 [12:10:59] [02miraheze/ImportDump] 07translatewiki 036c3a23d - Localisation updates from https://translatewiki.net. [12:11:02] [02miraheze/IncidentReporting] 07translatewiki pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/IncidentReporting/compare/3014c48830b4...96bb1e515738 [12:11:04] [02miraheze/IncidentReporting] 07translatewiki 0396bb1e5 - Localisation updates from https://translatewiki.net. [12:11:05] [02miraheze/landing] 07translatewiki pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/landing/compare/883e5640b569...e7281c2fae9e [12:11:08] [02miraheze/landing] 07translatewiki 03e7281c2 - Localisation updates from https://translatewiki.net. [12:11:10] [02miraheze/SpriteSheet] 07translatewiki pushed 031 commit to 03master [+1/-0/±0] 13https://github.com/miraheze/SpriteSheet/compare/48b60d793803...9cdab61277f2 [12:11:11] [02miraheze/SpriteSheet] 07translatewiki 039cdab61 - Localisation updates from https://translatewiki.net. [12:11:12] [02miraheze/PDFEmbed] 07translatewiki pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/PDFEmbed/compare/66a4fbcd1f8c...150c4ce41997 [12:11:14] [02miraheze/PDFEmbed] 07translatewiki 03150c4ce - Localisation updates from https://translatewiki.net. [12:11:15] [02miraheze/MirahezeMagic] 07translatewiki pushed 031 commit to 03master [+0/-0/±4] 13https://github.com/miraheze/MirahezeMagic/compare/dcb6b10c4300...6be00e4862f9 [12:11:18] [02miraheze/MirahezeMagic] 07translatewiki 036be00e4 - Localisation updates from https://translatewiki.net. [12:12:12] PROBLEM - cp22 Current Load on cp22 is CRITICAL: CRITICAL - load average: 5.92, 4.19, 2.88 [12:12:54] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.18, 3.41, 3.07 [12:13:23] miraheze/ErrorPages - translatewiki the build passed. [12:13:32] miraheze/landing - translatewiki the build passed. [12:14:50] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 0.90, 2.52, 2.78 [12:16:12] PROBLEM - cp22 Current Load on cp22 is WARNING: WARNING - load average: 2.55, 3.79, 3.05 [12:19:01] miraheze/CustomHeader - translatewiki the build passed. [12:20:12] RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 0.83, 2.48, 2.71 [12:24:32] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.63, 2.83, 2.23 [12:25:16] PROBLEM - cloud11 SMART on cloud11 is WARNING: WARNING: [cciss,6] - No health status line found, Self-test log contains errors --- [cciss,0] - Device is clean --- [cciss,1] - Device is clean --- [cciss,2] - Device is clean --- [cciss,3] - Device is clean --- [cciss,4] - Device is clean --- [cciss,5] - Device is clean| [12:25:33] miraheze/SpriteSheet - translatewiki the build passed. [12:25:48] miraheze/PDFEmbed - translatewiki the build passed. [12:25:54] RECOVERY - swiftobject114 PowerDNS Recursor on swiftobject114 is OK: DNS OK: 9.177 seconds response time. miraheze.org returns 109.228.51.216,217.174.247.33,2a00:da00:1800:326::1,2a00:da00:1800:328::1 [12:25:59] miraheze/IncidentReporting - translatewiki the build passed. [12:26:24] miraheze/CreateWiki - translatewiki the build passed. [12:26:32] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.48, 2.82, 2.31 [12:29:44] miraheze/ImportDump - translatewiki the build passed. [12:30:36] PROBLEM - test131 Puppet on test131 is CRITICAL: CRITICAL: Puppet has 2 failures. Last run 2 minutes ago with 2 failures. Failed resources (up to 3 shown): Exec[Landing Sync],Exec[ErrorPages Sync] [12:31:09] miraheze/MirahezeMagic - translatewiki the build passed. [12:44:12] PROBLEM - cp22 Current Load on cp22 is CRITICAL: CRITICAL - load average: 4.19, 3.41, 2.60 [12:48:12] RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 1.62, 3.13, 2.73 [12:58:54] RECOVERY - test131 Puppet on test131 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [13:03:53] PROBLEM - wiki.lefrenchmelee.fr - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query wiki.lefrenchmelee.fr. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [13:10:29] PROBLEM - arrieretoile.fr - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query arrieretoile.fr. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [13:32:47] RECOVERY - wiki.lefrenchmelee.fr - reverse DNS on sslhost is OK: SSL OK - wiki.lefrenchmelee.fr reverse DNS resolves to cp22.miraheze.org - CNAME OK [13:34:13] PROBLEM - wiki.controlistes.fr - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query wiki.controlistes.fr. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [13:37:04] PROBLEM - swiftobject114 PowerDNS Recursor on swiftobject114 is CRITICAL: CRITICAL - Plugin timed out while executing system call [13:39:58] RECOVERY - arrieretoile.fr - reverse DNS on sslhost is OK: SSL OK - arrieretoile.fr reverse DNS resolves to cp23.miraheze.org - NS RECORDS OK [13:41:13] RECOVERY - swiftobject114 PowerDNS Recursor on swiftobject114 is OK: DNS OK: 0.523 seconds response time. miraheze.org returns 109.228.51.216,217.174.247.33,2a00:da00:1800:326::1,2a00:da00:1800:328::1 [13:46:16] PROBLEM - cloud11 SMART on cloud11 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [13:51:43] PROBLEM - swiftobject114 PowerDNS Recursor on swiftobject114 is CRITICAL: CRITICAL - Plugin timed out while executing system call [13:51:58] PROBLEM - cloud11 SMART on cloud11 is WARNING: WARNING: [cciss,6] - No health status line found, Self-test log contains errors --- [cciss,0] - Device is clean --- [cciss,1] - Device is clean --- [cciss,2] - Device is clean --- [cciss,3] - Device is clean --- [cciss,4] - Device is clean --- [cciss,5] - Device is clean| [13:53:49] RECOVERY - swiftobject114 PowerDNS Recursor on swiftobject114 is OK: DNS OK: 6.829 seconds response time. miraheze.org returns 109.228.51.216,217.174.247.33,2a00:da00:1800:326::1,2a00:da00:1800:328::1 [13:54:33] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 6.60, 3.70, 2.62 [14:04:03] PROBLEM - wiki.controlistes.fr - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.controlistes.fr All nameservers failed to answer the query. [14:04:31] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.04, 3.07, 3.14 [14:11:55] PROBLEM - cloud11 SMART on cloud11 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [14:14:39] PROBLEM - cloud11 SMART on cloud11 is WARNING: WARNING: [cciss,6] - No health status line found, Self-test log contains errors --- [cciss,0] - Device is clean --- [cciss,1] - Device is clean --- [cciss,2] - Device is clean --- [cciss,3] - Device is clean --- [cciss,4] - Device is clean --- [cciss,5] - Device is clean| [14:26:32] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.77, 3.44, 2.63 [14:33:52] RECOVERY - wiki.controlistes.fr - reverse DNS on sslhost is OK: SSL OK - wiki.controlistes.fr reverse DNS resolves to cp22.miraheze.org - CNAME OK [14:36:16] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 13.64, 9.16, 4.88 [14:38:32] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.03, 3.10, 3.43 [14:40:32] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 0.81, 2.39, 3.13 [14:46:08] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.34, 3.20, 3.93 [14:56:08] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.79, 2.76, 3.35 [15:10:53] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.84, 2.89, 2.52 [15:12:50] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 2.88, 2.76, 2.51 [15:18:46] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 8.04, 5.72, 3.93 [15:24:34] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.20, 3.23, 3.43 [15:26:30] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.15, 2.50, 3.14 [15:28:01] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 3.58, 2.81, 2.31 [15:28:28] PROBLEM - cp22 Current Load on cp22 is WARNING: WARNING - load average: 2.11, 3.41, 2.71 [15:30:01] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 4.64, 3.97, 2.82 [15:30:22] RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 1.08, 2.63, 2.51 [15:32:01] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.14, 2.83, 2.54 [15:53:12] PROBLEM - mw122 MediaWiki Rendering on mw122 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:55:07] RECOVERY - mw122 MediaWiki Rendering on mw122 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.626 second response time [15:55:19] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.57, 3.76, 2.91 [15:56:00] PROBLEM - wiki.yermocapital.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.yermocapital.com' expires in 15 day(s) (Sat 19 Nov 2022 15:53:54 GMT +0000). [15:57:15] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.04, 3.26, 2.84 [15:57:49] [02miraheze/MirahezeMagic] 07Universal-Omega pushed 031 commit to 03use-swift [+0/-0/±1] 13https://github.com/miraheze/MirahezeMagic/commit/0c2235fdde9a [15:57:51] [02miraheze/MirahezeMagic] 07Universal-Omega 030c2235f - Always use Swift for renames and deletions [15:57:53] [02MirahezeMagic] 07Universal-Omega created branch 03use-swift - 13https://github.com/miraheze/MirahezeMagic [15:57:56] [02MirahezeMagic] 07Universal-Omega opened pull request 03#376: Always use Swift for renames and deletions - 13https://github.com/miraheze/MirahezeMagic/pull/376 [16:00:01] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 2.44, 3.58, 2.96 [16:00:48] PROBLEM - psychevos.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'psychevos.org' expires in 15 day(s) (Sat 19 Nov 2022 15:58:29 GMT +0000). [16:02:01] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.77, 2.77, 2.73 [16:02:56] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/61f035ddfcbe...7308cfbc1e96 [16:02:57] [02miraheze/ssl] 07MirahezeSSLBot 037308cfb - Bot: Update SSL cert for wiki.yermocapital.com [16:04:08] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.41, 3.37, 2.92 [16:04:14] PROBLEM - removededm.ml - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'removededm.ml' expires in 15 day(s) (Sat 19 Nov 2022 16:00:07 GMT +0000). [16:06:08] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 6.36, 4.17, 3.24 [16:08:08] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.91, 3.83, 3.25 [16:08:16] miraheze/MirahezeMagic - Universal-Omega the build passed. [16:09:01] PROBLEM - www.dlfm-wiki.top - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'dlfm-wiki.top' expires in 15 day(s) (Sat 19 Nov 2022 16:02:27 GMT +0000). [16:11:39] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/7308cfbc1e96...aad2efbc7216 [16:11:42] [02miraheze/ssl] 07MirahezeSSLBot 03aad2efb - Bot: Update SSL cert for psychevos.org [16:12:08] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.77, 2.95, 3.03 [16:14:12] PROBLEM - cp22 Current Load on cp22 is WARNING: WARNING - load average: 3.66, 2.89, 2.14 [16:15:14] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/aad2efbc7216...06d5a10b392a [16:15:17] [02miraheze/ssl] 07MirahezeSSLBot 0306d5a10 - Bot: Update SSL cert for removededm.ml [16:16:13] PROBLEM - cp22 Current Load on cp22 is CRITICAL: CRITICAL - load average: 4.96, 3.57, 2.48 [16:18:12] RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 3.40, 3.28, 2.49 [16:26:00] RECOVERY - wiki.yermocapital.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.yermocapital.com' will expire on Wed 01 Feb 2023 15:01:42 GMT +0000. [16:30:43] RECOVERY - psychevos.org - LetsEncrypt on sslhost is OK: OK - Certificate 'psychevos.org' will expire on Wed 01 Feb 2023 15:08:01 GMT +0000. [16:36:45] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.11, 3.52, 2.95 [16:38:41] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.20, 3.49, 3.01 [16:40:37] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.89, 3.83, 3.18 [16:42:33] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.39, 3.31, 3.07 [16:54:32] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 6.73, 4.36, 2.97 [16:56:01] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 4.46, 2.89, 2.19 [16:58:01] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 4.00, 3.11, 2.35 [16:58:32] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.63, 3.50, 2.94 [17:00:01] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 2.40, 3.37, 2.58 [17:00:32] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.24, 4.06, 3.23 [17:02:32] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.21, 3.00, 2.94 [17:03:11] RECOVERY - removededm.ml - LetsEncrypt on sslhost is OK: OK - Certificate 'removededm.ml' will expire on Wed 01 Feb 2023 15:12:51 GMT +0000. [17:03:56] PROBLEM - mw142 MediaWiki Rendering on mw142 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:03:59] PROBLEM - mw121 MediaWiki Rendering on mw121 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:05:51] RECOVERY - mw142 MediaWiki Rendering on mw142 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.200 second response time [17:05:59] RECOVERY - mw121 MediaWiki Rendering on mw121 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.406 second response time [17:16:12] PROBLEM - cp22 Current Load on cp22 is CRITICAL: CRITICAL - load average: 4.84, 4.16, 2.92 [17:18:12] PROBLEM - cp22 Current Load on cp22 is WARNING: WARNING - load average: 3.12, 3.72, 2.91 [17:20:12] RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 0.80, 2.68, 2.63 [17:30:19] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 5.53, 4.65, 3.14 [17:33:43] [02miraheze/mw-config] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://github.com/miraheze/mw-config/commit/f1c57041eb77 [17:33:44] [02miraheze/mw-config] 07paladox 03f1c5704 - Switching all wikis beginning with q to swift [17:33:47] [02mw-config] 07paladox created branch 03paladox-patch-1 - 13https://github.com/miraheze/mw-config [17:33:48] [02mw-config] 07paladox opened pull request 03#4977: Switching all wikis beginning with q to swift - 13https://github.com/miraheze/mw-config/pull/4977 [17:33:51] [02mw-config] 07paladox closed pull request 03#4977: Switching all wikis beginning with q to swift - 13https://github.com/miraheze/mw-config/pull/4977 [17:33:53]