[00:02:54] PROBLEM - es141 Current Load on es141 is CRITICAL: CRITICAL - load average: 6.60, 3.52, 1.90 [00:04:11] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 8.77, 5.48, 4.07 [00:10:07] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.40, 3.90, 3.84 [00:12:00] [Grafana] RESOLVED: PHP-FPM Worker Usage High https://grafana.miraheze.org/d/GtxbP1Xnk?orgId=1 [00:12:55] PROBLEM - es141 Current Load on es141 is WARNING: WARNING - load average: 2.02, 3.80, 3.12 [00:14:05] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 6.33, 4.13, 3.87 [00:14:56] RECOVERY - es141 Current Load on es141 is OK: OK - load average: 1.96, 3.16, 2.97 [00:16:05] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.21, 3.73, 3.75 [00:20:05] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.68, 2.83, 3.39 [00:24:05] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.22, 3.27, 3.45 [00:26:05] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.74, 2.72, 3.23 [00:30:58] PROBLEM - ping6 on ns1 is CRITICAL: PING CRITICAL - Packet loss = 0%, RTA = 263.52 ms [00:31:03] PROBLEM - ping6 on cp33 is CRITICAL: PING CRITICAL - Packet loss = 0%, RTA = 277.25 ms [00:31:51] RECOVERY - ping6 on cp32 is OK: PING OK - Packet loss = 0%, RTA = 103.40 ms [00:33:00] RECOVERY - ping6 on ns1 is OK: PING OK - Packet loss = 0%, RTA = 102.55 ms [00:33:03] RECOVERY - ping6 on cp33 is OK: PING OK - Packet loss = 0%, RTA = 102.74 ms [00:35:04] PROBLEM - mw122 MediaWiki Rendering on mw122 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:35:12] PROBLEM - db121 Current Load on db121 is WARNING: WARNING - load average: 7.20, 6.26, 4.84 [00:37:08] RECOVERY - mw122 MediaWiki Rendering on mw122 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 6.249 second response time [00:37:12] RECOVERY - db121 Current Load on db121 is OK: OK - load average: 5.20, 5.78, 4.83 [00:37:52] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.57, 3.02, 2.27 [00:39:52] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.19, 2.80, 2.29 [00:44:00] [Grafana] FIRING: Some MediaWiki Appservers are running out of PHP-FPM workers. https://grafana.miraheze.org/d/GtxbP1Xnk?orgId=1 [00:54:00] [Grafana] RESOLVED: PHP-FPM Worker Usage High https://grafana.miraheze.org/d/GtxbP1Xnk?orgId=1 [00:55:42] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.30, 3.94, 3.26 [00:59:39] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.00, 3.69, 3.33 [01:03:11] PROBLEM - es141 Current Load on es141 is WARNING: WARNING - load average: 3.85, 3.64, 3.31 [01:03:36] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.08, 2.95, 3.12 [01:05:05] RECOVERY - es141 Current Load on es141 is OK: OK - load average: 2.50, 3.27, 3.22 [01:07:47] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.63, 3.93, 2.76 [01:08:56] PROBLEM - es141 Current Load on es141 is CRITICAL: CRITICAL - load average: 4.38, 3.69, 3.38 [01:09:47] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.23, 3.53, 2.75 [01:10:54] RECOVERY - es141 Current Load on es141 is OK: OK - load average: 2.91, 3.34, 3.29 [01:11:29] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.96, 3.95, 3.47 [01:11:47] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.34, 3.88, 2.98 [01:13:47] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.31, 3.50, 2.97 [01:14:56] PROBLEM - es141 Current Load on es141 is CRITICAL: CRITICAL - load average: 4.12, 3.55, 3.36 [01:15:46] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 3.02, 3.17, 2.90 [01:16:58] RECOVERY - es141 Current Load on es141 is OK: OK - load average: 2.90, 3.18, 3.24 [01:17:25] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.34, 3.69, 3.42 [01:19:23] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.74, 2.99, 3.20 [01:24:56] PROBLEM - es141 Current Load on es141 is CRITICAL: CRITICAL - load average: 4.87, 3.74, 3.41 [01:26:54] PROBLEM - es141 Current Load on es141 is WARNING: WARNING - load average: 3.85, 3.75, 3.45 [01:30:43] RECOVERY - cloud11 IPMI Sensors on cloud11 is OK: IPMI Status: OK [01:32:54] PROBLEM - es141 Current Load on es141 is CRITICAL: CRITICAL - load average: 4.02, 3.90, 3.60 [01:34:43] PROBLEM - cloud11 IPMI Sensors on cloud11 is CRITICAL: IPMI Status: Critical [Cntlr 2 Bay 7 = Critical] [01:34:56] PROBLEM - es141 Current Load on es141 is WARNING: WARNING - load average: 3.44, 3.62, 3.53 [01:40:55] RECOVERY - es141 Current Load on es141 is OK: OK - load average: 3.01, 3.19, 3.37 [01:55:50] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.50, 5.02, 3.87 [01:59:47] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.38, 3.27, 3.43 [02:00:20] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 1.18, 2.52, 3.68 [02:01:46] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.38, 2.91, 3.27 [02:04:20] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 4.93, 3.16, 3.62 [02:20:20] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 2.95, 3.39, 3.90 [02:23:31] PROBLEM - cp22 NTP time on cp22 is WARNING: NTP WARNING: Offset 0.1033214331 secs [02:25:22] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.93, 10.06, 11.84 [02:25:23] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.58, 3.78, 3.33 [02:25:50] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 7.31, 9.34, 11.96 [02:26:20] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 2.37, 2.51, 3.30 [02:29:21] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.30, 4.46, 3.72 [02:31:19] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.42, 3.69, 3.53 [02:33:18] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.55, 3.15, 3.34 [02:33:35] PROBLEM - cp33 NTP time on cp33 is WARNING: NTP WARNING: Offset 0.3082544506 secs [02:35:22] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.08, 9.97, 10.62 [02:35:50] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.83, 8.18, 10.03 [02:37:22] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.30, 9.62, 10.39 [02:37:33] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.20, 3.43, 2.49 [02:39:22] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 14.84, 11.14, 10.83 [02:39:33] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.83, 2.82, 2.39 [02:39:50] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 19.38, 12.82, 11.37 [02:43:22] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.38, 11.38, 11.17 [02:43:31] RECOVERY - cp22 NTP time on cp22 is OK: NTP OK: Offset 0.08502626419 secs [02:45:22] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.84, 12.28, 11.54 [02:47:09] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 4.94, 3.87, 3.18 [02:47:22] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.32, 11.83, 11.48 [02:49:05] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.46, 3.74, 3.22 [02:51:00] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 3.18, 3.38, 3.14 [02:58:05] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 6.30, 5.71, 4.19 [03:03:22] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 19.68, 13.81, 11.83 [03:03:35] RECOVERY - cp33 NTP time on cp33 is OK: NTP OK: Offset -0.005420893431 secs [03:08:24] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.46, 3.35, 3.11 [03:09:22] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.07, 11.50, 11.79 [03:10:20] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 5.71, 4.20, 3.45 [03:11:22] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.02, 12.17, 12.01 [03:15:22] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.27, 10.78, 11.56 [03:16:20] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 2.25, 3.65, 3.58 [03:18:05] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.02, 2.34, 3.89 [03:18:20] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 1.29, 2.93, 3.33 [03:19:50] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.14, 10.30, 11.87 [03:22:05] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.17, 2.01, 3.38 [03:23:22] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 14.50, 10.70, 10.87 [03:25:22] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 6.95, 9.38, 10.39 [03:27:22] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.80, 8.76, 10.03 [03:27:50] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 14.31, 10.70, 11.34 [03:30:20] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.10, 3.48, 3.36 [03:31:22] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.80, 10.16, 10.46 [03:31:50] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 7.86, 10.23, 11.13 [03:32:20] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 1.59, 2.88, 3.16 [03:33:22] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.58, 10.71, 10.60 [03:35:22] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.66, 10.26, 10.48 [03:35:24] PROBLEM - mabi.myomi.net - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - mabi.myomi.net All nameservers failed to answer the query. [03:37:22] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 5.81, 9.00, 10.02 [03:37:50] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 4.50, 7.34, 9.62 [03:43:22] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 18.87, 12.60, 10.91 [03:43:50] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 16.06, 12.86, 11.18 [03:44:20] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 4.68, 3.87, 3.23 [03:45:50] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.20, 11.80, 11.00 [03:46:20] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.66, 3.92, 3.34 [03:47:22] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.90, 11.59, 11.07 [03:48:20] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 2.03, 3.18, 3.14 [03:49:50] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 5.99, 8.56, 9.82 [03:51:17] PROBLEM - cp23 NTP time on cp23 is WARNING: NTP WARNING: Offset 0.1244527698 secs [03:51:22] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.20, 10.33, 10.57 [03:53:22] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.34, 10.63, 10.69 [03:53:50] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.16, 10.30, 10.28 [03:55:50] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.54, 8.98, 9.78 [03:57:22] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 5.47, 8.25, 9.74 [04:05:22] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.02, 10.53, 9.96 [04:07:22] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 5.66, 8.69, 9.35 [04:15:17] RECOVERY - cp23 NTP time on cp23 is OK: NTP OK: Offset 0.08908763528 secs [04:18:56] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.91, 3.12, 2.49 [04:20:54] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.62, 3.69, 2.76 [04:22:03] PROBLEM - cp32 NTP time on cp32 is WARNING: NTP WARNING: Offset 0.2027074397 secs [04:22:14] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.84, 10.50, 9.63 [04:22:20] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 2.91, 3.48, 3.07 [04:22:53] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.35, 3.43, 2.77 [04:23:31] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.15, 10.66, 9.72 [04:24:11] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.69, 9.69, 9.45 [04:24:20] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 1.16, 2.67, 2.82 [04:24:51] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.73, 3.20, 2.77 [04:25:27] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 9.55, 9.80, 9.48 [04:28:03] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.55, 10.91, 10.06 [04:28:47] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.27, 3.41, 3.03 [04:30:00] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.64, 9.73, 9.73 [04:30:45] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.38, 2.75, 2.84 [04:33:15] PROBLEM - mabi.myomi.net - reverse DNS on sslhost is WARNING: Timeout: The DNS operation timed out after 5.406928539276123 seconds [04:40:20] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.73, 3.59, 3.18 [04:44:20] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 1.75, 2.93, 3.03 [04:48:03] RECOVERY - cp32 NTP time on cp32 is OK: NTP OK: Offset 0.0786973238 secs [04:55:24] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.36, 3.69, 3.11 [04:59:21] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.73, 2.81, 2.90 [05:03:13] PROBLEM - mabi.myomi.net - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - mabi.myomi.net All nameservers failed to answer the query. [05:03:22] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 17.15, 10.47, 8.66 [05:04:14] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.31, 11.54, 9.35 [05:04:20] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 4.44, 3.95, 3.23 [05:05:22] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.42, 11.24, 9.21 [05:06:10] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 6.10, 9.40, 8.83 [05:06:20] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 1.71, 3.10, 3.00 [05:07:22] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 5.45, 9.10, 8.68 [05:17:50] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.76, 10.60, 9.08 [05:19:09] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.25, 3.44, 3.14 [05:19:50] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.57, 9.13, 8.71 [05:21:05] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 1.75, 2.76, 2.92 [05:33:14] RECOVERY - mabi.myomi.net - reverse DNS on sslhost is OK: SSL OK - mabi.myomi.net reverse DNS resolves to cp23.miraheze.org - CNAME OK [05:39:44] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.79, 10.61, 8.89 [05:39:50] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 16.08, 12.00, 9.42 [05:40:26] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.49, 3.44, 2.92 [05:41:41] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 5.97, 8.82, 8.44 [05:41:50] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.68, 10.59, 9.23 [05:42:22] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 2.00, 2.95, 2.80 [05:43:50] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.00, 9.54, 8.99 [05:57:31] PROBLEM - cp22 NTP time on cp22 is WARNING: NTP WARNING: Offset 0.1305635571 secs [06:00:56] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 4.85, 3.55, 2.98 [06:04:47] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 1.74, 3.17, 3.01 [06:09:31] RECOVERY - cp22 NTP time on cp22 is OK: NTP OK: Offset 0.09379044175 secs [06:34:52] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=thechroniclesofosrethwiki --no-updates --username-prefix=wikia:the-chronicles-of-osreth /home/reception/ImportDump/thechroniclesofosrethwiki-20230224194342.xml (START) [06:34:56] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:40:20] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 5.07, 3.44, 2.73 [06:42:05] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=thechroniclesofosrethwiki --no-updates --username-prefix=wikia:the-chronicles-of-osreth /home/reception/ImportDump/thechroniclesofosrethwiki-20230224194342.xml (END - exit=0) [06:42:06] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=thechroniclesofosrethwiki (START) [06:42:10] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:42:13] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:42:20] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 2.19, 2.97, 2.65 [06:43:52] !log added notaracham and raidarr to cvt@ ldap [06:43:56] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:46:14] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=thechroniclesofosrethwiki (END - exit=0) [06:46:15] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/initSiteStats.php --wiki=thechroniclesofosrethwiki --active --update (END - exit=0) [06:46:18] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:46:21] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:07:17] PROBLEM - cp23 NTP time on cp23 is WARNING: NTP WARNING: Offset 0.1194567978 secs [07:39:17] RECOVERY - cp23 NTP time on cp23 is OK: NTP OK: Offset 0.08968421817 secs [07:51:17] PROBLEM - cp23 NTP time on cp23 is WARNING: NTP WARNING: Offset 0.1100895405 secs [07:54:05] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.82, 3.31, 2.21 [07:55:17] RECOVERY - cp23 NTP time on cp23 is OK: NTP OK: Offset 0.09053638577 secs [07:56:05] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.04, 2.76, 2.14 [09:10:43] RECOVERY - cloud11 IPMI Sensors on cloud11 is OK: IPMI Status: OK [09:14:43] PROBLEM - cloud11 IPMI Sensors on cloud11 is CRITICAL: IPMI Status: Critical [Cntlr 2 Bay 7 = Critical] [09:54:38] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.37, 3.12, 1.94 [09:56:36] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.85, 2.69, 1.94 [10:17:17] PROBLEM - cp23 NTP time on cp23 is WARNING: NTP WARNING: Offset 0.3153935075 secs [10:29:17] RECOVERY - cp23 NTP time on cp23 is OK: NTP OK: Offset -0.01454141736 secs [10:54:43] RECOVERY - cloud11 IPMI Sensors on cloud11 is OK: IPMI Status: OK [10:58:43] PROBLEM - cloud11 IPMI Sensors on cloud11 is CRITICAL: IPMI Status: Critical [Cntlr 2 Bay 7 = Critical] [11:09:42] PROBLEM - fid.koyomi-ya.net - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - fid.koyomi-ya.net All nameservers failed to answer the query. [11:24:38] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.77, 3.47, 2.32 [11:26:37] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.34, 2.70, 2.18 [11:38:24] RECOVERY - fid.koyomi-ya.net - reverse DNS on sslhost is OK: SSL OK - fid.koyomi-ya.net reverse DNS resolves to cp22.miraheze.org - CNAME OK [12:23:17] PROBLEM - cp23 NTP time on cp23 is WARNING: NTP WARNING: Offset 0.1565415859 secs [12:51:17] RECOVERY - cp23 NTP time on cp23 is OK: NTP OK: Offset 0.07369160652 secs [13:21:50] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.10, 10.30, 8.25 [13:23:50] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 9.76, 9.97, 8.37 [13:24:41] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.38, 4.13, 2.68 [13:27:17] PROBLEM - cp23 NTP time on cp23 is WARNING: NTP WARNING: Offset -0.1220106184 secs [13:29:05] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.56, 9.93, 8.31 [13:31:03] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.60, 8.88, 8.11 [13:31:50] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.71, 10.91, 9.38 [13:32:36] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.88, 3.98, 3.24 [13:33:50] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.02, 10.73, 9.52 [13:35:50] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 9.25, 10.08, 9.42 [13:36:33] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.23, 2.67, 2.88 [13:43:17] RECOVERY - cp23 NTP time on cp23 is OK: NTP OK: Offset -0.08648303151 secs [13:52:20] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.28, 3.45, 2.72 [13:56:17] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.54, 3.24, 2.85 [14:22:06] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 13.38, 6.19, 3.70 [14:26:05] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.62, 3.91, 3.36 [14:28:05] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.47, 3.17, 3.16 [14:42:44] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.47, 10.09, 8.97 [14:46:36] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 9.79, 9.66, 9.01 [14:50:30] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.44, 10.62, 9.57 [14:52:26] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.30, 11.06, 9.84 [14:55:22] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.96, 10.11, 9.35 [14:57:22] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 16.04, 12.14, 10.18 [15:01:22] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.89, 11.74, 10.50 [15:03:21] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.18, 12.09, 10.77 [15:05:22] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.27, 11.93, 10.91 [15:05:58] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.43, 11.92, 11.65 [15:06:39] PROBLEM - wiki.beergeeks.co.il - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.beergeeks.co.il All nameservers failed to answer the query. [15:07:22] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.49, 12.31, 11.18 [15:09:17] PROBLEM - cp23 NTP time on cp23 is WARNING: NTP WARNING: Offset 0.1679292917 secs [15:09:22] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.36, 10.95, 10.83 [15:11:50] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 14.76, 12.51, 11.82 [15:13:50] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.81, 11.68, 11.62 [15:14:47] [02MirahezeMagic] 07Reception123 closed pull request 03#406: Various changes to group system messages i18n - 13https://github.com/miraheze/MirahezeMagic/pull/406 [15:14:51] [02miraheze/MirahezeMagic] 07Reception123 pushed 031 commit to 03master [+0/-0/±31] 13https://github.com/miraheze/MirahezeMagic/compare/2feeedf620f3...951709a20e7b [15:14:53] [02miraheze/MirahezeMagic] 07AgentIsai 03951709a - Various changes to group system messages i18n (#406) [15:17:50] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.35, 11.87, 11.68 [15:18:26] miraheze/MirahezeMagic - Reception123 the build has errored. [15:20:20] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 4.16, 3.06, 2.50 [15:21:50] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.30, 11.56, 11.62 [15:23:21] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 9.87, 9.57, 10.11 [15:24:20] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 2.14, 3.03, 2.67 [15:29:22] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.81, 10.66, 10.43 [15:35:22] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.96, 12.20, 11.03 [15:36:33] RECOVERY - wiki.beergeeks.co.il - reverse DNS on sslhost is OK: SSL OK - wiki.beergeeks.co.il reverse DNS resolves to cp23.miraheze.org - CNAME OK [15:37:22] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.79, 11.12, 10.79 [15:41:17] RECOVERY - cp23 NTP time on cp23 is OK: NTP OK: Offset 0.09496277571 secs [15:41:22] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.05, 8.79, 9.90 [15:43:50] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.87, 8.73, 9.90 [15:48:02] [02mw-config] 07brandon-wm opened pull request 03#5134: T10445: configure wgKartographerSrcsetScales for leborkwiki - 13https://github.com/miraheze/mw-config/pull/5134 [15:48:30] [02mw-config] 07brandon-wm edited pull request 03#5134: T10547: configure wgKartographerSrcsetScales for bluepageswiki - 13https://github.com/miraheze/mw-config/pull/5134 [15:49:24] [02mw-config] 07brandon-wm commented on pull request 03#5134: T10547: configure wgKartographerSrcsetScales for bluepageswiki - 13https://github.com/miraheze/mw-config/pull/5134#issuecomment-1445146298 [15:51:25] [02mw-config] 07brandon-wm edited a comment on pull request 03#5134: T10547: configure wgKartographerSrcsetScales for bluepageswiki - 13https://github.com/miraheze/mw-config/pull/5134#issuecomment-1445146298 [15:55:22] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.88, 10.55, 9.75 [15:58:35] [02miraheze/dns] 07Reception123 pushed 031 commit to 03master [+1/-0/±0] 13https://github.com/miraheze/dns/compare/00bdc5720e7f...af7407c38e33 [15:58:36] [02miraheze/dns] 07Reception123 03af7407c - add lebork.info.pl zone [15:59:22] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.96, 10.89, 10.09 [15:59:58] miraheze/mw-config - brandon-wm the build passed. [16:07:22] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.03, 9.48, 9.80 [16:22:48] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.28, 4.88, 3.23 [16:26:11] [02mw-config] 07brandon-wm synchronize pull request 03#5134: T10547: configure wgKartographerSrcsetScales for bluepageswiki - 13https://github.com/miraheze/mw-config/pull/5134 [16:28:44] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.96, 4.00, 3.38 [16:30:42] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.56, 3.22, 3.18 [16:34:57] [02mw-config] 07brandon-wm opened pull request 03#5135: Update for Code of Conduct.md - 13https://github.com/miraheze/mw-config/pull/5135 [16:37:21] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 14.15, 11.11, 9.58 [16:39:22] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.29, 11.26, 9.83 [16:43:22] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.46, 9.44, 9.43 [16:59:06] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.07, 10.22, 9.73 [17:03:00] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.29, 11.11, 10.14 [17:03:50] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.82, 10.43, 9.80 [17:05:50] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.40, 11.49, 10.25 [17:06:55] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.36, 11.76, 10.70 [17:07:50] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.15, 10.51, 10.05 [17:08:04] PROBLEM - wiki.zulaclub.net - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query zulaclub.net. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [17:09:50] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 9.93, 10.12, 9.94 [17:09:54] PROBLEM - cp23 NTP time on cp23 is WARNING: NTP WARNING: Offset 0.1044743359 secs [17:10:50] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.90, 11.84, 10.93 [17:12:47] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.12, 11.21, 10.82 [17:15:51] RECOVERY - cp23 NTP time on cp23 is OK: NTP OK: Offset 0.09888106585 secs [17:21:50] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.72, 10.55, 10.09 [17:23:50] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 9.59, 9.93, 9.90 [17:26:28] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.93, 9.69, 10.11 [17:26:43] RECOVERY - cloud11 IPMI Sensors on cloud11 is OK: IPMI Status: OK [17:27:45] PROBLEM - cp23 NTP time on cp23 is WARNING: NTP WARNING: Offset 0.1507329047 secs [17:30:43] PROBLEM - cloud11 IPMI Sensors on cloud11 is CRITICAL: IPMI Status: Critical [Cntlr 2 Bay 7 = Critical] [17:35:41] RECOVERY - cp23 NTP time on cp23 is OK: NTP OK: Offset 0.09634238482 secs [17:36:34] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.54, 3.11, 2.30 [17:36:39] RECOVERY - wiki.zulaclub.net - reverse DNS on sslhost is OK: SSL OK - wiki.zulaclub.net reverse DNS resolves to cp22.miraheze.org - CNAME OK [17:38:34] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.14, 2.77, 2.28 [17:54:42] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 6.91, 4.18, 2.84 [17:56:40] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.70, 3.77, 2.87 [17:58:39] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.96, 3.17, 2.76 [18:06:30] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.69, 4.38, 2.73 [18:06:48] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.57, 10.42, 9.50 [18:08:30] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.75, 3.67, 2.67 [18:08:45] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.78, 10.03, 9.48 [18:10:28] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.42, 3.04, 2.77 [18:10:29] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 0.94, 2.66, 2.42 [18:11:43] PROBLEM - cp33 APT on cp33 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [18:12:27] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.57, 3.17, 2.87 [18:14:37] RECOVERY - cp33 APT on cp33 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [18:22:36] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.86, 9.72, 8.96 [18:24:16] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 8.73, 5.81, 3.99 [18:24:32] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.61, 9.38, 8.94 [18:25:22] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.97, 10.09, 9.36 [18:27:20] PROBLEM - cp23 NTP time on cp23 is WARNING: NTP WARNING: Offset -0.1096742749 secs [18:27:22] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.01, 10.67, 9.66 [18:31:22] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.84, 11.32, 10.16 [18:33:18] RECOVERY - cp23 NTP time on cp23 is OK: NTP OK: Offset -0.08682382107 secs [18:33:22] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.49, 11.62, 10.39 [18:34:08] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.95, 3.66, 3.71 [18:35:13] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.74, 10.75, 9.77 [18:37:09] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.29, 11.29, 10.08 [18:40:05] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.43, 3.73, 3.64 [18:42:05] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.49, 3.78, 3.68 [18:42:57] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.49, 11.02, 10.45 [18:43:05] PROBLEM - cp33 APT on cp33 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [18:43:22] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.09, 10.93, 11.10 [18:46:22] miraheze/mw-config - brandon-wm the build passed. [18:47:12] PROBLEM - es141 Current Load on es141 is WARNING: WARNING - load average: 3.56, 2.21, 1.17 [18:48:34] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.94, 3.31, 2.61 [18:48:40] RECOVERY - cp33 APT on cp33 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [18:48:45] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.57, 11.32, 10.62 [18:49:06] RECOVERY - es141 Current Load on es141 is OK: OK - load average: 2.12, 2.18, 1.29 [18:49:22] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.33, 10.68, 10.78 [18:49:49] [02mw-config] 07Reception123 closed pull request 03#5134: T10547: configure wgKartographerSrcsetScales for bluepageswiki - 13https://github.com/miraheze/mw-config/pull/5134 [18:49:50] [02miraheze/mw-config] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/7c1ebd7af3a5...f3c9307870a1 [18:49:52] [02miraheze/mw-config] 07brandon-wm 03f3c9307 - T10547: configure wgKartographerSrcsetScales for bluepageswiki (#5134) [18:50:30] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 2.87, 3.22, 2.67 [18:50:41] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.21, 11.56, 10.82 [18:50:46] miraheze/mw-config - Reception123 the build passed. [18:51:22] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.04, 9.80, 10.43 [18:54:05] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.11, 4.27, 3.84 [18:55:22] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.47, 9.25, 10.08 [18:56:05] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.33, 3.53, 3.62 [18:56:29] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.68, 9.14, 10.03 [18:56:47] !log [@test131] starting deploy of {'config': True} to all [18:56:49] !log [@test131] finished deploy of {'config': True} to all - SUCCESS in 0s [18:56:52] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:56:58] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:58:05] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 6.91, 4.44, 3.92 [18:59:07] miraheze/mw-config - brandon-wm the build passed. [19:02:05] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.37, 3.63, 3.76 [19:02:07] [02mw-config] 07brandon-wm synchronize pull request 03#5135: Update for Code of Conduct.md - 13https://github.com/miraheze/mw-config/pull/5135 [19:03:14] miraheze/mw-config - brandon-wm the build passed. [19:04:07] [02mw-config] 07Universal-Omega commented on pull request 03#5135: Update for Code of Conduct.md - 13https://github.com/miraheze/mw-config/pull/5135#issuecomment-1445183561 [19:06:05] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.16, 2.34, 3.20 [19:07:22] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.61, 10.96, 10.29 [19:08:09] [02mw-config] 07brandon-wm synchronize pull request 03#5135: Update for Code of Conduct.md - 13https://github.com/miraheze/mw-config/pull/5135 [19:08:48] [02mw-config] 07brandon-wm commented on pull request 03#5135: Update for Code of Conduct.md - 13https://github.com/miraheze/mw-config/pull/5135#issuecomment-1445184447 [19:09:05] miraheze/mw-config - brandon-wm the build passed. [19:09:22] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 6.81, 9.26, 9.74 [19:10:30] !log [@mwtask141] starting deploy of {'config': True} to all [19:10:33] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:10:38] !log [@mwtask141] finished deploy of {'config': True} to all - SUCCESS in 8s [19:10:42] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:24:22] [02miraheze/puppet] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/bedbbf259236...a89b93af731f [19:24:23] [02miraheze/puppet] 07Universal-Omega 03a89b93a - Update Code of Conduct to use MsCoC [19:24:32] [02mw-config] 07Universal-Omega closed pull request 03#5135: Update for Code of Conduct.md - 13https://github.com/miraheze/mw-config/pull/5135 [19:24:33] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/f3c9307870a1...eadb79bad376 [19:24:34] [02miraheze/mw-config] 07brandon-wm 03eadb79b - Update for Code of Conduct.md (#5135) [19:25:34] miraheze/mw-config - Universal-Omega the build passed. [19:26:57] !log [@test131] starting deploy of {'config': True} to all [19:26:58] !log [@test131] finished deploy of {'config': True} to all - SUCCESS in 0s [19:27:01] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:27:06] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:27:52] [02miraheze/ManageWiki] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ManageWiki/compare/89ef331940bd...2509cee91d29 [19:27:55] [02miraheze/ManageWiki] 07Universal-Omega 032509cee - Update Code of Conduct to use MsCoC [19:28:36] [02miraheze/dns] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/dns/compare/af7407c38e33...4fbef5f21e45 [19:28:38] [02miraheze/dns] 07Universal-Omega 034fbef5f - Update Code of Conduct to use MsCoC [19:29:35] [02miraheze/ssl] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/4919097b1d31...43766a6af743 [19:29:38] [02miraheze/ssl] 07Universal-Omega 0343766a6 - Update Code of Conduct to use MsCoC and Special:MyLanguage [19:30:25] [02miraheze/IncidentReporting] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/IncidentReporting/compare/319ac5e09abd...d6ef7847f11b [19:30:26] [02miraheze/IncidentReporting] 07Universal-Omega 03d6ef784 - Update Code of Conduct to use MsCoC and Special:MyLanguage [19:30:39] miraheze/ManageWiki - Universal-Omega the build has errored. [19:31:20] [02miraheze/MatomoAnalytics] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/MatomoAnalytics/compare/d9d08c3b8610...80c87e1035f1 [19:31:23] [02miraheze/MatomoAnalytics] 07Universal-Omega 0380c87e1 - Update Code of Conduct to use MsCoC and Special:MyLanguage [19:32:32] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.46, 9.50, 8.79 [19:33:43] miraheze/IncidentReporting - Universal-Omega the build passed. [19:34:28] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.99, 8.81, 8.62 [19:36:14] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.69, 10.72, 9.68 [19:38:11] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 9.64, 10.18, 9.60 [19:38:16] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 6.02, 4.11, 2.82 [19:39:01] PROBLEM - cp32 APT on cp32 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [19:40:15] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.80, 3.75, 2.84 [19:40:47] !log [@mwtask141] starting deploy of {'config': True} to all [19:40:51] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:40:54] !log [@mwtask141] finished deploy of {'config': True} to all - SUCCESS in 7s [19:40:58] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:41:35] PROBLEM - cp33 NTP time on cp33 is WARNING: NTP WARNING: Offset 0.2036814392 secs [19:43:51] RECOVERY - cp32 APT on cp32 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [19:46:14] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.76, 3.05, 2.88 [19:52:03] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=megatenwiki --no-updates --username-prefix=wikia:megamitensei /home/reception/ImportDump/megatenwiki-20230225195114.xml (START) [19:52:07] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:52:47] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.23, 3.29, 2.64 [19:53:51] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=megatenwiki --no-updates --username-prefix=wikia:megamitensei /home/reception/ImportDump/megatenwiki-20230225195114.xml (END - exit=0) [19:53:52] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=megatenwiki (START) [19:53:56] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:54:01] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:55:36] RECOVERY - cp33 NTP time on cp33 is OK: NTP OK: Offset -0.01656237245 secs [19:58:43] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.81, 3.24, 2.90 [20:01:40] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=megatenwiki (END - exit=0) [20:01:41] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/initSiteStats.php --wiki=megatenwiki --active --update (END - exit=0) [20:01:43] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:01:47] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:08:23] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.47, 10.13, 9.54 [20:10:20] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.29, 9.81, 9.52 [20:10:35] [Grafana] !sre FIRING: The mediawiki job queue has more than 2500 unclaimed jobs https://grafana.miraheze.org/d/GtxbP1Xnk?orgId=1 [20:13:27] [02MirahezeMagic] 07Universal-Omega synchronize pull request 03#392: Create community portals on wiki creation - 13https://github.com/miraheze/MirahezeMagic/pull/392 [20:15:05] [02MirahezeMagic] 07Universal-Omega synchronize pull request 03#392: Create community portals on wiki creation - 13https://github.com/miraheze/MirahezeMagic/pull/392 [20:15:43] [02MirahezeMagic] 07Universal-Omega synchronize pull request 03#392: Create community portals on wiki creation - 13https://github.com/miraheze/MirahezeMagic/pull/392 [20:16:55] [02MirahezeMagic] 07Universal-Omega synchronize pull request 03#392: Create community portals on wiki creation - 13https://github.com/miraheze/MirahezeMagic/pull/392 [20:17:55] miraheze/MirahezeMagic - Universal-Omega the build has errored. [20:18:35] [02MirahezeMagic] 07Universal-Omega synchronize pull request 03#392: Create community portals on wiki creation - 13https://github.com/miraheze/MirahezeMagic/pull/392 [20:19:37] miraheze/MirahezeMagic - Universal-Omega the build has errored. [20:20:32] miraheze/MirahezeMagic - Universal-Omega the build has errored. [20:21:15] miraheze/MirahezeMagic - Universal-Omega the build has errored. [20:22:31] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 6.03, 5.93, 4.01 [20:22:50] [02miraheze/CreateWiki] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-6 [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/commit/a4b8aa260030 [20:22:52] [02miraheze/CreateWiki] 07Universal-Omega 03a4b8aa2 - Pass $cwdb to CreateWikiCreation hook [20:22:53] [02CreateWiki] 07Universal-Omega created branch 03Universal-Omega-patch-6 - 13https://github.com/miraheze/CreateWiki [20:22:55] [02CreateWiki] 07Universal-Omega opened pull request 03#390: Pass $cwdb to CreateWikiCreation hook - 13https://github.com/miraheze/CreateWiki/pull/390 [20:23:31] miraheze/MirahezeMagic - Universal-Omega the build has errored. [20:23:56] [02miraheze/CreateWiki] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-6 [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/a4b8aa260030...c7d8a42a889e [20:23:58] [02miraheze/CreateWiki] 07Universal-Omega 03c7d8a42 - Update CreateWikiCreationHook.php [20:24:00] [02CreateWiki] 07Universal-Omega synchronize pull request 03#390: Pass $cwdb to CreateWikiCreation hook - 13https://github.com/miraheze/CreateWiki/pull/390 [20:24:11] PROBLEM - test131 MediaWiki Rendering on test131 is CRITICAL: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - 314 bytes in 0.054 second response time [20:24:43] [02miraheze/CreateWiki] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-6 [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/c7d8a42a889e...2ea997478993 [20:24:44] [02miraheze/CreateWiki] 07Universal-Omega 032ea9974 - Update WikiManager.php [20:24:45] [02CreateWiki] 07Universal-Omega synchronize pull request 03#390: Pass $cwdb to CreateWikiCreation hook - 13https://github.com/miraheze/CreateWiki/pull/390 [20:24:51] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.01, 10.89, 9.75 [20:25:29] [02miraheze/CreateWiki] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-6 [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/2ea997478993...dab888ce9942 [20:25:30] [02miraheze/CreateWiki] 07Universal-Omega 03dab888c - Update CreateWikiHookRunner.php [20:25:32] [02CreateWiki] 07Universal-Omega synchronize pull request 03#390: Pass $cwdb to CreateWikiCreation hook - 13https://github.com/miraheze/CreateWiki/pull/390 [20:25:53] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.54, 10.76, 9.98 [20:26:47] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.40, 10.60, 9.75 [20:28:11] RECOVERY - test131 MediaWiki Rendering on test131 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.351 second response time [20:29:15] miraheze/CreateWiki - Universal-Omega the build has errored. [20:29:48] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.44, 9.60, 9.73 [20:30:30] !log [reception@test131] starting deploy of {'l10n': True, 'lang': 'en'} to all [20:30:32] !log [reception@test131] finished deploy of {'l10n': True, 'lang': 'en'} to all - SUCCESS in 2s [20:30:33] PROBLEM - test131 Puppet on test131 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[Landing Sync] [20:30:34] [02MirahezeMagic] 07Universal-Omega synchronize pull request 03#392: Create community portals on wiki creation - 13https://github.com/miraheze/MirahezeMagic/pull/392 [20:30:40] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:30:52] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:32:24] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.69, 3.32, 3.72 [20:32:35] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.46, 11.70, 10.44 [20:33:32] [02miraheze/ManageWiki] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-2 [+0/-0/±1] 13https://github.com/miraheze/ManageWiki/commit/02947f04db2d [20:33:35] [02miraheze/ManageWiki] 07Universal-Omega 0302947f0 - Pass $cwdb to the CreateWikiCreation hook [20:33:35] [02ManageWiki] 07Universal-Omega created branch 03Universal-Omega-patch-2 - 13https://github.com/miraheze/ManageWiki [20:33:39] [02ManageWiki] 07Universal-Omega opened pull request 03#387: Pass $cwdb to the CreateWikiCreation hook - 13https://github.com/miraheze/ManageWiki/pull/387 [20:33:40] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.23, 10.90, 10.22 [20:34:05] miraheze/MirahezeMagic - Universal-Omega the build has errored. [20:34:20] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 4.05, 3.47, 2.69 [20:34:58] [02miraheze/ManageWiki] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-2 [+0/-0/±1] 13https://github.com/miraheze/ManageWiki/compare/02947f04db2d...02f5294ee319 [20:35:00] [02miraheze/ManageWiki] 07Universal-Omega 0302f5294 - Update Hooks.php [20:35:02] [02ManageWiki] 07Universal-Omega synchronize pull request 03#387: Pass $cwdb to the CreateWikiCreation hook - 13https://github.com/miraheze/ManageWiki/pull/387 [20:35:37] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.44, 10.97, 10.35 [20:36:20] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.96, 3.73, 2.89 [20:36:21] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.60, 2.37, 3.23 [20:36:27] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.00, 11.38, 10.64 [20:36:33] [02CreateWiki] 07Universal-Omega commented on pull request 03#390: Pass $cwdb to CreateWikiCreation hook - 13https://github.com/miraheze/CreateWiki/pull/390#issuecomment-1445201530 [20:37:46] miraheze/ManageWiki - Universal-Omega the build has errored. [20:38:20] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 2.84, 3.24, 2.80 [20:40:19] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.70, 11.18, 10.65 [20:41:21] [02miraheze/.github] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/.github/compare/506c8bef47ae...34e27498779c [20:41:24] [02miraheze/.github] 07Universal-Omega 0334e2749 - Set PHPUnit for master to expermental [20:41:29] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.43, 9.86, 10.16 [20:41:43] [02miraheze/IncidentReporting] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/IncidentReporting/compare/d6ef7847f11b...83051a99968e [20:41:45] [02miraheze/IncidentReporting] 07Universal-Omega 0383051a9 - Update workflow [20:41:47] [02miraheze/GlobalNewFiles] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/GlobalNewFiles/compare/212ea33c24f7...f4b0ded6c325 [20:41:48] [02miraheze/GlobalNewFiles] 07Universal-Omega 03f4b0ded - Update workflow [20:41:49] [02miraheze/CustomHeader] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/CustomHeader/compare/ad4b535f4d42...a5b233ef1cf7 [20:41:51] [02miraheze/CustomHeader] 07Universal-Omega 03a5b233e - Update workflow [20:41:52] [02miraheze/WikiDiscover] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/WikiDiscover/compare/64d6bb35405a...df45efc21b2b [20:41:53] [02miraheze/WikiDiscover] 07Universal-Omega 03df45efc - Update workflow [20:41:55] [02miraheze/RemovePII] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/RemovePII/compare/27e41ada7829...8da822806e13 [20:41:57] [02miraheze/RemovePII] 07Universal-Omega 038da8228 - Update workflow [20:41:58] [02miraheze/ManageWiki] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ManageWiki/compare/2509cee91d29...bf1f90c76057 [20:42:00] [02miraheze/ManageWiki] 07Universal-Omega 03bf1f90c - Update workflow [20:42:01] [02miraheze/RottenLinks] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/RottenLinks/compare/1e5d0cead3eb...389a11a3d1bb [20:42:02] [02miraheze/RottenLinks] 07Universal-Omega 03389a11a - Update workflow [20:42:04] [02miraheze/DataDump] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/DataDump/compare/539b8ce7c71b...7de5bb239c76 [20:42:06] [02miraheze/DataDump] 07Universal-Omega 037de5bb2 - Update workflow [20:42:08] [02miraheze/MatomoAnalytics] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/MatomoAnalytics/compare/80c87e1035f1...d9777b9aa0c8 [20:42:09] [02miraheze/MatomoAnalytics] 07Universal-Omega 03d9777b9 - Update workflow [20:42:10] [02miraheze/SpriteSheet] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/SpriteSheet/compare/c33669fd7738...2e2a5d865002 [20:42:12] [02miraheze/SpriteSheet] 07Universal-Omega 032e2a5d8 - Update workflow [20:42:15] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.62, 10.68, 10.54 [20:42:15] [02miraheze/PDFEmbed] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/PDFEmbed/compare/4b7de97ff804...e97d4cc33c36 [20:42:17] [02miraheze/PDFEmbed] 07Universal-Omega 03e97d4cc - Update workflow [20:42:18] [02miraheze/MirahezeMagic] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/MirahezeMagic/compare/951709a20e7b...757acc5fd53c [20:42:19] [02miraheze/MirahezeMagic] 07Universal-Omega 03757acc5 - Update workflow [20:42:22] [02miraheze/CreateWiki] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/c02e78c41793...71dd09411043 [20:42:23] [02miraheze/CreateWiki] 07Universal-Omega 0371dd094 - Update workflow [20:42:25] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/39483a627676...48c5c08d7c89 [20:42:28] [02miraheze/ImportDump] 07Universal-Omega 0348c5c08 - Update workflow [20:42:31] [02miraheze/YouTube] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/YouTube/compare/682e4e66baf6...134eaf7a307c [20:42:33] [02miraheze/YouTube] 07Universal-Omega 03134eaf7 - Update workflow [20:42:34] [02MirahezeMagic] 07Universal-Omega synchronize pull request 03#392: Create community portals on wiki creation - 13https://github.com/miraheze/MirahezeMagic/pull/392 [20:42:41] [02miraheze/CreateWiki] 07Universal-Omega pushed 032 commits to 03Universal-Omega-patch-6 [+0/-0/±2] 13https://github.com/miraheze/CreateWiki/compare/dab888ce9942...dd784a10743c [20:42:42] [02miraheze/CreateWiki] 07Universal-Omega 03dd784a1 - Merge branch 'master' into Universal-Omega-patch-6 [20:42:45] [02CreateWiki] 07Universal-Omega synchronize pull request 03#390: Pass $cwdb to CreateWikiCreation hook - 13https://github.com/miraheze/CreateWiki/pull/390 [20:43:11] [02miraheze/ManageWiki] 07Universal-Omega pushed 032 commits to 03Universal-Omega-patch-2 [+0/-0/±2] 13https://github.com/miraheze/ManageWiki/compare/02f5294ee319...e309a25a57ce [20:43:14] [02miraheze/ManageWiki] 07Universal-Omega 03e309a25 - Merge branch 'master' into Universal-Omega-patch-2 [20:43:16] [02ManageWiki] 07Universal-Omega synchronize pull request 03#387: Pass $cwdb to the CreateWikiCreation hook - 13https://github.com/miraheze/ManageWiki/pull/387 [20:44:35] [02CreateWiki] 07Universal-Omega closed pull request 03#388: Test - 13https://github.com/miraheze/CreateWiki/pull/388 [20:44:37] [02miraheze/CreateWiki] 07Universal-Omega deleted branch 03Universal-Omega-patch-5 [20:44:40] [02CreateWiki] 07Universal-Omega deleted branch 03Universal-Omega-patch-5 - 13https://github.com/miraheze/CreateWiki [20:46:07] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.59, 10.58, 10.45 [20:48:03] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.08, 10.14, 10.29 [20:49:22] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.86, 11.10, 10.42 [20:51:22] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.54, 10.42, 10.26 [20:53:51] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.68, 9.50, 10.04 [20:55:22] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.31, 9.42, 9.94 [20:58:29] miraheze/IncidentReporting - Universal-Omega the build passed. [20:58:31] RECOVERY - test131 Puppet on test131 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [20:58:34] miraheze/GlobalNewFiles - Universal-Omega the build passed. [20:58:41] miraheze/CustomHeader - Universal-Omega the build passed. [20:58:48] miraheze/WikiDiscover - Universal-Omega the build passed. [20:59:04] miraheze/RemovePII - Universal-Omega the build passed. [20:59:10] miraheze/RottenLinks - Universal-Omega the build passed. [20:59:15] miraheze/DataDump - Universal-Omega the build passed. [20:59:17] miraheze/MatomoAnalytics - Universal-Omega the build passed. [20:59:22] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.36, 10.48, 10.24 [20:59:24] miraheze/SpriteSheet - Universal-Omega the build passed. [21:01:22] miraheze/PDFEmbed - Universal-Omega the build passed. [21:03:14] miraheze/YouTube - Universal-Omega the build passed. [21:03:23] miraheze/MirahezeMagic - Universal-Omega the build passed. [21:04:52] miraheze/CreateWiki - Universal-Omega the build passed. [21:06:03] miraheze/ManageWiki - Universal-Omega the build passed. [21:06:56] miraheze/ImportDump - Universal-Omega the build passed. [21:08:29] miraheze/ManageWiki - Universal-Omega the build passed. [21:09:22] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.50, 9.92, 10.17 [21:09:57] miraheze/MirahezeMagic - Universal-Omega the build passed. [21:11:08] [02mw-config] 07thecutefinder opened pull request 03#5136: Add nofollow to genshinimpactwiki red links - 13https://github.com/miraheze/mw-config/pull/5136 [21:11:14] miraheze/CreateWiki - Universal-Omega the build passed. [21:21:22] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.27, 10.39, 9.99 [21:23:22] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.49, 11.13, 10.31 [21:25:22] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.63, 11.05, 10.39 [21:28:38] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.42, 4.12, 3.09 [21:29:22] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.73, 9.51, 9.93 [21:30:36] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.49, 3.79, 3.08 [21:32:35] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.55, 3.03, 2.89 [21:35:22] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.33, 10.55, 10.13 [21:37:22] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.35, 9.95, 9.99 [21:37:50] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.64, 9.79, 9.19 [21:39:50] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 9.95, 9.55, 9.17 [21:40:00] PROBLEM - cp33 NTP time on cp33 is WARNING: NTP WARNING: Offset 0.1449324787 secs [21:43:50] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 15.05, 12.55, 10.46 [21:45:22] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.39, 9.90, 9.81 [21:49:22] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.81, 10.49, 10.00 [21:49:50] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.09, 11.96, 10.92 [21:51:22] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.65, 9.71, 9.77 [21:52:19] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.74, 3.33, 2.92 [21:54:17] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.74, 3.65, 3.08 [22:03:50] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 6.93, 9.09, 10.00 [22:09:47] RECOVERY - cp33 NTP time on cp33 is OK: NTP OK: Offset 0.08311900496 secs [22:12:05] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.08, 2.68, 3.70 [22:16:20] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.62, 2.79, 2.37 [22:18:05] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 3.14, 2.77, 3.40 [22:18:20] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 3.37, 2.83, 2.43 [22:19:50] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.82, 10.32, 9.81 [22:21:50] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.18, 10.70, 10.00 [22:23:50] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.46, 9.78, 9.75 [22:24:34] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.33, 10.74, 9.73 [22:26:05] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.42, 3.64, 3.52 [22:26:31] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.07, 10.92, 9.92 [22:29:50] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.39, 11.85, 10.61 [22:30:05] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.62, 2.72, 3.18 [22:30:26] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.54, 9.73, 9.70 [22:31:50] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.82, 10.51, 10.26 [22:33:50] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.78, 9.66, 9.98 [22:43:50] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.52, 10.38, 9.96 [22:45:02] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.59, 10.23, 9.82 [22:45:50] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 9.28, 10.20, 9.96 [22:46:05] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.49, 3.54, 3.16 [22:46:59] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 14.91, 12.00, 10.51 [22:48:05] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.97, 3.17, 3.06 [22:48:56] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.83, 11.99, 10.70 [22:49:50] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.48, 11.18, 10.38 [22:51:50] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.84, 9.95, 10.04 [22:54:08] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 15.95, 9.26, 5.48 [22:54:29] PROBLEM - cp33 APT on cp33 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [22:56:24] [02miraheze/mediawiki] 07Universal-Omega pushed 03294 commits to 03REL1_39 [+22/-3/±1395] 13https://github.com/miraheze/mediawiki/compare/9f6f7df7f6d1...07843cc603dc [22:56:26] [02miraheze/mediawiki] 07reedy 03fb8122f - Start 1.39.2 [22:56:28] [02miraheze/mediawiki] 07lucaswerkmeister 03a128b08 - ChangeTags: Remove table name from condition [22:56:29] [02miraheze/mediawiki] 07translatewiki 03a13c052 - Localisation updates from https://translatewiki.net. [22:56:32] [02miraheze/mediawiki] ... and 291 more commits. [22:57:19] RECOVERY - cp33 APT on cp33 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [22:58:30] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.53, 2.97, 2.59 [22:58:43] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.60, 9.44, 10.04 [22:58:56] [02miraheze/mediawiki] 07Universal-Omega pushed 032 commits to 03REL1_39 [+0/-0/±2] 13https://github.com/miraheze/mediawiki/compare/07843cc603dc...baecb96f890a [22:58:59] [02miraheze/mediawiki] 07jdforrester 038c4f708 - Update git submodules [22:59:02] [02miraheze/mediawiki] 07Universal-Omega 03baecb96 - Merge branch 'wikimedia:REL1_39' into REL1_39 [23:00:26] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 1.92, 2.72, 2.55 [23:08:05] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.91, 2.99, 3.98 [23:11:50] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.64, 9.45, 9.16 [23:13:50] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 10.17, 9.78, 9.33 [23:14:05] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.81, 2.21, 3.34 [23:24:05] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.25, 3.76, 3.41 [23:28:05] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.71, 3.58, 3.44 [23:29:50] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.01, 10.22, 9.72 [23:30:05] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.36, 3.82, 3.55 [23:30:33] PROBLEM - test131 Puppet on test131 is CRITICAL: CRITICAL: Puppet has 20 failures. Last run 2 minutes ago with 20 failures. Failed resources (up to 3 shown): Exec[wikibase_composer],Exec[maps_composer],Exec[flow_composer],Exec[ipinfo_composer] [23:31:50] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.70, 9.56, 9.53 [23:32:05] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.82, 3.27, 3.40 [23:34:55] PROBLEM - es141 Current Load on es141 is CRITICAL: CRITICAL - load average: 4.12, 2.85, 1.52 [23:36:55] RECOVERY - es141 Current Load on es141 is OK: OK - load average: 2.11, 2.64, 1.61 [23:45:31] [02miraheze/puppet] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/puppet/commit/c2a4ca3599db [23:45:32] [02miraheze/puppet] 07Universal-Omega 03c2a4ca3 - mediawiki: use HTTP_PROXY in environment for composer install [23:45:34] [02puppet] 07Universal-Omega created branch 03Universal-Omega-patch-1 - 13https://github.com/miraheze/puppet [23:45:35] [02puppet] 07Universal-Omega opened pull request 03#3159: mediawiki: use HTTP_PROXY in environment for composer install - 13https://github.com/miraheze/puppet/pull/3159 [23:53:50] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.24, 10.81, 9.81 [23:55:50] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.71, 9.83, 9.59 [23:57:00] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 3.42, 4.01, 3.26 [23:58:13] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.70, 10.97, 9.92 [23:58:59] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.34, 3.08, 3.01 [23:59:50] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.17, 10.42, 9.89