[00:00:42] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 6.37, 4.33, 3.53 [00:02:05] PROBLEM - test131 NTP time on test131 is WARNING: NTP WARNING: Offset 0.4268141389 secs [00:03:38] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.97, 4.08, 3.15 [00:05:51] [02miraheze/puppet] 07paladox pushed 031 commit to 03opensearch [+205/-0/±0] 13https://github.com/miraheze/puppet/commit/bdb1e9bb136d [00:05:53] [02miraheze/puppet] 07paladox 03bdb1e9b - Introduce opensearch puppet module [00:05:56] [02puppet] 07paladox created branch 03opensearch - 13https://github.com/miraheze/puppet [00:06:03] [02puppet] 07paladox opened pull request 03#3110: Introduce opensearch puppet module - 13https://github.com/miraheze/puppet/pull/3110 [00:07:37] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.11, 3.39, 3.09 [00:09:19] PROBLEM - discordian.wiki - LetsEncrypt on sslhost is CRITICAL: connect to address discordian.wiki and port 443: Network is unreachableHTTP CRITICAL - Unable to open TCP socket [00:14:23] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 4.05, 3.33, 2.47 [00:14:58] PROBLEM - wiki.thesimswiki.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'www.thesimswiki.com' expires in 15 day(s) (Thu 19 Jan 2023 00:02:43 GMT +0000). [00:16:23] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 2.97, 3.15, 2.51 [00:16:33] RECOVERY - test131 NTP time on test131 is OK: NTP OK: Offset 0.0007618665695 secs [00:17:02] PROBLEM - cp22 Current Load on cp22 is CRITICAL: CRITICAL - load average: 8.46, 5.98, 3.21 [00:24:41] PROBLEM - www.thesimswiki.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'www.thesimswiki.com' expires in 15 day(s) (Thu 19 Jan 2023 00:02:43 GMT +0000). [00:25:02] RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 0.41, 3.10, 3.30 [00:26:36] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.05, 3.99, 3.31 [00:26:57] PROBLEM - test131 NTP time on test131 is WARNING: NTP WARNING: Offset 0.4217972755 secs [00:28:13] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.37, 10.06, 11.89 [00:29:29] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.46, 8.66, 11.56 [00:33:10] RECOVERY - test131 NTP time on test131 is OK: NTP OK: Offset 0.01297241449 secs [00:33:29] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.57, 9.83, 11.28 [00:34:36] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.56, 3.69, 3.61 [00:36:36] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.16, 2.81, 3.30 [00:36:55] !log [macfan@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=hotararewiki (END - exit=0) [00:36:56] !log [macfan@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/initSiteStats.php --wiki=hotararewiki --active --update (END - exit=0) [00:36:58] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:37:02] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:37:29] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.62, 10.93, 11.44 [00:38:10] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.57, 8.33, 10.08 [00:42:10] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.77, 11.08, 10.86 [00:43:29] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.80, 12.36, 11.91 [00:50:10] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.47, 10.88, 10.78 [00:52:10] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.57, 11.44, 11.03 [00:54:10] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.97, 12.26, 11.36 [00:54:35] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 6.34, 4.76, 3.49 [00:54:40] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 1.48, 1.75, 3.88 [00:58:10] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.54, 11.98, 11.56 [00:58:40] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 1.75, 1.71, 3.36 [01:00:34] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.93, 3.96, 3.72 [01:06:34] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 3.12, 3.00, 3.31 [01:10:10] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 19.79, 13.35, 11.91 [01:10:34] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 7.60, 4.54, 3.79 [01:12:34] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.87, 3.82, 3.62 [01:20:33] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.06, 3.08, 3.39 [01:24:04] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.06, 3.21, 3.95 [01:24:34] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 9.90, 5.37, 4.15 [01:30:05] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.61, 2.33, 3.33 [01:30:34] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.26, 3.29, 3.69 [01:32:34] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.01, 2.58, 3.38 [01:38:04] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 9.33, 5.59, 4.23 [01:52:04] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.74, 3.51, 3.98 [01:54:31] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.75, 3.54, 3.34 [01:56:10] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.76, 10.15, 11.73 [01:58:31] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.99, 3.04, 3.20 [02:02:04] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.09, 2.56, 3.30 [02:08:04] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.20, 5.36, 4.31 [02:08:10] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.46, 8.69, 10.15 [02:12:10] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 17.13, 12.31, 11.20 [02:20:04] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.70, 3.43, 3.88 [02:26:04] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.10, 2.66, 3.40 [02:30:10] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.14, 11.41, 11.85 [02:36:04] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.01, 3.57, 3.34 [02:40:04] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.37, 3.47, 3.39 [02:42:04] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.70, 4.12, 3.62 [02:43:29] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.71, 9.99, 11.76 [02:46:04] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.61, 3.93, 3.65 [02:46:10] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.67, 8.99, 10.14 [02:48:04] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.43, 4.15, 3.76 [02:52:04] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.30, 3.87, 3.76 [02:56:04] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.22, 3.78, 3.72 [02:57:29] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 15.99, 11.30, 10.94 [02:58:04] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.63, 3.29, 3.55 [03:00:05] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.52, 2.93, 3.38 [03:00:10] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.88, 11.28, 10.48 [03:01:29] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.87, 10.81, 10.90 [03:01:36] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 4.72, 3.16, 1.86 [03:03:29] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 17.83, 12.79, 11.56 [03:04:04] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.89, 3.70, 3.67 [03:04:26] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 6.08, 6.74, 4.49 [03:06:04] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.41, 3.95, 3.74 [03:06:10] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 6.70, 9.58, 10.12 [03:07:29] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.59, 11.34, 11.31 [03:08:04] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.77, 3.46, 3.59 [03:09:36] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.43, 3.23, 2.71 [03:10:04] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.72, 4.11, 3.81 [03:10:25] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.74, 3.39, 3.69 [03:12:04] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.85, 3.57, 3.64 [03:12:10] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 17.62, 12.80, 11.07 [03:13:29] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.49, 8.83, 10.16 [03:16:04] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.44, 3.66, 3.62 [03:16:10] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.93, 11.37, 10.94 [03:16:25] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.49, 2.52, 3.24 [03:18:05] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.13, 2.95, 3.36 [03:18:10] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 14.44, 13.26, 11.71 [03:19:29] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.97, 11.18, 10.83 [03:22:10] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.89, 11.80, 11.45 [03:23:29] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.76, 11.87, 11.16 [03:24:04] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.62, 3.69, 3.65 [03:25:29] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.57, 11.72, 11.20 [03:26:10] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.83, 11.57, 11.42 [03:27:29] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.29, 12.00, 11.37 [03:28:10] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.36, 11.20, 11.31 [03:29:29] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.69, 11.64, 11.33 [03:30:04] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 7.50, 4.48, 3.89 [03:33:29] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 14.59, 11.30, 11.14 [03:38:10] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.71, 8.97, 10.13 [03:39:29] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.87, 11.49, 11.55 [03:42:10] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.40, 10.33, 10.38 [03:44:10] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.09, 11.13, 10.65 [03:46:10] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.29, 10.00, 10.30 [03:48:10] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 5.69, 8.63, 9.77 [03:49:29] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 6.09, 7.95, 9.76 [03:51:22] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.63, 3.92, 3.06 [03:53:22] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.48, 3.30, 2.93 [03:58:04] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.79, 2.68, 3.80 [04:02:04] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 7.70, 5.35, 4.56 [04:05:29] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.21, 9.64, 8.95 [04:07:29] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.49, 9.04, 8.83 [04:13:40] PROBLEM - es141 PowerDNS Recursor on es141 is CRITICAL: CRITICAL - Plugin timed out while executing system call [04:14:04] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.86, 3.12, 3.86 [04:15:40] RECOVERY - es141 PowerDNS Recursor on es141 is OK: DNS OK: 0.113 seconds response time. miraheze.org returns 109.228.51.216,217.174.247.33,2a00:da00:1800:326::1,2a00:da00:1800:328::1 [04:24:04] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.02, 2.77, 3.34 [04:26:25] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 16.68, 8.83, 4.75 [04:38:04] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.68, 4.34, 3.59 [04:38:24] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.00, 3.26, 3.91 [04:40:04] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.41, 3.97, 3.55 [04:44:04] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.84, 3.05, 3.28 [04:44:24] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.61, 2.26, 3.24 [04:47:35] PROBLEM - cp22 NTP time on cp22 is WARNING: NTP WARNING: Offset 0.1976064742 secs [04:55:35] RECOVERY - cp22 NTP time on cp22 is OK: NTP OK: Offset 0.05670419335 secs [05:05:46] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 10.77, 5.74, 4.00 [05:15:37] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.30, 3.94, 3.98 [05:23:30] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.29, 2.80, 3.37 [05:25:21] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.65, 3.32, 2.60 [05:27:21] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.61, 2.59, 2.42 [05:31:20] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.68, 3.54, 3.48 [05:33:18] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.83, 3.23, 3.37 [05:49:05] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.90, 3.50, 3.25 [05:51:03] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 3.04, 3.28, 3.19 [05:56:56] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.18, 4.03, 3.52 [05:58:54] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.81, 3.13, 3.25 [05:59:53] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/deleteBatch.php --wiki=monstergirlencyclopediawiki --u Miraheze_maintenance_script --r Per request at T9885 /home/reception/monstergirlfilesdel.txt (START) [05:59:56] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:06:29] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.54, 10.00, 8.71 [06:08:28] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.55, 9.80, 8.85 [06:08:43] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 8.17, 4.79, 3.69 [06:12:40] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.66, 3.85, 3.55 [06:12:40] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.23, 3.99, 2.94 [06:14:38] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.88, 3.25, 3.37 [06:14:40] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.26, 3.72, 2.97 [06:20:40] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 2.79, 3.18, 2.99 [06:24:16] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.27, 3.40, 2.54 [06:25:35] PROBLEM - cp22 NTP time on cp22 is WARNING: NTP WARNING: Offset -0.1099826396 secs [06:26:16] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.97, 3.21, 2.57 [06:27:36] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 4.60, 3.28, 1.72 [06:28:24] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.95, 4.42, 3.55 [06:28:38] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/deleteBatch.php --wiki=monstergirlencyclopediawiki --u Miraheze_maintenance_script --r Per request at T9885 /home/reception/monstergirlfilesdel.txt (END - exit=0) [06:28:42] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:29:36] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.75, 2.67, 1.70 [06:30:22] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.04, 3.48, 3.31 [06:32:20] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.98, 2.90, 3.11 [06:33:36] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/deleteBatch.php --wiki=monstergirlencyclopediawiki --u Miraheze_maintenance_script --r Per request at T9885 /home/reception/monstergirlfilesdel.txt (START) [06:33:39] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:38:12] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.47, 6.43, 4.84 [06:38:13] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 9.20, 5.73, 4.16 [06:39:04] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.79, 10.74, 9.41 [06:39:35] RECOVERY - cp22 NTP time on cp22 is OK: NTP OK: Offset -0.08499157429 secs [06:40:12] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 3.35, 5.22, 4.59 [06:41:03] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 5.37, 8.82, 8.86 [06:42:10] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.53, 3.99, 3.78 [06:42:40] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.54, 3.18, 2.95 [06:44:08] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/deleteBatch.php --wiki=monstergirlencyclopediawiki --u Miraheze_maintenance_script --r Per request at T9885 /home/reception/monstergirlfilesdel.txt (END - exit=0) [06:44:11] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:44:40] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 3.29, 3.22, 2.99 [06:48:04] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.03, 3.14, 3.41 [06:48:40] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.60, 3.40, 3.11 [06:50:04] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 3.04, 3.01, 3.32 [06:50:40] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 3.37, 3.39, 3.14 [07:03:35] PROBLEM - cp22 NTP time on cp22 is WARNING: NTP WARNING: Offset 0.1467927992 secs [07:04:04] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.70, 3.42, 3.17 [07:06:04] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.94, 3.24, 3.14 [07:11:35] RECOVERY - cp22 NTP time on cp22 is OK: NTP OK: Offset 0.08686447144 secs [07:24:11] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 6.00, 3.76, 2.94 [07:26:31] [02miraheze/mw-config] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/47a7af61ea5b...bde418941091 [07:26:32] [02miraheze/mw-config] 07Reception123 03bde4189 - defaultuseroption setting for mariowiki per T10237 [07:26:51] !log [@test131] starting deploy of {'config': True} to all [07:26:52] !log [@test131] finished deploy of {'config': True} to all - SUCCESS in 0s [07:26:54] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:26:57] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:27:28] miraheze/mw-config - Reception123 the build passed. [07:27:43] !log [reception@mwtask141] starting deploy of {'config': True} to all [07:27:47] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:27:50] !log [reception@mwtask141] finished deploy of {'config': True} to all - SUCCESS in 6s [07:27:54] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:32:11] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.57, 3.31, 3.38 [07:35:49] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.74, 4.00, 3.28 [07:37:47] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.40, 3.73, 3.26 [07:39:45] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.11, 3.70, 3.29 [07:39:50] !log [@mwtask141] starting deploy of {'config': True} to all [07:39:54] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:39:56] !log [@mwtask141] finished deploy of {'config': True} to all - SUCCESS in 6s [07:39:59] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:43:42] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.51, 2.97, 3.13 [07:49:35] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.21, 5.11, 4.01 [07:53:31] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.43, 3.27, 3.52 [07:55:29] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 0.87, 2.52, 3.22 [07:56:09] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 9.08, 5.63, 3.64 [08:03:21] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.83, 3.51, 3.22 [08:08:17] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 0.99, 2.93, 3.73 [08:11:14] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.02, 3.48, 3.45 [08:12:17] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.18, 1.99, 3.16 [08:15:10] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.88, 2.75, 3.18 [08:26:16] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 7.39, 4.44, 3.30 [08:28:16] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.60, 3.89, 3.24 [08:32:16] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 6.19, 4.71, 3.69 [08:36:18] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.28, 3.78, 3.56 [08:36:49] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 7.04, 3.78, 2.64 [08:36:50] PROBLEM - cp32 NTP time on cp32 is WARNING: NTP WARNING: Offset 0.2092239559 secs [08:38:17] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.13, 2.96, 3.29 [08:44:43] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.86, 3.94, 3.74 [08:44:50] RECOVERY - cp32 NTP time on cp32 is OK: NTP OK: Offset -0.02061364055 secs [08:48:39] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.49, 2.70, 3.27 [08:58:21] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 6.69, 6.02, 3.76 [09:02:21] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.02, 3.34, 3.18 [09:14:10] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.28, 9.84, 7.65 [09:16:10] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.03, 8.92, 7.60 [09:34:58] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 8.92, 5.40, 3.07 [09:42:52] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 0.93, 3.00, 2.97 [09:56:17] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.60, 3.96, 2.50 [09:58:16] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.14, 3.18, 2.39 [10:13:26] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 6.34, 5.40, 3.51 [10:19:21] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.03, 3.01, 3.07 [10:28:20] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 18.04, 8.66, 4.22 [10:29:20] PROBLEM - cp33 PowerDNS Recursor on cp33 is CRITICAL: CRITICAL - Plugin timed out while executing system call [10:31:19] RECOVERY - cp33 PowerDNS Recursor on cp33 is OK: DNS OK: 0.574 seconds response time. miraheze.org returns 108.175.15.182,2607:f1c0:1800:26f::1,2607:f1c0:1800:8100::1,74.208.203.152 [10:37:05] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.11, 5.44, 3.94 [10:42:19] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 0.90, 2.39, 3.71 [10:44:18] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 0.55, 1.79, 3.32 [10:54:49] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.08, 2.56, 3.74 [10:56:48] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 0.59, 1.93, 3.37 [10:58:18] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.27, 3.41, 2.92 [11:02:18] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.31, 2.85, 2.86 [11:06:40] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 10.78, 6.39, 4.31 [11:20:28] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 0.71, 2.76, 3.85 [11:24:25] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 0.86, 1.73, 3.18 [11:26:16] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.06, 4.12, 2.68 [11:28:16] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.16, 3.73, 2.71 [11:30:15] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.04, 2.80, 2.49 [11:36:13] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.02, 3.19, 2.82 [11:38:11] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.75, 2.93, 2.77 [11:42:11] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 18.40, 8.74, 4.99 [11:44:10] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.91, 9.57, 7.99 [11:46:10] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.42, 8.68, 7.86 [11:49:38] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.97, 9.99, 8.53 [11:50:04] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 0.74, 3.10, 3.75 [11:51:37] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 6.29, 8.78, 8.27 [11:52:04] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 0.36, 2.18, 3.33 [11:57:17] PROBLEM - test131 NTP time on test131 is CRITICAL: NTP CRITICAL: Offset 0.7603490055 secs [12:04:29] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.10, 9.89, 8.88 [12:05:35] PROBLEM - cp22 NTP time on cp22 is WARNING: NTP WARNING: Offset 0.1449235976 secs [12:06:05] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.19, 4.57, 3.51 [12:06:28] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 15.31, 11.59, 9.59 [12:08:26] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.16, 11.00, 9.63 [12:10:25] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.65, 9.95, 9.39 [12:11:46] RECOVERY - test131 NTP time on test131 is OK: NTP OK: Offset 0.001366406679 secs [12:12:39] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.08, 9.59, 8.47 [12:14:05] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.65, 3.37, 3.47 [12:14:37] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 9.07, 9.46, 8.56 [12:16:04] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.32, 2.75, 3.23 [12:19:35] RECOVERY - cp22 NTP time on cp22 is OK: NTP OK: Offset 0.08201402426 secs [12:28:11] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 8.97, 4.58, 2.54 [12:36:05] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.53, 2.86, 2.40 [12:42:11] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 0.75, 3.06, 3.89 [12:44:04] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.22, 3.64, 3.19 [12:46:04] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.72, 3.10, 3.05 [12:46:11] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.09, 1.87, 3.20 [13:08:04] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.71, 3.57, 2.75 [13:10:04] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.46, 2.73, 2.54 [13:13:30] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.90, 11.47, 9.39 [13:15:27] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.66, 11.58, 9.72 [13:21:20] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 9.09, 9.82, 9.45 [13:29:07] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 7.05, 4.83, 3.06 [13:32:47] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.03, 3.46, 2.74 [13:34:46] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.56, 3.65, 2.87 [13:35:08] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.09, 3.62, 3.24 [13:35:29] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.54, 9.52, 9.00 [13:37:07] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.26, 2.77, 2.97 [13:37:29] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 17.75, 12.16, 9.99 [13:39:29] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.48, 11.11, 9.86 [13:41:29] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 6.30, 9.28, 9.34 [13:44:37] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.51, 3.23, 3.46 [13:46:35] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.10, 2.82, 3.28 [14:05:12] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.55, 10.73, 9.82 [14:07:11] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 14.27, 11.80, 10.31 [14:08:12] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.15, 3.96, 3.19 [14:09:09] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.24, 11.24, 10.29 [14:11:08] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.10, 9.73, 9.83 [14:14:12] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 14.16, 12.41, 10.42 [14:16:05] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.25, 3.47, 3.58 [14:16:10] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.56, 11.72, 10.41 [14:18:04] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.05, 2.67, 3.27 [14:18:10] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.12, 10.08, 9.97 [14:18:50] PROBLEM - cp32 NTP time on cp32 is CRITICAL: NTP CRITICAL: Offset 0.5398258269 secs [14:26:10] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 14.76, 12.15, 10.74 [14:26:57] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.87, 11.21, 9.89 [14:28:10] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.84, 11.10, 10.52 [14:28:50] RECOVERY - cp32 NTP time on cp32 is OK: NTP OK: Offset -0.0009323656559 secs [14:28:55] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.32, 11.11, 10.01 [14:30:10] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.72, 9.83, 10.12 [14:34:51] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.82, 11.96, 10.63 [14:38:04] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 7.75, 5.39, 3.68 [14:40:48] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.05, 11.76, 11.07 [14:42:04] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.19, 3.31, 3.24 [14:42:10] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 16.86, 11.94, 10.35 [14:44:10] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.59, 10.74, 10.10 [14:46:10] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.74, 9.65, 9.78 [14:48:42] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.12, 8.82, 9.96 [15:04:21] PROBLEM - www.arru.xyz - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - www.arru.xyz All nameservers failed to answer the query. [15:06:29] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.54, 10.23, 9.57 [15:08:05] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.68, 4.18, 2.99 [15:08:28] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.73, 9.51, 9.38 [15:14:10] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.62, 10.58, 9.17 [15:16:05] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.40, 3.80, 3.49 [15:18:04] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.51, 3.09, 3.27 [15:18:10] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.52, 9.25, 8.94 [15:22:14] [02miraheze/puppet] 07paladox pushed 031 commit to 03opensearch [+205/-0/±0] 13https://github.com/miraheze/puppet/compare/bdb1e9bb136d...446b5b2ed626 [15:22:17] [02miraheze/puppet] 07paladox 03446b5b2 - Introduce opensearch puppet module [15:22:18] [02puppet] 07paladox synchronize pull request 03#3110: Introduce opensearch puppet module - 13https://github.com/miraheze/puppet/pull/3110 [15:24:58] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 6.91, 3.71, 2.40 [15:27:35] PROBLEM - cp22 NTP time on cp22 is WARNING: NTP WARNING: Offset 0.1212262213 secs [15:33:41] RECOVERY - www.arru.xyz - reverse DNS on sslhost is OK: SSL OK - www.arru.xyz reverse DNS resolves to cp23.miraheze.org - NS RECORDS OK [15:34:04] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 9.18, 6.12, 4.04 [15:35:08] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 15.97, 11.70, 9.84 [15:36:59] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.83, 3.57, 3.56 [15:37:07] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.77, 11.46, 10.00 [15:37:40] PROBLEM - arrieretoile.fr - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query arrieretoile.fr. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [15:38:59] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 0.90, 2.71, 3.24 [15:39:06] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 6.35, 9.59, 9.49 [15:42:04] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.80, 3.93, 3.89 [15:43:35] RECOVERY - cp22 NTP time on cp22 is OK: NTP OK: Offset 0.0724620223 secs [15:43:46] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.94, 10.84, 9.59 [15:45:44] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 9.22, 9.81, 9.34 [15:48:04] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.36, 2.36, 3.19 [15:48:56] !log [macfan@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=minecrabberswiki --no-updates --username-prefix=wikia:minecrabbers /home/macfan/ImportDump/minecrabberswiki-20221230075453.xml (START) [15:48:59] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:49:11] [02miraheze/puppet] 07paladox pushed 031 commit to 03opensearch [+93/-0/±0] 13https://github.com/miraheze/puppet/compare/446b5b2ed626...3862a86a3df9 [15:49:12] [02miraheze/puppet] 07paladox 033862a86 - Introduce opensearch puppet module [15:49:14] [02puppet] 07paladox synchronize pull request 03#3110: Introduce opensearch puppet module - 13https://github.com/miraheze/puppet/pull/3110 [15:49:54] !log [macfan@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=minecrabberswiki --no-updates --username-prefix=wikia:minecrabbers /home/macfan/ImportDump/minecrabberswiki-20221230075453.xml (END - exit=0) [15:49:55] !log [macfan@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=minecrabberswiki (START) [15:49:56] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:49:59] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:50:30] !log [macfan@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=minecrabberswiki (END - exit=0) [15:50:31] !log [macfan@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/initSiteStats.php --wiki=minecrabberswiki --active --update (END - exit=0) [15:50:33] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:50:36] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:51:35] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.21, 9.94, 9.49 [15:53:32] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.43, 9.38, 9.34 [15:56:57] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.10, 3.83, 3.17 [15:58:57] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.62, 3.64, 3.20 [16:00:57] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.91, 3.03, 3.03 [16:05:38] PROBLEM - db112 Current Load on db112 is CRITICAL: CRITICAL - load average: 8.28, 8.64, 5.94 [16:06:44] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 17.26, 12.13, 10.14 [16:07:20] RECOVERY - arrieretoile.fr - reverse DNS on sslhost is OK: SSL OK - arrieretoile.fr reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [16:08:06] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 7.82, 4.62, 3.38 [16:08:42] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.67, 11.97, 10.35 [16:13:29] !log [macfan@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=hotararewiki --no-updates --username-prefix=w /home/macfan/ImportDump/hotararewiki-20221230163653.xml (START) [16:13:31] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:15:17] PROBLEM - db112 Current Load on db112 is WARNING: WARNING - load average: 4.50, 7.14, 6.90 [16:16:04] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.56, 3.58, 3.44 [16:16:37] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 14.08, 11.52, 10.56 [16:18:04] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.54, 2.90, 3.21 [16:18:36] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.58, 11.00, 10.48 [16:19:08] RECOVERY - db112 Current Load on db112 is OK: OK - load average: 4.73, 6.08, 6.53 [16:20:34] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.03, 9.64, 10.05 [16:20:39] PROBLEM - cp33 NTP time on cp33 is WARNING: NTP WARNING: Offset 0.1630249023 secs [16:24:10] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.24, 10.25, 9.91 [16:24:31] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.11, 11.21, 10.56 [16:24:57] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.50, 3.07, 2.28 [16:26:10] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.26, 9.81, 9.81 [16:26:29] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.59, 10.80, 10.51 [16:26:57] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.89, 4.03, 2.72 [16:28:28] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.54, 11.34, 10.73 [16:30:10] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.27, 10.36, 10.03 [16:30:56] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.59, 3.36, 2.81 [16:32:10] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.72, 9.64, 9.80 [16:32:25] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.25, 11.36, 10.94 [16:35:51] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.13, 5.22, 3.95 [16:36:23] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 15.45, 13.15, 11.72 [16:37:38] PROBLEM - db112 Current Load on db112 is CRITICAL: CRITICAL - load average: 12.08, 8.53, 6.64 [16:38:07] RECOVERY - cloud11 IPMI Sensors on cloud11 is OK: IPMI Status: OK [16:38:39] RECOVERY - cp33 NTP time on cp33 is OK: NTP OK: Offset 0.09440556169 secs [16:38:53] !log [macfan@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=hotararewiki --no-updates --username-prefix=w /home/macfan/ImportDump/hotararewiki-20221230163653.xml (END - exit=0) [16:38:54] !log [macfan@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=hotararewiki (START) [16:38:57] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:39:00] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:39:34] PROBLEM - db112 Current Load on db112 is WARNING: WARNING - load average: 7.04, 7.69, 6.54 [16:39:48] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.19, 3.99, 3.77 [16:40:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.24, 11.06, 11.26 [16:41:30] PROBLEM - db112 Current Load on db112 is CRITICAL: CRITICAL - load average: 10.88, 10.18, 7.66 [16:42:08] PROBLEM - cloud11 IPMI Sensors on cloud11 is CRITICAL: IPMI Status: Critical [Cntlr 2 Bay 7 = Critical] [16:42:58] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 7.54, 4.14, 3.05 [16:43:18] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 20.18, 10.24, 5.16 [16:43:44] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.39, 2.96, 3.39 [16:44:10] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.90, 10.89, 10.14 [16:46:58] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.76, 3.48, 3.13 [16:50:58] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.16, 3.00, 3.05 [16:52:10] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 9.69, 10.01, 9.98 [16:52:12] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.80, 9.09, 10.03 [16:54:57] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.61, 3.98, 3.46 [16:55:11] PROBLEM - wiki.zulaclub.net - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query zulaclub.net. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [16:56:57] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.21, 3.72, 3.43 [16:58:52] PROBLEM - db112 Current Load on db112 is WARNING: WARNING - load average: 1.00, 5.66, 7.52 [16:58:57] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.50, 2.82, 3.13 [17:02:44] RECOVERY - db112 Current Load on db112 is OK: OK - load average: 1.47, 4.08, 6.53 [17:03:03] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.16, 10.71, 10.17 [17:04:02] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 17.90, 13.37, 11.21 [17:05:00] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.86, 9.89, 9.92 [17:07:19] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.84, 5.08, 3.83 [17:08:53] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.39, 10.93, 10.35 [17:10:51] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 18.26, 12.79, 11.03 [17:11:57] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.37, 11.84, 11.65 [17:15:35] PROBLEM - cp22 NTP time on cp22 is WARNING: NTP WARNING: Offset 0.2450768352 secs [17:15:54] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.13, 11.53, 11.53 [17:17:53] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.22, 11.22, 11.44 [17:23:35] RECOVERY - cp22 NTP time on cp22 is OK: NTP OK: Offset -0.01479312778 secs [17:24:22] RECOVERY - wiki.zulaclub.net - reverse DNS on sslhost is OK: SSL OK - wiki.zulaclub.net reverse DNS resolves to cp23.miraheze.org - CNAME OK [17:24:58] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.66, 3.97, 3.11 [17:26:32] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.23, 11.12, 11.88 [17:26:58] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.32, 4.27, 3.33 [17:27:02] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.24, 3.04, 3.71 [17:28:30] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 11.53, 11.96, 12.13 [17:30:57] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.02, 3.21, 3.19 [17:32:58] !log [macfan@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=hotararewiki (END - exit=0) [17:32:59] !log [macfan@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/initSiteStats.php --wiki=hotararewiki --active --update (END - exit=0) [17:33:02] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:33:04] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:33:42] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 15.67, 11.38, 10.90 [17:34:23] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.83, 11.49, 11.95 [17:34:55] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.30, 3.18, 3.45 [17:36:53] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.12, 2.83, 3.30 [17:38:03] !log [macfan@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=mushroomcitycarwashwikiwiki --no-updates --username-prefix=wikia:mushroom-city-car-wash /home/macfan/ImportDump/mushroomcitycarwashwikiwiki-20230101155400.xml (START) [17:38:07] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:38:35] !log [macfan@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=mushroomcitycarwashwikiwiki --no-updates --username-prefix=wikia:mushroom-city-car-wash /home/macfan/ImportDump/mushroomcitycarwashwikiwiki-20230101155400.xml (END - exit=0) [17:38:37] !log [macfan@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=mushroomcitycarwashwikiwiki (START) [17:38:39] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:38:41] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:39:23] !log [macfan@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=mushroomcitycarwashwikiwiki (END - exit=0) [17:39:24] !log [macfan@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/initSiteStats.php --wiki=mushroomcitycarwashwikiwiki --active --update (END - exit=0) [17:39:25] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:39:28] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:39:38] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.17, 11.99, 11.47 [17:40:16] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 16.54, 12.28, 11.94 [17:42:01] !log [macfan@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=polcompballanarchywiki --no-updates --username-prefix=mh:polcompball /home/macfan/ImportDump/polcompballanarchywiki-20230101220105.xml (START) [17:42:04] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:43:37] !log [macfan@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=polcompballanarchywiki --no-updates --username-prefix=mh:polcompball /home/macfan/ImportDump/polcompballanarchywiki-20230101220105.xml (END - exit=0) [17:43:38] !log [macfan@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=polcompballanarchywiki (START) [17:43:40] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:43:42] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:47:33] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.17, 11.18, 11.10 [17:49:32] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.18, 10.92, 11.03 [17:50:10] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.46, 11.12, 11.81 [17:53:29] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 14.70, 12.07, 11.45 [17:54:10] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.02, 11.07, 11.60 [17:55:29] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.67, 10.74, 11.05 [17:55:55] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.33, 4.01, 3.10 [17:57:29] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 17.45, 12.47, 11.59 [17:59:29] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.81, 3.49, 3.20 [17:59:55] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.35, 3.63, 3.22 [18:01:55] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.24, 2.83, 2.98 [18:04:10] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.70, 11.87, 11.89 [18:04:40] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 1.77, 1.74, 3.78 [18:06:10] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.14, 12.53, 12.15 [18:07:22] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.22, 4.31, 3.70 [18:08:40] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 5.69, 3.46, 3.98 [18:15:15] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.00, 3.87, 3.82 [18:21:10] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.08, 2.86, 3.38 [18:33:10] PROBLEM - mw142 Current Load on mw142 is CRITICAL: CRITICAL - load average: 14.88, 12.85, 8.86 [18:36:54] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.34, 3.38, 3.03 [18:37:08] PROBLEM - mw142 Current Load on mw142 is WARNING: WARNING - load average: 7.25, 11.34, 9.30 [18:37:33] PROBLEM - mw132 Current Load on mw132 is CRITICAL: CRITICAL - load average: 14.21, 11.97, 8.61 [18:39:08] RECOVERY - mw142 Current Load on mw142 is OK: OK - load average: 5.29, 9.22, 8.75 [18:39:33] RECOVERY - mw132 Current Load on mw132 is OK: OK - load average: 6.02, 9.59, 8.14 [18:40:51] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.67, 3.50, 3.19 [18:42:49] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.66, 2.97, 3.04 [18:50:41] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.56, 5.07, 3.85 [18:54:50] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.97, 3.59, 2.81 [18:56:50] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.17, 3.08, 2.72 [19:00:32] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.61, 3.87, 4.00 [19:02:10] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 6.78, 8.97, 11.84 [19:04:29] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 14.68, 7.91, 5.43 [19:08:56] [02miraheze/puppet] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/puppet/commit/93452b300527 [19:08:59] [02miraheze/puppet] 07Universal-Omega 0393452b3 - es_exporter: add 200 status percentage to nginx metrics [19:09:00] [02puppet] 07Universal-Omega created branch 03Universal-Omega-patch-1 - 13https://github.com/miraheze/puppet [19:09:01] [02puppet] 07Universal-Omega opened pull request 03#3111: es_exporter: add 200 status percentage to nginx metrics - 13https://github.com/miraheze/puppet/pull/3111 [19:09:29] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.79, 9.62, 11.47 [19:11:29] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.50, 10.32, 11.45 [19:12:10] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 21.55, 12.75, 11.72 [19:14:12] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.27, 5.63, 4.24 [19:15:02] PROBLEM - cp22 Current Load on cp22 is CRITICAL: CRITICAL - load average: 5.68, 3.14, 1.83 [19:15:29] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.58, 10.47, 11.31 [19:16:12] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 3.76, 4.87, 4.13 [19:16:18] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.01, 2.97, 3.97 [19:16:48] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.97, 3.39, 2.68 [19:18:47] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.26, 2.82, 2.55 [19:19:02] RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 1.44, 2.88, 2.08 [19:19:29] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 14.20, 11.08, 11.28 [19:20:10] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.23, 11.83, 11.87 [19:22:10] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 14.18, 11.92, 11.85 [19:24:12] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.37, 6.52, 4.98 [19:24:47] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.22, 3.56, 2.98 [19:25:29] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.05, 10.76, 11.21 [19:26:10] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.31, 11.16, 11.59 [19:26:12] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 2.86, 5.13, 4.66 [19:26:48] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.87, 3.72, 3.09 [19:27:51] [02puppet] 07Universal-Omega synchronize pull request 03#3111: es_exporter: add 200 status percentage to nginx metrics - 13https://github.com/miraheze/puppet/pull/3111 [19:27:53] [02miraheze/puppet] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/93452b300527...33fe8aeb36d9 [19:27:56] [02miraheze/puppet] 07Universal-Omega 0333fe8ae - Update 20-nginx.cfg [19:28:03] [02puppet] 07Universal-Omega edited pull request 03#3111: es_exporter: add good status percentage to nginx metrics - 13https://github.com/miraheze/puppet/pull/3111 [19:28:08] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.25, 2.48, 3.27 [19:30:48] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.62, 3.73, 3.37 [19:32:48] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 0.93, 2.80, 3.07 [19:33:29] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 17.77, 12.82, 11.80 [19:36:04] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 6.13, 4.22, 3.67 [19:36:10] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.22, 11.01, 11.12 [19:46:04] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.81, 3.87, 3.93 [19:49:29] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.36, 10.76, 11.81 [19:53:29] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.34, 11.27, 11.71 [19:54:46] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.37, 3.31, 2.64 [19:55:29] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.86, 11.54, 11.77 [19:56:04] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.88, 3.70, 3.68 [19:56:10] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.69, 11.76, 11.96 [19:56:19] [02puppet] 07Universal-Omega closed pull request 03#3111: es_exporter: add good status percentage to nginx metrics - 13https://github.com/miraheze/puppet/pull/3111 [19:56:22] [02miraheze/puppet] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 [19:56:24] [02puppet] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 - 13https://github.com/miraheze/puppet [19:56:27] [02miraheze/puppet] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/62f0b2a6e282...b54c7eb50f21 [19:56:30] [02miraheze/puppet] 07Universal-Omega 03b54c7eb - es_exporter: add good status percentage to nginx metrics (#3111) [19:58:04] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.91, 3.23, 3.49 [20:00:04] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.99, 3.04, 3.39 [20:01:29] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.06, 10.90, 11.38 [20:03:02] PROBLEM - cp22 Current Load on cp22 is WARNING: WARNING - load average: 3.74, 3.57, 2.04 [20:04:45] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.12, 3.64, 3.51 [20:05:02] RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 1.10, 2.59, 1.86 [20:06:45] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.56, 2.90, 3.25 [20:08:04] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.55, 3.61, 3.41 [20:11:29] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.71, 11.58, 11.75 [20:12:10] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 15.00, 11.40, 11.05 [20:12:27] [02miraheze/puppet] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/b54c7eb50f21...fa24b103afda [20:12:28] [02miraheze/puppet] 07Universal-Omega 03fa24b10 - Revert back for now [20:14:10] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.14, 11.50, 11.16 [20:15:29] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 15.69, 12.11, 11.81 [20:16:10] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.27, 11.58, 11.21 [20:17:29] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.93, 11.81, 11.73 [20:18:10] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 7.80, 10.00, 10.67 [20:24:10] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.52, 9.10, 10.07 [20:25:44] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.91, 3.82, 3.32 [20:27:29] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.67, 10.45, 10.73 [20:27:44] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.67, 4.28, 3.56 [20:28:04] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.45, 3.30, 3.97 [20:28:10] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.69, 10.33, 10.43 [20:29:29] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.46, 10.42, 10.67 [20:30:10] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.36, 9.45, 10.08 [20:33:29] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 16.38, 11.65, 10.98 [20:34:05] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 7.97, 4.33, 4.04 [20:35:46] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.84, 3.91, 3.99 [20:38:10] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.07, 10.49, 10.18 [20:40:10] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.91, 10.32, 10.14 [20:41:29] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.22, 11.64, 11.74 [20:42:10] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 14.26, 12.08, 10.83 [20:43:46] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.28, 2.34, 3.18 [20:44:10] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.01, 11.84, 10.90 [20:47:29] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.40, 11.37, 11.49 [20:49:25] !log [macfan@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=polcompballanarchywiki (END - exit=0) [20:49:26] !log [macfan@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/initSiteStats.php --wiki=polcompballanarchywiki --active --update (END - exit=0) [20:49:27] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:49:30] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:53:46] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 6.33, 3.76, 3.22 [20:54:10] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 27.32, 17.34, 13.22 [20:55:29] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.50, 11.59, 11.89 [20:56:05] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.54, 2.92, 3.87 [20:56:40] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 1.39, 2.34, 4.00 [20:58:05] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.51, 3.18, 3.82 [20:59:46] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.44, 3.98, 3.58 [21:02:10] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 6.35, 10.82, 11.91 [21:02:23] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 3.63, 3.36, 2.18 [21:02:40] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 1.70, 1.81, 3.21 [21:03:29] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 15.00, 11.26, 11.37 [21:03:45] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.81, 2.99, 3.26 [21:04:17] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.12, 2.54, 2.02 [21:05:39] !log [macfan@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=polcompballanarchywiki --no-updates --username-prefix=mh:polcompball /home/macfan/ImportDump/polcompballanarchywiki-20230101220209.xml (START) [21:05:44] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:06:10] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 16.38, 12.59, 12.23 [21:07:29] !log [macfan@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=polcompballanarchywiki --no-updates --username-prefix=mh:polcompball /home/macfan/ImportDump/polcompballanarchywiki-20230101220209.xml (END - exit=0) [21:07:30] !log [macfan@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=polcompballanarchywiki (START) [21:07:32] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:07:34] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:25:46] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.01, 4.28, 3.41 [21:26:04] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.80, 2.74, 3.75 [21:29:46] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.57, 3.59, 3.40 [21:31:46] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 0.99, 2.76, 3.12 [21:32:04] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.30, 2.37, 3.25 [21:36:06] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 8.06, 5.07, 4.12 [21:36:40] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 5.46, 3.77, 2.82 [21:44:04] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.36, 3.33, 3.69 [21:48:05] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 9.39, 4.64, 4.02 [22:02:04] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.82, 3.17, 3.89 [22:04:04] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.01, 3.27, 3.82 [22:06:04] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.44, 3.43, 3.81 [22:07:42] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.90, 3.42, 3.23 [22:08:05] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.40, 3.53, 3.79 [22:09:42] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.36, 2.75, 3.01 [22:12:04] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.21, 3.50, 3.80 [22:20:05] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 6.05, 3.68, 3.61 [22:25:41] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.13, 3.50, 3.07 [22:27:41] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 6.26, 4.53, 3.49 [22:29:40] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.61, 3.88, 3.38 [22:31:40] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.89, 3.25, 3.21 [22:59:36] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 3.44, 2.68, 1.83 [23:01:36] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.49, 2.34, 1.82 [23:08:10] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.01, 9.83, 11.80 [23:10:10] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 16.64, 12.08, 12.35 [23:14:10] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.03, 11.22, 12.00 [23:15:29] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.91, 9.70, 11.88 [23:21:29] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.89, 11.04, 11.67 [23:22:10] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.28, 10.73, 11.26 [23:24:04] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.52, 2.39, 3.91 [23:24:10] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.96, 9.86, 10.87 [23:25:29] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.72, 11.36, 11.65 [23:25:36] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 7.76, 5.09, 3.31 [23:27:29] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.15, 11.77, 11.75 [23:28:10] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.20, 11.08, 11.11 [23:30:04] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.72, 2.29, 3.34 [23:30:10] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.30, 10.53, 10.89 [23:34:06] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 7.73, 4.13, 3.82 [23:35:36] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.13, 3.28, 3.54 [23:37:36] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.78, 2.97, 3.40 [23:40:10] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.90, 10.60, 10.55 [23:42:11] PROBLEM - mw122 NTP time on mw122 is WARNING: NTP WARNING: Offset 0.1052876711 secs [23:44:10] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.53, 11.75, 11.16 [23:46:10] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.40, 11.83, 11.25 [23:47:29] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.99, 11.13, 11.84 [23:48:10] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.87, 11.13, 11.04 [23:49:29] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.86, 11.88, 12.01 [23:50:10] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 14.24, 12.26, 11.46 [23:52:34] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.22, 4.23, 3.51