[00:00:11] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.68, 2.75, 3.35 [00:01:42] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 6.26, 4.18, 2.97 [00:02:00] [Grafana] FIRING: Some MediaWiki Appservers are running out of PHP-FPM workers. https://grafana.miraheze.org/d/GtxbP1Xnk?orgId=1 [00:03:28] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 4.98, 6.42, 6.61 [00:04:11] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 6.69, 5.00, 4.17 [00:05:40] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.43, 3.30, 2.94 [00:07:00] [Grafana] RESOLVED: PHP-FPM Worker Usage High https://grafana.miraheze.org/d/GtxbP1Xnk?orgId=1 [00:13:43] Do i have to do something in particular to get something accepted? [00:14:00] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.94, 3.58, 2.87 [00:14:46] PROBLEM - db142 Current Load on db142 is CRITICAL: CRITICAL - load average: 10.42, 8.17, 4.79 [00:15:17] PROBLEM - os141 Current Load on os141 is CRITICAL: CRITICAL - load average: 3.44, 4.04, 2.67 [00:16:10] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.79, 3.64, 3.98 [00:16:45] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 3.91, 6.64, 4.66 [00:17:15] PROBLEM - os141 Current Load on os141 is WARNING: WARNING - load average: 2.65, 3.64, 2.70 [00:18:00] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.07, 3.41, 2.98 [00:19:15] RECOVERY - os141 Current Load on os141 is OK: OK - load average: 1.78, 2.97, 2.56 [00:20:00] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 2.80, 3.13, 2.93 [00:26:10] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 8.83, 4.00, 3.77 [00:28:10] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.48, 3.37, 3.58 [00:32:10] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.20, 2.78, 3.30 [00:34:38] [02mw-config] 07Amanda-Catherine commented on pull request 03#5225: Userrights config for nycsubwaywiki - 13https://github.com/miraheze/mw-config/pull/5225#issuecomment-1541060574 [00:38:10] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.93, 4.69, 3.94 [00:39:50] PROBLEM - os141 Current Load on os141 is CRITICAL: CRITICAL - load average: 4.76, 4.17, 3.36 [00:40:10] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.15, 3.87, 3.72 [00:43:48] PROBLEM - os141 Current Load on os141 is WARNING: WARNING - load average: 2.55, 3.75, 3.41 [00:44:10] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.48, 3.89, 3.72 [00:44:46] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.07, 7.33, 6.78 [00:45:47] RECOVERY - os141 Current Load on os141 is OK: OK - load average: 2.92, 3.38, 3.31 [00:46:47] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.15, 6.62, 6.60 [00:48:10] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.02, 3.21, 3.50 [00:49:27] PROBLEM - db142 Current Load on db142 is CRITICAL: CRITICAL - load average: 9.64, 8.22, 6.51 [00:49:39] PROBLEM - os141 Current Load on os141 is WARNING: WARNING - load average: 3.65, 3.83, 3.54 [00:50:10] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.97, 2.92, 3.36 [00:51:37] PROBLEM - os141 Current Load on os141 is CRITICAL: CRITICAL - load average: 4.39, 4.02, 3.64 [00:53:22] PROBLEM - db142 Current Load on db142 is WARNING: WARNING - load average: 6.36, 7.84, 6.80 [00:53:38] PROBLEM - os141 Current Load on os141 is WARNING: WARNING - load average: 2.94, 3.60, 3.54 [00:54:46] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.83, 6.65, 6.57 [00:55:17] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.40, 3.70, 3.10 [00:55:35] RECOVERY - os141 Current Load on os141 is OK: OK - load average: 2.17, 3.10, 3.36 [00:57:17] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 3.77, 6.08, 6.33 [00:58:46] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 6.25, 6.60, 6.58 [01:03:13] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.62, 3.23, 3.13 [01:07:05] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 10.30, 6.35, 4.36 [01:07:24] PROBLEM - os141 Current Load on os141 is CRITICAL: CRITICAL - load average: 8.58, 5.02, 3.85 [01:07:59] PROBLEM - db142 Current Load on db142 is CRITICAL: CRITICAL - load average: 10.10, 8.40, 7.15 [01:15:48] PROBLEM - db142 Current Load on db142 is WARNING: WARNING - load average: 3.32, 7.04, 7.30 [01:16:56] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.87, 3.19, 3.77 [01:17:15] PROBLEM - os141 Current Load on os141 is WARNING: WARNING - load average: 0.59, 2.79, 3.58 [01:17:45] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 2.08, 5.26, 6.61 [01:18:54] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.68, 3.59, 3.84 [01:19:13] RECOVERY - os141 Current Load on os141 is OK: OK - load average: 1.36, 2.34, 3.31 [01:21:26] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.81, 6.43, 6.31 [01:22:51] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.79, 3.58, 3.78 [01:23:24] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.44, 6.11, 6.21 [01:23:35] PROBLEM - db142 Current Load on db142 is CRITICAL: CRITICAL - load average: 11.26, 8.52, 7.50 [01:25:32] PROBLEM - db142 Current Load on db142 is WARNING: WARNING - load average: 5.89, 7.81, 7.39 [01:26:48] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.76, 3.63, 3.71 [01:27:19] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.83, 6.68, 6.43 [01:27:30] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 1.88, 5.66, 6.65 [01:28:46] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.28, 3.02, 3.47 [01:29:17] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.15, 7.29, 6.66 [01:30:44] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.03, 3.25, 3.49 [01:31:15] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 5.30, 6.91, 6.63 [01:32:42] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.12, 2.87, 3.32 [01:33:13] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.22, 6.37, 6.47 [01:44:37] PROBLEM - db142 Disk Space on db142 is WARNING: DISK WARNING - free space: / 36675 MB (10% inode=97%); [01:45:01] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.18, 7.13, 6.79 [01:45:01] PROBLEM - db142 Current Load on db142 is CRITICAL: CRITICAL - load average: 10.92, 7.50, 6.34 [01:46:59] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 3.44, 6.27, 6.06 [01:46:59] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 4.96, 6.31, 6.53 [01:54:46] PROBLEM - db142 Current Load on db142 is CRITICAL: CRITICAL - load average: 9.00, 7.32, 6.26 [01:55:12] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.20, 10.73, 11.92 [01:56:39] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.27, 10.15, 11.90 [01:58:39] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 14.00, 11.36, 12.11 [01:58:45] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 2.69, 6.43, 6.28 [02:00:13] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.96, 3.78, 3.33 [02:00:39] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.52, 11.25, 11.98 [02:01:49] [02mw-config] 07Universal-Omega commented on pull request 03#5225: Userrights config for nycsubwaywiki - 13https://github.com/miraheze/mw-config/pull/5225#issuecomment-1541183256 [02:02:11] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.18, 4.54, 3.68 [02:05:12] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 14.74, 11.86, 11.75 [02:05:47] Hey so why does the timeless thing look all weird with the title placement? [02:06:10] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.17, 3.92, 3.64 [02:08:10] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.41, 4.21, 3.78 [02:08:39] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.14, 11.21, 11.57 [02:13:12] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.24, 11.45, 11.75 [02:14:10] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.56, 3.81, 3.74 [02:15:12] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.37, 12.16, 11.98 [02:18:10] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.22, 2.93, 3.38 [02:23:28] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.25, 4.38, 3.01 [02:25:15] PROBLEM - cp22 NTP time on cp22 is WARNING: NTP WARNING: Offset 0.1160022616 secs [02:25:27] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.39, 3.83, 2.97 [02:27:26] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.03, 3.62, 2.98 [02:28:10] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.65, 3.47, 3.38 [02:29:25] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.66, 2.87, 2.78 [02:32:10] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.55, 3.14, 3.27 [02:36:03] You should probably ask this in #general, no one checks this channel unless they're looking for technical help [02:38:19] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 3.27, 4.32, 3.52 [02:42:17] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.50, 3.34, 3.35 [02:45:03] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 6.19, 4.75, 3.78 [02:47:15] RECOVERY - cp22 NTP time on cp22 is OK: NTP OK: Offset 0.07485324144 secs [02:50:52] !log [agent@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/nukeNS.php --wiki=creaturawiki --delete --all --ns 3002 (END - exit=0) [02:50:59] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:54:37] PROBLEM - wiki.zulaclub.net - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.zulaclub.net All nameservers failed to answer the query. [03:17:53] !log [agent@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/initSiteStats.php --wiki=creaturawiki --active (END - exit=0) [03:17:59] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:18:04] !log [agent@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/initSiteStats.php --wiki=creaturawiki --active --update (END - exit=0) [03:18:11] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:18:33] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.97, 2.87, 3.97 [03:22:29] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.36, 3.14, 3.77 [03:23:16] RECOVERY - wiki.zulaclub.net - reverse DNS on sslhost is OK: SSL OK - wiki.zulaclub.net reverse DNS resolves to cp23.miraheze.org - CNAME OK [03:24:27] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.55, 3.38, 3.78 [03:26:26] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.36, 4.00, 3.95 [03:30:22] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.70, 3.59, 3.85 [03:34:19] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.00, 3.62, 3.75 [03:36:17] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.03, 3.18, 3.59 [03:36:39] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.11, 10.58, 11.71 [03:38:15] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.49, 3.64, 3.70 [03:38:39] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 16.02, 12.57, 12.30 [03:39:51] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.34, 6.86, 6.37 [03:40:14] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.95, 3.45, 3.63 [03:41:49] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 6.46, 6.58, 6.32 [03:42:12] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 6.60, 4.10, 3.81 [03:44:10] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.35, 3.26, 3.53 [03:45:11] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.76, 10.68, 11.84 [03:46:10] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.98, 2.96, 3.39 [03:47:12] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 16.00, 12.48, 12.34 [04:01:12] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.29, 10.49, 11.72 [04:05:11] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 15.50, 12.19, 12.02 [04:07:11] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.23, 11.06, 11.62 [04:09:12] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.75, 11.98, 11.87 [04:11:12] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.32, 11.45, 11.68 [04:12:53] [02miraheze/MirahezeMagic] 07AgentIsai pushed 031 commit to 03AgentIsai-patch-1 [+0/-0/±1] 13https://github.com/miraheze/MirahezeMagic/commit/d8debfaf7984 [04:12:54] [02miraheze/MirahezeMagic] 07AgentIsai 03d8debfa - Fix i18n for suppress group [04:12:57] [02MirahezeMagic] 07AgentIsai created branch 03AgentIsai-patch-1 - 13https://github.com/miraheze/MirahezeMagic [04:13:00] [02MirahezeMagic] 07AgentIsai opened pull request 03#422: Fix i18n for suppress group - 13https://github.com/miraheze/MirahezeMagic/pull/422 [04:13:19] [02miraheze/MirahezeMagic] 07AgentIsai pushed 031 commit to 03AgentIsai-patch-1 [+0/-0/±1] 13https://github.com/miraheze/MirahezeMagic/compare/d8debfaf7984...5804a8a6ea09 [04:13:22] [02miraheze/MirahezeMagic] 07AgentIsai 035804a8a - Remove duplicate i18n [04:13:23] [02MirahezeMagic] 07AgentIsai synchronize pull request 03#422: Fix i18n for suppress group - 13https://github.com/miraheze/MirahezeMagic/pull/422 [04:14:30] [02miraheze/MirahezeMagic] 07AgentIsai pushed 031 commit to 03AgentIsai-patch-1 [+0/-0/±1] 13https://github.com/miraheze/MirahezeMagic/compare/5804a8a6ea09...d12c3b7be17b [04:14:33] [02miraheze/MirahezeMagic] 07AgentIsai 03d12c3b7 - Remove calls to non-existent i18n messages [04:14:35] [02MirahezeMagic] 07AgentIsai synchronize pull request 03#422: Fix i18n for suppress group - 13https://github.com/miraheze/MirahezeMagic/pull/422 [04:19:53] [02MirahezeMagic] 07AgentIsai closed pull request 03#422: Fix i18n for suppress group - 13https://github.com/miraheze/MirahezeMagic/pull/422 [04:19:56] [02miraheze/MirahezeMagic] 07AgentIsai pushed 031 commit to 03master [+0/-0/±3] 13https://github.com/miraheze/MirahezeMagic/compare/ae39d85a56f7...d926c79433b5 [04:19:58] [02miraheze/MirahezeMagic] 07AgentIsai 03d926c79 - Fix i18n for suppress group (#422) [04:20:39] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.86, 10.98, 11.78 [04:21:56] [02miraheze/mediawiki] 07AgentIsai pushed 031 commit to 03REL1_40 [+0/-0/±14] 13https://github.com/miraheze/mediawiki/compare/acb7937c4c69...21e708fd8a0b [04:21:59] [02miraheze/mediawiki] 07AgentIsai 0321e708f - Revert update of core extensions [04:22:39] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 14.01, 11.85, 11.97 [04:23:11] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.33, 10.90, 10.79 [04:23:23] miraheze/MirahezeMagic - AgentIsai the build passed. [04:24:03] !log [agent@test131] starting deploy of {'world': True, 'l10n': True} to all [04:24:07] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [04:24:39] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.50, 11.02, 11.66 [04:25:12] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.67, 10.92, 10.82 [04:29:19] miraheze/MirahezeMagic - AgentIsai the build passed. [04:31:37] [02miraheze/mediawiki] 07AgentIsai pushed 031 commit to 03REL1_39 [+0/-0/±2] 13https://github.com/miraheze/mediawiki/compare/469b9cb9a98f...e1bc079b30d8 [04:31:38] [02miraheze/mediawiki] 07AgentIsai 03e1bc079 - Update ImportDump and MirahezeMagic [04:32:18] !log [agent@mwtask141] starting deploy of {'world': True, 'l10n': True} to all [04:32:24] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [04:32:39] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.82, 11.70, 11.54 [04:33:12] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.89, 11.51, 10.96 [04:35:29] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.33, 3.71, 3.09 [04:35:50] [02mw-config] 07AgentIsai commented on pull request 03#5225: Userrights config for nycsubwaywiki - 13https://github.com/miraheze/mw-config/pull/5225#issuecomment-1541339736 [04:36:39] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.41, 11.84, 11.71 [04:37:27] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.69, 3.33, 3.03 [04:38:39] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 15.85, 12.82, 12.04 [04:39:55] !log [agent@test131] finished deploy of {'world': True, 'l10n': True} to all - SUCCESS in 952s [04:40:00] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [04:43:11] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.85, 11.61, 11.49 [04:45:07] [02mw-config] 07Universal-Omega commented on pull request 03#5225: Userrights config for nycsubwaywiki - 13https://github.com/miraheze/mw-config/pull/5225#issuecomment-1541344432 [04:48:00] [02mw-config] 07Universal-Omega commented on pull request 03#5225: Userrights config for nycsubwaywiki - 13https://github.com/miraheze/mw-config/pull/5225#issuecomment-1541346518 [04:49:12] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.81, 11.70, 11.47 [04:59:08] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 3.86, 2.45, 1.33 [05:00:39] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.42, 11.25, 11.88 [05:01:08] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.70, 1.98, 1.28 [05:01:10] !log [agent@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=ultrasd5hawiki --no-updates --username-prefix=wikia:projetosmartcity /home/agent/ImportDump/ultrasd5hawiki-20230509151012.xml (START) [05:01:11] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.78, 10.78, 11.66 [05:01:16] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:03:11] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.75, 11.76, 11.89 [05:03:53] !log [agent@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=ultrasd5hawiki --no-updates --username-prefix=wikia:projetosmartcity /home/agent/ImportDump/ultrasd5hawiki-20230509151012.xml (END - exit=0) [05:03:54] !log [agent@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=ultrasd5hawiki (START) [05:04:01] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:04:20] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:05:19] !log [agent@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=ultrasd5hawiki (END - exit=0) [05:05:22] !log [agent@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/initSiteStats.php --wiki=ultrasd5hawiki --active --update (END - exit=0) [05:05:25] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:05:29] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:06:39] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.94, 11.61, 11.74 [05:06:51] !log [agent@mwtask141] finished deploy of {'world': True, 'l10n': True} to all - SUCCESS in 2072s [05:06:56] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:09:11] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.95, 11.23, 11.76 [05:10:57] [02miraheze/MirahezeMagic] 07AgentIsai pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/MirahezeMagic/compare/d926c79433b5...498ec040a578 [05:11:00] [02miraheze/MirahezeMagic] 07AgentIsai 03498ec04 - Alphabetize i18n [05:19:12] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.93, 11.04, 11.29 [05:20:06] miraheze/MirahezeMagic - AgentIsai the build passed. [05:20:39] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.14, 11.50, 11.97 [05:21:12] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.30, 11.13, 11.29 [05:25:11] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.21, 11.39, 11.31 [05:27:11] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.53, 10.24, 10.90 [05:33:12] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.50, 8.70, 10.04 [05:38:39] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 15.57, 11.75, 11.03 [05:40:10] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.40, 10.61, 10.42 [05:42:09] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.35, 10.54, 10.43 [05:42:39] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.17, 11.38, 11.06 [05:44:39] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 15.03, 12.61, 11.54 [05:46:08] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.68, 11.07, 10.61 [05:48:07] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.19, 11.28, 10.79 [05:50:39] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.33, 11.58, 11.53 [05:56:05] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.82, 9.38, 10.09 [06:06:39] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.12, 11.08, 10.97 [06:08:39] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.77, 10.64, 10.83 [06:10:39] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 16.03, 11.94, 11.22 [06:12:59] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.49, 10.89, 10.26 [06:13:23] PROBLEM - cp33 NTP time on cp33 is WARNING: NTP WARNING: Offset 0.2059933543 secs [06:16:57] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.48, 11.42, 10.68 [06:18:57] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.32, 12.23, 11.09 [06:22:56] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.17, 11.49, 11.12 [06:28:39] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 7.04, 10.65, 11.93 [06:30:53] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 9.41, 9.24, 10.16 [06:36:39] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 16.27, 11.99, 11.68 [06:36:51] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.96, 11.93, 11.00 [06:44:48] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.25, 11.54, 11.52 [06:45:23] RECOVERY - cp33 NTP time on cp33 is OK: NTP OK: Offset -0.02685886621 secs [06:50:59] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.54, 6.93, 6.16 [06:52:57] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 4.97, 6.14, 5.96 [06:53:52] PROBLEM - en.religiononfire.mar.in.ua - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query en.religiononfire.mar.in.ua. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [07:00:43] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.63, 10.24, 10.69 [07:02:43] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.26, 9.92, 10.53 [07:04:42] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 15.20, 11.78, 11.13 [07:06:41] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.23, 11.76, 11.23 [07:08:39] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.67, 10.75, 11.85 [07:10:39] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 15.41, 12.10, 12.19 [07:14:39] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 7.65, 10.97, 11.86 [07:16:39] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.40, 11.07, 11.75 [07:18:39] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.09, 10.77, 11.56 [07:23:28] PROBLEM - en.religiononfire.mar.in.ua - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - en.religiononfire.mar.in.ua All nameservers failed to answer the query. [07:24:36] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 9.13, 9.34, 10.20 [07:26:39] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.74, 11.47, 11.49 [07:28:34] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.21, 11.19, 10.78 [07:30:33] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.01, 10.78, 10.71 [07:32:39] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.11, 11.56, 11.64 [07:34:32] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.66, 11.12, 10.75 [07:36:32] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.76, 10.30, 10.49 [07:38:39] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 15.48, 12.46, 11.85 [07:40:30] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.89, 11.78, 11.04 [07:42:30] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.28, 10.71, 10.73 [07:46:39] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.42, 11.95, 12.00 [07:48:28] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 9.17, 9.55, 10.20 [07:53:04] RECOVERY - en.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - en.religiononfire.mar.in.ua reverse DNS resolves to cp22.miraheze.org - CNAME OK [07:54:25] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.57, 10.95, 10.49 [07:54:37] PROBLEM - wiki.joust.ro - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query wiki.joust.ro. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [07:55:50] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 11.91, 8.53, 7.02 [07:56:25] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.44, 11.54, 10.80 [07:56:52] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 6.83, 5.83, 4.68 [07:57:48] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.07, 7.82, 6.95 [07:58:39] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.46, 12.10, 11.79 [07:58:52] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 3.26, 4.84, 4.45 [08:02:40] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.22, 11.33, 11.57 [08:03:43] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 4.80, 6.42, 6.66 [08:04:22] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 17.48, 12.81, 11.45 [08:04:39] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.89, 12.03, 11.78 [08:23:13] RECOVERY - wiki.joust.ro - reverse DNS on sslhost is OK: SSL OK - wiki.joust.ro reverse DNS resolves to cp23.miraheze.org - CNAME OK [08:24:39] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.41, 11.10, 11.89 [08:28:15] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.16, 10.87, 11.91 [08:34:13] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 16.97, 11.70, 11.63 [08:34:39] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 14.08, 11.87, 11.63 [08:36:39] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.95, 11.49, 11.52 [08:38:39] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.49, 12.30, 11.84 [08:40:11] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.14, 11.24, 11.46 [08:42:39] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.84, 11.70, 11.72 [08:46:19] PROBLEM - db101 Backups SQL on db101 is CRITICAL: FILE_AGE CRITICAL: /var/log/sql-backup.log is 1209693 seconds old and 1753 bytes [08:50:08] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.83, 10.01, 10.44 [08:50:39] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 16.28, 11.79, 11.44 [08:52:08] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.24, 10.33, 10.53 [08:52:39] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.72, 11.81, 11.53 [08:54:07] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.06, 9.34, 10.16 [08:56:39] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.11, 11.70, 11.50 [08:58:05] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.22, 10.44, 10.47 [08:58:39] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 7.26, 10.01, 10.90 [09:02:04] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.76, 11.56, 10.85 [09:06:39] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 18.13, 12.77, 11.51 [09:10:39] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.66, 11.39, 11.30 [09:12:01] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 6.67, 10.24, 11.07 [09:16:39] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 15.07, 12.49, 11.61 [09:18:39] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.49, 11.61, 11.39 [09:21:58] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.60, 8.69, 9.99 [09:28:54] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 15.83, 12.03, 10.79 [09:30:39] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.43, 11.91, 11.15 [09:34:39] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.19, 11.27, 11.12 [09:36:12] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.32, 6.47, 6.05 [09:36:52] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.14, 11.47, 11.32 [09:37:05] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 9.42, 6.62, 3.39 [09:38:10] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 4.91, 5.94, 5.91 [09:38:51] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 14.64, 12.75, 11.79 [09:40:39] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 15.53, 12.03, 11.30 [09:41:01] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.26, 3.72, 2.95 [09:43:00] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.25, 2.90, 2.73 [09:44:39] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.28, 12.00, 11.62 [09:44:50] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.51, 10.92, 11.37 [09:46:39] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.37, 12.30, 11.75 [09:48:48] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 16.18, 12.85, 11.96 [09:50:48] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.98, 11.93, 11.75 [09:52:39] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.15, 11.78, 11.84 [09:54:39] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.87, 12.18, 11.97 [09:56:39] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.77, 11.00, 11.58 [09:59:47] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.46, 7.21, 6.49 [10:04:39] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.81, 11.65, 11.45 [10:04:43] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 15.47, 12.61, 11.78 [10:05:42] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.56, 6.52, 6.44 [10:06:39] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.97, 10.64, 11.11 [10:08:42] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.42, 11.41, 11.51 [10:14:39] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.84, 8.82, 9.98 [10:22:39] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 14.32, 11.10, 10.46 [10:24:39] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.59, 10.44, 10.28 [10:26:37] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.61, 9.05, 9.96 [10:26:39] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.99, 11.23, 10.57 [10:28:39] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.59, 10.52, 10.39 [10:30:39] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.53, 9.57, 10.07 [10:34:33] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.93, 11.22, 10.53 [10:36:07] [02MirahezeMagic] 07amire80 opened pull request 03#423: Fix message spelling - 13https://github.com/miraheze/MirahezeMagic/pull/423 [10:36:32] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.24, 10.29, 10.26 [10:38:32] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.75, 11.21, 10.59 [10:40:31] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.07, 10.12, 10.30 [10:40:39] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 14.26, 11.16, 10.45 [10:42:31] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 9.81, 9.78, 10.13 [10:44:10] miraheze/MirahezeMagic - amire80 the build passed. [10:44:39] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.50, 11.58, 10.88 [10:50:27] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 15.90, 12.82, 11.12 [10:50:39] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 17.11, 12.86, 11.45 [10:50:57] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.61, 6.60, 6.23 [10:52:55] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 6.75, 6.31, 6.15 [10:54:26] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.14, 11.36, 10.91 [10:54:39] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.41, 11.65, 11.33 [10:58:25] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 16.13, 11.85, 11.07 [10:58:39] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 15.35, 12.38, 11.61 [11:02:24] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.69, 11.30, 11.11 [11:04:23] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 15.55, 13.01, 11.76 [11:59:04] PROBLEM - wiki.nj.cn.eu.org - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query cn.eu.org. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [12:00:23] PROBLEM - cp23 NTP time on cp23 is WARNING: NTP WARNING: Offset 0.1197238266 secs [12:21:30] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.88, 6.74, 6.46 [12:21:38] PROBLEM - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - uk.religiononfire.mar.in.ua All nameservers failed to answer the query. [12:25:27] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.58, 6.49, 6.45 [12:28:59] RECOVERY - wiki.nj.cn.eu.org - reverse DNS on sslhost is OK: SSL OK - wiki.nj.cn.eu.org reverse DNS resolves to cp23.miraheze.org - CNAME OK [12:30:46] PROBLEM - db142 Current Load on db142 is CRITICAL: CRITICAL - load average: 8.51, 5.67, 3.21 [12:32:23] RECOVERY - cp23 NTP time on cp23 is OK: NTP OK: Offset 0.08049562573 secs [12:32:45] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 4.97, 5.60, 3.51 [12:42:00] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.08, 3.37, 2.88 [12:44:00] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 3.05, 3.21, 2.89 [12:46:04] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.38, 7.78, 7.01 [12:50:00] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.55, 7.40, 6.96 [12:51:24] RECOVERY - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - uk.religiononfire.mar.in.ua reverse DNS resolves to cp23.miraheze.org - CNAME OK [12:51:59] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 5.84, 6.84, 6.81 [12:54:56] PROBLEM - en.religiononfire.mar.in.ua - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query mar.in.ua. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [12:59:51] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.37, 7.86, 7.31 [13:07:44] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 5.16, 7.56, 7.58 [13:13:39] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 12.86, 9.16, 8.08 [13:19:27] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.19, 3.49, 2.57 [13:19:34] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.51, 7.37, 7.59 [13:21:25] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.86, 3.59, 2.71 [13:21:32] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.74, 7.68, 7.66 [13:23:23] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.02, 4.04, 3.01 [13:24:32] RECOVERY - en.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - en.religiononfire.mar.in.ua reverse DNS resolves to cp23.miraheze.org - CNAME OK [13:25:12] [02miraheze/MirahezeMagic] 07AgentIsai pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/MirahezeMagic/compare/498ec040a578...fdf5e01cb42f [13:25:15] [02miraheze/MirahezeMagic] 07AgentIsai 03fdf5e01 - Semi-alphabetize onMessageCacheGet array [13:25:21] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.59, 3.84, 3.05 [13:25:29] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.80, 7.16, 7.43 [13:29:18] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.45, 3.09, 2.92 [13:31:23] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.83, 7.49, 7.37 [13:33:22] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.80, 7.47, 7.37 [13:37:18] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 10.57, 7.89, 7.49 [13:38:46] PROBLEM - db142 Current Load on db142 is CRITICAL: CRITICAL - load average: 9.00, 6.56, 4.04 [13:42:18] PROBLEM - os141 Current Load on os141 is WARNING: WARNING - load average: 3.44, 2.99, 1.77 [13:43:13] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 5.49, 7.46, 7.51 [13:44:46] PROBLEM - db142 Current Load on db142 is WARNING: WARNING - load average: 6.32, 7.23, 5.26 [13:46:16] RECOVERY - os141 Current Load on os141 is OK: OK - load average: 1.71, 2.76, 2.00 [13:46:23] PROBLEM - cp23 NTP time on cp23 is WARNING: NTP WARNING: Offset 0.1023268998 secs [13:46:46] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 1.58, 5.18, 4.75 [13:53:05] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 10.52, 7.70, 7.44 [13:56:07] PROBLEM - en.religiononfire.mar.in.ua - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query en.religiononfire.mar.in.ua. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [13:57:02] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.42, 7.83, 7.61 [14:06:54] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.32, 8.20, 7.73 [14:08:52] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.12, 7.82, 7.65 [14:12:23] RECOVERY - cp23 NTP time on cp23 is OK: NTP OK: Offset 0.09182628989 secs [14:12:48] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.05, 7.95, 7.73 [14:14:22] PROBLEM - mw121 MediaWiki Rendering on mw121 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:14:47] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 5.03, 7.00, 7.42 [14:18:30] RECOVERY - mw121 MediaWiki Rendering on mw121 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 7.689 second response time [14:18:46] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 10.44, 8.53, 7.92 [14:22:47] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.79, 7.62, 7.71 [14:25:43] PROBLEM - en.religiononfire.mar.in.ua - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - en.religiononfire.mar.in.ua All nameservers failed to answer the query. [14:36:46] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.23, 7.48, 7.18 [14:38:46] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.20, 7.49, 7.24 [14:44:46] PROBLEM - db142 Current Load on db142 is CRITICAL: CRITICAL - load average: 8.37, 6.37, 3.52 [14:46:46] PROBLEM - db142 Current Load on db142 is WARNING: WARNING - load average: 7.70, 6.77, 4.02 [14:48:46] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 2.46, 5.10, 3.74 [14:48:46] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 10.28, 7.97, 7.34 [14:52:46] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.65, 7.51, 7.31 [14:55:19] RECOVERY - en.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - en.religiononfire.mar.in.ua reverse DNS resolves to cp22.miraheze.org - CNAME OK [14:55:45] PROBLEM - mw121 MediaWiki Rendering on mw121 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:56:00] [Grafana] FIRING: Some MediaWiki Appservers are running out of PHP-FPM workers. https://grafana.miraheze.org/d/GtxbP1Xnk?orgId=1 [14:58:46] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.82, 6.26, 6.79 [14:59:56] RECOVERY - mw121 MediaWiki Rendering on mw121 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 8.023 second response time [15:04:16] PROBLEM - mw121 MediaWiki Rendering on mw121 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:06:21] RECOVERY - mw121 MediaWiki Rendering on mw121 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 9.764 second response time [15:10:41] PROBLEM - mw121 MediaWiki Rendering on mw121 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:11:51] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.77, 3.59, 3.14 [15:13:49] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.92, 2.99, 2.98 [15:14:48] RECOVERY - mw121 MediaWiki Rendering on mw121 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 7.969 second response time [15:19:37] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 11.14, 7.81, 6.80 [15:21:36] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.33, 7.36, 6.75 [15:24:52] [02miraheze/MirahezeMagic] 07AgentIsai pushed 031 commit to 03master [+0/-0/±67] 13https://github.com/miraheze/MirahezeMagic/compare/fdf5e01cb42f...35b20422ceae [15:24:54] [02miraheze/MirahezeMagic] 07AgentIsai 0335b2042 - Alphabetize and remove dead groups [15:25:32] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 6.61, 6.63, 6.56 [15:28:15] PROBLEM - graylog131 NTP time on graylog131 is WARNING: NTP WARNING: Offset -0.1041879654 secs [15:29:59] [02MirahezeMagic] 07AgentIsai synchronize pull request 03#423: Fix message spelling - 13https://github.com/miraheze/MirahezeMagic/pull/423 [15:30:27] [02MirahezeMagic] 07AgentIsai synchronize pull request 03#423: Fix message spelling - 13https://github.com/miraheze/MirahezeMagic/pull/423 [15:30:42] [02MirahezeMagic] 07AgentIsai closed pull request 03#423: Fix message spelling - 13https://github.com/miraheze/MirahezeMagic/pull/423 [15:30:43] [02miraheze/MirahezeMagic] 07AgentIsai pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/MirahezeMagic/compare/35b20422ceae...3c99ddac1290 [15:30:46] [02miraheze/MirahezeMagic] 07amire80 033c99dda - Fix message spelling (#423) [15:32:21] RECOVERY - graylog131 NTP time on graylog131 is OK: NTP OK: Offset -0.09464243054 secs [15:33:19] [02miraheze/MirahezeMagic] 07AgentIsai deleted branch 03AgentIsai-patch-1 [15:33:22] [02MirahezeMagic] 07AgentIsai deleted branch 03AgentIsai-patch-1 - 13https://github.com/miraheze/MirahezeMagic [15:33:25] [02miraheze/MirahezeMagic] 07AgentIsai deleted branch 03lockedwikisitenotice [15:33:26] [02MirahezeMagic] 07AgentIsai deleted branch 03lockedwikisitenotice - 13https://github.com/miraheze/MirahezeMagic [15:38:39] [02miraheze/MirahezeMagic] 07AgentIsai created branch 03vanishuser-true 13https://github.com/miraheze/MirahezeMagic/commit/3c99ddac129042d4b54e6f66886ecaddc9a44f99 [15:38:40] [02MirahezeMagic] 07AgentIsai created branch 03vanishuser-true - 13https://github.com/miraheze/MirahezeMagic [15:39:07] [02miraheze/MirahezeMagic] 07AgentIsai pushed 031 commit to 03vanishuser-true [+1/-0/±0] 13https://github.com/miraheze/MirahezeMagic/compare/3c99ddac1290...bc9b558bd748 [15:39:10] [02miraheze/MirahezeMagic] 07AgentIsai 03bc9b558 - Create SpecialVanishUser.php [15:40:53] miraheze/MirahezeMagic - AgentIsai the build has errored. [15:40:56] miraheze/MirahezeMagic - AgentIsai the build has errored. [15:42:23] [02miraheze/MirahezeMagic] 07AgentIsai pushed 031 commit to 03vanishuser-true [+0/-0/±1] 13https://github.com/miraheze/MirahezeMagic/compare/bc9b558bd748...f64145ce6a54 [15:42:24] [02miraheze/MirahezeMagic] 07AgentIsai 03f64145c - i18n [15:42:59] [02miraheze/MirahezeMagic] 07AgentIsai pushed 031 commit to 03vanishuser-true [+0/-0/±1] 13https://github.com/miraheze/MirahezeMagic/compare/f64145ce6a54...4901ce151d25 [15:43:00] [02miraheze/MirahezeMagic] 07AgentIsai 034901ce1 - Add alias for Special:VanishUser [15:45:09] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.85, 6.72, 6.47 [15:46:26] [02miraheze/MirahezeMagic] 07AgentIsai pushed 031 commit to 03vanishuser-true [+0/-0/±1] 13https://github.com/miraheze/MirahezeMagic/compare/4901ce151d25...cd3141e5f37a [15:46:27] [02miraheze/MirahezeMagic] 07AgentIsai 03cd3141e - Add VanishUser in extension.json [15:47:07] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 4.89, 6.17, 6.30 [15:48:30] PROBLEM - mw122 MediaWiki Rendering on mw122 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:52:44] [02miraheze/MirahezeMagic] 07AgentIsai pushed 031 commit to 03vanishuser-true [+0/-0/±1] 13https://github.com/miraheze/MirahezeMagic/compare/cd3141e5f37a...86583cec69b4 [15:52:45] [02miraheze/MirahezeMagic] 07AgentIsai 0386583ce - Add licensing info and credit for VanishUser [15:53:16] [02MirahezeMagic] 07AgentIsai opened pull request 03#424: Create Special:VanishUser - 13https://github.com/miraheze/MirahezeMagic/pull/424 [15:54:43] RECOVERY - mw122 MediaWiki Rendering on mw122 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 5.461 second response time [15:55:59] RECOVERY - wiki.yuanpi.eu.org - reverse DNS on sslhost is OK: SSL OK - wiki.yuanpi.eu.org reverse DNS resolves to cp22.miraheze.org - CNAME OK [15:56:03] [02miraheze/MirahezeMagic] 07github-actions[bot] pushed 031 commit to 03vanishuser-true [+0/-0/±1] 13https://github.com/miraheze/MirahezeMagic/compare/86583cec69b4...774db54fcb4d [15:56:06] [02miraheze/MirahezeMagic] 07github-actions 03774db54 - CI: lint code to MediaWiki standards [15:56:09] [02MirahezeMagic] 07github-actions[bot] synchronize pull request 03#424: Create Special:VanishUser - 13https://github.com/miraheze/MirahezeMagic/pull/424 [15:57:04] miraheze/MirahezeMagic - AgentIsai the build has errored. [15:58:07] PROBLEM - db142 Current Load on db142 is WARNING: WARNING - load average: 7.34, 6.03, 4.64 [16:00:04] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 2.48, 4.47, 4.22 [16:01:10] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 3.74, 3.10, 1.89 [16:03:08] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.26, 2.38, 1.77 [16:03:34] [02miraheze/MirahezeMagic] 07AgentIsai pushed 031 commit to 03vanishuser-true [+0/-0/±1] 13https://github.com/miraheze/MirahezeMagic/compare/774db54fcb4d...5b27f16e0fcb [16:03:35] [02miraheze/MirahezeMagic] 07AgentIsai 035b27f16 - Add comma [16:03:38] [02MirahezeMagic] 07AgentIsai synchronize pull request 03#424: Create Special:VanishUser - 13https://github.com/miraheze/MirahezeMagic/pull/424 [16:06:07] PROBLEM - matomo121 Current Load on matomo121 is WARNING: WARNING - load average: 3.67, 3.31, 2.90 [16:06:10] miraheze/MirahezeMagic - AgentIsai the build has errored. [16:09:10] miraheze/MirahezeMagic - AgentIsai the build has errored. [16:11:47] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.44, 3.45, 2.66 [16:12:07] PROBLEM - matomo121 Current Load on matomo121 is CRITICAL: CRITICAL - load average: 4.19, 3.64, 3.16 [16:13:46] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.62, 2.76, 2.50 [16:14:07] RECOVERY - matomo121 Current Load on matomo121 is OK: OK - load average: 2.64, 3.34, 3.12 [16:18:29] PROBLEM - mw121 MediaWiki Rendering on mw121 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:22:38] RECOVERY - mw121 MediaWiki Rendering on mw121 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 9.204 second response time [16:23:45] PROBLEM - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query uk.religiononfire.mar.in.ua. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [16:31:26] miraheze/MirahezeMagic - AgentIsai the build has errored. [16:36:16] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.36, 7.40, 6.77 [16:38:15] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.10, 7.62, 6.91 [16:40:13] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.59, 7.19, 6.84 [16:41:20] PROBLEM - db142 Current Load on db142 is WARNING: WARNING - load average: 7.10, 6.34, 4.02 [16:42:08] PROBLEM - mw121 MediaWiki Rendering on mw121 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:42:11] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 4.16, 6.08, 6.47 [16:43:17] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 2.39, 4.76, 3.70 [16:44:09] RECOVERY - mw121 MediaWiki Rendering on mw121 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 5.695 second response time [16:48:04] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.32, 7.05, 6.84 [16:50:02] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 11.09, 8.55, 7.40 [16:51:05] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 3.43, 4.02, 3.22 [16:52:00] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.71, 7.82, 7.27 [16:53:03] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.94, 3.84, 3.26 [16:53:31] PROBLEM - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - uk.religiononfire.mar.in.ua All nameservers failed to answer the query. [16:55:02] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.67, 3.04, 3.03 [17:02:11] PROBLEM - mw121 MediaWiki Rendering on mw121 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:04:08] RECOVERY - mw121 MediaWiki Rendering on mw121 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 2.516 second response time [17:05:48] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.04, 7.70, 7.37 [17:09:45] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.41, 7.42, 7.38 [17:12:36] !log [agent@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=robloxroncommunitywiki --no-updates --username-prefix=wikia:old1682954242ronrobloxcommunity /home/agent/ImportDump/robloxroncommunitywiki-20230510012506.xml (START) [17:13:11] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:13:14] !log [agent@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=robloxroncommunitywiki --no-updates --username-prefix=wikia:old1682954242ronrobloxcommunity /home/agent/ImportDump/robloxroncommunitywiki-20230510012506.xml (END - exit=0) [17:13:15] !log [agent@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=robloxroncommunitywiki (START) [17:13:18] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:13:42] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:14:05] !log [agent@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=robloxroncommunitywiki (END - exit=0) [17:14:06] !log [agent@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/initSiteStats.php --wiki=robloxroncommunitywiki --active --update (END - exit=0) [17:14:21] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:14:56] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:23:18] PROBLEM - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query mar.in.ua. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [17:23:33] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 4.75, 6.33, 6.78 [17:27:27] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.21, 7.32, 7.12 [17:31:00] [Grafana] RESOLVED: PHP-FPM Worker Usage High https://grafana.miraheze.org/d/GtxbP1Xnk?orgId=1 [17:31:24] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.38, 3.72, 2.85 [17:32:05] PROBLEM - mw122 MediaWiki Rendering on mw122 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:33:22] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 3.33, 3.27, 2.77 [17:34:06] RECOVERY - mw122 MediaWiki Rendering on mw122 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 5.125 second response time [17:35:20] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.44, 8.00, 7.44 [17:36:04] [02miraheze/ssl] 07MacFan4000 pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/b34238ec5458...edfbceb3c5f2 [17:36:06] [02miraheze/ssl] 07MacFan4000 03edfbceb - rm source.erag.eu.org redirect [17:37:17] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.00, 3.49, 3.00 [17:37:18] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.44, 7.17, 7.19 [17:39:46] [02miraheze/ssl] 07MacFan4000 pushed 031 commit to 03MacFan4000-patch-1 [+0/-1/±0] 13https://github.com/miraheze/ssl/commit/75bb3474b643 [17:39:48] [02miraheze/ssl] 07MacFan4000 0375bb347 - Delete source.erag.eu.org.crt [17:39:49] [02ssl] 07MacFan4000 created branch 03MacFan4000-patch-1 - 13https://github.com/miraheze/ssl [17:39:52] [02ssl] 07MacFan4000 opened pull request 03#650: Rm source.erag.eu.org - 13https://github.com/miraheze/ssl/pull/650 [17:41:13] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.52, 3.18, 2.99 [17:41:42] [02miraheze/ssl] 07MacFan4000 pushed 031 commit to 03MacFan4000-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/75bb3474b643...fedd2928ac05 [17:41:45] [02miraheze/ssl] 07MacFan4000 03fedd292 - Update certs.yaml [17:41:46] [02ssl] 07MacFan4000 synchronize pull request 03#650: Rm source.erag.eu.org - 13https://github.com/miraheze/ssl/pull/650 [17:42:29] PROBLEM - mw121 MediaWiki Rendering on mw121 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:43:13] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.41, 7.01, 7.02 [17:43:36] PROBLEM - graylog131 NTP time on graylog131 is WARNING: NTP WARNING: Offset -0.1051188409 secs [17:44:25] RECOVERY - mw121 MediaWiki Rendering on mw121 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.718 second response time [17:45:11] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.98, 7.14, 7.08 [17:46:30] [02ssl] 07MacFan4000 closed pull request 03#650: Rm source.erag.eu.org - 13https://github.com/miraheze/ssl/pull/650 [17:46:33] [02miraheze/ssl] 07MacFan4000 deleted branch 03MacFan4000-patch-1 [17:46:34] [02miraheze/ssl] 07MacFan4000 pushed 031 commit to 03master [+0/-1/±1] 13https://github.com/miraheze/ssl/compare/edfbceb3c5f2...7e80066f1c0c [17:46:37] [02miraheze/ssl] 07MacFan4000 037e80066 - Rm source.erag.eu.org (#650) [17:46:39] [02ssl] 07MacFan4000 deleted branch 03MacFan4000-patch-1 - 13https://github.com/miraheze/ssl [17:49:04] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.74, 3.82, 3.29 [17:49:45] RECOVERY - graylog131 NTP time on graylog131 is OK: NTP OK: Offset -0.09489023685 secs [17:51:02] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.92, 3.03, 3.06 [17:52:35] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.19, 3.59, 2.74 [17:53:44] RECOVERY - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - uk.religiononfire.mar.in.ua reverse DNS resolves to cp22.miraheze.org - CNAME OK [17:54:35] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.92, 3.07, 2.66 [17:59:31] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 10.54, 7.72, 7.23 [18:03:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.45, 7.54, 7.29 [18:05:32] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.28, 3.45, 3.07 [18:07:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.86, 7.96, 7.46 [18:07:29] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 7.06, 4.19, 3.35 [18:09:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 5.98, 7.40, 7.34 [18:11:23] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.90, 3.82, 3.42 [18:11:36] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.07, 3.23, 2.40 [18:13:20] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.59, 3.37, 3.30 [18:13:33] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 3.27, 3.20, 2.49 [18:17:01] PROBLEM - db142 Current Load on db142 is CRITICAL: CRITICAL - load average: 9.37, 6.14, 3.18 [18:17:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.26, 7.35, 7.18 [18:18:01] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.61, 3.42, 3.02 [18:19:00] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 1.89, 4.48, 2.94 [18:19:58] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 3.26, 3.23, 2.99 [18:23:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.67, 7.77, 7.49 [18:23:54] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.57, 4.63, 3.69 [18:25:31] PROBLEM - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query uk.religiononfire.mar.in.ua. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [18:25:51] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.40, 4.00, 3.56 [18:27:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.23, 7.55, 7.45 [18:27:47] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.61, 3.23, 3.34 [18:29:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 5.97, 6.97, 7.25 [18:31:57] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.98, 5.22, 3.94 [18:35:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.06, 7.38, 7.36 [18:36:10] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.31, 3.53, 3.17 [18:37:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.35, 7.26, 7.31 [18:37:57] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.79, 3.83, 3.76 [18:38:10] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.57, 3.46, 3.18 [18:41:57] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.50, 2.56, 3.25 [18:44:10] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.09, 3.74, 3.40 [18:46:10] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.32, 3.50, 3.35 [18:48:10] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 3.25, 3.40, 3.33 [18:55:21] RECOVERY - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - uk.religiononfire.mar.in.ua reverse DNS resolves to cp23.miraheze.org - CNAME OK [18:55:25] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 6.60, 6.36, 6.79 [18:59:09] PROBLEM - mw121 MediaWiki Rendering on mw121 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:00:10] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.88, 3.58, 3.40 [19:01:09] RECOVERY - mw121 MediaWiki Rendering on mw121 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 5.166 second response time [19:02:10] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 3.24, 3.40, 3.35 [19:03:32] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.27, 3.64, 3.30 [19:05:29] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.13, 3.16, 3.17 [19:06:10] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.74, 3.70, 3.49 [19:10:10] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.44, 3.94, 3.63 [19:12:30] PROBLEM - mw121 MediaWiki Rendering on mw121 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:14:10] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.14, 3.68, 3.61 [19:21:04] PROBLEM - db142 Current Load on db142 is WARNING: WARNING - load average: 7.36, 4.81, 2.74 [19:21:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.19, 8.01, 6.97 [19:22:10] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.18, 3.68, 3.61 [19:23:03] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 2.49, 4.06, 2.74 [19:23:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 5.63, 6.90, 6.68 [19:24:10] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.58, 3.68, 3.62 [19:25:25] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.13, 6.29, 6.48 [19:26:10] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 1.89, 3.06, 3.40 [19:29:02] RECOVERY - mw121 MediaWiki Rendering on mw121 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 6.648 second response time [19:33:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.48, 7.12, 6.73 [19:35:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.19, 7.18, 6.79 [19:37:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.38, 7.21, 6.84 [19:40:08] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.74, 3.48, 2.68 [19:42:04] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.28, 2.66, 2.47 [19:42:27] PROBLEM - db112 Disk Space on db112 is WARNING: DISK WARNING - free space: / 14527 MB (10% inode=99%); [19:43:25] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 6.14, 6.54, 6.69 [19:47:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 5.79, 6.92, 6.86 [19:47:57] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.55, 3.21, 2.72 [19:49:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.94, 7.62, 7.11 [19:49:54] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.79, 2.64, 2.57 [19:53:34] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 6.92, 6.46, 5.33 [19:57:30] [Grafana] FIRING: Some MediaWiki Appservers are running out of PHP-FPM workers. https://grafana.miraheze.org/d/GtxbP1Xnk?orgId=1 [19:57:34] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 5.83, 6.14, 5.48 [19:59:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.06, 7.67, 7.87 [20:07:30] [Grafana] RESOLVED: PHP-FPM Worker Usage High https://grafana.miraheze.org/d/GtxbP1Xnk?orgId=1 [20:11:22] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.76, 4.14, 3.40 [20:15:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.55, 7.98, 7.48 [20:23:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.55, 7.73, 7.67 [20:25:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.72, 7.94, 7.74 [20:26:56] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.73, 3.50, 3.89 [20:29:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.58, 7.73, 7.68 [20:32:46] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.08, 2.60, 3.38 [20:33:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.57, 7.67, 7.63 [20:35:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.68, 7.28, 7.50 [20:37:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.72, 8.86, 8.12 [20:41:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 5.86, 7.43, 7.73 [20:47:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.24, 6.99, 7.34 [20:48:40] PROBLEM - mw121 MediaWiki Rendering on mw121 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:49:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.24, 6.80, 7.24 [20:50:22] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.04, 3.49, 3.38 [20:50:42] RECOVERY - mw121 MediaWiki Rendering on mw121 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 7.062 second response time [20:52:19] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.87, 3.01, 3.22 [20:55:01] PROBLEM - mw121 MediaWiki Rendering on mw121 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:59:02] RECOVERY - mw121 MediaWiki Rendering on mw121 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 2.208 second response time [20:59:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.77, 7.15, 7.14 [21:00:33] [Grafana] FIRING: Some MediaWiki Appservers are running out of PHP-FPM workers. https://grafana.miraheze.org/d/GtxbP1Xnk?orgId=1 [21:01:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.48, 6.66, 6.95 [21:02:05] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.70, 4.37, 3.65 [21:03:25] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.93, 6.18, 6.73 [21:09:57] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.51, 3.63, 3.69 [21:17:57] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.90, 2.74, 3.25 [21:18:57] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 10.50, 7.96, 7.19 [21:20:51] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.89, 7.49, 7.11 [21:28:53] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.94, 3.25, 3.10 [21:30:50] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.31, 3.79, 3.30 [21:32:46] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.98, 3.36, 3.19 [21:35:22] PROBLEM - db142 Current Load on db142 is WARNING: WARNING - load average: 7.80, 5.16, 3.05 [21:35:33] [Grafana] RESOLVED: PHP-FPM Worker Usage High https://grafana.miraheze.org/d/GtxbP1Xnk?orgId=1 [21:37:21] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 4.47, 5.06, 3.28 [21:39:58] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.91, 6.48, 6.74 [21:44:55] PROBLEM - db112 Current Load on db112 is CRITICAL: CRITICAL - load average: 11.51, 9.17, 4.66 [21:46:55] PROBLEM - db112 Current Load on db112 is WARNING: WARNING - load average: 4.91, 7.29, 4.51 [21:48:55] PROBLEM - db112 Current Load on db112 is CRITICAL: CRITICAL - load average: 8.74, 8.04, 5.13 [21:50:30] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.41, 7.29, 6.91 [21:52:24] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.90, 7.01, 6.85 [21:54:55] PROBLEM - db112 Current Load on db112 is WARNING: WARNING - load average: 5.95, 7.90, 6.33 [21:56:14] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.69, 7.58, 7.10 [21:56:55] PROBLEM - db112 Current Load on db112 is CRITICAL: CRITICAL - load average: 8.98, 8.81, 6.87 [21:57:12] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.66, 4.48, 3.51 [21:58:08] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 4.70, 6.44, 6.74 [22:00:51] [02mw-config] 07Amanda-Catherine commented on pull request 03#5225: Userrights config for nycsubwaywiki - 13https://github.com/miraheze/mw-config/pull/5225#issuecomment-1542867260 [22:02:27] PROBLEM - db112 Disk Space on db112 is CRITICAL: DISK CRITICAL - free space: / 7552 MB (5% inode=99%); [22:04:55] PROBLEM - db112 Current Load on db112 is WARNING: WARNING - load average: 5.30, 7.45, 7.27 [22:07:42] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.87, 7.22, 6.79 [22:08:12] [02mw-config] 07AgentIsai commented on pull request 03#5225: Userrights config for nycsubwaywiki - 13https://github.com/miraheze/mw-config/pull/5225#issuecomment-1542873710 [22:09:37] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 6.40, 6.75, 6.67 [22:10:49] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.42, 3.30, 3.72 [22:10:55] RECOVERY - db112 Current Load on db112 is OK: OK - load average: 3.66, 5.24, 6.43 [22:13:28] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.56, 7.17, 6.86 [22:15:25] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 6.24, 6.77, 6.74 [22:16:40] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.45, 2.46, 3.24 [22:16:55] PROBLEM - db112 Current Load on db112 is CRITICAL: CRITICAL - load average: 9.77, 10.41, 8.34 [22:18:55] PROBLEM - db112 Current Load on db112 is WARNING: WARNING - load average: 4.12, 8.00, 7.70 [22:21:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.73, 7.42, 7.01 [22:22:55] PROBLEM - db112 Current Load on db112 is CRITICAL: CRITICAL - load average: 42.67, 16.06, 10.33 [22:26:27] RECOVERY - db112 Disk Space on db112 is OK: DISK OK - free space: / 16204 MB (12% inode=99%); [22:31:25] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.47, 6.34, 6.77 [22:31:51] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.24, 3.65, 3.06 [22:32:27] PROBLEM - db112 Disk Space on db112 is WARNING: DISK WARNING - free space: / 14134 MB (10% inode=99%); [22:35:38] PROBLEM - cp23 NTP time on cp23 is WARNING: NTP WARNING: Offset 0.1143487692 secs [22:35:44] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.02, 2.97, 2.92 [22:39:07] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.11, 3.44, 3.01 [22:40:55] PROBLEM - db112 Current Load on db112 is WARNING: WARNING - load average: 3.54, 5.43, 7.98 [22:41:03] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.40, 2.73, 2.81 [22:41:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.86, 7.69, 7.16 [22:43:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.55, 7.79, 7.24 [22:44:55] PROBLEM - db112 Current Load on db112 is CRITICAL: CRITICAL - load average: 20.57, 8.99, 8.52 [22:45:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.65, 7.78, 7.31 [22:45:38] RECOVERY - cp23 NTP time on cp23 is OK: NTP OK: Offset 0.09141245484 secs [22:46:27] RECOVERY - db112 Disk Space on db112 is OK: DISK OK - free space: / 18264 MB (13% inode=99%); [22:46:55] PROBLEM - db112 Current Load on db112 is WARNING: WARNING - load average: 3.79, 6.48, 7.66 [22:46:57] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.23, 3.75, 3.23 [22:48:54] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.80, 3.39, 3.16 [22:48:55] RECOVERY - db112 Current Load on db112 is OK: OK - load average: 0.73, 4.44, 6.77 [22:52:15] miraheze/MirahezeMagic - AgentIsai the build has errored. [22:53:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 10.25, 7.38, 7.17 [22:54:18] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.03, 2.94, 2.63 [22:56:14] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.73, 2.90, 2.65 [22:57:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.62, 7.26, 7.19 [23:01:25] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 6.21, 6.35, 6.80 [23:13:17] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.83, 3.57, 3.21 [23:15:13] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.03, 3.93, 3.40 [23:23:00] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.07, 3.88, 3.72 [23:24:36] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.52, 3.94, 3.30 [23:26:33] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 6.95, 4.97, 3.74 [23:27:36] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.16, 10.10, 11.72 [23:27:41] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.06, 10.23, 11.57 [23:28:29] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.02, 3.77, 3.45 [23:28:50] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.80, 2.82, 3.34 [23:29:36] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.57, 10.68, 11.71 [23:30:26] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.50, 3.34, 3.32 [23:31:36] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.97, 10.95, 11.68 [23:33:36] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.49, 11.60, 11.83 [23:33:41] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 18.78, 13.52, 12.42 [23:35:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.92, 6.70, 6.45 [23:36:40] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.37, 4.20, 3.71 [23:38:36] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.82, 3.89, 3.65 [23:39:25] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.90, 6.55, 6.46 [23:40:36] [02miraheze/MirahezeMagic] 07AgentIsai pushed 031 commit to 03vanishuser-true [+0/-0/±1] 13https://github.com/miraheze/MirahezeMagic/compare/5b27f16e0fcb...c4005309c1ca [23:40:39] [02miraheze/MirahezeMagic] 07AgentIsai 03c400530 - Add SpecialVanishUser class [23:40:42] [02MirahezeMagic] 07AgentIsai synchronize pull request 03#424: Create Special:VanishUser - 13https://github.com/miraheze/MirahezeMagic/pull/424 [23:42:30] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 7.81, 4.47, 3.83 [23:43:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.51, 8.08, 7.11 [23:45:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.75, 7.45, 7.00 [23:48:20] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.95, 3.77, 3.72 [23:49:25] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.47, 6.55, 6.75 [23:50:16] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.16, 4.21, 3.88 [23:50:29] miraheze/MirahezeMagic - AgentIsai the build passed. [23:51:11] [02MirahezeMagic] 07AgentIsai closed pull request 03#424: Create Special:VanishUser - 13https://github.com/miraheze/MirahezeMagic/pull/424 [23:51:13] [02miraheze/MirahezeMagic] 07AgentIsai pushed 031 commit to 03master [+1/-0/±4] 13https://github.com/miraheze/MirahezeMagic/compare/3c99ddac1290...7a6a2a4a2b35 [23:51:15] [02miraheze/MirahezeMagic] 07AgentIsai 037a6a2a4 - Create Special:VanishUser (#424) [23:52:40] [02miraheze/mediawiki] 07AgentIsai pushed 031 commit to 03REL1_39 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/e1bc079b30d8...d544fcf00a06 [23:52:41] [02miraheze/mediawiki] 07AgentIsai 03d544fcf - Update MirahezeMagic [23:55:36] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.39, 10.63, 11.80 [23:55:59] [02miraheze/mediawiki] 07AgentIsai pushed 031 commit to 03REL1_40 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/21e708fd8a0b...2ee9e3548763 [23:56:01] [02miraheze/mediawiki] 07AgentIsai 032ee9e35 - Update MirahezeMagic [23:56:07] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.03, 3.95, 3.89 [23:56:14] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.15, 7.33, 7.04 [23:56:20] !log [agent@mwtask141] starting deploy of {'world': True, 'l10n': True} to all [23:56:26] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:56:27] !log [agent@test131] starting deploy of {'world': True, 'l10n': True} to all [23:56:32] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:58:09] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.47, 6.96, 6.91 [23:59:11] miraheze/MirahezeMagic - AgentIsai the build passed.