[00:01:01] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 22.15, 8.20, 3.52 [00:01:28] PROBLEM - cp23 APT on cp23 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [00:02:13] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 8.67, 6.28, 4.16 [00:02:34] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.89, 4.32, 3.37 [00:04:25] RECOVERY - cp23 APT on cp23 is OK: APT OK: 1 packages available for upgrade (0 critical updates). [00:05:15] PROBLEM - es141 Current Load on es141 is WARNING: WARNING - load average: 3.52, 2.57, 1.40 [00:06:31] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.01, 3.89, 3.43 [00:07:15] RECOVERY - es141 Current Load on es141 is OK: OK - load average: 2.52, 2.57, 1.55 [00:10:27] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.53, 3.35, 3.31 [00:14:55] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 0.79, 2.44, 3.72 [00:15:49] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.90, 3.29, 3.97 [00:18:53] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 0.59, 1.61, 3.10 [00:21:39] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 6.27, 4.05, 4.00 [00:23:36] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.19, 3.54, 3.81 [00:25:33] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.81, 3.63, 3.79 [00:26:23] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.46, 3.48, 3.26 [00:27:29] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.90, 3.03, 3.56 [00:30:23] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.48, 3.04, 3.18 [00:31:23] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.98, 2.94, 3.39 [00:35:19] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.71, 4.39, 3.86 [00:50:52] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.22, 3.09, 3.89 [00:56:43] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.21, 3.23, 3.66 [00:58:39] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.97, 2.71, 3.42 [01:00:36] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.71, 2.81, 3.37 [01:04:32] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 6.46, 4.78, 4.01 [01:10:27] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.51, 3.91, 3.88 [01:16:27] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 8.42, 4.75, 4.11 [01:20:27] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.55, 3.44, 3.72 [01:24:27] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.25, 4.16, 3.95 [01:24:39] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.44, 2.99, 2.74 [01:26:37] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.39, 3.83, 3.07 [01:28:36] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.02, 3.15, 2.92 [01:46:27] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.70, 3.09, 3.97 [01:52:27] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.55, 3.50, 3.80 [01:54:27] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.80, 3.41, 3.75 [01:56:23] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 8.36, 5.03, 3.42 [01:58:27] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.51, 2.67, 3.34 [02:00:23] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.46, 3.73, 3.28 [02:01:16] PROBLEM - cp23 APT on cp23 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [02:02:42] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 5.99, 4.62, 2.47 [02:05:00] PROBLEM - db142 Current Load on db142 is CRITICAL: CRITICAL - load average: 10.74, 5.80, 3.17 [02:06:23] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.00, 2.99, 3.14 [02:07:00] PROBLEM - db142 Current Load on db142 is WARNING: WARNING - load average: 7.31, 7.17, 4.06 [02:09:00] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 1.77, 5.11, 3.68 [02:09:12] RECOVERY - cp23 APT on cp23 is OK: APT OK: 1 packages available for upgrade (0 critical updates). [02:10:23] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.29, 3.68, 3.45 [02:12:23] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.43, 4.37, 3.76 [02:12:41] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 0.48, 2.81, 3.13 [02:17:09] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 6.29, 4.81, 3.87 [02:18:23] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.53, 3.46, 3.62 [02:22:23] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.19, 2.77, 3.29 [02:28:23] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.50, 3.47, 3.53 [02:28:49] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.02, 3.45, 3.84 [02:30:23] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.84, 2.90, 3.31 [02:36:36] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.41, 3.63, 3.73 [02:38:33] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.79, 3.19, 3.55 [02:42:27] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.23, 2.75, 3.29 [02:55:08] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.03, 3.69, 3.12 [02:55:29] PROBLEM - dc-multiverse.dcwikis.com - LetsEncrypt on sslhost is CRITICAL: connect to address dc-multiverse.dcwikis.com and port 443: Network is unreachableHTTP CRITICAL - Unable to open TCP socket [02:59:23] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.11, 3.81, 3.51 [03:01:20] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.11, 4.06, 3.64 [03:03:16] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.24, 3.60, 3.51 [03:05:13] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.46, 3.22, 3.38 [03:06:59] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.00, 3.78, 3.74 [03:09:45] PROBLEM - dc-multiverse.dcwikis.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for dc-multiverse.dcwikis.com could not be found [03:10:56] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.87, 2.84, 3.36 [03:20:09] PROBLEM - en.religiononfire.mar.in.ua - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query mar.in.ua. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [03:26:42] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.83, 3.68, 3.19 [03:28:39] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.80, 3.79, 3.27 [03:32:32] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.15, 3.90, 3.45 [03:34:29] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.40, 3.34, 3.29 [03:35:28] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.19, 10.16, 8.40 [03:37:28] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 6.99, 8.94, 8.17 [03:38:27] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.76, 3.47, 3.35 [03:40:27] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.63, 3.35, 3.33 [03:48:27] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.15, 4.64, 3.90 [03:48:48] RECOVERY - en.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - en.religiononfire.mar.in.ua reverse DNS resolves to cp23.miraheze.org - CNAME OK [03:52:27] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.68, 3.78, 3.74 [03:55:23] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 6.03, 4.24, 2.99 [03:56:27] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.76, 3.76, 3.68 [03:57:21] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.13, 3.65, 2.92 [03:59:20] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.82, 4.55, 3.33 [04:00:27] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.89, 4.00, 3.87 [04:01:18] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.58, 3.36, 3.05 [04:02:27] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.25, 4.15, 3.94 [04:05:28] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.83, 9.80, 8.22 [04:07:28] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.26, 9.25, 8.22 [04:12:27] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.87, 3.75, 3.92 [04:18:27] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.68, 2.63, 3.38 [04:18:52] PROBLEM - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query mar.in.ua. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [04:22:27] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.60, 4.09, 3.82 [04:24:27] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.90, 3.48, 3.62 [04:28:27] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.34, 3.03, 3.40 [04:31:48] PROBLEM - cp23 APT on cp23 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [04:32:41] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 4.69, 4.35, 2.44 [04:33:48] RECOVERY - cp23 APT on cp23 is OK: APT OK: 1 packages available for upgrade (0 critical updates). [04:34:41] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 0.86, 3.03, 2.19 [05:00:41] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 6.36, 3.60, 2.19 [05:00:46] PROBLEM - cp23 APT on cp23 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [05:02:41] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 3.56, 3.46, 2.31 [05:04:41] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 4.64, 4.07, 2.69 [05:09:20] RECOVERY - cp23 APT on cp23 is OK: APT OK: 1 packages available for upgrade (0 critical updates). [05:12:41] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 0.47, 3.01, 3.05 [05:16:52] RECOVERY - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - uk.religiononfire.mar.in.ua reverse DNS resolves to cp23.miraheze.org - CNAME OK [05:21:00] PROBLEM - db142 Current Load on db142 is WARNING: WARNING - load average: 7.76, 5.41, 2.76 [05:23:00] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 4.92, 5.71, 3.23 [05:41:19] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.68, 9.57, 8.51 [05:43:19] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.50, 8.63, 8.29 [05:47:00] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.11, 3.33, 2.68 [05:48:52] PROBLEM - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - uk.religiononfire.mar.in.ua All nameservers failed to answer the query. [05:50:54] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 3.30, 3.39, 2.84 [05:54:13] !log reception@mwtask141:~$ sudo -u www-data /usr/local/bin/foreachwikiindblist /srv/mediawiki/cache/databases.json /srv/mediawiki/w/extensions/ManageWiki/maintenance/populateWikiSettings.php --wgsetting=wgPivotFeatures --sourcelist=false --remove [05:54:17] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:54:46] [02mw-config] 07Reception123 closed pull request 03#5128: T10440: Add Pivot settings for wanderingstarswiki - 13https://github.com/miraheze/mw-config/pull/5128 [05:54:47] [02miraheze/mw-config] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/73673af6ff82...779e20bd53de [05:54:50] [02miraheze/mw-config] 07redbluegreenhat 03779e20b - T10440: Add Pivot settings for wanderingstarswiki (#5128) [05:55:59] miraheze/mw-config - Reception123 the build passed. [05:56:31] [02mw-config] 07Reception123 closed pull request 03#5145: Update README - 13https://github.com/miraheze/mw-config/pull/5145 [05:56:34] [02miraheze/mw-config] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/779e20bd53de...32b561a78634 [05:56:36] [02miraheze/mw-config] 07brandon-wm 0332b561a - Update README (#5145) [05:57:06] [02mw-config] 07Reception123 closed pull request 03#5163: Updated copyright year for revitwiki - 13https://github.com/miraheze/mw-config/pull/5163 [05:57:07] [02miraheze/mw-config] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/32b561a78634...a198d43d5759 [05:57:10] [02miraheze/mw-config] 07RevitIRL 03a198d43 - Updated copyright year for revitwiki (#5163) [05:57:37] miraheze/mw-config - Reception123 the build passed. [05:57:40] RECOVERY - test131 Puppet on test131 is OK: OK: Puppet is currently enabled, last run 40 seconds ago with 0 failures [05:57:42] [02mw-config] 07Reception123 closed pull request 03#5164: Update MirahezeStaffAccessIDs - 13https://github.com/miraheze/mw-config/pull/5164 [05:57:45] [02miraheze/mw-config] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/a198d43d5759...686d7dc5c4ba [05:57:48] [02miraheze/mw-config] 07brandon-wm 03686d7dc - Update MirahezeStaffAccessIDs (#5164) [05:58:08] miraheze/mw-config - Reception123 the build passed. [05:58:48] miraheze/mw-config - Reception123 the build passed. [06:04:01] PROBLEM - test131 MediaWiki Rendering on test131 is CRITICAL: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - 314 bytes in 0.026 second response time [06:04:47] [02mw-config] 07Reception123 closed pull request 03#5121: Revert "T10440: Add some Pivot settings to ManageWiki" - 13https://github.com/miraheze/mw-config/pull/5121 [06:04:48] [02miraheze/mw-config] 07Reception123 deleted branch 03revert-5110-T10440 [06:04:50] [02miraheze/mw-config] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/686d7dc5c4ba...e315d7256cf3 [06:04:53] [02miraheze/mw-config] 07Reception123 03e315d72 - Revert "T10440: Add some Pivot settings to ManageWiki" (#5121) [06:04:56] [02mw-config] 07Reception123 deleted branch 03revert-5110-T10440 - 13https://github.com/miraheze/mw-config [06:05:49] miraheze/mw-config - Reception123 the build passed. [06:09:13] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 9.81, 5.32, 3.22 [06:12:43] !log [@mwtask141] starting deploy of {'config': True} to all [06:12:47] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:12:52] !log [@mwtask141] finished deploy of {'config': True} to all - SUCCESS in 9s [06:12:56] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:17:22] [02WikiDiscover] 07joritochip opened pull request 03#91: API: Add creation date to output (T10606) - 13https://github.com/miraheze/WikiDiscover/pull/91 [06:25:54] PROBLEM - db121 Current Load on db121 is WARNING: WARNING - load average: 7.82, 5.65, 3.07 [06:27:50] !log [@test131] starting deploy of {'config': True} to all [06:27:51] !log [@test131] DEPLOY ABORTED: Canary check failed for beta.betaheze.org@localhost [06:27:54] RECOVERY - db121 Current Load on db121 is OK: OK - load average: 1.86, 4.06, 2.79 [06:27:54] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:27:59] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:31:25] PROBLEM - test131 Puppet on test131 is CRITICAL: CRITICAL: Puppet has 2 failures. Last run 3 minutes ago with 2 failures. Failed resources (up to 3 shown): Exec[MediaWiki Config Sync],Exec[Landing Sync] [06:35:13] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 2.03, 3.41, 3.97 [06:39:13] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 1.63, 2.34, 3.39 [06:46:53] RECOVERY - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - uk.religiononfire.mar.in.ua reverse DNS resolves to cp22.miraheze.org - CNAME OK [07:17:44] !log db121: MariaDB [(none)]> set global read_only = 0; [07:17:48] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [08:00:46] PROBLEM - cp23 APT on cp23 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [08:02:46] RECOVERY - cp23 APT on cp23 is OK: APT OK: 1 packages available for upgrade (0 critical updates). [08:07:14] PROBLEM - cp33 NTP time on cp33 is WARNING: NTP WARNING: Offset 0.1979669631 secs [08:25:14] RECOVERY - cp33 NTP time on cp33 is OK: NTP OK: Offset 0.06721720099 secs [08:43:07] PROBLEM - cp22 NTP time on cp22 is WARNING: NTP WARNING: Offset 0.1483412683 secs [09:01:30] PROBLEM - cp23 APT on cp23 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [09:02:17] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 10.57, 7.64, 3.86 [09:03:07] RECOVERY - cp22 NTP time on cp22 is OK: NTP OK: Offset 0.08892530203 secs [09:06:27] RECOVERY - cp23 APT on cp23 is OK: APT OK: 1 packages available for upgrade (0 critical updates). [09:08:15] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 1.26, 3.73, 3.35 [09:10:14] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 0.70, 2.75, 3.04 [09:45:07] PROBLEM - cp22 NTP time on cp22 is WARNING: NTP WARNING: Offset 0.2924527824 secs [10:09:07] RECOVERY - cp22 NTP time on cp22 is OK: NTP OK: Offset -0.02607789636 secs [10:14:48] PROBLEM - cp22 Current Load on cp22 is CRITICAL: CRITICAL - load average: 5.18, 3.22, 1.89 [10:16:48] RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 1.60, 2.49, 1.78 [10:48:52] PROBLEM - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query uk.religiononfire.mar.in.ua. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [11:06:31] miraheze/WikiDiscover - joritochip the build passed. [11:19:32] [02WikiDiscover] 07Reception123 closed pull request 03#91: API: Add creation date to output (T10606) - 13https://github.com/miraheze/WikiDiscover/pull/91 [11:19:35] [02miraheze/WikiDiscover] 07Reception123 pushed 033 commits to 03master [+0/-0/±5] 13https://github.com/miraheze/WikiDiscover/compare/e36bbe01e32a...acf37a220436 [11:19:36] [02miraheze/WikiDiscover] 07joritochip 035f95835 - Add creation date to wikidiscover API output (T10606) [11:19:37] [02miraheze/WikiDiscover] 07joritochip 0334825b4 - fix [11:19:40] [02miraheze/WikiDiscover] 07Reception123 03acf37a2 - Merge pull request #91 from joritochip/patch-1 [11:20:09] PROBLEM - en.religiononfire.mar.in.ua - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query en.religiononfire.mar.in.ua. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [11:21:29] [02miraheze/mediawiki] 07Reception123 pushed 031 commit to 03REL1_39 [+0/-0/±2] 13https://github.com/miraheze/mediawiki/compare/94120049c42a...eea3e36cda30 [11:21:32] [02miraheze/mediawiki] 07Reception123 03eea3e36 - Update MirahezeMagic && WikiDiscover [11:22:27] !log [reception@mwtask141] starting deploy of {'world': True} to all [11:22:33] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [11:23:02] miraheze/WikiDiscover - Reception123 the build passed. [11:27:13] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.57, 3.35, 2.22 [11:27:44] !log [reception@mwtask141] finished deploy of {'world': True} to all - SUCCESS in 317s [11:27:49] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [11:28:42] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 4.11, 2.93, 1.91 [11:29:12] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 0.90, 2.46, 2.03 [11:30:41] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 2.51, 2.91, 2.05 [11:46:52] RECOVERY - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - uk.religiononfire.mar.in.ua reverse DNS resolves to cp22.miraheze.org - CNAME OK [12:09:19] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 15.68, 11.41, 9.30 [12:13:19] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.01, 10.61, 9.54 [12:15:19] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.66, 9.60, 9.30 [12:18:09] PROBLEM - en.religiononfire.mar.in.ua - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - en.religiononfire.mar.in.ua All nameservers failed to answer the query. [12:20:02] PROBLEM - itadminwiki.pl - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'itadminwiki.pl' expires in 15 day(s) (Wed 12 Apr 2023 12:06:25 GMT +0000). [12:21:19] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.35, 10.41, 9.66 [12:23:19] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 10.18, 9.99, 9.59 [12:29:07] PROBLEM - cp22 NTP time on cp22 is WARNING: NTP WARNING: Offset 0.1701077223 secs [12:30:41] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 3.61, 3.48, 2.16 [12:34:41] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.53, 2.82, 2.24 [12:35:19] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.44, 10.65, 10.11 [12:35:28] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.62, 11.63, 9.58 [12:37:28] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.86, 10.14, 9.28 [12:39:19] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 9.95, 10.02, 9.97 [12:41:00] PROBLEM - db142 Current Load on db142 is CRITICAL: CRITICAL - load average: 10.23, 6.48, 3.70 [12:43:00] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 4.12, 5.79, 3.81 [12:43:19] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.39, 11.73, 10.69 [12:47:19] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.97, 10.95, 10.62 [12:48:09] PROBLEM - en.religiononfire.mar.in.ua - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query mar.in.ua. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [12:48:36] RECOVERY - itadminwiki.pl - LetsEncrypt on sslhost is OK: OK - Certificate 'itadminwiki.pl' will expire on Sun 25 Jun 2023 11:27:13 GMT +0000. [12:49:07] RECOVERY - cp22 NTP time on cp22 is OK: NTP OK: Offset 0.04767787457 secs [12:55:19] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.35, 9.21, 9.96 [12:57:07] PROBLEM - cp22 NTP time on cp22 is WARNING: NTP WARNING: Offset 0.1380681396 secs [13:03:07] RECOVERY - cp22 NTP time on cp22 is OK: NTP OK: Offset 0.08152103424 secs [13:16:35] PROBLEM - cp33 APT on cp33 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [13:17:07] PROBLEM - cp22 NTP time on cp22 is WARNING: NTP WARNING: Offset -0.1200472713 secs [13:18:09] RECOVERY - en.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - en.religiononfire.mar.in.ua reverse DNS resolves to cp23.miraheze.org - CNAME OK [13:18:47] RECOVERY - cp33 APT on cp33 is OK: APT OK: 1 packages available for upgrade (0 critical updates). [13:23:07] RECOVERY - cp22 NTP time on cp22 is OK: NTP OK: Offset -0.07671830058 secs [13:28:13] PROBLEM - cp33 APT on cp33 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [13:30:15] RECOVERY - cp33 APT on cp33 is OK: APT OK: 1 packages available for upgrade (0 critical updates). [13:31:28] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 3.20, 3.79, 2.54 [13:33:27] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 0.75, 2.65, 2.27 [14:10:50] PROBLEM - gs.sidem.wiki - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query gs.sidem.wiki. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [14:17:00] PROBLEM - db142 Current Load on db142 is CRITICAL: CRITICAL - load average: 9.46, 6.47, 3.63 [14:21:00] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 3.65, 5.95, 4.14 [14:25:11] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 8.46, 4.04, 2.68 [14:28:33] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.28, 3.89, 2.92 [14:32:27] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.06, 3.60, 3.07 [14:35:03] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.63, 3.29, 3.45 [14:36:27] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.19, 3.08, 3.01 [14:37:02] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.86, 2.74, 3.22 [14:47:00] PROBLEM - db142 Current Load on db142 is CRITICAL: CRITICAL - load average: 10.96, 6.11, 3.51 [14:51:00] PROBLEM - db142 Current Load on db142 is WARNING: WARNING - load average: 7.29, 7.73, 4.91 [14:52:39] [02mw-config] 07thecutefinder commented on pull request 03#5136: Add nofollow to genshinimpactwiki red links - 13https://github.com/miraheze/mw-config/pull/5136#issuecomment-1485262661 [14:52:40] [02mw-config] 07thecutefinder closed pull request 03#5136: Add nofollow to genshinimpactwiki red links - 13https://github.com/miraheze/mw-config/pull/5136 [14:53:00] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 2.06, 5.56, 4.45 [15:01:35] [02mw-config] 07thecutefinder opened pull request 03#5169: Add nofollow to genshinimpactwiki red links - 13https://github.com/miraheze/mw-config/pull/5169 [15:02:57] miraheze/mw-config - thecutefinder the build passed. [15:02:59] [02mw-config] 07thecutefinder commented on pull request 03#5169: Add nofollow to genshinimpactwiki red links - 13https://github.com/miraheze/mw-config/pull/5169#issuecomment-1485283406 [15:03:30] [02mw-config] 07thecutefinder commented on pull request 03#5169: Add nofollow to genshinimpactwiki red links - 13https://github.com/miraheze/mw-config/pull/5169#issuecomment-1485284304 [15:05:23] [02mw-config] 07thecutefinder synchronize pull request 03#5169: Add nofollow to genshinimpactwiki red links - 13https://github.com/miraheze/mw-config/pull/5169 [15:06:36] miraheze/mw-config - thecutefinder the build passed. [15:06:44] [02mw-config] 07thecutefinder synchronize pull request 03#5169: Add nofollow to genshinimpactwiki red links - 13https://github.com/miraheze/mw-config/pull/5169 [15:07:28] [02mw-config] 07thecutefinder commented on pull request 03#5169: Add nofollow to genshinimpactwiki red links - 13https://github.com/miraheze/mw-config/pull/5169#issuecomment-1485290831 [15:07:57] miraheze/mw-config - thecutefinder the build passed. [15:10:34] RECOVERY - gs.sidem.wiki - reverse DNS on sslhost is OK: SSL OK - gs.sidem.wiki reverse DNS resolves to cp22.miraheze.org - CNAME OK [15:12:19] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.37, 10.70, 9.45 [15:12:37] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.88, 10.50, 9.53 [15:15:58] PROBLEM - readerswhoknow.paneidoverse.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Certificate 'readerswhoknow.paneidoverse.com' expires in 7 day(s) (Tue 04 Apr 2023 15:08:06 GMT +0000). [15:16:08] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.73, 10.22, 9.59 [15:18:02] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 9.72, 10.01, 9.58 [15:20:09] PROBLEM - en.religiononfire.mar.in.ua - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query en.religiononfire.mar.in.ua. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [15:22:25] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.69, 9.84, 9.80 [15:36:06] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.81, 9.35, 9.18 [15:37:35] [02miraheze/CustomHeader] 07translatewiki pushed 031 commit to 03master [+1/-0/±0] 13https://github.com/miraheze/CustomHeader/compare/9a222ae2d2c4...3ab091348204 [15:37:36] [02miraheze/CustomHeader] 07translatewiki 033ab0913 - Localisation updates from https://translatewiki.net. [15:37:38] [02miraheze/MatomoAnalytics] 07translatewiki pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/MatomoAnalytics/compare/162beccb7706...23332d0b0881 [15:37:41] [02miraheze/MatomoAnalytics] 07translatewiki 0323332d0 - Localisation updates from https://translatewiki.net. [15:37:44] [02miraheze/landing] 07translatewiki pushed 031 commit to 03master [+0/-0/±2] 13https://github.com/miraheze/landing/compare/9b2c6b9b8f15...683c8482068c [15:37:46] [02miraheze/landing] 07translatewiki 03683c848 - Localisation updates from https://translatewiki.net. [15:38:04] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.14, 8.82, 9.00 [15:41:06] miraheze/landing - translatewiki the build passed. [15:41:39] miraheze/CustomHeader - translatewiki the build passed. [15:48:48] RECOVERY - en.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - en.religiononfire.mar.in.ua reverse DNS resolves to cp22.miraheze.org - CNAME OK [15:53:20] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.21, 10.93, 9.89 [15:55:19] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.02, 10.28, 9.79 [15:59:19] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.50, 11.16, 10.24 [15:59:35] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.22, 10.05, 9.27 [16:01:32] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 9.36, 9.73, 9.24 [16:05:19] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.76, 11.99, 11.02 [16:05:28] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 12.00, 11.09, 9.91 [16:07:28] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.79, 10.18, 9.72 [16:07:36] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.62, 3.92, 2.87 [16:11:19] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.60, 12.35, 11.40 [16:11:30] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.69, 3.85, 3.09 [16:12:12] PROBLEM - gs.sidem.wiki - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - gs.sidem.wiki All nameservers failed to answer the query. [16:13:27] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.12, 3.97, 3.22 [16:15:19] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.23, 11.85, 11.55 [16:15:23] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.27, 3.45, 3.12 [16:17:20] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.87, 3.19, 3.05 [16:21:11] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 14.38, 11.93, 10.50 [16:21:19] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 15.39, 12.01, 11.43 [16:23:09] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.22, 11.29, 10.41 [16:23:19] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.72, 11.41, 11.29 [16:27:04] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.23, 9.39, 9.87 [16:29:19] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.87, 8.91, 10.20 [16:30:59] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.50, 3.85, 3.20 [16:33:05] [02mw-config] 07thecutefinder commented on pull request 03#5136: Add nofollow to genshinimpactwiki red links - 13https://github.com/miraheze/mw-config/pull/5136#issuecomment-1485457708 [16:35:19] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.23, 9.89, 10.26 [16:36:49] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.54, 3.34, 3.21 [16:36:49] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.06, 10.76, 9.96 [16:40:44] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.56, 10.43, 10.02 [16:41:19] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.26, 11.29, 10.73 [16:42:04] PROBLEM - gs.sidem.wiki - reverse DNS on sslhost is WARNING: Timeout: The DNS operation timed out after 5.407081842422485 seconds [16:42:42] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.39, 10.68, 10.13 [16:44:40] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.06, 9.60, 9.80 [16:45:19] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.95, 10.65, 10.66 [16:47:00] PROBLEM - db142 Current Load on db142 is CRITICAL: CRITICAL - load average: 12.26, 6.68, 3.40 [16:49:19] PROBLEM - es141 Current Load on es141 is CRITICAL: CRITICAL - load average: 4.63, 2.95, 1.57 [16:50:13] PROBLEM - es141 PowerDNS Recursor on es141 is CRITICAL: CRITICAL - Plugin timed out while executing system call [16:51:16] RECOVERY - es141 Current Load on es141 is OK: OK - load average: 2.95, 2.94, 1.74 [16:51:19] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.74, 10.79, 10.69 [16:52:12] RECOVERY - es141 PowerDNS Recursor on es141 is OK: DNS OK: 0.085 seconds response time. miraheze.org returns 109.228.51.216,217.174.247.33,2a00:da00:1800:326::1,2a00:da00:1800:328::1 [16:53:00] PROBLEM - db142 Current Load on db142 is WARNING: WARNING - load average: 3.16, 7.52, 5.28 [16:53:28] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.22, 11.62, 10.48 [16:54:27] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.08, 3.70, 3.30 [16:55:00] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 0.80, 5.16, 4.69 [16:56:27] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.25, 3.02, 3.09 [16:57:59] PROBLEM - wiki.zulaclub.net - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.zulaclub.net All nameservers failed to answer the query. [17:03:19] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.59, 11.78, 12.00 [17:04:27] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.58, 3.78, 3.37 [17:05:19] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.73, 12.32, 12.17 [17:11:51] PROBLEM - gs.sidem.wiki - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - gs.sidem.wiki All nameservers failed to answer the query. [17:12:27] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 3.30, 3.34, 3.32 [17:13:28] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.83, 11.79, 11.89 [17:15:28] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.55, 12.63, 12.18 [17:29:01] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 3.60, 2.73, 1.84 [17:31:00] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.69, 2.27, 1.78 [17:41:41] RECOVERY - gs.sidem.wiki - reverse DNS on sslhost is OK: SSL OK - gs.sidem.wiki reverse DNS resolves to cp22.miraheze.org - CNAME OK [17:55:34] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.54, 3.80, 3.20 [17:56:00] RECOVERY - wiki.zulaclub.net - reverse DNS on sslhost is OK: SSL OK - wiki.zulaclub.net reverse DNS resolves to cp22.miraheze.org - CNAME OK [17:57:31] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.47, 3.79, 3.28 [17:59:27] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 3.79, 4.06, 3.45 [18:01:24] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.31, 3.46, 3.30 [18:03:20] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.47, 2.79, 3.07 [18:05:19] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.60, 11.08, 11.91 [18:09:19] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.28, 11.73, 11.93 [18:13:31] PROBLEM - gs.sidem.wiki - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - gs.sidem.wiki All nameservers failed to answer the query. [18:15:28] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.75, 11.58, 11.91 [18:19:28] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 15.35, 13.00, 12.34 [18:23:19] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.65, 11.43, 11.96 [18:23:28] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.86, 11.33, 11.87 [18:31:07] PROBLEM - cp22 NTP time on cp22 is WARNING: NTP WARNING: Offset 0.2824808359 secs [18:33:19] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 6.54, 8.00, 10.02 [18:35:28] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 9.24, 9.15, 10.16 [18:39:28] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.49, 9.84, 10.27 [18:41:19] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.49, 10.80, 10.56 [18:43:28] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.18, 9.45, 10.07 [18:47:19] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.25, 9.49, 10.06 [18:49:08] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 8.36, 4.80, 3.52 [18:51:05] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.47, 3.72, 3.27 [18:51:19] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.69, 10.20, 10.20 [18:53:19] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 14.72, 11.72, 10.75 [18:54:16] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.66, 10.51, 10.24 [18:54:41] !log sudo service relaybot restart [18:54:48] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:54:58] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.21, 3.01, 3.08 [18:55:19] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.56, 11.42, 10.78 [18:56:13] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 9.55, 10.02, 10.09 [18:57:15] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.42, 3.07, 2.44 [18:57:51] [02miraheze/mw-config] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/e315d7256cf3...3bbdeb52f108 [18:57:52] [02miraheze/mw-config] 07Reception123 033bbdeb5 - switch hcaptcha sitekay [18:58:55] miraheze/mw-config - Reception123 the build passed. [18:59:13] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.82, 2.57, 2.33 [18:59:49] !log replaced hcaptcha private key [18:59:55] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:00:00] !log [reception@mwtask141] starting deploy of {'pull': 'config', 'config': True} to all [19:00:05] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:00:49] !log [reception@mwtask141] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 49s [19:00:56] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:01:00] PROBLEM - db142 Current Load on db142 is WARNING: WARNING - load average: 6.90, 5.88, 3.20 [19:01:07] RECOVERY - cp22 NTP time on cp22 is OK: NTP OK: Offset 0.03940153122 secs [19:01:19] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 14.40, 11.72, 10.98 [19:02:04] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.83, 10.61, 10.30 [19:03:00] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 1.94, 4.46, 3.01 [19:03:19] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.72, 11.28, 10.91 [19:04:01] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.34, 11.67, 10.73 [19:05:59] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.81, 11.07, 10.64 [19:07:56] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 14.00, 12.24, 11.12 [19:09:19] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.89, 12.30, 11.45 [19:09:54] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.00, 11.94, 11.18 [19:13:19] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.96, 11.94, 11.49 [19:13:49] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.72, 12.19, 11.38 [19:17:19] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 14.25, 12.40, 11.73 [19:19:09] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=buttonmenwiki --no-updates --username-prefix=wikia:buttonmen /home/reception/ImportDump/buttonmenwiki-20230327191732.xml (START) [19:19:13] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:19:39] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=buttonmenwiki --no-updates --username-prefix=wikia:buttonmen /home/reception/ImportDump/buttonmenwiki-20230327191732.xml (END - exit=0) [19:19:40] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=buttonmenwiki (START) [19:19:44] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:19:47] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:23:29] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=buttonmenwiki (END - exit=0) [19:23:30] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/initSiteStats.php --wiki=buttonmenwiki --active --update (END - exit=0) [19:23:38] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:23:44] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:27:32] !log [@test131] starting deploy of {'config': True} to all [19:27:33] !log [@test131] DEPLOY ABORTED: Canary check failed for beta.betaheze.org@localhost [19:27:36] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:27:40] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:41:19] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.52, 4.31, 3.51 [19:41:28] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.56, 11.32, 11.97 [19:42:53] RECOVERY - gs.sidem.wiki - reverse DNS on sslhost is OK: SSL OK - gs.sidem.wiki reverse DNS resolves to cp22.miraheze.org - CNAME OK [19:47:09] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.28, 3.82, 3.63 [19:49:06] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 8.21, 5.02, 4.06 [19:51:03] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.31, 3.83, 3.73 [19:51:28] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 17.69, 12.56, 11.87 [19:53:28] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.62, 11.51, 11.58 [19:54:56] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.67, 3.77, 3.68 [19:56:27] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.13, 3.56, 2.66 [19:56:53] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.34, 3.31, 3.53 [19:58:25]