[00:04:01] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 11.78, 6.98, 4.56 [00:05:32] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.04, 3.05, 3.37 [00:09:25] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.97, 3.23, 3.45 [00:11:16] PROBLEM - db142 Current Load on db142 is WARNING: WARNING - load average: 7.58, 5.87, 3.45 [00:11:21] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.08, 3.05, 3.37 [00:13:16] PROBLEM - db142 Current Load on db142 is CRITICAL: CRITICAL - load average: 8.71, 7.11, 4.21 [00:15:16] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 6.69, 6.67, 4.37 [00:22:01] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.34, 2.98, 3.89 [00:22:39] PROBLEM - cp23 NTP time on cp23 is WARNING: NTP WARNING: Offset 0.1015000939 secs [00:23:14] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.64, 3.51, 3.31 [00:25:14] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.49, 3.57, 3.36 [00:27:14] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.59, 4.54, 3.75 [00:28:01] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.20, 2.70, 3.40 [00:29:14] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.62, 3.91, 3.62 [00:29:16] PROBLEM - db142 Current Load on db142 is CRITICAL: CRITICAL - load average: 9.50, 6.93, 5.33 [00:30:02] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.46, 3.04, 3.44 [00:32:02] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.06, 2.54, 3.20 [00:34:59] PROBLEM - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - uk.religiononfire.mar.in.ua All nameservers failed to answer the query. [00:35:14] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.63, 4.00, 3.70 [00:35:16] PROBLEM - db142 Current Load on db142 is WARNING: WARNING - load average: 6.80, 8.00, 6.46 [00:38:39] RECOVERY - cp23 NTP time on cp23 is OK: NTP OK: Offset -0.009929537773 secs [00:39:14] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.03, 3.52, 3.56 [00:39:16] PROBLEM - db142 Current Load on db142 is CRITICAL: CRITICAL - load average: 8.48, 7.32, 6.46 [00:45:14] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.51, 2.57, 3.15 [00:48:01] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.24, 3.87, 3.21 [00:51:16] PROBLEM - db142 Current Load on db142 is WARNING: WARNING - load average: 6.34, 7.90, 7.38 [00:52:02] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.95, 3.98, 3.41 [00:54:01] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.29, 5.00, 3.88 [00:55:14] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.12, 3.68, 3.35 [00:55:16] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 3.23, 5.25, 6.40 [00:57:14] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.28, 3.11, 3.18 [01:00:02] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.45, 3.62, 3.62 [01:04:02] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.45, 3.70, 3.62 [01:06:02] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.19, 3.66, 3.63 [01:08:02] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 7.38, 4.98, 4.11 [01:26:01] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.78, 3.46, 3.96 [01:28:01] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 3.91, 3.94, 4.09 [01:32:50] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.72, 9.80, 8.40 [01:33:26] RECOVERY - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - uk.religiononfire.mar.in.ua reverse DNS resolves to cp23.miraheze.org - CNAME OK [01:34:01] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.13, 3.71, 3.98 [01:35:03] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.63, 9.90, 8.27 [01:36:02] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.44, 4.29, 4.18 [01:36:50] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.87, 9.70, 8.71 [01:37:03] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 9.07, 9.79, 8.44 [01:38:01] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.89, 3.36, 3.85 [01:46:58] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 3.91, 4.21, 3.41 [01:48:54] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.28, 3.59, 3.28 [01:50:01] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.68, 2.57, 3.29 [01:50:50] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.67, 3.25, 3.19 [01:56:27] PROBLEM - wiki.zymonic.com - reverse DNS on sslhost is WARNING: Timeout: The DNS operation timed out after 5.407325744628906 seconds [02:00:01] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.71, 3.86, 3.54 [02:02:01] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.27, 3.32, 3.38 [02:08:02] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.12, 3.75, 3.51 [02:10:01] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.31, 3.37, 3.41 [02:12:00] PROBLEM - db142 Current Load on db142 is CRITICAL: CRITICAL - load average: 10.13, 5.85, 3.47 [02:12:01] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.13, 2.87, 3.22 [02:17:52] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 4.11, 6.63, 4.75 [02:18:53] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.13, 3.34, 3.00 [02:20:49] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.98, 3.42, 3.06 [02:26:37] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.80, 4.30, 3.50 [02:30:28] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.22, 3.75, 3.46 [02:32:24] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.13, 3.31, 3.34 [02:35:47] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 3.57, 4.20, 3.43 [02:40:09] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.44, 3.88, 3.50 [02:41:32] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.29, 3.82, 3.62 [02:42:05] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.21, 3.55, 3.42 [02:43:27] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.60, 3.09, 3.38 [02:49:14] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 7.91, 4.60, 3.82 [02:53:41] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.79, 4.01, 3.67 [02:59:28] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.86, 3.43, 3.63 [03:02:41] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.87, 3.79, 3.96 [03:03:19] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 6.14, 4.48, 3.96 [03:04:36] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.01, 4.41, 4.17 [03:05:15] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.91, 3.85, 3.79 [03:08:27] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.51, 3.63, 3.93 [03:13:14] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.47, 2.85, 3.30 [03:18:03] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.51, 2.38, 3.20 [03:32:20] PROBLEM - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - uk.religiononfire.mar.in.ua All nameservers failed to answer the query. [03:47:16] PROBLEM - db142 Current Load on db142 is CRITICAL: CRITICAL - load average: 11.96, 6.78, 3.78 [03:51:16] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 2.37, 5.08, 3.84 [04:01:34] PROBLEM - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query mar.in.ua. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [04:06:53] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.21, 3.41, 3.21 [04:08:48] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.04, 3.77, 3.38 [04:12:39] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.44, 3.21, 3.25 [04:23:43] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.20, 3.09, 2.69 [04:25:24] PROBLEM - wiki.zymonic.com - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.zymonic.com All nameservers failed to answer the query. [04:25:39] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.68, 2.95, 2.69 [04:30:57] PROBLEM - cp23 APT on cp23 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [04:32:02] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.05, 3.72, 3.23 [04:33:01] RECOVERY - cp23 APT on cp23 is OK: APT OK: 1 packages available for upgrade (0 critical updates). [04:33:29] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 5.46, 3.65, 2.13 [04:34:01] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.22, 3.57, 3.24 [04:35:23] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.68, 2.83, 2.01 [04:36:01] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.35, 3.52, 3.24 [04:40:01] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.47, 3.14, 3.16 [04:55:12] PROBLEM - wiki.zymonic.com - reverse DNS on sslhost is WARNING: Timeout: The DNS operation timed out after 5.406854152679443 seconds [05:00:03] RECOVERY - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - uk.religiononfire.mar.in.ua reverse DNS resolves to cp23.miraheze.org - CNAME OK [05:25:24] [02puppet] 07Reception123 closed pull request 03#3177: switch test131 to REL1_40 - 13https://github.com/miraheze/puppet/pull/3177 [05:25:27] [02miraheze/puppet] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/76d1820722f1...10f19f8822ce [05:25:29] [02miraheze/puppet] 07Reception123 0310f19f8 - switch test131 to REL1_40 (#3177) [05:25:32] [02miraheze/puppet] 07Reception123 deleted branch 03Reception123-patch-2 [05:25:34] [02puppet] 07Reception123 deleted branch 03Reception123-patch-2 - 13https://github.com/miraheze/puppet [05:30:03] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.16, 3.67, 2.97 [05:32:01] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.09, 2.98, 2.79 [05:36:19] PROBLEM - test131 Puppet on test131 is CRITICAL: CRITICAL: Puppet has 2 failures. Last run 3 minutes ago with 2 failures. Failed resources (up to 3 shown): Exec[git_checkout_MediaWiki core],Exec[git_checkout_femiwiki-deploy] [06:23:23] [02miraheze/femiwiki-deploy] 07Reception123 created branch 03REL1_40 13https://github.com/miraheze/femiwiki-deploy/commit/84b0444b1c3d2509cf63845a58ec735842e28395 [06:23:25] [02femiwiki-deploy] 07Reception123 created branch 03REL1_40 - 13https://github.com/miraheze/femiwiki-deploy [06:23:28] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.71, 3.58, 2.81 [06:25:23] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.94, 3.54, 2.87 [06:29:13] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.14, 4.30, 3.34 [06:29:57] PROBLEM - test131 MediaWiki Rendering on test131 is CRITICAL: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - 665 bytes in 0.160 second response time [06:31:08] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.23, 3.46, 3.14 [06:33:04] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.60, 3.20, 3.08 [07:16:58] PROBLEM - cp22 NTP time on cp22 is WARNING: NTP WARNING: Offset 0.1868204474 secs [07:38:58] RECOVERY - cp22 NTP time on cp22 is OK: NTP OK: Offset 0.05694928765 secs [08:29:34] PROBLEM - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - uk.religiononfire.mar.in.ua All nameservers failed to answer the query. [08:58:48] PROBLEM - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query uk.religiononfire.mar.in.ua. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [09:01:12] PROBLEM - cp23 APT on cp23 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [09:03:13] RECOVERY - cp23 APT on cp23 is OK: APT OK: 1 packages available for upgrade (0 critical updates). [09:13:16] PROBLEM - db142 Current Load on db142 is WARNING: WARNING - load average: 6.85, 5.10, 3.02 [09:15:16] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 1.21, 3.54, 2.69 [09:28:02] RECOVERY - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - uk.religiononfire.mar.in.ua reverse DNS resolves to cp23.miraheze.org - CNAME OK [09:40:15] RECOVERY - test131 Puppet on test131 is OK: OK: Puppet is currently enabled, last run 7 seconds ago with 0 failures [10:53:24] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 8.33, 6.28, 4.95 [10:55:24] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 7.12, 6.36, 5.13 [10:55:32] PROBLEM - swiftobject121 APT on swiftobject121 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [10:57:24] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 5.69, 6.37, 5.30 [10:57:32] RECOVERY - swiftobject121 APT on swiftobject121 is OK: APT OK: 16 packages available for upgrade (0 critical updates). [11:18:20] [02miraheze/ImportDump] 07translatewiki pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/e10019790aa8...7935d3663e67 [11:18:22] [02miraheze/ImportDump] 07translatewiki 037935d36 - Localisation updates from https://translatewiki.net. [11:26:12] PROBLEM - wiki.geoparkcorumbatai.com.br - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.geoparkcorumbatai.com.br' expires in 15 day(s) (Wed 19 Apr 2023 11:09:53 GMT +0000). [11:26:54] PROBLEM - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query uk.religiononfire.mar.in.ua. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [11:28:04] miraheze/ImportDump - translatewiki the build passed. [11:28:42] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 5.25, 2.85, 1.73 [11:30:25] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/d781f40fe406...4add33cc790c [11:30:27] [02miraheze/ssl] 07MirahezeSSLBot 034add33c - Bot: Update SSL cert for wiki.geoparkcorumbatai.com.br [11:30:42] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 2.34, 2.61, 1.79 [11:53:25] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 8.18, 6.86, 5.46 [11:54:54] RECOVERY - wiki.geoparkcorumbatai.com.br - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.geoparkcorumbatai.com.br' will expire on Sun 02 Jul 2023 10:30:17 GMT +0000. [11:56:08] RECOVERY - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - uk.religiononfire.mar.in.ua reverse DNS resolves to cp23.miraheze.org - CNAME OK [11:56:20] PROBLEM - swiftobject121 APT on swiftobject121 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [11:58:19] PROBLEM - swiftobject121 PowerDNS Recursor on swiftobject121 is CRITICAL: CRITICAL - Plugin timed out while executing system call [12:02:17] PROBLEM - swiftobject121 SSH on swiftobject121 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:05:15] PROBLEM - swiftobject121 Puppet on swiftobject121 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [12:06:48] RECOVERY - swiftobject121 PowerDNS Recursor on swiftobject121 is OK: DNS OK: 2.046 seconds response time. miraheze.org returns 109.228.51.216,217.174.247.33,2a00:da00:1800:326::1,2a00:da00:1800:328::1 [12:07:16] RECOVERY - swiftobject121 Puppet on swiftobject121 is OK: OK: Puppet is currently enabled, last run 44 minutes ago with 0 failures [12:08:35] RECOVERY - swiftobject121 SSH on swiftobject121 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [12:08:42] RECOVERY - swiftobject121 APT on swiftobject121 is OK: APT OK: 16 packages available for upgrade (0 critical updates). [12:08:50] [02miraheze/mediawiki] 07Reception123 pushed 031 commit to 03REL1_40 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/7579e7f9b83f...e1f62e6fb184 [12:08:51] [02miraheze/mediawiki] 07Reception123 03e1f62e6 - attempt to fix composer [12:27:20] PROBLEM - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query uk.religiononfire.mar.in.ua. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [12:28:25] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=worldofrevolutionwiki --no-updates --username-prefix=wikia:wor /home/reception/ImportDump/worldofrevolutionwiki-20230403122551.xml (START) [12:28:30] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:32:10] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=worldofrevolutionwiki --no-updates --username-prefix=wikia:wor /home/reception/ImportDump/worldofrevolutionwiki-20230403122551.xml (END - exit=0) [12:32:11] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=worldofrevolutionwiki (START) [12:32:15] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:32:18] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:34:39] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=worldofrevolutionwiki (END - exit=0) [12:34:40] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/initSiteStats.php --wiki=worldofrevolutionwiki --active --update (END - exit=0) [12:34:43] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:34:47] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:38:24] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 2.84, 2.99, 7.99 [12:38:40] Reception123: that breaks wikibase? [12:42:23] [02miraheze/puppet] 07paladox pushed 031 commit to 03opensearch [+102/-0/±0] 13https://github.com/miraheze/puppet/compare/696fb8d07e1a...7c2048078ed3 [12:42:26] [02miraheze/puppet] 07paladox 037c20480 - Introduce opensearch puppet module [12:42:28] [02puppet] 07paladox synchronize pull request 03#3110: Introduce opensearch puppet module - 13https://github.com/miraheze/puppet/pull/3110 [12:44:20] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 3.85, 3.20, 6.46 [12:56:34] PROBLEM - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - uk.religiononfire.mar.in.ua All nameservers failed to answer the query. [12:58:42] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 5.37, 3.81, 2.40 [13:01:22] PROBLEM - cp23 APT on cp23 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [13:02:42] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.54, 3.11, 2.48 [13:03:22] RECOVERY - cp23 APT on cp23 is OK: APT OK: 1 packages available for upgrade (0 critical updates). [13:05:05] [02miraheze/puppet] 07paladox pushed 031 commit to 03opensearch [+103/-0/±0] 13https://github.com/miraheze/puppet/compare/7c2048078ed3...a73f6938fe54 [13:05:07] [02miraheze/puppet] 07paladox 03a73f693 - Introduce opensearch puppet module [13:05:09] [02puppet] 07paladox synchronize pull request 03#3110: Introduce opensearch puppet module - 13https://github.com/miraheze/puppet/pull/3110 [13:23:03] paladox: oh? Right now there's a weird error on 1.40 [13:23:15] > Interface 'Wikimedia\Bcp47Code\Bcp47Code' not found [13:25:08] [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_40 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/e1f62e6fb184...f67438ec014d [13:25:10] [02miraheze/mediawiki] 07paladox 03f67438e - Update composer.json [13:25:48] PROBLEM - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query mar.in.ua. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [13:28:24] vendor is checked out at REL1_39 Reception123 [13:28:28] it needs to be 1_40 [13:28:41] you need to update all the submodules so those uses 1_39 use 1_40 [13:29:38] paladox: oh, that would be it then... How come that didn't update though? [13:29:43] where is vendor supposed to be updated? [13:29:53] i wouldn't have a clue. I don't know how you did it all [13:32:15] paladox: I basically just pulled changes from wikimedia's REL1_40 and then applied ours back and replaced REL1_39 with REL1_40 in .gitmodules [13:33:43] [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_40 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/f67438ec014d...648ea1427259 [13:33:44] [02miraheze/mediawiki] 07paladox 03648ea14 - Update vendor to REL1_40 [13:33:55] thanks paladox [13:34:59] !log [paladox@test131] starting deploy of {'world': True, 'l10n': True, 'force': True} to all [13:35:03] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [13:37:09] !log [alex@mwtask141] sudo -u www-data php /srv/mediawiki/w/extensions/CreateWiki/maintenance/setContainersAccess.php --wiki=thesohnlandwikiwiki [13:37:13] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [13:38:17] !log [paladox@test131] DEPLOY ABORTED: Non-Zero Exit Code in prep, see output. [13:38:23] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [13:38:56] paladox: that's probably the error I got that you're getting [13:42:32] !log [paladox@test131] starting deploy of {'world': True, 'l10n': True, 'force': True} to all [13:42:36] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [13:46:27] !log [paladox@test131] DEPLOY ABORTED: Non-Zero Exit Code in prep, see output. [13:46:31] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [13:47:00] !log [paladox@test131] starting deploy of {'config': True, 'world': True, 'errorpages': True, 'l10n': True, 'force': True} to all [13:47:04] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [13:47:29] [1/9] > [561beab1bdfb9becde310de5] [no req] ParseError: syntax error, unexpected 'throw' (T_THROW) [13:47:30] [2/9] > Backtrace: [13:47:30] [3/9] > from /srv/mediawiki-staging/w/includes/GitInfo.php(425) [13:47:30] [4/9] > #0 [internal function]: AutoLoader::autoload(string) [13:47:31] [5/9] > #1 /srv/mediawiki-staging/w/extensions/MirahezeMagic/maintenance/rebuildVersionCache.php(58): splautoloadcall(string) [13:47:31] [6/9] > #2 /srv/mediawiki-staging/w/maintenance/includes/MaintenanceRunner.php(681): RebuildVersionCache->execute() [13:47:31] [7/9] > #3 /srv/mediawiki-staging/w/maintenance/doMaintenance.php(100): MediaWiki\Maintenance\MaintenanceRunner->run() [13:47:32] [8/9] > #4 /srv/mediawiki-staging/w/extensions/MirahezeMagic/maintenance/rebuildVersionCache.php(114): require_once(string) [13:47:32] [9/9] > #5 {main} [13:50:08] Sounds like that MirahezeMagic maintenance script may be incompatible with 1.40 [13:50:27] (mw-deploy runs it) [13:52:09] throw new RuntimeException( "Unable to create GitInfo cache \"{$cacheDir}\"" ); [13:52:14] https://github.com/miraheze/mediawiki/blob/REL1_40/includes/GitInfo.php#L425 [13:52:18] https://github.com/miraheze/mediawiki/commit/4900100a95d6cfdf2673e87439c5740dc86cd12b [13:52:19] [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_40 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/648ea1427259...4900100a95d6 [13:52:21] [02miraheze/mediawiki] 07paladox 034900100 - Fix typo in GitInfo [13:52:22] !log [paladox@test131] DEPLOY ABORTED: Non-Zero Exit Code in prep, see output. [13:52:27] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [13:52:32] !log [paladox@test131] starting deploy of {'config': True, 'world': True, 'errorpages': True, 'l10n': True, 'force': True} to all [13:52:36] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [13:55:01] RECOVERY - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - uk.religiononfire.mar.in.ua reverse DNS resolves to cp22.miraheze.org - CNAME OK [13:55:13] oh my bad :( [13:55:15] thanks for fixing [13:57:59] RECOVERY - test131 MediaWiki Rendering on test131 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 1.544 second response time [13:58:31] yay [13:58:33] [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_40 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/4900100a95d6...c671a62585c1 [13:58:36] [02miraheze/mediawiki] 07paladox 03c671a62 - Update Wikibase to REL1_40 [14:00:07] !log [paladox@test131] DEPLOY ABORTED: Non-Zero Exit Code in prep, see output. [14:00:12] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:01:32] !log [paladox@test131] starting deploy of {'config': True, 'world': True, 'errorpages': True, 'l10n': True, 'force': True} to all [14:01:36] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:04:22] [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_40 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/c671a62585c1...1bec3e6f708d [14:04:24] [02miraheze/mediawiki] 07paladox 031bec3e6 - Update CentralAuth to REL1_40 [14:04:40] Reception123: you'll have to go through all extensions [14:05:03] !log [paladox@test131] DEPLOY ABORTED: Non-Zero Exit Code in prep, see output. [14:05:08] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:06:25] [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_40 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/1bec3e6f708d...dd84301cfa01 [14:06:26] [02miraheze/mediawiki] 07paladox 03dd84301 - Update WikibaseLexeme to REL1_40 [14:06:37] PROBLEM - en.religiononfire.mar.in.ua - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query en.religiononfire.mar.in.ua. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [14:07:02] !log [paladox@test131] starting deploy of {'config': True, 'world': True, 'errorpages': True, 'l10n': True, 'force': True} to all [14:07:06] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:07:57] PROBLEM - test131 MediaWiki Rendering on test131 is CRITICAL: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - 341 bytes in 0.165 second response time [14:09:00] !log [paladox@test131] DEPLOY ABORTED: Non-Zero Exit Code in prep, see output. [14:09:04] [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_40 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/dd84301cfa01...dd886d185d6b [14:09:06] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:09:07] [02miraheze/mediawiki] 07paladox 03dd886d1 - Update GlobalUsage [14:09:21] !log [paladox@test131] starting deploy of {'config': True, 'world': True, 'errorpages': True, 'l10n': True, 'force': True} to all [14:09:24] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:10:50] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.53, 10.56, 8.89 [14:12:50] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.85, 10.56, 9.10 [14:13:59] RECOVERY - test131 MediaWiki Rendering on test131 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 1.969 second response time [14:16:29] [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_40 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/dd886d185d6b...1dcbbf1b740c [14:16:31] [02miraheze/mediawiki] 07paladox 031dcbbf1 - Update WikibaseQualityConstraints [14:16:50] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 6.39, 9.36, 9.03 [14:19:18] [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_40 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/1dcbbf1b740c...c3d7a4ef6dbd [14:19:20] [02miraheze/mediawiki] 07paladox 03c3d7a4e - Update WikibaseLocalMedia [14:19:59] [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_40 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/c3d7a4ef6dbd...756382d97fdb [14:20:01] [02miraheze/mediawiki] 07paladox 03756382d - Update WikibaseEdtf [14:20:58] PROBLEM - cp22 NTP time on cp22 is WARNING: NTP WARNING: Offset 0.2347305119 secs [14:21:36] !log [paladox@test131] finished deploy of {'config': True, 'world': True, 'errorpages': True, 'l10n': True, 'force': True} to all - SUCCESS in 734s [14:21:40] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:22:11] !log [paladox@test131] starting deploy of {'world': True, 'l10n': True, 'force': True} to all [14:22:16] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:27:43] !log [paladox@test131] finished deploy of {'world': True, 'l10n': True, 'force': True} to all - SUCCESS in 331s [14:27:47] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:35:14] RECOVERY - en.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - en.religiononfire.mar.in.ua reverse DNS resolves to cp22.miraheze.org - CNAME OK [14:35:17] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.76, 9.83, 8.56 [14:37:17] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 9.83, 9.67, 8.65 [14:41:37] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 16.48, 14.13, 10.84 [14:42:58] RECOVERY - cp22 NTP time on cp22 is OK: NTP OK: Offset -0.0124887526 secs [14:43:51] [02mw-config] 07brandon-wm opened pull request 03#5174: T10688: Set $wgChatKicks = true on zhtranswiki - 13https://github.com/miraheze/mw-config/pull/5174 [14:44:50] miraheze/mw-config - brandon-wm the build has errored. [14:45:28] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.22, 11.60, 10.52 [14:47:23] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 6.92, 9.98, 10.06 [14:58:42] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 7.09, 3.70, 2.05 [14:58:53] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.48, 3.28, 2.75 [14:58:56] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.16, 10.58, 10.08 [15:00:42] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 2.06, 2.96, 1.97 [15:00:48] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 3.23, 3.09, 2.73 [15:02:50] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.32, 9.35, 9.76 [15:04:40] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.90, 4.26, 3.23 [15:09:00] [02mw-config] 07brandon-wm synchronize pull request 03#5174: T10688: Set $wgChatKicks = true on zhtranswiki - 13https://github.com/miraheze/mw-config/pull/5174 [15:10:04] miraheze/mw-config - brandon-wm the build passed. [15:10:26] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.57, 3.47, 3.25 [15:14:16] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 3.08, 3.35, 3.26 [15:26:01] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.89, 3.54, 3.41 [15:27:21] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 11.45, 5.16, 3.18 [15:30:01] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.90, 3.28, 3.40 [15:35:14] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.28, 3.14, 3.27 [15:42:50] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.27, 10.10, 9.29 [15:44:23] [02mw-config] 07brandon-wm synchronize pull request 03#5174: T10688: Set $wgChatKicks = true on zhtranswiki - 13https://github.com/miraheze/mw-config/pull/5174 [15:44:50] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.61, 9.45, 9.14 [15:45:22] miraheze/mw-config - brandon-wm the build passed. [15:47:05] [02mw-config] 07brandon-wm opened pull request 03#5175: T10688: Set $wgChatKicks = true on zhtranswiki - 13https://github.com/miraheze/mw-config/pull/5175 [15:47:44] [02mw-config] 07brandon-wm closed pull request 03#5174: T10688: Set $wgChatKicks = true on zhtranswiki - 13https://github.com/miraheze/mw-config/pull/5174 [15:48:05] miraheze/mw-config - brandon-wm the build passed. [15:48:07] [02mw-config] 07brandon-wm commented on pull request 03#5174: T10688: Set $wgChatKicks = true on zhtranswiki - 13https://github.com/miraheze/mw-config/pull/5174#issuecomment-1494566783 [16:18:39] PROBLEM - cp33 APT on cp33 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [16:21:11] RECOVERY - cp33 APT on cp33 is OK: APT OK: 1 packages available for upgrade (0 critical updates). [16:27:59] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.71, 4.77, 3.41 [16:29:02] PROBLEM - db112 Disk Space on db112 is CRITICAL: DISK CRITICAL - free space: / 7966 MB (5% inode=98%); [16:29:25] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.09, 3.47, 2.95 [16:29:55] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.45, 3.47, 3.09 [16:31:20] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 3.39, 3.36, 2.96 [16:31:51] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.13, 2.66, 2.84 [16:42:29] [02mw-config] 07AgentIsai commented on pull request 03#5175: T10688: Set $wgChatKicks = true on zhtranswiki - 13https://github.com/miraheze/mw-config/pull/5175#issuecomment-1494648868 [16:48:50] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.96, 10.08, 8.97 [16:50:50] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 9.06, 9.59, 8.92 [17:06:54] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.46, 3.41, 2.97 [17:08:50] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.65, 2.82, 2.81 [17:31:03] PROBLEM - db112 Disk Space on db112 is WARNING: DISK WARNING - free space: / 8741 MB (6% inode=98%); [17:36:43] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.10, 3.44, 2.90 [17:38:38] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.72, 3.39, 2.94 [17:40:33] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 6.32, 3.77, 3.09 [17:42:28] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.20, 3.14, 2.94 [17:54:14] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.29, 3.51, 2.52 [17:55:45] PROBLEM - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query mar.in.ua. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [18:01:58] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.41, 3.81, 3.19 [18:03:53] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.32, 3.29, 3.07 [18:24:59] RECOVERY - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - uk.religiononfire.mar.in.ua reverse DNS resolves to cp22.miraheze.org - CNAME OK [18:28:53] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.70, 4.25, 3.17 [18:30:48] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.23, 3.82, 3.14 [18:32:43] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.29, 3.22, 2.99 [18:36:35] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.60, 3.99, 3.37 [18:38:30] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.34, 3.50, 3.27 [18:40:26] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.07, 3.01, 3.12 [18:48:50] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.95, 9.84, 9.24 [18:50:50] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.65, 9.11, 9.06 [18:59:02] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.14, 3.82, 3.20 [19:00:58] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.78, 3.15, 3.03 [19:08:50] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.18, 10.78, 9.78 [19:10:15] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 7.39, 5.16, 3.63 [19:10:50] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.81, 11.25, 10.06 [19:12:50] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.26, 10.38, 9.91 [19:14:06] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.69, 3.51, 3.32 [19:14:50] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.88, 9.49, 9.63 [19:18:01] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.20, 3.91, 3.49 [19:26:08] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 6.57, 4.29, 3.20 [19:28:01] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.03, 3.73, 3.73 [19:29:32] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.58, 10.45, 9.91 [19:30:00] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.91, 3.53, 3.18 [19:31:28] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.66, 9.71, 9.70 [19:31:56] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.71, 2.93, 3.00 [19:32:01] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.97, 4.54, 3.99 [19:40:02] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.37, 3.78, 3.93 [19:44:01] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.38, 4.32, 4.10 [19:46:01] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.67, 3.38, 3.79 [19:49:02] PROBLEM - wiki.zymonic.com - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.zymonic.com All nameservers failed to answer the query. [19:52:28] [02mw-config] 07redbluegreenhat commented on pull request 03#5175: T10688: Set $wgChatKicks = true on zhtranswiki - 13https://github.com/miraheze/mw-config/pull/5175#issuecomment-1494889032 [19:52:34] [02mw-config] 07redbluegreenhat closed pull request 03#5175: T10688: Set $wgChatKicks = true on zhtranswiki - 13https://github.com/miraheze/mw-config/pull/5175 [19:56:02] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.82, 2.70, 3.32 [20:00:02] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.10, 3.35, 3.53 [20:02:01] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.57, 2.79, 3.30 [20:10:01] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.40, 3.60, 3.48 [20:14:01] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.80, 4.15, 3.71 [20:16:01] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.12, 3.82, 3.65 [20:18:50] PROBLEM - wiki.zymonic.com - reverse DNS on sslhost is WARNING: Timeout: The DNS operation timed out after 5.406567811965942 seconds [20:22:01] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.90, 2.84, 3.31 [20:25:49] PROBLEM - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query mar.in.ua. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [20:27:15] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 6.43, 4.59, 3.41 [20:30:58] PROBLEM - cp23 APT on cp23 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [20:31:14] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.42, 3.40, 3.22 [20:31:30] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 4.25, 3.53, 2.27 [20:32:59] RECOVERY - cp23 APT on cp23 is OK: APT OK: 1 packages available for upgrade (0 critical updates). [20:33:23] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 2.24, 3.15, 2.28 [20:41:03] PROBLEM - db112 Disk Space on db112 is CRITICAL: DISK CRITICAL - free space: / 7970 MB (5% inode=98%); [20:42:16] [02miraheze/ssl] 07paladox pushed 031 commit to 03paladox-patch-1 [+1/-0/±0] 13https://github.com/miraheze/ssl/commit/c31e1f001d28 [20:42:19] [02miraheze/ssl] 07paladox 03c31e1f0 - Add opensearch certificate [20:42:20] [02ssl] 07paladox created branch 03paladox-patch-1 - 13https://github.com/miraheze/ssl [20:42:23] [02ssl] 07paladox opened pull request 03#645: Add opensearch certificate - 13https://github.com/miraheze/ssl/pull/645 [20:43:02] RECOVERY - db112 Disk Space on db112 is OK: DISK OK - free space: / 29465 MB (22% inode=98%); [20:45:14] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.35, 4.85, 3.92 [20:46:22] PROBLEM - cp33 APT on cp33 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [20:48:16] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.24, 4.14, 3.47 [20:48:56] RECOVERY - cp33 APT on cp33 is OK: APT OK: 1 packages available for upgrade (0 critical updates). [20:49:14] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.00, 3.50, 3.60 [20:50:11] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.48, 3.74, 3.43 [20:52:07] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.16, 3.23, 3.28 [20:53:14] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.56, 3.08, 3.40 [21:14:01] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.95, 3.29, 2.95 [21:16:01] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.11, 2.90, 2.85 [21:22:54] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 11.81, 5.73, 3.95 [21:24:17] RECOVERY - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - uk.religiononfire.mar.in.ua reverse DNS resolves to cp22.miraheze.org - CNAME OK [21:26:35] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 8.11, 5.81, 4.10 [21:30:32] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 14.13, 7.51, 4.74 [21:31:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.54, 7.47, 5.19 [21:31:23] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 11.39, 7.74, 5.36 [21:31:29] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 12.30, 7.45, 4.83 [21:33:21]