[00:05:36] PROBLEM - graylog131 Current Load on graylog131 is CRITICAL: LOAD CRITICAL - total load average: 4.58, 3.52, 2.91 [00:07:35] RECOVERY - graylog131 Current Load on graylog131 is OK: LOAD OK - total load average: 2.73, 3.23, 2.88 [00:14:35] PROBLEM - mw132 Current Load on mw132 is WARNING: WARNING - load average: 11.46, 10.41, 9.09 [00:17:44] PROBLEM - os131 Current Load on os131 is WARNING: LOAD WARNING - total load average: 3.51, 3.26, 2.39 [00:19:44] RECOVERY - os131 Current Load on os131 is OK: LOAD OK - total load average: 2.15, 2.88, 2.36 [00:20:33] PROBLEM - mw132 Current Load on mw132 is CRITICAL: CRITICAL - load average: 12.29, 11.41, 9.98 [00:22:32] PROBLEM - mw132 Current Load on mw132 is WARNING: WARNING - load average: 9.53, 10.90, 9.97 [00:36:27] RECOVERY - mw132 Current Load on mw132 is OK: OK - load average: 9.85, 10.02, 10.06 [00:39:22] PROBLEM - mw131 Current Load on mw131 is WARNING: WARNING - load average: 11.50, 10.23, 9.10 [00:40:16] PROBLEM - os141 Current Load on os141 is CRITICAL: LOAD CRITICAL - total load average: 4.84, 3.99, 3.02 [00:41:17] RECOVERY - mw131 Current Load on mw131 is OK: OK - load average: 9.91, 9.97, 9.13 [00:42:24] PROBLEM - mw132 Current Load on mw132 is WARNING: WARNING - load average: 11.36, 11.15, 10.49 [00:44:11] PROBLEM - os141 Current Load on os141 is WARNING: LOAD WARNING - total load average: 3.56, 3.91, 3.21 [00:44:23] PROBLEM - mw132 Current Load on mw132 is CRITICAL: CRITICAL - load average: 13.15, 11.56, 10.70 [00:46:08] PROBLEM - os141 Current Load on os141 is CRITICAL: LOAD CRITICAL - total load average: 4.21, 4.06, 3.36 [00:46:23] PROBLEM - mw132 Current Load on mw132 is WARNING: WARNING - load average: 10.84, 11.64, 10.86 [00:48:09] PROBLEM - os141 Current Load on os141 is WARNING: LOAD WARNING - total load average: 2.85, 3.60, 3.27 [00:50:07] RECOVERY - os141 Current Load on os141 is OK: LOAD OK - total load average: 2.16, 3.22, 3.17 [00:50:21] RECOVERY - mw132 Current Load on mw132 is OK: OK - load average: 8.72, 9.55, 10.12 [01:49:25] [02miraheze/mediawiki] 07The-Voidwalker pushed 031 commit to 03REL1_40 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/fbba282f6c9f...7aff83d9ad9d [01:49:28] [02miraheze/mediawiki] 07The-Voidwalker 037aff83d - HACK: disable use of APCOND_BLOCKED [01:51:55] !log [void@mwtask141] starting deploy of {'world': True} to all [01:52:02] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:56:27] !log [void@mwtask141] finished deploy of {'world': True} to all - SUCCESS in 271s [01:56:33] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:06:43] PROBLEM - mw131 Current Load on mw131 is CRITICAL: CRITICAL - load average: 15.71, 11.17, 8.92 [02:08:43] PROBLEM - mw131 Current Load on mw131 is WARNING: WARNING - load average: 8.67, 10.29, 8.90 [02:10:43] RECOVERY - mw131 Current Load on mw131 is OK: OK - load average: 7.69, 9.31, 8.70 [03:02:37] RECOVERY - ns1 NTP time on ns1 is OK: NTP OK: Offset 0.004917412996 secs [03:09:47] PROBLEM - graylog131 Current Load on graylog131 is WARNING: LOAD WARNING - total load average: 3.63, 2.84, 2.51 [03:11:47] RECOVERY - graylog131 Current Load on graylog131 is OK: LOAD OK - total load average: 2.49, 2.75, 2.53 [03:22:37] PROBLEM - ns1 NTP time on ns1 is WARNING: NTP WARNING: Offset 0.1095473468 secs [05:21:17] PROBLEM - wiki.zulaclub.net - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query zulaclub.net. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [05:51:15] RECOVERY - wiki.zulaclub.net - reverse DNS on sslhost is OK: SSL OK - wiki.zulaclub.net reverse DNS resolves to cp24.miraheze.org - CNAME OK [07:03:41] PROBLEM - wiki.gab.pt.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.gab.pt.eu.org All nameservers failed to answer the query. [07:28:37] PROBLEM - ns1 NTP time on ns1 is CRITICAL: NTP CRITICAL: Offset 0.5860324204 secs [07:33:41] PROBLEM - wiki.gab.pt.eu.org - reverse DNS on sslhost is WARNING: SSL WARNING - rDNS OK but records conflict. {'NS': ['ns.ankh.fr.eu.org.', 'ns1.eu.org.', 'ns1.eriomem.net.'], 'CNAME': 'bouncingwiki.miraheze.org.'} [07:55:12] PROBLEM - cloud13 Puppet on cloud13 is UNKNOWN: NRPE: Unable to read output [08:21:12] RECOVERY - cloud13 Puppet on cloud13 is OK: OK: Puppet is currently enabled, last run 45 seconds ago with 0 failures [09:36:38] PROBLEM - test131 NTP time on test131 is WARNING: NTP WARNING: Offset 0.3557087183 secs [09:42:42] RECOVERY - test131 NTP time on test131 is OK: NTP OK: Offset -0.03545403481 secs [10:20:59] PROBLEM - mw132 Current Load on mw132 is CRITICAL: CRITICAL - load average: 13.07, 10.65, 8.66 [10:22:59] PROBLEM - mw132 Current Load on mw132 is WARNING: WARNING - load average: 10.51, 10.14, 8.70 [10:24:59] RECOVERY - mw132 Current Load on mw132 is OK: OK - load average: 5.33, 8.47, 8.27 [10:33:41] PROBLEM - wiki.gab.pt.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.gab.pt.eu.org All nameservers failed to answer the query. [11:03:42] PROBLEM - wiki.gab.pt.eu.org - reverse DNS on sslhost is WARNING: SSL WARNING - rDNS OK but records conflict. {'NS': ['ns.ankh.fr.eu.org.', 'ns1.eu.org.', 'ns1.eriomem.net.'], 'CNAME': 'bouncingwiki.miraheze.org.'} [11:28:31] RECOVERY - cloud11 IPMI Sensors on cloud11 is OK: IPMI Status: OK [11:32:31] PROBLEM - cloud11 IPMI Sensors on cloud11 is CRITICAL: IPMI Status: Critical [Cntlr 2 Bay 8 = Critical] [11:35:05] PROBLEM - mw142 Current Load on mw142 is CRITICAL: CRITICAL - load average: 12.13, 10.01, 7.58 [11:36:59] RECOVERY - mw142 Current Load on mw142 is OK: OK - load average: 10.00, 9.42, 7.62 [12:13:55] PROBLEM - graylog131 Current Load on graylog131 is WARNING: LOAD WARNING - total load average: 3.63, 3.10, 2.78 [12:14:31] PROBLEM - mw132 Current Load on mw132 is WARNING: WARNING - load average: 11.95, 10.05, 8.59 [12:15:54] RECOVERY - graylog131 Current Load on graylog131 is OK: LOAD OK - total load average: 2.69, 2.94, 2.76 [12:16:30] PROBLEM - mw132 Current Load on mw132 is CRITICAL: CRITICAL - load average: 14.14, 11.31, 9.21 [12:18:30] PROBLEM - mw132 Current Load on mw132 is WARNING: WARNING - load average: 10.45, 10.62, 9.20 [12:20:29] PROBLEM - mw132 Current Load on mw132 is CRITICAL: CRITICAL - load average: 13.18, 11.21, 9.57 [12:22:28] PROBLEM - mw132 Current Load on mw132 is WARNING: WARNING - load average: 10.49, 11.10, 9.74 [12:24:27] RECOVERY - mw132 Current Load on mw132 is OK: OK - load average: 6.38, 9.59, 9.36 [12:43:47] PROBLEM - graylog131 Current Load on graylog131 is WARNING: LOAD WARNING - total load average: 3.43, 3.27, 2.90 [12:45:47] RECOVERY - graylog131 Current Load on graylog131 is OK: LOAD OK - total load average: 2.83, 3.08, 2.87 [13:47:54] PROBLEM - mw132 Current Load on mw132 is WARNING: WARNING - load average: 11.65, 10.13, 9.22 [13:49:54] RECOVERY - mw132 Current Load on mw132 is OK: OK - load average: 7.03, 8.96, 8.91 [13:58:49] PROBLEM - mw132 Current Load on mw132 is WARNING: WARNING - load average: 10.09, 10.84, 9.88 [13:59:24] PROBLEM - graylog131 Current Load on graylog131 is WARNING: LOAD WARNING - total load average: 3.73, 3.37, 3.00 [14:00:49] PROBLEM - mw132 Current Load on mw132 is CRITICAL: CRITICAL - load average: 14.99, 11.82, 10.32 [14:01:23] RECOVERY - graylog131 Current Load on graylog131 is OK: LOAD OK - total load average: 3.10, 3.33, 3.04 [14:02:43] PROBLEM - mw131 Current Load on mw131 is CRITICAL: CRITICAL - load average: 13.77, 11.87, 9.72 [14:03:01] PROBLEM - mw134 Current Load on mw134 is CRITICAL: CRITICAL - load average: 12.02, 10.30, 8.81 [14:04:43] PROBLEM - mw131 Current Load on mw131 is WARNING: WARNING - load average: 10.85, 11.25, 9.74 [14:04:47] PROBLEM - mw132 Current Load on mw132 is WARNING: WARNING - load average: 10.03, 11.24, 10.46 [14:06:46] PROBLEM - mw132 Current Load on mw132 is CRITICAL: CRITICAL - load average: 17.14, 13.13, 11.22 [14:10:43] PROBLEM - mw131 Current Load on mw131 is CRITICAL: CRITICAL - load average: 12.41, 11.34, 10.19 [14:10:45] PROBLEM - mw132 Current Load on mw132 is WARNING: WARNING - load average: 9.38, 11.22, 10.90 [14:10:58] PROBLEM - mw134 Current Load on mw134 is WARNING: WARNING - load average: 11.97, 11.65, 10.08 [14:12:43] PROBLEM - mw131 Current Load on mw131 is WARNING: WARNING - load average: 9.98, 10.99, 10.23 [14:18:42] PROBLEM - mw132 Current Load on mw132 is CRITICAL: CRITICAL - load average: 12.90, 11.71, 11.28 [14:20:41] PROBLEM - mw132 Current Load on mw132 is WARNING: WARNING - load average: 11.28, 11.73, 11.35 [14:20:43] PROBLEM - mw131 Current Load on mw131 is CRITICAL: CRITICAL - load average: 12.54, 11.55, 10.76 [14:22:43] RECOVERY - mw131 Current Load on mw131 is OK: OK - load average: 6.54, 9.50, 10.09 [14:22:52] RECOVERY - mw134 Current Load on mw134 is OK: OK - load average: 7.46, 9.25, 9.79 [14:32:37] PROBLEM - mw132 Current Load on mw132 is CRITICAL: CRITICAL - load average: 13.70, 11.27, 10.88 [14:34:36] PROBLEM - mw132 Current Load on mw132 is WARNING: WARNING - load average: 8.97, 10.69, 10.74 [14:40:35] RECOVERY - mw132 Current Load on mw132 is OK: OK - load average: 8.08, 9.24, 10.11 [14:55:27] PROBLEM - mw132 Current Load on mw132 is CRITICAL: CRITICAL - load average: 15.94, 12.17, 10.82 [14:57:27] PROBLEM - mw132 Current Load on mw132 is WARNING: WARNING - load average: 8.71, 11.12, 10.64 [14:57:57] PROBLEM - graylog131 Current Load on graylog131 is CRITICAL: LOAD CRITICAL - total load average: 4.44, 3.47, 3.07 [14:59:56] RECOVERY - graylog131 Current Load on graylog131 is OK: LOAD OK - total load average: 3.02, 3.35, 3.08 [15:03:25] PROBLEM - mw132 Current Load on mw132 is CRITICAL: CRITICAL - load average: 12.89, 11.55, 10.93 [15:05:24] PROBLEM - mw132 Current Load on mw132 is WARNING: WARNING - load average: 10.45, 11.19, 10.88 [15:13:21] PROBLEM - mw132 Current Load on mw132 is CRITICAL: CRITICAL - load average: 13.46, 10.98, 10.81 [15:15:20] PROBLEM - mw132 Current Load on mw132 is WARNING: WARNING - load average: 10.49, 10.74, 10.75 [15:17:19] PROBLEM - mw132 Current Load on mw132 is CRITICAL: CRITICAL - load average: 12.04, 11.15, 10.89 [15:19:19] PROBLEM - mw132 Current Load on mw132 is WARNING: WARNING - load average: 7.04, 9.73, 10.42 [15:25:17] RECOVERY - mw132 Current Load on mw132 is OK: OK - load average: 6.99, 8.82, 9.90 [15:37:11] PROBLEM - mw132 Current Load on mw132 is WARNING: WARNING - load average: 11.19, 9.89, 9.63 [15:39:11] PROBLEM - mw132 Current Load on mw132 is CRITICAL: CRITICAL - load average: 14.00, 11.38, 10.20 [15:39:24] PROBLEM - mw131 Current Load on mw131 is CRITICAL: CRITICAL - load average: 12.59, 9.77, 8.69 [15:40:38] PROBLEM - graylog131 Current Load on graylog131 is WARNING: LOAD WARNING - total load average: 3.76, 3.26, 3.06 [15:41:10] PROBLEM - mw132 Current Load on mw132 is WARNING: WARNING - load average: 11.13, 11.63, 10.47 [15:41:19] PROBLEM - mw131 Current Load on mw131 is WARNING: WARNING - load average: 10.48, 10.19, 8.99 [15:43:14] RECOVERY - mw131 Current Load on mw131 is OK: OK - load average: 9.64, 9.71, 8.93 [15:44:36] RECOVERY - graylog131 Current Load on graylog131 is OK: LOAD OK - total load average: 3.14, 3.16, 3.06 [15:45:08] PROBLEM - mw132 Current Load on mw132 is CRITICAL: CRITICAL - load average: 12.94, 11.39, 10.55 [15:47:08] RECOVERY - mw132 Current Load on mw132 is OK: OK - load average: 7.42, 9.94, 10.13 [15:57:30] PROBLEM - www.esolibrary.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Certificate 'www.esolibrary.com' expires in 7 day(s) (Sun 05 Nov 2023 15:35:59 GMT +0000). [17:05:01] PROBLEM - graylog131 Current Load on graylog131 is CRITICAL: LOAD CRITICAL - total load average: 4.05, 3.34, 2.92 [17:07:00] PROBLEM - graylog131 Current Load on graylog131 is WARNING: LOAD WARNING - total load average: 3.75, 3.52, 3.04 [17:10:58] RECOVERY - graylog131 Current Load on graylog131 is OK: LOAD OK - total load average: 2.14, 3.20, 3.06 [17:33:41] PROBLEM - wiki.gab.pt.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.gab.pt.eu.org All nameservers failed to answer the query. [18:03:42] PROBLEM - wiki.gab.pt.eu.org - reverse DNS on sslhost is WARNING: SSL WARNING - rDNS OK but records conflict. {'NS': ['ns.ankh.fr.eu.org.', 'ns1.eu.org.', 'ns1.eriomem.net.'], 'CNAME': 'bouncingwiki.miraheze.org.'} [19:00:09] PROBLEM - graylog131 Current Load on graylog131 is CRITICAL: LOAD CRITICAL - total load average: 4.10, 3.70, 3.08 [19:04:07] RECOVERY - graylog131 Current Load on graylog131 is OK: LOAD OK - total load average: 2.98, 3.29, 3.05 [19:07:16] PROBLEM - wiki.andreijiroh.uk.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.andreijiroh.uk.eu.org All nameservers failed to answer the query. [19:21:10] PROBLEM - wiki.gab.pt.eu.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.gab.pt.eu.org' expires in 15 day(s) (Mon 13 Nov 2023 19:07:45 GMT +0000). [19:22:03] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/b4f7bb09f1fd...eeeadd25fd06 [19:22:05] [02miraheze/ssl] 07MirahezeSSLBot 03eeeadd2 - Bot: Update SSL cert for wiki.gab.pt.eu.org [19:33:54] PROBLEM - graylog131 Current Load on graylog131 is WARNING: LOAD WARNING - total load average: 3.50, 3.43, 3.14 [19:36:30] RECOVERY - wiki.andreijiroh.uk.eu.org - reverse DNS on sslhost is OK: SSL OK - wiki.andreijiroh.uk.eu.org reverse DNS resolves to cp24.miraheze.org - CNAME OK [19:38:00] RECOVERY - graylog131 Current Load on graylog131 is OK: LOAD OK - total load average: 3.12, 3.16, 3.08 [20:04:11] PROBLEM - os141 Current Load on os141 is WARNING: LOAD WARNING - total load average: 3.63, 3.38, 2.64 [20:04:33] PROBLEM - mw132 Current Load on mw132 is WARNING: WARNING - load average: 11.58, 10.53, 9.58 [20:06:32] RECOVERY - mw132 Current Load on mw132 is OK: OK - load average: 7.04, 9.38, 9.29 [20:10:07] RECOVERY - os141 Current Load on os141 is OK: LOAD OK - total load average: 1.42, 2.74, 2.65 [20:20:12] RECOVERY - wiki.gab.pt.eu.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.gab.pt.eu.org' will expire on Fri 26 Jan 2024 18:21:28 GMT +0000. [22:03:41] PROBLEM - wiki.gab.pt.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.gab.pt.eu.org All nameservers failed to answer the query. [22:33:42] PROBLEM - wiki.gab.pt.eu.org - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query wiki.gab.pt.eu.org. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [23:03:03] PROBLEM - db112 Current Load on db112 is CRITICAL: CRITICAL - load average: 14.03, 7.44, 3.36 [23:09:03] PROBLEM - db112 Current Load on db112 is WARNING: WARNING - load average: 3.59, 7.58, 4.98 [23:11:03] RECOVERY - db112 Current Load on db112 is OK: OK - load average: 0.75, 5.16, 4.40