[00:02:32] PROBLEM - cp22 Current Load on cp22 is CRITICAL: LOAD CRITICAL - total load average: 6.98, 4.95, 2.28 [00:04:01] PROBLEM - cp23 Current Load on cp23 is CRITICAL: LOAD CRITICAL - total load average: 2.81, 7.60, 4.16 [00:04:32] RECOVERY - cp22 Current Load on cp22 is OK: LOAD OK - total load average: 1.11, 3.38, 2.03 [00:08:01] PROBLEM - cp23 Current Load on cp23 is WARNING: LOAD WARNING - total load average: 0.73, 4.00, 3.47 [00:10:21] PROBLEM - cp23 Current Load on cp23 is CRITICAL: LOAD CRITICAL - total load average: 13.29, 7.89, 4.93 [00:18:01] PROBLEM - cp23 Current Load on cp23 is WARNING: LOAD WARNING - total load average: 0.54, 3.17, 3.94 [00:22:01] RECOVERY - cp23 Current Load on cp23 is OK: LOAD OK - total load average: 0.47, 1.64, 3.12 [01:25:08] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 7.40, 6.38, 5.87 [01:27:02] RECOVERY - swiftobject101 Current Load on swiftobject101 is OK: OK - load average: 6.35, 6.24, 5.88 [01:32:45] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 8.19, 7.37, 6.43 [01:34:14] PROBLEM - cp33 Current Load on cp33 is WARNING: LOAD WARNING - total load average: 3.47, 2.97, 2.43 [01:34:40] RECOVERY - swiftobject101 Current Load on swiftobject101 is OK: OK - load average: 5.75, 6.60, 6.25 [01:36:09] PROBLEM - cp33 Current Load on cp33 is CRITICAL: LOAD CRITICAL - total load average: 5.36, 4.86, 3.25 [01:37:22] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.67, 6.80, 6.25 [01:38:04] PROBLEM - cp33 Current Load on cp33 is WARNING: LOAD WARNING - total load average: 2.45, 3.90, 3.08 [01:39:17] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.18, 6.16, 6.08 [01:39:53] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.24, 3.72, 3.33 [01:39:58] RECOVERY - cp33 Current Load on cp33 is OK: LOAD OK - total load average: 1.44, 3.09, 2.88 [01:41:52] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.83, 3.70, 3.37 [01:45:09] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 7.20, 6.81, 6.39 [01:47:03] RECOVERY - swiftobject101 Current Load on swiftobject101 is OK: OK - load average: 5.11, 6.11, 6.18 [01:59:44] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 2.03, 3.16, 3.39 [02:05:25] PROBLEM - cp33 Current Load on cp33 is CRITICAL: LOAD CRITICAL - total load average: 2.54, 4.10, 3.01 [02:07:25] RECOVERY - cp33 Current Load on cp33 is OK: LOAD OK - total load average: 1.00, 3.02, 2.74 [03:31:36] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 7.09, 6.51, 5.93 [03:35:25] RECOVERY - swiftobject101 Current Load on swiftobject101 is OK: OK - load average: 5.31, 6.05, 5.90 [03:35:33] PROBLEM - cp33 Current Load on cp33 is CRITICAL: LOAD CRITICAL - total load average: 4.69, 4.85, 3.02 [03:37:28] PROBLEM - cp33 Current Load on cp33 is WARNING: LOAD WARNING - total load average: 1.98, 3.77, 2.84 [03:39:25] RECOVERY - cp33 Current Load on cp33 is OK: LOAD OK - total load average: 1.77, 3.11, 2.70 [03:49:25] PROBLEM - cp33 Current Load on cp33 is CRITICAL: LOAD CRITICAL - total load average: 3.33, 4.07, 3.08 [03:51:25] RECOVERY - cp33 Current Load on cp33 is OK: LOAD OK - total load average: 1.62, 3.08, 2.83 [04:01:42] PROBLEM - cp32 Current Load on cp32 is WARNING: LOAD WARNING - total load average: 3.48, 3.38, 2.20 [04:03:42] RECOVERY - cp32 Current Load on cp32 is OK: LOAD OK - total load average: 2.01, 2.81, 2.13 [06:09:50] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.62, 3.70, 2.85 [06:13:48] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.70, 3.73, 3.06 [06:18:04] PROBLEM - db101 Backups SQL on db101 is CRITICAL: FILE_AGE CRITICAL: /var/log/sql-backup.log is 1209696 seconds old and 49257 bytes [06:23:44] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.25, 3.64, 3.29 [06:28:01] PROBLEM - cp23 Current Load on cp23 is WARNING: LOAD WARNING - total load average: 2.88, 3.97, 2.08 [06:30:01] RECOVERY - cp23 Current Load on cp23 is OK: LOAD OK - total load average: 1.00, 2.82, 1.88 [06:33:39] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.65, 3.99, 3.71 [06:37:37] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.11, 4.06, 3.80 [07:07:24] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 2.50, 3.67, 3.97 [07:15:20] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 2.27, 2.47, 3.25 [07:51:43] PROBLEM - worldtriggerwiki.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'worldtriggerwiki.com' expires in 15 day(s) (Mon 25 Sep 2023 07:34:17 GMT +0000). [07:57:40] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/5d7673ca5ade...484bb75fab77 [07:57:43] [02miraheze/ssl] 07MirahezeSSLBot 03484bb75 - Bot: Update SSL cert for worldtriggerwiki.com [08:49:43] RECOVERY - worldtriggerwiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'worldtriggerwiki.com' will expire on Fri 08 Dec 2023 06:57:28 GMT +0000. [10:40:18] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 7.06, 6.38, 5.04 [10:42:18] RECOVERY - swiftobject101 Current Load on swiftobject101 is OK: OK - load average: 3.88, 5.34, 4.81 [10:59:23] PROBLEM - en.religiononfire.mar.in.ua - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query en.religiononfire.mar.in.ua. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [11:57:23] RECOVERY - en.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - en.religiononfire.mar.in.ua reverse DNS resolves to cp22.miraheze.org - CNAME OK [12:08:53] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.61, 3.24, 2.70 [12:16:50] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.53, 3.98, 3.37 [12:28:44] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 5.32, 4.23, 3.71 [12:54:33] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 2.95, 3.67, 3.91 [12:58:31] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.12, 3.95, 3.97 [13:00:30] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.77, 3.90, 3.95 [13:10:26] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 1.95, 2.55, 3.27 [13:40:23] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.09, 3.37, 2.90 [13:42:23] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.66, 3.44, 2.99 [13:44:23] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 2.66, 3.18, 2.95 [13:58:21] RECOVERY - cloud11 IPMI Sensors on cloud11 is OK: IPMI Status: OK [14:02:21] PROBLEM - cloud11 IPMI Sensors on cloud11 is CRITICAL: IPMI Status: Critical [Cntlr 2 Bay 8 = Critical] [14:24:45] PROBLEM - cp33 NTP time on cp33 is WARNING: NTP WARNING: Offset -0.3863555193 secs [14:36:23] PROBLEM - cp23 Current Load on cp23 is CRITICAL: LOAD CRITICAL - total load average: 4.41, 4.98, 3.03 [14:38:17] PROBLEM - cp23 Current Load on cp23 is WARNING: LOAD WARNING - total load average: 1.43, 3.74, 2.80 [14:40:12] RECOVERY - cp23 Current Load on cp23 is OK: LOAD OK - total load average: 1.31, 2.94, 2.61 [16:36:18] PROBLEM - matomo121 Current Load on matomo121 is WARNING: WARNING - load average: 3.59, 3.26, 2.82 [16:38:14] RECOVERY - matomo121 Current Load on matomo121 is OK: OK - load average: 3.11, 3.18, 2.84 [17:01:48] PROBLEM - wiki.gab.pt.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.gab.pt.eu.org All nameservers failed to answer the query. [17:02:48] RECOVERY - cloud11 IPMI Sensors on cloud11 is OK: IPMI Status: OK [17:06:46] PROBLEM - cloud11 IPMI Sensors on cloud11 is CRITICAL: IPMI Status: Critical [Cntlr 2 Bay 8 = Critical] [17:31:40] PROBLEM - wiki.gab.pt.eu.org - reverse DNS on sslhost is WARNING: SSL WARNING - rDNS OK but records conflict. {'NS': ['NS.ANKH.FR.eu.org.', 'NS1.eu.org.', 'NS1.ERIOMEM.NET.'], 'CNAME': 'bouncingwiki.miraheze.org.'} [18:09:35] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.16, 3.34, 2.62 [18:13:34] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.16, 3.47, 2.86 [18:21:30] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.12, 3.77, 3.24 [18:23:29] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.55, 3.64, 3.26 [18:25:28] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.07, 3.92, 3.42 [18:37:23] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.33, 3.87, 3.76 [18:39:22] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.73, 4.07, 3.83 [19:03:11] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 2.86, 3.75, 3.98 [19:05:52] PROBLEM - cp33 Current Load on cp33 is CRITICAL: LOAD CRITICAL - total load average: 3.21, 4.62, 2.90 [19:07:47] RECOVERY - cp33 Current Load on cp33 is OK: LOAD OK - total load average: 0.99, 3.33, 2.63 [19:09:09] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 2.26, 2.58, 3.36 [20:54:21] RECOVERY - cloud11 IPMI Sensors on cloud11 is OK: IPMI Status: OK [20:58:21] PROBLEM - cloud11 IPMI Sensors on cloud11 is CRITICAL: IPMI Status: Critical [Cntlr 2 Bay 8 = Critical] [21:37:22] PROBLEM - ns2 APT on ns2 is CRITICAL: APT CRITICAL: 1 packages available for upgrade (1 critical updates). [21:45:47] PROBLEM - ns1 APT on ns1 is CRITICAL: APT CRITICAL: 1 packages available for upgrade (1 critical updates). [21:45:53] PROBLEM - cp33 Current Load on cp33 is CRITICAL: LOAD CRITICAL - total load average: 2.56, 5.16, 3.34 [21:51:37] PROBLEM - cp33 Current Load on cp33 is WARNING: LOAD WARNING - total load average: 1.16, 3.63, 3.32 [21:53:31] RECOVERY - cp33 Current Load on cp33 is OK: LOAD OK - total load average: 0.94, 2.79, 3.05 [22:04:21] RECOVERY - cloud11 IPMI Sensors on cloud11 is OK: IPMI Status: OK [22:08:21] PROBLEM - cloud11 IPMI Sensors on cloud11 is CRITICAL: IPMI Status: Critical [Cntlr 2 Bay 8 = Critical] [22:12:22] RECOVERY - wiki.thunis.eu - reverse DNS on sslhost is OK: SSL OK - wiki.thunis.eu reverse DNS resolves to cp22.miraheze.org - CNAME OK [22:17:10] PROBLEM - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query mar.in.ua. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [22:22:03] PROBLEM - cp33 Current Load on cp33 is WARNING: LOAD WARNING - total load average: 3.65, 3.85, 2.77 [22:23:58] RECOVERY - cp33 Current Load on cp33 is OK: LOAD OK - total load average: 1.81, 3.28, 2.70 [22:29:23] PROBLEM - en.religiononfire.mar.in.ua - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - en.religiononfire.mar.in.ua All nameservers failed to answer the query. [22:45:49] RECOVERY - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - uk.religiononfire.mar.in.ua reverse DNS resolves to cp23.miraheze.org - CNAME OK [22:56:25] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.68, 3.07, 2.57 [22:58:16] RECOVERY - en.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - en.religiononfire.mar.in.ua reverse DNS resolves to cp23.miraheze.org - CNAME OK [23:00:23] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 2.58, 2.93, 2.64 [23:04:24] PROBLEM - db112 Current Load on db112 is CRITICAL: CRITICAL - load average: 12.23, 7.85, 3.78 [23:06:24] RECOVERY - db112 Current Load on db112 is OK: OK - load average: 3.69, 6.64, 3.87 [23:29:14] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.54, 3.25, 3.10 [23:31:13] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 2.76, 3.00, 3.02