[00:02:14] <icinga-miraheze>	 PROBLEM - cp33 Current Load on cp33 is CRITICAL: LOAD CRITICAL - total load average: 4.45, 4.21, 2.85
[00:02:15] <icinga-miraheze>	 PROBLEM - cp23 Current Load on cp23 is CRITICAL: LOAD CRITICAL - total load average: 34.22, 19.90, 8.06
[00:03:14] <icinga-miraheze>	 PROBLEM - cp22 Current Load on cp22 is CRITICAL: LOAD CRITICAL - total load average: 12.81, 9.20, 4.23
[00:04:10] <icinga-miraheze>	 RECOVERY - cp33 Current Load on cp33 is OK: LOAD OK - total load average: 1.66, 3.39, 2.72
[00:07:06] <icinga-miraheze>	 PROBLEM - tudien.como.vn - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for tudien.como.vn could not be found
[00:18:14] <icinga-miraheze>	 PROBLEM - cp23 Current Load on cp23 is WARNING: LOAD WARNING - total load average: 0.47, 2.04, 3.99
[00:22:14] <icinga-miraheze>	 RECOVERY - cp23 Current Load on cp23 is OK: LOAD OK - total load average: 0.41, 1.11, 3.15
[00:25:14] <icinga-miraheze>	 PROBLEM - cp22 Current Load on cp22 is WARNING: LOAD WARNING - total load average: 0.34, 1.97, 3.65
[00:27:14] <icinga-miraheze>	 RECOVERY - cp22 Current Load on cp22 is OK: LOAD OK - total load average: 0.35, 1.41, 3.24
[00:40:35] <icinga-miraheze>	 [Grafana] !sre FIRING: The mediawiki job queue has more than 2500 unclaimed jobs https://grafana.miraheze.org/d/GtxbP1Xnk?orgId=1
[01:03:11] <icinga-miraheze>	 PROBLEM - wiki.gab.pt.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.gab.pt.eu.org All nameservers failed to answer the query.
[01:33:11] <icinga-miraheze>	 PROBLEM - wiki.gab.pt.eu.org - reverse DNS on sslhost is WARNING: SSL WARNING - rDNS OK but records conflict. {'NS': ['ns.ankh.fr.eu.org.', 'ns1.eu.org.', 'ns1.eriomem.net.'], 'CNAME': 'bouncingwiki.miraheze.org.'}
[02:10:35] <icinga-miraheze>	 [Grafana] !sre RESOLVED: High Job Queue Backlog https://grafana.miraheze.org/d/GtxbP1Xnk?orgId=1
[02:14:42] <icinga-miraheze>	 PROBLEM - wiki.otir.nl - reverse DNS on sslhost is WARNING: Timeout: The DNS operation timed out after 5.406144380569458 seconds
[02:24:32] <icinga-miraheze>	 PROBLEM - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query mar.in.ua. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL
[02:43:33] <icinga-miraheze>	 RECOVERY - wiki.otir.nl - reverse DNS on sslhost is OK: SSL OK - wiki.otir.nl reverse DNS resolves to cp23.miraheze.org - CNAME OK
[02:53:33] <icinga-miraheze>	 RECOVERY - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - uk.religiononfire.mar.in.ua reverse DNS resolves to cp22.miraheze.org - CNAME OK
[03:27:57] <icinga-miraheze>	 PROBLEM - en.religiononfire.mar.in.ua - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - en.religiononfire.mar.in.ua All nameservers failed to answer the query.
[03:56:27] <icinga-miraheze>	 RECOVERY - en.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - en.religiononfire.mar.in.ua reverse DNS resolves to cp23.miraheze.org - CNAME OK
[04:53:31] <icinga-miraheze>	 PROBLEM - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - uk.religiononfire.mar.in.ua All nameservers failed to answer the query.
[05:22:32] <icinga-miraheze>	 PROBLEM - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query mar.in.ua. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL
[05:58:15] <icinga-miraheze>	 PROBLEM - cp32 Current Load on cp32 is CRITICAL: LOAD CRITICAL - total load average: 5.10, 3.17, 1.84
[06:00:15] <icinga-miraheze>	 RECOVERY - cp32 Current Load on cp32 is OK: LOAD OK - total load average: 2.65, 3.09, 1.98
[06:27:26] <icinga-miraheze>	 PROBLEM - cp22 Current Load on cp22 is CRITICAL: LOAD CRITICAL - total load average: 4.89, 2.88, 1.63
[06:28:14] <icinga-miraheze>	 PROBLEM - cp23 Current Load on cp23 is CRITICAL: LOAD CRITICAL - total load average: 6.78, 5.36, 2.49
[06:29:21] <icinga-miraheze>	 RECOVERY - cp22 Current Load on cp22 is OK: LOAD OK - total load average: 1.75, 2.27, 1.55
[06:30:14] <icinga-miraheze>	 PROBLEM - cp23 Current Load on cp23 is WARNING: LOAD WARNING - total load average: 1.52, 3.81, 2.27
[06:32:14] <icinga-miraheze>	 RECOVERY - cp23 Current Load on cp23 is OK: LOAD OK - total load average: 0.95, 2.80, 2.08
[06:51:32] <icinga-miraheze>	 RECOVERY - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - uk.religiononfire.mar.in.ua reverse DNS resolves to cp22.miraheze.org - CNAME OK
[07:15:19] <icinga-miraheze>	 RECOVERY - cp33 NTP time on cp33 is OK: NTP OK: Offset 0.09987193346 secs
[07:22:15] <icinga-miraheze>	 PROBLEM - wiki.andreijiroh.uk.eu.org - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query wiki.andreijiroh.uk.eu.org. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL
[07:51:30] <icinga-miraheze>	 RECOVERY - wiki.andreijiroh.uk.eu.org - reverse DNS on sslhost is OK: SSL OK - wiki.andreijiroh.uk.eu.org reverse DNS resolves to cp22.miraheze.org - CNAME OK
[09:27:31] <icinga-miraheze>	 PROBLEM - en.religiononfire.mar.in.ua - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - en.religiononfire.mar.in.ua All nameservers failed to answer the query.
[09:56:01] <icinga-miraheze>	 PROBLEM - en.religiononfire.mar.in.ua - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query mar.in.ua. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL
[10:03:11] <icinga-miraheze>	 PROBLEM - wiki.gab.pt.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.gab.pt.eu.org All nameservers failed to answer the query.
[10:13:45] <icinga-miraheze>	 PROBLEM - cp32 NTP time on cp32 is WARNING: NTP WARNING: Offset 0.4998492002 secs
[10:25:31] <icinga-miraheze>	 RECOVERY - en.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - en.religiononfire.mar.in.ua reverse DNS resolves to cp22.miraheze.org - CNAME OK
[10:33:11] <icinga-miraheze>	 PROBLEM - wiki.gab.pt.eu.org - reverse DNS on sslhost is WARNING: SSL WARNING - rDNS OK but records conflict. {'NS': ['ns.ankh.fr.eu.org.', 'ns1.eu.org.', 'ns1.eriomem.net.'], 'CNAME': 'bouncingwiki.miraheze.org.'}
[10:59:38] <icinga-miraheze>	 PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 2.95, 2.92, 4.00
[11:09:38] <icinga-miraheze>	 RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 3.06, 2.69, 3.35
[11:48:26] <icinga-miraheze>	 PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.81, 3.79, 3.20
[12:00:03] <icinga-miraheze>	 PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.62, 4.00, 3.80
[12:01:59] <icinga-miraheze>	 PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.11, 4.02, 3.83
[12:03:40] <icinga-miraheze>	 RECOVERY - cloud11 IPMI Sensors on cloud11 is OK: IPMI Status: OK
[12:03:56] <icinga-miraheze>	 PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.62, 3.84, 3.78
[12:05:52] <icinga-miraheze>	 PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.23, 3.95, 3.83
[12:07:40] <icinga-miraheze>	 PROBLEM - cloud11 IPMI Sensors on cloud11 is CRITICAL: IPMI Status: Critical [Cntlr 2 Bay 8 = Critical]
[12:07:48] <icinga-miraheze>	 PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.80, 3.96, 3.85
[12:09:44] <icinga-miraheze>	 PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 5.26, 4.34, 4.00
[12:33:11] <icinga-miraheze>	 PROBLEM - wiki.gab.pt.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.gab.pt.eu.org All nameservers failed to answer the query.
[13:03:11] <icinga-miraheze>	 PROBLEM - wiki.gab.pt.eu.org - reverse DNS on sslhost is WARNING: SSL WARNING - rDNS OK but records conflict. {'NS': ['NS.ANKH.FR.eu.org.', 'NS1.eu.org.', 'NS1.ERIOMEM.NET.'], 'CNAME': 'bouncingwiki.miraheze.org.'}
[13:37:15] <icinga-miraheze>	 PROBLEM - www.deadprem.wiki - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'deadprem.wiki' expires in 15 day(s) (Tue 05 Sep 2023 13:29:06 GMT +0000).
[13:58:19] <icinga-miraheze>	 PROBLEM - deadprem.wiki - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'deadprem.wiki' expires in 15 day(s) (Tue 05 Sep 2023 13:29:06 GMT +0000).
[13:59:29] <botifico>	 [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/98ad667dcf6b...67bd7914b8c6
[13:59:30] <botifico>	 [02miraheze/ssl] 07MirahezeSSLBot 0367bd791 - Bot: Update SSL cert for deadprem.wiki
[14:14:43] <icinga-miraheze>	 PROBLEM - wiki.arsrobotics.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.arsrobotics.org' expires in 15 day(s) (Tue 05 Sep 2023 13:53:20 GMT +0000).
[14:21:31] <botifico>	 [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/67bd7914b8c6...3af4f4ec7195
[14:21:33] <botifico>	 [02miraheze/ssl] 07MirahezeSSLBot 033af4f4e - Bot: Update SSL cert for wiki.arsrobotics.org
[14:36:25] <icinga-miraheze>	 PROBLEM - kombinat.eu.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'kombinat.eu.org' expires in 15 day(s) (Tue 05 Sep 2023 14:12:55 GMT +0000).
[14:44:48] <botifico>	 [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/3af4f4ec7195...8eb0e6997b48
[14:44:51] <botifico>	 [02miraheze/ssl] 07MirahezeSSLBot 038eb0e69 - Bot: Update SSL cert for kombinat.eu.org
[15:35:18] <icinga-miraheze>	 PROBLEM - fotnswiki.com - reverse DNS on sslhost is WARNING: NXDOMAIN: The DNS query name does not exist: fotnswiki.com.
[16:31:20] <icinga-miraheze>	 PROBLEM - bast141 Current Load on bast141 is CRITICAL: LOAD CRITICAL - total load average: 3.94, 1.87, 0.71
[16:35:11] <icinga-miraheze>	 RECOVERY - bast141 Current Load on bast141 is OK: LOAD OK - total load average: 0.38, 1.39, 0.81
[17:13:38] <icinga-miraheze>	 PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.27, 3.45, 4.00
[17:23:31] <icinga-miraheze>	 PROBLEM - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - uk.religiononfire.mar.in.ua All nameservers failed to answer the query.
[17:35:38] <icinga-miraheze>	 RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 2.66, 3.11, 3.39
[17:41:38] <icinga-miraheze>	 PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.39, 3.45, 3.45
[17:45:38] <icinga-miraheze>	 PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.28, 3.75, 3.56
[17:47:38] <icinga-miraheze>	 PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.30, 3.63, 3.55
[17:52:32] <icinga-miraheze>	 PROBLEM - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query uk.religiononfire.mar.in.ua. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL
[18:07:38] <icinga-miraheze>	 PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 5.71, 4.28, 3.76
[18:21:33] <icinga-miraheze>	 RECOVERY - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - uk.religiononfire.mar.in.ua reverse DNS resolves to cp22.miraheze.org - CNAME OK
[19:23:31] <icinga-miraheze>	 PROBLEM - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - uk.religiononfire.mar.in.ua All nameservers failed to answer the query.
[19:52:32] <icinga-miraheze>	 RECOVERY - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - uk.religiononfire.mar.in.ua reverse DNS resolves to cp23.miraheze.org - CNAME OK
[19:54:38] <icinga-miraheze>	 PROBLEM - cp33 Current Load on cp33 is CRITICAL: LOAD CRITICAL - total load average: 5.38, 3.49, 2.14
[19:56:38] <icinga-miraheze>	 RECOVERY - cp33 Current Load on cp33 is OK: LOAD OK - total load average: 2.49, 3.03, 2.14
[20:01:38] <icinga-miraheze>	 PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 2.70, 3.48, 3.91
[20:04:38] <icinga-miraheze>	 PROBLEM - cp33 Current Load on cp33 is WARNING: LOAD WARNING - total load average: 3.58, 3.92, 2.81
[20:06:38] <icinga-miraheze>	 RECOVERY - cp33 Current Load on cp33 is OK: LOAD OK - total load average: 1.66, 3.15, 2.66
[20:09:38] <icinga-miraheze>	 PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.85, 3.85, 3.85
[20:13:38] <icinga-miraheze>	 PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.37, 3.81, 3.85
[20:19:38] <icinga-miraheze>	 PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.12, 3.69, 3.75
[20:21:38] <icinga-miraheze>	 PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.60, 3.54, 3.68
[20:39:38] <icinga-miraheze>	 PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.13, 3.74, 3.59
[20:41:38] <icinga-miraheze>	 PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.53, 3.58, 3.54
[20:59:38] <icinga-miraheze>	 RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 2.92, 3.18, 3.40
[21:03:38] <icinga-miraheze>	 PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.72, 3.47, 3.47
[21:09:38] <icinga-miraheze>	 PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.74, 3.89, 3.62
[21:11:38] <icinga-miraheze>	 PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.97, 3.88, 3.65
[21:17:38] <icinga-miraheze>	 RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 2.93, 3.17, 3.39
[21:27:31] <icinga-miraheze>	 PROBLEM - en.religiononfire.mar.in.ua - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query en.religiononfire.mar.in.ua. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL
[21:56:03] <icinga-miraheze>	 RECOVERY - en.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - en.religiononfire.mar.in.ua reverse DNS resolves to cp23.miraheze.org - CNAME OK
[21:59:21] <icinga-miraheze>	 PROBLEM - prometheus131 Current Load on prometheus131 is CRITICAL: CRITICAL - load average: 5.85, 3.03, 1.39
[22:03:21] <icinga-miraheze>	 PROBLEM - prometheus131 Current Load on prometheus131 is WARNING: WARNING - load average: 3.63, 3.60, 2.02
[22:05:21] <icinga-miraheze>	 RECOVERY - prometheus131 Current Load on prometheus131 is OK: OK - load average: 1.18, 2.71, 1.89
[22:08:33] <icinga-miraheze>	 PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.13, 3.50, 3.30
[22:08:43] <icinga-miraheze>	 PROBLEM - isv.orain.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'orain.org' expires in 15 day(s) (Tue 05 Sep 2023 22:02:13 GMT +0000).
[22:10:29] <icinga-miraheze>	 PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.35, 3.44, 3.30
[22:12:25] <icinga-miraheze>	 RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 3.10, 3.28, 3.26
[22:18:18] <icinga-miraheze>	 PROBLEM - allthetropes.orain.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'orain.org' expires in 15 day(s) (Tue 05 Sep 2023 22:02:13 GMT +0000).
[22:25:55] <icinga-miraheze>	 PROBLEM - orain.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'orain.org' expires in 15 day(s) (Tue 05 Sep 2023 22:02:13 GMT +0000).
[22:33:56] <icinga-miraheze>	 PROBLEM - poserdazfreebies.orain.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'orain.org' expires in 15 day(s) (Tue 05 Sep 2023 22:02:13 GMT +0000).
[22:35:19] <icinga-miraheze>	 PROBLEM - cp33 NTP time on cp33 is WARNING: NTP WARNING: Offset 0.3923422992 secs
[22:48:28] <icinga-miraheze>	 PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.55, 3.61, 3.36
[22:52:20] <icinga-miraheze>	 RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 2.90, 3.40, 3.33
[23:01:07] <icinga-miraheze>	 PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.79, 3.93, 3.55
[23:02:30] <icinga-miraheze>	 PROBLEM - db112 Current Load on db112 is CRITICAL: CRITICAL - load average: 11.90, 5.64, 2.57
[23:03:03] <icinga-miraheze>	 PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.43, 3.74, 3.52
[23:06:55] <icinga-miraheze>	 RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 2.83, 3.22, 3.36
[23:08:30] <icinga-miraheze>	 RECOVERY - db112 Current Load on db112 is OK: OK - load average: 2.34, 6.61, 4.31
[23:23:38] <icinga-miraheze>	 PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.43, 3.36, 3.33
[23:25:38] <icinga-miraheze>	 RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 3.16, 3.23, 3.28
[23:28:51] <icinga-miraheze>	 PROBLEM - cp33 Current Load on cp33 is CRITICAL: LOAD CRITICAL - total load average: 5.87, 2.82, 1.80
[23:30:48] <icinga-miraheze>	 RECOVERY - cp33 Current Load on cp33 is OK: LOAD OK - total load average: 1.70, 2.21, 1.70
[23:42:22] <icinga-miraheze>	 PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.62, 3.74, 3.47
[23:48:10] <icinga-miraheze>	 PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.16, 3.78, 3.54
[23:50:07] <icinga-miraheze>	 PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.69, 3.72, 3.55
[23:52:03] <icinga-miraheze>	 PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.55, 3.96, 3.65
[23:57:52] <icinga-miraheze>	 PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.37, 3.91, 3.77