[00:06:47] <icinga-miraheze>	 PROBLEM - www.portalsofphereon.com - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query portalsofphereon.com. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL
[00:11:16] <icinga-miraheze>	 PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.87, 5.07, 3.38
[00:13:15] <icinga-miraheze>	 PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.78, 3.92, 3.16
[00:17:11] <icinga-miraheze>	 RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.89, 2.96, 2.94
[00:18:07] <icinga-miraheze>	 PROBLEM - drowiki.com - LetsEncrypt on sslhost is CRITICAL: connect to address drowiki.com and port 443: Network is unreachableHTTP CRITICAL - Unable to open TCP socket
[00:36:39] <icinga-miraheze>	 RECOVERY - www.portalsofphereon.com - reverse DNS on sslhost is OK: SSL OK - www.portalsofphereon.com reverse DNS resolves to cp23.miraheze.org - NS RECORDS OK
[00:48:07] <icinga-miraheze>	 PROBLEM - drowiki.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'drowiki.com' expires in 12 day(s) (Tue 25 Jul 2023 15:53:31 GMT +0000).
[01:18:07] <icinga-miraheze>	 PROBLEM - drowiki.com - LetsEncrypt on sslhost is CRITICAL: connect to address drowiki.com and port 443: Network is unreachableHTTP CRITICAL - Unable to open TCP socket
[01:47:38] <icinga-miraheze>	 PROBLEM - matomo121 Current Load on matomo121 is WARNING: WARNING - load average: 3.51, 3.26, 2.90
[01:49:38] <icinga-miraheze>	 RECOVERY - matomo121 Current Load on matomo121 is OK: OK - load average: 1.69, 2.69, 2.74
[02:07:33] <icinga-miraheze>	 RECOVERY - en.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - en.religiononfire.mar.in.ua reverse DNS resolves to cp23.miraheze.org - CNAME OK
[02:40:23] <icinga-miraheze>	 PROBLEM - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - uk.religiononfire.mar.in.ua All nameservers failed to answer the query.
[02:43:52] <icinga-miraheze>	 PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 8.38, 7.01, 6.45
[02:45:47] <icinga-miraheze>	 PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 6.48, 6.84, 6.46
[02:47:42] <icinga-miraheze>	 RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 5.63, 6.47, 6.37
[02:48:07] <icinga-miraheze>	 PROBLEM - drowiki.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'drowiki.com' expires in 12 day(s) (Tue 25 Jul 2023 15:53:31 GMT +0000).
[02:58:04] <icinga-miraheze>	 PROBLEM - cp22 NTP time on cp22 is WARNING: NTP WARNING: Offset 0.1027175784 secs
[03:04:07] <icinga-miraheze>	 PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.98, 5.21, 3.32
[03:08:07] <icinga-miraheze>	 PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.21, 3.64, 3.15
[03:10:07] <icinga-miraheze>	 RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 0.60, 2.64, 2.84
[03:10:12] <icinga-miraheze>	 PROBLEM - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query mar.in.ua. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL
[03:11:37] <icinga-miraheze>	 PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 6.86, 6.62, 6.32
[03:13:32] <icinga-miraheze>	 RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 6.53, 6.71, 6.40
[03:18:07] <icinga-miraheze>	 PROBLEM - drowiki.com - LetsEncrypt on sslhost is CRITICAL: connect to address drowiki.com and port 443: Network is unreachableHTTP CRITICAL - Unable to open TCP socket
[03:20:04] <icinga-miraheze>	 RECOVERY - cp22 NTP time on cp22 is OK: NTP OK: Offset 0.09999164939 secs
[03:40:02] <icinga-miraheze>	 RECOVERY - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - uk.religiononfire.mar.in.ua reverse DNS resolves to cp23.miraheze.org - CNAME OK
[03:41:08] <icinga-miraheze>	 PROBLEM - en.religiononfire.mar.in.ua - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query mar.in.ua. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL
[04:31:31] <icinga-miraheze>	 PROBLEM - db112 Current Load on db112 is CRITICAL: CRITICAL - load average: 20.10, 12.40, 7.00
[04:39:40] <icinga-miraheze>	 RECOVERY - en.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - en.religiononfire.mar.in.ua reverse DNS resolves to cp22.miraheze.org - CNAME OK
[04:45:57] <icinga-miraheze>	 PROBLEM - db112 Disk Space on db112 is WARNING: DISK WARNING - free space: / 14361 MB (10% inode=99%);
[05:03:57] <icinga-miraheze>	 RECOVERY - db112 Disk Space on db112 is OK: DISK OK - free space: / 23373 MB (17% inode=99%);
[05:34:39] <icinga-miraheze>	 PROBLEM - db112 Current Load on db112 is WARNING: WARNING - load average: 2.47, 3.09, 7.33
[05:36:39] <icinga-miraheze>	 RECOVERY - db112 Current Load on db112 is OK: OK - load average: 0.47, 2.12, 6.45
[05:38:46] <icinga-miraheze>	 PROBLEM - cp33 NTP time on cp33 is CRITICAL: NTP CRITICAL: Offset 0.5540400743 secs
[05:48:46] <icinga-miraheze>	 PROBLEM - cp33 NTP time on cp33 is WARNING: NTP WARNING: Offset 0.1250959635 secs
[05:50:46] <icinga-miraheze>	 RECOVERY - cp33 NTP time on cp33 is OK: NTP OK: Offset -0.02673125267 secs
[06:11:27] <icinga-miraheze>	 PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.59, 3.04, 2.48
[06:13:27] <icinga-miraheze>	 RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 2.94, 2.99, 2.53
[06:38:46] <icinga-miraheze>	 PROBLEM - cp33 NTP time on cp33 is WARNING: NTP WARNING: Offset 0.124212116 secs
[06:45:49] <icinga-miraheze>	 PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.41, 3.39, 3.09
[06:46:13] <icinga-miraheze>	 PROBLEM - wiki.altilunium.my.id - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.altilunium.my.id' expires in 15 day(s) (Sat 29 Jul 2023 06:20:16 GMT +0000).
[06:49:39] <botifico-16655b7>	 [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/63afa0113970...e1dc2ddda38b
[06:49:40] <botifico-16655b7>	 [02miraheze/ssl] 07MirahezeSSLBot 03e1dc2dd - Bot: Update SSL cert for wiki.altilunium.my.id
[06:49:43] <icinga-miraheze>	 RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 3.12, 3.31, 3.13
[06:50:46] <icinga-miraheze>	 PROBLEM - cp33 NTP time on cp33 is CRITICAL: NTP CRITICAL: Offset 0.6744648218 secs
[06:53:34] <icinga-miraheze>	 PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.60, 3.44, 3.21
[06:55:30] <icinga-miraheze>	 RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 2.59, 3.07, 3.10
[07:10:46] <icinga-miraheze>	 RECOVERY - cp33 NTP time on cp33 is OK: NTP OK: Offset -0.005804002285 secs
[07:15:43] <icinga-miraheze>	 RECOVERY - wiki.altilunium.my.id - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.altilunium.my.id' will expire on Wed 11 Oct 2023 05:49:31 GMT +0000.
[07:36:40] <icinga-miraheze>	 PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 6.37, 3.66, 2.17
[07:40:42] <icinga-miraheze>	 PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.46, 3.69, 2.56
[07:42:40] <icinga-miraheze>	 RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.13, 2.82, 2.38
[07:48:07] <icinga-miraheze>	 PROBLEM - drowiki.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'drowiki.com' expires in 12 day(s) (Tue 25 Jul 2023 15:53:31 GMT +0000).
[08:14:46] <icinga-miraheze>	 PROBLEM - cp33 NTP time on cp33 is WARNING: NTP WARNING: Offset 0.278612107 secs
[08:18:07] <icinga-miraheze>	 PROBLEM - drowiki.com - LetsEncrypt on sslhost is CRITICAL: connect to address drowiki.com and port 443: Network is unreachableHTTP CRITICAL - Unable to open TCP socket
[08:18:46] <icinga-miraheze>	 RECOVERY - cp33 NTP time on cp33 is OK: NTP OK: Offset -0.03185886145 secs
[08:40:27] <icinga-miraheze>	 PROBLEM - en.religiononfire.mar.in.ua - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - en.religiononfire.mar.in.ua All nameservers failed to answer the query.
[08:48:07] <icinga-miraheze>	 PROBLEM - drowiki.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'drowiki.com' expires in 12 day(s) (Tue 25 Jul 2023 15:53:31 GMT +0000).
[09:07:48] <icinga-miraheze>	 PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.33, 4.11, 2.50
[09:09:43] <icinga-miraheze>	 RECOVERY - en.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - en.religiononfire.mar.in.ua reverse DNS resolves to cp22.miraheze.org - CNAME OK
[09:09:47] <icinga-miraheze>	 PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.68, 3.80, 2.57
[09:15:42] <icinga-miraheze>	 RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 0.74, 2.56, 2.48
[09:48:08] <icinga-miraheze>	 PROBLEM - drowiki.com - LetsEncrypt on sslhost is CRITICAL: connect to address drowiki.com and port 443: Network is unreachableHTTP CRITICAL - Unable to open TCP socket
[10:10:10] <icinga-miraheze>	 PROBLEM - en.religiononfire.mar.in.ua - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query en.religiononfire.mar.in.ua. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL
[10:13:48] <icinga-miraheze>	 PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.53, 3.49, 2.39
[10:15:46] <icinga-miraheze>	 RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 0.47, 2.41, 2.12
[10:37:18] <icinga-miraheze>	 PROBLEM - wiki.nj.cn.eu.org - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query cn.eu.org. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL
[10:37:25] <icinga-miraheze>	 PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.82, 2.73, 1.84
[10:39:24] <icinga-miraheze>	 PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.86, 3.23, 2.15
[10:41:22] <icinga-miraheze>	 RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.09, 2.40, 1.97
[11:03:54] <icinga-miraheze>	 PROBLEM - wiki.gab.pt.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.gab.pt.eu.org All nameservers failed to answer the query.
[11:06:28] <icinga-miraheze>	 PROBLEM - wiki.nj.cn.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.nj.cn.eu.org All nameservers failed to answer the query.
[11:14:34] <botifico-16655b7>	 [02miraheze/ImportDump] 07translatewiki pushed 031 commit to 03master [+1/-0/±0] 13https://github.com/miraheze/ImportDump/compare/6f2a482c5860...d7d4082ffafd
[11:14:37] <botifico-16655b7>	 [02miraheze/ImportDump] 07translatewiki 03d7d4082 - Localisation updates from https://translatewiki.net.
[11:14:39] <botifico-16655b7>	 [02miraheze/IncidentReporting] 07translatewiki pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/IncidentReporting/compare/21337373a869...d7727e8a9e3b
[11:14:40] <botifico-16655b7>	 [02miraheze/IncidentReporting] 07translatewiki 03d7727e8 - Localisation updates from https://translatewiki.net.
[11:14:42] <botifico-16655b7>	 [02miraheze/ManageWiki] 07translatewiki pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ManageWiki/compare/6f33a28904e1...3ef7b780eb05
[11:14:44] <botifico-16655b7>	 [02miraheze/ManageWiki] 07translatewiki 033ef7b78 - Localisation updates from https://translatewiki.net.
[11:14:46] <botifico-16655b7>	 [02miraheze/DataDump] 07translatewiki pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/DataDump/compare/6629b6040f5a...b75fa46ab146
[11:14:49] <botifico-16655b7>	 [02miraheze/DataDump] 07translatewiki 03b75fa46 - Localisation updates from https://translatewiki.net.
[11:14:52] <botifico-16655b7>	 [02miraheze/PDFEmbed] 07translatewiki pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/PDFEmbed/compare/95d4e0d53eeb...e90eb6aab590
[11:14:54] <botifico-16655b7>	 [02miraheze/PDFEmbed] 07translatewiki 03e90eb6a - Localisation updates from https://translatewiki.net.
[11:15:01] <botifico-16655b7>	 [02miraheze/SpriteSheet] 07translatewiki pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/SpriteSheet/compare/f87cf81af935...adce4c6874d9
[11:15:02] <botifico-16655b7>	 [02miraheze/SpriteSheet] 07translatewiki 03adce4c6 - Localisation updates from https://translatewiki.net.
[11:15:03] <botifico-16655b7>	 [02miraheze/MirahezeMagic] 07translatewiki pushed 031 commit to 03master [+0/-0/±2] 13https://github.com/miraheze/MirahezeMagic/compare/4d73da1df3ef...f512e0e7d52a
[11:15:04] <botifico-16655b7>	 [02miraheze/MirahezeMagic] 07translatewiki 03f512e0e - Localisation updates from https://translatewiki.net.
[11:15:07] <botifico-16655b7>	 [02miraheze/WikiDiscover] 07translatewiki pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/WikiDiscover/compare/905afde003d0...da808c789605
[11:15:08] <botifico-16655b7>	 [02miraheze/WikiDiscover] 07translatewiki 03da808c7 - Localisation updates from https://translatewiki.net.
[11:20:42] <miraheze-github>	 miraheze/IncidentReporting - translatewiki the build passed.
[11:20:46] <miraheze-github_>	 miraheze/DataDump - translatewiki the build passed.
[11:20:54] <miraheze-github_>	 miraheze/SpriteSheet - translatewiki the build passed.
[11:21:23] <miraheze-github>	 miraheze/PDFEmbed - translatewiki the build passed.
[11:21:50] <miraheze-github>	 miraheze/ManageWiki - translatewiki the build passed.
[11:26:18] <miraheze-github>	 miraheze/WikiDiscover - translatewiki the build passed.
[11:30:04] <icinga-miraheze>	 PROBLEM - cp22 NTP time on cp22 is WARNING: NTP WARNING: Offset 0.1125532091 secs
[11:33:40] <icinga-miraheze>	 PROBLEM - wiki.gab.pt.eu.org - reverse DNS on sslhost is WARNING: SSL WARNING - rDNS OK but records conflict. {'NS': ['ns.ankh.fr.eu.org.', 'ns1.eu.org.', 'ns1.eriomem.net.'], 'CNAME': 'bouncingwiki.miraheze.org.'}
[11:35:37] <icinga-miraheze>	 RECOVERY - wiki.nj.cn.eu.org - reverse DNS on sslhost is OK: SSL OK - wiki.nj.cn.eu.org reverse DNS resolves to cp22.miraheze.org - CNAME OK
[11:37:57] <icinga-miraheze>	 RECOVERY - en.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - en.religiononfire.mar.in.ua reverse DNS resolves to cp23.miraheze.org - CNAME OK
[11:39:29] <miraheze-github>	 miraheze/MirahezeMagic - translatewiki the build passed.
[11:39:39] <miraheze-github>	 miraheze/ImportDump - translatewiki the build passed.
[11:41:29] <icinga-miraheze>	 PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 9.96, 5.24, 2.79
[11:45:10] <icinga-miraheze>	 PROBLEM - cp32 HTTPS on cp32 is CRITICAL: CRITICAL - Socket timeout after 10 seconds
[11:45:22] <icinga-miraheze>	 PROBLEM - ns1 GDNSD Datacenters on ns1 is CRITICAL: CRITICAL - 1 datacenter is down: 2607:f1c0:1800:8100::1/cpweb
[11:45:23] <icinga-miraheze>	 PROBLEM - cp32 PowerDNS Recursor on cp32 is CRITICAL: CRITICAL - Plugin timed out while executing system call
[11:46:06] <icinga-miraheze>	 PROBLEM - cp32 SSH on cp32 is CRITICAL: CRITICAL - Socket timeout after 10 seconds
[11:47:08] <icinga-miraheze>	 RECOVERY - cp32 HTTPS on cp32 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 3734 bytes in 0.426 second response time
[11:47:19] <icinga-miraheze>	 RECOVERY - cp32 PowerDNS Recursor on cp32 is OK: DNS OK: 0.362 seconds response time. miraheze.org returns 108.175.15.182,2607:f1c0:1800:26f::1,2607:f1c0:1800:8100::1,74.208.203.152
[11:47:22] <icinga-miraheze>	 RECOVERY - ns1 GDNSD Datacenters on ns1 is OK: OK - all datacenters are online
[11:48:01] <icinga-miraheze>	 RECOVERY - cp32 SSH on cp32 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0)
[12:03:19] <icinga-miraheze>	 PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.34, 1.52, 3.75
[12:11:13] <icinga-miraheze>	 PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.75, 3.57, 3.76
[12:13:11] <icinga-miraheze>	 PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.37, 3.39, 3.67
[12:16:18] <icinga-miraheze>	 PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.33, 3.61, 2.68
[12:17:08] <icinga-miraheze>	 PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 10.61, 5.66, 4.43
[12:18:07] <icinga-miraheze>	 PROBLEM - drowiki.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'drowiki.com' expires in 12 day(s) (Tue 25 Jul 2023 15:53:31 GMT +0000).
[12:18:14] <icinga-miraheze>	 PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.70, 3.67, 2.81
[12:25:05] <icinga-miraheze>	 PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 0.85, 2.79, 3.68
[12:27:03] <icinga-miraheze>	 RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.11, 2.26, 3.38
[12:27:59] <icinga-miraheze>	 RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 3.29, 3.36, 3.05
[12:28:04] <icinga-miraheze>	 RECOVERY - cp22 NTP time on cp22 is OK: NTP OK: Offset 0.08363938332 secs
[12:35:43] <icinga-miraheze>	 PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.44, 3.37, 3.14
[12:37:40] <icinga-miraheze>	 RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 2.90, 3.16, 3.09
[12:38:57] <icinga-miraheze>	 PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 9.58, 4.77, 3.53
[12:41:30] <icinga-miraheze>	 PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.01, 3.74, 3.34
[12:43:27] <icinga-miraheze>	 PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.55, 3.56, 3.32
[12:45:27] <icinga-miraheze>	 RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 2.32, 3.13, 3.19
[12:48:07] <icinga-miraheze>	 PROBLEM - drowiki.com - LetsEncrypt on sslhost is CRITICAL: connect to address drowiki.com and port 443: Network is unreachableHTTP CRITICAL - Unable to open TCP socket
[12:56:52] <icinga-miraheze>	 PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.12, 1.86, 3.80
[12:58:50] <icinga-miraheze>	 RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 0.64, 1.43, 3.40
[13:12:47] <icinga-miraheze>	 PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 11.83, 7.50, 4.62
[13:16:43] <icinga-miraheze>	 PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.61, 3.91, 3.77
[13:17:16] <icinga-miraheze>	 PROBLEM - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - uk.religiononfire.mar.in.ua All nameservers failed to answer the query.
[13:18:41] <icinga-miraheze>	 RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 0.55, 2.79, 3.37
[13:37:08] <icinga-miraheze>	 PROBLEM - wiki.nj.cn.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.nj.cn.eu.org All nameservers failed to answer the query.
[13:41:36] <icinga-miraheze>	 PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.50, 4.32, 3.15
[13:43:34] <icinga-miraheze>	 PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.33, 3.99, 3.17
[13:45:32] <icinga-miraheze>	 PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.47, 4.44, 3.46
[13:47:05] <icinga-miraheze>	 PROBLEM - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query mar.in.ua. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL
[13:47:31] <icinga-miraheze>	 PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.83, 3.60, 3.27
[13:49:29] <icinga-miraheze>	 RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.14, 2.75, 3.00
[14:06:17] <icinga-miraheze>	 PROBLEM - wiki.nj.cn.eu.org - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query cn.eu.org. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL
[14:07:12] <icinga-miraheze>	 PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.10, 2.99, 2.36
[14:09:11] <icinga-miraheze>	 RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 3.17, 3.11, 2.48
[14:16:54] <icinga-miraheze>	 RECOVERY - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - uk.religiononfire.mar.in.ua reverse DNS resolves to cp22.miraheze.org - CNAME OK
[14:18:07] <icinga-miraheze>	 PROBLEM - drowiki.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'drowiki.com' expires in 12 day(s) (Tue 25 Jul 2023 15:53:31 GMT +0000).
[14:27:23] <icinga-miraheze>	 PROBLEM - wiki.andreijiroh.uk.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.andreijiroh.uk.eu.org All nameservers failed to answer the query.
[14:35:25] <icinga-miraheze>	 PROBLEM - wiki.nj.cn.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.nj.cn.eu.org All nameservers failed to answer the query.
[14:39:49] <icinga-miraheze>	 PROBLEM - mw142 Current Load on mw142 is CRITICAL: CRITICAL - load average: 11.73, 14.56, 9.09
[14:43:40] <icinga-miraheze>	 PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.35, 3.60, 2.57
[14:43:49] <icinga-miraheze>	 PROBLEM - mw142 Current Load on mw142 is WARNING: WARNING - load average: 7.32, 11.13, 8.93
[14:45:39] <icinga-miraheze>	 RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 0.99, 2.65, 2.34
[14:45:49] <icinga-miraheze>	 RECOVERY - mw142 Current Load on mw142 is OK: OK - load average: 3.89, 8.55, 8.24
[14:48:08] <icinga-miraheze>	 PROBLEM - drowiki.com - LetsEncrypt on sslhost is CRITICAL: connect to address drowiki.com and port 443: Network is unreachableHTTP CRITICAL - Unable to open TCP socket
[14:56:42] <icinga-miraheze>	 RECOVERY - wiki.andreijiroh.uk.eu.org - reverse DNS on sslhost is OK: SSL OK - wiki.andreijiroh.uk.eu.org reverse DNS resolves to cp23.miraheze.org - CNAME OK
[15:29:29] <icinga-miraheze>	 PROBLEM - wiki.danvs.net - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.danvs.net All nameservers failed to answer the query.
[15:34:14] <icinga-miraheze>	 PROBLEM - mercy.theking1543.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - mercy.theking1543.eu.org All nameservers failed to answer the query.
[15:35:08] <icinga-miraheze>	 PROBLEM - wiki.nj.cn.eu.org - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query cn.eu.org. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL
[15:58:22] <icinga-miraheze>	 RECOVERY - wiki.danvs.net - reverse DNS on sslhost is OK: SSL OK - wiki.danvs.net reverse DNS resolves to cp22.miraheze.org - CNAME OK
[16:04:02] <icinga-miraheze>	 PROBLEM - mercy.theking1543.eu.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for mercy.theking1543.eu.org could not be found
[16:05:09] <icinga-miraheze>	 PROBLEM - wiki.nj.cn.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.nj.cn.eu.org All nameservers failed to answer the query.
[16:07:24] <icinga-miraheze>	 PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 6.01, 6.39, 3.74
[16:11:20] <icinga-miraheze>	 PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.44, 3.90, 3.32
[16:13:19] <icinga-miraheze>	 RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.02, 2.90, 3.02
[16:18:07] <icinga-miraheze>	 PROBLEM - drowiki.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'drowiki.com' expires in 11 day(s) (Tue 25 Jul 2023 15:53:31 GMT +0000).
[16:38:55] <icinga-miraheze>	 PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.63, 3.73, 2.65
[16:42:38] <icinga-miraheze>	 PROBLEM - cloud12 Puppet on cloud12 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[ulogd2]
[16:42:51] <icinga-miraheze>	 PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.22, 3.50, 2.83
[16:44:50] <icinga-miraheze>	 RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.29, 2.73, 2.63
[16:48:07] <icinga-miraheze>	 PROBLEM - drowiki.com - LetsEncrypt on sslhost is CRITICAL: connect to address drowiki.com and port 443: Network is unreachableHTTP CRITICAL - Unable to open TCP socket
[17:02:40] <icinga-miraheze>	 PROBLEM - mw133 Current Load on mw133 is CRITICAL: CRITICAL - load average: 14.84, 12.38, 7.48
[17:04:37] <icinga-miraheze>	 RECOVERY - mw133 Current Load on mw133 is OK: OK - load average: 6.12, 9.97, 7.18
[17:10:38] <icinga-miraheze>	 RECOVERY - cloud12 Puppet on cloud12 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures
[17:13:23] <icinga-miraheze>	 PROBLEM - en.religiononfire.mar.in.ua - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - en.religiononfire.mar.in.ua All nameservers failed to answer the query.
[17:28:07] <icinga-miraheze>	 PROBLEM - wiki.andreijiroh.uk.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.andreijiroh.uk.eu.org All nameservers failed to answer the query.
[17:42:39] <icinga-miraheze>	 RECOVERY - en.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - en.religiononfire.mar.in.ua reverse DNS resolves to cp22.miraheze.org - CNAME OK
[17:57:26] <icinga-miraheze>	 RECOVERY - wiki.andreijiroh.uk.eu.org - reverse DNS on sslhost is OK: SSL OK - wiki.andreijiroh.uk.eu.org reverse DNS resolves to cp23.miraheze.org - CNAME OK
[18:05:10] <icinga-miraheze>	 PROBLEM - wiki.nj.cn.eu.org - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query cn.eu.org. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL
[18:08:52] <icinga-miraheze>	 PROBLEM - njtelimination.ml - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'njtelimination.ml' expires in 15 day(s) (Sat 29 Jul 2023 18:02:20 GMT +0000).
[18:10:15] <botifico-16655b7>	 [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/e1dc2ddda38b...86febf124e25
[18:10:18] <botifico-16655b7>	 [02miraheze/ssl] 07MirahezeSSLBot 0386febf1 - Bot: Update SSL cert for njtelimination.ml
[18:13:27] <icinga-miraheze>	 PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.89, 3.26, 2.47
[18:18:56] <icinga-miraheze>	 RECOVERY - cloud11 IPMI Sensors on cloud11 is OK: IPMI Status: OK
[18:19:27] <icinga-miraheze>	 RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 2.69, 3.03, 2.63
[18:20:42] <botifico-16655b7>	 [02miraheze/CreateWiki] 07paladox pushed 031 commit to 03paladox-patch-2 [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/commit/a27e9440d491
[18:20:43] <botifico-16655b7>	 [02miraheze/CreateWiki] 07paladox 03a27e944 - Don’t use CreateWikiUseSecureContainers
[18:20:45] <botifico-16655b7>	 [02CreateWiki] 07paladox created branch 03paladox-patch-2 - 13https://github.com/miraheze/CreateWiki
[18:20:46] <botifico-16655b7>	 [02CreateWiki] 07paladox opened pull request 03#423: Don’t use CreateWikiUseSecureContainers - 13https://github.com/miraheze/CreateWiki/pull/423
[18:20:53] <botifico-16655b7>	 [02miraheze/CreateWiki] 07The-Voidwalker pushed 031 commit to 03The-Voidwalker-patch-1 [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/commit/33b188f73af7
[18:20:54] <botifico-16655b7>	 [02miraheze/CreateWiki] 07The-Voidwalker 0333b188f - RemoteWiki: support CreateWikiContainers
[18:20:57] <botifico-16655b7>	 [02CreateWiki] 07The-Voidwalker created branch 03The-Voidwalker-patch-1 - 13https://github.com/miraheze/CreateWiki
[18:21:01] <botifico-16655b7>	 [02CreateWiki] 07The-Voidwalker opened pull request 03#424: RemoteWiki: support CreateWikiContainers - 13https://github.com/miraheze/CreateWiki/pull/424
[18:22:50] <icinga-miraheze>	 PROBLEM - cloud11 IPMI Sensors on cloud11 is CRITICAL: IPMI Status: Critical [Cntlr 2 Bay 8 = Critical]
[18:25:54] <botifico-16655b7>	 [02miraheze/CreateWiki] 07The-Voidwalker pushed 031 commit to 03The-Voidwalker-patch-1 [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/33b188f73af7...19ff91fcf7dd
[18:25:57] <botifico-16655b7>	 [02miraheze/CreateWiki] 07The-Voidwalker 0319ff91f - setContainersAccess: update docs
[18:25:58] <botifico-16655b7>	 [02CreateWiki] 07The-Voidwalker synchronize pull request 03#424: RemoteWiki: support CreateWikiContainers - 13https://github.com/miraheze/CreateWiki/pull/424
[18:26:45] <botifico-16655b7>	 [02CreateWiki] 07The-Voidwalker commented on pull request 03#423: Don’t use CreateWikiUseSecureContainers - 13https://github.com/miraheze/CreateWiki/pull/423#issuecomment-1634705254
[18:26:47] <botifico-16655b7>	 [02CreateWiki] 07The-Voidwalker closed pull request 03#423: Don’t use CreateWikiUseSecureContainers - 13https://github.com/miraheze/CreateWiki/pull/423
[18:27:56] <botifico-16655b7>	 [02miraheze/CreateWiki] 07The-Voidwalker pushed 031 commit to 03The-Voidwalker-patch-1 [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/19ff91fcf7dd...d76dca82881e
[18:27:58] <botifico-16655b7>	 [02miraheze/CreateWiki] 07The-Voidwalker 03d76dca8 - WikiManagerTest: remove CreateWikiUseSecureContainers
[18:28:00] <botifico-16655b7>	 [02CreateWiki] 07The-Voidwalker synchronize pull request 03#424: RemoteWiki: support CreateWikiContainers - 13https://github.com/miraheze/CreateWiki/pull/424
[18:28:31] <botifico-16655b7>	 [02miraheze/CreateWiki] 07The-Voidwalker pushed 031 commit to 03The-Voidwalker-patch-1 [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/d76dca82881e...7dfd6ae2a5fa
[18:28:33] <botifico-16655b7>	 [02miraheze/CreateWiki] 07The-Voidwalker 037dfd6ae - RemoteWikiTest: remove CreateWikiUseSecureContainers
[18:28:36] <botifico-16655b7>	 [02CreateWiki] 07The-Voidwalker synchronize pull request 03#424: RemoteWiki: support CreateWikiContainers - 13https://github.com/miraheze/CreateWiki/pull/424
[18:29:03] <botifico-16655b7>	 [02miraheze/CreateWiki] 07The-Voidwalker deleted branch 03paladox-patch-2
[18:29:04] <botifico-16655b7>	 [02CreateWiki] 07The-Voidwalker deleted branch 03paladox-patch-2 - 13https://github.com/miraheze/CreateWiki
[18:31:56] <botifico-16655b7>	 [02CreateWiki] 07The-Voidwalker edited pull request 03#424: Remove use of CreateWikiUseSecureContainers - 13https://github.com/miraheze/CreateWiki/pull/424
[18:35:09] <icinga-miraheze>	 PROBLEM - wiki.nj.cn.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.nj.cn.eu.org All nameservers failed to answer the query.
[18:37:09] <icinga-miraheze>	 PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.87, 3.51, 2.45
[18:39:08] <icinga-miraheze>	 RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.45, 3.11, 2.43
[18:41:27] <icinga-miraheze>	 PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.14, 3.49, 3.07
[18:43:07] <icinga-miraheze>	 PROBLEM - en.religiononfire.mar.in.ua - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - en.religiononfire.mar.in.ua All nameservers failed to answer the query.
[18:43:27] <icinga-miraheze>	 RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 3.07, 3.28, 3.04
[18:44:59] <miraheze-github>	 miraheze/CreateWiki - paladox the build passed.
[18:53:21] <miraheze-github>	 miraheze/CreateWiki - The-Voidwalker the build passed.
[18:54:00] <icinga-miraheze>	 PROBLEM - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query mar.in.ua. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL
[18:59:47] <icinga-miraheze>	 PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.77, 2.94, 2.29
[19:01:45] <icinga-miraheze>	 RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.24, 2.24, 2.11
[19:05:09] <icinga-miraheze>	 PROBLEM - wiki.nj.cn.eu.org - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query cn.eu.org. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL
[19:07:37] <icinga-miraheze>	 RECOVERY - njtelimination.ml - LetsEncrypt on sslhost is OK: OK - Certificate 'njtelimination.ml' will expire on Wed 11 Oct 2023 17:10:00 GMT +0000.
[19:10:22] <botifico-16655b7>	 [02CreateWiki] 07The-Voidwalker closed pull request 03#424: Remove use of CreateWikiUseSecureContainers - 13https://github.com/miraheze/CreateWiki/pull/424
[19:10:24] <botifico-16655b7>	 [02miraheze/CreateWiki] 07The-Voidwalker pushed 031 commit to 03master [+0/-0/±4] 13https://github.com/miraheze/CreateWiki/compare/e9a76fb27ac5...851b07ab84cd
[19:10:27] <botifico-16655b7>	 [02miraheze/CreateWiki] 07The-Voidwalker 03851b07a - Remove use of CreateWikiUseSecureContainers (#424)
[19:10:30] <botifico-16655b7>	 [02miraheze/CreateWiki] 07The-Voidwalker deleted branch 03The-Voidwalker-patch-1
[19:10:32] <botifico-16655b7>	 [02CreateWiki] 07The-Voidwalker deleted branch 03The-Voidwalker-patch-1 - 13https://github.com/miraheze/CreateWiki
[19:12:23] <icinga-miraheze>	 PROBLEM - en.religiononfire.mar.in.ua - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query en.religiononfire.mar.in.ua. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL
[19:13:02] <botifico-16655b7>	 [02miraheze/mediawiki] 07The-Voidwalker pushed 031 commit to 03REL1_39 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/ef6528e5410f...326c9d12b092
[19:13:04] <botifico-16655b7>	 [02miraheze/mediawiki] 07The-Voidwalker 03326c9d1 - update CreateWiki
[19:18:33] <MirahezeLSBot>	 !log [void@mwtask141] starting deploy of {'world': True, 'l10n': True} to all
[19:18:38] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[19:23:49] <icinga-miraheze>	 RECOVERY - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - uk.religiononfire.mar.in.ua reverse DNS resolves to cp22.miraheze.org - CNAME OK
[19:24:55] <MirahezeLSBot>	 !log [void@mwtask141] DEPLOY ABORTED: Canary check failed for publictestwiki.com@mw134.miraheze.org
[19:25:00] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[19:25:52] <MirahezeLSBot>	 !log [void@mwtask141] starting deploy of {'world': True, 'l10n': True, 'force': True} to all
[19:25:59] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[19:27:22] <icinga-miraheze>	 PROBLEM - wiki.andreijiroh.uk.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.andreijiroh.uk.eu.org All nameservers failed to answer the query.
[19:32:19] <MirahezeLSBot>	 !log [void@mwtask141] finished deploy of {'world': True, 'l10n': True, 'force': True} to all - SUCCESS in 386s
[19:32:24] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[19:33:26] <miraheze-github>	 miraheze/CreateWiki - The-Voidwalker the build passed.
[19:34:20] <MirahezeRelay>	 <orduin> Huh, mw134 seems to be down?
[19:38:12] <icinga-miraheze>	 PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.23, 3.89, 2.70
[19:40:10] <icinga-miraheze>	 PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.42, 3.95, 2.88
[19:41:38] <icinga-miraheze>	 PROBLEM - en.religiononfire.mar.in.ua - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - en.religiononfire.mar.in.ua All nameservers failed to answer the query.
[19:42:08] <icinga-miraheze>	 PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.88, 4.53, 3.24
[19:44:07] <icinga-miraheze>	 PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.82, 3.73, 3.09
[19:46:05] <icinga-miraheze>	 RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.87, 3.10, 2.94
[19:56:10] <paladox>	 @orduin try a reboot
[19:56:44] <icinga-miraheze>	 PROBLEM - wiki.andreijiroh.uk.eu.org - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query uk.eu.org. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL
[19:57:29] <MirahezeRelay>	 <orduin> Will try, but seems to be a php-adjacent issue
[20:00:30] <icinga-miraheze>	 RECOVERY - mw134 MediaWiki Rendering on mw134 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 4.919 second response time
[20:03:09] <MirahezeRelay>	 <orduin> I see some spooky lines in php error.log "execution timed out (163240.815300 sec)"
[20:04:22] <icinga-miraheze>	 RECOVERY - cp33 Varnish Backends on cp33 is OK: All 15 backends are healthy
[20:04:27] <icinga-miraheze>	 RECOVERY - cp32 Varnish Backends on cp32 is OK: All 15 backends are healthy
[20:04:55] <icinga-miraheze>	 RECOVERY - cp22 Varnish Backends on cp22 is OK: All 15 backends are healthy
[20:05:08] <icinga-miraheze>	 PROBLEM - wiki.nj.cn.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.nj.cn.eu.org All nameservers failed to answer the query.
[20:05:47] <icinga-miraheze>	 RECOVERY - cp23 Varnish Backends on cp23 is OK: All 15 backends are healthy
[20:07:41] <MirahezeLSBot>	 !log [void@mw134] reboot mw134 (issues with php)
[20:07:45] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[20:08:05] <MirahezeRelay>	 <paladox, replying to orduin> Interesting
[20:08:13] <MirahezeRelay>	 <paladox> Weird how the timeout didn’t kick in
[20:08:22] <MirahezeRelay>	 <orduin> Will monitor, but seems to be improved
[20:09:12] <MirahezeRelay>	 <orduin> Looks like the next big thing to look at (according to icinga) is SSL
[20:10:54] <icinga-miraheze>	 PROBLEM - en.religiononfire.mar.in.ua - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query mar.in.ua. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL
[20:15:38] <MirahezeRelay>	 <zppix, replying to orduin> I have a pr for ssl pending too
[20:26:03] <icinga-miraheze>	 PROBLEM - wiki.andreijiroh.uk.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.andreijiroh.uk.eu.org All nameservers failed to answer the query.
[20:37:20] <icinga-miraheze>	 PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.97, 4.33, 2.65
[20:39:19] <icinga-miraheze>	 PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.66, 3.78, 2.65
[20:43:16] <icinga-miraheze>	 RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.16, 2.63, 2.47
[20:55:24] <icinga-miraheze>	 RECOVERY - wiki.andreijiroh.uk.eu.org - reverse DNS on sslhost is OK: SSL OK - wiki.andreijiroh.uk.eu.org reverse DNS resolves to cp23.miraheze.org - CNAME OK
[21:24:46] <icinga-miraheze>	 PROBLEM - cp33 NTP time on cp33 is WARNING: NTP WARNING: Offset 0.2077737749 secs
[21:48:46] <icinga-miraheze>	 RECOVERY - cp33 NTP time on cp33 is OK: NTP OK: Offset -0.02410748601 secs
[22:02:33] <icinga-miraheze>	 PROBLEM - mw133 Current Load on mw133 is WARNING: WARNING - load average: 7.74, 11.48, 7.32
[22:04:33] <icinga-miraheze>	 RECOVERY - mw133 Current Load on mw133 is OK: OK - load average: 3.18, 8.55, 6.75
[22:05:10] <icinga-miraheze>	 RECOVERY - wiki.nj.cn.eu.org - reverse DNS on sslhost is OK: SSL OK - wiki.nj.cn.eu.org reverse DNS resolves to cp22.miraheze.org - CNAME OK
[22:06:41] <icinga-miraheze>	 PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 7.18, 3.66, 2.23
[22:08:40] <icinga-miraheze>	 RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.73, 2.89, 2.12
[22:22:46] <icinga-miraheze>	 PROBLEM - wiki.zulaclub.net - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query wiki.zulaclub.net. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL
[22:48:07] <icinga-miraheze>	 PROBLEM - drowiki.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'drowiki.com' expires in 11 day(s) (Tue 25 Jul 2023 15:53:31 GMT +0000).
[22:52:32] <icinga-miraheze>	 RECOVERY - wiki.zulaclub.net - reverse DNS on sslhost is OK: SSL OK - wiki.zulaclub.net reverse DNS resolves to cp22.miraheze.org - CNAME OK
[22:53:00] <icinga-miraheze>	 PROBLEM - cp32 NTP time on cp32 is WARNING: NTP WARNING: Offset 0.1956923604 secs
[23:06:46] <icinga-miraheze>	 RECOVERY - en.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - en.religiononfire.mar.in.ua reverse DNS resolves to cp23.miraheze.org - CNAME OK
[23:08:15] <icinga-miraheze>	 PROBLEM - wiki.nj.cn.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.nj.cn.eu.org All nameservers failed to answer the query.
[23:17:00] <icinga-miraheze>	 RECOVERY - cp32 NTP time on cp32 is OK: NTP OK: Offset -0.02306628227 secs
[23:18:07] <icinga-miraheze>	 PROBLEM - drowiki.com - LetsEncrypt on sslhost is CRITICAL: connect to address drowiki.com and port 443: Network is unreachableHTTP CRITICAL - Unable to open TCP socket
[23:57:15] <icinga-miraheze>	 PROBLEM - wiki.rebirthofthenight.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.rebirthofthenight.com could not be found
[23:58:53] <icinga-miraheze>	 PROBLEM - wiki.rebirthofthenight.com - LetsEncrypt on sslhost is CRITICAL: connect to address wiki.rebirthofthenight.com and port 443: Network is unreachableHTTP CRITICAL - Unable to open TCP socket