[00:17:06] <icinga-miraheze>	 PROBLEM - wiki.mineplay.nl - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.mineplay.nl' expires in 15 day(s) (Tue 21 May 2024 12:00:10 AM GMT +0000).
[00:39:48] <botifico>	 [02miraheze/RemovePII] 07Universal-Omega pushed 031 commit to 03improve [+0/-0/±1] 13https://github.com/miraheze/RemovePII/commit/7ca8b7083760
[00:39:50] <botifico>	 [02miraheze/RemovePII] 07Universal-Omega 037ca8b70 - Improvements to RemovePII
[00:39:51] <botifico>	 [02RemovePII] 07Universal-Omega created branch 03improve - 13https://github.com/miraheze/RemovePII
[00:39:55] <botifico>	 [02RemovePII] 07Universal-Omega opened pull request 03#84: Improvements to RemovePII - 13https://github.com/miraheze/RemovePII/pull/84
[00:42:11] <botifico>	 [02RemovePII] 07Universal-Omega edited pull request 03#84: Improvements to RemovePII - 13https://github.com/miraheze/RemovePII/pull/84
[00:42:29] <botifico>	 [02RemovePII] 07Universal-Omega edited pull request 03#84: Improvements to RemovePII - 13https://github.com/miraheze/RemovePII/pull/84
[00:43:35] <botifico>	 [02RemovePII] 07Universal-Omega edited pull request 03#84: Improvements to RemovePII - 13https://github.com/miraheze/RemovePII/pull/84
[00:48:19] <miraheze-github>	 miraheze/RemovePII - Universal-Omega the build passed.
[01:07:55] <botifico>	 [02landing] 07colleirose closed pull request 03#146: Use JSDelivr for CSS and JS files - 13https://github.com/miraheze/landing/pull/146
[01:07:58] <botifico>	 [02landing] 07colleirose commented on pull request 03#146: Use JSDelivr for CSS and JS files - 13https://github.com/miraheze/landing/pull/146#issuecomment-2094532218
[01:53:39] <icinga-miraheze>	 PROBLEM - ping6 on cp51 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 168.51 ms
[01:55:42] <icinga-miraheze>	 RECOVERY - ping6 on cp51 is OK: PING OK - Packet loss = 0%, RTA = 175.71 ms
[01:56:27] <icinga-miraheze>	 PROBLEM - private.yahyabd.xyz - reverse DNS on sslhost is WARNING: LifetimeTimeout: The resolution lifetime expired after 5.405 seconds: Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.
[02:09:09] <icinga-miraheze>	 PROBLEM - wiki.yahyabd.xyz - reverse DNS on sslhost is WARNING: LifetimeTimeout: The resolution lifetime expired after 5.404 seconds: Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.
[02:37:02] <icinga-miraheze>	 PROBLEM - ping6 on cp51 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 168.73 ms
[02:39:05] <icinga-miraheze>	 RECOVERY - ping6 on cp51 is OK: PING OK - Packet loss = 0%, RTA = 175.23 ms
[02:56:26] <icinga-miraheze>	 PROBLEM - private.yahyabd.xyz - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - private.yahyabd.xyz All nameservers failed to answer the query.
[03:00:15] <icinga-miraheze>	 RECOVERY - db161 Backups SQL on db161 is OK: FILE_AGE OK: /var/log/sql-backup.log is 13 seconds old and 0 bytes
[03:01:42] <icinga-miraheze>	 RECOVERY - db181 Backups SQL on db181 is OK: FILE_AGE OK: /var/log/sql-backup.log is 101 seconds old and 0 bytes
[03:03:38] <icinga-miraheze>	 PROBLEM - mon181 Backups Grafana on mon181 is WARNING: FILE_AGE WARNING: /var/log/grafana-backup.log is 864198 seconds old and 93 bytes
[03:09:08] <icinga-miraheze>	 PROBLEM - wiki.yahyabd.xyz - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.yahyabd.xyz All nameservers failed to answer the query.
[03:13:02] <icinga-miraheze>	 PROBLEM - ping6 on cp51 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 171.60 ms
[03:15:05] <icinga-miraheze>	 RECOVERY - ping6 on cp51 is OK: PING OK - Packet loss = 0%, RTA = 168.03 ms
[03:26:28] <icinga-miraheze>	 PROBLEM - private.yahyabd.xyz - reverse DNS on sslhost is WARNING: LifetimeTimeout: The resolution lifetime expired after 5.404 seconds: Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.
[03:34:43] <icinga-miraheze>	 PROBLEM - ping6 on cp51 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 171.32 ms
[03:36:46] <icinga-miraheze>	 RECOVERY - ping6 on cp51 is OK: PING OK - Packet loss = 0%, RTA = 172.75 ms
[04:09:09] <icinga-miraheze>	 PROBLEM - wiki.yahyabd.xyz - reverse DNS on sslhost is WARNING: LifetimeTimeout: The resolution lifetime expired after 5.405 seconds: Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.
[04:37:21] <icinga-miraheze>	 PROBLEM - wiki.mahdiruiz.line.pm - reverse DNS on sslhost is WARNING: LifetimeTimeout: The resolution lifetime expired after 5.405 seconds: Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.
[04:39:07] <icinga-miraheze>	 PROBLEM - wiki.yahyabd.xyz - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.yahyabd.xyz All nameservers failed to answer the query.
[05:26:26] <icinga-miraheze>	 PROBLEM - private.yahyabd.xyz - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - private.yahyabd.xyz All nameservers failed to answer the query.
[05:35:32] <icinga-miraheze>	 RECOVERY - wiki.mahdiruiz.line.pm - reverse DNS on sslhost is OK: SSL OK - wiki.mahdiruiz.line.pm reverse DNS resolves to cp36.wikitide.net - CNAME OK
[06:00:14] <icinga-miraheze>	 RECOVERY - swiftac171 Backups Swift Account Container on swiftac171 is OK: FILE_AGE OK: /var/log/swift-account-container-backup.log is 12 seconds old and 0 bytes
[06:01:19] <icinga-miraheze>	 RECOVERY - puppet181 Backups SSLKeys on puppet181 is OK: FILE_AGE OK: /var/log/sslkeys-backup.log is 65 seconds old and 93 bytes
[06:05:43] <icinga-miraheze>	 PROBLEM - ping6 on cp51 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 169.35 ms
[06:09:50] <icinga-miraheze>	 RECOVERY - ping6 on cp51 is OK: PING OK - Packet loss = 0%, RTA = 170.89 ms
[07:32:51] <icinga-miraheze>	 PROBLEM - mw171 MediaWiki Rendering on mw171 is CRITICAL: CRITICAL - Socket timeout after 10 seconds
[07:32:54] <icinga-miraheze>	 PROBLEM - mw171 HTTPS on mw171 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10006 milliseconds with 0 bytes received
[07:33:15] <icinga-miraheze>	 PROBLEM - cp41 Varnish Backends on cp41 is CRITICAL: 1 backends are down. mw171
[07:33:29] <icinga-miraheze>	 PROBLEM - cp26 Varnish Backends on cp26 is CRITICAL: 1 backends are down. mw171
[07:33:35] <icinga-miraheze>	 PROBLEM - cp37 Varnish Backends on cp37 is CRITICAL: 1 backends are down. mw171
[07:34:08] <icinga-miraheze>	 PROBLEM - cp51 Varnish Backends on cp51 is CRITICAL: 1 backends are down. mw171
[07:34:49] <icinga-miraheze>	 RECOVERY - mw171 MediaWiki Rendering on mw171 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.303 second response time
[07:34:50] <icinga-miraheze>	 RECOVERY - mw171 HTTPS on mw171 is OK: HTTP OK: HTTP/2 404 - Status line output matched "HTTP/2 404" - 286 bytes in 0.065 second response time
[07:35:15] <icinga-miraheze>	 RECOVERY - cp41 Varnish Backends on cp41 is OK: All 19 backends are healthy
[07:35:29] <icinga-miraheze>	 RECOVERY - cp26 Varnish Backends on cp26 is OK: All 19 backends are healthy
[07:35:35] <icinga-miraheze>	 RECOVERY - cp37 Varnish Backends on cp37 is OK: All 19 backends are healthy
[07:36:09] <icinga-miraheze>	 RECOVERY - cp51 Varnish Backends on cp51 is OK: All 19 backends are healthy
[08:38:29] <icinga-miraheze>	 PROBLEM - ping6 on cp51 is CRITICAL: PING CRITICAL - Packet loss = 28%, RTA = 170.31 ms
[08:40:32] <icinga-miraheze>	 RECOVERY - ping6 on cp51 is OK: PING OK - Packet loss = 0%, RTA = 172.18 ms
[08:40:59] <MirahezeLSBot>	 !log [alex@test151] sudo -u www-data php /srv/mediawiki/1.42/maintenance/run.php /srv/mediawiki/1.42/extensions/CreateWiki/maintenance/deleteWiki.php --wiki=metawikibeta --deleteWiki=requestssltestwiki --delete (END - exit=256)
[08:41:03] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[08:41:20] <MirahezeLSBot>	 !log [alex@test151] sudo -u www-data php /srv/mediawiki/1.42/maintenance/run.php /srv/mediawiki/1.42/extensions/CreateWiki/maintenance/deleteWiki.php --wiki=metawikibeta --deleteWiki requestssltestwiki --delete (END - exit=256)
[08:41:23] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[08:41:31] <MirahezeLSBot>	 !log [alex@test151] sudo -u www-data php /srv/mediawiki/1.42/maintenance/run.php /srv/mediawiki/1.42/extensions/CreateWiki/maintenance/deleteWiki.php --wiki=metawikibeta --deleteWiki requestssltestwikibeta --delete (END - exit=256)
[08:41:35] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[08:42:06] <MirahezeLSBot>	 !log [alex@test151] sudo -u www-data php /srv/mediawiki/1.42/maintenance/run.php /srv/mediawiki/1.42/extensions/CreateWiki/maintenance/deleteWiki.php --wiki=metawikibeta --deletewiki requestssltestwikibeta --delete (END - exit=0)
[08:42:10] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[08:43:06] <MirahezeRelay>	 <bluemoon0332> !log db161: DROP DATABASE requestssltestwikibeta;
[08:43:10] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[08:44:57] <MirahezeRelay>	 <bluemoon0332> test run of wiki recreations complete
[08:53:01] <icinga-miraheze>	 PROBLEM - ping6 on cp51 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 172.19 ms
[08:55:04] <icinga-miraheze>	 RECOVERY - ping6 on cp51 is OK: PING OK - Packet loss = 0%, RTA = 169.79 ms
[09:10:32] <icinga-miraheze>	 PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 152.93 ms
[09:12:35] <icinga-miraheze>	 RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 152.24 ms
[09:47:50] <icinga-miraheze>	 PROBLEM - ping6 on cp51 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 170.80 ms
[09:49:53] <icinga-miraheze>	 RECOVERY - ping6 on cp51 is OK: PING OK - Packet loss = 0%, RTA = 172.70 ms
[10:05:28] <icinga-miraheze>	 PROBLEM - ping6 on cp51 is CRITICAL: PING CRITICAL - Packet loss = 37%, RTA = 171.06 ms
[10:07:31] <icinga-miraheze>	 RECOVERY - ping6 on cp51 is OK: PING OK - Packet loss = 0%, RTA = 170.65 ms
[10:12:33] <icinga-miraheze>	 PROBLEM - wiki.andreijiroh.uk.eu.org - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query uk.eu.org. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL
[10:42:22] <icinga-miraheze>	 RECOVERY - wiki.andreijiroh.uk.eu.org - reverse DNS on sslhost is OK: SSL OK - wiki.andreijiroh.uk.eu.org reverse DNS resolves to cp37.wikitide.net - CNAME OK
[11:28:12] <icinga-miraheze>	 PROBLEM - ping6 on cp51 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 171.68 ms
[11:28:39] <icinga-miraheze>	 PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 28%, RTA = 148.25 ms
[11:30:42] <icinga-miraheze>	 RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 145.07 ms
[11:32:43] <icinga-miraheze>	 PROBLEM - www.tintinpedia.fr - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'tintinpedia.fr' expires in 15 day(s) (Tue 21 May 2024 11:22:47 AM GMT +0000).
[11:32:46] <icinga-miraheze>	 PROBLEM - tintinpedia.fr - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'tintinpedia.fr' expires in 15 day(s) (Tue 21 May 2024 11:22:47 AM GMT +0000).
[11:33:01] <botifico>	 [02miraheze/ssl] 07WikiTideSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/b58955137aab...0b4fda97c56d
[11:33:02] <botifico>	 [02miraheze/ssl] 07WikiTideSSLBot 030b4fda9 - Bot: Update SSL cert for tintinpedia.fr
[11:36:27] <icinga-miraheze>	 RECOVERY - ping6 on cp51 is OK: PING OK - Packet loss = 0%, RTA = 169.38 ms
[11:44:05] <icinga-miraheze>	 PROBLEM - www.burnout.wiki - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'burnout.wiki' expires in 15 day(s) (Tue 21 May 2024 11:31:43 AM GMT +0000).
[11:56:44] <icinga-miraheze>	 PROBLEM - kingdomdeath.wiki - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'kingdomdeath.wiki' expires in 15 day(s) (Tue 21 May 2024 11:47:41 AM GMT +0000).
[11:56:58] <botifico>	 [02miraheze/ssl] 07WikiTideSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/0b4fda97c56d...84051374c04f
[11:57:00] <icinga-miraheze>	 PROBLEM - burnout.wiki - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'burnout.wiki' expires in 15 day(s) (Tue 21 May 2024 11:31:43 AM GMT +0000).
[11:57:01] <botifico>	 [02miraheze/ssl] 07WikiTideSSLBot 038405137 - Bot: Update SSL cert for kingdomdeath.wiki
[11:57:15] <botifico>	 [02miraheze/ssl] 07WikiTideSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/84051374c04f...0967f475ce29
[11:57:17] <botifico>	 [02miraheze/ssl] 07WikiTideSSLBot 030967f47 - Bot: Update SSL cert for burnout.wiki
[12:01:56] <icinga-miraheze>	 RECOVERY - www.tintinpedia.fr - LetsEncrypt on sslhost is OK: OK - Certificate 'tintinpedia.fr' will expire on Sat 03 Aug 2024 10:32:55 AM GMT +0000.
[12:02:03] <icinga-miraheze>	 RECOVERY - tintinpedia.fr - LetsEncrypt on sslhost is OK: OK - Certificate 'tintinpedia.fr' will expire on Sat 03 Aug 2024 10:32:55 AM GMT +0000.
[12:13:16] <icinga-miraheze>	 PROBLEM - wiki.hspdev.0t0.jp - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.hspdev.0t0.jp' expires in 15 day(s) (Tue 21 May 2024 11:56:01 AM GMT +0000).
[12:13:27] <botifico>	 [02miraheze/ssl] 07WikiTideSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/0967f475ce29...03b5739aa162
[12:13:29] <botifico>	 [02miraheze/ssl] 07WikiTideSSLBot 0303b5739 - Bot: Update SSL cert for wiki.hspdev.0t0.jp
[12:20:56] <icinga-miraheze>	 PROBLEM - ping6 on cp51 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 171.44 ms
[12:22:59] <icinga-miraheze>	 RECOVERY - ping6 on cp51 is OK: PING OK - Packet loss = 0%, RTA = 171.02 ms
[12:24:11] <icinga-miraheze>	 PROBLEM - wiki.corgicam.tv - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.corgicam.tv' expires in 15 day(s) (Tue 21 May 2024 12:01:13 PM GMT +0000).
[12:24:22] <botifico>	 [02miraheze/ssl] 07WikiTideSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/03b5739aa162...ad53990cab09
[12:24:23] <botifico>	 [02miraheze/ssl] 07WikiTideSSLBot 03ad53990 - Bot: Update SSL cert for wiki.corgicam.tv
[12:25:57] <icinga-miraheze>	 RECOVERY - kingdomdeath.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'kingdomdeath.wiki' will expire on Sat 03 Aug 2024 10:56:52 AM GMT +0000.
[12:26:27] <icinga-miraheze>	 PROBLEM - private.yahyabd.xyz - reverse DNS on sslhost is WARNING: LifetimeTimeout: The resolution lifetime expired after 5.404 seconds: Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.
[12:26:29] <icinga-miraheze>	 RECOVERY - burnout.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'burnout.wiki' will expire on Sat 03 Aug 2024 10:57:09 AM GMT +0000.
[12:32:44] <icinga-miraheze>	 PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 136.65 ms
[12:34:02] <icinga-miraheze>	 PROBLEM - cp51 Puppet on cp51 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[nginx]
[12:34:47] <icinga-miraheze>	 RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 139.08 ms
[12:42:06] <icinga-miraheze>	 RECOVERY - www.burnout.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'burnout.wiki' will expire on Sat 03 Aug 2024 10:57:09 AM GMT +0000.
[12:43:36] <icinga-miraheze>	 PROBLEM - wiki.andreijiroh.uk.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.andreijiroh.uk.eu.org All nameservers failed to answer the query.
[12:46:57] <icinga-miraheze>	 PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2407:3641:2161:9774::1/cpweb
[12:48:54] <icinga-miraheze>	 RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online
[12:53:51] <icinga-miraheze>	 RECOVERY - wiki.corgicam.tv - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.corgicam.tv' will expire on Sat 03 Aug 2024 11:24:17 AM GMT +0000.
[13:01:58] <icinga-miraheze>	 RECOVERY - cp51 Puppet on cp51 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures
[13:09:09] <icinga-miraheze>	 PROBLEM - wiki.yahyabd.xyz - reverse DNS on sslhost is WARNING: LifetimeTimeout: The resolution lifetime expired after 5.404 seconds: Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.
[13:11:48] <icinga-miraheze>	 RECOVERY - wiki.hspdev.0t0.jp - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.hspdev.0t0.jp' will expire on Sat 03 Aug 2024 11:13:22 AM GMT +0000.
[13:13:26] <icinga-miraheze>	 PROBLEM - wiki.andreijiroh.uk.eu.org - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query uk.eu.org. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL
[13:13:42] <icinga-miraheze>	 PROBLEM - ping6 on cp51 is CRITICAL: PING CRITICAL - Packet loss = 37%, RTA = 172.48 ms
[13:15:45] <icinga-miraheze>	 RECOVERY - ping6 on cp51 is OK: PING OK - Packet loss = 0%, RTA = 170.82 ms
[13:43:17] <icinga-miraheze>	 RECOVERY - wiki.andreijiroh.uk.eu.org - reverse DNS on sslhost is OK: SSL OK - wiki.andreijiroh.uk.eu.org reverse DNS resolves to cp37.wikitide.net - CNAME OK
[13:47:50] <icinga-miraheze>	 PROBLEM - wiki.mahdiruiz.line.pm - LetsEncrypt on sslhost is CRITICAL: Temporary failure in name resolutionHTTP CRITICAL - Unable to open TCP socket
[13:50:54] <icinga-miraheze>	 PROBLEM - ping6 on cp51 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 171.78 ms
[13:55:01] <icinga-miraheze>	 RECOVERY - ping6 on cp51 is OK: PING OK - Packet loss = 0%, RTA = 179.79 ms
[13:56:26] <icinga-miraheze>	 PROBLEM - private.yahyabd.xyz - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - private.yahyabd.xyz All nameservers failed to answer the query.
[14:09:07] <icinga-miraheze>	 PROBLEM - wiki.yahyabd.xyz - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.yahyabd.xyz All nameservers failed to answer the query.
[14:15:45] <icinga-miraheze>	 PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 152.85 ms
[14:17:03] <icinga-miraheze>	 RECOVERY - wiki.mahdiruiz.line.pm - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.mahdiruiz.line.pm' will expire on Fri 14 Jun 2024 04:28:50 PM GMT +0000.
[14:21:56] <icinga-miraheze>	 RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 155.22 ms
[14:26:09] <icinga-miraheze>	 PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 158.73 ms
[14:28:12] <icinga-miraheze>	 RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 158.71 ms
[14:56:28] <icinga-miraheze>	 PROBLEM - private.yahyabd.xyz - reverse DNS on sslhost is WARNING: LifetimeTimeout: The resolution lifetime expired after 5.402 seconds: Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.
[15:00:23] <icinga-miraheze>	 PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 154.94 ms
[15:02:26] <icinga-miraheze>	 RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 156.35 ms
[15:09:09] <icinga-miraheze>	 PROBLEM - wiki.yahyabd.xyz - reverse DNS on sslhost is WARNING: LifetimeTimeout: The resolution lifetime expired after 5.404 seconds: Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.
[15:18:40] <icinga-miraheze>	 PROBLEM - ping6 on cp51 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 169.38 ms
[15:22:48] <icinga-miraheze>	 RECOVERY - ping6 on cp51 is OK: PING OK - Packet loss = 0%, RTA = 171.15 ms
[15:56:26] <icinga-miraheze>	 PROBLEM - private.yahyabd.xyz - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - private.yahyabd.xyz All nameservers failed to answer the query.
[16:09:08] <icinga-miraheze>	 PROBLEM - wiki.yahyabd.xyz - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.yahyabd.xyz All nameservers failed to answer the query.
[16:36:05] <icinga-miraheze>	 PROBLEM - wiki.pixandbit.gay - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.pixandbit.gay' expires in 15 day(s) (Tue 21 May 2024 04:16:07 PM GMT +0000).
[16:36:18] <botifico>	 [02miraheze/ssl] 07WikiTideSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/ad53990cab09...c30cee85392c
[16:36:20] <botifico>	 [02miraheze/ssl] 07WikiTideSSLBot 03c30cee8 - Bot: Update SSL cert for wiki.pixandbit.gay
[16:36:37] <icinga-miraheze>	 PROBLEM - fashiondreamer.wiki - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'fashiondreamer.wiki' expires in 15 day(s) (Tue 21 May 2024 04:30:55 PM GMT +0000).
[16:36:48] <botifico>	 [02miraheze/ssl] 07WikiTideSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/c30cee85392c...4e1aaec0f9cd
[16:36:50] <botifico>	 [02miraheze/ssl] 07WikiTideSSLBot 034e1aaec - Bot: Update SSL cert for fashiondreamer.wiki
[16:40:25] <icinga-miraheze>	 PROBLEM - ping6 on cp51 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 170.29 ms
[16:41:49] <icinga-miraheze>	 PROBLEM - archives.nsgov.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'archives.nsgov.org' expires in 15 day(s) (Tue 21 May 2024 04:17:24 PM GMT +0000).
[16:42:01] <botifico>	 [02miraheze/ssl] 07WikiTideSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/4e1aaec0f9cd...243ae6905dd6
[16:42:04] <botifico>	 [02miraheze/ssl] 07WikiTideSSLBot 03243ae69 - Bot: Update SSL cert for archives.nsgov.org
[16:42:27] <icinga-miraheze>	 RECOVERY - ping6 on cp51 is OK: PING OK - Packet loss = 0%, RTA = 170.77 ms
[16:45:49] <MirahezeRelay>	 <originalauthority, replying to cosmicalpha> How do you enroll in that
[16:46:33] <MirahezeRelay>	 <koreirose, replying to originalauthority> Cant you just download it somewhere?
[16:46:45] <MirahezeRelay>	 <originalauthority> Probably im too lazy to google
[16:47:20] <MirahezeRelay>	 <koreirose, replying to pixldev> I use Aliucord which is based on an old version of Discord. I don't ever intend to get the new UI.
[16:47:27] <MirahezeRelay>	 <originalauthority> Oh the beta is full RIP
[16:47:50] <MirahezeRelay>	 <koreirose, replying to originalauthority> I'm sure someone has posted the apk somewhere
[16:47:57] <MirahezeRelay>	 <koreirose> I don't even use the Google Play Store
[16:48:38] <MirahezeRelay>	 <koreirose> [1/2] GrapheneOS
[16:48:38] <MirahezeRelay>	 <koreirose> [2/2] https://cdn.discordapp.com/attachments/808001911868489748/1236721227985588286/Screenshot_20240505-094801.png?ex=663909e5&is=6637b865&hm=6d193ccd8c60331d13d738cd4c98a1075e4fdb6a15b8901883495b9fa2f9bfa5&
[16:51:55] <MirahezeRelay>	 <bluemoon0332> !log MariaDB [iceriawiki]> INSERT INTO slot_roles (role_id, role_name) VALUES (1, 'main');
[16:51:59] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[16:54:37] <MirahezeRelay>	 <bluemoon0332> !log [iceriawiki]> INSERT INTO content_models (model_id, model_name) VALUES ( 2, 'css');
[16:54:41] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[16:54:56] <icinga-miraheze>	 PROBLEM - ping6 on cp51 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 170.84 ms
[16:55:29] <MirahezeRelay>	 <bluemoon0332> !log [iceriawiki]> INSERT INTO content_models (model_id, model_name) VALUES ( 3, 'javascript');
[16:55:32] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[16:56:04] <MirahezeRelay>	 <bluemoon0332> !log [iceriawiki]> INSERT INTO content_models (model_id, model_name) VALUES ( 4, 'Scribunto');
[16:56:08] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[16:56:26] <MirahezeRelay>	 <bluemoon0332> !log [iceriawiki]> INSERT INTO content_models (model_id, model_name) VALUES ( 5, 'json');
[16:56:27] <icinga-miraheze>	 PROBLEM - private.yahyabd.xyz - reverse DNS on sslhost is WARNING: LifetimeTimeout: The resolution lifetime expired after 5.404 seconds: Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.
[16:56:30] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[16:56:55] <MirahezeRelay>	 <pixldev, replying to koreirose> CollieOS
[16:57:03] <MirahezeRelay>	 <koreirose> Lol
[16:59:02] <icinga-miraheze>	 RECOVERY - ping6 on cp51 is OK: PING OK - Packet loss = 0%, RTA = 178.13 ms
[17:04:00] <icinga-miraheze>	 PROBLEM - cp51 Puppet on cp51 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[nginx]
[17:05:14] <icinga-miraheze>	 RECOVERY - fashiondreamer.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'fashiondreamer.wiki' will expire on Sat 03 Aug 2024 03:36:43 PM GMT +0000.
[17:05:40] <icinga-miraheze>	 RECOVERY - wiki.pixandbit.gay - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.pixandbit.gay' will expire on Sat 03 Aug 2024 03:36:11 PM GMT +0000.
[17:09:09] <icinga-miraheze>	 PROBLEM - wiki.yahyabd.xyz - reverse DNS on sslhost is WARNING: LifetimeTimeout: The resolution lifetime expired after 5.405 seconds: Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.
[17:11:08] <icinga-miraheze>	 RECOVERY - archives.nsgov.org - LetsEncrypt on sslhost is OK: OK - Certificate 'archives.nsgov.org' will expire on Sat 03 Aug 2024 03:41:55 PM GMT +0000.
[17:14:58] <MirahezeLSBot>	 !log [alex@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/extensions/CreateWiki/maintenance/deleteWiki.php --wiki=metawiki --deletewiki hebwiki --delete (END - exit=0)
[17:15:02] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[17:15:36] <MirahezeRelay>	 <pixldev> I saw deleteWiki.php --wiki=metawiki and had a heart attack
[17:15:45] <MirahezeRelay>	 <bluemoon0332> !log db171: DROP DATABASE hebwiki;
[17:15:48] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[17:21:44] <MirahezeRelay>	 <koreirose, replying to pixldev> Lol rip
[17:23:56] <icinga-miraheze>	 PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 152.52 ms
[17:25:59] <icinga-miraheze>	 RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 149.89 ms
[17:31:58] <icinga-miraheze>	 RECOVERY - cp51 Puppet on cp51 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures
[17:32:15] <icinga-miraheze>	 PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 28%, RTA = 151.26 ms
[17:33:19] <icinga-miraheze>	 PROBLEM - ping6 on cp51 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 171.80 ms
[17:34:18] <icinga-miraheze>	 RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 154.90 ms
[17:35:49] <MirahezeRelay>	 <cosmicalpha, replying to originalauthority> There is a google group you have to join to enroll IIRC
[17:38:21] <MirahezeRelay>	 <cosmicalpha> Then it is available in play store
[17:39:33] <icinga-miraheze>	 RECOVERY - ping6 on cp51 is OK: PING OK - Packet loss = 0%, RTA = 170.70 ms
[18:44:45] <icinga-miraheze>	 PROBLEM - ping6 on cp51 is CRITICAL: PING CRITICAL - Packet loss = 28%, RTA = 171.33 ms
[18:48:52] <icinga-miraheze>	 RECOVERY - ping6 on cp51 is OK: PING OK - Packet loss = 0%, RTA = 171.00 ms
[18:56:27] <icinga-miraheze>	 PROBLEM - private.yahyabd.xyz - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - private.yahyabd.xyz All nameservers failed to answer the query.
[19:05:26] <icinga-miraheze>	 PROBLEM - ping6 on cp51 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 171.79 ms
[19:07:53] <icinga-miraheze>	 PROBLEM - permanentfuturelab.wiki - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - permanentfuturelab.wiki All nameservers failed to answer the query.
[19:11:37] <icinga-miraheze>	 RECOVERY - ping6 on cp51 is OK: PING OK - Packet loss = 0%, RTA = 171.96 ms
[19:26:27] <icinga-miraheze>	 PROBLEM - private.yahyabd.xyz - reverse DNS on sslhost is WARNING: LifetimeTimeout: The resolution lifetime expired after 5.404 seconds: Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.
[19:37:43] <icinga-miraheze>	 RECOVERY - permanentfuturelab.wiki - reverse DNS on sslhost is OK: SSL OK - permanentfuturelab.wiki reverse DNS resolves to cp37.wikitide.net - NS RECORDS OK
[19:39:05] <icinga-miraheze>	 PROBLEM - wiki.yahyabd.xyz - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.yahyabd.xyz All nameservers failed to answer the query.
[19:56:27] <icinga-miraheze>	 PROBLEM - private.yahyabd.xyz - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - private.yahyabd.xyz All nameservers failed to answer the query.
[20:09:09] <icinga-miraheze>	 PROBLEM - wiki.yahyabd.xyz - reverse DNS on sslhost is WARNING: LifetimeTimeout: The resolution lifetime expired after 5.402 seconds: Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.
[20:26:27] <icinga-miraheze>	 PROBLEM - private.yahyabd.xyz - reverse DNS on sslhost is WARNING: LifetimeTimeout: The resolution lifetime expired after 5.402 seconds: Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.
[20:39:06] <icinga-miraheze>	 PROBLEM - wiki.yahyabd.xyz - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.yahyabd.xyz All nameservers failed to answer the query.
[21:09:09] <icinga-miraheze>	 PROBLEM - wiki.yahyabd.xyz - reverse DNS on sslhost is WARNING: LifetimeTimeout: The resolution lifetime expired after 5.402 seconds: Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.
[21:17:25] <icinga-miraheze>	 [Grafana] !sre FIRING: The mediawiki job queue has more than 500 unclaimed jobs https://grafana.wikitide.net/d/GtxbP1Xnk?orgId=1
[21:26:26] <icinga-miraheze>	 PROBLEM - private.yahyabd.xyz - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - private.yahyabd.xyz All nameservers failed to answer the query.
[21:56:27] <icinga-miraheze>	 PROBLEM - private.yahyabd.xyz - reverse DNS on sslhost is WARNING: LifetimeTimeout: The resolution lifetime expired after 5.404 seconds: Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.
[21:57:25] <icinga-miraheze>	 [Grafana] !sre RESOLVED: High Job Queue Backlog https://grafana.wikitide.net/d/GtxbP1Xnk?orgId=1
[22:09:08] <icinga-miraheze>	 PROBLEM - wiki.yahyabd.xyz - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.yahyabd.xyz All nameservers failed to answer the query.
[22:39:09] <icinga-miraheze>	 PROBLEM - wiki.yahyabd.xyz - reverse DNS on sslhost is WARNING: LifetimeTimeout: The resolution lifetime expired after 5.402 seconds: Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.
[22:47:22] <icinga-miraheze>	 PROBLEM - wiki.andreijiroh.uk.eu.org - reverse DNS on sslhost is WARNING: LifetimeTimeout: The resolution lifetime expired after 5.405 seconds: Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.
[23:09:05] <icinga-miraheze>	 PROBLEM - wiki.yahyabd.xyz - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.yahyabd.xyz All nameservers failed to answer the query.
[23:17:12] <icinga-miraheze>	 RECOVERY - wiki.andreijiroh.uk.eu.org - reverse DNS on sslhost is OK: SSL OK - wiki.andreijiroh.uk.eu.org reverse DNS resolves to cp37.wikitide.net - CNAME OK
[23:39:09] <icinga-miraheze>	 PROBLEM - wiki.yahyabd.xyz - reverse DNS on sslhost is WARNING: LifetimeTimeout: The resolution lifetime expired after 5.402 seconds: Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.