[00:09:08] <icinga-miraheze>	 PROBLEM - wiki.yahyabd.xyz - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.yahyabd.xyz All nameservers failed to answer the query.
[00:26:27] <icinga-miraheze>	 PROBLEM - private.yahyabd.xyz - reverse DNS on sslhost is WARNING: LifetimeTimeout: The resolution lifetime expired after 5.404 seconds: Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.
[01:09:09] <icinga-miraheze>	 PROBLEM - wiki.yahyabd.xyz - reverse DNS on sslhost is WARNING: LifetimeTimeout: The resolution lifetime expired after 5.405 seconds: Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.
[01:39:08] <icinga-miraheze>	 PROBLEM - wiki.yahyabd.xyz - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.yahyabd.xyz All nameservers failed to answer the query.
[01:46:57] <icinga-miraheze>	 PROBLEM - wiki.elgeis.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Certificate 'wiki.elgeis.com' expires in 7 day(s) (Wed 15 May 2024 01:24:45 AM GMT +0000).
[01:56:26] <icinga-miraheze>	 PROBLEM - private.yahyabd.xyz - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - private.yahyabd.xyz All nameservers failed to answer the query.
[02:07:58] <icinga-miraheze>	 PROBLEM - ping6 on cp51 is CRITICAL: PING CRITICAL - Packet loss = 28%, RTA = 171.43 ms
[02:09:09] <icinga-miraheze>	 PROBLEM - wiki.yahyabd.xyz - reverse DNS on sslhost is WARNING: LifetimeTimeout: The resolution lifetime expired after 5.405 seconds: Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.
[02:12:05] <icinga-miraheze>	 RECOVERY - ping6 on cp51 is OK: PING OK - Packet loss = 0%, RTA = 166.86 ms
[02:26:27] <icinga-miraheze>	 PROBLEM - private.yahyabd.xyz - reverse DNS on sslhost is WARNING: LifetimeTimeout: The resolution lifetime expired after 5.404 seconds: Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.
[02:38:53] <icinga-miraheze>	 PROBLEM - ping6 on cp51 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 171.09 ms
[02:39:08] <icinga-miraheze>	 PROBLEM - wiki.yahyabd.xyz - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.yahyabd.xyz All nameservers failed to answer the query.
[02:43:00] <icinga-miraheze>	 RECOVERY - ping6 on cp51 is OK: PING OK - Packet loss = 0%, RTA = 169.99 ms
[02:54:29] <icinga-miraheze>	 PROBLEM - ping6 on cp51 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 167.76 ms
[02:56:26] <icinga-miraheze>	 PROBLEM - private.yahyabd.xyz - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - private.yahyabd.xyz All nameservers failed to answer the query.
[02:58:36] <icinga-miraheze>	 RECOVERY - ping6 on cp51 is OK: PING OK - Packet loss = 0%, RTA = 174.41 ms
[03:09:09] <icinga-miraheze>	 PROBLEM - wiki.yahyabd.xyz - reverse DNS on sslhost is WARNING: LifetimeTimeout: The resolution lifetime expired after 5.404 seconds: Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.
[03:26:28] <icinga-miraheze>	 PROBLEM - private.yahyabd.xyz - reverse DNS on sslhost is WARNING: LifetimeTimeout: The resolution lifetime expired after 5.405 seconds: Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.
[03:37:14] <icinga-miraheze>	 PROBLEM - wiki.mahdiruiz.line.pm - reverse DNS on sslhost is WARNING: LifetimeTimeout: The resolution lifetime expired after 5.404 seconds: Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.
[03:39:05] <icinga-miraheze>	 PROBLEM - wiki.yahyabd.xyz - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.yahyabd.xyz All nameservers failed to answer the query.
[03:40:46] <icinga-miraheze>	 PROBLEM - ping6 on cp51 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 172.55 ms
[03:42:49] <icinga-miraheze>	 RECOVERY - ping6 on cp51 is OK: PING OK - Packet loss = 0%, RTA = 170.03 ms
[03:53:09] <icinga-miraheze>	 PROBLEM - wiki.fbpml.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Certificate 'wiki.fbpml.org' expires in 7 day(s) (Wed 15 May 2024 03:34:59 AM GMT +0000).
[03:56:26] <icinga-miraheze>	 PROBLEM - private.yahyabd.xyz - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - private.yahyabd.xyz All nameservers failed to answer the query.
[03:56:45] <icinga-miraheze>	 PROBLEM - wiki.andreijiroh.uk.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.andreijiroh.uk.eu.org All nameservers failed to answer the query.
[04:06:17] <icinga-miraheze>	 RECOVERY - wiki.mahdiruiz.line.pm - reverse DNS on sslhost is OK: SSL OK - wiki.mahdiruiz.line.pm reverse DNS resolves to cp36.wikitide.net - CNAME OK
[04:06:49] <botifico>	 [02mw-config] 07brandon-wm opened pull request 03#5554: T12047: Can't recreate the Interwiki Administrator usergroup - 13https://github.com/miraheze/mw-config/pull/5554
[04:07:45] <miraheze-github>	 miraheze/mw-config - brandon-wm the build passed.
[04:08:03] <botifico>	 [02mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/3d08d6314380...e057f87d6f05
[04:08:05] <botifico>	 [02mw-config] 07Universal-Omega 03e057f87 - Allow interwiki-admin group
[04:08:59] <miraheze-github>	 miraheze/mw-config - Universal-Omega the build passed.
[04:09:47] <botifico>	 [02mw-config] 07brandon-wm closed pull request 03#5554: T12047: Can't recreate the Interwiki Administrator usergroup - 13https://github.com/miraheze/mw-config/pull/5554
[04:23:42] <MirahezeLSBot>	 !log [@test151] starting deploy of {'config': True} to test151
[04:23:43] <MirahezeLSBot>	 !log [@test151] finished deploy of {'config': True} to test151 - SUCCESS in 0s
[04:23:46] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[04:23:49] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[04:32:12] <MirahezeLSBot>	 !log [@mwtask181] starting deploy of {'config': True} to all
[04:32:16] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[04:32:22] <MirahezeLSBot>	 !log [@mwtask181] finished deploy of {'config': True} to all - SUCCESS in 10s
[04:32:26] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[04:37:20] <MirahezeLSBot>	 !log [@mwtask171] starting deploy of {'config': True} to all
[04:37:23] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[04:37:28] <MirahezeLSBot>	 !log [@mwtask171] finished deploy of {'config': True} to all - SUCCESS in 8s
[04:37:32] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[04:56:22] <icinga-miraheze>	 RECOVERY - wiki.andreijiroh.uk.eu.org - reverse DNS on sslhost is OK: SSL OK - wiki.andreijiroh.uk.eu.org reverse DNS resolves to cp37.wikitide.net - CNAME OK
[05:21:04] <icinga-miraheze>	 PROBLEM - ping6 on cp51 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 166.88 ms
[05:25:11] <icinga-miraheze>	 RECOVERY - ping6 on cp51 is OK: PING OK - Packet loss = 0%, RTA = 172.23 ms
[05:38:36] <icinga-miraheze>	 PROBLEM - wiki.mahdiruiz.line.pm - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query line.pm. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL
[05:52:02] <icinga-miraheze>	 PROBLEM - ping6 on cp51 is CRITICAL: PING CRITICAL - Packet loss = 37%, RTA = 168.33 ms
[05:54:05] <icinga-miraheze>	 RECOVERY - ping6 on cp51 is OK: PING OK - Packet loss = 0%, RTA = 200.07 ms
[06:07:41] <icinga-miraheze>	 RECOVERY - wiki.mahdiruiz.line.pm - reverse DNS on sslhost is OK: SSL OK - wiki.mahdiruiz.line.pm reverse DNS resolves to cp37.wikitide.net - CNAME OK
[06:30:11] <icinga-miraheze>	 PROBLEM - ping6 on cp51 is CRITICAL: PING CRITICAL - Packet loss = 28%, RTA = 166.21 ms
[06:36:23] <icinga-miraheze>	 RECOVERY - ping6 on cp51 is OK: PING OK - Packet loss = 0%, RTA = 172.98 ms
[07:12:25] <icinga-miraheze>	 [Grafana] !sre FIRING: The mediawiki job queue has more than 500 unclaimed jobs https://grafana.wikitide.net/d/GtxbP1Xnk?orgId=1
[07:26:28] <icinga-miraheze>	 PROBLEM - private.yahyabd.xyz - reverse DNS on sslhost is WARNING: LifetimeTimeout: The resolution lifetime expired after 5.404 seconds: Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.
[07:40:21] <icinga-miraheze>	 PROBLEM - ping6 on cp51 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 170.97 ms
[07:44:28] <icinga-miraheze>	 RECOVERY - ping6 on cp51 is OK: PING OK - Packet loss = 0%, RTA = 170.51 ms
[07:56:26] <icinga-miraheze>	 PROBLEM - private.yahyabd.xyz - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - private.yahyabd.xyz All nameservers failed to answer the query.
[09:09:17] <icinga-miraheze>	 PROBLEM - ping6 on cp51 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 171.73 ms
[09:11:20] <icinga-miraheze>	 RECOVERY - ping6 on cp51 is OK: PING OK - Packet loss = 0%, RTA = 171.94 ms
[09:17:25] <icinga-miraheze>	 [Grafana] !sre RESOLVED: High Job Queue Backlog https://grafana.wikitide.net/d/GtxbP1Xnk?orgId=1
[09:29:02] <icinga-miraheze>	 PROBLEM - ping6 on cp51 is CRITICAL: PING CRITICAL - Packet loss = 28%, RTA = 168.14 ms
[09:31:05] <icinga-miraheze>	 RECOVERY - ping6 on cp51 is OK: PING OK - Packet loss = 0%, RTA = 170.89 ms
[09:48:41] <icinga-miraheze>	 PROBLEM - ping6 on cp51 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 169.02 ms
[09:50:44] <icinga-miraheze>	 RECOVERY - ping6 on cp51 is OK: PING OK - Packet loss = 0%, RTA = 173.04 ms
[10:39:07] <icinga-miraheze>	 PROBLEM - with.cpt-ra.bid - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Certificate 'with.cpt-ra.bid' expires in 7 day(s) (Wed 15 May 2024 10:32:47 AM GMT +0000).
[12:26:28] <icinga-miraheze>	 PROBLEM - private.yahyabd.xyz - reverse DNS on sslhost is WARNING: LifetimeTimeout: The resolution lifetime expired after 5.405 seconds: Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.
[13:09:09] <icinga-miraheze>	 PROBLEM - wiki.yahyabd.xyz - reverse DNS on sslhost is WARNING: LifetimeTimeout: The resolution lifetime expired after 5.405 seconds: Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.
[13:23:15] <icinga-miraheze>	 PROBLEM - wiki.jeremyboyd.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Certificate 'wiki.jeremyboyd.org' expires in 7 day(s) (Wed 15 May 2024 01:03:14 PM GMT +0000).
[13:26:26] <icinga-miraheze>	 PROBLEM - private.yahyabd.xyz - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - private.yahyabd.xyz All nameservers failed to answer the query.
[13:27:17] <icinga-miraheze>	 PROBLEM - ping6 on cp51 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 168.73 ms
[13:29:20] <icinga-miraheze>	 RECOVERY - ping6 on cp51 is OK: PING OK - Packet loss = 0%, RTA = 167.72 ms
[13:56:27] <icinga-miraheze>	 PROBLEM - private.yahyabd.xyz - reverse DNS on sslhost is WARNING: LifetimeTimeout: The resolution lifetime expired after 5.404 seconds: Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.
[14:04:17] <icinga-miraheze>	 PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 161.93 ms
[14:06:20] <icinga-miraheze>	 RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 156.81 ms
[14:28:14] <icinga-miraheze>	 PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 28%, RTA = 154.46 ms
[14:32:22] <icinga-miraheze>	 RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 164.04 ms
[14:39:08] <icinga-miraheze>	 PROBLEM - wiki.yahyabd.xyz - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.yahyabd.xyz All nameservers failed to answer the query.
[14:59:25] <icinga-miraheze>	 PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 28%, RTA = 163.47 ms
[15:05:39] <icinga-miraheze>	 RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 163.65 ms
[15:09:09] <icinga-miraheze>	 PROBLEM - wiki.yahyabd.xyz - reverse DNS on sslhost is WARNING: LifetimeTimeout: The resolution lifetime expired after 5.404 seconds: Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.
[15:11:23] <icinga-miraheze>	 PROBLEM - ping6 on cp51 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 169.46 ms
[15:11:54] <icinga-miraheze>	 PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 155.34 ms
[15:15:31] <icinga-miraheze>	 RECOVERY - ping6 on cp51 is OK: PING OK - Packet loss = 0%, RTA = 171.38 ms
[15:18:06] <icinga-miraheze>	 RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 158.04 ms
[15:21:46] <icinga-miraheze>	 PROBLEM - ping6 on cp51 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 171.33 ms
[15:23:49] <icinga-miraheze>	 RECOVERY - ping6 on cp51 is OK: PING OK - Packet loss = 0%, RTA = 170.48 ms
[15:26:42] <icinga-miraheze>	 PROBLEM - wiki.andreijiroh.uk.eu.org - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query uk.eu.org. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL
[15:56:26] <icinga-miraheze>	 PROBLEM - private.yahyabd.xyz - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - private.yahyabd.xyz All nameservers failed to answer the query.
[15:56:32] <icinga-miraheze>	 RECOVERY - wiki.andreijiroh.uk.eu.org - reverse DNS on sslhost is OK: SSL OK - wiki.andreijiroh.uk.eu.org reverse DNS resolves to cp36.wikitide.net - CNAME OK
[15:56:50] <icinga-miraheze>	 PROBLEM - ping6 on cp51 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 168.68 ms
[16:02:25] <icinga-miraheze>	 [Grafana] !sre FIRING: The mediawiki job queue has more than 500 unclaimed jobs https://grafana.wikitide.net/d/GtxbP1Xnk?orgId=1
[16:03:04] <icinga-miraheze>	 RECOVERY - ping6 on cp51 is OK: PING OK - Packet loss = 0%, RTA = 196.50 ms
[16:22:25] <icinga-miraheze>	 [Grafana] !sre RESOLVED: High Job Queue Backlog https://grafana.wikitide.net/d/GtxbP1Xnk?orgId=1
[16:26:28] <icinga-miraheze>	 PROBLEM - private.yahyabd.xyz - reverse DNS on sslhost is WARNING: LifetimeTimeout: The resolution lifetime expired after 5.404 seconds: Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.
[16:41:42] <icinga-miraheze>	 PROBLEM - wiki.queenscourt.games - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.queenscourt.games' expires in 15 day(s) (Thu 23 May 2024 04:18:40 PM GMT +0000).
[16:41:54] <botifico>	 [02ssl] 07WikiTideSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/69ecdfe58bd5...4a3e83cadafc
[16:41:55] <botifico>	 [02ssl] 07WikiTideSSLBot 034a3e83c - Bot: Update SSL cert for wiki.queenscourt.games
[16:56:27] <icinga-miraheze>	 PROBLEM - private.yahyabd.xyz - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - private.yahyabd.xyz All nameservers failed to answer the query.
[17:08:05] <icinga-miraheze>	 PROBLEM - ping6 on cp51 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 173.13 ms
[17:10:07] <icinga-miraheze>	 RECOVERY - ping6 on cp51 is OK: PING OK - Packet loss = 0%, RTA = 168.59 ms
[17:10:54] <icinga-miraheze>	 RECOVERY - wiki.queenscourt.games - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.queenscourt.games' will expire on Mon 05 Aug 2024 03:41:48 PM GMT +0000.
[17:26:28] <icinga-miraheze>	 PROBLEM - private.yahyabd.xyz - reverse DNS on sslhost is WARNING: LifetimeTimeout: The resolution lifetime expired after 5.402 seconds: Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.
[17:35:51] <MirahezeLSBot>	 !log [macfan@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/sql.php --wiki=wrytewiki /srv/mediawiki/1.41/extensions/CheckUser/schema/mysql/patch-cu_private_event-def.sql (END - exit=0)
[17:35:54] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[17:37:09] <MirahezeLSBot>	 !log [macfan@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/sql.php --wiki=wrytewiki /srv/mediawiki/1.41/extensions/CheckUser/schema/mysql/patch-cu_changes-add-cuc_only_for_read_old.sql (END - exit=0)
[17:37:13] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[17:45:12] <botifico>	 [02puppet] 07redbluegreenhat opened pull request 03#3848: Add a --include-kernel option to do kernel upgrades as well - 13https://github.com/miraheze/puppet/pull/3848
[17:50:00] <botifico>	 [02puppet] 07clarfonthey commented on pull request 03#3848: Add a --include-kernel option to do kernel upgrades as well - 13https://github.com/miraheze/puppet/pull/3848#issuecomment-2098990401
[17:55:50] <botifico>	 [02puppet] 07redbluegreenhat commented on pull request 03#3848: Add a --include-kernel option to do kernel upgrades as well - 13https://github.com/miraheze/puppet/pull/3848#issuecomment-2098999405
[17:56:26] <icinga-miraheze>	 PROBLEM - private.yahyabd.xyz - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - private.yahyabd.xyz All nameservers failed to answer the query.
[17:58:48] <MirahezeLSBot>	 !log [macfan@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/rebuildtextindex.php --wiki=wrytewiki (START)
[17:58:49] <MirahezeLSBot>	 !log [macfan@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/rebuildtextindex.php --wiki=wrytewiki (END - exit=0)
[17:58:52] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[17:58:55] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[18:00:19] <MirahezeLSBot>	 !log [macfan@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/migrateRevisionCommentTemp.php --wiki=wrytewiki (END - exit=0)
[18:00:23] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[18:11:24] <botifico>	 [02puppet] 07clarfonthey commented on pull request 03#3848: Add a --include-kernel option to do kernel upgrades as well - 13https://github.com/miraheze/puppet/pull/3848#issuecomment-2099024959
[18:21:22] <botifico>	 [02puppet] 07Universal-Omega commented on pull request 03#3848: Add a --include-kernel option to do kernel upgrades as well - 13https://github.com/miraheze/puppet/pull/3848#issuecomment-2099043053
[18:21:30] <botifico>	 [02puppet] 07Universal-Omega closed pull request 03#3848: Add a --include-kernel option to do kernel upgrades as well - 13https://github.com/miraheze/puppet/pull/3848
[18:21:33] <botifico>	 [02puppet] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/f91387cc5567...fafc71db809b
[18:21:35] <botifico>	 [02puppet] 07redbluegreenhat 03fafc71d - Add a --include-kernel option to do kernel upgrades as well (#3848)
[18:32:53] <icinga-miraheze>	 PROBLEM - puppet181 Puppet on puppet181 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[pg-initdb]
[18:47:34] <MirahezeLSBot>	 !log [reception@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/importDump.php --wiki=runwiki --username-prefix=fandom:run /home/reception/run_pages_full.xml (START)
[18:47:38] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[18:54:19] <MirahezeLSBot>	 !log [reception@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/importDump.php --wiki=runwiki --username-prefix=fandom:run /home/reception/run_pages_full.xml (END - exit=2)
[18:54:23] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[18:54:23] <MirahezeLSBot>	 !log [reception@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/importDump.php --wiki=runwiki --username-prefix=fandom:run /home/reception/run_pages_full.xml --report 1 (START)
[18:54:27] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[19:26:27] <icinga-miraheze>	 PROBLEM - private.yahyabd.xyz - reverse DNS on sslhost is WARNING: LifetimeTimeout: The resolution lifetime expired after 5.405 seconds: Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.
[19:31:52] <botifico>	 [02ImportDump] 07Universal-Omega pushed 031 commit to 03connectionprovider [+0/-0/±1] 13https://github.com/miraheze/ImportDump/commit/6179ab9b2d1c
[19:31:55] <botifico>	 [02ImportDump] 07Universal-Omega 036179ab9 - Prepare for 1.42 migration to ConnectionProvider
[19:31:57] <botifico>	 [02ImportDump] 07Universal-Omega created branch 03connectionprovider - 13https://github.com/miraheze/ImportDump
[19:31:59] <botifico>	 [02ImportDump] 07Universal-Omega opened pull request 03#95: Prepare for 1.42 migration to ConnectionProvider - 13https://github.com/miraheze/ImportDump/pull/95
[19:38:18] <botifico>	 [02ImportDump] 07Universal-Omega pushed 031 commit to 03connectionprovider [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/6179ab9b2d1c...0ce666f89d69
[19:38:21] <botifico>	 [02ImportDump] 07Universal-Omega 030ce666f - Update
[19:38:22] <botifico>	 [02ImportDump] 07Universal-Omega synchronize pull request 03#95: Prepare for 1.42 migration to ConnectionProvider - 13https://github.com/miraheze/ImportDump/pull/95
[19:42:10] <botifico>	 [02ImportDump] 07Universal-Omega pushed 031 commit to 03connectionprovider [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/0ce666f89d69...6f14171071ac
[19:42:12] <botifico>	 [02ImportDump] 07Universal-Omega 036f14171 - Update
[19:42:14] <botifico>	 [02ImportDump] 07Universal-Omega synchronize pull request 03#95: Prepare for 1.42 migration to ConnectionProvider - 13https://github.com/miraheze/ImportDump/pull/95
[19:44:24] <botifico>	 [02ImportDump] 07Universal-Omega pushed 031 commit to 03connectionprovider [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/6f14171071ac...5b159e72f725
[19:44:26] <botifico>	 [02ImportDump] 07Universal-Omega 035b159e7 - Update
[19:44:29] <botifico>	 [02ImportDump] 07Universal-Omega synchronize pull request 03#95: Prepare for 1.42 migration to ConnectionProvider - 13https://github.com/miraheze/ImportDump/pull/95
[19:46:10] <botifico>	 [02ImportDump] 07github-actions[bot] pushed 031 commit to 03connectionprovider [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/5b159e72f725...0a8977524170
[19:46:12] <botifico>	 [02ImportDump] 07github-actions 030a89775 - CI: lint code to MediaWiki standards
[19:46:13] <botifico>	 [02ImportDump] 07github-actions[bot] synchronize pull request 03#95: Prepare for 1.42 migration to ConnectionProvider - 13https://github.com/miraheze/ImportDump/pull/95
[19:46:42] <botifico>	 [02ImportDump] 07Universal-Omega pushed 031 commit to 03connectionprovider [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/0a8977524170...705dd34e87c6
[19:46:43] <botifico>	 [02ImportDump] 07Universal-Omega 03705dd34 - Update
[19:46:45] <botifico>	 [02ImportDump] 07Universal-Omega synchronize pull request 03#95: Prepare for 1.42 migration to ConnectionProvider - 13https://github.com/miraheze/ImportDump/pull/95
[19:47:23] <miraheze-github>	 miraheze/ImportDump - Universal-Omega the build has errored.
[19:48:17] <botifico>	 [02ImportDump] 07Universal-Omega pushed 031 commit to 03connectionprovider [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/705dd34e87c6...b6efc3089407
[19:48:20] <botifico>	 [02ImportDump] 07Universal-Omega 03b6efc30 - Fix
[19:48:21] <botifico>	 [02ImportDump] 07Universal-Omega synchronize pull request 03#95: Prepare for 1.42 migration to ConnectionProvider - 13https://github.com/miraheze/ImportDump/pull/95
[19:56:26] <icinga-miraheze>	 PROBLEM - private.yahyabd.xyz - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - private.yahyabd.xyz All nameservers failed to answer the query.
[19:56:29] <miraheze-github>	 miraheze/ImportDump - Universal-Omega the build passed.
[19:58:02] <botifico>	 [02ImportDump] 07Universal-Omega synchronize pull request 03#95: Prepare for 1.42 migration to ConnectionProvider - 13https://github.com/miraheze/ImportDump/pull/95
[19:58:03] <botifico>	 [02ImportDump] 07Universal-Omega pushed 031 commit to 03connectionprovider [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/b6efc3089407...762e89f8e3da
[19:58:05] <botifico>	 [02ImportDump] 07Universal-Omega 03762e89f - Use IConnectionProvider
[20:00:42] <botifico>	 [02ImportDump] 07Universal-Omega synchronize pull request 03#95: Prepare for 1.42 migration to ConnectionProvider - 13https://github.com/miraheze/ImportDump/pull/95
[20:00:43] <botifico>	 [02ImportDump] 07Universal-Omega pushed 031 commit to 03connectionprovider [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/762e89f8e3da...5b314c86abae
[20:00:46] <botifico>	 [02ImportDump] 07Universal-Omega 035b314c8 - Use IConnectionProvider
[20:01:27] <botifico>	 [02ImportDump] 07Universal-Omega synchronize pull request 03#95: Prepare for 1.42 migration to ConnectionProvider - 13https://github.com/miraheze/ImportDump/pull/95
[20:01:30] <botifico>	 [02ImportDump] 07Universal-Omega pushed 031 commit to 03connectionprovider [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/5b314c86abae...e17784903813
[20:01:33] <botifico>	 [02ImportDump] 07Universal-Omega 03e177849 - Use IConnectionProvider
[20:01:59] <botifico>	 [02ImportDump] 07Universal-Omega synchronize pull request 03#95: Prepare for 1.42 migration to ConnectionProvider - 13https://github.com/miraheze/ImportDump/pull/95
[20:02:02] <botifico>	 [02ImportDump] 07Universal-Omega pushed 031 commit to 03connectionprovider [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/e17784903813...a99ef06c722d
[20:02:05] <botifico>	 [02ImportDump] 07Universal-Omega 03a99ef06 - Fix
[20:02:40] <botifico>	 [02ImportDump] 07Universal-Omega synchronize pull request 03#95: Prepare for 1.42 migration to ConnectionProvider - 13https://github.com/miraheze/ImportDump/pull/95
[20:02:41] <botifico>	 [02ImportDump] 07Universal-Omega pushed 031 commit to 03connectionprovider [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/a99ef06c722d...c08a674e3efb
[20:02:42] <botifico>	 [02ImportDump] 07Universal-Omega 03c08a674 - Use IConnectionProvider
[20:03:21] <botifico>	 [02ImportDump] 07Universal-Omega synchronize pull request 03#95: Prepare for 1.42 migration to ConnectionProvider - 13https://github.com/miraheze/ImportDump/pull/95
[20:03:24] <botifico>	 [02ImportDump] 07Universal-Omega pushed 031 commit to 03connectionprovider [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/c08a674e3efb...114d3f96b07d
[20:03:27] <botifico>	 [02ImportDump] 07Universal-Omega 03114d3f9 - Use IConnectionProvider
[20:11:30] <miraheze-github>	 miraheze/ImportDump - Universal-Omega the build passed.
[20:20:46] <botifico>	 [02ImportDump] 07Universal-Omega edited pull request 03#95: Prepare for 1.42 migration to ConnectionProvider - 13https://github.com/miraheze/ImportDump/pull/95
[20:26:28] <icinga-miraheze>	 PROBLEM - private.yahyabd.xyz - reverse DNS on sslhost is WARNING: LifetimeTimeout: The resolution lifetime expired after 5.408 seconds: Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.
[20:56:26] <icinga-miraheze>	 PROBLEM - private.yahyabd.xyz - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - private.yahyabd.xyz All nameservers failed to answer the query.
[21:17:25] <icinga-miraheze>	 [Grafana] !sre FIRING: The mediawiki job queue has more than 500 unclaimed jobs https://grafana.wikitide.net/d/GtxbP1Xnk?orgId=1
[21:26:28] <icinga-miraheze>	 PROBLEM - private.yahyabd.xyz - reverse DNS on sslhost is WARNING: LifetimeTimeout: The resolution lifetime expired after 5.404 seconds: Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.
[22:26:26] <icinga-miraheze>	 PROBLEM - private.yahyabd.xyz - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - private.yahyabd.xyz All nameservers failed to answer the query.
[22:49:12] <icinga-miraheze>	 PROBLEM - franchise.franchising.org.ua - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query franchise.franchising.org.ua. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL
[22:56:28] <icinga-miraheze>	 PROBLEM - private.yahyabd.xyz - reverse DNS on sslhost is WARNING: LifetimeTimeout: The resolution lifetime expired after 5.403 seconds: Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.
[23:18:22] <icinga-miraheze>	 PROBLEM - franchise.franchising.org.ua - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - franchise.franchising.org.ua All nameservers failed to answer the query.
[23:26:27] <icinga-miraheze>	 PROBLEM - private.yahyabd.xyz - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - private.yahyabd.xyz All nameservers failed to answer the query.
[23:47:33] <icinga-miraheze>	 RECOVERY - franchise.franchising.org.ua - reverse DNS on sslhost is OK: SSL OK - franchise.franchising.org.ua reverse DNS resolves to cp36.wikitide.net - CNAME OK
[23:56:28] <icinga-miraheze>	 PROBLEM - private.yahyabd.xyz - reverse DNS on sslhost is WARNING: LifetimeTimeout: The resolution lifetime expired after 5.405 seconds: Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.