[01:59:45] [02mw-config] 07clarfonthey commented on pull request 03#5521: Add "Special:" in more languages - 13https://github.com/miraheze/mw-config/pull/5521#issuecomment-2101793919 [02:01:17] [02mw-config] 07clarfonthey reviewed pull request 03#5529 commit - 13https://github.com/miraheze/mw-config/pull/5529#discussion_r1594876815 [02:04:15] [02mw-config] 07clarfonthey commented on pull request 03#5527: Change the license image to be an svg - 13https://github.com/miraheze/mw-config/pull/5527#issuecomment-2101797499 [02:14:04] [02mw-config] 07Universal-Omega synchronize pull request 03#5529: Allow using orain.org and wiki.surf also - 13https://github.com/miraheze/mw-config/pull/5529 [02:14:05] [02mw-config] 07Universal-Omega pushed 031 commit to 03more-domains [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/4f1043485538...c858e813893f [02:14:08] [02mw-config] 07Universal-Omega 03c858e81 - Fix indentation [02:14:18] [02mw-config] 07Universal-Omega reviewed pull request 03#5529 commit - 13https://github.com/miraheze/mw-config/pull/5529#discussion_r1594883386 [02:15:02] miraheze/mw-config - Universal-Omega the build passed. [02:15:31] [02mw-config] 07Universal-Omega closed pull request 03#5527: Change the license image to be an svg - 13https://github.com/miraheze/mw-config/pull/5527 [02:15:33] [02mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/acc5400531bd...3b56d1838c48 [02:15:35] [02mw-config] 07colleirose 033b56d18 - Change the license image to be an svg (#5527) [02:16:27] miraheze/mw-config - Universal-Omega the build passed. [02:22:25] [Grafana] !sre RESOLVED: High Job Queue Backlog https://grafana.wikitide.net/d/GtxbP1Xnk?orgId=1 [02:23:56] !log [@test151] starting deploy of {'config': True} to test151 [02:23:57] !log [@test151] finished deploy of {'config': True} to test151 - SUCCESS in 0s [02:24:01] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:24:04] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:32:50] !log [@mwtask181] starting deploy of {'config': True} to all [02:32:54] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:33:00] !log [@mwtask181] finished deploy of {'config': True} to all - SUCCESS in 10s [02:33:04] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:37:50] !log [@mwtask171] starting deploy of {'config': True} to all [02:37:54] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:37:58] !log [@mwtask171] finished deploy of {'config': True} to all - SUCCESS in 8s [02:38:01] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:00:44] PROBLEM - mon181 Backups Grafana on mon181 is CRITICAL: FILE_AGE CRITICAL: /var/log/grafana-backup.log is 1209624 seconds old and 93 bytes [05:08:20] PROBLEM - test151 APT on test151 is CRITICAL: APT CRITICAL: 32 packages available for upgrade (5 critical updates). [05:42:25] [Grafana] !sre FIRING: The mediawiki job queue has more than 500 unclaimed jobs https://grafana.wikitide.net/d/GtxbP1Xnk?orgId=1 [05:57:25] [Grafana] !sre RESOLVED: High Job Queue Backlog https://grafana.wikitide.net/d/GtxbP1Xnk?orgId=1 [06:33:28] PROBLEM - cp51 Puppet on cp51 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [06:42:25] [Grafana] !sre FIRING: The mediawiki job queue has more than 500 unclaimed jobs https://grafana.wikitide.net/d/GtxbP1Xnk?orgId=1 [07:01:27] RECOVERY - cp51 Puppet on cp51 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [07:07:44] PROBLEM - ping6 on cp51 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 170.59 ms [07:11:48] RECOVERY - ping6 on cp51 is OK: PING OK - Packet loss = 0%, RTA = 167.79 ms [07:12:25] [Grafana] !sre RESOLVED: High Job Queue Backlog https://grafana.wikitide.net/d/GtxbP1Xnk?orgId=1 [07:19:31] [02mw-config] 07labster opened pull request 03#5556: Move StructuredDiscussions (Flow) to managewiki-restricted - 13https://github.com/miraheze/mw-config/pull/5556 [07:20:35] miraheze/mw-config - labster the build passed. [07:28:45] [02mw-config] 07Universal-Omega commented on pull request 03#5556: Move StructuredDiscussions (Flow) to managewiki-restricted - 13https://github.com/miraheze/mw-config/pull/5556#issuecomment-2102111488 [07:49:32] PROBLEM - eventgate181 APT on eventgate181 is WARNING: APT WARNING: 0 packages available for upgrade (0 critical updates). warnings detected, errors detected. [07:51:23] [02mw-config] 07labster commented on pull request 03#5556: Move StructuredDiscussions (Flow) to managewiki-restricted - 13https://github.com/miraheze/mw-config/pull/5556#issuecomment-2102142373 [07:51:33] PROBLEM - eventgate181 APT on eventgate181 is CRITICAL: APT CRITICAL: 28 packages available for upgrade (27 critical updates). [07:57:40] PROBLEM - ping6 on cp51 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 166.77 ms [07:59:41] RECOVERY - ping6 on cp51 is OK: PING OK - Packet loss = 0%, RTA = 170.97 ms [08:36:04] [02mw-config] 07Universal-Omega commented on pull request 03#5556: Move StructuredDiscussions (Flow) to managewiki-restricted - 13https://github.com/miraheze/mw-config/pull/5556#issuecomment-2102212541 [09:55:16] PROBLEM - ping6 on cp51 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 169.44 ms [09:57:17] RECOVERY - ping6 on cp51 is OK: PING OK - Packet loss = 0%, RTA = 166.62 ms [10:30:40] PROBLEM - ping6 on cp51 is CRITICAL: PING CRITICAL - Packet loss = 28%, RTA = 174.64 ms [10:32:40] RECOVERY - ping6 on cp51 is OK: PING OK - Packet loss = 0%, RTA = 167.38 ms [11:57:49] PROBLEM - ping6 on cp51 is CRITICAL: PING CRITICAL - Packet loss = 28%, RTA = 169.08 ms [11:59:49] RECOVERY - ping6 on cp51 is OK: PING OK - Packet loss = 0%, RTA = 168.37 ms [12:09:24] PROBLEM - wiki.mahdiruiz.line.pm - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query wiki.mahdiruiz.line.pm. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [12:11:28] [02GlobalNewFiles] 07translatewiki pushed 031 commit to 03master [+0/-0/±2] 13https://github.com/miraheze/GlobalNewFiles/compare/6f543311b27c...ee42af46d222 [12:11:31] [02GlobalNewFiles] 07translatewiki 03ee42af4 - Localisation updates from https://translatewiki.net. [12:11:33] [02ImportDump] 07translatewiki pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/5080e4602182...d45bd3c204b3 [12:11:35] [02ImportDump] 07translatewiki 03d45bd3c - Localisation updates from https://translatewiki.net. [12:11:38] [02RequestSSL] 07translatewiki pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/RequestSSL/compare/2ff821c204ae...0cf71a7648a5 [12:11:39] [02RequestSSL] 07translatewiki 030cf71a7 - Localisation updates from https://translatewiki.net. [12:11:41] [02MirahezeMagic] 07translatewiki pushed 031 commit to 03master [+0/-0/±6] 13https://github.com/miraheze/MirahezeMagic/compare/7ccbe2853138...7d8ac7dd3070 [12:11:44] [02MirahezeMagic] 07translatewiki 037d8ac7d - Localisation updates from https://translatewiki.net. [12:11:45] [02SpriteSheet] 07translatewiki pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/SpriteSheet/compare/f7596b3fb78e...60ee82d9a687 [12:11:47] [02SpriteSheet] 07translatewiki 0360ee82d - Localisation updates from https://translatewiki.net. [12:15:00] miraheze/MirahezeMagic - translatewiki the build has errored. [12:15:23] miraheze/SpriteSheet - translatewiki the build has errored. [12:16:10] miraheze/GlobalNewFiles - translatewiki the build passed. [12:20:45] miraheze/ImportDump - translatewiki the build passed. [12:21:00] miraheze/RequestSSL - translatewiki the build passed. [12:23:17] !log [@test151] starting deploy of {'folders': '1.41/extensions/MirahezeMagic'} to test151 [12:23:18] !log [@test151] finished deploy of {'folders': '1.41/extensions/MirahezeMagic'} to test151 - SUCCESS in 0s [12:23:21] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:23:25] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:23:29] !log [@test151] starting deploy of {'folders': '1.42/extensions/MirahezeMagic'} to test151 [12:23:30] !log [@test151] finished deploy of {'folders': '1.42/extensions/MirahezeMagic'} to test151 - SUCCESS in 0s [12:23:33] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:23:37] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:23:39] !log [@test151] starting deploy of {'folders': '1.43/extensions/MirahezeMagic'} to test151 [12:23:40] !log [@test151] finished deploy of {'folders': '1.43/extensions/MirahezeMagic'} to test151 - SUCCESS in 0s [12:23:43] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:23:48] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:32:36] !log [@mwtask181] starting deploy of {'folders': '1.41/extensions/MirahezeMagic'} to all [12:32:40] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:32:46] !log [@mwtask181] finished deploy of {'folders': '1.41/extensions/MirahezeMagic'} to all - SUCCESS in 10s [12:32:50] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:32:56] !log [@mwtask181] starting deploy of {'folders': '1.42/extensions/MirahezeMagic'} to all [12:32:59] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:33:05] !log [@mwtask181] finished deploy of {'folders': '1.42/extensions/MirahezeMagic'} to all - SUCCESS in 9s [12:33:09] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:38:03] !log [@mwtask171] starting deploy of {'folders': '1.41/extensions/MirahezeMagic'} to all [12:38:07] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:38:11] !log [@mwtask171] finished deploy of {'folders': '1.41/extensions/MirahezeMagic'} to all - SUCCESS in 8s [12:38:15] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:38:22] !log [@mwtask171] starting deploy of {'folders': '1.42/extensions/MirahezeMagic'} to all [12:38:25] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:38:30] !log [@mwtask171] finished deploy of {'folders': '1.42/extensions/MirahezeMagic'} to all - SUCCESS in 8s [12:38:34] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:38:36] PROBLEM - ping6 on cp51 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 170.32 ms [12:39:23] RECOVERY - wiki.mahdiruiz.line.pm - reverse DNS on sslhost is OK: SSL OK - wiki.mahdiruiz.line.pm reverse DNS resolves to cp36.wikitide.net - CNAME OK [12:42:38] RECOVERY - ping6 on cp51 is OK: PING OK - Packet loss = 0%, RTA = 170.91 ms [13:33:50] PROBLEM - private.yahyabd.xyz - reverse DNS on sslhost is WARNING: LifetimeTimeout: The resolution lifetime expired after 5.408 seconds: Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out. [14:03:46] PROBLEM - private.yahyabd.xyz - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - private.yahyabd.xyz All nameservers failed to answer the query. [14:11:16] PROBLEM - wiki.mahdiruiz.line.pm - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query wiki.mahdiruiz.line.pm. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [14:17:25] [Grafana] !sre FIRING: The mediawiki job queue has more than 500 unclaimed jobs https://grafana.wikitide.net/d/GtxbP1Xnk?orgId=1 [14:41:09] RECOVERY - wiki.mahdiruiz.line.pm - reverse DNS on sslhost is OK: SSL OK - wiki.mahdiruiz.line.pm reverse DNS resolves to cp37.wikitide.net - CNAME OK [14:42:25] [Grafana] !sre RESOLVED: High Job Queue Backlog https://grafana.wikitide.net/d/GtxbP1Xnk?orgId=1 [15:18:38] [02mw-config] 07redbluegreenhat closed pull request 03#5556: Move StructuredDiscussions (Flow) to managewiki-restricted - 13https://github.com/miraheze/mw-config/pull/5556 [15:18:41] [02mw-config] 07redbluegreenhat pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/3b56d1838c48...d51725875aaa [15:18:43] [02mw-config] 07labster 03d517258 - Move StructuredDiscussions (Flow) to managewiki-restricted (#5556) [15:19:59] miraheze/mw-config - redbluegreenhat the build passed. [15:23:40] !log [@test151] starting deploy of {'config': True} to test151 [15:23:41] !log [@test151] finished deploy of {'config': True} to test151 - SUCCESS in 0s [15:23:44] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:23:48] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:30:41] PROBLEM - ping6 on cp51 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 166.96 ms [15:32:01] !log [@mwtask181] starting deploy of {'config': True} to all [15:32:05] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:32:11] !log [@mwtask181] finished deploy of {'config': True} to all - SUCCESS in 9s [15:32:15] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:34:43] RECOVERY - ping6 on cp51 is OK: PING OK - Packet loss = 0%, RTA = 168.72 ms [15:37:40] !log [@mwtask171] starting deploy of {'config': True} to all [15:37:44] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:37:49] !log [@mwtask171] finished deploy of {'config': True} to all - SUCCESS in 8s [15:37:52] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:57:01] !log [alex@mw151] Upgraded packages libglib2.0-dev, libglib2.0-dev-bin, libglib2.0-data, libglib2.0-bin, libglib2.0-0, libdav1d6, linux-image-6.1.0-21-amd64, linux-image-amd64, and linux-libc-dev [15:57:05] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:57:13] RECOVERY - mw151 APT on mw151 is OK: APT OK: 27 packages available for upgrade (0 critical updates). [15:58:34] !log rebooted mw151 [15:58:38] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:03:39] PROBLEM - wiki.yahyabd.xyz - reverse DNS on sslhost is WARNING: LifetimeTimeout: The resolution lifetime expired after 5.402 seconds: Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out. [16:04:01] !log [alex@mw152] Upgraded packages libglib2.0-dev, libglib2.0-dev-bin, libglib2.0-data, libglib2.0-bin, libglib2.0-0, libdav1d6, linux-image-6.1.0-21-amd64, linux-image-amd64, and linux-libc-dev [16:04:05] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:04:31] !log rebooted mw152 [16:04:34] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:06:37] RECOVERY - mw152 APT on mw152 is OK: APT OK: 27 packages available for upgrade (0 critical updates). [16:07:38] !log [alex@mw161] Upgraded packages libglib2.0-dev, libglib2.0-dev-bin, libglib2.0-data, libglib2.0-bin, libglib2.0-0, libdav1d6, linux-image-6.1.0-21-amd64, linux-image-amd64, and linux-libc-dev [16:07:41] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:07:57] !log rebooted mw161 [16:08:01] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:09:20] RECOVERY - mw161 APT on mw161 is OK: APT OK: 27 packages available for upgrade (0 critical updates). [16:11:07] !log [alex@mw162] Upgraded packages libglib2.0-dev, libglib2.0-dev-bin, libglib2.0-data, libglib2.0-bin, libglib2.0-0, libdav1d6, linux-image-6.1.0-21-amd64, linux-image-amd64, and linux-libc-dev [16:11:11] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:11:20] !log rebooted mw162 [16:11:35] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:11:47] RECOVERY - mw162 APT on mw162 is OK: APT OK: 27 packages available for upgrade (0 critical updates). [16:13:05] !log [alex@mw171] Upgraded packages libglib2.0-dev, libglib2.0-dev-bin, libglib2.0-data, libglib2.0-bin, libglib2.0-0, libdav1d6, linux-image-6.1.0-21-amd64, linux-image-amd64, and linux-libc-dev [16:13:09] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:13:16] !log rebooted mw171 [16:13:20] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:14:04] RECOVERY - mw171 APT on mw171 is OK: APT OK: 27 packages available for upgrade (0 critical updates). [16:15:25] !log [alex@mw172] Upgraded packages libglib2.0-dev, libglib2.0-dev-bin, libglib2.0-data, libglib2.0-bin, libglib2.0-0, libdav1d6, linux-image-6.1.0-21-amd64, linux-image-amd64, and linux-libc-dev [16:15:29] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:15:37] !log rebooted mw172 [16:15:41] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:16:30] RECOVERY - mw172 APT on mw172 is OK: APT OK: 27 packages available for upgrade (0 critical updates). [16:18:23] !log [alex@mwtask171] Upgraded packages libdav1d6, libglib2.0-dev, libglib2.0-dev-bin, libglib2.0-data, libglib2.0-bin, libglib2.0-0, linux-image-6.1.0-21-amd64, linux-image-amd64, and linux-libc-dev [16:18:26] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:18:36] !log rebooted mwtask171 [16:18:39] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:19:01] RECOVERY - mwtask171 APT on mwtask171 is OK: APT OK: 1 packages available for upgrade (0 critical updates). [16:20:26] !log [alex@mw181] Upgraded packages libglib2.0-dev, libglib2.0-dev-bin, libglib2.0-data, libglib2.0-bin, libglib2.0-0, libdav1d6, linux-image-6.1.0-21-amd64, linux-image-amd64, and linux-libc-dev [16:20:29] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:20:58] !log rebooted mw181 [16:21:02] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:21:59] RECOVERY - mw181 APT on mw181 is OK: APT OK: 27 packages available for upgrade (0 critical updates). [16:23:27] !log [alex@mw182] Upgraded packages libglib2.0-dev, libglib2.0-dev-bin, libglib2.0-data, libglib2.0-bin, libglib2.0-0, libdav1d6, linux-image-6.1.0-21-amd64, linux-image-amd64, and linux-libc-dev [16:23:31] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:23:37] !log rebooted mw182 [16:23:41] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:25:48] RECOVERY - mw182 APT on mw182 is OK: APT OK: 27 packages available for upgrade (0 critical updates). [16:26:43] !log [alex@mwtask181] Upgraded packages libdav1d6, libglib2.0-dev, libglib2.0-dev-bin, libglib2.0-data, libglib2.0-bin, libglib2.0-0, linux-image-6.1.0-21-amd64, linux-image-amd64, and linux-libc-dev [16:26:47] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:26:53] !log rebooted mwtask181 [16:26:57] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:27:26] RECOVERY - mwtask181 APT on mwtask181 is OK: APT OK: 1 packages available for upgrade (0 critical updates). [16:27:47] !log [alex@test151] Upgraded packages libglib2.0-dev, libglib2.0-dev-bin, libglib2.0-data, libglib2.0-bin, libglib2.0-0, and libdav1d6 [16:27:51] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:28:20] RECOVERY - test151 APT on test151 is OK: APT OK: 27 packages available for upgrade (0 critical updates). [16:29:27] !log rebooted test151 [16:29:31] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:33:40] PROBLEM - wiki.yahyabd.xyz - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.yahyabd.xyz All nameservers failed to answer the query. [16:52:00] [02puppet] 07Universal-Omega pushed 031 commit to 03relaybot-dotnet [+0/-0/±1] 13https://github.com/miraheze/puppet/commit/31df2f515560 [16:52:03] [02puppet] 07Universal-Omega 0331df2f5 - relaybot: pass dotnet version as parameter [16:52:05] [02puppet] 07Universal-Omega created branch 03relaybot-dotnet - 13https://github.com/miraheze/puppet [16:52:07] [02puppet] 07Universal-Omega opened pull request 03#3850: relaybot: pass dotnet version as parameter - 13https://github.com/miraheze/puppet/pull/3850 [16:54:05] [02puppet] 07Universal-Omega pushed 031 commit to 03relaybot-dotnet [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/31df2f515560...2eb50ca75d18 [16:54:08] [02puppet] 07Universal-Omega 032eb50ca - Update [16:54:10] [02puppet] 07Universal-Omega synchronize pull request 03#3850: relaybot: pass dotnet version as parameter - 13https://github.com/miraheze/puppet/pull/3850 [16:55:24] [02puppet] 07Universal-Omega closed pull request 03#3850: relaybot: pass dotnet version as parameter - 13https://github.com/miraheze/puppet/pull/3850 [16:55:26] [02puppet] 07Universal-Omega deleted branch 03relaybot-dotnet [16:55:28] [02puppet] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±2] 13https://github.com/miraheze/puppet/compare/536b458d8c34...61d7bc3ef9c8 [16:55:31] [02puppet] 07Universal-Omega 0361d7bc3 - relaybot: pass dotnet version as parameter (#3850) [16:55:34] [02puppet] 07Universal-Omega deleted branch 03relaybot-dotnet - 13https://github.com/miraheze/puppet [17:03:42] PROBLEM - wiki.yahyabd.xyz - reverse DNS on sslhost is WARNING: LifetimeTimeout: The resolution lifetime expired after 5.403 seconds: Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out. [17:06:56] [02puppet] 07Universal-Omega pushed 031 commit to 03relaybot-title [+0/-0/±1] 13https://github.com/miraheze/puppet/commit/e0677909bd81 [17:06:59] [02puppet] 07Universal-Omega 03e067790 - relaybot: use title instead of instance variable [17:07:01] [02puppet] 07Universal-Omega created branch 03relaybot-title - 13https://github.com/miraheze/puppet [17:07:05] [02puppet] 07Universal-Omega opened pull request 03#3851: relaybot: use title instead of instance variable - 13https://github.com/miraheze/puppet/pull/3851 [17:07:58] [02puppet] 07Universal-Omega pushed 031 commit to 03relaybot-title [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/e0677909bd81...18bdbe52dce0 [17:08:01] [02puppet] 07Universal-Omega 0318bdbe5 - Update [17:08:04] [02puppet] 07Universal-Omega synchronize pull request 03#3851: relaybot: use title instead of instance variable - 13https://github.com/miraheze/puppet/pull/3851 [17:08:32] [02puppet] 07Universal-Omega pushed 031 commit to 03relaybot-title [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/18bdbe52dce0...4fca1c56d400 [17:08:34] [02puppet] 07Universal-Omega 034fca1c5 - Remove [17:08:35] [02puppet] 07Universal-Omega synchronize pull request 03#3851: relaybot: use title instead of instance variable - 13https://github.com/miraheze/puppet/pull/3851 [17:10:23] [02puppet] 07Universal-Omega closed pull request 03#3851: relaybot: use title instead of instance variable - 13https://github.com/miraheze/puppet/pull/3851 [17:10:24] [02puppet] 07Universal-Omega deleted branch 03relaybot-title [17:10:25] [02puppet] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±3] 13https://github.com/miraheze/puppet/compare/61d7bc3ef9c8...a1af84c52baa [17:10:27] [02puppet] 07Universal-Omega 03a1af84c - relaybot: use title instead of instance variable (#3851) [17:10:28] [02puppet] 07Universal-Omega deleted branch 03relaybot-title - 13https://github.com/miraheze/puppet [17:15:27] PROBLEM - mon181 Check correctness of the icinga configuration on mon181 is CRITICAL: Icinga configuration contains errors [17:15:38] [02puppet] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/a1af84c52baa...b78157ebd8f9 [17:15:41] [02puppet] 07Universal-Omega 03b78157e - Fix [17:17:25] RECOVERY - mon181 Check correctness of the icinga configuration on mon181 is OK: Icinga configuration is correct [17:19:36] [02puppet] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/b78157ebd8f9...4da595f8560a [17:19:38] [02puppet] 07Universal-Omega 034da595f - Fix [17:33:43] PROBLEM - wiki.yahyabd.xyz - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.yahyabd.xyz All nameservers failed to answer the query. [17:33:50] PROBLEM - private.yahyabd.xyz - reverse DNS on sslhost is WARNING: LifetimeTimeout: The resolution lifetime expired after 5.409 seconds: Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out. [17:46:58] PROBLEM - wiki.mahdiruiz.line.pm - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query line.pm. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [18:03:31] PROBLEM - private.yahyabd.xyz - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - private.yahyabd.xyz All nameservers failed to answer the query. [18:45:45] RECOVERY - wiki.mahdiruiz.line.pm - reverse DNS on sslhost is OK: SSL OK - wiki.mahdiruiz.line.pm reverse DNS resolves to cp37.wikitide.net - CNAME OK [18:56:18] PROBLEM - ping6 on cp51 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 174.20 ms [18:58:20] RECOVERY - ping6 on cp51 is OK: PING OK - Packet loss = 0%, RTA = 175.29 ms [19:46:32] PROBLEM - wiki.mahdiruiz.line.pm - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query wiki.mahdiruiz.line.pm. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [20:07:25] PROBLEM - ping6 on cp51 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 169.24 ms [20:09:26] RECOVERY - ping6 on cp51 is OK: PING OK - Packet loss = 0%, RTA = 171.01 ms [20:13:35] PROBLEM - ping6 on cp51 is CRITICAL: PING CRITICAL - Packet loss = 28%, RTA = 166.31 ms [20:15:36] RECOVERY - ping6 on cp51 is OK: PING OK - Packet loss = 0%, RTA = 170.26 ms [20:15:56] RECOVERY - wiki.mahdiruiz.line.pm - reverse DNS on sslhost is OK: SSL OK - wiki.mahdiruiz.line.pm reverse DNS resolves to cp36.wikitide.net - CNAME OK [20:43:08] [02ImportDump] 07Universal-Omega closed pull request 03#95: Prepare for 1.42 migration to ConnectionProvider - 13https://github.com/miraheze/ImportDump/pull/95 [20:43:09] [02ImportDump] 07Universal-Omega deleted branch 03connectionprovider [20:43:10] [02ImportDump] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±5] 13https://github.com/miraheze/ImportDump/compare/d45bd3c204b3...9d8e299d35e0 [20:43:12] [02ImportDump] 07Universal-Omega 039d8e299 - Prepare for 1.42 migration to ConnectionProvider (#95) [20:43:13] [02ImportDump] 07Universal-Omega deleted branch 03connectionprovider - 13https://github.com/miraheze/ImportDump [20:48:56] [02ImportDump] 07Universal-Omega created branch 03row 13https://github.com/miraheze/ImportDump/commit/9d8e299d35e0df49c7d4ad69acda3423681ff1f8 [20:49:02] [02ImportDump] 07Universal-Omega created branch 03row - 13https://github.com/miraheze/ImportDump [20:49:09] [02ImportDump] 07Universal-Omega pushed 031 commit to 03row [+0/-0/±3] 13https://github.com/miraheze/ImportDump/compare/9d8e299d35e0...40937b40c615 [20:49:10] [02ImportDump] 07Universal-Omega 0340937b4 - Only using one row for inserts [20:49:25] [02ImportDump] 07Universal-Omega opened pull request 03#96: Only using one row for inserts - 13https://github.com/miraheze/ImportDump/pull/96 [20:52:03] miraheze/ImportDump - Universal-Omega the build passed. [20:55:59] [02ImportDump] 07Universal-Omega synchronize pull request 03#96: Only using one row for inserts - 13https://github.com/miraheze/ImportDump/pull/96 [20:56:00] [02ImportDump] 07Universal-Omega pushed 031 commit to 03row [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/40937b40c615...cc0f31af1b54 [20:56:03] [02ImportDump] 07Universal-Omega 03cc0f31a - Fix res check [21:02:25] [Grafana] !sre FIRING: The mediawiki job queue has more than 500 unclaimed jobs https://grafana.wikitide.net/d/GtxbP1Xnk?orgId=1 [21:04:21] miraheze/ImportDump - Universal-Omega the build passed. [21:04:44] [02ImportDump] 07Universal-Omega closed pull request 03#96: Only using one row for inserts - 13https://github.com/miraheze/ImportDump/pull/96 [21:04:45] [02ImportDump] 07Universal-Omega deleted branch 03row [21:04:46] [02ImportDump] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±3] 13https://github.com/miraheze/ImportDump/compare/9d8e299d35e0...aa90ee31afec [21:04:49] [02ImportDump] 07Universal-Omega 03aa90ee3 - Only using one row for inserts (#96) [21:04:51] [02ImportDump] 07Universal-Omega deleted branch 03row - 13https://github.com/miraheze/ImportDump [21:14:02] miraheze/ImportDump - Universal-Omega the build passed. [21:17:17] [02ImportDump] 07Universal-Omega pushed 031 commit to 03rawmessage [+0/-0/±1] 13https://github.com/miraheze/ImportDump/commit/6d479b375129 [21:17:18] [02ImportDump] 07Universal-Omega 036d479b3 - Update namespace for RawMessage [21:17:19] [02ImportDump] 07Universal-Omega created branch 03rawmessage - 13https://github.com/miraheze/ImportDump [21:17:21] [02ImportDump] 07Universal-Omega opened pull request 03#97: Update namespace for RawMessage - 13https://github.com/miraheze/ImportDump/pull/97 [21:17:55] [02ImportDump] 07Universal-Omega pushed 031 commit to 03rawmessage [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/6d479b375129...6a457c7f4ecb [21:17:57] [02ImportDump] 07Universal-Omega 036a457c7 - Update [21:17:59] [02ImportDump] 07Universal-Omega synchronize pull request 03#97: Update namespace for RawMessage - 13https://github.com/miraheze/ImportDump/pull/97 [21:26:49] miraheze/ImportDump - Universal-Omega the build passed. [21:28:24] [02ImportDump] 07Universal-Omega closed pull request 03#97: Update namespace for RawMessage - 13https://github.com/miraheze/ImportDump/pull/97 [21:28:26] [02ImportDump] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±2] 13https://github.com/miraheze/ImportDump/compare/aa90ee31afec...b2c9ab25ddb6 [21:28:27] [02ImportDump] 07Universal-Omega 03b2c9ab2 - Update namespace for RawMessage (#97) [21:28:29] [02ImportDump] 07Universal-Omega deleted branch 03rawmessage [21:28:32] [02ImportDump] 07Universal-Omega deleted branch 03rawmessage - 13https://github.com/miraheze/ImportDump [21:36:34] miraheze/ImportDump - Universal-Omega the build passed. [21:40:01] PROBLEM - ping6 on cp51 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 173.94 ms [21:42:03] RECOVERY - ping6 on cp51 is OK: PING OK - Packet loss = 0%, RTA = 164.95 ms [21:48:12] PROBLEM - wiki.mahdiruiz.line.pm - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query line.pm. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [22:01:13] PROBLEM - graphite151 NTP time on graphite151 is UNKNOWN: check_ntp_time: Invalid hostname/address - time.cloudflare.comUsage: check_ntp_time -H [-4|-6] [-w ] [-c ] [-v verbose] [-o