[00:00:20] PROBLEM - cp26 HTTP 4xx/5xx ERROR Rate on cp26 is UNKNOWN: UNKNOWN - NGINX Error Rate is UNKNOWN [00:02:20] PROBLEM - cp26 HTTP 4xx/5xx ERROR Rate on cp26 is CRITICAL: CRITICAL - NGINX Error Rate is 100% [00:03:52] RECOVERY - cp36 Disk Space on cp36 is OK: DISK OK - free space: / 21778MiB (24% inode=98%); [00:04:12] RECOVERY - cp37 Disk Space on cp37 is OK: DISK OK - free space: / 21880MiB (24% inode=98%); [00:29:24] [02landing] 07Xenareee opened pull request 03#139: Fix "Ad-free" link to point to FAQ instead of non-existent page - 13https://github.com/miraheze/landing/pull/139 [00:30:10] miraheze/landing - Xenareee the build passed. [00:33:02] PROBLEM - ping6 on cp26 is CRITICAL: PING CRITICAL - Packet loss = 37%, RTA = 139.50 ms [00:35:00] RECOVERY - ping6 on cp26 is OK: PING OK - Packet loss = 0%, RTA = 140.21 ms [00:44:41] [02landing] 07Xenareee edited pull request 03#139: Fix "Ad-free" link to point to FAQ instead of non-existent page - 13https://github.com/miraheze/landing/pull/139 [00:44:47] [02landing] 07Xenareee edited pull request 03#139: Fix "Ad-free" link to point to FAQ instead of non-existent page - 13https://github.com/miraheze/landing/pull/139 [00:45:01] PROBLEM - ping6 on cp26 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 185.19 ms [00:46:59] RECOVERY - ping6 on cp26 is OK: PING OK - Packet loss = 0%, RTA = 139.51 ms [01:03:59] RECOVERY - cp27 HTTP 4xx/5xx ERROR Rate on cp27 is OK: OK - NGINX Error Rate is 26% [01:11:53] RECOVERY - wiki.mahdiruiz.line.pm - reverse DNS on sslhost is OK: SSL OK - wiki.mahdiruiz.line.pm reverse DNS resolves to cp37.wikitide.net - CNAME OK [02:07:59] PROBLEM - cp27 HTTP 4xx/5xx ERROR Rate on cp27 is WARNING: WARNING - NGINX Error Rate is 40% [03:30:36] [Grafana] !sre FIRING: The mediawiki job queue has more than 500 unclaimed jobs https://grafana.miraheze.org/d/GtxbP1Xnk?orgId=1 [03:35:36] [Grafana] !sre RESOLVED: High Job Queue Backlog https://grafana.miraheze.org/d/GtxbP1Xnk?orgId=1 [05:24:34] PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 169.28 ms [05:28:31] RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 175.33 ms [06:07:29] PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 166.09 ms [06:11:28] RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 177.52 ms [06:13:59] PROBLEM - cp27 HTTP 4xx/5xx ERROR Rate on cp27 is CRITICAL: CRITICAL - NGINX Error Rate is 60% [06:36:26] PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 169.16 ms [06:40:27] RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 176.84 ms [06:52:24] PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 179.46 ms [06:56:23] RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 178.61 ms [07:10:26] PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 179.29 ms [07:12:25] RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 181.02 ms [07:24:34] PROBLEM - wiki.gab.pt.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.gab.pt.eu.org All nameservers failed to answer the query. [07:28:44] PROBLEM - wiki.andreijiroh.uk.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.andreijiroh.uk.eu.org All nameservers failed to answer the query. [07:54:36] PROBLEM - wiki.gab.pt.eu.org - reverse DNS on sslhost is WARNING: SSL WARNING - rDNS OK but records conflict. {'NS': ['ns.ankh.fr.eu.org.', 'ns1.eu.org.', 'ns1.eriomem.net.'], 'CNAME': 'bouncingwiki.miraheze.org.'} [08:28:14] RECOVERY - wiki.andreijiroh.uk.eu.org - reverse DNS on sslhost is OK: SSL OK - wiki.andreijiroh.uk.eu.org reverse DNS resolves to cp37.wikitide.net - CNAME OK [09:01:48] PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 177.70 ms [09:03:47] RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 172.65 ms [10:37:54] PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 177.35 ms [10:39:52] RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 172.80 ms [11:04:44] PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 178.93 ms [11:08:42] RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 178.01 ms [11:58:57] PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 179.53 ms [12:02:55] RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 178.10 ms [12:07:00] PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 180.36 ms [12:08:58] RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 181.68 ms [12:13:02] PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 181.95 ms [12:17:01] RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 181.35 ms [12:23:05] PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 182.06 ms [12:24:35] PROBLEM - wiki.gab.pt.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.gab.pt.eu.org All nameservers failed to answer the query. [12:29:03] RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 183.86 ms [12:44:40] PROBLEM - wiki.mahdiruiz.line.pm - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query line.pm. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [12:54:36] PROBLEM - wiki.gab.pt.eu.org - reverse DNS on sslhost is WARNING: SSL WARNING - rDNS OK but records conflict. {'NS': ['ns.ankh.fr.eu.org.', 'ns1.eu.org.', 'ns1.eriomem.net.'], 'CNAME': 'bouncingwiki.miraheze.org.'} [13:14:12] RECOVERY - wiki.mahdiruiz.line.pm - reverse DNS on sslhost is OK: SSL OK - wiki.mahdiruiz.line.pm reverse DNS resolves to cp37.wikitide.net - CNAME OK [13:24:35] PROBLEM - wiki.gab.pt.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.gab.pt.eu.org All nameservers failed to answer the query. [13:28:11] PROBLEM - mw181 Puppet on mw181 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Package[libboost-regex1.74.0-icu72] [13:35:53] PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 28%, RTA = 184.46 ms [13:39:50] RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 184.04 ms [13:54:36] PROBLEM - wiki.gab.pt.eu.org - reverse DNS on sslhost is WARNING: SSL WARNING - rDNS OK but records conflict. {'NS': ['NS.ANKH.FR.eu.org.', 'NS1.eu.org.', 'NS1.ERIOMEM.NET.'], 'CNAME': 'bouncingwiki.miraheze.org.'} [13:54:56] PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 185.04 ms [13:56:11] RECOVERY - mw181 Puppet on mw181 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [13:56:54] RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 187.08 ms [14:15:04] PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 197.38 ms [14:17:02] RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 186.00 ms [14:31:08] PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 44%, RTA = 196.87 ms [14:35:06] RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 194.69 ms [14:44:10] PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 197.50 ms [14:46:09] RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 201.79 ms [15:10:47] PROBLEM - bots171 Puppet on bots171 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): File[/srv/pywikibot/families/miraheze_family.py] [15:39:48] [02miraheze/puppet] 07AgentIsai pushed 031 commit to 03master [+3/-0/±1] 13https://github.com/miraheze/puppet/compare/5ae946ee72bc...a120fcd704e8 [15:39:49] [02miraheze/puppet] 07AgentIsai 03a120fcd - Add PyWikiBot module [15:42:52] !log [agent@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/extensions/CreateWiki/maintenance/deleteWiki.php --wiki=metawiki --delete --deletewiki sagan4alphawiki (END - exit=0) [15:42:55] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:43:59] [02miraheze/puppet] 07AgentIsai pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/a120fcd704e8...debb2673a46a [15:44:02] [02miraheze/puppet] 07AgentIsai 03debb267 - pywikibot: Require packages [15:44:47] RECOVERY - bots171 Puppet on bots171 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [15:48:28] [02RequestSSL] 07redbluegreenhat opened pull request 03#37: Inject createwikihookrunner - 13https://github.com/miraheze/RequestSSL/pull/37 [15:48:46] [02miraheze/puppet] 07AgentIsai pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/debb2673a46a...75af5c650b07 [15:48:47] [02miraheze/puppet] 07AgentIsai 0375af5c6 - Remove some packages [15:48:59] [02miraheze/puppet] 07AgentIsai pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/75af5c650b07...f80979428c14 [15:49:02] [02miraheze/puppet] 07AgentIsai 03f809794 - pwb: fix client [15:50:05] [02miraheze/puppet] 07AgentIsai pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/f80979428c14...3b5e436c070d [15:50:07] [02miraheze/puppet] 07AgentIsai 033b5e436 - pywikibot: trigger python3 [15:58:24] PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 37%, RTA = 197.70 ms [16:01:59] [02RequestSSL] 07redbluegreenhat edited pull request 03#37: Pass CreateWikiHookRunner to RemoteWiki - 13https://github.com/miraheze/RequestSSL/pull/37 [16:02:11] [02RequestSSL] 07redbluegreenhat closed pull request 03#37: Pass CreateWikiHookRunner to RemoteWiki - 13https://github.com/miraheze/RequestSSL/pull/37 [16:02:14] [02miraheze/RequestSSL] 07redbluegreenhat pushed 031 commit to 03master [+0/-0/±4] 13https://github.com/miraheze/RequestSSL/compare/42cd87dc8f70...a4b0b3a14bfb [16:02:16] [02miraheze/RequestSSL] 07redbluegreenhat 03a4b0b3a - Pass CreateWikiHookRunner to RemoteWiki (#37) [16:04:24] RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 204.34 ms [16:05:35] !log [alex@test151] starting deploy of {'versions': '1.41', 'upgrade_extensions': 'RequestSSL'} to test151 [16:05:36] !log [alex@test151] finished deploy of {'versions': '1.41', 'upgrade_extensions': 'RequestSSL'} to test151 - SUCCESS in 1s [16:05:39] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:05:41] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:08:34] PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 28%, RTA = 198.38 ms [16:10:33] RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 194.99 ms [16:12:33] [02RequestSSL] 07redbluegreenhat opened pull request 03#38: Fix passing CreateWikiHookRunner to Special:RequestSSL - 13https://github.com/miraheze/RequestSSL/pull/38 [16:12:42] [02RequestSSL] 07redbluegreenhat closed pull request 03#38: Fix passing CreateWikiHookRunner to Special:RequestSSL - 13https://github.com/miraheze/RequestSSL/pull/38 [16:12:45] [02miraheze/RequestSSL] 07redbluegreenhat pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/RequestSSL/compare/a4b0b3a14bfb...7a8ff580f806 [16:12:46] !log [alex@test151] starting deploy of {'versions': '1.41', 'upgrade_extensions': 'RequestSSL'} to test151 [16:12:46] [02miraheze/RequestSSL] 07redbluegreenhat 037a8ff58 - Fix passing CreateWikiHookRunner to Special:RequestSSL (#38) [16:12:47] !log [alex@test151] finished deploy of {'versions': '1.41', 'upgrade_extensions': 'RequestSSL'} to test151 - SUCCESS in 1s [16:12:49] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:12:51] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:15:45] PROBLEM - wiki.mahdiruiz.line.pm - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query wiki.mahdiruiz.line.pm. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [16:16:16] miraheze/RequestSSL - redbluegreenhat the build has errored. [16:16:18] miraheze/RequestSSL - redbluegreenhat the build has errored. [16:31:54] PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 194.00 ms [16:35:51] RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 190.65 ms [16:37:24] includes/RequestSSLManager.php:293 PhanDeprecatedFunction Call to deprecated function \MediaWiki\User\UserRightsProxy::newFromName() defined at ../../includes/user/UserRightsProxy.php:133 (Deprecated because: Whole class is deprecated since 1.38. Hard-deprecated since 1.41) [16:37:46] I got some bad news for whoever is running RequestSSL on < 1.41 [16:38:21] cause I'm dropping that from the code [16:39:12] I think that class was used because some other class was bugged when ImportDump was being coded [16:39:16] I remember discussing this with UO [16:40:03] on MH we aren't using that class currently [16:40:16] and it is working fine [16:43:36] PROBLEM - wiki.metaiitgn.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.metaiitgn.org' expires in 15 day(s) (Sun 17 Mar 2024 04:33:23 PM GMT +0000). [16:43:48] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/6243a2cd194f...c1b0116d5b17 [16:43:51] [02miraheze/ssl] 07MirahezeSSLBot 03c1b0116 - Bot: Update SSL cert for wiki.metaiitgn.org [16:56:29] PROBLEM - wiki.cityrp.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.cityrp.org' expires in 15 day(s) (Sun 17 Mar 2024 04:34:46 PM GMT +0000). [16:56:41] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/c1b0116d5b17...90343617fd27 [16:56:43] [02miraheze/ssl] 07MirahezeSSLBot 039034361 - Bot: Update SSL cert for wiki.cityrp.org [17:00:38] PROBLEM - wiki.seamly.io - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.seamly.io' expires in 15 day(s) (Sun 17 Mar 2024 04:35:24 PM GMT +0000). [17:00:50] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/90343617fd27...0d0c080e22e1 [17:00:53] [02miraheze/ssl] 07MirahezeSSLBot 030d0c080 - Bot: Update SSL cert for wiki.seamly.io [17:01:11] PROBLEM - wiki.hacklabsr.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.hacklabsr.org' expires in 15 day(s) (Sun 17 Mar 2024 04:34:21 PM GMT +0000). [17:01:21] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/0d0c080e22e1...d75dd00291b6 [17:01:23] [02miraheze/ssl] 07MirahezeSSLBot 03d75dd00 - Bot: Update SSL cert for wiki.hacklabsr.org [17:03:11] PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 191.61 ms [17:07:08] RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 193.55 ms [17:13:12] RECOVERY - wiki.metaiitgn.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.metaiitgn.org' will expire on Thu 30 May 2024 03:43:42 PM GMT +0000. [17:14:03] [02ManageWiki] 07Universal-Omega created branch 03maintenance-cleanup - 13https://github.com/miraheze/ManageWiki [17:14:06] [02miraheze/ManageWiki] 07Universal-Omega pushed 031 commit to 03maintenance-cleanup [+0/-0/±1] 13https://github.com/miraheze/ManageWiki/commit/c40ff69a4281 [17:14:09] [02miraheze/ManageWiki] 07Universal-Omega 03c40ff69 - maintenance: cleanup and use modern functions [17:14:11] [02ManageWiki] 07Universal-Omega opened pull request 03#453: maintenance: cleanup and use modern functions - 13https://github.com/miraheze/ManageWiki/pull/453 [17:14:54] RECOVERY - wiki.mahdiruiz.line.pm - reverse DNS on sslhost is OK: SSL OK - wiki.mahdiruiz.line.pm reverse DNS resolves to cp37.wikitide.net - CNAME OK [17:15:20] [02miraheze/ManageWiki] 07Universal-Omega pushed 031 commit to 03maintenance-cleanup [+0/-0/±1] 13https://github.com/miraheze/ManageWiki/compare/c40ff69a4281...9fa0e185e55c [17:15:23] [02miraheze/ManageWiki] 07Universal-Omega 039fa0e18 - Update [17:15:25] [02ManageWiki] 07Universal-Omega synchronize pull request 03#453: maintenance: cleanup and use modern functions - 13https://github.com/miraheze/ManageWiki/pull/453 [17:15:52] [02miraheze/puppet] 07dependabot[bot] pushed 031 commit to 03dependabot/bundler/modules/graylog/yard-0.9.36 [+0/-0/±1] 13https://github.com/miraheze/puppet/commit/e0335c140e3b [17:15:53] [02miraheze/puppet] 07dependabot[bot] 03e0335c1 - build(deps-dev): bump yard from 0.9.35 to 0.9.36 in /modules/graylog [17:15:56] [02puppet] 07dependabot[bot] created branch 03dependabot/bundler/modules/graylog/yard-0.9.36 - 13https://github.com/miraheze/puppet [17:15:59] [02puppet] 07dependabot[bot] labeled pull request 03#3769: build(deps-dev): bump yard from 0.9.35 to 0.9.36 in /modules/graylog - 13https://github.com/miraheze/puppet/pull/3769 [17:16:02] [02puppet] 07dependabot[bot] labeled pull request 03#3769: build(deps-dev): bump yard from 0.9.35 to 0.9.36 in /modules/graylog - 13https://github.com/miraheze/puppet/pull/3769 [17:16:04] [02puppet] 07dependabot[bot] opened pull request 03#3769: build(deps-dev): bump yard from 0.9.35 to 0.9.36 in /modules/graylog - 13https://github.com/miraheze/puppet/pull/3769 [17:16:42] [02miraheze/ManageWiki] 07Universal-Omega pushed 031 commit to 03maintenance-cleanup [+0/-0/±1] 13https://github.com/miraheze/ManageWiki/compare/9fa0e185e55c...776137fd52da [17:16:43] [02miraheze/ManageWiki] 07Universal-Omega 03776137f - Update [17:16:45] [02ManageWiki] 07Universal-Omega synchronize pull request 03#453: maintenance: cleanup and use modern functions - 13https://github.com/miraheze/ManageWiki/pull/453 [17:20:22] [02miraheze/ManageWiki] 07Universal-Omega pushed 031 commit to 03maintenance-cleanup [+0/-0/±1] 13https://github.com/miraheze/ManageWiki/compare/776137fd52da...6fae076fc29a [17:20:25] [02miraheze/ManageWiki] 07Universal-Omega 036fae076 - Update [17:20:26] [02ManageWiki] 07Universal-Omega synchronize pull request 03#453: maintenance: cleanup and use modern functions - 13https://github.com/miraheze/ManageWiki/pull/453 [17:25:12] miraheze/ManageWiki - Universal-Omega the build passed. [17:25:28] RECOVERY - wiki.cityrp.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.cityrp.org' will expire on Thu 30 May 2024 03:56:35 PM GMT +0000. [17:26:04] [02miraheze/ManageWiki] 07Universal-Omega pushed 031 commit to 03maintenance-cleanup [+0/-0/±1] 13https://github.com/miraheze/ManageWiki/compare/6fae076fc29a...54c587b81681 [17:26:07] [02miraheze/ManageWiki] 07Universal-Omega 0354c587b - Update [17:26:09] [02ManageWiki] 07Universal-Omega synchronize pull request 03#453: maintenance: cleanup and use modern functions - 13https://github.com/miraheze/ManageWiki/pull/453 [17:29:15] RECOVERY - wiki.seamly.io - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.seamly.io' will expire on Thu 30 May 2024 04:00:44 PM GMT +0000. [17:29:21] PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 191.33 ms [17:29:49] [02miraheze/ManageWiki] 07Universal-Omega pushed 031 commit to 03maintenance-cleanup [+0/-0/±1] 13https://github.com/miraheze/ManageWiki/compare/54c587b81681...0a52b222cc3d [17:29:50] [02miraheze/ManageWiki] 07Universal-Omega 030a52b22 - Update [17:29:51] [02ManageWiki] 07Universal-Omega synchronize pull request 03#453: maintenance: cleanup and use modern functions - 13https://github.com/miraheze/ManageWiki/pull/453 [17:30:04] RECOVERY - wiki.hacklabsr.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.hacklabsr.org' will expire on Thu 30 May 2024 04:01:15 PM GMT +0000. [17:34:37] miraheze/ManageWiki - Universal-Omega the build passed. [17:37:18] [02miraheze/ManageWiki] 07Universal-Omega pushed 031 commit to 03maintenance-cleanup [+0/-0/±1] 13https://github.com/miraheze/ManageWiki/compare/0a52b222cc3d...2de32b285f06 [17:37:18] RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 195.41 ms [17:37:20] [02miraheze/ManageWiki] 07Universal-Omega 032de32b2 - Update [17:37:23] [02ManageWiki] 07Universal-Omega synchronize pull request 03#453: maintenance: cleanup and use modern functions - 13https://github.com/miraheze/ManageWiki/pull/453 [17:41:14] [02miraheze/ManageWiki] 07Universal-Omega pushed 031 commit to 03maintenance-cleanup [+0/-0/±1] 13https://github.com/miraheze/ManageWiki/compare/2de32b285f06...4f19dcea2b5c [17:41:17] [02miraheze/ManageWiki] 07Universal-Omega 034f19dce - Update [17:41:19] [02ManageWiki] 07Universal-Omega synchronize pull request 03#453: maintenance: cleanup and use modern functions - 13https://github.com/miraheze/ManageWiki/pull/453 [17:41:38] miraheze/ManageWiki - Universal-Omega the build passed. [17:42:20] [02miraheze/ManageWiki] 07Universal-Omega pushed 031 commit to 03maintenance-cleanup [+0/-0/±1] 13https://github.com/miraheze/ManageWiki/compare/4f19dcea2b5c...b3f21f1f9a33 [17:42:23] [02miraheze/ManageWiki] 07Universal-Omega 03b3f21f1 - Update [17:42:25] [02ManageWiki] 07Universal-Omega synchronize pull request 03#453: maintenance: cleanup and use modern functions - 13https://github.com/miraheze/ManageWiki/pull/453 [17:43:24] [02miraheze/ManageWiki] 07Universal-Omega pushed 031 commit to 03maintenance-cleanup [+0/-0/±1] 13https://github.com/miraheze/ManageWiki/compare/b3f21f1f9a33...0bae92439905 [17:43:27] [02miraheze/ManageWiki] 07Universal-Omega 030bae924 - Update [17:43:30] [02ManageWiki] 07Universal-Omega synchronize pull request 03#453: maintenance: cleanup and use modern functions - 13https://github.com/miraheze/ManageWiki/pull/453 [17:45:20] PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 28%, RTA = 188.95 ms [17:45:28] [02miraheze/ManageWiki] 07Universal-Omega pushed 031 commit to 03maintenance-cleanup [+0/-0/±1] 13https://github.com/miraheze/ManageWiki/compare/0bae92439905...1b3b12618829 [17:45:30] [02miraheze/ManageWiki] 07Universal-Omega 031b3b126 - Update [17:45:33] [02ManageWiki] 07Universal-Omega synchronize pull request 03#453: maintenance: cleanup and use modern functions - 13https://github.com/miraheze/ManageWiki/pull/453 [17:46:24] [02miraheze/ManageWiki] 07Universal-Omega pushed 031 commit to 03maintenance-cleanup [+0/-0/±1] 13https://github.com/miraheze/ManageWiki/compare/1b3b12618829...e4572a5e579f [17:46:27] [02miraheze/ManageWiki] 07Universal-Omega 03e4572a5 - Update [17:46:29] [02ManageWiki] 07Universal-Omega synchronize pull request 03#453: maintenance: cleanup and use modern functions - 13https://github.com/miraheze/ManageWiki/pull/453 [17:46:32] PROBLEM - wiki.mahdiruiz.line.pm - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query wiki.mahdiruiz.line.pm. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [17:47:01] [02miraheze/ManageWiki] 07Universal-Omega pushed 031 commit to 03maintenance-cleanup [+0/-0/±1] 13https://github.com/miraheze/ManageWiki/compare/e4572a5e579f...cb681307de5f [17:47:04] [02miraheze/ManageWiki] 07Universal-Omega 03cb68130 - Update [17:47:05] [02ManageWiki] 07Universal-Omega synchronize pull request 03#453: maintenance: cleanup and use modern functions - 13https://github.com/miraheze/ManageWiki/pull/453 [17:47:18] RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 184.79 ms [17:48:12] [02miraheze/ManageWiki] 07Universal-Omega pushed 031 commit to 03maintenance-cleanup [+0/-0/±1] 13https://github.com/miraheze/ManageWiki/compare/cb681307de5f...dafe02aab8b3 [17:48:14] [02miraheze/ManageWiki] 07Universal-Omega 03dafe02a - Update [17:48:17] [02ManageWiki] 07Universal-Omega synchronize pull request 03#453: maintenance: cleanup and use modern functions - 13https://github.com/miraheze/ManageWiki/pull/453 [17:49:13] [02miraheze/ManageWiki] 07Universal-Omega pushed 031 commit to 03maintenance-cleanup [+0/-0/±1] 13https://github.com/miraheze/ManageWiki/compare/dafe02aab8b3...bb8fb45eb52a [17:49:16] [02miraheze/ManageWiki] 07Universal-Omega 03bb8fb45 - Update [17:49:19] [02ManageWiki] 07Universal-Omega synchronize pull request 03#453: maintenance: cleanup and use modern functions - 13https://github.com/miraheze/ManageWiki/pull/453 [17:49:39] [02miraheze/ManageWiki] 07Universal-Omega pushed 031 commit to 03maintenance-cleanup [+0/-0/±1] 13https://github.com/miraheze/ManageWiki/compare/bb8fb45eb52a...49b0c9ec4ef2 [17:49:41] [02miraheze/ManageWiki] 07Universal-Omega 0349b0c9e - Update [17:49:44] [02ManageWiki] 07Universal-Omega synchronize pull request 03#453: maintenance: cleanup and use modern functions - 13https://github.com/miraheze/ManageWiki/pull/453 [17:50:04] [02miraheze/ManageWiki] 07Universal-Omega pushed 031 commit to 03maintenance-cleanup [+0/-0/±1] 13https://github.com/miraheze/ManageWiki/compare/49b0c9ec4ef2...144240879afc [17:50:07] [02miraheze/ManageWiki] 07Universal-Omega 031442408 - Update [17:50:08] [02ManageWiki] 07Universal-Omega synchronize pull request 03#453: maintenance: cleanup and use modern functions - 13https://github.com/miraheze/ManageWiki/pull/453 [17:50:21] [02miraheze/ManageWiki] 07Universal-Omega pushed 031 commit to 03maintenance-cleanup [+0/-0/±1] 13https://github.com/miraheze/ManageWiki/compare/144240879afc...45bf06b10764 [17:50:22] [02miraheze/ManageWiki] 07Universal-Omega 0345bf06b - Update [17:50:25] [02ManageWiki] 07Universal-Omega synchronize pull request 03#453: maintenance: cleanup and use modern functions - 13https://github.com/miraheze/ManageWiki/pull/453 [17:50:31] PROBLEM - wikappedia.cc - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wikappedia.cc' expires in 15 day(s) (Sun 17 Mar 2024 05:32:40 PM GMT +0000). [17:50:43] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/d75dd00291b6...0e6e2a0bf1e4 [17:50:45] [02miraheze/ssl] 07MirahezeSSLBot 030e6e2a0 - Bot: Update SSL cert for wikappedia.cc [17:50:51] [02miraheze/ManageWiki] 07Universal-Omega pushed 031 commit to 03maintenance-cleanup [+0/-0/±1] 13https://github.com/miraheze/ManageWiki/compare/45bf06b10764...f5805c669d76 [17:50:54] [02miraheze/ManageWiki] 07Universal-Omega 03f5805c6 - Update [17:50:59] [02ManageWiki] 07Universal-Omega synchronize pull request 03#453: maintenance: cleanup and use modern functions - 13https://github.com/miraheze/ManageWiki/pull/453 [17:51:31] [02miraheze/ManageWiki] 07Universal-Omega pushed 031 commit to 03maintenance-cleanup [+0/-0/±1] 13https://github.com/miraheze/ManageWiki/compare/f5805c669d76...5180fe3e8023 [17:51:33] [02miraheze/ManageWiki] 07Universal-Omega 035180fe3 - Update [17:51:34] [02ManageWiki] 07Universal-Omega synchronize pull request 03#453: maintenance: cleanup and use modern functions - 13https://github.com/miraheze/ManageWiki/pull/453 [17:52:00] [02RequestSSL] 07redbluegreenhat opened pull request 03#39: Drop usage of UserRightsProxy - 13https://github.com/miraheze/RequestSSL/pull/39 [17:52:05] [02miraheze/ManageWiki] 07Universal-Omega pushed 031 commit to 03maintenance-cleanup [+0/-0/±1] 13https://github.com/miraheze/ManageWiki/compare/5180fe3e8023...dff7af7e491d [17:52:08] [02miraheze/ManageWiki] 07Universal-Omega 03dff7af7 - Update [17:52:10] [02ManageWiki] 07Universal-Omega synchronize pull request 03#453: maintenance: cleanup and use modern functions - 13https://github.com/miraheze/ManageWiki/pull/453 [17:52:28] [02miraheze/ManageWiki] 07Universal-Omega pushed 031 commit to 03maintenance-cleanup [+0/-0/±1] 13https://github.com/miraheze/ManageWiki/compare/dff7af7e491d...e88a4532add1 [17:52:30] [02miraheze/ManageWiki] 07Universal-Omega 03e88a453 - Update [17:52:31] [02ManageWiki] 07Universal-Omega synchronize pull request 03#453: maintenance: cleanup and use modern functions - 13https://github.com/miraheze/ManageWiki/pull/453 [17:54:02] [02miraheze/ManageWiki] 07Universal-Omega pushed 031 commit to 03maintenance-cleanup [+0/-0/±1] 13https://github.com/miraheze/ManageWiki/compare/e88a4532add1...700af44ae97d [17:54:03] [02miraheze/ManageWiki] 07Universal-Omega 03700af44 - Bump [17:54:04] [02ManageWiki] 07Universal-Omega synchronize pull request 03#453: maintenance: cleanup and use modern functions - 13https://github.com/miraheze/ManageWiki/pull/453 [17:54:35] PROBLEM - wiki.gab.pt.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.gab.pt.eu.org All nameservers failed to answer the query. [17:55:06] miraheze/RequestSSL - redbluegreenhat the build has errored. [17:58:42] miraheze/ManageWiki - Universal-Omega the build passed. [17:59:29] [02miraheze/ManageWiki] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ManageWiki/compare/5c6c30d87852...c7a960d39ea9 [17:59:31] [02miraheze/ManageWiki] 07Universal-Omega 03c7a960d - Use $skin->msg [17:59:48] [02ManageWiki] 07Universal-Omega closed pull request 03#453: maintenance: cleanup and use modern functions - 13https://github.com/miraheze/ManageWiki/pull/453 [17:59:51] [02miraheze/ManageWiki] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±11] 13https://github.com/miraheze/ManageWiki/compare/c7a960d39ea9...238aede5d182 [17:59:52] [02miraheze/ManageWiki] 07Universal-Omega 03238aede - maintenance: cleanup and use modern functions (#453) [17:59:54] [02miraheze/ManageWiki] 07Universal-Omega deleted branch 03maintenance-cleanup [17:59:55] [02ManageWiki] 07Universal-Omega deleted branch 03maintenance-cleanup - 13https://github.com/miraheze/ManageWiki [18:03:00] [02miraheze/ManageWiki] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ManageWiki/compare/238aede5d182...4e62ac1ba7a0 [18:03:02] [02miraheze/ManageWiki] 07Universal-Omega 034e62ac1 - ApiModifyServer: inject CreateWikiHookRunner into RemoteWiki [18:04:59] [02miraheze/ManageWiki] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ManageWiki/compare/4e62ac1ba7a0...811e9e7cb582 [18:05:02] [02miraheze/ManageWiki] 07Universal-Omega 03811e9e7 - QueryWikiConfig: inject CreateWikiHookRunner into RemoteWiki [18:07:19] PROBLEM - wiki.cosmicdeathfungus.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.cosmicdeathfungus.com' expires in 15 day(s) (Sun 17 Mar 2024 05:52:59 PM GMT +0000). [18:07:30] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/0e6e2a0bf1e4...42375ed0d8cd [18:07:32] [02miraheze/ssl] 07MirahezeSSLBot 0342375ed - Bot: Update SSL cert for wiki.cosmicdeathfungus.com [18:08:03] [02miraheze/ManageWiki] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ManageWiki/compare/811e9e7cb582...97b1735f9da9 [18:08:04] [02miraheze/ManageWiki] 07Universal-Omega 0397b1735 - ManageWikiExtensions: inject CreateWikiHookRunner into RemoteWiki and CreateWikiJson [18:08:25] PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 28%, RTA = 205.39 ms [18:10:24] RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 192.05 ms [18:10:48] [02miraheze/ManageWiki] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ManageWiki/compare/97b1735f9da9...ae18865edb16 [18:10:49] [02miraheze/ManageWiki] 07Universal-Omega 03ae18865 - ManageWikiSettings: inject CreateWikiHookRunner into CreateWikiJson [18:11:45] miraheze/ManageWiki - Universal-Omega the build has errored. [18:12:16] [02miraheze/ManageWiki] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ManageWiki/compare/ae18865edb16...8e112c6f3f51 [18:12:17] [02miraheze/ManageWiki] 07Universal-Omega 038e112c6 - ManageWikiPermissions: inject CreateWikiHookRunner into CreateWikiJson [18:13:48] [02miraheze/ManageWiki] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ManageWiki/compare/8e112c6f3f51...a44bb586aa57 [18:13:51] [02miraheze/ManageWiki] 07Universal-Omega 03a44bb58 - ManageWikiNamespaces: inject CreateWikiHookRunner into CreateWikiJson [18:16:07] RECOVERY - wiki.mahdiruiz.line.pm - reverse DNS on sslhost is OK: SSL OK - wiki.mahdiruiz.line.pm reverse DNS resolves to cp36.wikitide.net - CNAME OK [18:17:53] miraheze/ManageWiki - Universal-Omega the build has errored. [18:19:32] RECOVERY - wikappedia.cc - LetsEncrypt on sslhost is OK: OK - Certificate 'wikappedia.cc' will expire on Thu 30 May 2024 04:50:37 PM GMT +0000. [18:20:42] [02miraheze/ErrorPages] 07Universal-Omega pushed 031 commit to 03inject [+0/-0/±1] 13https://github.com/miraheze/ErrorPages/commit/a6a92a309226 [18:20:44] [02miraheze/ErrorPages] 07Universal-Omega 03a6a92a3 - DeletedWiki: inject CreateWikiHookRunner into CreateWikiJson [18:20:46] [02ErrorPages] 07Universal-Omega created branch 03inject - 13https://github.com/miraheze/ErrorPages [18:20:47] [02ErrorPages] 07Universal-Omega opened pull request 03#42: DeletedWiki: inject CreateWikiHookRunner into CreateWikiJson - 13https://github.com/miraheze/ErrorPages/pull/42 [18:21:42] miraheze/ErrorPages - Universal-Omega the build passed. [18:22:19] [02miraheze/ManageWiki] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ManageWiki/compare/a44bb586aa57...0132fe9135bf [18:22:20] [02miraheze/ManageWiki] 07Universal-Omega 030132fe9 - Fix PHPCS [18:24:36] PROBLEM - wiki.gab.pt.eu.org - reverse DNS on sslhost is WARNING: SSL WARNING - rDNS OK but records conflict. {'NS': ['ns.ankh.fr.eu.org.', 'ns1.eu.org.', 'ns1.eriomem.net.'], 'CNAME': 'bouncingwiki.miraheze.org.'} [18:25:58] [02ErrorPages] 07Universal-Omega closed pull request 03#42: DeletedWiki: inject CreateWikiHookRunner into CreateWikiJson - 13https://github.com/miraheze/ErrorPages/pull/42 [18:26:00] [02miraheze/ErrorPages] 07Universal-Omega deleted branch 03inject [18:26:03] [02miraheze/ErrorPages] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ErrorPages/compare/e20927ac982a...7966fec61ea3 [18:26:06] [02miraheze/ErrorPages] 07Universal-Omega 037966fec - DeletedWiki: inject CreateWikiHookRunner into CreateWikiJson (#42) [18:26:09] [02ErrorPages] 07Universal-Omega deleted branch 03inject - 13https://github.com/miraheze/ErrorPages [18:26:47] miraheze/ManageWiki - Universal-Omega the build passed. [18:26:51] miraheze/ErrorPages - Universal-Omega the build passed. [18:33:58] [02miraheze/CreateWiki] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/5842160c1148...87abb4fa9f46 [18:34:00] [02miraheze/CreateWiki] 07Universal-Omega 0387abb4f - WikiManager: always pass hookRunner [18:35:37] [02miraheze/CreateWiki] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/87abb4fa9f46...b438b6891807 [18:35:40] [02miraheze/CreateWiki] 07Universal-Omega 03b438b68 - RemoteWiki: always pass hookRunner [18:37:17] RECOVERY - wiki.cosmicdeathfungus.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.cosmicdeathfungus.com' will expire on Thu 30 May 2024 05:07:25 PM GMT +0000. [18:41:43] [02miraheze/CreateWiki] 07Universal-Omega pushed 031 commit to 03rw-service [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/commit/32b49c6e9968 [18:41:44] [02miraheze/CreateWiki] 07Universal-Omega 0332b49c6 - RemoteWiki: convert to service [18:41:47] [02CreateWiki] 07Universal-Omega created branch 03rw-service - 13https://github.com/miraheze/CreateWiki [18:41:48] [02CreateWiki] 07Universal-Omega opened pull request 03#483: RemoteWiki: convert to service - 13https://github.com/miraheze/CreateWiki/pull/483 [18:43:20] miraheze/CreateWiki - Universal-Omega the build passed. [18:44:57] miraheze/CreateWiki - Universal-Omega the build has errored. [19:04:20] PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 100% [19:06:19] RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 154.10 ms [19:28:05] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/c4cf08b3fdf1...df251d25b861 [19:28:06] [02miraheze/mw-config] 07Universal-Omega 03df251d2 - Add action paths configs for better support with root article paths [19:29:06] miraheze/mw-config - Universal-Omega the build passed. [19:34:58] !log [agent@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/extensions/MirahezeMagic/maintenance/restoreManageWikiBackup.php --wiki=sagan4alphawiki --filename sagan4alphawiki_managewiki_backup_80b7df68fc6ff16ba3f6.json (END - exit=0) [19:35:01] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:37:30] !log [@mwtask171] starting deploy of {'config': True} to all [19:37:33] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:37:38] !log [@mwtask171] finished deploy of {'config': True} to all - SUCCESS in 8s [19:37:41] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:43:58] !log [agent@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/purgeParserCache.php --wiki=sagan4alphawiki --age 1 (END - exit=2) [19:44:01] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:51:38] !log [agent@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/eval.php --wiki=sagan4alphawiki (END - exit=65280) [19:51:41] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:58:07] !log [agent@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/extensions/CreateWiki/maintenance/deleteWiki.php --wiki=metawiki --delete --deletewiki sagan4alphawiki (END - exit=0) [19:58:09] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:47:32] PROBLEM - cp37 Varnish Backends on cp37 is CRITICAL: 2 backends are down. mw152 mw172 [20:47:44] PROBLEM - cp41 Varnish Backends on cp41 is CRITICAL: 1 backends are down. mw172 [20:47:44] PROBLEM - cp27 Varnish Backends on cp27 is CRITICAL: 1 backends are down. mw172 [20:47:45] PROBLEM - cp26 Varnish Backends on cp26 is CRITICAL: 1 backends are down. mw172 [20:47:51] PROBLEM - cp36 Varnish Backends on cp36 is CRITICAL: 1 backends are down. mw172 [20:48:03] PROBLEM - cp51 Varnish Backends on cp51 is CRITICAL: 1 backends are down. mw172 [20:48:04] PROBLEM - cp28 Varnish Backends on cp28 is CRITICAL: 1 backends are down. mw172 [20:49:29] RECOVERY - cp37 Varnish Backends on cp37 is OK: All 19 backends are healthy [20:49:42] RECOVERY - cp41 Varnish Backends on cp41 is OK: All 19 backends are healthy [20:49:43] RECOVERY - cp26 Varnish Backends on cp26 is OK: All 19 backends are healthy [20:49:44] RECOVERY - cp27 Varnish Backends on cp27 is OK: All 19 backends are healthy [20:49:50] RECOVERY - cp36 Varnish Backends on cp36 is OK: All 19 backends are healthy [20:50:00] RECOVERY - cp28 Varnish Backends on cp28 is OK: All 19 backends are healthy [20:50:03] RECOVERY - cp51 Varnish Backends on cp51 is OK: All 19 backends are healthy [20:53:22] [02RequestSSL] 07redbluegreenhat edited pull request 03#39: Drop usage of UserRightsProxy - 13https://github.com/miraheze/RequestSSL/pull/39 [20:53:27] [02RequestSSL] 07redbluegreenhat closed pull request 03#39: Drop usage of UserRightsProxy - 13https://github.com/miraheze/RequestSSL/pull/39 [20:54:40] [02miraheze/RequestSSL] 07redbluegreenhat pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/RequestSSL/compare/7a8ff580f806...c4c115ce7ce8 [20:54:40] [02miraheze/RequestSSL] 07redbluegreenhat 03c4c115c - Drop usage of UserRightsProxy (#39) [20:54:40] !log [alex@test151] starting deploy of {'versions': '1.41', 'upgrade_extensions': 'RequestSSL'} to test151 [20:54:40] !log [alex@test151] finished deploy of {'versions': '1.41', 'upgrade_extensions': 'RequestSSL'} to test151 - SUCCESS in 1s [20:54:42] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:54:45] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:56:23] miraheze/RequestSSL - redbluegreenhat the build has errored. [20:57:50] UserRightsProxy has been removed from RequestSSL [20:58:08] F [23:01:00] !log (metawiki) DELETE FROM echo_unread_wikis WHERE euw_user=349504; [23:01:03] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:07:11] !log (massirowiki) UPDATE echo_notification SET notification_read_timestamp=20240301122226 WHERE notification_user=4; [23:07:13] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:16:55] PROBLEM - wiki.mahdiruiz.line.pm - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query line.pm. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [23:24:57] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03alias [+0/-0/±1] 13https://github.com/miraheze/ImportDump/commit/313398b4a21e [23:24:59] [02miraheze/ImportDump] 07Universal-Omega 03313398b - Add SpecialPageAliases to RequestImport/RequestImportQueue [23:25:00] [02ImportDump] 07Universal-Omega created branch 03alias - 13https://github.com/miraheze/ImportDump [23:25:02] [02ImportDump] 07Universal-Omega opened pull request 03#75: Add SpecialPageAliases to RequestImport/RequestImportQueue - 13https://github.com/miraheze/ImportDump/pull/75 [23:25:15] [02ImportDump] 07Universal-Omega edited pull request 03#75: Add SpecialPageAliases for RequestImport/RequestImportQueue - 13https://github.com/miraheze/ImportDump/pull/75 [23:26:47] PROBLEM - bots171 Puppet on bots171 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [23:27:52] PROBLEM - cp36 Disk Space on cp36 is WARNING: DISK WARNING - free space: / 9702MiB (10% inode=98%); [23:29:18] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/a0adb2feaf74...22702b2a01c2 [23:29:21] [02miraheze/ImportDump] 07Universal-Omega 0322702b2 - Update i18n for right-handle-import-dump-requests [23:32:36] [02ImportDump] 07Universal-Omega created branch 03ratelimits - 13https://github.com/miraheze/ImportDump [23:32:38] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03ratelimits [+0/-0/±1] 13https://github.com/miraheze/ImportDump/commit/ba147f7b3776 [23:32:39] [02miraheze/ImportDump] 07Universal-Omega 03ba147f7 - Use request-import for RateLimits [23:32:41] [02ImportDump] 07Universal-Omega opened pull request 03#76: Use request-import for RateLimits - 13https://github.com/miraheze/ImportDump/pull/76 [23:33:35] miraheze/ImportDump - Universal-Omega the build passed. [23:33:54] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03ratelimits [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/ba147f7b3776...c30835eaa7f4 [23:33:56] [02miraheze/ImportDump] 07Universal-Omega 03c30835e - Update [23:33:58] [02ImportDump] 07Universal-Omega synchronize pull request 03#76: Use request-import for RateLimits - 13https://github.com/miraheze/ImportDump/pull/76 [23:36:49] [02miraheze/ImportDump] 07Universal-Omega created branch 03rename-tables 13https://github.com/miraheze/ImportDump/commit/22702b2a01c2c4972ddf83923426ed6ef0500e9c [23:36:52] [02ImportDump] 07Universal-Omega created branch 03rename-tables - 13https://github.com/miraheze/ImportDump [23:36:52] miraheze/ImportDump - Universal-Omega the build passed. [23:39:02] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03rename-tables [+0/-0/±9] 13https://github.com/miraheze/ImportDump/compare/22702b2a01c2...5c9eab3318ed [23:39:05] [02miraheze/ImportDump] 07Universal-Omega 035c9eab3 - Rename importdump_request* tables [23:39:21] [02ImportDump] 07Universal-Omega opened pull request 03#77: Rename importdump_request* tables - 13https://github.com/miraheze/ImportDump/pull/77 [23:41:29] miraheze/ImportDump - Universal-Omega the build passed. [23:42:52] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03ImportDumpHookRunnerTest [+1/-0/±0] 13https://github.com/miraheze/ImportDump/commit/bb0184241700 [23:42:54] [02miraheze/ImportDump] 07Universal-Omega 03bb01842 - Add ImportDumpHookRunnerTest [23:42:56] [02ImportDump] 07Universal-Omega created branch 03ImportDumpHookRunnerTest - 13https://github.com/miraheze/ImportDump [23:42:58] [02ImportDump] 07Universal-Omega opened pull request 03#78: Add ImportDumpHookRunnerTest - 13https://github.com/miraheze/ImportDump/pull/78 [23:47:53] miraheze/ImportDump - Universal-Omega the build passed. [23:50:12] PROBLEM - cp37 Disk Space on cp37 is WARNING: DISK WARNING - free space: / 9713MiB (10% inode=98%); [23:50:56] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03InsertQueryBuilder [+0/-0/±1] 13https://github.com/miraheze/ImportDump/commit/7a3c477e090a [23:50:58] [02miraheze/ImportDump] 07Universal-Omega 037a3c477 - Migrate to use InsertQueryBuilder [23:51:01] [02ImportDump] 07Universal-Omega created branch 03InsertQueryBuilder - 13https://github.com/miraheze/ImportDump [23:51:03] [02ImportDump] 07Universal-Omega opened pull request 03#79: Migrate to use InsertQueryBuilder - 13https://github.com/miraheze/ImportDump/pull/79 [23:51:16] miraheze/ImportDump - Universal-Omega the build passed. [23:56:14] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03InsertQueryBuilder [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/7a3c477e090a...354aa8eda2b0 [23:56:15] [02miraheze/ImportDump] 07Universal-Omega 03354aa8e - Migrate [23:56:18] [02ImportDump] 07Universal-Omega synchronize pull request 03#79: Migrate to use InsertQueryBuilder - 13https://github.com/miraheze/ImportDump/pull/79 [23:58:08] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03InsertQueryBuilder [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/354aa8eda2b0...99244acfa03f [23:58:09] [02miraheze/ImportDump] 07Universal-Omega 0399244ac - Migrate [23:58:10] [02ImportDump] 07Universal-Omega synchronize pull request 03#79: Migrate to use InsertQueryBuilder - 13https://github.com/miraheze/ImportDump/pull/79