[00:00:32] PROBLEM - cp27 HTTP 4xx/5xx ERROR Rate on cp27 is UNKNOWN: UNKNOWN - NGINX Error Rate is UNKNOWN [00:00:46] PROBLEM - cp26 HTTP 4xx/5xx ERROR Rate on cp26 is UNKNOWN: UNKNOWN - NGINX Error Rate is UNKNOWN [00:02:30] PROBLEM - cp27 HTTP 4xx/5xx ERROR Rate on cp27 is CRITICAL: CRITICAL - NGINX Error Rate is 100% [00:02:42] PROBLEM - cp26 HTTP 4xx/5xx ERROR Rate on cp26 is CRITICAL: CRITICAL - NGINX Error Rate is 100% [00:02:56] PROBLEM - cp51 Puppet on cp51 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [00:03:58] RECOVERY - cp36 Disk Space on cp36 is OK: DISK OK - free space: / 21634MiB (24% inode=98%); [00:04:28] RECOVERY - cp37 Disk Space on cp37 is OK: DISK OK - free space: / 21595MiB (24% inode=98%); [00:04:38] PROBLEM - cp26 HTTP 4xx/5xx ERROR Rate on cp26 is WARNING: WARNING - NGINX Error Rate is 50% [00:06:27] RECOVERY - cp41 Puppet on cp41 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [00:06:34] PROBLEM - cp26 HTTP 4xx/5xx ERROR Rate on cp26 is CRITICAL: CRITICAL - NGINX Error Rate is 60% [00:25:03] PROBLEM - mw151 NTP time on mw151 is CRITICAL: NTP CRITICAL: No response from NTP server [00:26:53] PROBLEM - wiki.mxlinuxusers.de - reverse DNS on sslhost is WARNING: LifetimeTimeout: The resolution lifetime expired after 5.404 seconds: Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out. [00:26:53] PROBLEM - tl.awiki.org - reverse DNS on sslhost is WARNING: LifetimeTimeout: The resolution lifetime expired after 5.405 seconds: Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out. [00:26:53] PROBLEM - cp37 NTP time on cp37 is CRITICAL: NTP CRITICAL: No response from NTP server [00:26:53] PROBLEM - www.istpcomputing.com - reverse DNS on sslhost is WARNING: LifetimeTimeout: The resolution lifetime expired after 5.404 seconds: Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out. [00:26:53] PROBLEM - swiftobject151 NTP time on swiftobject151 is CRITICAL: NTP CRITICAL: No response from NTP server [00:28:06] RECOVERY - matomo151 NTP time on matomo151 is OK: NTP OK: Offset -0.005811244249 secs [00:28:06] RECOVERY - cloud15 NTP time on cloud15 is OK: NTP OK: Offset -0.002235889435 secs [00:29:14] PROBLEM - mw182 Puppet on mw182 is CRITICAL: CRITICAL: Puppet has 2 failures. Last run 2 minutes ago with 2 failures. Failed resources (up to 3 shown): Exec[git_pull_femiwiki-deploy-1.41],Exec[git_pull_3d2png] [00:29:16] RECOVERY - prometheus151 NTP time on prometheus151 is OK: NTP OK: Offset -0.00198969245 secs [00:30:40] RECOVERY - cp51 Puppet on cp51 is OK: OK: Puppet is currently enabled, last run 5 seconds ago with 0 failures [00:53:54] RECOVERY - wiki.mxlinuxusers.de - reverse DNS on sslhost is OK: SSL OK - wiki.mxlinuxusers.de reverse DNS resolves to cp37.wikitide.net - CNAME OK [00:53:58] RECOVERY - tl.awiki.org - reverse DNS on sslhost is OK: SSL OK - tl.awiki.org reverse DNS resolves to cp36.wikitide.net - CNAME OK [00:54:08] RECOVERY - wiki.denby.tech - reverse DNS on sslhost is OK: SSL OK - wiki.denby.tech reverse DNS resolves to cp37.wikitide.net - CNAME OK [00:54:10] RECOVERY - piwik.miraheze.org - reverse DNS on sslhost is OK: SSL OK - piwik.miraheze.org reverse DNS resolves to cp37.wikitide.net - NS RECORDS OK [00:54:19] RECOVERY - www.durawiki.com - reverse DNS on sslhost is OK: SSL OK - www.durawiki.com reverse DNS resolves to cp37.wikitide.net - NS RECORDS OK [00:54:23] RECOVERY - swests.org - reverse DNS on sslhost is OK: SSL OK - swests.org reverse DNS resolves to cp37.wikitide.net - CNAME FLAT [00:54:30] RECOVERY - orain.org - reverse DNS on sslhost is OK: SSL OK - orain.org reverse DNS resolves to cp36.wikitide.net - NS RECORDS OK [00:54:35] RECOVERY - fashiondreamer.wiki - reverse DNS on sslhost is OK: SSL OK - fashiondreamer.wiki reverse DNS resolves to cp36.wikitide.net - NS RECORDS OK [00:55:00] RECOVERY - translate.petrawiki.org - reverse DNS on sslhost is OK: SSL OK - translate.petrawiki.org reverse DNS resolves to cp37.wikitide.net - NS RECORDS OK [00:55:04] RECOVERY - www.istpcomputing.com - reverse DNS on sslhost is OK: SSL OK - www.istpcomputing.com reverse DNS resolves to cp37.wikitide.net - CNAME OK [00:55:35] RECOVERY - ie.unigon.net - reverse DNS on sslhost is OK: SSL OK - ie.unigon.net reverse DNS resolves to cp37.wikitide.net - CNAME OK [00:55:36] RECOVERY - wiki.esnmilanostatale.it - reverse DNS on sslhost is OK: SSL OK - wiki.esnmilanostatale.it reverse DNS resolves to cp36.wikitide.net - CNAME OK [00:55:37] RECOVERY - puritwiki.p-e.kr - reverse DNS on sslhost is OK: SSL OK - puritwiki.p-e.kr reverse DNS resolves to cp37.wikitide.net - CNAME OK [00:55:38] RECOVERY - ru-teirailway.f5.si - reverse DNS on sslhost is OK: SSL OK - ru-teirailway.f5.si reverse DNS resolves to cp37.wikitide.net - CNAME OK [00:55:52] RECOVERY - glitchcity.wiki - reverse DNS on sslhost is OK: SSL OK - glitchcity.wiki reverse DNS resolves to cp36.wikitide.net - CNAME OK [00:55:57] RECOVERY - minescape.wiki - reverse DNS on sslhost is OK: SSL OK - minescape.wiki reverse DNS resolves to cp37.wikitide.net - CNAME FLAT [00:55:57] RECOVERY - wiki.zamnhacking.net - reverse DNS on sslhost is OK: SSL OK - wiki.zamnhacking.net reverse DNS resolves to cp36.wikitide.net - CNAME OK [00:55:58] RECOVERY - wiki.mc.marochuru.net - reverse DNS on sslhost is OK: SSL OK - wiki.mc.marochuru.net reverse DNS resolves to cp37.wikitide.net - CNAME OK [00:57:25] RECOVERY - mw182 Puppet on mw182 is OK: OK: Puppet is currently enabled, last run 7 seconds ago with 0 failures [01:04:15] [02miraheze/RemovePII] 07Universal-Omega pushed 031 commit to 03namespaced [+0/-0/±1] 13https://github.com/miraheze/RemovePII/commit/6c8688e94129 [01:04:17] [02miraheze/RemovePII] 07Universal-Omega 036c8688e - Use namespaced classes [01:04:18] [02RemovePII] 07Universal-Omega created branch 03namespaced - 13https://github.com/miraheze/RemovePII [01:04:21] [02RemovePII] 07Universal-Omega opened pull request 03#82: Use namespaced classes - 13https://github.com/miraheze/RemovePII/pull/82 [01:07:28] [02miraheze/RemovePII] 07Universal-Omega pushed 031 commit to 03namespaced [+0/-0/±1] 13https://github.com/miraheze/RemovePII/compare/6c8688e94129...e57f7420a743 [01:07:29] [02miraheze/RemovePII] 07Universal-Omega 03e57f742 - Use namespaced classes [01:07:32] [02RemovePII] 07Universal-Omega synchronize pull request 03#82: Use namespaced classes - 13https://github.com/miraheze/RemovePII/pull/82 [01:10:59] [02miraheze/RemovePII] 07Universal-Omega pushed 031 commit to 03namespaced [+0/-0/±1] 13https://github.com/miraheze/RemovePII/compare/e57f7420a743...edfaef8244b9 [01:11:02] [02miraheze/RemovePII] 07Universal-Omega 03edfaef8 - Use namespaced classes [01:11:04] [02RemovePII] 07Universal-Omega synchronize pull request 03#82: Use namespaced classes - 13https://github.com/miraheze/RemovePII/pull/82 [01:18:14] PROBLEM - wiki.mahdiruiz.line.pm - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query wiki.mahdiruiz.line.pm. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [01:18:41] miraheze/RemovePII - Universal-Omega the build passed. [01:21:04] [02miraheze/RemovePII] 07Universal-Omega deleted branch 03paladox-patch-1 [01:21:05] [02RemovePII] 07Universal-Omega deleted branch 03paladox-patch-1 - 13https://github.com/miraheze/RemovePII [01:21:06] [02RemovePII] 07Universal-Omega closed pull request 03#82: Use namespaced classes - 13https://github.com/miraheze/RemovePII/pull/82 [01:21:07] [02miraheze/RemovePII] 07Universal-Omega deleted branch 03namespaced [01:21:10] [02miraheze/RemovePII] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±3] 13https://github.com/miraheze/RemovePII/compare/09855af65c4b...95d035f0e677 [01:21:12] [02miraheze/RemovePII] 07Universal-Omega 0395d035f - Use namespaced classes (#82) [01:21:14] [02RemovePII] 07Universal-Omega deleted branch 03namespaced - 13https://github.com/miraheze/RemovePII [01:27:12] miraheze/RemovePII - Universal-Omega the build passed. [01:33:40] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/4595901edcdc...c0bdc9168a6d [01:33:42] [02miraheze/mw-config] 07Universal-Omega 03c0bdc91 - Add ImportDump rights to Stewards [01:34:39] miraheze/mw-config - Universal-Omega the build passed. [01:37:26] !log [@mwtask171] starting deploy of {'config': True} to all [01:37:33] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:37:35] !log [@mwtask171] finished deploy of {'config': True} to all - SUCCESS in 9s [01:37:42] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:39:02] [02ImportDump] 07Universal-Omega closed pull request 03#81: Rename import-dump rights - 13https://github.com/miraheze/ImportDump/pull/81 [01:39:03] [02miraheze/ImportDump] 07Universal-Omega deleted branch 03rename-rights [01:39:05] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±27] 13https://github.com/miraheze/ImportDump/compare/9ebc1d177c2c...09167232e6bd [01:39:06] [02miraheze/ImportDump] 07Universal-Omega 030916723 - Rename import-dump rights (#81) [01:39:08] [02ImportDump] 07Universal-Omega deleted branch 03rename-rights - 13https://github.com/miraheze/ImportDump [01:42:26] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03rename-specialpages [+1/-1/±0] 13https://github.com/miraheze/ImportDump/commit/32ecf18d2bc7 [01:42:27] [02miraheze/ImportDump] 07Universal-Omega 0332ecf18 - Rename special pages [01:42:30] [02ImportDump] 07Universal-Omega created branch 03rename-specialpages - 13https://github.com/miraheze/ImportDump [01:42:31] [02ImportDump] 07Universal-Omega opened pull request 03#83: Rename special pages - 13https://github.com/miraheze/ImportDump/pull/83 [01:43:12] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03rename-specialpages [+1/-1/±0] 13https://github.com/miraheze/ImportDump/compare/32ecf18d2bc7...3784fc0d5e57 [01:43:15] [02miraheze/ImportDump] 07Universal-Omega 033784fc0 - Rename [01:43:18] [02ImportDump] 07Universal-Omega synchronize pull request 03#83: Rename special pages - 13https://github.com/miraheze/ImportDump/pull/83 [01:43:35] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03rename-specialpages [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/3784fc0d5e57...6460887a8443 [01:43:36] [02miraheze/ImportDump] 07Universal-Omega 036460887 - Rename [01:43:37] [02ImportDump] 07Universal-Omega synchronize pull request 03#83: Rename special pages - 13https://github.com/miraheze/ImportDump/pull/83 [01:45:13] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03rename-specialpages [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/6460887a8443...018de2260ee5 [01:45:15] [02miraheze/ImportDump] 07Universal-Omega 03018de22 - Rename [01:45:16] [02ImportDump] 07Universal-Omega synchronize pull request 03#83: Rename special pages - 13https://github.com/miraheze/ImportDump/pull/83 [01:46:44] miraheze/ImportDump - Universal-Omega the build passed. [01:49:38] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03rename-specialpages [+0/-0/±24] 13https://github.com/miraheze/ImportDump/compare/018de2260ee5...f5616a3c971a [01:49:41] [02miraheze/ImportDump] 07Universal-Omega 03f5616a3 - Rename [01:49:42] [02ImportDump] 07Universal-Omega synchronize pull request 03#83: Rename special pages - 13https://github.com/miraheze/ImportDump/pull/83 [01:57:27] miraheze/ImportDump - Universal-Omega the build passed. [01:58:49] [02ImportDump] 07Universal-Omega closed pull request 03#83: Rename special pages - 13https://github.com/miraheze/ImportDump/pull/83 [01:58:51] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03master [+2/-2/±23] 13https://github.com/miraheze/ImportDump/compare/09167232e6bd...43c174ae6f41 [01:58:54] [02miraheze/ImportDump] 07Universal-Omega 0343c174a - Rename special pages (#83) [01:58:55] [02miraheze/ImportDump] 07Universal-Omega deleted branch 03rename-specialpages [01:58:56] [02ImportDump] 07Universal-Omega deleted branch 03rename-specialpages - 13https://github.com/miraheze/ImportDump [02:02:10] !log [@mwtask181] starting deploy of {'config': True} to all [02:02:18] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:02:20] !log [@mwtask181] finished deploy of {'config': True} to all - SUCCESS in 9s [02:02:27] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:06:40] miraheze/ImportDump - Universal-Omega the build passed. [03:00:17] RECOVERY - db171 Backups SQL on db171 is OK: FILE_AGE OK: /var/log/sql-backup.log is 16 seconds old and 0 bytes [03:09:36] PROBLEM - thelonsdalebattalion.co.uk - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - thelonsdalebattalion.co.uk All nameservers failed to answer the query. [03:14:23] RECOVERY - wiki.mahdiruiz.line.pm - reverse DNS on sslhost is OK: SSL OK - wiki.mahdiruiz.line.pm reverse DNS resolves to cp36.wikitide.net - CNAME OK [03:38:35] RECOVERY - thelonsdalebattalion.co.uk - reverse DNS on sslhost is OK: SSL OK - thelonsdalebattalion.co.uk reverse DNS resolves to cp36.wikitide.net - NS RECORDS OK [03:55:43] PROBLEM - wiki.andreijiroh.uk.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.andreijiroh.uk.eu.org All nameservers failed to answer the query. [04:24:37] RECOVERY - wiki.andreijiroh.uk.eu.org - reverse DNS on sslhost is OK: SSL OK - wiki.andreijiroh.uk.eu.org reverse DNS resolves to cp36.wikitide.net - CNAME OK [07:03:17] PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 176.02 ms [07:05:17] RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 164.70 ms [08:10:21] PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 181.09 ms [08:12:21] RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 177.36 ms [08:59:11] PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 182.70 ms [09:01:11] RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 177.49 ms [09:02:13] PROBLEM - db181 Backups SQL on db181 is CRITICAL: FILE_AGE CRITICAL: /var/log/sql-backup.log is 1209685 seconds old and 112234 bytes [11:13:35] PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 185.94 ms [11:14:33] PROBLEM - wiki.mahdiruiz.line.pm - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query line.pm. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [11:17:39] RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 178.80 ms [11:31:33] PROBLEM - cp37 Current Load on cp37 is CRITICAL: LOAD CRITICAL - total load average: 9.06, 5.31, 2.48 [11:33:33] RECOVERY - cp37 Current Load on cp37 is OK: LOAD OK - total load average: 1.84, 3.84, 2.28 [11:43:35] RECOVERY - wiki.mahdiruiz.line.pm - reverse DNS on sslhost is OK: SSL OK - wiki.mahdiruiz.line.pm reverse DNS resolves to cp37.wikitide.net - CNAME OK [11:59:12] !log [macfan@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/importImages.php --wiki=1d6chanwiki /home/macfan/images --search-recursively (END - exit=0) [11:59:19] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:01:43] PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 180.78 ms [12:05:49] RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 179.52 ms [12:12:45] [02miraheze/CreateWiki] 07translatewiki pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/c5be15fa7eec...20e47488053a [12:12:47] [02miraheze/CreateWiki] 07translatewiki 0320e4748 - Localisation updates from https://translatewiki.net. [12:12:49] [02miraheze/ErrorPages] 07translatewiki pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ErrorPages/compare/7966fec61ea3...a70d3f2b561f [12:12:52] [02miraheze/ErrorPages] 07translatewiki 03a70d3f2 - Localisation updates from https://translatewiki.net. [12:12:55] [02miraheze/IncidentReporting] 07translatewiki pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/IncidentReporting/compare/b6ee18f01a3f...955b6f5f3c62 [12:12:58] [02miraheze/IncidentReporting] 07translatewiki 03955b6f5 - Localisation updates from https://translatewiki.net. [12:13:00] [02miraheze/ManageWiki] 07translatewiki pushed 031 commit to 03master [+0/-0/±3] 13https://github.com/miraheze/ManageWiki/compare/0132fe9135bf...428be82c7ba7 [12:13:02] [02miraheze/ManageWiki] 07translatewiki 03428be82 - Localisation updates from https://translatewiki.net. [12:13:05] [02miraheze/landing] 07translatewiki pushed 031 commit to 03master [+0/-0/±2] 13https://github.com/miraheze/landing/compare/8b5926926f50...e2315dc385bb [12:13:06] [02miraheze/landing] 07translatewiki 03e2315dc - Localisation updates from https://translatewiki.net. [12:13:08] [02miraheze/DataDump] 07translatewiki pushed 031 commit to 03master [+0/-0/±3] 13https://github.com/miraheze/DataDump/compare/f23cb1f87846...fbc3c778457d [12:13:11] [02miraheze/DataDump] 07translatewiki 03fbc3c77 - Localisation updates from https://translatewiki.net. [12:13:12] [02miraheze/MirahezeMagic] 07translatewiki pushed 031 commit to 03master [+0/-0/±3] 13https://github.com/miraheze/MirahezeMagic/compare/2d73b1e7747a...c7279c1c893e [12:13:15] [02miraheze/MirahezeMagic] 07translatewiki 03c7279c1 - Localisation updates from https://translatewiki.net. [12:13:18] [02miraheze/SpriteSheet] 07translatewiki pushed 031 commit to 03master [+0/-0/±3] 13https://github.com/miraheze/SpriteSheet/compare/bca5baaead5a...e4ae3316584a [12:13:19] [02miraheze/SpriteSheet] 07translatewiki 03e4ae331 - Localisation updates from https://translatewiki.net. [12:13:20] [02miraheze/WikiDiscover] 07translatewiki pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/WikiDiscover/compare/a8b26edfddc2...774366c1fa54 [12:13:22] [02miraheze/WikiDiscover] 07translatewiki 03774366c - Localisation updates from https://translatewiki.net. [12:13:33] miraheze/ErrorPages - translatewiki the build passed. [12:13:50] miraheze/landing - translatewiki the build passed. [12:16:10] miraheze/SpriteSheet - translatewiki the build has errored. [12:16:58] miraheze/DataDump - translatewiki the build passed. [12:17:06] miraheze/WikiDiscover - translatewiki the build passed. [12:17:16] miraheze/IncidentReporting - translatewiki the build passed. [12:17:20] miraheze/ManageWiki - translatewiki the build passed. [12:21:16] miraheze/CreateWiki - translatewiki the build passed. [12:23:01] PROBLEM - db161 Backups SQL on db161 is CRITICAL: FILE_AGE CRITICAL: /var/log/sql-backup.log is 1209606 seconds old and 111810 bytes [12:23:20] PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 179.81 ms [12:26:48] miraheze/MirahezeMagic - translatewiki the build passed. [12:29:25] RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 183.21 ms [12:33:05] !log [@mwtask181] starting deploy of {'folders': '1.41/extensions/MirahezeMagic'} to all [12:33:12] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:33:13] !log [@mwtask181] finished deploy of {'folders': '1.41/extensions/MirahezeMagic'} to all - SUCCESS in 8s [12:33:21] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:35:13] PROBLEM - kalons-reverie.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'kalons-reverie.com' expires in 15 day(s) (Wed 20 Mar 2024 12:04:08 PM GMT +0000). [12:35:26] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/049e6f0e302a...cba0d167dbd4 [12:35:27] [02miraheze/ssl] 07MirahezeSSLBot 03cba0d16 - Bot: Update SSL cert for kalons-reverie.com [12:37:23] !log [@mwtask171] starting deploy of {'folders': '1.41/extensions/MirahezeMagic'} to all [12:37:31] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:37:31] !log [@mwtask171] finished deploy of {'folders': '1.41/extensions/MirahezeMagic'} to all - SUCCESS in 7s [12:37:38] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:44:32] PROBLEM - wiki.mahdiruiz.line.pm - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query line.pm. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [13:03:56] RECOVERY - kalons-reverie.com - LetsEncrypt on sslhost is OK: OK - Certificate 'kalons-reverie.com' will expire on Sun 02 Jun 2024 11:35:19 AM GMT +0000. [13:27:55] PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 37%, RTA = 185.49 ms [13:28:41] PROBLEM - www.hebammenwiki.de - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'www.hebammenwiki.de' expires in 15 day(s) (Wed 20 Mar 2024 01:22:39 PM GMT +0000). [13:28:52] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/cba0d167dbd4...cd31c8de5712 [13:28:54] [02miraheze/ssl] 07MirahezeSSLBot 03cd31c8d - Bot: Update SSL cert for www.hebammenwiki.de [13:29:55] RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 182.22 ms [13:42:34] PROBLEM - wiki.mahdiruiz.line.pm - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.mahdiruiz.line.pm All nameservers failed to answer the query. [13:52:30] PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 37%, RTA = 193.18 ms [13:54:30] RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 184.60 ms [13:58:21] RECOVERY - www.hebammenwiki.de - LetsEncrypt on sslhost is OK: OK - Certificate 'www.hebammenwiki.de' will expire on Sun 02 Jun 2024 12:28:46 PM GMT +0000. [13:58:43] PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 37%, RTA = 172.16 ms [14:00:43] RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 189.75 ms [14:14:11] PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 189.79 ms [14:15:21] PROBLEM - bushcraftwiki.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'bushcraftwiki.com' expires in 15 day(s) (Wed 20 Mar 2024 01:52:40 PM GMT +0000). [14:15:33] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/cd31c8de5712...4bacf9fbc211 [14:15:36] [02miraheze/ssl] 07MirahezeSSLBot 034bacf9f - Bot: Update SSL cert for bushcraftwiki.com [14:16:11] RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 190.74 ms [14:24:33] PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 187.86 ms [14:30:37] RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 214.90 ms [14:34:51] PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 191.28 ms [14:36:51] RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 207.22 ms [14:42:31] PROBLEM - wiki.mahdiruiz.line.pm - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query line.pm. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [15:12:29] RECOVERY - wiki.mahdiruiz.line.pm - reverse DNS on sslhost is OK: SSL OK - wiki.mahdiruiz.line.pm reverse DNS resolves to cp37.wikitide.net - CNAME OK [15:12:41] PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 28%, RTA = 187.54 ms [15:14:02] RECOVERY - bushcraftwiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'bushcraftwiki.com' will expire on Sun 02 Jun 2024 01:15:27 PM GMT +0000. [15:20:48] RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 188.52 ms [15:50:18] PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 183.51 ms [15:58:29] [02RequestSSL] 07redbluegreenhat edited pull request 03#40: T11699: Create a job to automate CNAME and Reverse DNS checks - 13https://github.com/miraheze/RequestSSL/pull/40 [15:59:20] [02RequestSSL] 07redbluegreenhat edited pull request 03#40: T11699: Create a job to automate CNAME and Reverse DNS checks - 13https://github.com/miraheze/RequestSSL/pull/40 [16:00:25] RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 188.87 ms [16:06:37] PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 216.00 ms [16:14:06] !log [macfan@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/sql.php --wiki=wodoxwiki /srv/mediawiki/1.41/extensions/CheckUser/schema/mysq (END - exit=256) [16:14:13] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:14:21] !log [macfan@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/sql.php --wiki=wodoxwiki /srv/mediawiki/1.41/extensions/CheckUser/schema/mysql/patch-cu_private_event-def.sql (END - exit=0) [16:14:28] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:14:42] RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 184.11 ms [16:15:14] !log [macfan@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/sql.php --wiki=wodoxwiki /srv/mediawiki/1.41/extensions/CheckUser/schema/mysql/patch-cu_changes-add-cuc_only_for_read_old.sql (END - exit=0) [16:15:22] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:20:56] PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 44%, RTA = 184.80 ms [16:27:00] RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 179.59 ms [16:41:34] PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 28%, RTA = 180.43 ms [16:43:36] !log (simpleelectronicswiki) INSERT INTO content_models(model_id,model_name) VALUES(6,"sanitized-css"); [16:43:43] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:45:36] RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 179.77 ms [16:55:27] !log [macfan@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/importImages.php --wiki=321nailswiki /home/macfan/images --search-recursively (START) [16:55:34] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:03:20] !log (321nailswiki) NSERT INTO content_models(model_id,model_name) VALUES(6,"sanitized-css"); [17:03:28] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:23:14] !log [macfan@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/importImages.php --wiki=321nailswiki /home/macfan/images --search-recursively (END - exit=0) [17:23:22] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:29:05] [02MirahezeMagic] 07Universal-Omega created branch 03services - 13https://github.com/miraheze/MirahezeMagic [17:29:08] [02miraheze/MirahezeMagic] 07Universal-Omega pushed 031 commit to 03services [+0/-0/±1] 13https://github.com/miraheze/MirahezeMagic/commit/55247eee6d06 [17:29:10] [02miraheze/MirahezeMagic] 07Universal-Omega 0355247ee - Inject CentralAuth services again [17:30:46] [02MirahezeMagic] 07Universal-Omega opened pull request 03#477: Inject CentralAuth services again - 13https://github.com/miraheze/MirahezeMagic/pull/477 [17:31:33] [02miraheze/MirahezeMagic] 07Universal-Omega pushed 031 commit to 03services [+0/-0/±1] 13https://github.com/miraheze/MirahezeMagic/compare/55247eee6d06...50fc718e0762 [17:31:36] [02miraheze/MirahezeMagic] 07Universal-Omega 0350fc718 - Add optional_services [17:31:39] [02MirahezeMagic] 07Universal-Omega synchronize pull request 03#477: Inject CentralAuth services again - 13https://github.com/miraheze/MirahezeMagic/pull/477 [17:33:12] [02miraheze/RemovePII] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/RemovePII/compare/95d035f0e677...29760e57d2e9 [17:33:14] [02miraheze/RemovePII] 07Universal-Omega 0329760e5 - Fix globalRenameUserValidator [17:34:32] PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 159.92 ms [17:36:32] RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 157.96 ms [17:40:47] miraheze/RemovePII - Universal-Omega the build passed. [17:44:46] miraheze/MirahezeMagic - Universal-Omega the build passed. [17:45:13] [02MirahezeMagic] 07Universal-Omega closed pull request 03#477: Inject CentralAuth services again - 13https://github.com/miraheze/MirahezeMagic/pull/477 [17:45:14] [02miraheze/MirahezeMagic] 07Universal-Omega deleted branch 03services [17:45:17] [02miraheze/MirahezeMagic] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±2] 13https://github.com/miraheze/MirahezeMagic/compare/c7279c1c893e...604a729739fe [17:45:20] [02miraheze/MirahezeMagic] 07Universal-Omega 03604a729 - Inject CentralAuth services again (#477) [17:45:22] [02MirahezeMagic] 07Universal-Omega deleted branch 03services - 13https://github.com/miraheze/MirahezeMagic [17:58:07] miraheze/MirahezeMagic - Universal-Omega the build passed. [18:02:26] !log [@mwtask181] starting deploy of {'folders': '1.41/extensions/MirahezeMagic'} to all [18:02:34] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:02:36] !log [@mwtask181] finished deploy of {'folders': '1.41/extensions/MirahezeMagic'} to all - SUCCESS in 9s [18:02:43] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:07:11] !log [@mwtask171] starting deploy of {'folders': '1.41/extensions/MirahezeMagic'} to all [18:07:18] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:07:19] !log [@mwtask171] finished deploy of {'folders': '1.41/extensions/MirahezeMagic'} to all - SUCCESS in 8s [18:07:27] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:14:34] PROBLEM - wiki.mahdiruiz.line.pm - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query line.pm. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [19:43:34] PROBLEM - wiki.mahdiruiz.line.pm - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.mahdiruiz.line.pm All nameservers failed to answer the query. [20:02:54] [02miraheze/MirahezeMagic] 07Universal-Omega pushed 031 commit to 03rights-access-ids [+0/-0/±1] 13https://github.com/miraheze/MirahezeMagic/commit/6191e6551247 [20:02:55] [02miraheze/MirahezeMagic] 07Universal-Omega 036191e65 - Support different IDs for different wikis in UserGetRightsRemove [20:02:56] [02MirahezeMagic] 07Universal-Omega created branch 03rights-access-ids - 13https://github.com/miraheze/MirahezeMagic [20:02:59] [02MirahezeMagic] 07Universal-Omega opened pull request 03#478: Support different IDs for different wikis in UserGetRightsRemove - 13https://github.com/miraheze/MirahezeMagic/pull/478 [20:05:32] [02miraheze/MirahezeMagic] 07Universal-Omega pushed 031 commit to 03rights-access-ids [+0/-0/±1] 13https://github.com/miraheze/MirahezeMagic/compare/6191e6551247...ce0aec5ba965 [20:05:34] [02miraheze/MirahezeMagic] 07Universal-Omega 03ce0aec5 - Use MirahezeMagicAccessIdsMap [20:05:35] [02MirahezeMagic] 07Universal-Omega synchronize pull request 03#478: Support different IDs for different wikis in UserGetRightsRemove - 13https://github.com/miraheze/MirahezeMagic/pull/478 [20:06:26] [02miraheze/MirahezeMagic] 07Universal-Omega pushed 031 commit to 03rights-access-ids [+0/-0/±1] 13https://github.com/miraheze/MirahezeMagic/compare/ce0aec5ba965...1145f49e192a [20:06:27] [02miraheze/MirahezeMagic] 07Universal-Omega 031145f49 - Fix [20:06:30] [02MirahezeMagic] 07Universal-Omega synchronize pull request 03#478: Support different IDs for different wikis in UserGetRightsRemove - 13https://github.com/miraheze/MirahezeMagic/pull/478 [20:12:34] RECOVERY - wiki.mahdiruiz.line.pm - reverse DNS on sslhost is OK: SSL OK - wiki.mahdiruiz.line.pm reverse DNS resolves to cp37.wikitide.net - CNAME OK [20:19:15] miraheze/MirahezeMagic - Universal-Omega the build passed. [23:13:20] !log [macfan@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/migrateExternallinks.php --wiki=wodoxwiki (END - exit=0) [23:13:28] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:14:46] !log [macfan@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/sql.php --wiki=wodoxwiki /srv/mediawiki/1.41/maintenance/archives/patch-externallinks-el_to_path.sql (END - exit=0) [23:14:53] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:50:43] !log [agent@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/migrateRevisionCommentTemp.php --wiki=wodoxwiki (END - exit=0) [23:50:50] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log