[00:01:14] PROBLEM - cp27 HTTP 4xx/5xx ERROR Rate on cp27 is WARNING: WARNING - NGINX Error Rate is 50% [00:03:15] PROBLEM - cp27 HTTP 4xx/5xx ERROR Rate on cp27 is CRITICAL: CRITICAL - NGINX Error Rate is 67% [00:04:32] RECOVERY - cp37 Disk Space on cp37 is OK: DISK OK - free space: / 21343MiB (24% inode=98%); [00:05:04] RECOVERY - cp41 Disk Space on cp41 is OK: DISK OK - free space: / 19456MiB (20% inode=98%); [00:05:08] RECOVERY - cp36 Disk Space on cp36 is OK: DISK OK - free space: / 21336MiB (24% inode=98%); [01:34:15] RECOVERY - os161 Disk Space on os161 is OK: DISK OK - free space: / 157719MiB (71% inode=99%); [01:35:37] RECOVERY - os151 Disk Space on os151 is OK: DISK OK - free space: / 180408MiB (81% inode=99%); [01:40:15] PROBLEM - graylog161 Current Load on graylog161 is WARNING: LOAD WARNING - total load average: 7.45, 5.54, 3.22 [01:46:12] PROBLEM - os151 Current Load on os151 is CRITICAL: LOAD CRITICAL - total load average: 4.11, 3.29, 1.89 [01:46:15] RECOVERY - graylog161 Current Load on graylog161 is OK: LOAD OK - total load average: 6.15, 6.36, 4.39 [01:48:08] PROBLEM - os151 Current Load on os151 is WARNING: LOAD WARNING - total load average: 3.66, 3.38, 2.09 [01:50:05] RECOVERY - os151 Current Load on os151 is OK: LOAD OK - total load average: 2.03, 3.05, 2.14 [02:58:22] [02YouTube] 07koreirozzu opened pull request 03#27: Improve page loading speed - 13https://github.com/miraheze/YouTube/pull/27 [03:02:25] miraheze/YouTube - koreirozzu the build has errored. [03:14:22] [02miraheze/mw-config] 07AgentIsai pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/63c150fde68d...3863b398aad2 [03:14:25] [02miraheze/mw-config] 07AgentIsai 033863b39 - Use Redis once again for jobs [03:14:43] [02miraheze/mw-config] 07AgentIsai pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/3863b398aad2...9fa79bb768ca [03:14:44] [02miraheze/mw-config] 07AgentIsai 039fa79bb - Disable EventBus [03:15:11] !log [agent@mwtask181] starting deploy of {'pull': 'config', 'config': True} to all [03:15:15] miraheze/mw-config - AgentIsai the build passed. [03:15:19] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:15:22] !log [agent@mwtask181] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 10s [03:15:30] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:15:38] miraheze/mw-config - AgentIsai the build passed. [03:23:17] !log [@test151] starting deploy of {'config': True} to test151 [03:23:18] !log [@test151] finished deploy of {'config': True} to test151 - SUCCESS in 0s [03:23:26] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:23:34] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:37:35] !log [@mwtask171] starting deploy of {'config': True} to all [03:37:43] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:37:43] !log [@mwtask171] finished deploy of {'config': True} to all - SUCCESS in 8s [03:37:52] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:50:30] PROBLEM - ping6 on cp51 is CRITICAL: PING CRITICAL - Packet loss = 37%, RTA = 171.12 ms [03:52:15] oh noes [03:52:28] RECOVERY - ping6 on cp51 is OK: PING OK - Packet loss = 0%, RTA = 175.68 ms [03:53:01] recovered 👍 [03:58:31] PROBLEM - ping6 on cp51 is CRITICAL: PING CRITICAL - Packet loss = 28%, RTA = 173.57 ms [04:02:29] RECOVERY - ping6 on cp51 is OK: PING OK - Packet loss = 0%, RTA = 172.32 ms [04:30:18] PROBLEM - ping6 on cp51 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 190.62 ms [04:32:16] RECOVERY - ping6 on cp51 is OK: PING OK - Packet loss = 0%, RTA = 169.46 ms [04:48:05] PROBLEM - wiki.gab.pt.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.gab.pt.eu.org All nameservers failed to answer the query. [04:49:44] PROBLEM - wiki.mahdiruiz.line.pm - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query line.pm. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [05:17:41] RECOVERY - wiki.gab.pt.eu.org - reverse DNS on sslhost is OK: SSL OK - wiki.gab.pt.eu.org reverse DNS resolves to cp36.wikitide.net - CNAME OK [05:31:51] PROBLEM - ping6 on cp51 is CRITICAL: PING CRITICAL - Packet loss = 28%, RTA = 172.13 ms [05:33:50] RECOVERY - ping6 on cp51 is OK: PING OK - Packet loss = 0%, RTA = 167.09 ms [05:49:37] RECOVERY - wiki.mahdiruiz.line.pm - reverse DNS on sslhost is OK: SSL OK - wiki.mahdiruiz.line.pm reverse DNS resolves to cp36.wikitide.net - CNAME OK [05:53:55] PROBLEM - ping6 on cp51 is CRITICAL: PING CRITICAL - Packet loss = 28%, RTA = 168.15 ms [05:57:53] RECOVERY - ping6 on cp51 is OK: PING OK - Packet loss = 0%, RTA = 169.56 ms [05:57:58] hm [06:06:41] PROBLEM - wiki.sadboyzpod.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.sadboyzpod.com' expires in 15 day(s) (Thu 02 May 2024 05:37:40 AM GMT +0000). [06:06:52] [02miraheze/ssl] 07WikiTideSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/f31b510f9af2...a8cfcb47a1b3 [06:06:53] [02miraheze/ssl] 07WikiTideSSLBot 03a8cfcb4 - Bot: Update SSL cert for wiki.sadboyzpod.com [06:35:21] RECOVERY - wiki.sadboyzpod.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.sadboyzpod.com' will expire on Mon 15 Jul 2024 05:06:46 AM GMT +0000. [07:20:26] PROBLEM - ping6 on cp51 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 171.58 ms [07:21:46] PROBLEM - wiki.andreijiroh.uk.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.andreijiroh.uk.eu.org All nameservers failed to answer the query. [07:22:24] RECOVERY - ping6 on cp51 is OK: PING OK - Packet loss = 0%, RTA = 165.51 ms [07:38:17] PROBLEM - ping6 on cp51 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 186.62 ms [07:44:16] RECOVERY - ping6 on cp51 is OK: PING OK - Packet loss = 0%, RTA = 169.34 ms [08:19:47] RECOVERY - wiki.andreijiroh.uk.eu.org - reverse DNS on sslhost is OK: SSL OK - wiki.andreijiroh.uk.eu.org reverse DNS resolves to cp37.wikitide.net - CNAME OK [08:22:24] PROBLEM - wiki.mahdiruiz.line.pm - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.mahdiruiz.line.pm All nameservers failed to answer the query. [08:27:04] PROBLEM - ping6 on cp51 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 167.56 ms [08:29:02] RECOVERY - ping6 on cp51 is OK: PING OK - Packet loss = 0%, RTA = 170.13 ms [08:52:22] PROBLEM - wiki.mahdiruiz.line.pm - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query wiki.mahdiruiz.line.pm. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [08:58:56] PROBLEM - ping6 on cp51 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 173.97 ms [09:00:55] RECOVERY - ping6 on cp51 is OK: PING OK - Packet loss = 0%, RTA = 169.15 ms [09:18:55] PROBLEM - ping6 on cp51 is CRITICAL: PING CRITICAL - Packet loss = 28%, RTA = 174.91 ms [09:20:53] RECOVERY - ping6 on cp51 is OK: PING OK - Packet loss = 0%, RTA = 171.48 ms [09:34:52] PROBLEM - ping6 on cp51 is CRITICAL: PING CRITICAL - Packet loss = 28%, RTA = 169.06 ms [09:40:49] RECOVERY - ping6 on cp51 is OK: PING OK - Packet loss = 0%, RTA = 179.10 ms [09:52:21] RECOVERY - wiki.mahdiruiz.line.pm - reverse DNS on sslhost is OK: SSL OK - wiki.mahdiruiz.line.pm reverse DNS resolves to cp37.wikitide.net - CNAME OK [10:31:31] PROBLEM - cp36 HTTP 4xx/5xx ERROR Rate on cp36 is CRITICAL: CRITICAL - NGINX Error Rate is 100% [10:31:36] PROBLEM - www.thegreatwar.uk - LetsEncrypt on sslhost is CRITICAL: connect to address www.thegreatwar.uk and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [10:31:37] PROBLEM - fashiondreamer.wiki - LetsEncrypt on sslhost is CRITICAL: connect to address fashiondreamer.wiki and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [10:31:37] PROBLEM - cp37 Varnish Backends on cp37 is CRITICAL: 9 backends are down. mw151 mw152 mw161 mw162 mw171 mw172 mw181 mw182 mediawiki [10:31:47] PROBLEM - en.omniversalis.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:31:49] PROBLEM - kaylaandrachel.miraheze.org - Sectigo on sslhost is CRITICAL: connect to address kaylaandrachel.miraheze.org and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [10:31:59] PROBLEM - wiki.thunis.eu - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:31:59] PROBLEM - wiki.milkywayidle.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:32:00] PROBLEM - cp37 Nginx Backend for mw151 on cp37 is CRITICAL: connect to address localhost and port 8113: Connection refused [10:32:02] PROBLEM - wiki.10key.plus - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:32:02] PROBLEM - cp37 Nginx Backend for swiftproxy161 on cp37 is CRITICAL: connect to address localhost and port 8206: Connection refused [10:32:06] PROBLEM - wiki.widwwa.co.uk - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:32:09] PROBLEM - cp37 Nginx Backend for mwtask171 on cp37 is CRITICAL: connect to address localhost and port 8161: Connection refused [10:32:10] PROBLEM - cp36 Varnish Backends on cp36 is CRITICAL: 9 backends are down. mw151 mw152 mw161 mw162 mw171 mw172 mw181 mw182 mediawiki [10:32:11] PROBLEM - cp41 Varnish Backends on cp41 is CRITICAL: 9 backends are down. mw151 mw152 mw161 mw162 mw171 mw172 mw181 mw182 mediawiki [10:32:12] PROBLEM - cp37 Nginx Backend for test151 on cp37 is CRITICAL: connect to address localhost and port 8181: Connection refused [10:32:13] PROBLEM - cp37 Nginx Backend for mw152 on cp37 is CRITICAL: connect to address localhost and port 8114: Connection refused [10:32:15] PROBLEM - cp37 Nginx Backend for puppet181 on cp37 is CRITICAL: connect to address localhost and port 8204: Connection refused [10:32:19] PROBLEM - beta.sagan4.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:32:22] PROBLEM - pt.graalmilitary.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:32:27] PROBLEM - cp37 Nginx Backend for mw182 on cp37 is CRITICAL: connect to address localhost and port 8120: Connection refused [10:32:32] PROBLEM - cp41 HTTPS on cp41 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Connection timed out after 10003 milliseconds [10:32:33] PROBLEM - cp36 HTTPS on cp36 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 7 - Failed to connect to cp36.wikitide.net port 443 after 0 ms: Couldn't connect to server [10:32:34] PROBLEM - cp37 Nginx Backend for matomo151 on cp37 is CRITICAL: connect to address localhost and port 8203: Connection refused [10:32:34] PROBLEM - cp37 Nginx Backend for mw162 on cp37 is CRITICAL: connect to address localhost and port 8116: Connection refused [10:32:39] PROBLEM - cp36 Nginx Backend for mw151 on cp36 is CRITICAL: connect to address localhost and port 8113: Connection refused [10:32:41] PROBLEM - cp37 HTTPS on cp37 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 7 - Failed to connect to cp37.wikitide.net port 443 after 0 ms: Couldn't connect to server [10:32:43] PROBLEM - cp37 HTTP 4xx/5xx ERROR Rate on cp37 is CRITICAL: CRITICAL - NGINX Error Rate is 100% [10:32:43] PROBLEM - cp36 Nginx Backend for mw182 on cp36 is CRITICAL: connect to address localhost and port 8120: Connection refused [10:32:45] PROBLEM - cp36 Nginx Backend for swiftproxy161 on cp36 is CRITICAL: connect to address localhost and port 8206: Connection refused [10:32:47] PROBLEM - cp36 Nginx Backend for swiftproxy171 on cp36 is CRITICAL: connect to address localhost and port 8207: Connection refused [10:32:49] PROBLEM - m.miraheze.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:32:49] PROBLEM - cp37 Nginx Backend for reports171 on cp37 is CRITICAL: connect to address localhost and port 8205: Connection refused [10:32:50] PROBLEM - cp36 Nginx Backend for mw172 on cp36 is CRITICAL: connect to address localhost and port 8118: Connection refused [10:32:50] PROBLEM - cp36 Nginx Backend for mon181 on cp36 is CRITICAL: connect to address localhost and port 8201: Connection refused [10:32:50] PROBLEM - encyclopediarobotica.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:32:51] PROBLEM - psycho.engineering - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:32:51] PROBLEM - wiki.joust.ro - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:32:51] PROBLEM - kombinat.eu.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:32:53] PROBLEM - cp37 Nginx Backend for mwtask181 on cp37 is CRITICAL: connect to address localhost and port 8160: Connection refused [10:32:53] PROBLEM - cp51 Varnish Backends on cp51 is CRITICAL: 9 backends are down. mw151 mw152 mw161 mw162 mw171 mw172 mw181 mw182 mediawiki [10:32:55] PROBLEM - wc.miraheze.org on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:32:59] PROBLEM - cp51 HTTP 4xx/5xx ERROR Rate on cp51 is WARNING: WARNING - NGINX Error Rate is 43% [10:32:59] PROBLEM - cp36 Nginx Backend for mw162 on cp36 is CRITICAL: connect to address localhost and port 8116: Connection refused [10:33:04] PROBLEM - cp37 Nginx Backend for phorge171 on cp37 is CRITICAL: connect to address localhost and port 8202: Connection refused [10:33:04] PROBLEM - cp51 Current Load on cp51 is CRITICAL: LOAD CRITICAL - total load average: 15.72, 10.90, 5.23 [10:33:13] PROBLEM - cp36 Nginx Backend for phorge171 on cp36 is CRITICAL: connect to address localhost and port 8202: Connection refused [10:33:14] PROBLEM - sarovia.graalmilitary.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:33:17] PROBLEM - cp37 Nginx Backend for mon181 on cp37 is CRITICAL: connect to address localhost and port 8201: Connection refused [10:33:20] PROBLEM - 321nails.crpteam.club - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:33:26] PROBLEM - cp37 Nginx Backend for mw171 on cp37 is CRITICAL: connect to address localhost and port 8117: Connection refused [10:33:27] PROBLEM - cp41 HTTP 4xx/5xx ERROR Rate on cp41 is CRITICAL: CRITICAL - NGINX Error Rate is 100% [10:33:27] PROBLEM - www.allthetropes.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:33:28] PROBLEM - cp36 Nginx Backend for mw152 on cp36 is CRITICAL: connect to address localhost and port 8114: Connection refused [10:33:29] PROBLEM - thegreatwar.uk - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:33:32] PROBLEM - cp36 Nginx Backend for mw171 on cp36 is CRITICAL: connect to address localhost and port 8117: Connection refused [10:33:32] PROBLEM - cp37 Nginx Backend for mw161 on cp37 is CRITICAL: connect to address localhost and port 8115: Connection refused [10:33:32] PROBLEM - cp37 Nginx Backend for swiftproxy171 on cp37 is CRITICAL: connect to address localhost and port 8207: Connection refused [10:33:32] PROBLEM - wiki.knowledgerevolution.eu - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:33:34] PROBLEM - wiki.iurevar.world - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:33:34] PROBLEM - cp36 Nginx Backend for mwtask171 on cp36 is CRITICAL: connect to address localhost and port 8161: Connection refused [10:33:34] PROBLEM - wiki.zahira.me - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:33:36] PROBLEM - electowiki.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:33:36] PROBLEM - pastport.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:33:38] PROBLEM - www.kinitopedia.lol - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:33:39] PROBLEM - pwsc.polandballwiki.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:33:39] PROBLEM - wiki.macc.nyc - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:33:43] PROBLEM - cp37 Nginx Backend for mw172 on cp37 is CRITICAL: connect to address localhost and port 8118: Connection refused [10:33:43] PROBLEM - osfirsttimer.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:33:44] PROBLEM - n64brew.dev - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:33:44] PROBLEM - lophocmatngu.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:33:45] PROBLEM - cp37 Nginx Backend for mw181 on cp37 is CRITICAL: connect to address localhost and port 8119: Connection refused [10:33:48] PROBLEM - cp36 Nginx Backend for test151 on cp36 is CRITICAL: connect to address localhost and port 8181: Connection refused [10:33:53] PROBLEM - largedu.eu.org - LetsEncrypt on sslhost is CRITICAL: connect to address largedu.eu.org and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [10:33:53] PROBLEM - wiki.sofurry.games - LetsEncrypt on sslhost is CRITICAL: connect to address wiki.sofurry.games and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [10:33:54] PROBLEM - cp36 Nginx Backend for reports171 on cp36 is CRITICAL: connect to address localhost and port 8205: Connection refused [10:33:57] PROBLEM - themagical.world - LetsEncrypt on sslhost is CRITICAL: connect to address themagical.world and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [10:34:01] PROBLEM - rct.wiki - LetsEncrypt on sslhost is CRITICAL: connect to address rct.wiki and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [10:34:01] PROBLEM - yokaiwatchwiki.com - LetsEncrypt on sslhost is CRITICAL: connect to address yokaiwatchwiki.com and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [10:34:03] PROBLEM - wikimas.kr - LetsEncrypt on sslhost is CRITICAL: connect to address wikimas.kr and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [10:34:05] PROBLEM - cp36 Nginx Backend for mwtask181 on cp36 is CRITICAL: connect to address localhost and port 8160: Connection refused [10:34:06] PROBLEM - cp36 Nginx Backend for matomo151 on cp36 is CRITICAL: connect to address localhost and port 8203: Connection refused [10:34:06] PROBLEM - cp36 Nginx Backend for mw161 on cp36 is CRITICAL: connect to address localhost and port 8115: Connection refused [10:34:11] PROBLEM - pornwiki.org - LetsEncrypt on sslhost is CRITICAL: connect to address pornwiki.org and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [10:34:13] PROBLEM - phighting.wiki - LetsEncrypt on sslhost is CRITICAL: connect to address phighting.wiki and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [10:34:13] PROBLEM - www.mwcosmos.com - LetsEncrypt on sslhost is CRITICAL: connect to address www.mwcosmos.com and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [10:34:14] PROBLEM - otherkin.wiki - LetsEncrypt on sslhost is CRITICAL: connect to address otherkin.wiki and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [10:34:15] PROBLEM - cp36 Nginx Backend for puppet181 on cp36 is CRITICAL: connect to address localhost and port 8204: Connection refused [10:34:15] PROBLEM - www.satepedia.com - LetsEncrypt on sslhost is CRITICAL: connect to address www.satepedia.com and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [10:34:21] PROBLEM - cp36 Nginx Backend for mw181 on cp36 is CRITICAL: connect to address localhost and port 8119: Connection refused [10:34:22] PROBLEM - infectowiki.com - LetsEncrypt on sslhost is CRITICAL: connect to address infectowiki.com and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [10:34:31] PROBLEM - piwik.miraheze.org - Sectigo on sslhost is CRITICAL: connect to address piwik.miraheze.org and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [10:34:34] PROBLEM - removededmsongs.miraheze.org - Sectigo on sslhost is CRITICAL: connect to address removededmsongs.miraheze.org and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [10:34:37] PROBLEM - roll-of-arms.com - LetsEncrypt on sslhost is CRITICAL: connect to address roll-of-arms.com and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [10:34:45] RECOVERY - m.miraheze.org - LetsEncrypt on sslhost is OK: OK - Certificate 'm.miraheze.org' will expire on Wed 26 Jun 2024 05:32:24 PM GMT +0000. [10:34:55] RECOVERY - wc.miraheze.org on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Mon 18 Nov 2024 11:59:59 PM GMT +0000. [10:34:55] RECOVERY - cp51 Varnish Backends on cp51 is OK: All 19 backends are healthy [10:34:58] RECOVERY - cp51 HTTP 4xx/5xx ERROR Rate on cp51 is OK: OK - NGINX Error Rate is 26% [10:36:10] RECOVERY - cp41 Varnish Backends on cp41 is OK: All 19 backends are healthy [10:36:31] RECOVERY - cp41 HTTPS on cp41 is OK: HTTP OK: HTTP/2 404 - Status line output matched "HTTP/2 404" - 3760 bytes in 1.117 second response time [10:37:27] RECOVERY - cp41 HTTP 4xx/5xx ERROR Rate on cp41 is OK: OK - NGINX Error Rate is 1% [10:38:26] PROBLEM - thesimswiki.com - LetsEncrypt on sslhost is CRITICAL: connect to address thesimswiki.com and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [10:38:32] PROBLEM - ping6 on cp51 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 195.59 ms [10:42:31] RECOVERY - ping6 on cp51 is OK: PING OK - Packet loss = 0%, RTA = 193.21 ms [10:45:06] PROBLEM - cp51 Current Load on cp51 is WARNING: LOAD WARNING - total load average: 6.68, 7.57, 6.40 [10:49:28] RECOVERY - cp36 Nginx Backend for mw152 on cp36 is OK: TCP OK - 0.000 second response time on localhost port 8114 [10:49:32] RECOVERY - cp36 Nginx Backend for mw171 on cp36 is OK: TCP OK - 0.000 second response time on localhost port 8117 [10:49:34] RECOVERY - cp36 Nginx Backend for mwtask171 on cp36 is OK: TCP OK - 0.000 second response time on localhost port 8161 [10:49:48] RECOVERY - cp36 Nginx Backend for test151 on cp36 is OK: TCP OK - 0.000 second response time on localhost port 8181 [10:49:54] RECOVERY - cp36 Nginx Backend for reports171 on cp36 is OK: TCP OK - 0.000 second response time on localhost port 8205 [10:50:05] RECOVERY - cp36 Nginx Backend for mwtask181 on cp36 is OK: TCP OK - 0.000 second response time on localhost port 8160 [10:50:06] RECOVERY - cp36 Nginx Backend for matomo151 on cp36 is OK: TCP OK - 0.000 second response time on localhost port 8203 [10:50:06] RECOVERY - cp36 Nginx Backend for mw161 on cp36 is OK: TCP OK - 0.000 second response time on localhost port 8115 [10:50:10] RECOVERY - cp36 Varnish Backends on cp36 is OK: All 19 backends are healthy [10:50:15] RECOVERY - cp36 Nginx Backend for puppet181 on cp36 is OK: TCP OK - 0.000 second response time on localhost port 8204 [10:50:21] RECOVERY - cp36 Nginx Backend for mw181 on cp36 is OK: TCP OK - 0.000 second response time on localhost port 8119 [10:50:32] RECOVERY - cp36 HTTPS on cp36 is OK: HTTP OK: HTTP/2 404 - Status line output matched "HTTP/2 404" - 3781 bytes in 0.067 second response time [10:50:39] RECOVERY - cp36 Nginx Backend for mw151 on cp36 is OK: TCP OK - 0.000 second response time on localhost port 8113 [10:50:43] RECOVERY - cp36 Nginx Backend for mw182 on cp36 is OK: TCP OK - 0.000 second response time on localhost port 8120 [10:50:45] RECOVERY - cp36 Nginx Backend for swiftproxy161 on cp36 is OK: TCP OK - 0.000 second response time on localhost port 8206 [10:50:47] RECOVERY - cp36 Nginx Backend for swiftproxy171 on cp36 is OK: TCP OK - 0.000 second response time on localhost port 8207 [10:50:50] RECOVERY - cp36 Nginx Backend for mw172 on cp36 is OK: TCP OK - 0.000 second response time on localhost port 8118 [10:50:50] RECOVERY - cp36 Nginx Backend for mon181 on cp36 is OK: TCP OK - 0.000 second response time on localhost port 8201 [10:50:59] RECOVERY - cp36 Nginx Backend for mw162 on cp36 is OK: TCP OK - 0.000 second response time on localhost port 8116 [10:51:06] RECOVERY - cp51 Current Load on cp51 is OK: LOAD OK - total load average: 4.07, 6.56, 6.47 [10:51:13] RECOVERY - cp36 Nginx Backend for phorge171 on cp36 is OK: TCP OK - 0.000 second response time on localhost port 8202 [10:51:31] RECOVERY - cp36 HTTP 4xx/5xx ERROR Rate on cp36 is OK: OK - NGINX Error Rate is 1% [10:59:17] RECOVERY - cp37 Nginx Backend for mon181 on cp37 is OK: TCP OK - 0.000 second response time on localhost port 8201 [10:59:26] RECOVERY - cp37 Nginx Backend for mw171 on cp37 is OK: TCP OK - 0.000 second response time on localhost port 8117 [10:59:32] RECOVERY - cp37 Nginx Backend for mw161 on cp37 is OK: TCP OK - 0.000 second response time on localhost port 8115 [10:59:32] RECOVERY - cp37 Nginx Backend for swiftproxy171 on cp37 is OK: TCP OK - 0.000 second response time on localhost port 8207 [10:59:43] RECOVERY - cp37 Nginx Backend for mw172 on cp37 is OK: TCP OK - 0.000 second response time on localhost port 8118 [10:59:45] RECOVERY - cp37 Nginx Backend for mw181 on cp37 is OK: TCP OK - 0.000 second response time on localhost port 8119 [11:00:00] RECOVERY - cp37 Nginx Backend for mw151 on cp37 is OK: TCP OK - 0.000 second response time on localhost port 8113 [11:00:02] RECOVERY - cp37 Nginx Backend for swiftproxy161 on cp37 is OK: TCP OK - 0.000 second response time on localhost port 8206 [11:00:09] RECOVERY - cp37 Nginx Backend for mwtask171 on cp37 is OK: TCP OK - 0.000 second response time on localhost port 8161 [11:00:12] RECOVERY - cp37 Nginx Backend for test151 on cp37 is OK: TCP OK - 0.000 second response time on localhost port 8181 [11:00:13] RECOVERY - cp37 Nginx Backend for mw152 on cp37 is OK: TCP OK - 0.000 second response time on localhost port 8114 [11:00:15] RECOVERY - cp37 Nginx Backend for puppet181 on cp37 is OK: TCP OK - 0.000 second response time on localhost port 8204 [11:00:27] RECOVERY - cp37 Nginx Backend for mw182 on cp37 is OK: TCP OK - 0.000 second response time on localhost port 8120 [11:00:34] RECOVERY - cp37 Nginx Backend for matomo151 on cp37 is OK: TCP OK - 0.000 second response time on localhost port 8203 [11:00:34] RECOVERY - cp37 Nginx Backend for mw162 on cp37 is OK: TCP OK - 0.000 second response time on localhost port 8116 [11:00:41] RECOVERY - cp37 HTTPS on cp37 is OK: HTTP OK: HTTP/2 404 - Status line output matched "HTTP/2 404" - 3759 bytes in 0.065 second response time [11:00:43] RECOVERY - cp37 HTTP 4xx/5xx ERROR Rate on cp37 is OK: OK - NGINX Error Rate is 3% [11:00:49] RECOVERY - cp37 Nginx Backend for reports171 on cp37 is OK: TCP OK - 0.000 second response time on localhost port 8205 [11:00:53] RECOVERY - cp37 Nginx Backend for mwtask181 on cp37 is OK: TCP OK - 0.000 second response time on localhost port 8160 [11:00:59] RECOVERY - pt.graalmilitary.com - LetsEncrypt on sslhost is OK: OK - Certificate 'pt.graalmilitary.com' will expire on Wed 15 May 2024 04:15:06 AM GMT +0000. [11:01:04] RECOVERY - cp37 Nginx Backend for phorge171 on cp37 is OK: TCP OK - 0.000 second response time on localhost port 8202 [11:01:08] RECOVERY - fashiondreamer.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'fashiondreamer.wiki' will expire on Tue 21 May 2024 04:30:55 PM GMT +0000. [11:01:09] RECOVERY - www.thegreatwar.uk - LetsEncrypt on sslhost is OK: OK - Certificate 'thegreatwar.uk' will expire on Mon 08 Jul 2024 03:02:33 PM GMT +0000. [11:01:18] RECOVERY - en.omniversalis.org - LetsEncrypt on sslhost is OK: OK - Certificate 'en.omniversalis.org' will expire on Thu 16 May 2024 02:43:10 AM GMT +0000. [11:01:32] RECOVERY - kaylaandrachel.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Mon 18 Nov 2024 11:59:59 PM GMT +0000. [11:01:35] RECOVERY - cp37 Varnish Backends on cp37 is OK: All 19 backends are healthy [11:01:42] RECOVERY - wiki.milkywayidle.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.milkywayidle.com' will expire on Thu 16 May 2024 02:06:06 PM GMT +0000. [11:01:42] RECOVERY - wiki.thunis.eu - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.thunis.eu' will expire on Tue 14 May 2024 10:36:45 AM GMT +0000. [11:01:45] RECOVERY - encyclopediarobotica.org - LetsEncrypt on sslhost is OK: OK - Certificate 'encyclopediarobotica.org' will expire on Mon 01 Jul 2024 04:30:05 PM GMT +0000. [11:01:46] RECOVERY - psycho.engineering - LetsEncrypt on sslhost is OK: OK - Certificate 'psycho.engineering' will expire on Sat 18 May 2024 02:53:17 PM GMT +0000. [11:01:46] RECOVERY - kombinat.eu.org - LetsEncrypt on sslhost is OK: OK - Certificate 'kombinat.eu.org' will expire on Thu 27 Jun 2024 11:55:32 AM GMT +0000. [11:01:47] RECOVERY - wiki.joust.ro - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.joust.ro' will expire on Tue 14 May 2024 12:37:22 PM GMT +0000. [11:01:49] RECOVERY - wiki.10key.plus - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.10key.plus' will expire on Thu 16 May 2024 01:08:59 PM GMT +0000. [11:01:57] RECOVERY - wiki.widwwa.co.uk - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.widwwa.co.uk' will expire on Sat 13 Jul 2024 06:04:01 PM GMT +0000. [11:02:10] RECOVERY - beta.sagan4.org - LetsEncrypt on sslhost is OK: OK - Certificate 'beta.sagan4.org' will expire on Wed 29 May 2024 01:43:07 PM GMT +0000. [11:02:28] RECOVERY - wiki.sofurry.games - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.sofurry.games' will expire on Fri 05 Jul 2024 08:48:58 PM GMT +0000. [11:02:28] RECOVERY - largedu.eu.org - LetsEncrypt on sslhost is OK: OK - Certificate 'largedu.eu.org' will expire on Thu 16 May 2024 02:22:30 PM GMT +0000. [11:02:36] RECOVERY - themagical.world - LetsEncrypt on sslhost is OK: OK - Certificate 'themagical.world' will expire on Fri 05 Jul 2024 08:53:14 PM GMT +0000. [11:02:40] RECOVERY - sarovia.graalmilitary.com - LetsEncrypt on sslhost is OK: OK - Certificate 'sarovia.graalmilitary.com' will expire on Wed 15 May 2024 03:43:11 AM GMT +0000. [11:02:51] RECOVERY - wikimas.kr - LetsEncrypt on sslhost is OK: OK - Certificate 'wikimas.kr' will expire on Wed 15 May 2024 12:56:54 PM GMT +0000. [11:02:53] RECOVERY - 321nails.crpteam.club - LetsEncrypt on sslhost is OK: OK - Certificate '321nails.crpteam.club' will expire on Thu 16 May 2024 02:09:05 PM GMT +0000. [11:02:54] RECOVERY - wiki.knowledgerevolution.eu - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.knowledgerevolution.eu' will expire on Mon 27 May 2024 05:45:39 PM GMT +0000. [11:02:55] RECOVERY - wiki.zahira.me - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.zahira.me' will expire on Thu 16 May 2024 06:14:44 PM GMT +0000. [11:03:01] RECOVERY - www.allthetropes.org - LetsEncrypt on sslhost is OK: OK - Certificate 'allthetropes.org' will expire on Mon 13 May 2024 11:30:59 PM GMT +0000. [11:03:03] RECOVERY - thegreatwar.uk - LetsEncrypt on sslhost is OK: OK - Certificate 'thegreatwar.uk' will expire on Mon 08 Jul 2024 03:02:33 PM GMT +0000. [11:03:04] RECOVERY - pornwiki.org - LetsEncrypt on sslhost is OK: OK - Certificate 'en.pornwiki.org' will expire on Thu 16 May 2024 05:51:10 PM GMT +0000. [11:03:05] RECOVERY - n64brew.dev - LetsEncrypt on sslhost is OK: OK - Certificate 'n64brew.dev' will expire on Tue 14 May 2024 08:47:45 PM GMT +0000. [11:03:05] RECOVERY - lophocmatngu.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'lophocmatngu.wiki' will expire on Thu 09 May 2024 05:32:10 PM GMT +0000. [11:03:12] RECOVERY - www.satepedia.com - LetsEncrypt on sslhost is OK: OK - Certificate 'www.satepedia.com' will expire on Sun 07 Jul 2024 03:00:18 AM GMT +0000. [11:03:13] RECOVERY - phighting.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'phighting.wiki' will expire on Thu 06 Jun 2024 09:33:21 PM GMT +0000. [11:03:13] RECOVERY - www.mwcosmos.com - LetsEncrypt on sslhost is OK: OK - Certificate 'mwcosmos.com' will expire on Thu 09 May 2024 02:41:46 AM GMT +0000. [11:03:14] RECOVERY - otherkin.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'otherkin.wiki' will expire on Fri 14 Jun 2024 04:45:13 PM GMT +0000. [11:03:14] RECOVERY - pastport.org - LetsEncrypt on sslhost is OK: OK - Certificate 'pastport.org' will expire on Wed 15 May 2024 06:30:46 PM GMT +0000. [11:03:16] RECOVERY - electowiki.org - LetsEncrypt on sslhost is OK: OK - Certificate 'electowiki.org' will expire on Sat 18 May 2024 03:01:50 PM GMT +0000. [11:03:18] RECOVERY - wiki.iurevar.world - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.iurevar.world' will expire on Wed 15 May 2024 05:16:03 PM GMT +0000. [11:03:24] RECOVERY - infectowiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'infectowiki.com' will expire on Tue 14 May 2024 05:45:44 PM GMT +0000. [11:03:27] RECOVERY - osfirsttimer.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'osfirsttimer.wiki' will expire on Sat 13 Jul 2024 09:16:39 PM GMT +0000. [11:03:29] RECOVERY - www.kinitopedia.lol - LetsEncrypt on sslhost is OK: OK - Certificate 'www.kinitopedia.lol' will expire on Wed 26 Jun 2024 10:17:49 PM GMT +0000. [11:03:30] RECOVERY - pwsc.polandballwiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'pwsc.polandballwiki.com' will expire on Wed 15 May 2024 11:36:03 AM GMT +0000. [11:03:30] RECOVERY - wiki.macc.nyc - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.macc.nyc' will expire on Mon 13 May 2024 11:41:25 PM GMT +0000. [11:03:49] RECOVERY - piwik.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Mon 18 Nov 2024 11:59:59 PM GMT +0000. [11:03:57] RECOVERY - yokaiwatchwiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'yokaiwatchwiki.com' will expire on Thu 16 May 2024 07:28:26 PM GMT +0000. [11:03:58] RECOVERY - roll-of-arms.com - LetsEncrypt on sslhost is OK: OK - Certificate 'roll-of-arms.com' will expire on Thu 16 May 2024 02:08:26 AM GMT +0000. [11:04:00] RECOVERY - rct.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'rct.wiki' will expire on Wed 15 May 2024 01:02:31 PM GMT +0000. [11:04:22] RECOVERY - removededmsongs.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Mon 18 Nov 2024 11:59:59 PM GMT +0000. [11:07:21] RECOVERY - thesimswiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'www.thesimswiki.com' will expire on Fri 03 May 2024 01:21:33 AM GMT +0000. [11:24:20] PROBLEM - wiki.mahdiruiz.line.pm - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query line.pm. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [12:26:24] PROBLEM - wiki.mahdiruiz.line.pm - LetsEncrypt on sslhost is CRITICAL: Temporary failure in name resolutionHTTP CRITICAL - Unable to open TCP socket [12:48:05] PROBLEM - wiki.gab.pt.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.gab.pt.eu.org All nameservers failed to answer the query. [12:54:17] PROBLEM - wiki.mahdiruiz.line.pm - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.mahdiruiz.line.pm All nameservers failed to answer the query. [13:17:41] RECOVERY - wiki.gab.pt.eu.org - reverse DNS on sslhost is OK: SSL OK - wiki.gab.pt.eu.org reverse DNS resolves to cp37.wikitide.net - CNAME OK [13:25:53] RECOVERY - wiki.mahdiruiz.line.pm - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.mahdiruiz.line.pm' will expire on Fri 14 Jun 2024 04:28:50 PM GMT +0000. [13:54:11] RECOVERY - wiki.mahdiruiz.line.pm - reverse DNS on sslhost is OK: SSL OK - wiki.mahdiruiz.line.pm reverse DNS resolves to cp36.wikitide.net - CNAME OK [13:57:29] PROBLEM - ping6 on cp51 is CRITICAL: PING CRITICAL - Packet loss = 28%, RTA = 170.62 ms [13:59:27] RECOVERY - ping6 on cp51 is OK: PING OK - Packet loss = 0%, RTA = 177.06 ms [14:07:01] [02miraheze/puppet] 07Universal-Omega pushed 031 commit to 03database-admins [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/92d12126cc65...34cf61333527 [14:07:02] [02miraheze/puppet] 07Universal-Omega 0334cf613 - Add [14:07:04] [02puppet] 07Universal-Omega synchronize pull request 03#3834: Add a database-admins group - 13https://github.com/miraheze/puppet/pull/3834 [14:07:29] [02miraheze/puppet] 07Universal-Omega pushed 031 commit to 03database-admins [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/34cf61333527...fe92ad623190 [14:07:31] [02miraheze/puppet] 07Universal-Omega 03fe92ad6 - Add [14:07:33] [02puppet] 07Universal-Omega synchronize pull request 03#3834: Add a database-admins group - 13https://github.com/miraheze/puppet/pull/3834 [14:07:50] [02miraheze/puppet] 07Universal-Omega pushed 031 commit to 03database-admins [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/fe92ad623190...2e7f8a5538a5 [14:07:51] [02miraheze/puppet] 07Universal-Omega 032e7f8a5 - Add [14:07:52] [02puppet] 07Universal-Omega synchronize pull request 03#3834: Add a database-admins group - 13https://github.com/miraheze/puppet/pull/3834 [14:08:11] [02miraheze/puppet] 07Universal-Omega pushed 031 commit to 03database-admins [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/2e7f8a5538a5...0a5e24d61592 [14:08:13] [02miraheze/puppet] 07Universal-Omega 030a5e24d - Add [14:08:16] [02puppet] 07Universal-Omega synchronize pull request 03#3834: Add a database-admins group - 13https://github.com/miraheze/puppet/pull/3834 [15:11:29] PROBLEM - ping6 on cp51 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 170.97 ms [15:15:27] RECOVERY - ping6 on cp51 is OK: PING OK - Packet loss = 0%, RTA = 167.37 ms [15:21:29] PROBLEM - ping6 on cp51 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 173.71 ms [15:27:26] RECOVERY - ping6 on cp51 is OK: PING OK - Packet loss = 0%, RTA = 176.60 ms [15:46:11] [02YouTube] 07koreirozzu commented on pull request 03#27: Improve page loading speed - 13https://github.com/miraheze/YouTube/pull/27#issuecomment-2059406282 [15:46:29] [02YouTube] 07koreirozzu edited a comment on pull request 03#27: Improve page loading speed - 13https://github.com/miraheze/YouTube/pull/27#issuecomment-2059406282 [15:52:38] [02YouTube] 07koreirozzu synchronize pull request 03#27: Improve page loading speed - 13https://github.com/miraheze/YouTube/pull/27 [16:01:04] PROBLEM - cp41 Disk Space on cp41 is WARNING: DISK WARNING - free space: / 10221MiB (10% inode=98%); [16:58:23] PROBLEM - ping6 on cp51 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 169.12 ms [17:00:22] RECOVERY - ping6 on cp51 is OK: PING OK - Packet loss = 0%, RTA = 170.80 ms [17:24:12] !log [macfan@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/importImages.php --wiki=epicduelwikiwiki /home/macfan/images --search-recursively (START) [17:24:13] !log [macfan@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/importImages.php --wiki=epicduelwikiwiki /home/macfan/images --search-recursively (END - exit=0) [17:24:20] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:24:29] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:24:56] !log [macfan@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/importImages.php --wiki=epicduelwikiwiki /home/macfan/images --search-recursively (START) [17:25:05] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:59:38] [02miraheze/mw-config] 07OAuthority pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/9fa79bb768ca...333281590b42 [17:59:39] [02miraheze/mw-config] 07OAuthority 033332815 - temp disable url shortner on 1.42 [18:00:33] miraheze/mw-config - OAuthority the build passed. [18:02:43] !log [@mwtask181] starting deploy of {'config': True} to all [18:02:51] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:02:53] !log [@mwtask181] finished deploy of {'config': True} to all - SUCCESS in 10s [18:03:02] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:07:14] !log [@mwtask171] starting deploy of {'config': True} to all [18:07:23] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:07:23] !log [@mwtask171] finished deploy of {'config': True} to all - SUCCESS in 8s [18:07:31] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:24:04] !log [@test151] starting deploy of {'config': True} to test151 [18:24:05] !log [@test151] finished deploy of {'config': True} to test151 - SUCCESS in 0s [18:24:13] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:24:21] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:34:52] PROBLEM - phorge171 APT on phorge171 is WARNING: APT WARNING: 0 packages available for upgrade (0 critical updates). warnings detected, errors detected. [18:36:53] PROBLEM - phorge171 APT on phorge171 is CRITICAL: APT CRITICAL: 58 packages available for upgrade (29 critical updates). [18:40:26] PROBLEM - swiftac171 APT on swiftac171 is WARNING: APT WARNING: 0 packages available for upgrade (0 critical updates). warnings detected, errors detected. [18:42:26] PROBLEM - swiftac171 APT on swiftac171 is CRITICAL: APT CRITICAL: 16 packages available for upgrade (15 critical updates). [18:46:52] PROBLEM - tssm.wiki - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'tssm.wiki' expires in 15 day(s) (Thu 02 May 2024 06:32:45 PM GMT +0000). [18:47:07] [02miraheze/ssl] 07WikiTideSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/a8cfcb47a1b3...754929e5af9a [18:47:10] [02miraheze/ssl] 07WikiTideSSLBot 03754929e - Bot: Update SSL cert for tssm.wiki [18:47:41] PROBLEM - hardcore.wiki - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'hardcore.wiki' expires in 15 day(s) (Thu 02 May 2024 06:32:35 PM GMT +0000). [18:47:54] [02miraheze/ssl] 07WikiTideSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/754929e5af9a...e5961bd96dc4 [18:47:55] [02miraheze/ssl] 07WikiTideSSLBot 03e5961bd - Bot: Update SSL cert for hardcore.wiki [19:20:01] PROBLEM - ping6 on cp51 is CRITICAL: PING CRITICAL - Packet loss = 28%, RTA = 171.41 ms [19:21:59] RECOVERY - ping6 on cp51 is OK: PING OK - Packet loss = 0%, RTA = 170.38 ms [19:32:47] PROBLEM - wiki.mahdiruiz.line.pm - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.mahdiruiz.line.pm All nameservers failed to answer the query. [19:46:03] RECOVERY - hardcore.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'hardcore.wiki' will expire on Mon 15 Jul 2024 05:47:47 PM GMT +0000. [19:46:37] RECOVERY - tssm.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'tssm.wiki' will expire on Mon 15 Jul 2024 05:47:01 PM GMT +0000. [19:59:46] PROBLEM - ping6 on cp51 is CRITICAL: PING CRITICAL - Packet loss = 28%, RTA = 170.70 ms [20:01:44] RECOVERY - ping6 on cp51 is OK: PING OK - Packet loss = 0%, RTA = 167.82 ms [20:02:08] PROBLEM - cloud17 APT on cloud17 is WARNING: APT WARNING: 0 packages available for upgrade (0 critical updates). warnings detected, errors detected. [20:02:43] RECOVERY - wiki.mahdiruiz.line.pm - reverse DNS on sslhost is OK: SSL OK - wiki.mahdiruiz.line.pm reverse DNS resolves to cp37.wikitide.net - CNAME OK [20:03:15] PROBLEM - cloud16 Puppet on cloud16 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[ulogd2] [20:04:09] PROBLEM - cloud17 APT on cloud17 is CRITICAL: APT CRITICAL: 72 packages available for upgrade (14 critical updates). [20:04:52] PROBLEM - phorge171 APT on phorge171 is WARNING: APT WARNING: 0 packages available for upgrade (0 critical updates). warnings detected, errors detected. [20:06:53] PROBLEM - phorge171 APT on phorge171 is CRITICAL: APT CRITICAL: 58 packages available for upgrade (29 critical updates). [20:31:15] RECOVERY - cloud16 Puppet on cloud16 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [22:01:06] PROBLEM - cp41 Disk Space on cp41 is CRITICAL: connect to address 2400:d320:2161:9775::1 port 5666: No route to hostconnect to host 2400:d320:2161:9775::1 port 5666: No route to host [22:03:04] PROBLEM - cp41 Disk Space on cp41 is WARNING: DISK WARNING - free space: / 8452MiB (9% inode=98%); [22:33:08] PROBLEM - cp36 Disk Space on cp36 is WARNING: DISK WARNING - free space: / 9690MiB (10% inode=98%); [22:42:32] PROBLEM - cp37 Disk Space on cp37 is WARNING: DISK WARNING - free space: / 9712MiB (10% inode=98%); [23:18:05] PROBLEM - wiki.gab.pt.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.gab.pt.eu.org All nameservers failed to answer the query.