[00:02:20] [Grafana] FIRING: The mediawiki job queue has more than 2000 unclaimed jobs https://grafana.wikitide.net/d/GtxbP1Xnk?orgId=1 [00:14:51] RECOVERY - cp37 Disk Space on cp37 is OK: DISK OK - free space: / 51090MiB (11% inode=99%); [00:23:34] PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 22.58, 16.46, 9.80 [00:27:34] RECOVERY - mwtask181 Current Load on mwtask181 is OK: LOAD OK - total load average: 17.56, 18.69, 12.32 [00:32:20] [Grafana] RESOLVED: High Job Queue Backlog https://grafana.wikitide.net/d/GtxbP1Xnk?orgId=1 [00:56:51] PROBLEM - cp37 Disk Space on cp37 is WARNING: DISK WARNING - free space: / 49837MiB (10% inode=99%); [02:39:27] PROBLEM - matomo151 HTTPS on matomo151 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 7 - Failed to connect to matomo151.wikitide.net port 443 after 1 ms: Couldn't connect to server [02:55:29] RECOVERY - matomo151 HTTPS on matomo151 is OK: HTTP OK: HTTP/2 200 - 553 bytes in 1.437 second response time [03:57:39] PROBLEM - ping6 on mattermost1 is CRITICAL: PING CRITICAL - Packet loss = 50%, RTA = 31.35 ms [03:59:41] RECOVERY - ping6 on mattermost1 is OK: PING OK - Packet loss = 0%, RTA = 31.34 ms [04:08:02] PROBLEM - ping6 on mattermost1 is CRITICAL: PING CRITICAL - Packet loss = 100% [04:20:19] RECOVERY - ping6 on mattermost1 is OK: PING OK - Packet loss = 0%, RTA = 31.40 ms [04:24:39] PROBLEM - ping6 on mattermost1 is CRITICAL: PING CRITICAL - Packet loss = 60%, RTA = 49.32 ms [04:28:42] RECOVERY - ping6 on mattermost1 is OK: PING OK - Packet loss = 0%, RTA = 31.93 ms [04:32:58] PROBLEM - ping6 on mattermost1 is CRITICAL: PING CRITICAL - Packet loss = 28%, RTA = 31.38 ms [04:43:15] RECOVERY - ping6 on mattermost1 is OK: PING OK - Packet loss = 0%, RTA = 31.42 ms [05:42:11] PROBLEM - mwtask171 Current Load on mwtask171 is WARNING: LOAD WARNING - total load average: 22.04, 18.54, 10.64 [05:48:11] RECOVERY - mwtask171 Current Load on mwtask171 is OK: LOAD OK - total load average: 9.10, 16.88, 12.86 [06:11:26] PROBLEM - mwtask151 Current Load on mwtask151 is CRITICAL: LOAD CRITICAL - total load average: 24.63, 13.80, 6.06 [06:15:26] PROBLEM - mwtask151 Current Load on mwtask151 is WARNING: LOAD WARNING - total load average: 20.57, 18.81, 9.97 [06:19:26] RECOVERY - mwtask151 Current Load on mwtask151 is OK: LOAD OK - total load average: 20.16, 19.51, 12.29 [06:21:47] PROBLEM - ping6 on mattermost1 is CRITICAL: PING CRITICAL - Packet loss = 100% [06:23:45] RECOVERY - ping6 on mattermost1 is OK: PING OK - Packet loss = 0%, RTA = 31.37 ms [06:38:44] PROBLEM - mwtask161 Current Load on mwtask161 is WARNING: LOAD WARNING - total load average: 21.57, 19.24, 12.31 [06:40:44] RECOVERY - mwtask161 Current Load on mwtask161 is OK: LOAD OK - total load average: 16.09, 18.22, 12.80 [07:00:41] PROBLEM - ping6 on mattermost1 is CRITICAL: PING CRITICAL - Packet loss = 50%, RTA = 31.90 ms [07:04:45] RECOVERY - ping6 on mattermost1 is OK: PING OK - Packet loss = 0%, RTA = 31.51 ms [08:12:05] PROBLEM - ping6 on mattermost1 is CRITICAL: PING CRITICAL - Packet loss = 100% [08:14:04] RECOVERY - ping6 on mattermost1 is OK: PING OK - Packet loss = 0%, RTA = 31.43 ms [08:17:20] PROBLEM - wiki.truevanilla.org - Cloudflare on sslhost is CRITICAL: Temporary failure in name resolutionHTTP CRITICAL - Unable to open TCP socket [08:22:37] PROBLEM - ping6 on mattermost1 is CRITICAL: PING CRITICAL - Packet loss = 50%, RTA = 31.33 ms [08:26:40] RECOVERY - ping6 on mattermost1 is OK: PING OK - Packet loss = 0%, RTA = 31.30 ms [08:30:11] PROBLEM - mwtask171 Current Load on mwtask171 is WARNING: LOAD WARNING - total load average: 20.92, 14.57, 6.83 [08:32:11] RECOVERY - mwtask171 Current Load on mwtask171 is OK: LOAD OK - total load average: 16.97, 15.75, 8.24 [08:40:44] PROBLEM - mwtask161 Current Load on mwtask161 is CRITICAL: LOAD CRITICAL - total load average: 28.83, 14.37, 5.96 [08:44:44] RECOVERY - mwtask161 Current Load on mwtask161 is OK: LOAD OK - total load average: 18.51, 19.89, 10.33 [08:47:13] RECOVERY - wiki.truevanilla.org - Cloudflare on sslhost is OK: OK - Certificate 'wiki.truevanilla.org' will expire on Tue 15 Apr 2025 04:43:16 PM GMT +0000. [08:51:47] PROBLEM - ping6 on mattermost1 is CRITICAL: PING CRITICAL - Packet loss = 100% [08:52:44] PROBLEM - mwtask161 Current Load on mwtask161 is CRITICAL: LOAD CRITICAL - total load average: 33.01, 23.66, 14.62 [08:53:45] RECOVERY - ping6 on mattermost1 is OK: PING OK - Packet loss = 0%, RTA = 31.40 ms [08:56:44] RECOVERY - mwtask161 Current Load on mwtask161 is OK: LOAD OK - total load average: 5.70, 18.28, 14.90 [09:04:44] PROBLEM - mwtask161 Current Load on mwtask161 is CRITICAL: LOAD CRITICAL - total load average: 26.48, 20.37, 16.50 [09:24:44] PROBLEM - mwtask161 Current Load on mwtask161 is WARNING: LOAD WARNING - total load average: 6.80, 19.13, 20.89 [09:26:44] RECOVERY - mwtask161 Current Load on mwtask161 is OK: LOAD OK - total load average: 9.41, 16.66, 19.79 [09:33:41] PROBLEM - mwtask151 Current Load on mwtask151 is CRITICAL: LOAD CRITICAL - total load average: 29.20, 17.40, 9.30 [09:37:32] RECOVERY - mwtask151 Current Load on mwtask151 is OK: LOAD OK - total load average: 6.80, 16.07, 10.95 [09:41:26] PROBLEM - mwtask151 Current Load on mwtask151 is CRITICAL: LOAD CRITICAL - total load average: 29.38, 22.49, 14.57 [09:43:26] PROBLEM - mwtask151 Current Load on mwtask151 is WARNING: LOAD WARNING - total load average: 16.93, 21.78, 15.38 [09:45:26] PROBLEM - mwtask151 Current Load on mwtask151 is CRITICAL: LOAD CRITICAL - total load average: 24.41, 21.78, 16.06 [09:49:26] PROBLEM - mwtask151 Current Load on mwtask151 is WARNING: LOAD WARNING - total load average: 17.27, 23.22, 18.21 [09:51:26] PROBLEM - mwtask151 Current Load on mwtask151 is CRITICAL: LOAD CRITICAL - total load average: 26.97, 24.33, 19.17 [10:27:26] PROBLEM - mwtask151 Current Load on mwtask151 is WARNING: LOAD WARNING - total load average: 15.11, 19.65, 23.46 [10:29:26] PROBLEM - mwtask151 Current Load on mwtask151 is CRITICAL: LOAD CRITICAL - total load average: 29.70, 23.55, 24.42 [10:35:26] PROBLEM - mwtask151 Current Load on mwtask151 is WARNING: LOAD WARNING - total load average: 16.47, 22.07, 23.98 [10:37:26] PROBLEM - mwtask151 Current Load on mwtask151 is CRITICAL: LOAD CRITICAL - total load average: 27.92, 24.59, 24.68 [10:45:26] PROBLEM - mwtask151 Current Load on mwtask151 is WARNING: LOAD WARNING - total load average: 3.48, 18.49, 23.05 [10:51:26] RECOVERY - mwtask151 Current Load on mwtask151 is OK: LOAD OK - total load average: 3.60, 13.30, 19.56 [11:01:26] PROBLEM - mwtask151 Current Load on mwtask151 is CRITICAL: LOAD CRITICAL - total load average: 27.36, 23.41, 21.39 [11:15:26] PROBLEM - mwtask151 Current Load on mwtask151 is WARNING: LOAD WARNING - total load average: 10.51, 21.96, 23.39 [11:19:26] RECOVERY - mwtask151 Current Load on mwtask151 is OK: LOAD OK - total load average: 17.23, 16.09, 20.37 [11:34:13] PROBLEM - ping6 on mattermost1 is CRITICAL: PING CRITICAL - Packet loss = 70%, RTA = 31.32 ms [11:38:16] RECOVERY - ping6 on mattermost1 is OK: PING OK - Packet loss = 0%, RTA = 31.37 ms [11:42:36] PROBLEM - ping6 on mattermost1 is CRITICAL: PING CRITICAL - Packet loss = 70%, RTA = 31.35 ms [11:46:39] RECOVERY - ping6 on mattermost1 is OK: PING OK - Packet loss = 0%, RTA = 31.29 ms [11:50:57] PROBLEM - ping6 on mattermost1 is CRITICAL: PING CRITICAL - Packet loss = 44%, RTA = 31.38 ms [12:01:14] RECOVERY - ping6 on mattermost1 is OK: PING OK - Packet loss = 0%, RTA = 31.32 ms [12:39:05] PROBLEM - dccomicswiki.com - LetsEncrypt on sslhost is CRITICAL: connect to address dccomicswiki.com and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [12:40:17] PROBLEM - db171 Current Load on db171 is CRITICAL: LOAD CRITICAL - total load average: 12.42, 13.92, 9.61 [12:40:41] PROBLEM - cp36 HTTPS on cp36 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 7 - Failed to connect to cp36.wikitide.net port 443 after 0 ms: Couldn't connect to server [12:40:57] PROBLEM - cp36 HTTP 4xx/5xx ERROR Rate on cp36 is CRITICAL: CRITICAL - NGINX Error Rate is 99% [12:41:02] PROBLEM - phighting.wiki - LetsEncrypt on sslhost is CRITICAL: connect to address phighting.wiki and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [12:41:04] PROBLEM - cp36 Nginx Backend for mon181 on cp36 is CRITICAL: connect to address localhost and port 8201: Connection refused [12:41:04] PROBLEM - puzzles.wiki - LetsEncrypt on sslhost is CRITICAL: connect to address puzzles.wiki and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [12:41:08] PROBLEM - cp36 Nginx Backend for reports171 on cp36 is CRITICAL: connect to address localhost and port 8205: Connection refused [12:41:12] PROBLEM - ns1 GDNSD Datacenters on ns1 is CRITICAL: CRITICAL - 2 datacenters are down: 38.46.223.205/cpweb, 2602:294:0:b13::110/cpweb [12:41:13] PROBLEM - cp36 Nginx Backend for mwtask171 on cp36 is CRITICAL: connect to address localhost and port 8161: Connection refused [12:41:14] PROBLEM - cp36 Varnish Backends on cp36 is CRITICAL: 17 backends are down. mw151 mw152 mw161 mw162 mw171 mw172 mw181 mw182 mw153 mw154 mw163 mw164 mw173 mw174 mw183 mw184 mediawiki [12:41:16] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 2 datacenters are down: 38.46.223.205/cpweb, 2602:294:0:b13::110/cpweb [12:41:19] PROBLEM - cp36 Nginx Backend for mw153 on cp36 is CRITICAL: connect to address localhost and port 8121: Connection refused [12:41:26] PROBLEM - cp36 Nginx Backend for matomo151 on cp36 is CRITICAL: connect to address localhost and port 8203: Connection refused [12:41:26] PROBLEM - cp36 Nginx Backend for test151 on cp36 is CRITICAL: connect to address localhost and port 8181: Connection refused [12:41:26] PROBLEM - cp36 Nginx Backend for mw171 on cp36 is CRITICAL: connect to address localhost and port 8117: Connection refused [12:41:27] PROBLEM - kingdomdeath.wiki - LetsEncrypt on sslhost is CRITICAL: connect to address kingdomdeath.wiki and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [12:41:27] PROBLEM - encyclopediarobotica.org - LetsEncrypt on sslhost is CRITICAL: connect to address encyclopediarobotica.org and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [12:41:30] PROBLEM - cp36 Nginx Backend for mw183 on cp36 is CRITICAL: connect to address localhost and port 8127: Connection refused [12:41:34] PROBLEM - rarewarewiki.com - LetsEncrypt on sslhost is CRITICAL: connect to address rarewarewiki.com and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [12:41:34] PROBLEM - trollpasta.com - LetsEncrypt on sslhost is CRITICAL: connect to address trollpasta.com and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [12:41:37] PROBLEM - binrayarchives.com - LetsEncrypt on sslhost is CRITICAL: connect to address binrayarchives.com and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [12:41:38] PROBLEM - cp36 Nginx Backend for swiftproxy171 on cp36 is CRITICAL: connect to address localhost and port 8207: Connection refused [12:41:50] PROBLEM - cp36 Nginx Backend for mwtask161 on cp36 is CRITICAL: connect to address localhost and port 8163: Connection refused [12:41:50] PROBLEM - cp36 Nginx Backend for mwtask151 on cp36 is CRITICAL: connect to address localhost and port 8162: Connection refused [12:41:51] PROBLEM - cp36 Nginx Backend for mwtask181 on cp36 is CRITICAL: connect to address localhost and port 8160: Connection refused [12:41:54] PROBLEM - cp36 Nginx Backend for phorge171 on cp36 is CRITICAL: connect to address localhost and port 8202: Connection refused [12:41:56] PROBLEM - cp36 Nginx Backend for puppet181 on cp36 is CRITICAL: connect to address localhost and port 8204: Connection refused [12:41:58] PROBLEM - cp36 Nginx Backend for mw163 on cp36 is CRITICAL: connect to address localhost and port 8123: Connection refused [12:42:01] PROBLEM - cp36 Nginx Backend for mw161 on cp36 is CRITICAL: connect to address localhost and port 8115: Connection refused [12:42:10] PROBLEM - cp36 Nginx Backend for mw184 on cp36 is CRITICAL: connect to address localhost and port 8128: Connection refused [12:42:13] PROBLEM - cp36 Nginx Backend for mw181 on cp36 is CRITICAL: connect to address localhost and port 8119: Connection refused [12:42:17] PROBLEM - db171 Current Load on db171 is WARNING: LOAD WARNING - total load average: 5.32, 10.80, 8.99 [12:42:25] PROBLEM - cp36 Nginx Backend for mw154 on cp36 is CRITICAL: connect to address localhost and port 8122: Connection refused [12:42:30] PROBLEM - cp36 Nginx Backend for mw174 on cp36 is CRITICAL: connect to address localhost and port 8126: Connection refused [12:42:31] PROBLEM - cp36 Nginx Backend for swiftproxy161 on cp36 is CRITICAL: connect to address localhost and port 8206: Connection refused [12:42:32] PROBLEM - cp36 Nginx Backend for mw164 on cp36 is CRITICAL: connect to address localhost and port 8124: Connection refused [12:42:35] PROBLEM - cp36 Nginx Backend for mw173 on cp36 is CRITICAL: connect to address localhost and port 8125: Connection refused [12:42:37] PROBLEM - cp36 Nginx Backend for mw152 on cp36 is CRITICAL: connect to address localhost and port 8114: Connection refused [12:42:38] PROBLEM - beidipedia.com - LetsEncrypt on sslhost is CRITICAL: connect to address beidipedia.com and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [12:42:48] PROBLEM - kagaga.jp - LetsEncrypt on sslhost is CRITICAL: connect to address kagaga.jp and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [12:42:57] PROBLEM - cp36 Nginx Backend for mw162 on cp36 is CRITICAL: connect to address localhost and port 8116: Connection refused [12:42:57] PROBLEM - cp36 Nginx Backend for mw182 on cp36 is CRITICAL: connect to address localhost and port 8120: Connection refused [12:42:58] PROBLEM - cp36 Nginx Backend for mw151 on cp36 is CRITICAL: connect to address localhost and port 8113: Connection refused [12:42:58] PROBLEM - cp36 Nginx Backend for mw172 on cp36 is CRITICAL: connect to address localhost and port 8118: Connection refused [12:43:07] PROBLEM - vylet.wiki - LetsEncrypt on sslhost is CRITICAL: connect to address vylet.wiki and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [12:43:07] PROBLEM - terraforming.wiki - LetsEncrypt on sslhost is CRITICAL: connect to address terraforming.wiki and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [12:43:09] PROBLEM - fairytail.wiki - LetsEncrypt on sslhost is CRITICAL: connect to address fairytail.wiki and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [12:43:19] PROBLEM - clubpenguinfanon.wiki - LetsEncrypt on sslhost is CRITICAL: connect to address clubpenguinfanon.wiki and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [12:43:19] PROBLEM - mariopedia.org - LetsEncrypt on sslhost is CRITICAL: connect to address mariopedia.org and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [12:43:19] PROBLEM - bristolstudenthousingcoop.org - LetsEncrypt on sslhost is CRITICAL: connect to address bristolstudenthousingcoop.org and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [12:43:25] PROBLEM - otherkin.wiki - LetsEncrypt on sslhost is CRITICAL: connect to address otherkin.wiki and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [12:43:32] PROBLEM - voecwiki.com - LetsEncrypt on sslhost is CRITICAL: connect to address voecwiki.com and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [12:43:42] PROBLEM - hardcore.wiki - LetsEncrypt on sslhost is CRITICAL: connect to address hardcore.wiki and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [12:43:42] PROBLEM - fnafmw.wiki - LetsEncrypt on sslhost is CRITICAL: connect to address fnafmw.wiki and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [12:43:54] PROBLEM - gimkit.wiki - LetsEncrypt on sslhost is CRITICAL: connect to address gimkit.wiki and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [12:44:12] PROBLEM - wikimoma.art - LetsEncrypt on sslhost is CRITICAL: connect to address wikimoma.art and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [12:44:13] PROBLEM - podpedia.org - LetsEncrypt on sslhost is CRITICAL: connect to address podpedia.org and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [12:44:13] PROBLEM - hellowhirled.org - LetsEncrypt on sslhost is CRITICAL: connect to address hellowhirled.org and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [12:44:17] RECOVERY - db171 Current Load on db171 is OK: LOAD OK - total load average: 3.02, 8.14, 8.24 [12:44:21] PROBLEM - sdiy.info - LetsEncrypt on sslhost is CRITICAL: connect to address sdiy.info and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [12:44:48] PROBLEM - worldtriggerwiki.com - LetsEncrypt on sslhost is CRITICAL: connect to address worldtriggerwiki.com and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [12:44:48] PROBLEM - beyondtheveilrp.com - LetsEncrypt on sslhost is CRITICAL: connect to address beyondtheveilrp.com and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [12:44:50] PROBLEM - rainverse.wiki - LetsEncrypt on sslhost is CRITICAL: connect to address rainverse.wiki and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [12:45:10] PROBLEM - corru.wiki - LetsEncrypt on sslhost is CRITICAL: connect to address corru.wiki and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [12:45:15] PROBLEM - lotrmc.ru - LetsEncrypt on sslhost is CRITICAL: connect to address lotrmc.ru and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [12:45:53] PROBLEM - yokaiwatchwiki.com - LetsEncrypt on sslhost is CRITICAL: connect to address yokaiwatchwiki.com and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [12:46:12] PROBLEM - ff8.wiki - LetsEncrypt on sslhost is CRITICAL: connect to address ff8.wiki and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [12:46:12] PROBLEM - theenglishlakes.uk - LetsEncrypt on sslhost is CRITICAL: connect to address theenglishlakes.uk and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [12:46:19] oh 😃 [12:46:29] PROBLEM - mappingwiki.org - LetsEncrypt on sslhost is CRITICAL: connect to address mappingwiki.org and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [12:46:38] PROBLEM - royal-wiki.org - LetsEncrypt on sslhost is CRITICAL: connect to address royal-wiki.org and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [12:46:41] PROBLEM - wikappedia.cc - LetsEncrypt on sslhost is CRITICAL: connect to address wikappedia.cc and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [12:47:10] PROBLEM - hoseki.wiki - LetsEncrypt on sslhost is CRITICAL: connect to address hoseki.wiki and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [12:47:10] PROBLEM - landofliberos.com - LetsEncrypt on sslhost is CRITICAL: connect to address landofliberos.com and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [12:47:47] PROBLEM - mockgovernments.com - LetsEncrypt on sslhost is CRITICAL: connect to address mockgovernments.com and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [12:47:49] PROBLEM - thelonsdalebattalion.co.uk - LetsEncrypt on sslhost is CRITICAL: connect to address thelonsdalebattalion.co.uk and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [12:47:52] PROBLEM - poupedia.com - LetsEncrypt on sslhost is CRITICAL: connect to address poupedia.com and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [12:47:55] PROBLEM - vilexia.com - LetsEncrypt on sslhost is CRITICAL: connect to address vilexia.com and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [12:48:37] PROBLEM - lotr.su - LetsEncrypt on sslhost is CRITICAL: connect to address lotr.su and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [12:48:57] PROBLEM - pizzatower.wiki - LetsEncrypt on sslhost is CRITICAL: connect to address pizzatower.wiki and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [12:48:57] PROBLEM - smashbroswiki.com - LetsEncrypt on sslhost is CRITICAL: connect to address smashbroswiki.com and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [12:49:04] PROBLEM - iol.wiki - LetsEncrypt on sslhost is CRITICAL: connect to address iol.wiki and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [12:49:04] PROBLEM - psycho.engineering - LetsEncrypt on sslhost is CRITICAL: connect to address psycho.engineering and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [12:49:08] PROBLEM - n64brew.dev - LetsEncrypt on sslhost is CRITICAL: connect to address n64brew.dev and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [12:49:26] RECOVERY - cp36 Nginx Backend for test151 on cp36 is OK: TCP OK - 0.001 second response time on localhost port 8181 [12:49:26] RECOVERY - cp36 Nginx Backend for matomo151 on cp36 is OK: TCP OK - 0.000 second response time on localhost port 8203 [12:49:26] RECOVERY - cp36 Nginx Backend for mw171 on cp36 is OK: TCP OK - 0.000 second response time on localhost port 8117 [12:49:31] RECOVERY - cp36 Nginx Backend for mw183 on cp36 is OK: TCP OK - 0.000 second response time on localhost port 8127 [12:49:39] RECOVERY - cp36 Nginx Backend for swiftproxy171 on cp36 is OK: TCP OK - 0.000 second response time on localhost port 8207 [12:49:50] RECOVERY - cp36 Nginx Backend for mwtask161 on cp36 is OK: TCP OK - 0.000 second response time on localhost port 8163 [12:49:50] RECOVERY - cp36 Nginx Backend for mwtask151 on cp36 is OK: TCP OK - 0.000 second response time on localhost port 8162 [12:49:51] RECOVERY - cp36 Nginx Backend for mwtask181 on cp36 is OK: TCP OK - 0.000 second response time on localhost port 8160 [12:49:54] RECOVERY - cp36 Nginx Backend for phorge171 on cp36 is OK: TCP OK - 0.000 second response time on localhost port 8202 [12:49:56] RECOVERY - cp36 Nginx Backend for puppet181 on cp36 is OK: TCP OK - 0.000 second response time on localhost port 8204 [12:49:58] RECOVERY - cp36 Nginx Backend for mw163 on cp36 is OK: TCP OK - 0.000 second response time on localhost port 8123 [12:50:01] RECOVERY - cp36 Nginx Backend for mw161 on cp36 is OK: TCP OK - 0.000 second response time on localhost port 8115 [12:50:10] RECOVERY - cp36 Nginx Backend for mw184 on cp36 is OK: TCP OK - 0.000 second response time on localhost port 8128 [12:50:13] RECOVERY - cp36 Nginx Backend for mw181 on cp36 is OK: TCP OK - 0.000 second response time on localhost port 8119 [12:50:25] RECOVERY - cp36 Nginx Backend for mw154 on cp36 is OK: TCP OK - 0.000 second response time on localhost port 8122 [12:50:30] RECOVERY - cp36 Nginx Backend for mw174 on cp36 is OK: TCP OK - 0.000 second response time on localhost port 8126 [12:50:31] RECOVERY - cp36 Nginx Backend for swiftproxy161 on cp36 is OK: TCP OK - 0.000 second response time on localhost port 8206 [12:50:32] RECOVERY - cp36 Nginx Backend for mw164 on cp36 is OK: TCP OK - 0.000 second response time on localhost port 8124 [12:50:35] RECOVERY - cp36 HTTPS on cp36 is OK: HTTP OK: HTTP/2 404 - Status line output matched "HTTP/2 404" - 4113 bytes in 0.064 second response time [12:50:35] RECOVERY - cp36 Nginx Backend for mw173 on cp36 is OK: TCP OK - 0.000 second response time on localhost port 8125 [12:50:37] RECOVERY - cp36 Nginx Backend for mw152 on cp36 is OK: TCP OK - 0.000 second response time on localhost port 8114 [12:50:57] RECOVERY - cp36 HTTP 4xx/5xx ERROR Rate on cp36 is OK: OK - NGINX Error Rate is 4% [12:50:57] RECOVERY - cp36 Nginx Backend for mw162 on cp36 is OK: TCP OK - 0.000 second response time on localhost port 8116 [12:50:57] RECOVERY - cp36 Nginx Backend for mw182 on cp36 is OK: TCP OK - 0.000 second response time on localhost port 8120 [12:50:58] RECOVERY - cp36 Nginx Backend for mw151 on cp36 is OK: TCP OK - 0.000 second response time on localhost port 8113 [12:50:58] RECOVERY - cp36 Nginx Backend for mw172 on cp36 is OK: TCP OK - 0.000 second response time on localhost port 8118 [12:51:04] RECOVERY - cp36 Nginx Backend for mon181 on cp36 is OK: TCP OK - 0.000 second response time on localhost port 8201 [12:51:08] RECOVERY - cp36 Nginx Backend for reports171 on cp36 is OK: TCP OK - 0.000 second response time on localhost port 8205 [12:51:11] RECOVERY - ns1 GDNSD Datacenters on ns1 is OK: OK - all datacenters are online [12:51:13] RECOVERY - cp36 Nginx Backend for mwtask171 on cp36 is OK: TCP OK - 0.000 second response time on localhost port 8161 [12:51:13] RECOVERY - cp36 Varnish Backends on cp36 is OK: All 29 backends are healthy [12:51:16] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [12:51:18] RECOVERY - cp36 Nginx Backend for mw153 on cp36 is OK: TCP OK - 0.000 second response time on localhost port 8121 [13:09:05] PROBLEM - dccomicswiki.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'dccomicswiki.com' expires in 11 day(s) (Fri 28 Feb 2025 11:41:34 PM GMT +0000). [13:09:25] [02ssl] 07WikiTideSSLBot pushed 1 new commit to 03master 13https://github.com/miraheze/ssl/commit/64a68a268c8f58094c19b58750eddfe208e7671f [13:09:25] 02ssl/03master 07WikiTideSSLBot 0364a68a2 Bot: Update SSL cert for dccomicswiki.com [13:09:34] RECOVERY - phighting.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'phighting.wiki' will expire on Sun 30 Mar 2025 06:24:57 PM GMT +0000. [13:09:38] RECOVERY - puzzles.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'puzzles.wiki' will expire on Tue 08 Apr 2025 10:21:57 PM GMT +0000. [13:10:24] RECOVERY - encyclopediarobotica.org - LetsEncrypt on sslhost is OK: OK - Certificate 'encyclopediarobotica.org' will expire on Fri 25 Apr 2025 02:16:23 PM GMT +0000. [13:10:24] RECOVERY - kingdomdeath.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'kingdomdeath.wiki' will expire on Fri 14 Mar 2025 08:40:52 AM GMT +0000. [13:10:37] RECOVERY - rarewarewiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'rarewarewiki.com' will expire on Sun 09 Mar 2025 03:52:46 PM GMT +0000. [13:10:39] RECOVERY - trollpasta.com - LetsEncrypt on sslhost is OK: OK - Certificate 'trollpasta.com' will expire on Tue 18 Mar 2025 03:42:24 PM GMT +0000. [13:10:43] RECOVERY - binrayarchives.com - LetsEncrypt on sslhost is OK: OK - Certificate 'binrayarchives.com' will expire on Fri 25 Apr 2025 09:14:14 PM GMT +0000. [13:11:35] RECOVERY - kagaga.jp - LetsEncrypt on sslhost is OK: OK - Certificate 'kagaga.jp' will expire on Thu 20 Mar 2025 04:51:28 PM GMT +0000. [13:12:13] RECOVERY - vylet.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'vylet.wiki' will expire on Tue 22 Apr 2025 02:04:34 AM GMT +0000. [13:12:13] RECOVERY - terraforming.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'terraforming.wiki' will expire on Wed 07 May 2025 06:27:23 PM GMT +0000. [13:12:19] RECOVERY - fairytail.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'fairytail.wiki' will expire on Thu 20 Mar 2025 09:03:07 PM GMT +0000. [13:12:28] RECOVERY - beidipedia.com - LetsEncrypt on sslhost is OK: OK - Certificate 'beidipedia.com' will expire on Mon 07 Apr 2025 02:07:29 PM GMT +0000. [13:12:37] RECOVERY - clubpenguinfanon.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'clubpenguinfanon.wiki' will expire on Tue 25 Mar 2025 11:01:22 PM GMT +0000. [13:12:37] RECOVERY - mariopedia.org - LetsEncrypt on sslhost is OK: OK - Certificate 'mariopedia.org' will expire on Sat 08 Mar 2025 10:39:11 PM GMT +0000. [13:12:37] RECOVERY - bristolstudenthousingcoop.org - LetsEncrypt on sslhost is OK: OK - Certificate 'bristolstudenthousingcoop.org' will expire on Fri 07 Mar 2025 10:39:11 AM GMT +0000. [13:12:55] RECOVERY - podpedia.org - LetsEncrypt on sslhost is OK: OK - Certificate 'podpedia.org' will expire on Fri 07 Mar 2025 09:06:45 AM GMT +0000. [13:12:55] RECOVERY - hellowhirled.org - LetsEncrypt on sslhost is OK: OK - Certificate 'hellowhirled.org' will expire on Sun 30 Mar 2025 04:36:12 PM GMT +0000. [13:12:55] RECOVERY - wikimoma.art - LetsEncrypt on sslhost is OK: OK - Certificate 'wikimoma.art' will expire on Fri 14 Mar 2025 02:42:04 PM GMT +0000. [13:13:03] RECOVERY - voecwiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'voecwiki.com' will expire on Tue 25 Mar 2025 12:53:32 AM GMT +0000. [13:13:12] RECOVERY - sdiy.info - LetsEncrypt on sslhost is OK: OK - Certificate 'sdiy.info' will expire on Fri 16 May 2025 02:15:56 PM GMT +0000. [13:13:14] RECOVERY - otherkin.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'otherkin.wiki' will expire on Mon 07 Apr 2025 01:52:12 PM GMT +0000. [13:13:23] RECOVERY - fnafmw.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'fnafmw.wiki' will expire on Thu 15 May 2025 11:15:17 PM GMT +0000. [13:13:23] RECOVERY - hardcore.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'hardcore.wiki' will expire on Fri 09 May 2025 07:38:37 PM GMT +0000. [13:13:47] RECOVERY - gimkit.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'gimkit.wiki' will expire on Wed 05 Mar 2025 02:35:49 PM GMT +0000. [13:14:06] RECOVERY - beyondtheveilrp.com - LetsEncrypt on sslhost is OK: OK - Certificate 'beyondtheveilrp.com' will expire on Wed 07 May 2025 06:56:31 PM GMT +0000. [13:14:06] RECOVERY - worldtriggerwiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'worldtriggerwiki.com' will expire on Sun 16 Mar 2025 12:03:12 AM GMT +0000. [13:14:11] RECOVERY - rainverse.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'rainverse.wiki' will expire on Mon 21 Apr 2025 12:52:28 AM GMT +0000. [13:14:46] RECOVERY - yokaiwatchwiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'yokaiwatchwiki.com' will expire on Fri 14 Mar 2025 02:31:09 PM GMT +0000. [13:14:50] RECOVERY - corru.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'corru.wiki' will expire on Mon 07 Apr 2025 02:27:02 AM GMT +0000. [13:15:00] RECOVERY - lotrmc.ru - LetsEncrypt on sslhost is OK: OK - Certificate 'lotrmc.ru' will expire on Fri 18 Apr 2025 04:19:35 PM GMT +0000. [13:15:24] RECOVERY - ff8.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'ff8.wiki' will expire on Thu 01 May 2025 12:35:59 AM GMT +0000. [13:15:24] RECOVERY - theenglishlakes.uk - LetsEncrypt on sslhost is OK: OK - Certificate 'theenglishlakes.uk' will expire on Thu 17 Apr 2025 05:44:53 PM GMT +0000. [13:15:49] RECOVERY - hoseki.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'hoseki.wiki' will expire on Sat 08 Mar 2025 01:09:01 PM GMT +0000. [13:15:49] RECOVERY - landofliberos.com - LetsEncrypt on sslhost is OK: OK - Certificate 'landofliberos.com' will expire on Sun 09 Mar 2025 08:42:53 AM GMT +0000. [13:15:58] RECOVERY - mappingwiki.org - LetsEncrypt on sslhost is OK: OK - Certificate 'mappingwiki.org' will expire on Mon 12 May 2025 09:09:10 PM GMT +0000. [13:16:15] RECOVERY - royal-wiki.org - LetsEncrypt on sslhost is OK: OK - Certificate 'royal-wiki.org' will expire on Sun 09 Mar 2025 12:08:28 AM GMT +0000. [13:16:23] RECOVERY - wikappedia.cc - LetsEncrypt on sslhost is OK: OK - Certificate 'wikappedia.cc' will expire on Sun 23 Mar 2025 01:58:38 PM GMT +0000. [13:17:04] RECOVERY - mockgovernments.com - LetsEncrypt on sslhost is OK: OK - Certificate 'mockgovernments.com' will expire on Tue 01 Apr 2025 05:55:36 PM GMT +0000. [13:17:08] RECOVERY - thelonsdalebattalion.co.uk - LetsEncrypt on sslhost is OK: OK - Certificate 'thelonsdalebattalion.co.uk' will expire on Thu 06 Mar 2025 09:28:33 PM GMT +0000. [13:17:14] RECOVERY - lotr.su - LetsEncrypt on sslhost is OK: OK - Certificate 'lotr.su' will expire on Wed 12 Mar 2025 04:28:42 PM GMT +0000. [13:17:14] RECOVERY - poupedia.com - LetsEncrypt on sslhost is OK: OK - Certificate 'poupedia.com' will expire on Mon 28 Apr 2025 01:12:42 PM GMT +0000. [13:17:19] RECOVERY - vilexia.com - LetsEncrypt on sslhost is OK: OK - Certificate 'vilexia.com' will expire on Thu 01 May 2025 05:08:25 PM GMT +0000. [13:17:53] RECOVERY - pizzatower.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'pizzatower.wiki' will expire on Sat 15 Mar 2025 06:20:47 PM GMT +0000. [13:17:53] RECOVERY - smashbroswiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'smashbroswiki.com' will expire on Sat 08 Mar 2025 01:33:58 PM GMT +0000. [13:18:08] RECOVERY - iol.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'iol.wiki' will expire on Sun 09 Mar 2025 12:04:46 AM GMT +0000. [13:18:08] RECOVERY - psycho.engineering - LetsEncrypt on sslhost is OK: OK - Certificate 'psycho.engineering' will expire on Tue 11 Mar 2025 12:21:00 PM GMT +0000. [13:18:15] RECOVERY - n64brew.dev - LetsEncrypt on sslhost is OK: OK - Certificate 'n64brew.dev' will expire on Fri 07 Mar 2025 06:15:58 PM GMT +0000. [13:47:37] PROBLEM - ping6 on mattermost1 is CRITICAL: PING CRITICAL - Packet loss = 37%, RTA = 31.38 ms [13:57:52] RECOVERY - ping6 on mattermost1 is OK: PING OK - Packet loss = 0%, RTA = 31.51 ms [14:00:51] PROBLEM - cp37 Disk Space on cp37 is CRITICAL: DISK CRITICAL - free space: / 27194MiB (5% inode=99%); [14:03:33] PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 23.48, 20.71, 12.78 [14:09:05] RECOVERY - dccomicswiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'dccomicswiki.com' will expire on Sun 18 May 2025 12:10:49 PM GMT +0000. [14:17:34] PROBLEM - mwtask181 Current Load on mwtask181 is CRITICAL: LOAD CRITICAL - total load average: 24.42, 23.50, 19.13 [14:20:22] PROBLEM - agesofconflict.wiki - LetsEncrypt on sslhost is CRITICAL: Name or service not knownHTTP CRITICAL - Unable to open TCP socket [14:23:34] PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 17.15, 21.93, 20.11 [14:25:34] RECOVERY - mwtask181 Current Load on mwtask181 is OK: LOAD OK - total load average: 3.26, 14.96, 17.77 [15:32:02] PROBLEM - ping6 on mattermost1 is CRITICAL: PING CRITICAL - Packet loss = 100% [15:34:01] RECOVERY - ping6 on mattermost1 is OK: PING OK - Packet loss = 0%, RTA = 31.40 ms [15:38:20] PROBLEM - ping6 on mattermost1 is CRITICAL: PING CRITICAL - Packet loss = 70%, RTA = 31.38 ms [15:42:23] RECOVERY - ping6 on mattermost1 is OK: PING OK - Packet loss = 0%, RTA = 31.37 ms [15:46:43] PROBLEM - ping6 on mattermost1 is CRITICAL: PING CRITICAL - Packet loss = 60%, RTA = 31.36 ms [15:50:46] RECOVERY - ping6 on mattermost1 is OK: PING OK - Packet loss = 0%, RTA = 31.48 ms [15:55:05] PROBLEM - ping6 on mattermost1 is CRITICAL: PING CRITICAL - Packet loss = 50%, RTA = 31.36 ms [16:03:17] RECOVERY - ping6 on mattermost1 is OK: PING OK - Packet loss = 0%, RTA = 31.36 ms [17:30:17] [02CreateWiki] 07Universal-Omega pushed 1 new commit to 03schema 13https://github.com/miraheze/CreateWiki/commit/ef2e18d1489628754190ce5daccabc75fa8a1c98 [17:30:18] 02CreateWiki/03schema 07CosmicAlpha 03ef2e18d Update [17:32:15] [02CreateWiki] 07Universal-Omega pushed 1 new commit to 03schema 13https://github.com/miraheze/CreateWiki/commit/f88f14aba60534dabb26397c6dad8f8771054c7a [17:32:15] 02CreateWiki/03schema 07CosmicAlpha 03f88f14a Update [17:42:14] miraheze/CreateWiki - Universal-Omega the build has errored. [17:42:35] oh no [17:44:43] [02CreateWiki] 07Universal-Omega pushed 1 new commit to 03schema 13https://github.com/miraheze/CreateWiki/commit/b7a0035d395696740eb55e4d9ff489b7c2aab501 [17:44:43] 02CreateWiki/03schema 07CosmicAlpha 03b7a0035 Update [17:47:15] [02CreateWiki] 07Universal-Omega pushed 1 new commit to 03schema 13https://github.com/miraheze/CreateWiki/commit/b696f327c4aae9a4a02eff8f3caf68ed122c3a2a [17:47:15] 02CreateWiki/03schema 07CosmicAlpha 03b696f32 Update [17:54:10] [02CreateWiki] 07Universal-Omega pushed 1 new commit to 03schema 13https://github.com/miraheze/CreateWiki/commit/005e21f9cdeb05854b6c3a8deec11f4213e885de [17:54:10] 02CreateWiki/03schema 07CosmicAlpha 03005e21f Update [17:58:00] miraheze/CreateWiki - Universal-Omega the build has errored. [18:10:39] [02CreateWiki] 07Universal-Omega pushed 1 new commit to 03schema 13https://github.com/miraheze/CreateWiki/commit/bcdd1e51aa71ef97239e841e680ebb4c5810f9e4 [18:10:39] 02CreateWiki/03schema 07CosmicAlpha 03bcdd1e5 Update [18:11:38] [02CreateWiki] 07Universal-Omega pushed 1 new commit to 03schema 13https://github.com/miraheze/CreateWiki/commit/38c12d7fec28ae8db121bd06c9f1e4aed0ad6bc0 [18:11:38] 02CreateWiki/03schema 07CosmicAlpha 0338c12d7 Add [18:12:55] [02CreateWiki] 07Universal-Omega un-readied pull request #661: Some schema changes (03master...03schema) 13https://github.com/miraheze/CreateWiki/pull/661 [18:19:34] PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 23.52, 16.36, 8.34 [18:21:34] RECOVERY - mwtask181 Current Load on mwtask181 is OK: LOAD OK - total load average: 18.19, 17.26, 9.69 [18:23:21] miraheze/CreateWiki - Universal-Omega the build passed. [18:25:34] PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 23.28, 20.64, 12.83 [18:29:34] PROBLEM - mwtask181 Current Load on mwtask181 is CRITICAL: LOAD CRITICAL - total load average: 25.16, 22.64, 15.37 [18:40:03] [02CreateWiki] 07Universal-Omega created 03WikiRequestManager (+1 new commit) 13https://github.com/miraheze/CreateWiki/commit/60af012198a3 [18:40:03] 02CreateWiki/03WikiRequestManager 07CosmicAlpha 0360af012 Use WikiRequestManager in RestWikiRequest [18:40:07] [02CreateWiki] 07Universal-Omega opened pull request #664: Use WikiRequestManager in RestWikiRequest (03master...03WikiRequestManager) 13https://github.com/miraheze/CreateWiki/pull/664 [18:40:14] [02CreateWiki] 07coderabbitai[bot] commented on pull request #664: --- […] 13https://github.com/miraheze/CreateWiki/pull/664#issuecomment-2663869755 [18:41:10] [02CreateWiki] 07Universal-Omega pushed 1 new commit to 03WikiRequestManager 13https://github.com/miraheze/CreateWiki/commit/464f8f471d5dddb6155711911f5247baf953a3c0 [18:41:10] 02CreateWiki/03WikiRequestManager 07CosmicAlpha 03464f8f4 Add [18:41:42] [02CreateWiki] 07Universal-Omega pushed 1 new commit to 03WikiRequestManager 13https://github.com/miraheze/CreateWiki/commit/133b9521003ae6cd15ccf7ff7b2f7aa97a9bd498 [18:41:43] 02CreateWiki/03WikiRequestManager 07CosmicAlpha 03133b952 Fix order [18:43:34] PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 19.98, 22.38, 20.33 [18:45:34] RECOVERY - mwtask181 Current Load on mwtask181 is OK: LOAD OK - total load average: 8.51, 18.47, 19.24 [18:46:12] [02CreateWiki] 07Universal-Omega created 03remove-getrequesterusername (+1 new commit) 13https://github.com/miraheze/CreateWiki/commit/e5e06b5a4d99 [18:46:12] 02CreateWiki/03remove-getrequesterusername 07CosmicAlpha 03e5e06b5 Remove getRequesterUsername… [18:46:16] [02CreateWiki] 07Universal-Omega opened pull request #665: Remove getRequesterUsername (03master...03remove-getrequesterusername) 13https://github.com/miraheze/CreateWiki/pull/665 [18:46:23] [02CreateWiki] 07coderabbitai[bot] commented on pull request #665: --- […] 13https://github.com/miraheze/CreateWiki/pull/665#issuecomment-2663878492 [18:47:30] [02CreateWiki] 07Universal-Omega pushed 1 new commit to 03remove-getrequesterusername 13https://github.com/miraheze/CreateWiki/commit/b6d7e441876f9c43f1a995ce7b12594b73efab04 [18:47:30] 02CreateWiki/03remove-getrequesterusername 07CosmicAlpha 03b6d7e44 Update [18:53:56] miraheze/CreateWiki - Universal-Omega the build passed. [18:56:28] [02CreateWiki] 07Universal-Omega created 03ai-visibility (+1 new commit) 13https://github.com/miraheze/CreateWiki/commit/72346a35b903 [18:56:28] 02CreateWiki/03ai-visibility 07CosmicAlpha 0372346a3 Remove CreateWiki AI from all isVisibilityAllowed… [18:56:32] [02CreateWiki] 07Universal-Omega opened pull request #666: Remove CreateWiki AI from all isVisibilityAllowed (03master...03ai-visibility) 13https://github.com/miraheze/CreateWiki/pull/666 [18:56:39] [02CreateWiki] 07coderabbitai[bot] commented on pull request #666: --- […] 13https://github.com/miraheze/CreateWiki/pull/666#issuecomment-2663892785 [18:59:12] miraheze/CreateWiki - Universal-Omega the build passed. [18:59:22] [02CreateWiki] 07Universal-Omega merged pull request #665: Remove getRequesterUsername (03master...03remove-getrequesterusername) 13https://github.com/miraheze/CreateWiki/pull/665 [18:59:22] [02CreateWiki] 07Universal-Omega pushed 1 new commit to 03master 13https://github.com/miraheze/CreateWiki/commit/231802a8219ec3463a50606b8563ab6b08c834e3 [18:59:24] 02CreateWiki/03master 07CosmicAlpha 03231802a Remove getRequesterUsername (#665)… [18:59:26] [02CreateWiki] 07Universal-Omega 04deleted 03remove-getrequesterusername at 03b6d7e44 13https://github.com/miraheze/CreateWiki/commit/b6d7e44 [18:59:35] [02CreateWiki] 07Universal-Omega merged pull request #664: Use WikiRequestManager in RestWikiRequest (03master...03WikiRequestManager) 13https://github.com/miraheze/CreateWiki/pull/664 [18:59:36] [02CreateWiki] 07Universal-Omega pushed 1 new commit to 03master 13https://github.com/miraheze/CreateWiki/commit/b44d02914b3fb33fa6bd61482e08f3af5945f90b [18:59:36] 02CreateWiki/03master 07CosmicAlpha 03b44d029 Use WikiRequestManager in RestWikiRequest (#664) [18:59:37] [02CreateWiki] 07Universal-Omega 04deleted 03WikiRequestManager at 03133b952 13https://github.com/miraheze/CreateWiki/commit/133b952 [19:01:31] [02CreateWiki] 07Universal-Omega pushed 1 new commit to 03schema 13https://github.com/miraheze/CreateWiki/commit/132112e651491c0bbe0664eb2d9c0ee134db50c6 [19:01:31] 02CreateWiki/03schema 07CosmicAlpha 03132112e Merge branch 'master' into schema [19:09:05] miraheze/CreateWiki - Universal-Omega the build passed. [19:12:00] miraheze/CreateWiki - Universal-Omega the build passed. [19:12:34] [02CreateWiki] 07Universal-Omega pushed 1 new commit to 03master 13https://github.com/miraheze/CreateWiki/commit/84626957f1d2d8995782ff654deff83eb27ca10f [19:12:34] 02CreateWiki/03master 07CosmicAlpha 038462695 Remove CreateWiki AI from all isVisibilityAllowed (#666)… [19:12:36] [02CreateWiki] 07Universal-Omega merged pull request #666: Remove CreateWiki AI from all isVisibilityAllowed (03master...03ai-visibility) 13https://github.com/miraheze/CreateWiki/pull/666 [19:12:38] [02CreateWiki] 07Universal-Omega 04deleted 03ai-visibility at 0372346a3 13https://github.com/miraheze/CreateWiki/commit/72346a3 [19:14:04] miraheze/CreateWiki - Universal-Omega the build passed. [19:17:40] [02CreateWiki] 07Universal-Omega created 03rest (+1 new commit) 13https://github.com/miraheze/CreateWiki/commit/dd8ce774b3b2 [19:17:40] 02CreateWiki/03rest 07CosmicAlpha 03dd8ce77 Move and rename rest handlers [19:17:44] [02CreateWiki] 07Universal-Omega opened pull request #667: Move and rename rest handlers (03master...03rest) 13https://github.com/miraheze/CreateWiki/pull/667 [19:17:52] [02CreateWiki] 07coderabbitai[bot] commented on pull request #667: --- […] 13https://github.com/miraheze/CreateWiki/pull/667#issuecomment-2663921571 [19:22:09] [02CreateWiki] 07Universal-Omega pushed 1 new commit to 03rest 13https://github.com/miraheze/CreateWiki/commit/ba53dddb1f16b3028b5742f043281c78a0cbadb3 [19:22:09] 02CreateWiki/03rest 07CosmicAlpha 03ba53ddd Move [19:23:22] [02CreateWiki] 07Universal-Omega pushed 1 new commit to 03rest 13https://github.com/miraheze/CreateWiki/commit/14920cf08e46cdb0316bd104918e5c759d85421a [19:23:22] 02CreateWiki/03rest 07CosmicAlpha 0314920cf Move [19:24:29] [02CreateWiki] 07Universal-Omega pushed 1 new commit to 03rest 13https://github.com/miraheze/CreateWiki/commit/e3567e27280b0d704d101aafca948d9c3836e786 [19:24:29] 02CreateWiki/03rest 07CosmicAlpha 03e3567e2 Rename [19:25:11] miraheze/CreateWiki - Universal-Omega the build passed. [19:28:05] [02CreateWiki] 07Universal-Omega pushed 1 new commit to 03rest 13https://github.com/miraheze/CreateWiki/commit/11b2db78aa503a181f03dc2de5b4b6a989017fed [19:28:05] 02CreateWiki/03rest 07CosmicAlpha 0311b2db7 Update [19:29:31] [02CreateWiki] 07Universal-Omega pushed 1 new commit to 03rest 13https://github.com/miraheze/CreateWiki/commit/b4522093caed2b4f8d383209dcaa0aa8a608be17 [19:29:31] 02CreateWiki/03rest 07CosmicAlpha 03b452209 Move [19:30:29] [02CreateWiki] 07Universal-Omega pushed 1 new commit to 03rest 13https://github.com/miraheze/CreateWiki/commit/afa4540888189628b3dab581b9f00ea612736f62 [19:30:29] 02CreateWiki/03rest 07CosmicAlpha 03afa4540 Update [19:32:52] @cosmicalpha what tcha cooking [19:39:08] Cleaning up the rest api code [19:39:16] Gasp [19:40:36] It doesn't make him rest [19:42:29] miraheze/CreateWiki - Universal-Omega the build passed. [19:49:08] [02CreateWiki] 07Universal-Omega pushed 1 new commit to 03master 13https://github.com/miraheze/CreateWiki/commit/85bf1b0272b5e38f680b5fc6f7a49bde774b5c09 [19:49:08] 02CreateWiki/03master 07CosmicAlpha 0385bf1b0 Use UltimateAuthority for CreateWiki AI [19:49:51] It’s CA [19:51:35] Whoops hope that works didn't mean to commit directly to master lol [19:51:58] hey lol [19:52:12] Just some code cleanup yeah lol [19:52:59] Evening [19:59:47] PROBLEM - ping6 on mattermost1 is CRITICAL: PING CRITICAL - Packet loss = 100% [20:00:35] @cosmicalpha can we make this less sensitive [20:00:43] Or check another way [20:00:56] miraheze/CreateWiki - Universal-Omega the build passed. [20:01:05] It's OVH rate limiting ICMP pings [20:01:14] Not an actual alert [20:01:45] RECOVERY - ping6 on mattermost1 is OK: PING OK - Packet loss = 0%, RTA = 31.34 ms [20:06:05] PROBLEM - ping6 on mattermost1 is CRITICAL: PING CRITICAL - Packet loss = 90%, RTA = 31.29 ms [20:10:08] RECOVERY - ping6 on mattermost1 is OK: PING OK - Packet loss = 0%, RTA = 31.32 ms [20:11:22] We can yeah [20:11:49] ohhh that's good to know actually I've been wondering why it kept doing it but didn't have any problems... [20:14:28] PROBLEM - ping6 on mattermost1 is CRITICAL: PING CRITICAL - Packet loss = 70%, RTA = 31.35 ms [20:14:35] PROBLEM - mattermost1 APT on mattermost1 is CRITICAL: APT CRITICAL: 1 packages available for upgrade (1 critical updates). [20:14:42] PROBLEM - mw174 APT on mw174 is CRITICAL: APT CRITICAL: 1 packages available for upgrade (1 critical updates). [20:14:49] PROBLEM - ns2 APT on ns2 is CRITICAL: APT CRITICAL: 59 packages available for upgrade (1 critical updates). [20:16:39] PROBLEM - swiftobject171 APT on swiftobject171 is CRITICAL: APT CRITICAL: 62 packages available for upgrade (1 critical updates). [20:16:49] PROBLEM - cloud17 APT on cloud17 is CRITICAL: APT CRITICAL: 68 packages available for upgrade (4 critical updates). [20:17:00] PROBLEM - mw171 APT on mw171 is CRITICAL: APT CRITICAL: 1 packages available for upgrade (1 critical updates). [20:17:07] thank you icinga we get it [20:18:09] PROBLEM - mw153 APT on mw153 is CRITICAL: APT CRITICAL: 1 packages available for upgrade (1 critical updates). [20:18:17] PROBLEM - prometheus151 APT on prometheus151 is CRITICAL: APT CRITICAL: 1 packages available for upgrade (1 critical updates). [20:18:29] PROBLEM - mw183 APT on mw183 is CRITICAL: APT CRITICAL: 1 packages available for upgrade (1 critical updates). [20:18:31] RECOVERY - ping6 on mattermost1 is OK: PING OK - Packet loss = 0%, RTA = 31.42 ms [20:18:31] PROBLEM - mon181 APT on mon181 is CRITICAL: APT CRITICAL: 12 packages available for upgrade (1 critical updates). [20:18:32] PROBLEM - mw172 APT on mw172 is CRITICAL: APT CRITICAL: 1 packages available for upgrade (1 critical updates). [20:19:18] PROBLEM - db151 APT on db151 is CRITICAL: APT CRITICAL: 51 packages available for upgrade (1 critical updates). [20:19:24] PROBLEM - mwtask161 APT on mwtask161 is CRITICAL: APT CRITICAL: 1 packages available for upgrade (1 critical updates). [20:19:54] PROBLEM - swiftobject151 APT on swiftobject151 is CRITICAL: APT CRITICAL: 62 packages available for upgrade (1 critical updates). [20:21:26] PROBLEM - mwtask151 APT on mwtask151 is CRITICAL: APT CRITICAL: 1 packages available for upgrade (1 critical updates). [20:22:03] PROBLEM - changeprop151 APT on changeprop151 is CRITICAL: APT CRITICAL: 1 packages available for upgrade (1 critical updates). [20:22:08] PROBLEM - cp36 APT on cp36 is CRITICAL: APT CRITICAL: 1 packages available for upgrade (1 critical updates). [20:22:50] PROBLEM - ping6 on mattermost1 is CRITICAL: PING CRITICAL - Packet loss = 50%, RTA = 31.36 ms [20:24:22] shut up [20:24:51] PROBLEM - ns1 APT on ns1 is CRITICAL: APT CRITICAL: 58 packages available for upgrade (1 critical updates). [20:25:34] [1/3] I know this is like complimenting my own work here which I don't know but I absolutely love looking at the CW codebase being cleaned up and pretty much 100% modernized up to PHP 8.1/8.2 standards and all modern MediaWiki standards. It makes working with it so much easier and I know longer dread having to work with it to make changes etc... lol. Went from being like our (probably [20:25:34] [2/3] second) worst extension codebase to the best/more modern codebase we have in any extension lol... [20:25:34] [3/3] CW is also very straightforward to install for 3rd parties now, the installer can do it all... [20:26:01] PROBLEM - test151 APT on test151 is CRITICAL: APT CRITICAL: 67 packages available for upgrade (1 critical updates). [20:26:11] * PixDeVl claps for CosmicAlpha: [20:26:27] PROBLEM - bots171 APT on bots171 is CRITICAL: APT CRITICAL: 2 packages available for upgrade (1 critical updates). [20:26:28]