[00:01:25] RECOVERY - cp26 HTTP 4xx/5xx ERROR Rate on cp26 is OK: OK - NGINX Error Rate is 0% [00:03:29] RECOVERY - wiki.mahdiruiz.line.pm - reverse DNS on sslhost is OK: SSL OK - wiki.mahdiruiz.line.pm reverse DNS resolves to cp36.wikitide.net - CNAME OK [00:03:59] RECOVERY - cp36 Disk Space on cp36 is OK: DISK OK - free space: / 21347MiB (24% inode=98%); [00:05:11] RECOVERY - cp41 Disk Space on cp41 is OK: DISK OK - free space: / 19264MiB (20% inode=98%); [00:05:24] PROBLEM - cp26 HTTP 4xx/5xx ERROR Rate on cp26 is CRITICAL: CRITICAL - NGINX Error Rate is 67% [00:05:43] RECOVERY - cp37 Disk Space on cp37 is OK: DISK OK - free space: / 21328MiB (24% inode=98%); [00:12:53] PROBLEM - www.istpcomputing.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'www.istpcomputing.com' expires in 15 day(s) (Sun 28 Apr 2024 11:57:33 PM GMT +0000). [00:13:05] [02miraheze/ssl] 07WikiTideSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/7120969d89b9...a50926eaacbb [00:13:08] [02miraheze/ssl] 07WikiTideSSLBot 03a50926e - Bot: Update SSL cert for www.istpcomputing.com [01:12:43] RECOVERY - www.istpcomputing.com - LetsEncrypt on sslhost is OK: OK - Certificate 'www.istpcomputing.com' will expire on Thu 11 Jul 2024 11:12:59 PM GMT +0000. [01:53:12] PROBLEM - www.durawiki.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'www.durawiki.com' expires in 15 day(s) (Mon 29 Apr 2024 01:39:02 AM GMT +0000). [02:17:49] PROBLEM - dodgecircle.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for dodgecircle.com could not be found [02:33:18] PROBLEM - dodgecircle.com - LetsEncrypt on sslhost is CRITICAL: Name or service not knownHTTP CRITICAL - Unable to open TCP socket [03:09:58] PROBLEM - ping6 on cp26 is CRITICAL: PING CRITICAL - Packet loss = 100% [03:10:06] PROBLEM - cp26 HTTPS on cp26 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Connection timed out after 10003 milliseconds [03:12:00] RECOVERY - ping6 on cp26 is OK: PING OK - Packet loss = 0%, RTA = 138.55 ms [03:12:04] RECOVERY - cp26 HTTPS on cp26 is OK: HTTP OK: HTTP/2 404 - Status line output matched "HTTP/2 404" - 3781 bytes in 0.926 second response time [03:22:41] [02dns] 07MacFan4000 opened pull request 03#508: add 2 zones - 13https://github.com/miraheze/dns/pull/508 [03:38:22] PROBLEM - ping6 on cp26 is WARNING: PING WARNING - Packet loss = 0%, RTA = 235.89 ms [03:39:39] PROBLEM - ping6 on ns2 is WARNING: PING WARNING - Packet loss = 0%, RTA = 220.76 ms [03:39:45] PROBLEM - ping6 on cp27 is WARNING: PING WARNING - Packet loss = 0%, RTA = 219.79 ms [03:40:31] PROBLEM - phorge171 phorge-static.wikitide.net HTTPS on phorge171 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: HTTP/1.1 502 Bad Gateway [03:40:35] PROBLEM - phorge171 php-fpm on phorge171 is CRITICAL: PROCS CRITICAL: 0 processes with command name 'php-fpm8.2' [03:41:05] PROBLEM - phorge171 issue-tracker.miraheze.org HTTPS on phorge171 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 328 bytes in 0.021 second response time [03:41:37] RECOVERY - ping6 on ns2 is OK: PING OK - Packet loss = 0%, RTA = 171.38 ms [03:45:49] PROBLEM - ping6 on cp27 is CRITICAL: PING CRITICAL - Packet loss = 0%, RTA = 389.93 ms [03:46:09] uhh seems like php-fpm crashed on phorgr171? [03:46:28] PROBLEM - ping6 on cp26 is CRITICAL: PING CRITICAL - Packet loss = 0%, RTA = 308.11 ms [03:46:46] (@Site reliability engineers) [03:48:40] PROBLEM - ping6 on ns2 is WARNING: PING WARNING - Packet loss = 0%, RTA = 242.04 ms [03:49:51] PROBLEM - ping6 on cp27 is WARNING: PING WARNING - Packet loss = 0%, RTA = 277.84 ms [03:51:52] PROBLEM - ping6 on cp27 is CRITICAL: PING CRITICAL - Packet loss = 0%, RTA = 327.51 ms [03:53:53] PROBLEM - ping6 on cp27 is WARNING: PING WARNING - Packet loss = 0%, RTA = 287.41 ms [03:57:20] PROBLEM - ping6 on cp51 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 265.62 ms [03:58:39] PROBLEM - ping6 on cp26 is WARNING: PING WARNING - Packet loss = 0%, RTA = 253.94 ms [03:59:20] RECOVERY - ping6 on cp51 is OK: PING OK - Packet loss = 0%, RTA = 271.90 ms [04:01:58] PROBLEM - ping6 on cp27 is CRITICAL: PING CRITICAL - Packet loss = 0%, RTA = 431.94 ms [04:02:43] PROBLEM - ping6 on cp26 is CRITICAL: PING CRITICAL - Packet loss = 0%, RTA = 425.08 ms [04:03:13] [02miraheze/mw-config] 07AgentIsai pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/cfb36c7ac088...63c150fde68d [04:03:16] [02miraheze/mw-config] 07AgentIsai 0363c150f - Set wgSecurePollSingleTransferableVoteEnabled to true [04:03:59] PROBLEM - ping6 on cp27 is WARNING: PING WARNING - Packet loss = 0%, RTA = 255.39 ms [04:04:02] miraheze/mw-config - AgentIsai the build passed. [04:04:03] !log [agent@mwtask181] starting deploy of {'pull': 'config', 'config': True} to all [04:04:12] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [04:04:15] !log [agent@mwtask181] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 11s [04:04:24] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [04:06:46] PROBLEM - ping6 on cp26 is WARNING: PING WARNING - Packet loss = 0%, RTA = 271.78 ms [04:07:10] !log [@mwtask171] starting deploy of {'config': True} to all [04:07:18] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [04:07:19] !log [@mwtask171] finished deploy of {'config': True} to all - SUCCESS in 8s [04:07:27] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [04:08:01] PROBLEM - ping6 on cp27 is CRITICAL: PING CRITICAL - Packet loss = 0%, RTA = 354.89 ms [04:08:31] RECOVERY - phorge171 phorge-static.wikitide.net HTTPS on phorge171 is OK: HTTP OK: Status line output matched "HTTP/1.1 200" - 17717 bytes in 0.038 second response time [04:08:35] RECOVERY - phorge171 php-fpm on phorge171 is OK: PROCS OK: 9 processes with command name 'php-fpm8.2' [04:08:48] PROBLEM - ping6 on cp26 is CRITICAL: PING CRITICAL - Packet loss = 0%, RTA = 364.82 ms [04:09:05] RECOVERY - phorge171 issue-tracker.miraheze.org HTTPS on phorge171 is OK: HTTP OK: HTTP/1.1 200 OK - 19090 bytes in 0.061 second response time [04:10:03] PROBLEM - ping6 on cp27 is WARNING: PING WARNING - Packet loss = 0%, RTA = 299.82 ms [04:12:03] RECOVERY - ping6 on cp27 is OK: PING OK - Packet loss = 0%, RTA = 145.01 ms [04:12:25] RECOVERY - ping6 on ns2 is OK: PING OK - Packet loss = 0%, RTA = 149.95 ms [04:12:51] RECOVERY - ping6 on cp26 is OK: PING OK - Packet loss = 0%, RTA = 138.28 ms [04:16:42] PROBLEM - ping6 on cp51 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 170.45 ms [04:18:42] RECOVERY - ping6 on cp51 is OK: PING OK - Packet loss = 0%, RTA = 265.07 ms [04:18:58] PROBLEM - ping6 on cp26 is WARNING: PING WARNING - Packet loss = 0%, RTA = 247.72 ms [04:20:08] PROBLEM - ping6 on cp27 is CRITICAL: PING CRITICAL - Packet loss = 0%, RTA = 374.85 ms [04:20:25] PROBLEM - ping6 on ns2 is WARNING: PING WARNING - Packet loss = 0%, RTA = 243.88 ms [04:21:00] PROBLEM - ping6 on cp26 is CRITICAL: PING CRITICAL - Packet loss = 0%, RTA = 375.45 ms [04:22:09] PROBLEM - ping6 on cp27 is WARNING: PING WARNING - Packet loss = 0%, RTA = 256.23 ms [04:23:37] !log [@test151] starting deploy of {'config': True} to test151 [04:23:38] !log [@test151] finished deploy of {'config': True} to test151 - SUCCESS in 0s [04:23:46] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [04:23:54] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [04:24:24] PROBLEM - ping6 on ns2 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 247.68 ms [04:25:03] PROBLEM - ping6 on cp26 is WARNING: PING WARNING - Packet loss = 0%, RTA = 249.80 ms [04:29:06] RECOVERY - ping6 on cp26 is OK: PING OK - Packet loss = 0%, RTA = 140.18 ms [04:30:16] RECOVERY - ping6 on cp27 is OK: PING OK - Packet loss = 0%, RTA = 147.60 ms [04:30:20] RECOVERY - ping6 on ns2 is OK: PING OK - Packet loss = 0%, RTA = 196.42 ms [04:33:38] PROBLEM - ping6 on cp41 is WARNING: PING WARNING - Packet loss = 0%, RTA = 349.22 ms [04:34:23] PROBLEM - ping6 on ns2 is WARNING: PING WARNING - Packet loss = 0%, RTA = 295.46 ms [04:35:44] PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 28%, RTA = 335.28 ms [04:36:22] PROBLEM - ping6 on ns2 is CRITICAL: PING CRITICAL - Packet loss = 0%, RTA = 426.92 ms [04:37:47] RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 139.31 ms [04:38:21] PROBLEM - ping6 on ns2 is WARNING: PING WARNING - Packet loss = 0%, RTA = 253.11 ms [04:38:23] PROBLEM - ping6 on cp27 is WARNING: PING WARNING - Packet loss = 0%, RTA = 236.57 ms [04:39:19] PROBLEM - ping6 on cp26 is CRITICAL: PING CRITICAL - Packet loss = 28%, RTA = 239.73 ms [04:41:13] PROBLEM - ping6 on cp51 is CRITICAL: PING CRITICAL - Packet loss = 0%, RTA = 406.12 ms [04:41:20] PROBLEM - ping6 on cp26 is WARNING: PING WARNING - Packet loss = 0%, RTA = 238.92 ms [04:42:18] PROBLEM - ping6 on ns2 is CRITICAL: PING CRITICAL - Packet loss = 0%, RTA = 374.01 ms [04:43:14] PROBLEM - ping6 on cp51 is WARNING: PING WARNING - Packet loss = 0%, RTA = 360.70 ms [04:46:05] PROBLEM - cloud17 Puppet on cloud17 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[ulogd2] [04:49:15] PROBLEM - ping6 on cp51 is CRITICAL: PING CRITICAL - Packet loss = 0%, RTA = 416.44 ms [04:51:30] PROBLEM - ping6 on cp26 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 237.77 ms [04:54:33] PROBLEM - ping6 on cp27 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 235.60 ms [04:56:11] PROBLEM - ping6 on ns2 is WARNING: PING WARNING - Packet loss = 0%, RTA = 227.83 ms [04:57:38] PROBLEM - ping6 on cp26 is WARNING: PING WARNING - Packet loss = 0%, RTA = 233.89 ms [04:58:12] PROBLEM - ping6 on ns2 is CRITICAL: PING CRITICAL - Packet loss = 28%, RTA = 246.88 ms [04:58:35] PROBLEM - ping6 on cp27 is WARNING: PING WARNING - Packet loss = 0%, RTA = 236.22 ms [04:59:24] RECOVERY - ping6 on cp51 is OK: PING OK - Packet loss = 0%, RTA = 273.64 ms [05:00:11] PROBLEM - ping6 on ns2 is WARNING: PING WARNING - Packet loss = 0%, RTA = 250.16 ms [05:02:11] PROBLEM - ping6 on ns2 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 250.66 ms [05:04:10] PROBLEM - ping6 on ns2 is WARNING: PING WARNING - Packet loss = 0%, RTA = 250.96 ms [05:06:09] PROBLEM - ping6 on ns2 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 254.97 ms [05:07:49] PROBLEM - ping6 on cp26 is CRITICAL: PING CRITICAL - Packet loss = 37%, RTA = 247.52 ms [05:08:08] PROBLEM - ping6 on ns2 is WARNING: PING WARNING - Packet loss = 0%, RTA = 247.52 ms [05:09:51] PROBLEM - ping6 on cp26 is WARNING: PING WARNING - Packet loss = 0%, RTA = 238.92 ms [05:11:53] PROBLEM - ping6 on cp26 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 247.62 ms [05:12:07] PROBLEM - ping6 on ns2 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 358.40 ms [05:13:33] PROBLEM - ping on changeprop151 is WARNING: PING WARNING - Packet loss = 0%, RTA = 111.10 ms [05:13:55] PROBLEM - ping6 on cp26 is WARNING: PING WARNING - Packet loss = 0%, RTA = 244.48 ms [05:14:05] RECOVERY - cloud17 Puppet on cloud17 is OK: OK: Puppet is currently enabled, last run 5 seconds ago with 0 failures [05:14:06] PROBLEM - ping6 on ns2 is WARNING: PING WARNING - Packet loss = 0%, RTA = 245.41 ms [05:15:35] RECOVERY - ping on changeprop151 is OK: PING OK - Packet loss = 0%, RTA = 1.00 ms [05:15:57] PROBLEM - ping6 on cp26 is CRITICAL: PING CRITICAL - Packet loss = 0%, RTA = 435.30 ms [05:16:05] PROBLEM - ping6 on ns2 is CRITICAL: PING CRITICAL - Packet loss = 0%, RTA = 376.21 ms [05:16:46] PROBLEM - ping6 on cp27 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 387.84 ms [05:17:58] PROBLEM - ping6 on cp26 is WARNING: PING WARNING - Packet loss = 0%, RTA = 238.05 ms [05:18:04] PROBLEM - ping6 on ns2 is WARNING: PING WARNING - Packet loss = 0%, RTA = 247.83 ms [05:18:47] PROBLEM - ping6 on cp27 is WARNING: PING WARNING - Packet loss = 0%, RTA = 248.86 ms [05:20:01] PROBLEM - ping6 on cp26 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 239.06 ms [05:20:50] PROBLEM - ping6 on cp27 is CRITICAL: PING CRITICAL - Packet loss = 28%, RTA = 236.42 ms [05:22:03] PROBLEM - ping6 on cp26 is WARNING: PING WARNING - Packet loss = 0%, RTA = 234.91 ms [05:22:03] PROBLEM - ping6 on ns2 is CRITICAL: PING CRITICAL - Packet loss = 28%, RTA = 247.23 ms [05:22:51] PROBLEM - ping6 on cp27 is WARNING: PING WARNING - Packet loss = 0%, RTA = 236.86 ms [05:28:01] PROBLEM - ping6 on ns2 is WARNING: PING WARNING - Packet loss = 0%, RTA = 245.54 ms [05:28:08] PROBLEM - ping6 on cp26 is CRITICAL: PING CRITICAL - Packet loss = 0%, RTA = 333.12 ms [05:30:01] PROBLEM - ping6 on ns2 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 262.03 ms [05:30:09] PROBLEM - ping6 on cp26 is WARNING: PING WARNING - Packet loss = 0%, RTA = 295.62 ms [05:31:14] PROBLEM - ping6 on cp51 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 263.64 ms [05:32:00] PROBLEM - ping6 on ns2 is WARNING: PING WARNING - Packet loss = 0%, RTA = 246.60 ms [05:32:11] PROBLEM - ping6 on cp26 is CRITICAL: PING CRITICAL - Packet loss = 0%, RTA = 317.78 ms [05:34:13] PROBLEM - ping6 on cp26 is WARNING: PING WARNING - Packet loss = 0%, RTA = 238.73 ms [05:34:58] PROBLEM - ping6 on cp27 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 235.63 ms [05:35:16] RECOVERY - ping6 on cp51 is OK: PING OK - Packet loss = 0%, RTA = 273.34 ms [05:35:59] PROBLEM - ping6 on ns2 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 262.27 ms [05:36:15] PROBLEM - ping6 on cp26 is CRITICAL: PING CRITICAL - Packet loss = 0%, RTA = 315.88 ms [05:37:57] PROBLEM - ping6 on ns2 is WARNING: PING WARNING - Packet loss = 0%, RTA = 241.95 ms [05:39:01] PROBLEM - ping6 on cp27 is WARNING: PING WARNING - Packet loss = 0%, RTA = 286.91 ms [05:40:19] PROBLEM - ping6 on cp26 is WARNING: PING WARNING - Packet loss = 0%, RTA = 237.40 ms [05:41:56] PROBLEM - ping6 on ns2 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 254.18 ms [05:45:05] PROBLEM - ping6 on cp27 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 235.48 ms [05:45:55] PROBLEM - ping6 on ns2 is WARNING: PING WARNING - Packet loss = 0%, RTA = 253.44 ms [05:47:06] PROBLEM - ping6 on cp27 is WARNING: PING WARNING - Packet loss = 0%, RTA = 236.15 ms [05:48:26] PROBLEM - ping6 on cp26 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 248.60 ms [05:49:38] PROBLEM - ping6 on cp51 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 271.67 ms [05:49:53] PROBLEM - ping6 on ns2 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 246.44 ms [05:50:28] PROBLEM - ping6 on cp26 is WARNING: PING WARNING - Packet loss = 0%, RTA = 242.76 ms [05:51:09] PROBLEM - ping6 on cp27 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 237.10 ms [05:51:38] RECOVERY - ping6 on cp51 is OK: PING OK - Packet loss = 0%, RTA = 275.00 ms [05:51:52] PROBLEM - ping6 on ns2 is WARNING: PING WARNING - Packet loss = 0%, RTA = 261.44 ms [05:53:10] PROBLEM - ping6 on cp27 is WARNING: PING WARNING - Packet loss = 0%, RTA = 236.46 ms [05:55:12] PROBLEM - ping6 on cp27 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 237.59 ms [05:57:13] PROBLEM - ping6 on cp27 is WARNING: PING WARNING - Packet loss = 0%, RTA = 237.61 ms [05:59:15] PROBLEM - ping6 on cp27 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 242.51 ms [05:59:48] PROBLEM - ping6 on ns2 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 246.26 ms [06:01:16] PROBLEM - ping6 on cp27 is WARNING: PING WARNING - Packet loss = 0%, RTA = 235.40 ms [06:03:47] PROBLEM - ping6 on ns2 is WARNING: PING WARNING - Packet loss = 0%, RTA = 246.62 ms [06:04:40] PROBLEM - ping6 on cp26 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 237.07 ms [06:07:45] PROBLEM - ping6 on ns2 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 248.09 ms [06:08:45] PROBLEM - ping6 on cp26 is WARNING: PING WARNING - Packet loss = 0%, RTA = 241.15 ms [06:11:44] PROBLEM - ping6 on ns2 is WARNING: PING WARNING - Packet loss = 0%, RTA = 250.69 ms [06:12:11] PROBLEM - ping6 on cp51 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 270.21 ms [06:12:48] PROBLEM - ping6 on cp26 is CRITICAL: PING CRITICAL - Packet loss = 0%, RTA = 359.92 ms [06:14:12] RECOVERY - ping6 on cp51 is OK: PING OK - Packet loss = 0%, RTA = 270.63 ms [06:14:36] PROBLEM - graylog161 NTP time on graylog161 is WARNING: NTP WARNING: Offset -0.1019496322 secs [06:15:24] PROBLEM - ping6 on cp27 is CRITICAL: PING CRITICAL - Packet loss = 0%, RTA = 366.25 ms [06:17:09] PROBLEM - mw162 NTP time on mw162 is WARNING: NTP WARNING: Offset -0.1023067534 secs [06:18:53] PROBLEM - ping6 on cp26 is WARNING: PING WARNING - Packet loss = 0%, RTA = 240.25 ms [06:19:10] RECOVERY - mw162 NTP time on mw162 is OK: NTP OK: Offset -0.05625924468 secs [06:20:45] RECOVERY - graylog161 NTP time on graylog161 is OK: NTP OK: Offset -0.08928620815 secs [06:22:58] PROBLEM - ping6 on cp26 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 240.82 ms [06:23:32] PROBLEM - ping6 on cp27 is WARNING: PING WARNING - Packet loss = 0%, RTA = 240.90 ms [06:23:38] PROBLEM - ping6 on ns2 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 248.08 ms [06:24:52] PROBLEM - wiki.andreijiroh.uk.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.andreijiroh.uk.eu.org All nameservers failed to answer the query. [06:25:36] PROBLEM - ping6 on ns2 is WARNING: PING WARNING - Packet loss = 0%, RTA = 256.30 ms [06:27:02] PROBLEM - ping6 on cp26 is WARNING: PING WARNING - Packet loss = 0%, RTA = 250.40 ms [06:27:35] PROBLEM - ping6 on cp27 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 236.85 ms [06:27:36] PROBLEM - ping6 on ns2 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 252.13 ms [06:28:33] PROBLEM - ping6 on cp51 is CRITICAL: PING CRITICAL - Packet loss = 28%, RTA = 279.30 ms [06:31:35] PROBLEM - ping6 on ns2 is WARNING: PING WARNING - Packet loss = 0%, RTA = 248.64 ms [06:31:38] PROBLEM - ping6 on cp27 is WARNING: PING WARNING - Packet loss = 0%, RTA = 249.46 ms [06:36:41] RECOVERY - ping6 on cp51 is OK: PING OK - Packet loss = 0%, RTA = 273.97 ms [06:39:36] PROBLEM - ping6 on ns2 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 271.12 ms [06:41:35] PROBLEM - ping6 on ns2 is WARNING: PING WARNING - Packet loss = 0%, RTA = 296.66 ms [06:43:45] PROBLEM - ping6 on cp27 is CRITICAL: PING CRITICAL - Packet loss = 0%, RTA = 365.27 ms [06:45:46] PROBLEM - ping6 on cp27 is WARNING: PING WARNING - Packet loss = 0%, RTA = 251.61 ms [06:47:19] PROBLEM - ping6 on cp26 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 239.12 ms [06:49:10] PROBLEM - ping6 on cp51 is WARNING: PING WARNING - Packet loss = 0%, RTA = 336.98 ms [06:49:21] PROBLEM - ping6 on cp26 is WARNING: PING WARNING - Packet loss = 0%, RTA = 237.96 ms [06:51:11] RECOVERY - ping6 on cp51 is OK: PING OK - Packet loss = 0%, RTA = 271.80 ms [06:51:24] PROBLEM - ping6 on cp26 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 240.20 ms [06:54:44] RECOVERY - wiki.andreijiroh.uk.eu.org - reverse DNS on sslhost is OK: SSL OK - wiki.andreijiroh.uk.eu.org reverse DNS resolves to cp37.wikitide.net - CNAME OK [06:55:28] PROBLEM - ping6 on cp26 is WARNING: PING WARNING - Packet loss = 0%, RTA = 240.57 ms [06:59:31] PROBLEM - ping6 on cp51 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 344.76 ms [06:59:35] PROBLEM - ping6 on ns2 is CRITICAL: PING CRITICAL - Packet loss = 0%, RTA = 346.95 ms [07:01:35] PROBLEM - ping6 on ns2 is WARNING: PING WARNING - Packet loss = 0%, RTA = 256.85 ms [07:03:35] PROBLEM - ping6 on ns2 is CRITICAL: PING CRITICAL - Packet loss = 0%, RTA = 380.38 ms [07:05:39] PROBLEM - ping6 on cp26 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 239.92 ms [07:07:40] PROBLEM - ping6 on cp26 is WARNING: PING WARNING - Packet loss = 0%, RTA = 246.71 ms [07:09:36] PROBLEM - ping6 on ns2 is WARNING: PING WARNING - Packet loss = 0%, RTA = 247.78 ms [07:09:42] RECOVERY - ping6 on cp51 is OK: PING OK - Packet loss = 0%, RTA = 276.16 ms [07:11:09] [02dns] 07Universal-Omega closed pull request 03#508: add 2 zones - 13https://github.com/miraheze/dns/pull/508 [07:11:10] [02miraheze/dns] 07Universal-Omega pushed 031 commit to 03master [+2/-0/±0] 13https://github.com/miraheze/dns/compare/478ecd492d8a...c8189630107b [07:11:11] [02miraheze/dns] 07MacFan4000 03c818963 - add 2 zones (#508) [07:11:36] PROBLEM - ping6 on ns2 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 248.85 ms [07:13:35] PROBLEM - ping6 on ns2 is WARNING: PING WARNING - Packet loss = 0%, RTA = 251.24 ms [07:18:58] PROBLEM - ping6 on cp51 is CRITICAL: PING CRITICAL - Packet loss = 28%, RTA = 264.82 ms [07:20:58] RECOVERY - ping6 on cp51 is OK: PING OK - Packet loss = 0%, RTA = 283.36 ms [07:23:36] PROBLEM - ping6 on ns2 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 245.37 ms [07:25:35] PROBLEM - ping6 on ns2 is WARNING: PING WARNING - Packet loss = 0%, RTA = 244.12 ms [07:33:36] PROBLEM - ping6 on ns2 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 238.61 ms [07:33:43] PROBLEM - wiki.mahdiruiz.line.pm - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query wiki.mahdiruiz.line.pm. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [07:35:35] PROBLEM - ping6 on ns2 is WARNING: PING WARNING - Packet loss = 0%, RTA = 236.32 ms [07:36:04] PROBLEM - ping6 on cp26 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 234.87 ms [07:38:06] PROBLEM - ping6 on cp26 is WARNING: PING WARNING - Packet loss = 0%, RTA = 232.94 ms [07:40:26] [02miraheze/ManageWiki] 07redbluegreenhat pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ManageWiki/compare/884494362f78...bd41729d7283 [07:40:29] [02miraheze/ManageWiki] 07redbluegreenhat 03bd41729 - Revert "Merge branch 'master' into master" [07:43:30] PROBLEM - ping6 on cp51 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 261.01 ms [07:44:57] miraheze/ManageWiki - redbluegreenhat the build passed. [07:47:31] RECOVERY - ping6 on cp51 is OK: PING OK - Packet loss = 0%, RTA = 266.80 ms [07:52:25] PROBLEM - ping6 on cp27 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 230.86 ms [07:54:26] PROBLEM - ping6 on cp27 is WARNING: PING WARNING - Packet loss = 0%, RTA = 230.25 ms [08:02:19] RECOVERY - wiki.mahdiruiz.line.pm - reverse DNS on sslhost is OK: SSL OK - wiki.mahdiruiz.line.pm reverse DNS resolves to cp36.wikitide.net - CNAME OK [08:11:35] PROBLEM - ping6 on ns2 is CRITICAL: PING CRITICAL - Packet loss = 0%, RTA = 316.55 ms [08:13:35] PROBLEM - ping6 on ns2 is WARNING: PING WARNING - Packet loss = 0%, RTA = 242.25 ms [08:19:35] PROBLEM - ping6 on ns2 is CRITICAL: PING CRITICAL - Packet loss = 0%, RTA = 398.18 ms [08:20:40] PROBLEM - ping6 on cp27 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 232.15 ms [08:21:35] PROBLEM - ping6 on ns2 is WARNING: PING WARNING - Packet loss = 0%, RTA = 243.64 ms [08:22:41] PROBLEM - ping6 on cp27 is WARNING: PING WARNING - Packet loss = 0%, RTA = 223.88 ms [08:22:43] PROBLEM - ping6 on cp26 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 233.43 ms [08:24:44] PROBLEM - ping6 on cp26 is WARNING: PING WARNING - Packet loss = 0%, RTA = 234.98 ms [08:27:32] Hey guys, I wanted to ask the status of the acceptance of my requestes wiki :) I would need it soon for education purposes :) [08:31:54] Aeibl: do you mind joining the main channel, #miraheze ? [08:32:06] Sure, thanks :) [08:32:52] PROBLEM - ping6 on cp26 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 235.89 ms [08:34:54] PROBLEM - ping6 on cp26 is WARNING: PING WARNING - Packet loss = 0%, RTA = 237.40 ms [08:40:08] PROBLEM - wiki.gab.pt.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.gab.pt.eu.org All nameservers failed to answer the query. [08:40:14] PROBLEM - ping6 on cp51 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 296.12 ms [08:42:14] RECOVERY - ping6 on cp51 is OK: PING OK - Packet loss = 0%, RTA = 273.21 ms [09:09:44] RECOVERY - wiki.gab.pt.eu.org - reverse DNS on sslhost is OK: SSL OK - wiki.gab.pt.eu.org reverse DNS resolves to cp37.wikitide.net - CNAME OK [09:56:00] [02miraheze/ssl] 07WikiTideSSLBot pushed 031 commit to 03master [+1/-0/±1] 13https://github.com/miraheze/ssl/compare/a50926eaacbb...84a34d358528 [09:56:01] [02miraheze/ssl] 07WikiTideSSLBot 0384a34d3 - Bot: Add SSL cert for worldless.wiki [09:57:31] RECOVERY - ping6 on cp27 is OK: PING OK - Packet loss = 0%, RTA = 147.16 ms [09:58:02] RECOVERY - ping6 on cp26 is OK: PING OK - Packet loss = 0%, RTA = 182.51 ms [10:01:34] PROBLEM - ping6 on cp27 is WARNING: PING WARNING - Packet loss = 0%, RTA = 219.35 ms [10:02:07] PROBLEM - ping6 on cp26 is WARNING: PING WARNING - Packet loss = 0%, RTA = 233.34 ms [10:38:00] PROBLEM - ping6 on ns2 is CRITICAL: PING CRITICAL - Packet loss = 0%, RTA = 377.58 ms [10:40:04] PROBLEM - ping6 on ns2 is WARNING: PING WARNING - Packet loss = 0%, RTA = 243.63 ms [10:42:54] RECOVERY - ping6 on cp26 is OK: PING OK - Packet loss = 0%, RTA = 142.15 ms [10:47:02] PROBLEM - ping6 on cp26 is WARNING: PING WARNING - Packet loss = 0%, RTA = 229.43 ms [10:53:12] PROBLEM - ping6 on cp26 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 230.49 ms [10:55:15] PROBLEM - ping6 on cp26 is WARNING: PING WARNING - Packet loss = 0%, RTA = 240.37 ms [10:59:39] PROBLEM - ping6 on cp51 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 234.87 ms [11:05:35] RECOVERY - ping6 on cp51 is OK: PING OK - Packet loss = 0%, RTA = 269.37 ms [11:28:07] PROBLEM - ping6 on cp27 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 227.01 ms [11:30:07] PROBLEM - ping6 on cp27 is WARNING: PING WARNING - Packet loss = 0%, RTA = 223.40 ms [11:36:12] PROBLEM - ping6 on cp26 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 231.19 ms [11:38:15] PROBLEM - ping6 on cp26 is WARNING: PING WARNING - Packet loss = 0%, RTA = 223.57 ms [11:50:06] RECOVERY - ping6 on ns2 is OK: PING OK - Packet loss = 0%, RTA = 148.48 ms [11:50:09] RECOVERY - ping6 on cp27 is OK: PING OK - Packet loss = 0%, RTA = 143.50 ms [11:50:32] RECOVERY - ping6 on cp26 is OK: PING OK - Packet loss = 0%, RTA = 145.27 ms [11:56:49] PROBLEM - wiki.mahdiruiz.line.pm - LetsEncrypt on sslhost is CRITICAL: Temporary failure in name resolutionHTTP CRITICAL - Unable to open TCP socket [11:57:39] PROBLEM - ping6 on cp51 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 169.32 ms [11:59:37] PROBLEM - ping6 on cp51 is WARNING: PING WARNING - Packet loss = 0%, RTA = 364.14 ms [12:01:35] RECOVERY - ping6 on cp51 is OK: PING OK - Packet loss = 0%, RTA = 250.68 ms [12:02:31] PROBLEM - ping6 on ns2 is WARNING: PING WARNING - Packet loss = 0%, RTA = 232.42 ms [12:03:38] PROBLEM - wiki.mahdiruiz.line.pm - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query line.pm. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [12:08:00] PROBLEM - ping6 on cp26 is WARNING: PING WARNING - Packet loss = 0%, RTA = 228.01 ms [12:10:02] RECOVERY - ping6 on cp26 is OK: PING OK - Packet loss = 0%, RTA = 143.44 ms [12:10:46] RECOVERY - ping6 on ns2 is OK: PING OK - Packet loss = 0%, RTA = 148.79 ms [12:17:18] PROBLEM - bots171 NTP time on bots171 is WARNING: NTP WARNING: Offset -0.117411226 secs [12:25:30] RECOVERY - bots171 NTP time on bots171 is OK: NTP OK: Offset -0.06973958015 secs [12:25:36] RECOVERY - wiki.mahdiruiz.line.pm - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.mahdiruiz.line.pm' will expire on Fri 14 Jun 2024 04:28:50 PM GMT +0000. [12:39:43] PROBLEM - ping6 on cp51 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 175.09 ms [12:41:41] RECOVERY - ping6 on cp51 is OK: PING OK - Packet loss = 0%, RTA = 172.15 ms [12:43:48] PROBLEM - wiki.gab.pt.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.gab.pt.eu.org All nameservers failed to answer the query. [13:02:07] PROBLEM - wiki.mahdiruiz.line.pm - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.mahdiruiz.line.pm All nameservers failed to answer the query. [13:13:24] RECOVERY - wiki.gab.pt.eu.org - reverse DNS on sslhost is OK: SSL OK - wiki.gab.pt.eu.org reverse DNS resolves to cp36.wikitide.net - CNAME OK [13:25:17] PROBLEM - wiki.mahdiruiz.line.pm - LetsEncrypt on sslhost is CRITICAL: Temporary failure in name resolutionHTTP CRITICAL - Unable to open TCP socket [13:54:03] RECOVERY - wiki.mahdiruiz.line.pm - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.mahdiruiz.line.pm' will expire on Fri 14 Jun 2024 04:28:50 PM GMT +0000. [14:25:04] PROBLEM - ping6 on cp51 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 167.33 ms [14:26:29] PROBLEM - ping on changeprop151 is WARNING: PING WARNING - Packet loss = 0%, RTA = 153.17 ms [14:28:29] RECOVERY - ping on changeprop151 is OK: PING OK - Packet loss = 0%, RTA = 0.35 ms [14:29:48] PROBLEM - wiki.mahdiruiz.line.pm - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query line.pm. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [14:31:00] RECOVERY - ping6 on cp51 is OK: PING OK - Packet loss = 0%, RTA = 166.18 ms [14:58:59] RECOVERY - wiki.mahdiruiz.line.pm - reverse DNS on sslhost is OK: SSL OK - wiki.mahdiruiz.line.pm reverse DNS resolves to cp36.wikitide.net - CNAME OK [15:01:11] PROBLEM - cp41 Disk Space on cp41 is WARNING: DISK WARNING - free space: / 10201MiB (10% inode=98%); [15:30:22] PROBLEM - wiki.mahdiruiz.line.pm - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query wiki.mahdiruiz.line.pm. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [16:08:08] PROBLEM - ping6 on cp51 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 168.22 ms [16:10:06] RECOVERY - ping6 on cp51 is OK: PING OK - Packet loss = 0%, RTA = 277.34 ms [16:27:00] PROBLEM - ping6 on cp51 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 173.27 ms [16:28:50] RECOVERY - wiki.mahdiruiz.line.pm - reverse DNS on sslhost is OK: SSL OK - wiki.mahdiruiz.line.pm reverse DNS resolves to cp37.wikitide.net - CNAME OK [16:32:57] RECOVERY - ping6 on cp51 is OK: PING OK - Packet loss = 0%, RTA = 170.44 ms [17:58:52] [02miraheze/ssl] 07WikiTideSSLBot pushed 031 commit to 03master [+1/-0/±1] 13https://github.com/miraheze/ssl/compare/84a34d358528...88c123b6fc39 [17:58:54] [02miraheze/ssl] 07WikiTideSSLBot 0388c123b - Bot: Add SSL cert for www.langrisser.wiki [18:02:33] PROBLEM - cp51 Puppet on cp51 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[nginx] [18:04:33] !log [macfan@test151] starting deploy of {'versions': '1.42', 'upgrade_extensions': 'PortableInfobox'} to test151 [18:04:34] !log [macfan@test151] finished deploy of {'versions': '1.42', 'upgrade_extensions': 'PortableInfobox'} to test151 - SUCCESS in 1s [18:04:41] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:04:49] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:15:08] !log [macfan@test151] starting deploy of {'world': True, 'versions': '1.42'} to test151 [18:15:16] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:15:24] !log [macfan@test151] finished deploy of {'world': True, 'versions': '1.42'} to test151 - SUCCESS in 15s [18:15:32] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:30:00] we are going to have mw 1.42 already?! [18:30:12] RECOVERY - cp51 Puppet on cp51 is OK: OK: Puppet is currently enabled, last run 10 seconds ago with 0 failures [18:30:36] lechuga es lettuce in spansih [18:35:43] yup, feel free to help test https://test.mirabeta.org (email sre@miraheze.org for an account) [18:37:46] what is new in mw 1.42, probably that you can collapse the side bar idk? [18:38:31] ill see [18:38:37] our concern are the extensiosn [18:38:46] making sure they each work [18:38:52] [[phab:T12039]] [18:38:52] https://meta.miraheze.org/wiki/phab:T12039 [18:38:53]

[18:39:03] wrong task [18:39:37] https://issue-tracker.miraheze.org/T12042 [18:40:22] [1/2] I love it [18:40:22] [2/2] https://cdn.discordapp.com/attachments/808001911868489748/1228776813681971341/Captura_de_Pantalla_2024-04-13_a_las_12.39.43_p.m..png?ex=662d4695&is=661ad195&hm=6522e30dbe80d9c219d8da8cad59cfd4e00446ef232e8657242feae88ed8df3e& [19:21:49] @emicraftnoob well, hard to say what’s core and what isn’t, all available extensions are enabled on that wiki [19:22:14] Best bet is to read the release notes [19:23:39] [1/2] nothing [19:23:39] [2/2] https://www.mediawiki.org/wiki/MediaWiki_1.42 [19:24:19] hm [19:24:59] I think that MediaWiki is launching new versions so quickly, and marking obsolete the past one that is perfect and without issues [20:00:38] PROBLEM - wiki.mahdiruiz.line.pm - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query line.pm. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [20:27:44] Release notes arent populated until the release [20:27:57] They are in the git repo under RELEASE-NOTES.md or sometbing [20:28:02] That’s a but silly:( [20:28:07] But mediawiki.org ones aren't updated till post release [20:28:14] are there prerelease noted [20:28:29] Yes in the git repo [20:28:31] For each branch [20:30:36] RECOVERY - wiki.mahdiruiz.line.pm - reverse DNS on sslhost is OK: SSL OK - wiki.mahdiruiz.line.pm reverse DNS resolves to cp36.wikitide.net - CNAME OK [21:40:32] PROBLEM - cp37 Disk Space on cp37 is WARNING: DISK WARNING - free space: / 9705MiB (10% inode=98%); [21:51:08] PROBLEM - cp36 Disk Space on cp36 is WARNING: DISK WARNING - free space: / 9698MiB (10% inode=98%); [22:15:16] [02ImportDump] 07Universal-Omega closed pull request 03#92: Bump eslint-config-wikimedia from 0.26.0 to 0.27.0 - 13https://github.com/miraheze/ImportDump/pull/92 [22:15:17] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±2] 13https://github.com/miraheze/ImportDump/compare/78d4a8842ae2...53553bda3d5d [22:15:20] [02miraheze/ImportDump] 07dependabot[bot] 0353553bd - Bump eslint-config-wikimedia from 0.26.0 to 0.27.0 (#92) [22:15:21] [02miraheze/ImportDump] 07Universal-Omega deleted branch 03dependabot/npm_and_yarn/eslint-config-wikimedia-0.27.0 [22:15:24] [02ImportDump] 07Universal-Omega deleted branch 03dependabot/npm_and_yarn/eslint-config-wikimedia-0.27.0 - 13https://github.com/miraheze/ImportDump [22:23:35] miraheze/ImportDump - Universal-Omega the build passed. [23:21:46] PROBLEM - wiki.andreijiroh.uk.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.andreijiroh.uk.eu.org All nameservers failed to answer the query. [23:50:33] RECOVERY - wiki.andreijiroh.uk.eu.org - reverse DNS on sslhost is OK: SSL OK - wiki.andreijiroh.uk.eu.org reverse DNS resolves to cp37.wikitide.net - CNAME OK