[00:07:10] PROBLEM - os141 Current Load on os141 is WARNING: LOAD WARNING - total load average: 3.82, 3.01, 1.96 [00:11:11] RECOVERY - os141 Current Load on os141 is OK: LOAD OK - total load average: 3.06, 3.09, 2.25 [00:11:55] PROBLEM - graylog131 Current Load on graylog131 is WARNING: LOAD WARNING - total load average: 3.58, 3.38, 2.71 [00:12:26] PROBLEM - os131 Current Load on os131 is CRITICAL: LOAD CRITICAL - total load average: 5.97, 4.22, 2.56 [00:13:54] RECOVERY - graylog131 Current Load on graylog131 is OK: LOAD OK - total load average: 2.95, 3.20, 2.72 [00:16:20] PROBLEM - os131 Current Load on os131 is WARNING: LOAD WARNING - total load average: 2.92, 3.80, 2.78 [00:18:17] RECOVERY - os131 Current Load on os131 is OK: LOAD OK - total load average: 1.94, 3.24, 2.70 [00:24:51] PROBLEM - cp35 HTTPS on cp35 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10001 milliseconds with 0 bytes received [00:26:51] PROBLEM - cp35 HTTPS on cp35 is WARNING: HTTP WARNING: HTTP/2 404 - 3459 bytes in 0.650 second response time [00:28:01] PROBLEM - richterian.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'richterian.com' expires in 15 day(s) (Sat 03 Feb 2024 12:24:21 AM GMT +0000). [00:28:17] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/49a928634724...b58b46307d9e [00:28:20] [02miraheze/ssl] 07MirahezeSSLBot 03b58b463 - Bot: Update SSL cert for richterian.com [00:38:12] PROBLEM - mw141 HTTPS on mw141 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10002 milliseconds with 0 bytes received [00:38:19] PROBLEM - os141 Current Load on os141 is CRITICAL: LOAD CRITICAL - total load average: 5.74, 4.23, 3.28 [00:38:49] PROBLEM - cp34 Varnish Backends on cp34 is CRITICAL: 1 backends are down. mw141 [00:39:25] PROBLEM - mw141 Current Load on mw141 is CRITICAL: LOAD CRITICAL - total load average: 20.17, 15.14, 9.09 [00:40:09] PROBLEM - mw141 HTTPS on mw141 is WARNING: HTTP WARNING: HTTP/2 404 - 285 bytes in 0.594 second response time [00:40:49] RECOVERY - cp34 Varnish Backends on cp34 is OK: All 19 backends are healthy [00:41:05] PROBLEM - www.clinitheque.fr - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'www.clinitheque.fr' expires in 15 day(s) (Sat 03 Feb 2024 12:23:54 AM GMT +0000). [00:41:08] PROBLEM - coffeewiki.net - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'coffeewiki.net' expires in 15 day(s) (Sat 03 Feb 2024 12:25:27 AM GMT +0000). [00:41:20] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/b58b46307d9e...d79238310e2f [00:41:21] [02miraheze/ssl] 07MirahezeSSLBot 03d792383 - Bot: Update SSL cert for www.clinitheque.fr [00:41:34] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/d79238310e2f...51a954c85b19 [00:41:37] [02miraheze/ssl] 07MirahezeSSLBot 0351a954c - Bot: Update SSL cert for coffeewiki.net [00:42:20] PROBLEM - os141 Current Load on os141 is WARNING: LOAD WARNING - total load average: 2.88, 3.92, 3.42 [00:43:25] PROBLEM - mw141 Current Load on mw141 is WARNING: LOAD WARNING - total load average: 6.52, 10.25, 8.47 [00:45:01] PROBLEM - mw132 Current Load on mw132 is WARNING: LOAD WARNING - total load average: 10.67, 8.75, 7.49 [00:45:25] RECOVERY - mw141 Current Load on mw141 is OK: LOAD OK - total load average: 4.79, 8.31, 7.97 [00:45:44] PROBLEM - mw131 Current Load on mw131 is WARNING: LOAD WARNING - total load average: 10.28, 9.00, 7.87 [00:46:10] PROBLEM - os131 Current Load on os131 is CRITICAL: LOAD CRITICAL - total load average: 4.96, 4.43, 3.44 [00:47:25] PROBLEM - mw132 HTTPS on mw132 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10000 milliseconds with 0 bytes received [00:47:44] PROBLEM - mw131 Current Load on mw131 is CRITICAL: LOAD CRITICAL - total load average: 18.36, 11.24, 8.74 [00:49:24] PROBLEM - mw132 HTTPS on mw132 is WARNING: HTTP WARNING: HTTP/2 404 - 285 bytes in 1.005 second response time [00:49:44] RECOVERY - mw131 Current Load on mw131 is OK: LOAD OK - total load average: 7.66, 9.71, 8.50 [00:50:29] PROBLEM - os141 Current Load on os141 is CRITICAL: LOAD CRITICAL - total load average: 4.87, 3.92, 3.57 [00:51:01] RECOVERY - mw132 Current Load on mw132 is OK: LOAD OK - total load average: 7.68, 9.17, 8.25 [00:52:32] PROBLEM - os141 Current Load on os141 is WARNING: LOAD WARNING - total load average: 3.66, 3.79, 3.56 [00:54:09] PROBLEM - os131 Current Load on os131 is WARNING: LOAD WARNING - total load average: 2.50, 3.76, 3.76 [00:56:34] RECOVERY - os141 Current Load on os141 is OK: LOAD OK - total load average: 2.53, 3.07, 3.32 [00:57:14] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 8.96, 7.37, 6.15 [00:57:25] RECOVERY - richterian.com - LetsEncrypt on sslhost is OK: OK - Certificate 'richterian.com' will expire on Tue 16 Apr 2024 11:28:06 PM GMT +0000. [00:59:13] RECOVERY - swiftobject101 Current Load on swiftobject101 is OK: OK - load average: 6.02, 6.76, 6.07 [00:59:45] PROBLEM - os141 PowerDNS Recursor on os141 is CRITICAL: CRITICAL - Plugin timed out while executing system call [01:00:39] PROBLEM - os141 Current Load on os141 is WARNING: LOAD WARNING - total load average: 3.60, 3.66, 3.53 [01:01:45] RECOVERY - os141 PowerDNS Recursor on os141 is OK: DNS OK: 0.621 seconds response time. miraheze.org returns 2001:41d0:801:2000::3a18,2001:41d0:801:2000::5d68,51.195.201.140,51.89.139.24 [01:02:11] RECOVERY - os131 Current Load on os131 is OK: LOAD OK - total load average: 2.37, 2.92, 3.35 [01:02:41] RECOVERY - os141 Current Load on os141 is OK: LOAD OK - total load average: 2.63, 3.14, 3.34 [01:08:44] PROBLEM - os141 Current Load on os141 is WARNING: LOAD WARNING - total load average: 3.74, 3.77, 3.57 [01:09:46] RECOVERY - coffeewiki.net - LetsEncrypt on sslhost is OK: OK - Certificate 'coffeewiki.net' will expire on Tue 16 Apr 2024 11:41:24 PM GMT +0000. [01:10:11] PROBLEM - mw142 HTTPS on mw142 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10001 milliseconds with 0 bytes received [01:10:12] PROBLEM - mw141 HTTPS on mw141 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10003 milliseconds with 0 bytes received [01:10:31] RECOVERY - www.clinitheque.fr - LetsEncrypt on sslhost is OK: OK - Certificate 'www.clinitheque.fr' will expire on Tue 16 Apr 2024 11:41:10 PM GMT +0000. [01:10:36] PROBLEM - cp24 HTTPS on cp24 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10003 milliseconds with 0 bytes received [01:10:44] PROBLEM - os141 Current Load on os141 is CRITICAL: LOAD CRITICAL - total load average: 5.03, 4.35, 3.82 [01:12:06] PROBLEM - mw142 HTTPS on mw142 is WARNING: HTTP WARNING: HTTP/2 404 - 285 bytes in 0.562 second response time [01:12:09] PROBLEM - mw141 HTTPS on mw141 is WARNING: HTTP WARNING: HTTP/2 404 - 285 bytes in 0.588 second response time [01:12:36] PROBLEM - cp24 HTTPS on cp24 is WARNING: HTTP WARNING: HTTP/2 404 - 3458 bytes in 0.618 second response time [01:14:03] PROBLEM - os141 Puppet on os141 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [01:16:57] RECOVERY - os141 Puppet on os141 is OK: OK: Puppet is currently enabled, last run 7 minutes ago with 0 failures [01:20:04] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.78, 6.81, 6.23 [01:22:04] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.89, 8.47, 6.92 [01:22:11] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 7.36, 6.31, 5.20 [01:23:14] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 7.49, 7.38, 6.57 [01:24:04] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 5.70, 7.55, 6.79 [01:24:11] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 6.45, 6.23, 5.30 [01:25:14] RECOVERY - swiftobject101 Current Load on swiftobject101 is OK: OK - load average: 6.07, 6.78, 6.45 [01:26:04] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 4.83, 6.71, 6.58 [01:32:57] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 11.86, 8.86, 7.49 [01:32:59] PROBLEM - os141 Current Load on os141 is WARNING: LOAD WARNING - total load average: 2.80, 3.54, 3.97 [01:34:55] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.49, 7.86, 7.29 [01:36:12] PROBLEM - mw141 HTTPS on mw141 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10004 milliseconds with 0 bytes received [01:36:21] PROBLEM - mw143 HTTPS on mw143 is CRITICAL: HTTP CRITICAL: HTTP/2 502 - 170 bytes in 1.749 second response time [01:36:49] PROBLEM - cp34 HTTPS on cp34 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10001 milliseconds with 0 bytes received [01:36:51] PROBLEM - cp24 HTTPS on cp24 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10002 milliseconds with 0 bytes received [01:36:55] PROBLEM - mw131 HTTPS on mw131 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10000 milliseconds with 0 bytes received [01:36:55] PROBLEM - cp25 HTTPS on cp25 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10003 milliseconds with 0 bytes received [01:37:01] PROBLEM - os141 Current Load on os141 is CRITICAL: LOAD CRITICAL - total load average: 4.98, 3.98, 4.02 [01:38:09] PROBLEM - mw141 HTTPS on mw141 is WARNING: HTTP WARNING: HTTP/2 404 - 285 bytes in 0.520 second response time [01:38:20] PROBLEM - mw143 HTTPS on mw143 is WARNING: HTTP WARNING: HTTP/2 404 - 285 bytes in 0.517 second response time [01:38:27] PROBLEM - mw141 Current Load on mw141 is WARNING: LOAD WARNING - total load average: 11.08, 10.79, 8.48 [01:38:46] PROBLEM - cp34 HTTPS on cp34 is WARNING: HTTP WARNING: HTTP/2 404 - 3458 bytes in 0.640 second response time [01:38:51] PROBLEM - cp24 HTTPS on cp24 is WARNING: HTTP WARNING: HTTP/2 404 - 3480 bytes in 0.597 second response time [01:38:52] PROBLEM - mw131 HTTPS on mw131 is WARNING: HTTP WARNING: HTTP/2 404 - 285 bytes in 0.510 second response time [01:38:55] PROBLEM - cp25 HTTPS on cp25 is WARNING: HTTP WARNING: HTTP/2 404 - 3458 bytes in 0.810 second response time [01:39:01] PROBLEM - os141 Current Load on os141 is WARNING: LOAD WARNING - total load average: 3.72, 3.87, 3.98 [01:40:22] RECOVERY - mw141 Current Load on mw141 is OK: LOAD OK - total load average: 6.51, 9.08, 8.12 [01:44:44] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.27, 6.17, 6.63 [01:45:07] PROBLEM - os141 Current Load on os141 is CRITICAL: LOAD CRITICAL - total load average: 5.06, 4.07, 3.98 [01:47:07] PROBLEM - os141 Current Load on os141 is WARNING: LOAD WARNING - total load average: 2.64, 3.65, 3.85 [01:50:35] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.80, 7.02, 6.77 [01:51:17] PROBLEM - os141 Current Load on os141 is CRITICAL: LOAD CRITICAL - total load average: 4.21, 3.45, 3.68 [01:52:33] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.90, 6.65, 6.68 [01:55:18] PROBLEM - os141 Current Load on os141 is WARNING: LOAD WARNING - total load average: 2.00, 3.13, 3.57 [01:56:26] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.05, 7.10, 6.85 [01:57:13] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 7.16, 7.00, 6.49 [01:57:20] RECOVERY - os141 Current Load on os141 is OK: LOAD OK - total load average: 0.84, 2.47, 3.28 [01:59:12] RECOVERY - swiftobject101 Current Load on swiftobject101 is OK: OK - load average: 4.70, 6.09, 6.21 [02:00:22] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.61, 6.59, 6.72 [02:44:13] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 7.58, 6.80, 6.26 [02:46:13] RECOVERY - swiftobject101 Current Load on swiftobject101 is OK: OK - load average: 5.47, 6.15, 6.08 [02:52:11] PROBLEM - mw142 HTTPS on mw142 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10001 milliseconds with 0 bytes received [02:52:12] PROBLEM - mw141 HTTPS on mw141 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10003 milliseconds with 0 bytes received [02:52:29] PROBLEM - mw143 HTTPS on mw143 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10003 milliseconds with 0 bytes received [02:52:39] PROBLEM - cp34 HTTPS on cp34 is CRITICAL: HTTP CRITICAL: HTTP/2 502 - 3370 bytes in 0.473 second response time [02:54:06] PROBLEM - mw142 HTTPS on mw142 is WARNING: HTTP WARNING: HTTP/2 404 - 285 bytes in 0.601 second response time [02:54:09] PROBLEM - mw141 HTTPS on mw141 is WARNING: HTTP WARNING: HTTP/2 404 - 285 bytes in 0.511 second response time [02:54:17] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.62, 7.83, 6.60 [02:54:25] PROBLEM - mw143 HTTPS on mw143 is WARNING: HTTP WARNING: HTTP/2 404 - 285 bytes in 0.512 second response time [02:54:39] PROBLEM - cp34 HTTPS on cp34 is WARNING: HTTP WARNING: HTTP/2 404 - 3480 bytes in 0.583 second response time [02:56:15] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.59, 7.64, 6.67 [03:01:11] RECOVERY - db131 Backups SQL on db131 is OK: FILE_AGE OK: /var/log/sql-backup.log is 69 seconds old and 0 bytes [03:02:08] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.05, 7.18, 6.73 [03:04:06] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.34, 6.32, 6.46 [03:07:45] PROBLEM - cloud11 IPMI Sensors on cloud11 is CRITICAL: IPMI Status: Critical [Cntlr 2 Bay 8 = Critical] [03:32:57] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 5.74, 6.86, 6.59 [03:34:55] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 4.78, 6.22, 6.39 [03:54:31] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.01, 6.71, 6.35 [03:56:29] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.05, 6.15, 6.19 [04:06:45] PROBLEM - cp25 HTTPS on cp25 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10001 milliseconds with 0 bytes received [04:06:49] PROBLEM - cp34 HTTPS on cp34 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10002 milliseconds with 0 bytes received [04:06:55] PROBLEM - mw131 HTTPS on mw131 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10000 milliseconds with 0 bytes received [04:08:19] PROBLEM - mw134 Current Load on mw134 is WARNING: LOAD WARNING - total load average: 11.28, 9.66, 7.69 [04:08:44] PROBLEM - cp25 HTTPS on cp25 is WARNING: HTTP WARNING: HTTP/2 404 - 3458 bytes in 0.785 second response time [04:08:46] PROBLEM - cp34 HTTPS on cp34 is WARNING: HTTP WARNING: HTTP/2 404 - 3458 bytes in 0.631 second response time [04:08:52] PROBLEM - mw131 HTTPS on mw131 is WARNING: HTTP WARNING: HTTP/2 404 - 285 bytes in 0.508 second response time [04:10:19] RECOVERY - mw134 Current Load on mw134 is OK: LOAD OK - total load average: 5.56, 8.02, 7.33 [04:28:29] PROBLEM - mw143 HTTPS on mw143 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10003 milliseconds with 0 bytes received [04:28:45] PROBLEM - cp25 HTTPS on cp25 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10002 milliseconds with 0 bytes received [04:30:25] PROBLEM - mw143 HTTPS on mw143 is WARNING: HTTP WARNING: HTTP/2 404 - 285 bytes in 0.534 second response time [04:30:44] PROBLEM - cp25 HTTPS on cp25 is WARNING: HTTP WARNING: HTTP/2 404 - 3458 bytes in 0.587 second response time [04:50:49] PROBLEM - cp34 HTTPS on cp34 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10002 milliseconds with 0 bytes received [04:52:46] PROBLEM - cp34 HTTPS on cp34 is WARNING: HTTP WARNING: HTTP/2 404 - 3458 bytes in 0.591 second response time [05:03:09] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 8.30, 6.99, 6.16 [05:06:05] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.57, 7.97, 6.87 [05:07:09] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 5.82, 7.34, 6.59 [05:08:04] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.92, 7.45, 6.81 [05:12:04] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 6.26, 6.80, 6.69 [05:13:08] RECOVERY - swiftobject101 Current Load on swiftobject101 is OK: OK - load average: 4.79, 6.31, 6.43 [06:21:10] PROBLEM - cp24 HTTPS on cp24 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10002 milliseconds with 0 bytes received [06:23:10] PROBLEM - cp24 HTTPS on cp24 is WARNING: HTTP WARNING: HTTP/2 404 - 3480 bytes in 0.586 second response time [06:24:29] PROBLEM - mw143 HTTPS on mw143 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10003 milliseconds with 0 bytes received [06:24:45] PROBLEM - cp25 HTTPS on cp25 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10002 milliseconds with 0 bytes received [06:26:25] PROBLEM - mw143 HTTPS on mw143 is WARNING: HTTP WARNING: HTTP/2 404 - 285 bytes in 0.575 second response time [06:26:44] PROBLEM - cp25 HTTPS on cp25 is WARNING: HTTP WARNING: HTTP/2 404 - 3458 bytes in 0.613 second response time [07:34:57] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.32, 6.44, 5.93 [07:36:55] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.38, 6.13, 5.89 [07:47:45] RECOVERY - cloud11 IPMI Sensors on cloud11 is OK: IPMI Status: OK [07:51:45] PROBLEM - cloud11 IPMI Sensors on cloud11 is CRITICAL: IPMI Status: Critical [Cntlr 2 Bay 8 = Critical] [07:59:52] PROBLEM - mw134 HTTPS on mw134 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10002 milliseconds with 0 bytes received [08:00:11] PROBLEM - mw142 HTTPS on mw142 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10003 milliseconds with 0 bytes received [08:00:12] PROBLEM - mw141 HTTPS on mw141 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10003 milliseconds with 0 bytes received [08:00:29] PROBLEM - mw143 HTTPS on mw143 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10001 milliseconds with 0 bytes received [08:00:35] PROBLEM - cp25 HTTPS on cp25 is CRITICAL: HTTP CRITICAL: HTTP/2 503 - 3363 bytes in 0.467 second response time [08:00:39] PROBLEM - cp34 HTTPS on cp34 is CRITICAL: HTTP CRITICAL: HTTP/2 503 - 3363 bytes in 0.227 second response time [08:01:47] PROBLEM - mw134 HTTPS on mw134 is WARNING: HTTP WARNING: HTTP/2 404 - 285 bytes in 0.870 second response time [08:02:06] PROBLEM - mw142 HTTPS on mw142 is WARNING: HTTP WARNING: HTTP/2 404 - 285 bytes in 0.538 second response time [08:02:09] PROBLEM - mw141 HTTPS on mw141 is WARNING: HTTP WARNING: HTTP/2 404 - 285 bytes in 0.523 second response time [08:02:25] PROBLEM - mw143 HTTPS on mw143 is WARNING: HTTP WARNING: HTTP/2 404 - 285 bytes in 0.553 second response time [08:02:35] PROBLEM - cp25 HTTPS on cp25 is WARNING: HTTP WARNING: HTTP/2 404 - 3458 bytes in 0.659 second response time [08:02:39] PROBLEM - cp34 HTTPS on cp34 is WARNING: HTTP WARNING: HTTP/2 404 - 3458 bytes in 0.612 second response time [08:30:59] PROBLEM - mw133 Current Load on mw133 is CRITICAL: LOAD CRITICAL - total load average: 20.82, 13.24, 8.61 [08:31:45] PROBLEM - mw131 Current Load on mw131 is WARNING: LOAD WARNING - total load average: 11.84, 10.23, 7.40 [08:32:56] PROBLEM - mw133 Current Load on mw133 is WARNING: LOAD WARNING - total load average: 8.35, 11.23, 8.43 [08:33:44] RECOVERY - mw131 Current Load on mw131 is OK: LOAD OK - total load average: 5.88, 8.64, 7.17 [08:34:52] RECOVERY - mw133 Current Load on mw133 is OK: LOAD OK - total load average: 6.48, 9.63, 8.17 [09:04:49] PROBLEM - cp34 HTTPS on cp34 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10002 milliseconds with 0 bytes received [09:06:46] PROBLEM - cp34 HTTPS on cp34 is WARNING: HTTP WARNING: HTTP/2 404 - 3458 bytes in 0.788 second response time [09:42:29] PROBLEM - mw143 HTTPS on mw143 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10002 milliseconds with 0 bytes received [09:44:25] PROBLEM - mw143 HTTPS on mw143 is WARNING: HTTP WARNING: HTTP/2 404 - 285 bytes in 0.532 second response time [10:09:11] PROBLEM - os141 Current Load on os141 is CRITICAL: LOAD CRITICAL - total load average: 4.80, 2.83, 1.49 [10:11:11] RECOVERY - os141 Current Load on os141 is OK: LOAD OK - total load average: 1.54, 2.34, 1.48 [10:20:23] [02miraheze/CreateWiki] 07AgentIsai pushed 031 commit to 03AgentIsai-patch-1 [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/commit/f7461b7269ae [10:20:24] [02miraheze/CreateWiki] 07AgentIsai 03f7461b7 - Organize by alphabetical order + add minimum length [10:20:25] [02CreateWiki] 07AgentIsai created branch 03AgentIsai-patch-1 - 13https://github.com/miraheze/CreateWiki [10:20:34] [02CreateWiki] 07AgentIsai opened pull request 03#460: Backport further changes from WikiForge/CreateWiki - 13https://github.com/miraheze/CreateWiki/pull/460 [10:26:24] [02miraheze/CreateWiki] 07AgentIsai pushed 031 commit to 03AgentIsai-patch-1 [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/f7461b7269ae...2956a1ff11d3 [10:26:27] [02miraheze/CreateWiki] 07AgentIsai 032956a1f - Add few questions [10:26:28] [02CreateWiki] 07AgentIsai synchronize pull request 03#460: Backport further changes from WikiForge/CreateWiki - 13https://github.com/miraheze/CreateWiki/pull/460 [10:29:04] [02miraheze/CreateWiki] 07AgentIsai pushed 031 commit to 03AgentIsai-patch-1 [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/2956a1ff11d3...6513827b960b [10:29:07] [02miraheze/CreateWiki] 07AgentIsai 036513827 - Fix questions [10:29:10] [02CreateWiki] 07AgentIsai synchronize pull request 03#460: Backport further changes from WikiForge/CreateWiki - 13https://github.com/miraheze/CreateWiki/pull/460 [10:29:35] miraheze/CreateWiki - AgentIsai the build has errored. [10:32:22] [02miraheze/CreateWiki] 07AgentIsai pushed 031 commit to 03AgentIsai-patch-1 [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/6513827b960b...da59ae35931d [10:32:24] [02miraheze/CreateWiki] 07AgentIsai 03da59ae3 - Fix CI [10:32:25] [02CreateWiki] 07AgentIsai synchronize pull request 03#460: Backport further changes from WikiForge/CreateWiki - 13https://github.com/miraheze/CreateWiki/pull/460 [10:32:44] miraheze/CreateWiki - AgentIsai the build has errored. [10:33:25] [02miraheze/CreateWiki] 07AgentIsai pushed 031 commit to 03AgentIsai-patch-1 [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/da59ae35931d...957c59ca46e0 [10:33:27] [02miraheze/CreateWiki] 07AgentIsai 03957c59c - Add i18n [10:33:29] [02CreateWiki] 07AgentIsai synchronize pull request 03#460: Backport further changes from WikiForge/CreateWiki - 13https://github.com/miraheze/CreateWiki/pull/460 [10:35:31] [02miraheze/CreateWiki] 07github-actions[bot] pushed 031 commit to 03AgentIsai-patch-1 [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/957c59ca46e0...ef2fcd83f2ff [10:35:33] [02miraheze/CreateWiki] 07github-actions 03ef2fcd8 - CI: lint code to MediaWiki standards [10:35:35] [02CreateWiki] 07github-actions[bot] synchronize pull request 03#460: Backport further changes from WikiForge/CreateWiki - 13https://github.com/miraheze/CreateWiki/pull/460 [10:36:59] miraheze/CreateWiki - AgentIsai the build has errored. [10:40:58] [02miraheze/CreateWiki] 07AgentIsai pushed 031 commit to 03AgentIsai-patch-1 [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/ef2fcd83f2ff...657bb1efb8cf [10:41:01] [02miraheze/CreateWiki] 07AgentIsai 03657bb1e - Add missing i18n [10:41:04] [02CreateWiki] 07AgentIsai synchronize pull request 03#460: Backport further changes from WikiForge/CreateWiki - 13https://github.com/miraheze/CreateWiki/pull/460 [10:41:54] [02miraheze/CreateWiki] 07AgentIsai pushed 031 commit to 03AgentIsai-patch-1 [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/657bb1efb8cf...584918828d36 [10:41:55] [02miraheze/CreateWiki] 07AgentIsai 035849188 - Add missing classes [10:41:58] [02CreateWiki] 07AgentIsai synchronize pull request 03#460: Backport further changes from WikiForge/CreateWiki - 13https://github.com/miraheze/CreateWiki/pull/460 [10:46:43] miraheze/CreateWiki - AgentIsai the build has errored. [11:16:44] [02miraheze/CreateWiki] 07AgentIsai pushed 031 commit to 03AgentIsai-patch-1 [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/584918828d36...5a1384f53f19 [11:16:47] [02miraheze/CreateWiki] 07AgentIsai 035a1384f - Update variable name [11:16:48] [02CreateWiki] 07AgentIsai synchronize pull request 03#460: Backport further changes from WikiForge/CreateWiki - 13https://github.com/miraheze/CreateWiki/pull/460 [11:21:35] miraheze/CreateWiki - AgentIsai the build has errored. [12:14:13] [02miraheze/CreateWiki] 07translatewiki pushed 031 commit to 03master [+0/-0/±3] 13https://github.com/miraheze/CreateWiki/compare/20240b7f4adf...46bc2521c05c [12:14:15] [02miraheze/CreateWiki] 07translatewiki 0346bc252 - Localisation updates from https://translatewiki.net. [12:14:17] [02miraheze/MirahezeMagic] 07translatewiki pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/MirahezeMagic/compare/6287c5350ed7...4f4edf429e5b [12:14:18] [02miraheze/MirahezeMagic] 07translatewiki 034f4edf4 - Localisation updates from https://translatewiki.net. [12:14:19] [02miraheze/landing] 07translatewiki pushed 031 commit to 03master [+0/-0/±2] 13https://github.com/miraheze/landing/compare/3f3821b3234f...c7978b092ef7 [12:14:21] [02miraheze/landing] 07translatewiki 03c7978b0 - Localisation updates from https://translatewiki.net. [12:14:23] [02miraheze/ManageWiki] 07translatewiki pushed 031 commit to 03master [+0/-0/±3] 13https://github.com/miraheze/ManageWiki/compare/a917fcdcd947...1439d573b2cc [12:14:26] [02miraheze/ManageWiki] 07translatewiki 031439d57 - Localisation updates from https://translatewiki.net. [12:15:08] miraheze/landing - translatewiki the build passed. [12:20:09] miraheze/ManageWiki - translatewiki the build passed. [12:23:07] miraheze/MirahezeMagic - translatewiki the build passed. [12:23:42] miraheze/CreateWiki - translatewiki the build passed. [12:23:45] !log [@test151] starting deploy of {'folders': '1.40/extensions/MirahezeMagic'} to test151 [12:23:46] !log [@test151] finished deploy of {'folders': '1.40/extensions/MirahezeMagic'} to test151 - SUCCESS in 1s [12:23:55] !log [@test151] starting deploy of {'folders': '1.41/extensions/MirahezeMagic'} to test151 [12:23:56] !log [@test151] finished deploy of {'folders': '1.41/extensions/MirahezeMagic'} to test151 - SUCCESS in 0s [12:23:57] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:24:03] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:24:04] !log [@test151] starting deploy of {'folders': '1.42/extensions/MirahezeMagic'} to test151 [12:24:05] !log [@test151] finished deploy of {'folders': '1.42/extensions/MirahezeMagic'} to test151 - SUCCESS in 0s [12:24:08] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:24:13] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:24:18] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:24:25] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:26:58] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.89, 7.14, 6.11 [12:28:56] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 4.48, 6.09, 5.85 [12:33:32] !log [@mwtask181] starting deploy of {'folders': '1.40/extensions/MirahezeMagic'} to all [12:33:38] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:34:19] !log [@mwtask181] finished deploy of {'folders': '1.40/extensions/MirahezeMagic'} to all - SUCCESS in 48s [12:34:25] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:34:27] !log [@mwtask181] starting deploy of {'folders': '1.41/extensions/MirahezeMagic'} to all [12:34:33] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:35:12] !log [@mwtask181] finished deploy of {'folders': '1.41/extensions/MirahezeMagic'} to all - SUCCESS in 44s [12:35:24] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:51:25] PROBLEM - mw132 HTTPS on mw132 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10002 milliseconds with 0 bytes received [12:53:24] PROBLEM - mw132 HTTPS on mw132 is WARNING: HTTP WARNING: HTTP/2 404 - 285 bytes in 1.585 second response time [12:56:55] PROBLEM - mw131 HTTPS on mw131 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10000 milliseconds with 0 bytes received [12:57:30] PROBLEM - mw132 HTTPS on mw132 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10001 milliseconds with 0 bytes received [12:57:42] PROBLEM - cp35 HTTPS on cp35 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10004 milliseconds with 0 bytes received [12:58:45] PROBLEM - mw133 Current Load on mw133 is CRITICAL: LOAD CRITICAL - total load average: 17.69, 11.58, 8.02 [12:58:52] PROBLEM - mw131 HTTPS on mw131 is WARNING: HTTP WARNING: HTTP/2 404 - 285 bytes in 0.570 second response time [12:59:01] PROBLEM - mw132 Current Load on mw132 is CRITICAL: LOAD CRITICAL - total load average: 16.05, 11.52, 7.92 [12:59:08] PROBLEM - mw134 Current Load on mw134 is CRITICAL: LOAD CRITICAL - total load average: 13.01, 10.85, 7.56 [12:59:28] PROBLEM - mw132 HTTPS on mw132 is WARNING: HTTP WARNING: HTTP/2 404 - 285 bytes in 0.536 second response time [12:59:41] PROBLEM - cp35 HTTPS on cp35 is WARNING: HTTP WARNING: HTTP/2 404 - 3458 bytes in 0.662 second response time [13:00:45] RECOVERY - mw133 Current Load on mw133 is OK: LOAD OK - total load average: 7.62, 9.99, 7.89 [13:01:01] RECOVERY - mw132 Current Load on mw132 is OK: LOAD OK - total load average: 6.01, 9.64, 7.71 [13:01:02] RECOVERY - mw134 Current Load on mw134 is OK: LOAD OK - total load average: 6.45, 9.20, 7.34 [13:05:08] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.42, 6.52, 5.95 [13:06:01] PROBLEM - mw142 HTTPS on mw142 is CRITICAL: HTTP CRITICAL: HTTP/2 502 - 170 bytes in 0.399 second response time [13:07:06] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 4.90, 5.98, 5.83 [13:08:01] PROBLEM - mw142 HTTPS on mw142 is WARNING: HTTP WARNING: HTTP/2 404 - 285 bytes in 0.518 second response time [13:09:24] PROBLEM - os141 Current Load on os141 is CRITICAL: LOAD CRITICAL - total load average: 4.25, 3.54, 2.80 [13:11:24] RECOVERY - os141 Current Load on os141 is OK: LOAD OK - total load average: 2.09, 3.06, 2.72 [13:17:08] PROBLEM - os131 Current Load on os131 is CRITICAL: LOAD CRITICAL - total load average: 4.31, 3.46, 2.48 [13:19:14] PROBLEM - os131 Current Load on os131 is WARNING: LOAD WARNING - total load average: 4.00, 3.41, 2.57 [13:20:25] PROBLEM - os141 Current Load on os141 is WARNING: LOAD WARNING - total load average: 4.00, 3.68, 3.16 [13:21:11] RECOVERY - os131 Current Load on os131 is OK: LOAD OK - total load average: 2.69, 3.14, 2.57 [13:22:25] RECOVERY - os141 Current Load on os141 is OK: LOAD OK - total load average: 2.45, 3.17, 3.03 [13:26:27] PROBLEM - os141 Current Load on os141 is CRITICAL: LOAD CRITICAL - total load average: 4.65, 4.23, 3.51 [13:27:01] PROBLEM - mw132 Current Load on mw132 is WARNING: LOAD WARNING - total load average: 11.42, 10.49, 8.58 [13:28:29] PROBLEM - os141 Current Load on os141 is WARNING: LOAD WARNING - total load average: 3.03, 3.77, 3.43 [13:29:01] RECOVERY - mw132 Current Load on mw132 is OK: LOAD OK - total load average: 6.91, 9.13, 8.31 [13:30:29] PROBLEM - os141 Current Load on os141 is CRITICAL: LOAD CRITICAL - total load average: 4.64, 3.98, 3.53 [13:31:22] PROBLEM - cp24 HTTPS on cp24 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10002 milliseconds with 0 bytes received [13:32:35] PROBLEM - os141 PowerDNS Recursor on os141 is CRITICAL: CRITICAL - Plugin timed out while executing system call [13:33:00] PROBLEM - mw142 Current Load on mw142 is WARNING: LOAD WARNING - total load average: 10.33, 8.18, 6.84 [13:33:07] PROBLEM - mw143 Current Load on mw143 is CRITICAL: LOAD CRITICAL - total load average: 20.03, 11.94, 8.43 [13:33:22] PROBLEM - cp24 HTTPS on cp24 is WARNING: HTTP WARNING: HTTP/2 404 - 3458 bytes in 0.591 second response time [13:33:28] PROBLEM - mw141 Current Load on mw141 is CRITICAL: LOAD CRITICAL - total load average: 17.50, 12.05, 8.75 [13:34:39] RECOVERY - os141 PowerDNS Recursor on os141 is OK: DNS OK: 4.828 seconds response time. miraheze.org returns 2001:41d0:801:2000::3a18,2001:41d0:801:2000::5d68,51.195.201.140,51.89.139.24 [13:34:55] RECOVERY - mw142 Current Load on mw142 is OK: LOAD OK - total load average: 8.57, 9.07, 7.38 [13:35:07] PROBLEM - mw143 Current Load on mw143 is WARNING: LOAD WARNING - total load average: 10.67, 11.81, 8.87 [13:35:25] PROBLEM - mw141 Current Load on mw141 is WARNING: LOAD WARNING - total load average: 8.60, 11.07, 8.84 [13:37:07] RECOVERY - mw143 Current Load on mw143 is OK: LOAD OK - total load average: 5.88, 9.51, 8.37 [13:37:25] RECOVERY - mw141 Current Load on mw141 is OK: LOAD OK - total load average: 7.32, 9.79, 8.65 [13:40:45] PROBLEM - cp25 HTTPS on cp25 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10002 milliseconds with 0 bytes received [13:42:44] PROBLEM - cp25 HTTPS on cp25 is WARNING: HTTP WARNING: HTTP/2 404 - 3458 bytes in 0.824 second response time [13:48:29] PROBLEM - mw143 HTTPS on mw143 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10002 milliseconds with 0 bytes received [13:50:25] PROBLEM - mw143 HTTPS on mw143 is WARNING: HTTP WARNING: HTTP/2 404 - 285 bytes in 0.632 second response time [14:02:57] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.90, 7.29, 6.50 [14:07:01] PROBLEM - os141 Current Load on os141 is WARNING: LOAD WARNING - total load average: 2.69, 2.91, 4.00 [14:10:48] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 4.82, 6.45, 6.54 [14:11:00] RECOVERY - os141 Current Load on os141 is OK: LOAD OK - total load average: 0.74, 1.91, 3.36 [14:14:41] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.91, 6.98, 6.72 [14:16:39] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.17, 6.85, 6.68 [14:18:37] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.53, 7.06, 6.77 [14:22:32] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.17, 6.19, 6.51 [14:33:17] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.20, 6.93, 6.70 [14:37:12] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.65, 6.70, 6.71 [14:38:08] !log [agent@mwtask181] sudo -u www-data /usr/local/bin/foreachwikiindblist /srv/mediawiki/cache/databases.json /srv/mediawiki/1.40/maintenance/run.php /srv/mediawiki/1.40/extensions/CreateWiki/maintenance/setContainersAccess.php (END - exit=0) [14:38:13] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:44:04] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.36, 7.60, 7.05 [14:44:57] PROBLEM - wiki.overwood.xyz - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.overwood.xyz' expires in 15 day(s) (Sat 03 Feb 2024 02:22:46 PM GMT +0000). [14:45:13] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/51a954c85b19...5186da3b2625 [14:45:15] [02miraheze/ssl] 07MirahezeSSLBot 035186da3 - Bot: Update SSL cert for wiki.overwood.xyz [14:48:04] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.57, 6.97, 6.91 [14:52:03] PROBLEM - wiki.jsal.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.jsal.org' expires in 15 day(s) (Sat 03 Feb 2024 02:39:59 PM GMT +0000). [14:52:04] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.52, 6.32, 6.67 [14:52:20] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/5186da3b2625...2c572e18b99e [14:52:22] [02miraheze/ssl] 07MirahezeSSLBot 032c572e1 - Bot: Update SSL cert for wiki.jsal.org [14:58:04] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 11.66, 7.97, 7.11 [15:00:04] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.27, 7.55, 7.06 [15:02:04] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.33, 7.80, 7.21 [15:03:13] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 7.54, 6.61, 5.91 [15:04:04] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.50, 7.72, 7.26 [15:04:09] PROBLEM - wiki.tmyt105.leyhp.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.tmyt105.leyhp.com' expires in 15 day(s) (Sat 03 Feb 2024 02:35:32 PM GMT +0000). [15:04:25] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/2c572e18b99e...c64f593eca32 [15:04:27] [02miraheze/ssl] 07MirahezeSSLBot 03c64f593 - Bot: Update SSL cert for wiki.tmyt105.leyhp.com [15:05:13] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 10.56, 7.46, 6.27 [15:06:12] PROBLEM - mw141 HTTPS on mw141 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10003 milliseconds with 0 bytes received [15:07:14] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 5.80, 6.64, 6.11 [15:08:06] PROBLEM - mw142 HTTPS on mw142 is CRITICAL: HTTP CRITICAL: HTTP/2 502 - 170 bytes in 5.577 second response time [15:08:30] PROBLEM - mw143 HTTPS on mw143 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10002 milliseconds with 0 bytes received [15:08:49] PROBLEM - cp34 Varnish Backends on cp34 is CRITICAL: 3 backends are down. mw141 mw142 mw143 [15:09:07] PROBLEM - mw143 Current Load on mw143 is CRITICAL: LOAD CRITICAL - total load average: 16.80, 13.66, 8.50 [15:09:29] PROBLEM - mw141 Current Load on mw141 is CRITICAL: LOAD CRITICAL - total load average: 23.53, 14.49, 9.06 [15:10:09] PROBLEM - mw142 HTTPS on mw142 is WARNING: HTTP WARNING: HTTP/2 404 - 285 bytes in 7.468 second response time [15:10:18] PROBLEM - mw141 HTTPS on mw141 is WARNING: HTTP WARNING: HTTP/2 404 - 285 bytes in 3.880 second response time [15:10:19] PROBLEM - mw142 Current Load on mw142 is CRITICAL: LOAD CRITICAL - total load average: 14.04, 11.67, 8.23 [15:11:44] PROBLEM - mw131 Current Load on mw131 is CRITICAL: LOAD CRITICAL - total load average: 15.94, 11.10, 8.26 [15:12:04] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.80, 6.21, 6.73 [15:12:19] PROBLEM - mw142 Current Load on mw142 is WARNING: LOAD WARNING - total load average: 7.29, 10.53, 8.28 [15:12:31] PROBLEM - mw143 HTTPS on mw143 is WARNING: HTTP WARNING: HTTP/2 404 - 285 bytes in 0.537 second response time [15:12:49] RECOVERY - cp34 Varnish Backends on cp34 is OK: All 19 backends are healthy [15:13:07] PROBLEM - mw143 Current Load on mw143 is WARNING: LOAD WARNING - total load average: 7.09, 11.43, 8.87 [15:13:44] RECOVERY - mw131 Current Load on mw131 is OK: LOAD OK - total load average: 8.73, 10.05, 8.22 [15:14:19] RECOVERY - mw142 Current Load on mw142 is OK: LOAD OK - total load average: 4.57, 8.56, 7.84 [15:14:23] RECOVERY - wiki.overwood.xyz - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.overwood.xyz' will expire on Wed 17 Apr 2024 01:45:02 PM GMT +0000. [15:15:07] RECOVERY - mw143 Current Load on mw143 is OK: LOAD OK - total load average: 4.96, 9.29, 8.40 [15:15:25] RECOVERY - mw141 Current Load on mw141 is OK: LOAD OK - total load average: 3.97, 9.80, 9.12 [15:20:55] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.63, 7.07, 6.93 [15:22:53] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.47, 6.37, 6.68 [15:33:17] RECOVERY - wiki.tmyt105.leyhp.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.tmyt105.leyhp.com' will expire on Wed 17 Apr 2024 02:04:14 PM GMT +0000. [15:42:24] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.06, 7.39, 6.98 [15:44:27] PROBLEM - mw132 Current Load on mw132 is WARNING: LOAD WARNING - total load average: 11.53, 9.17, 7.87 [15:44:33] PROBLEM - mw133 Current Load on mw133 is CRITICAL: LOAD CRITICAL - total load average: 12.18, 10.00, 8.29 [15:45:44] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 6.99, 6.99, 6.51 [15:46:23] RECOVERY - mw132 Current Load on mw132 is OK: LOAD OK - total load average: 5.54, 7.57, 7.43 [15:46:30] RECOVERY - mw133 Current Load on mw133 is OK: LOAD OK - total load average: 6.63, 8.83, 8.08 [15:48:54] PROBLEM - rodzinka.wiki - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'rodzinka.wiki' expires in 15 day(s) (Sat 03 Feb 2024 03:38:10 PM GMT +0000). [15:49:13] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/c64f593eca32...8033827621d4 [15:49:14] [02miraheze/ssl] 07MirahezeSSLBot 038033827 - Bot: Update SSL cert for rodzinka.wiki [15:50:09] RECOVERY - wiki.jsal.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.jsal.org' will expire on Wed 17 Apr 2024 01:52:08 PM GMT +0000. [15:51:33] RECOVERY - swiftobject101 Current Load on swiftobject101 is OK: OK - load average: 5.99, 6.64, 6.54 [15:54:53] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 12.51, 8.96, 7.75 [15:55:29] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 9.71, 7.89, 7.02 [15:57:26] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 7.63, 7.70, 7.05 [15:59:22] RECOVERY - swiftobject101 Current Load on swiftobject101 is OK: OK - load average: 4.70, 6.74, 6.79 [16:02:36] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.09, 7.85, 7.72 [16:04:05] PROBLEM - psycho.engineering - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'psycho.engineering' expires in 15 day(s) (Sat 03 Feb 2024 03:34:03 PM GMT +0000). [16:04:31] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.21, 8.61, 8.02 [16:06:05] PROBLEM - mw143 HTTPS on mw143 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10002 milliseconds with 0 bytes received [16:06:13] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 6.40, 7.08, 6.94 [16:06:22] PROBLEM - mw132 Current Load on mw132 is CRITICAL: LOAD CRITICAL - total load average: 14.02, 10.04, 7.95 [16:06:23] PROBLEM - mw133 Current Load on mw133 is CRITICAL: LOAD CRITICAL - total load average: 12.48, 10.21, 8.49 [16:06:27] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.11, 7.91, 7.83 [16:07:24] PROBLEM - mw134 Current Load on mw134 is CRITICAL: LOAD CRITICAL - total load average: 12.76, 10.38, 8.30 [16:07:39] PROBLEM - mw131 Current Load on mw131 is WARNING: LOAD WARNING - total load average: 10.49, 9.20, 7.89 [16:07:55] PROBLEM - mw143 Current Load on mw143 is WARNING: LOAD WARNING - total load average: 11.48, 10.67, 8.37 [16:08:04] PROBLEM - mw143 HTTPS on mw143 is WARNING: HTTP WARNING: HTTP/2 404 - 285 bytes in 0.552 second response time [16:08:21] PROBLEM - mw132 Current Load on mw132 is WARNING: LOAD WARNING - total load average: 11.99, 10.43, 8.34 [16:08:22] RECOVERY - mw133 Current Load on mw133 is OK: LOAD OK - total load average: 9.93, 10.17, 8.69 [16:08:22] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.55, 8.11, 7.88 [16:09:19] PROBLEM - mw134 Current Load on mw134 is WARNING: LOAD WARNING - total load average: 10.32, 10.32, 8.53 [16:09:50] RECOVERY - mw143 Current Load on mw143 is OK: LOAD OK - total load average: 4.81, 8.50, 7.85 [16:10:06] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 8.45, 7.71, 7.18 [16:10:20] RECOVERY - mw132 Current Load on mw132 is OK: LOAD OK - total load average: 7.85, 9.39, 8.21 [16:11:14] RECOVERY - mw134 Current Load on mw134 is OK: LOAD OK - total load average: 9.57, 9.94, 8.59 [16:11:38] RECOVERY - mw131 Current Load on mw131 is OK: LOAD OK - total load average: 9.18, 9.51, 8.33 [16:12:02] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 6.63, 7.33, 7.11 [16:12:27] [02CreateWiki] 07amire80 opened pull request 03#461: Remove an unnecessary apostrophe from a message - 13https://github.com/miraheze/CreateWiki/pull/461 [16:12:55] [02CreateWiki] 07AgentIsai closed pull request 03#461: Remove an unnecessary apostrophe from a message - 13https://github.com/miraheze/CreateWiki/pull/461 [16:12:56] [02miraheze/CreateWiki] 07AgentIsai pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/46bc2521c05c...58546d93c11d [16:12:59] [02miraheze/CreateWiki] 07amire80 0358546d9 - Remove an unnecessary apostrophe from a message (#461) [16:14:09] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 4.89, 7.45, 7.87 [16:15:55] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 11.27, 7.99, 7.32 [16:17:01] [02CreateWiki] 07AgentIsai synchronize pull request 03#460: Backport further changes from WikiForge/CreateWiki - 13https://github.com/miraheze/CreateWiki/pull/460 [16:17:02] [02miraheze/CreateWiki] 07AgentIsai pushed 031 commit to 03AgentIsai-patch-1 [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/5a1384f53f19...e71e3253a560 [16:17:04] [02miraheze/CreateWiki] 07AgentIsai 03e71e325 - Fix expression [16:17:37] PROBLEM - mw131 Current Load on mw131 is WARNING: LOAD WARNING - total load average: 10.65, 9.94, 8.80 [16:18:49] RECOVERY - rodzinka.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'rodzinka.wiki' will expire on Wed 17 Apr 2024 02:49:03 PM GMT +0000. [16:19:36] RECOVERY - mw131 Current Load on mw131 is OK: LOAD OK - total load average: 7.59, 9.21, 8.68 [16:19:56] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.33, 7.59, 7.72 [16:21:22] [02CreateWiki] 07amire80 opened pull request 03#462: Simplify the message createwiki-label-statuschangecomment - 13https://github.com/miraheze/CreateWiki/pull/462 [16:21:52] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.36, 7.88, 7.85 [16:21:52] miraheze/CreateWiki - amire80 the build passed. [16:21:55] RECOVERY - cloud11 IPMI Sensors on cloud11 is OK: IPMI Status: OK [16:22:10] miraheze/CreateWiki - AgentIsai the build passed. [16:23:11] miraheze/CreateWiki - AgentIsai the build has errored. [16:23:47] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.33, 8.57, 8.10 [16:25:39] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 5.21, 7.07, 7.36 [16:25:58] PROBLEM - cloud11 IPMI Sensors on cloud11 is CRITICAL: IPMI Status: Critical [Cntlr 2 Bay 8 = Critical] [16:27:44] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.22, 8.00, 7.98 [16:28:01] PROBLEM - removededm.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'removededm.com' expires in 15 day(s) (Sat 03 Feb 2024 04:01:05 PM GMT +0000). [16:29:44] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.10, 8.55, 8.20 [16:30:32] miraheze/CreateWiki - amire80 the build passed. [16:31:28] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 10.04, 7.88, 7.50 [16:33:25] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 7.99, 7.78, 7.51 [16:35:44] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.33, 7.64, 7.90 [16:39:15] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 10.05, 7.88, 7.53 [16:41:11] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 6.37, 7.32, 7.38 [16:43:08] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 8.52, 7.62, 7.47 [16:43:44] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 10.45, 8.04, 7.89 [16:45:04] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 7.58, 7.83, 7.58 [16:47:00] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 8.02, 7.67, 7.53 [16:48:57] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 6.69, 7.21, 7.38 [16:50:54] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 8.48, 7.26, 7.35 [16:52:51] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 6.89, 7.28, 7.36 [16:53:44] miraheze/CreateWiki - AgentIsai the build has errored. [16:59:44] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.47, 7.67, 7.97 [17:00:07] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+1/-0/±1] 13https://github.com/miraheze/ssl/compare/8033827621d4...8fe61454a8c3 [17:00:08] [02miraheze/ssl] 07MirahezeSSLBot 038fe6145 - Bot: Add SSL cert for tno.wiki [17:01:44] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.25, 7.75, 7.95 [17:03:44] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.72, 7.36, 7.78 [17:03:57] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/8fe61454a8c3...c5f07f892bc1 [17:04:00] [02miraheze/ssl] 07MirahezeSSLBot 03c5f07f8 - Bot: Update SSL cert for removededm.com [17:08:52] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 8.74, 7.52, 7.25 [17:10:51] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 5.50, 6.82, 7.03 [17:12:51] RECOVERY - swiftobject101 Current Load on swiftobject101 is OK: OK - load average: 4.75, 6.15, 6.76 [17:15:44] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.04, 7.30, 7.39 [17:17:44] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.03, 7.09, 7.32 [17:18:22] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 6.35, 6.70, 6.82 [17:20:18] RECOVERY - swiftobject101 Current Load on swiftobject101 is OK: OK - load average: 5.51, 6.24, 6.64 [17:21:34] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.04, 7.92, 7.62 [17:23:29] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.99, 7.61, 7.54 [17:24:24] PROBLEM - cloud14 Puppet on cloud14 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[ulogd2] [17:25:44] RECOVERY - removededm.com - LetsEncrypt on sslhost is OK: OK - Certificate 'removededm.com' will expire on Wed 17 Apr 2024 04:03:46 PM GMT +0000. [17:29:15] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.85, 8.08, 7.77 [17:31:58] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 6.88, 7.00, 6.68 [17:33:05] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.08, 7.32, 7.55 [17:39:44] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 9.12, 7.58, 7.05 [17:40:18] [02CreateWiki] 07Universal-Omega closed pull request 03#462: Simplify the message createwiki-label-statuschangecomment - 13https://github.com/miraheze/CreateWiki/pull/462 [17:40:20] [02miraheze/CreateWiki] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/58546d93c11d...0168c59965e0 [17:40:21] [02miraheze/CreateWiki] 07amire80 030168c59 - Simplify the message createwiki-label-statuschangecomment (#462) [17:40:50] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.53, 8.00, 7.67 [17:41:40] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 5.59, 6.79, 6.83 [17:42:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.30, 7.81, 7.65 [17:45:33] RECOVERY - swiftobject101 Current Load on swiftobject101 is OK: OK - load average: 5.81, 6.43, 6.68 [17:49:59] miraheze/CreateWiki - Universal-Omega the build passed. [17:50:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.33, 7.40, 7.40 [17:51:45] RECOVERY - cloud14 Puppet on cloud14 is OK: OK: Puppet is currently enabled, last run 18 seconds ago with 0 failures [17:52:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.85, 7.18, 7.32 [17:55:17] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 7.13, 7.07, 6.81 [17:58:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.12, 7.41, 7.39 [18:02:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.36, 7.46, 7.43 [18:03:02] RECOVERY - swiftobject101 Current Load on swiftobject101 is OK: OK - load average: 4.54, 6.38, 6.68 [18:05:49] [02RequestSSL] 07redbluegreenhat opened pull request 03#6: Cleanup - 13https://github.com/miraheze/RequestSSL/pull/6 [18:06:57] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 6.55, 6.86, 6.85 [18:08:53] RECOVERY - swiftobject101 Current Load on swiftobject101 is OK: OK - load average: 6.27, 6.61, 6.75 [18:08:55] [02RequestSSL] 07redbluegreenhat edited pull request 03#6: Cleanup - 13https://github.com/miraheze/RequestSSL/pull/6 [18:12:50] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 12.18, 8.00, 7.51 [18:14:13] [02RequestSSL] 07redbluegreenhat synchronize pull request 03#6: Cleanup - 13https://github.com/miraheze/RequestSSL/pull/6 [18:14:50] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.49, 7.52, 7.39 [18:15:44] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 9.41, 8.45, 7.54 [18:16:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.06, 7.74, 7.48 [18:17:40] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 6.64, 7.94, 7.47 [18:18:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.98, 7.79, 7.53 [18:24:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.46, 8.49, 7.86 [18:25:25] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 8.26, 7.68, 7.46 [18:27:22] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 7.17, 7.69, 7.50 [18:28:53] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 7.83, 7.02, 6.29 [18:31:14] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 8.41, 7.96, 7.65 [18:33:36] [02RequestSSL] 07redbluegreenhat synchronize pull request 03#6: Cleanup - 13https://github.com/miraheze/RequestSSL/pull/6 [18:34:25] PROBLEM - mw134 HTTPS on mw134 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10003 milliseconds with 0 bytes received [18:34:26] PROBLEM - cp35 HTTPS on cp35 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10003 milliseconds with 0 bytes received [18:34:43] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 5.18, 6.07, 6.10 [18:34:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 5.35, 7.20, 7.75 [18:35:08] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 5.19, 7.18, 7.48 [18:35:48] PROBLEM - mw131 Current Load on mw131 is CRITICAL: LOAD CRITICAL - total load average: 12.60, 11.48, 9.27 [18:35:49] PROBLEM - mw132 Current Load on mw132 is WARNING: LOAD WARNING - total load average: 10.66, 10.27, 8.59 [18:36:25] PROBLEM - cp35 HTTPS on cp35 is WARNING: HTTP WARNING: HTTP/2 404 - 3458 bytes in 1.373 second response time [18:36:27] PROBLEM - mw134 HTTPS on mw134 is WARNING: HTTP WARNING: HTTP/2 404 - 285 bytes in 2.261 second response time [18:36:44] PROBLEM - mw134 Current Load on mw134 is WARNING: LOAD WARNING - total load average: 11.95, 10.93, 8.91 [18:37:48] RECOVERY - mw131 Current Load on mw131 is OK: LOAD OK - total load average: 7.06, 10.01, 9.01 [18:37:50] RECOVERY - mw132 Current Load on mw132 is OK: LOAD OK - total load average: 7.04, 9.19, 8.41 [18:38:41] RECOVERY - mw134 Current Load on mw134 is OK: LOAD OK - total load average: 5.89, 9.06, 8.47 [18:40:02] [02RequestSSL] 07redbluegreenhat synchronize pull request 03#6: Cleanup - 13https://github.com/miraheze/RequestSSL/pull/6 [18:40:40] [02mediawiki-repos] 07Reception123 synchronize pull request 03#3: add RequestSSL - 13https://github.com/miraheze/mediawiki-repos/pull/3 [18:40:43] [02miraheze/mediawiki-repos] 07Reception123 pushed 031 commit to 03Reception123-patch-1 [+0/-0/±1] 13https://github.com/miraheze/mediawiki-repos/compare/55b7958e77a4...2303f91dc53e [18:40:44] [02miraheze/mediawiki-repos] 07Reception123 032303f91 - Update mediawiki-repos.yaml [18:40:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 10.14, 7.73, 7.65 [18:40:57] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 9.59, 8.25, 7.80 [18:41:45] PROBLEM - mw131 Current Load on mw131 is CRITICAL: LOAD CRITICAL - total load average: 12.17, 10.92, 9.55 [18:42:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.77, 7.50, 7.57 [18:42:53] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 6.77, 7.91, 7.75 [18:43:44] PROBLEM - mw131 Current Load on mw131 is WARNING: LOAD WARNING - total load average: 9.85, 10.65, 9.64 [18:44:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.25, 7.85, 7.69 [18:45:44] RECOVERY - mw131 Current Load on mw131 is OK: LOAD OK - total load average: 7.71, 9.36, 9.27 [18:46:45] [02RequestSSL] 07redbluegreenhat synchronize pull request 03#6: Cleanup - 13https://github.com/miraheze/RequestSSL/pull/6 [18:46:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.80, 7.50, 7.59 [18:50:38] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 8.61, 7.32, 7.41 [18:52:34] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 6.06, 6.83, 7.22 [18:53:30] [02mediawiki-repos] 07Reception123 closed pull request 03#3: add RequestSSL - 13https://github.com/miraheze/mediawiki-repos/pull/3 [18:53:31] [02miraheze/mediawiki-repos] 07Reception123 deleted branch 03Reception123-patch-1 [18:53:33] [02miraheze/mediawiki-repos] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mediawiki-repos/compare/7e1e1529c17d...7f30976d17db [18:53:35] [02miraheze/mediawiki-repos] 07Reception123 037f30976 - add RequestSSL (#3) [18:53:38] [02mediawiki-repos] 07Reception123 deleted branch 03Reception123-patch-1 - 13https://github.com/miraheze/mediawiki-repos [18:54:30] RECOVERY - swiftobject101 Current Load on swiftobject101 is OK: OK - load average: 3.74, 5.75, 6.78 [18:56:44] [02MirahezeMagic] 07Reception123 closed pull request 03#454: RequestSSL header - 13https://github.com/miraheze/MirahezeMagic/pull/454 [18:56:45] [02miraheze/MirahezeMagic] 07Reception123 deleted branch 03Reception123-patch-1 [18:56:47] [02miraheze/MirahezeMagic] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/MirahezeMagic/compare/4f4edf429e5b...8b5b22e0ccff [18:56:48] [02miraheze/MirahezeMagic] 07Reception123 038b5b22e - RequestSSL header (#454) [18:56:50] [02MirahezeMagic] 07Reception123 deleted branch 03Reception123-patch-1 - 13https://github.com/miraheze/MirahezeMagic [18:56:52] [02RequestSSL] 07redbluegreenhat synchronize pull request 03#6: Cleanup - 13https://github.com/miraheze/RequestSSL/pull/6 [18:57:37] !log [reception@mwtask181] starting deploy of {'pull': 'world', 'world': True, 'versions': '1.40'} to all [18:57:44] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:58:12] !log [reception@mwtask181] DEPLOY ABORTED: Non-Zero Exit Code in prep, see output. [18:58:18] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:00:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.30, 7.35, 7.41 [19:01:57] !log [@mwtask181] starting deploy of {'folders': '1.40/extensions/MirahezeMagic'} to all [19:02:02] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:03:14] !log [@mwtask181] finished deploy of {'folders': '1.40/extensions/MirahezeMagic'} to all - SUCCESS in 77s [19:03:22] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:03:23] !log [@mwtask181] starting deploy of {'folders': '1.41/extensions/MirahezeMagic'} to all [19:03:26] !log [reception@mwtask181] starting deploy of {'pull': 'world', 'world': True, 'force': True, 'versions': '1.40'} to all [19:03:29] !log [reception@mwtask181] DEPLOY ABORTED: Non-Zero Exit Code in prep, see output. [19:03:31] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:03:40] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:03:48] !log [reception@mwtask181] starting deploy of {'force': True, 'versions': ['1.40', '1.41'], 'upgrade_extensions': 'RequestSSL'} to all [19:03:50] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:03:58] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:04:11] !log [@mwtask181] finished deploy of {'folders': '1.41/extensions/MirahezeMagic'} to all - SUCCESS in 47s [19:04:18] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:04:35] [02RequestSSL] 07redbluegreenhat synchronize pull request 03#6: Cleanup - 13https://github.com/miraheze/RequestSSL/pull/6 [19:04:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.89, 7.55, 7.48 [19:05:20] !log [reception@mwtask181] finished deploy of {'force': True, 'versions': ['1.40', '1.41'], 'upgrade_extensions': 'RequestSSL'} to all - SUCCESS in 92s [19:05:27] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:05:41] miraheze/MirahezeMagic - Reception123 the build passed. [19:05:50] PROBLEM - mw132 Current Load on mw132 is WARNING: LOAD WARNING - total load average: 10.54, 8.81, 8.04 [19:06:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.14, 7.54, 7.47 [19:08:50] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.71, 7.55, 7.49 [19:09:49] RECOVERY - mw132 Current Load on mw132 is OK: LOAD OK - total load average: 9.24, 9.29, 8.44 [19:10:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.76, 8.71, 7.94 [19:13:32] PROBLEM - mw131 Current Load on mw131 is WARNING: LOAD WARNING - total load average: 10.47, 10.32, 9.17 [19:14:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 5.92, 7.78, 7.77 [19:14:51] PROBLEM - mw133 Current Load on mw133 is CRITICAL: LOAD CRITICAL - total load average: 13.64, 11.01, 9.25 [19:15:00] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 7.11, 7.60, 7.12 [19:15:31] PROBLEM - mw131 Current Load on mw131 is CRITICAL: LOAD CRITICAL - total load average: 15.50, 12.25, 10.01 [19:15:56] PROBLEM - mw134 Current Load on mw134 is CRITICAL: LOAD CRITICAL - total load average: 15.99, 12.19, 10.00 [19:16:00] [02RequestSSL] 07redbluegreenhat synchronize pull request 03#6: Cleanup - 13https://github.com/miraheze/RequestSSL/pull/6 [19:16:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.06, 8.21, 7.95 [19:16:56] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 8.71, 8.25, 7.42 [19:17:50] PROBLEM - mw132 Current Load on mw132 is CRITICAL: LOAD CRITICAL - total load average: 17.11, 12.68, 10.09 [19:18:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 5.15, 7.13, 7.59 [19:18:52] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 5.56, 7.32, 7.19 [19:22:34] [02miraheze/mediawiki-repos] 07Reception123 pushed 031 commit to 03Reception123-patch-1 [+0/-0/±1] 13https://github.com/miraheze/mediawiki-repos/commit/c79c2218b3fb [19:22:35] [02miraheze/mediawiki-repos] 07Reception123 03c79c221 - add Drafts extension [19:22:36] [02mediawiki-repos] 07Reception123 created branch 03Reception123-patch-1 - 13https://github.com/miraheze/mediawiki-repos [19:22:43] [02mediawiki-repos] 07Reception123 opened pull request 03#4: add Drafts extension T11509 - 13https://github.com/miraheze/mediawiki-repos/pull/4 [19:22:44] RECOVERY - swiftobject101 Current Load on swiftobject101 is OK: OK - load average: 6.03, 6.19, 6.71 [19:23:07] !log [@test151] starting deploy of {'folders': '1.40/extensions/MirahezeMagic'} to test151 [19:23:14] !log [@test151] finished deploy of {'folders': '1.40/extensions/MirahezeMagic'} to test151 - SUCCESS in 7s [19:23:15] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:23:23] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:23:25] !log [@test151] starting deploy of {'folders': '1.41/extensions/MirahezeMagic'} to test151 [19:23:26] !log [@test151] finished deploy of {'folders': '1.41/extensions/MirahezeMagic'} to test151 - SUCCESS in 0s [19:23:34] !log [@test151] starting deploy of {'folders': '1.42/extensions/MirahezeMagic'} to test151 [19:23:35] !log [@test151] finished deploy of {'folders': '1.42/extensions/MirahezeMagic'} to test151 - SUCCESS in 0s [19:23:41] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:23:50] [02mediawiki-repos] 07Reception123 closed pull request 03#4: add Drafts extension T11509 - 13https://github.com/miraheze/mediawiki-repos/pull/4 [19:23:51] [02miraheze/mediawiki-repos] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mediawiki-repos/compare/7f30976d17db...ee7f225f84e9 [19:23:53] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:23:54] [02miraheze/mediawiki-repos] 07Reception123 03ee7f225 - add Drafts extension (#4) [19:23:57] [02miraheze/mediawiki-repos] 07Reception123 deleted branch 03Reception123-patch-1 [19:23:58] [02mediawiki-repos] 07Reception123 deleted branch 03Reception123-patch-1 - 13https://github.com/miraheze/mediawiki-repos [19:24:05] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:24:14] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:25:40] [02miraheze/mw-config] 07Reception123 pushed 031 commit to 03Reception123-patch-2 [+0/-0/±1] 13https://github.com/miraheze/mw-config/commit/a4f8c7a03eba [19:25:43] [02miraheze/mw-config] 07Reception123 03a4f8c7a - add drafts extension T11509 [19:25:46] [02mw-config] 07Reception123 created branch 03Reception123-patch-2 - 13https://github.com/miraheze/mw-config [19:25:49] [02mw-config] 07Reception123 opened pull request 03#5441: add drafts extension T11509 - 13https://github.com/miraheze/mw-config/pull/5441 [19:26:49] miraheze/mw-config - Reception123 the build passed. [19:27:03] PROBLEM - test151 Puppet on test151 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_checkout_MediaWiki-REL1_41 RequestSSL] [19:32:00] PROBLEM - mw142 Current Load on mw142 is WARNING: LOAD WARNING - total load average: 10.19, 10.67, 9.05 [19:32:12] [02RequestSSL] 07Reception123 reviewed pull request 03#6 commit - 13https://github.com/miraheze/RequestSSL/pull/6#discussion_r1457895814 [19:33:58] RECOVERY - mw142 Current Load on mw142 is OK: LOAD OK - total load average: 10.09, 10.20, 9.05 [19:36:21] !log [reception@test151] starting deploy of {'pull': 'world', 'world': True, 'force': True, 'versions': '1.41'} to test151 [19:36:22] !log [reception@test151] DEPLOY ABORTED: Non-Zero Exit Code in prep, see output. [19:36:30] PROBLEM - mw143 Current Load on mw143 is WARNING: LOAD WARNING - total load average: 10.61, 9.69, 8.31 [19:36:30] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:36:36] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:37:01] [02RequestSSL] 07redbluegreenhat synchronize pull request 03#6: Cleanup - 13https://github.com/miraheze/RequestSSL/pull/6 [19:37:19] [02RequestSSL] 07redbluegreenhat reviewed pull request 03#6 commit - 13https://github.com/miraheze/RequestSSL/pull/6#discussion_r1457900445 [19:37:26] !log [reception@test151] starting deploy of {'pull': 'world', 'world': True, 'force': True, 'versions': '1.41'} to test151 [19:37:27] !log [reception@test151] DEPLOY ABORTED: Non-Zero Exit Code in prep, see output. [19:37:37] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:37:44] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:38:02] !log [reception@test151] starting deploy of {'pull': 'world', 'world': True, 'force': True, 'versions': '1.41'} to test151 [19:38:12] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:38:24] !log [reception@test151] finished deploy of {'pull': 'world', 'world': True, 'force': True, 'versions': '1.41'} to test151 - SUCCESS in 22s [19:38:28] RECOVERY - mw143 Current Load on mw143 is OK: LOAD OK - total load average: 8.85, 9.24, 8.31 [19:38:35] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:40:07] PROBLEM - cp24 HTTPS on cp24 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10002 milliseconds with 0 bytes received [19:40:49] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 6.33, 6.43, 6.80 [19:42:05] PROBLEM - cp24 HTTPS on cp24 is WARNING: HTTP WARNING: HTTP/2 404 - 3458 bytes in 0.653 second response time [19:44:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.77, 7.67, 7.24 [19:45:49] PROBLEM - mw132 Current Load on mw132 is WARNING: LOAD WARNING - total load average: 7.56, 9.70, 11.71 [19:46:50] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.10, 6.99, 7.04 [19:47:51] PROBLEM - mw134 Current Load on mw134 is WARNING: LOAD WARNING - total load average: 7.56, 9.63, 12.00 [19:49:18] PROBLEM - mw131 Current Load on mw131 is WARNING: LOAD WARNING - total load average: 7.50, 8.91, 11.84 [19:50:51] PROBLEM - mw133 Current Load on mw133 is WARNING: LOAD WARNING - total load average: 6.35, 8.37, 11.81 [19:53:50] RECOVERY - mw132 Current Load on mw132 is OK: LOAD OK - total load average: 5.93, 7.17, 9.72 [19:53:51] RECOVERY - mw134 Current Load on mw134 is OK: LOAD OK - total load average: 5.89, 7.19, 10.16 [19:55:03] RECOVERY - test151 Puppet on test151 is OK: OK: Puppet is currently enabled, last run 48 seconds ago with 0 failures [19:55:16] RECOVERY - mw131 Current Load on mw131 is OK: LOAD OK - total load average: 5.70, 6.81, 9.96 [19:56:51] RECOVERY - mw133 Current Load on mw133 is OK: LOAD OK - total load average: 4.88, 6.78, 10.07 [19:58:49] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 4.35, 6.07, 6.74 [20:05:36] PROBLEM - poserdazfreebies.orain.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'orain.org' expires in 15 day(s) (Sat 03 Feb 2024 07:51:10 PM GMT +0000). [20:06:32] PROBLEM - orain.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'orain.org' expires in 15 day(s) (Sat 03 Feb 2024 07:51:10 PM GMT +0000). [20:07:49] PROBLEM - allthetropes.orain.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'orain.org' expires in 15 day(s) (Sat 03 Feb 2024 07:51:10 PM GMT +0000). [20:11:40] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.43, 6.99, 6.78 [20:11:46] PROBLEM - isv.orain.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'orain.org' expires in 15 day(s) (Sat 03 Feb 2024 07:51:10 PM GMT +0000). [20:21:15] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.04, 7.24, 7.01 [20:23:39] !log [@test151] starting deploy of {'config': True} to test151 [20:23:41] !log [@test151] finished deploy of {'config': True} to test151 - SUCCESS in 1s [20:23:45] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:23:50] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:25:06] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.34, 7.15, 7.03 [20:38:37] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 6.49, 6.95, 6.28 [20:38:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.65, 7.59, 7.19 [20:40:33] RECOVERY - swiftobject101 Current Load on swiftobject101 is OK: OK - load average: 5.47, 6.51, 6.20 [20:40:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 5.37, 6.72, 6.92 [20:42:32] PROBLEM - swiftobject181 PowerDNS Recursor on swiftobject181 is CRITICAL: No response from DNS 127.0.0.1 [20:44:28] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 6.49, 7.12, 6.56 [20:44:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.88, 7.36, 7.09 [20:46:04] [02mw-config] 07Reception123 synchronize pull request 03#5440: Enable RequestSSL + settings - 13https://github.com/miraheze/mw-config/pull/5440 [20:46:05] [02miraheze/mw-config] 07Reception123 pushed 031 commit to 03Reception123-patch-1 [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/0906a0159372...a6a379193fd5 [20:46:06] [02miraheze/mw-config] 07Reception123 03a6a3791 - Update LocalSettings.php [20:47:07] miraheze/mw-config - Reception123 the build passed. [20:49:13] [02mw-config] 07Reception123 closed pull request 03#5440: Enable RequestSSL + settings - 13https://github.com/miraheze/mw-config/pull/5440 [20:49:14] [02miraheze/mw-config] 07Reception123 pushed 031 commit to 03master [+0/-0/±2] 13https://github.com/miraheze/mw-config/compare/98e22e94792c...96e139f137ca [20:49:15] [02miraheze/mw-config] 07Reception123 0396e139f - Enable RequestSSL + settings (#5440) [20:49:18] [02miraheze/mw-config] 07Reception123 deleted branch 03Reception123-patch-1 [20:49:20] [02mw-config] 07Reception123 deleted branch 03Reception123-patch-1 - 13https://github.com/miraheze/mw-config [20:49:33] !log [reception@mwtask181] starting deploy of {'pull': 'config', 'config': True} to all [20:49:39] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:50:17] miraheze/mw-config - Reception123 the build passed. [20:50:29] !log [reception@mwtask181] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 55s [20:50:34] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:50:54] !log [reception@mwtask181] starting deploy of {'l10n': True, 'lang': 'en', 'versions': '1.40'} to all [20:50:59] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:52:26] RECOVERY - swiftobject101 Current Load on swiftobject101 is OK: OK - load average: 5.93, 6.70, 6.63 [20:52:27] !log [reception@mwtask181] starting deploy of {'l10n': True, 'lang': 'en', 'versions': '1.40'} to all [20:52:32] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:52:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 5.49, 6.93, 7.08 [20:53:38] PROBLEM - cp25 HTTPS on cp25 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10002 milliseconds with 0 bytes received [20:53:38] PROBLEM - cp24 HTTPS on cp24 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10002 milliseconds with 0 bytes received [20:53:48] PROBLEM - mw141 HTTPS on mw141 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10001 milliseconds with 0 bytes received [20:54:09] PROBLEM - mw143 HTTPS on mw143 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10000 milliseconds with 0 bytes received [20:54:29] [02miraheze/RequestSSL] 07Reception123 pushed 031 commit to 03main [+0/-0/±1] 13https://github.com/miraheze/RequestSSL/compare/cca7e9c7ff12...211b479815e7 [20:54:30] [02miraheze/RequestSSL] 07Reception123 03211b479 - fix double name [20:54:47] [02miraheze/RequestSSL] 07Reception123 pushed 031 commit to 03main [+0/-0/±1] 13https://github.com/miraheze/RequestSSL/compare/211b479815e7...002f437e0957 [20:54:50] [02miraheze/RequestSSL] 07Reception123 03002f437 - fix double name [20:55:37] PROBLEM - cp25 HTTPS on cp25 is WARNING: HTTP WARNING: HTTP/2 404 - 3458 bytes in 0.603 second response time [20:55:37] PROBLEM - cp24 HTTPS on cp24 is WARNING: HTTP WARNING: HTTP/2 404 - 3458 bytes in 0.670 second response time [20:55:45] PROBLEM - mw141 HTTPS on mw141 is WARNING: HTTP WARNING: HTTP/2 404 - 285 bytes in 1.271 second response time [20:56:08] PROBLEM - mw143 HTTPS on mw143 is WARNING: HTTP WARNING: HTTP/2 404 - 285 bytes in 0.505 second response time [20:56:25] !log [reception@mwtask181] starting deploy of {'versions': ['1.40', '1.41'], 'upgrade_extensions': 'RequestSSL'} to all [20:56:32] RECOVERY - swiftobject181 PowerDNS Recursor on swiftobject181 is OK: DNS OK: 0.200 seconds response time. miraheze.org returns 2607:5300:205:200::1c93,2607:5300:205:200::3121,51.222.12.133,51.222.14.30 [20:56:34] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:57:03] PROBLEM - test151 Puppet on test151 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki config] [20:58:35] !log [reception@mwtask181] finished deploy of {'versions': ['1.40', '1.41'], 'upgrade_extensions': 'RequestSSL'} to all - SUCCESS in 129s [20:58:41] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:01:26] PROBLEM - mw142 HTTPS on mw142 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10000 milliseconds with 0 bytes received [21:03:24] PROBLEM - mw142 HTTPS on mw142 is WARNING: HTTP WARNING: HTTP/2 404 - 285 bytes in 0.515 second response time [21:06:55] [02miraheze/RequestSSL] 07Reception123 pushed 031 commit to 03main [+0/-0/±1] 13https://github.com/miraheze/RequestSSL/compare/002f437e0957...3c6dab4d1825 [21:06:58] [02miraheze/RequestSSL] 07Reception123 033c6dab4 - Update extension.json [21:07:30] PROBLEM - mw142 HTTPS on mw142 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10002 milliseconds with 0 bytes received [21:07:48] PROBLEM - mw141 HTTPS on mw141 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10001 milliseconds with 0 bytes received [21:08:12] PROBLEM - mw143 HTTPS on mw143 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10001 milliseconds with 0 bytes received [21:09:01] PROBLEM - mw142 Current Load on mw142 is CRITICAL: LOAD CRITICAL - total load average: 14.49, 12.09, 8.56 [21:09:04] PROBLEM - cp34 Varnish Backends on cp34 is CRITICAL: 1 backends are down. mw141 [21:09:23] PROBLEM - os141 Current Load on os141 is CRITICAL: LOAD CRITICAL - total load average: 8.39, 4.60, 2.63 [21:09:29] PROBLEM - mw142 HTTPS on mw142 is WARNING: HTTP WARNING: HTTP/2 404 - 285 bytes in 0.543 second response time [21:09:44] PROBLEM - mw141 HTTPS on mw141 is WARNING: HTTP WARNING: HTTP/2 404 - 285 bytes in 0.500 second response time [21:09:49] PROBLEM - mw143 Current Load on mw143 is CRITICAL: LOAD CRITICAL - total load average: 16.85, 11.10, 8.59 [21:10:22] PROBLEM - os141 PowerDNS Recursor on os141 is CRITICAL: CRITICAL - Plugin timed out while executing system call [21:10:33] PROBLEM - mw141 Current Load on mw141 is CRITICAL: LOAD CRITICAL - total load average: 22.29, 13.91, 9.49 [21:10:42] PROBLEM - mw132 Current Load on mw132 is WARNING: LOAD WARNING - total load average: 10.49, 9.81, 8.27 [21:11:47] PROBLEM - mw143 Current Load on mw143 is WARNING: LOAD WARNING - total load average: 9.62, 11.56, 9.14 [21:12:20] PROBLEM - mw143 HTTPS on mw143 is WARNING: HTTP WARNING: HTTP/2 404 - 285 bytes in 0.554 second response time [21:12:22] RECOVERY - os141 PowerDNS Recursor on os141 is OK: DNS OK: 0.155 seconds response time. miraheze.org returns 2001:41d0:801:2000::3a18,2001:41d0:801:2000::5d68,51.195.201.140,51.89.139.24 [21:12:30] PROBLEM - mw141 Current Load on mw141 is WARNING: LOAD WARNING - total load average: 7.18, 10.89, 8.90 [21:12:37] RECOVERY - mw132 Current Load on mw132 is OK: LOAD OK - total load average: 8.53, 9.29, 8.27 [21:12:58] RECOVERY - mw142 Current Load on mw142 is OK: LOAD OK - total load average: 6.03, 9.85, 8.54 [21:13:04] RECOVERY - cp34 Varnish Backends on cp34 is OK: All 19 backends are healthy [21:13:48] PROBLEM - mw141 HTTPS on mw141 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10003 milliseconds with 0 bytes received [21:14:26] PROBLEM - cp35 HTTPS on cp35 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10003 milliseconds with 0 bytes received [21:14:27] PROBLEM - mw141 Current Load on mw141 is CRITICAL: LOAD CRITICAL - total load average: 11.84, 12.36, 9.72 [21:14:28] PROBLEM - mw143 HTTPS on mw143 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10002 milliseconds with 0 bytes received [21:15:44] PROBLEM - mw141 HTTPS on mw141 is WARNING: HTTP WARNING: HTTP/2 404 - 285 bytes in 0.524 second response time [21:15:46] PROBLEM - mw143 Current Load on mw143 is CRITICAL: LOAD CRITICAL - total load average: 12.72, 12.58, 10.04 [21:16:24] PROBLEM - mw141 Current Load on mw141 is WARNING: LOAD WARNING - total load average: 7.54, 11.07, 9.58 [21:16:24] PROBLEM - cp35 HTTPS on cp35 is WARNING: HTTP WARNING: HTTP/2 404 - 3480 bytes in 0.629 second response time [21:16:27] PROBLEM - mw143 HTTPS on mw143 is WARNING: HTTP WARNING: HTTP/2 404 - 285 bytes in 0.586 second response time [21:17:22] RECOVERY - os141 Current Load on os141 is OK: LOAD OK - total load average: 1.03, 3.14, 2.98 [21:17:46] RECOVERY - mw143 Current Load on mw143 is OK: LOAD OK - total load average: 4.40, 9.53, 9.23 [21:18:21] RECOVERY - mw141 Current Load on mw141 is OK: LOAD OK - total load average: 3.90, 8.69, 8.89 [21:18:49] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.07, 6.13, 6.63 [21:27:38] PROBLEM - cp24 HTTPS on cp24 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10002 milliseconds with 0 bytes received [21:29:37] PROBLEM - cp24 HTTPS on cp24 is WARNING: HTTP WARNING: HTTP/2 404 - 3458 bytes in 0.708 second response time [21:29:38] PROBLEM - mw131 Current Load on mw131 is WARNING: LOAD WARNING - total load average: 10.27, 8.60, 7.53 [21:29:52] PROBLEM - mw134 Current Load on mw134 is CRITICAL: LOAD CRITICAL - total load average: 12.26, 9.74, 8.01 [21:31:38] RECOVERY - mw131 Current Load on mw131 is OK: LOAD OK - total load average: 6.09, 7.61, 7.30 [21:31:51] RECOVERY - mw134 Current Load on mw134 is OK: LOAD OK - total load average: 7.46, 8.95, 7.94 [21:33:30] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-15 [+0/-0/±1] 13https://github.com/miraheze/puppet/commit/7e86db7f0b44 [21:33:32] [02miraheze/puppet] 07paladox 037e86db7 - dns: fix recursor for ipv6 only hosts [21:33:35] [02puppet] 07paladox created branch 03paladox-patch-15 - 13https://github.com/miraheze/puppet [21:33:36] [02puppet] 07paladox opened pull request 03#3662: dns: fix recursor for ipv6 only hosts - 13https://github.com/miraheze/puppet/pull/3662 [21:34:28] [02puppet] 07paladox edited pull request 03#3662: dns: fix recursor for ipv6 only hosts - 13https://github.com/miraheze/puppet/pull/3662 [21:37:44] [02puppet] 07paladox closed pull request 03#3662: dns: fix recursor for ipv6 only hosts - 13https://github.com/miraheze/puppet/pull/3662 [21:37:46] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/22bb31b61dca...10ccd1509f18 [21:37:48] [02miraheze/puppet] 07paladox 0310ccd15 - dns: fix recursor for ipv6 only hosts (#3662) [21:37:51] [02miraheze/puppet] 07paladox deleted branch 03paladox-patch-15 [21:37:52] [02puppet] 07paladox deleted branch 03paladox-patch-15 - 13https://github.com/miraheze/puppet [21:39:42] PROBLEM - cp25 HTTPS on cp25 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10001 milliseconds with 0 bytes received [21:39:42] PROBLEM - cp24 HTTPS on cp24 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10001 milliseconds with 0 bytes received [21:41:40] PROBLEM - cp25 HTTPS on cp25 is WARNING: HTTP WARNING: HTTP/2 404 - 3458 bytes in 0.599 second response time [21:41:40] PROBLEM - cp24 HTTPS on cp24 is WARNING: HTTP WARNING: HTTP/2 404 - 3458 bytes in 0.825 second response time [21:43:54] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.19, 6.51, 6.30 [21:45:49] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.65, 6.16, 6.20 [21:49:40] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.84, 6.77, 6.44 [21:49:57] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 7.79, 6.68, 6.12 [21:51:36] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 6.22, 6.65, 6.44 [21:51:53] RECOVERY - swiftobject101 Current Load on swiftobject101 is OK: OK - load average: 5.19, 6.02, 5.95 [22:00:44] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-15 [+0/-0/±1] 13https://github.com/miraheze/puppet/commit/f59ebb8d124d [22:00:47] [02miraheze/puppet] 07paladox 03f59ebb8 - dns: drop ipv4 for recursor [22:00:48] [02puppet] 07paladox created branch 03paladox-patch-15 - 13https://github.com/miraheze/puppet [22:00:51] [02puppet] 07paladox opened pull request 03#3663: dns: drop ipv4 for recursor - 13https://github.com/miraheze/puppet/pull/3663 [22:01:48] [02puppet] 07paladox closed pull request 03#3663: dns: drop ipv4 for recursor - 13https://github.com/miraheze/puppet/pull/3663 [22:01:51] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/10ccd1509f18...893b5291f21a [22:01:52] [02miraheze/puppet] 07paladox 03893b529 - dns: drop ipv4 for recursor (#3663) [22:01:54] [02miraheze/puppet] 07paladox deleted branch 03paladox-patch-15 [22:01:55] [02puppet] 07paladox deleted branch 03paladox-patch-15 - 13https://github.com/miraheze/puppet [22:07:26] PROBLEM - mw142 HTTPS on mw142 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10003 milliseconds with 0 bytes received [22:07:48] PROBLEM - mw141 HTTPS on mw141 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10001 milliseconds with 0 bytes received [22:09:23] PROBLEM - os141 Current Load on os141 is CRITICAL: LOAD CRITICAL - total load average: 4.51, 3.22, 2.02 [22:09:24] PROBLEM - mw142 HTTPS on mw142 is WARNING: HTTP WARNING: HTTP/2 404 - 285 bytes in 0.506 second response time [22:09:44] PROBLEM - mw141 HTTPS on mw141 is WARNING: HTTP WARNING: HTTP/2 404 - 285 bytes in 0.529 second response time [22:11:22] RECOVERY - os141 Current Load on os141 is OK: LOAD OK - total load average: 1.31, 2.37, 1.84 [22:12:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.05, 7.18, 6.54 [22:14:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 5.99, 6.85, 6.51 [22:18:50] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 10.00, 7.98, 7.02 [22:21:17] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-15 [+0/-0/±1] 13https://github.com/miraheze/puppet/commit/17070b28455e [22:21:19] [02miraheze/puppet] 07paladox 0317070b2 - dns: use ::1 for the recursor [22:21:22] [02puppet] 07paladox created branch 03paladox-patch-15 - 13https://github.com/miraheze/puppet [22:21:24] [02puppet] 07paladox opened pull request 03#3664: dns: use ::1 for the recursor - 13https://github.com/miraheze/puppet/pull/3664 [22:21:36] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-15 [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/17070b28455e...f368a202384b [22:21:39] [02miraheze/puppet] 07paladox 03f368a20 - Update resolv.conf.erb [22:21:40] [02puppet] 07paladox synchronize pull request 03#3664: dns: use ::1 for the recursor - 13https://github.com/miraheze/puppet/pull/3664 [22:21:52] [02puppet] 07paladox closed pull request 03#3664: dns: use ::1 for the recursor - 13https://github.com/miraheze/puppet/pull/3664 [22:21:55] [02miraheze/puppet] 07paladox deleted branch 03paladox-patch-15 [22:21:56] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±2] 13https://github.com/miraheze/puppet/compare/893b5291f21a...5a54a83b2038 [22:21:57] [02miraheze/puppet] 07paladox 035a54a83 - dns: use ::1 for the recursor (#3664) [22:21:59] [02puppet] 07paladox deleted branch 03paladox-patch-15 - 13https://github.com/miraheze/puppet [22:22:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.35, 7.74, 7.17 [22:24:32] PROBLEM - swiftobject181 PowerDNS Recursor on swiftobject181 is CRITICAL: No response from DNS 127.0.0.1 [22:24:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.29, 7.75, 7.22 [22:25:21] PROBLEM - cp25 PowerDNS Recursor on cp25 is CRITICAL: No response from DNS 127.0.0.1 [22:25:30] PROBLEM - bast121 PowerDNS Recursor on bast121 is CRITICAL: No response from DNS 127.0.0.1 [22:25:34] PROBLEM - bast181 PowerDNS Recursor on bast181 is CRITICAL: No response from DNS 127.0.0.1 [22:25:36] PROBLEM - db181 PowerDNS Recursor on db181 is CRITICAL: No response from DNS 127.0.0.1 [22:25:38] PROBLEM - db151 PowerDNS Recursor on db151 is CRITICAL: No response from DNS 127.0.0.1 [22:25:43] PROBLEM - mem151 PowerDNS Recursor on mem151 is CRITICAL: No response from DNS 127.0.0.1 [22:25:44] PROBLEM - cp24 PowerDNS Recursor on cp24 is CRITICAL: No response from DNS 127.0.0.1 [22:25:45] PROBLEM - cp35 PowerDNS Recursor on cp35 is CRITICAL: No response from DNS 127.0.0.1 [22:25:45] PROBLEM - bast141 PowerDNS Recursor on bast141 is CRITICAL: No response from DNS 127.0.0.1 [22:25:49] PROBLEM - mw152 PowerDNS Recursor on mw152 is CRITICAL: No response from DNS 127.0.0.1 [22:25:50] PROBLEM - swiftac111 PowerDNS Recursor on swiftac111 is CRITICAL: CRITICAL - Plugin timed out while executing system call [22:26:02] PROBLEM - db182 PowerDNS Recursor on db182 is CRITICAL: No response from DNS 127.0.0.1 [22:26:14] PROBLEM - mw181 PowerDNS Recursor on mw181 is CRITICAL: No response from DNS 127.0.0.1 [22:26:23] PROBLEM - cloud18 PowerDNS Recursor on cloud18 is CRITICAL: No response from DNS 127.0.0.1 [22:26:24] PROBLEM - db101 PowerDNS Recursor on db101 is CRITICAL: CRITICAL - Plugin timed out while executing system call [22:26:24] PROBLEM - mem141 PowerDNS Recursor on mem141 is CRITICAL: CRITICAL - Plugin timed out while executing system call [22:26:30] PROBLEM - db131 PowerDNS Recursor on db131 is CRITICAL: CRITICAL - Plugin timed out while executing system call [22:26:33] PROBLEM - test151 PowerDNS Recursor on test151 is CRITICAL: No response from DNS 127.0.0.1 [22:26:42] PROBLEM - db142 PowerDNS Recursor on db142 is CRITICAL: CRITICAL - Plugin timed out while executing system call [22:26:43] PROBLEM - graylog131 PowerDNS Recursor on graylog131 is CRITICAL: No response from DNS 127.0.0.1 [22:26:43] PROBLEM - os131 PowerDNS Recursor on os131 is CRITICAL: No response from DNS 127.0.0.1 [22:26:45] PROBLEM - cloud11 PowerDNS Recursor on cloud11 is CRITICAL: CRITICAL - Plugin timed out while executing system call [22:26:46] PROBLEM - mw141 PowerDNS Recursor on mw141 is CRITICAL: No response from DNS 127.0.0.1 [22:26:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.47, 7.64, 7.24 [22:26:50] PROBLEM - mwtask181 PowerDNS Recursor on mwtask181 is CRITICAL: No response from DNS 127.0.0.1 [22:26:50] PROBLEM - cloud14 PowerDNS Recursor on cloud14 is CRITICAL: CRITICAL - Plugin timed out while executing system call [22:26:56] PROBLEM - cloud12 PowerDNS Recursor on cloud12 is CRITICAL: CRITICAL - Plugin timed out while executing system call [22:26:56] PROBLEM - db121 PowerDNS Recursor on db121 is CRITICAL: CRITICAL - Plugin timed out while executing system call [22:26:58] PROBLEM - cloud15 PowerDNS Recursor on cloud15 is CRITICAL: No response from DNS 127.0.0.1 [22:26:59] PROBLEM - mw142 PowerDNS Recursor on mw142 is CRITICAL: No response from DNS 127.0.0.1 [22:27:01] PROBLEM - cp34 PowerDNS Recursor on cp34 is CRITICAL: No response from DNS 127.0.0.1 [22:27:01] PROBLEM - ldap141 PowerDNS Recursor on ldap141 is CRITICAL: No response from DNS 127.0.0.1 [22:27:02] PROBLEM - db112 PowerDNS Recursor on db112 is CRITICAL: CRITICAL - Plugin timed out while executing system call [22:27:12] PROBLEM - mw131 PowerDNS Recursor on mw131 is CRITICAL: No response from DNS 127.0.0.1 [22:27:16] PROBLEM - jobchron121 PowerDNS Recursor on jobchron121 is CRITICAL: No response from DNS 127.0.0.1 [22:27:18] PROBLEM - swiftobject151 PowerDNS Recursor on swiftobject151 is CRITICAL: No response from DNS 127.0.0.1 [22:27:18] PROBLEM - swiftproxy181 PowerDNS Recursor on swiftproxy181 is CRITICAL: No response from DNS 127.0.0.1 [22:27:19] PROBLEM - matomo151 PowerDNS Recursor on matomo151 is CRITICAL: No response from DNS 127.0.0.1 [22:27:26] PROBLEM - mem131 PowerDNS Recursor on mem131 is CRITICAL: CRITICAL - Plugin timed out while executing system call [22:27:29] PROBLEM - mw143 PowerDNS Recursor on mw143 is CRITICAL: No response from DNS 127.0.0.1 [22:27:29] PROBLEM - mw151 PowerDNS Recursor on mw151 is CRITICAL: No response from DNS 127.0.0.1 [22:27:37] PROBLEM - mw182 PowerDNS Recursor on mw182 is CRITICAL: No response from DNS 127.0.0.1 [22:27:38] PROBLEM - cloud10 PowerDNS Recursor on cloud10 is CRITICAL: CRITICAL - Plugin timed out while executing system call [22:27:38] PROBLEM - cloud13 PowerDNS Recursor on cloud13 is CRITICAL: CRITICAL - Plugin timed out while executing system call [22:27:39] PROBLEM - reports121 PowerDNS Recursor on reports121 is CRITICAL: CRITICAL - Plugin timed out while executing system call [22:27:42] PROBLEM - prometheus151 PowerDNS Recursor on prometheus151 is CRITICAL: No response from DNS 127.0.0.1 [22:27:44] PROBLEM - mail121 PowerDNS Recursor on mail121 is CRITICAL: No response from DNS 127.0.0.1 [22:27:45] PROBLEM - os151 PowerDNS Recursor on os151 is CRITICAL: No response from DNS 127.0.0.1 [22:27:45] PROBLEM - os141 PowerDNS Recursor on os141 is CRITICAL: No response from DNS 127.0.0.1 [22:27:45] PROBLEM - mon181 PowerDNS Recursor on mon181 is CRITICAL: No response from DNS 127.0.0.1 [22:27:49] PROBLEM - mw133 PowerDNS Recursor on mw133 is CRITICAL: No response from DNS 127.0.0.1 [22:27:52] PROBLEM - mwtask141 PowerDNS Recursor on mwtask141 is CRITICAL: No response from DNS 127.0.0.1 [22:27:58] PROBLEM - puppet181 PowerDNS Recursor on puppet181 is CRITICAL: No response from DNS 127.0.0.1 [22:28:03] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 5.96, 7.19, 6.46 [22:28:07] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/5a54a83b2038...e3c397fb4408 [22:28:09] [02miraheze/puppet] 07paladox 03e3c397f - Fix "PowerDNS Recursor" monitoring [22:28:11] PROBLEM - swiftproxy131 PowerDNS Recursor on swiftproxy131 is CRITICAL: CRITICAL - Plugin timed out while executing system call [22:28:25] PROBLEM - phab121 PowerDNS Recursor on phab121 is CRITICAL: No response from DNS 127.0.0.1 [22:28:40] PROBLEM - swiftproxy111 PowerDNS Recursor on swiftproxy111 is CRITICAL: CRITICAL - Plugin timed out while executing system call [22:28:41] PROBLEM - swiftobject113 PowerDNS Recursor on swiftobject113 is CRITICAL: CRITICAL - Plugin timed out while executing system call [22:28:45] PROBLEM - mw134 PowerDNS Recursor on mw134 is CRITICAL: No response from DNS 127.0.0.1 [22:28:45] RECOVERY - cloud11 PowerDNS Recursor on cloud11 is OK: DNS OK: 0.129 seconds response time. miraheze.org returns 2001:41d0:801:2000::3a18,2001:41d0:801:2000::5d68,51.195.201.140,51.89.139.24 [22:28:45] PROBLEM - swiftobject112 PowerDNS Recursor on swiftobject112 is CRITICAL: CRITICAL - Plugin timed out while executing system call [22:28:46] PROBLEM - mw132 PowerDNS Recursor on mw132 is CRITICAL: No response from DNS 127.0.0.1 [22:28:51] RECOVERY - cloud12 PowerDNS Recursor on cloud12 is OK: DNS OK: 0.026 seconds response time. miraheze.org returns 2001:41d0:801:2000::3a18,2001:41d0:801:2000::5d68,51.195.201.140,51.89.139.24 [22:28:51] RECOVERY - db121 PowerDNS Recursor on db121 is OK: DNS OK: 0.147 seconds response time. miraheze.org returns 2001:41d0:801:2000::3a18,2001:41d0:801:2000::5d68,51.195.201.140,51.89.139.24 [22:28:58] RECOVERY - cloud15 PowerDNS Recursor on cloud15 is OK: DNS OK: 0.098 seconds response time. miraheze.org returns 2607:5300:205:200::1c93,2607:5300:205:200::3121,51.222.12.133,51.222.14.30 [22:29:01] RECOVERY - cp34 PowerDNS Recursor on cp34 is OK: DNS OK: 0.158 seconds response time. miraheze.org returns 2607:5300:205:200::1c93,2607:5300:205:200::3121,51.222.12.133,51.222.14.30 [22:29:01] RECOVERY - ldap141 PowerDNS Recursor on ldap141 is OK: DNS OK: 0.090 seconds response time. miraheze.org returns 2001:41d0:801:2000::3a18,2001:41d0:801:2000::5d68,51.195.201.140,51.89.139.24 [22:29:01] PROBLEM - swiftobject101 PowerDNS Recursor on swiftobject101 is CRITICAL: CRITICAL - Plugin timed out while executing system call [22:29:02] RECOVERY - db112 PowerDNS Recursor on db112 is OK: DNS OK: 0.045 seconds response time. miraheze.org returns 2001:41d0:801:2000::3a18,2001:41d0:801:2000::5d68,51.195.201.140,51.89.139.24 [22:29:04] PROBLEM - swiftobject111 PowerDNS Recursor on swiftobject111 is CRITICAL: CRITICAL - Plugin timed out while executing system call [22:29:16] RECOVERY - jobchron121 PowerDNS Recursor on jobchron121 is OK: DNS OK: 0.041 seconds response time. miraheze.org returns 2001:41d0:801:2000::3a18,2001:41d0:801:2000::5d68,51.195.201.140,51.89.139.24 [22:29:19] RECOVERY - matomo151 PowerDNS Recursor on matomo151 is OK: DNS OK: 0.102 seconds response time. miraheze.org returns 2607:5300:205:200::1c93,2607:5300:205:200::3121,51.222.12.133,51.222.14.30 [22:29:21] RECOVERY - cp25 PowerDNS Recursor on cp25 is OK: DNS OK: 0.135 seconds response time. miraheze.org returns 2001:41d0:801:2000::3a18,2001:41d0:801:2000::5d68,51.195.201.140,51.89.139.24 [22:29:28] RECOVERY - mem131 PowerDNS Recursor on mem131 is OK: DNS OK: 0.106 seconds response time. miraheze.org returns 2001:41d0:801:2000::3a18,2001:41d0:801:2000::5d68,51.195.201.140,51.89.139.24 [22:29:29] RECOVERY - mw151 PowerDNS Recursor on mw151 is OK: DNS OK: 0.104 seconds response time. miraheze.org returns 2607:5300:205:200::1c93,2607:5300:205:200::3121,51.222.12.133,51.222.14.30 [22:29:29] RECOVERY - bast121 PowerDNS Recursor on bast121 is OK: DNS OK: 0.094 seconds response time. miraheze.org returns 2001:41d0:801:2000::3a18,2001:41d0:801:2000::5d68,51.195.201.140,51.89.139.24 [22:29:33] RECOVERY - cloud13 PowerDNS Recursor on cloud13 is OK: DNS OK: 0.238 seconds response time. miraheze.org returns 2001:41d0:801:2000::3a18,2001:41d0:801:2000::5d68,51.195.201.140,51.89.139.24 [22:29:34] RECOVERY - bast181 PowerDNS Recursor on bast181 is OK: DNS OK: 0.197 seconds response time. miraheze.org returns 2607:5300:205:200::1c93,2607:5300:205:200::3121,51.222.12.133,51.222.14.30 [22:29:36] RECOVERY - db181 PowerDNS Recursor on db181 is OK: DNS OK: 0.102 seconds response time. miraheze.org returns 2607:5300:205:200::1c93,2607:5300:205:200::3121,51.222.12.133,51.222.14.30 [22:29:36] RECOVERY - cloud10 PowerDNS Recursor on cloud10 is OK: DNS OK: 0.130 seconds response time. miraheze.org returns 2001:41d0:801:2000::3a18,2001:41d0:801:2000::5d68,51.195.201.140,51.89.139.24 [22:29:37] RECOVERY - mw182 PowerDNS Recursor on mw182 is OK: DNS OK: 0.109 seconds response time. miraheze.org returns 2607:5300:205:200::1c93,2607:5300:205:200::3121,51.222.12.133,51.222.14.30 [22:29:38] RECOVERY - db151 PowerDNS Recursor on db151 is OK: DNS OK: 0.102 seconds response time. miraheze.org returns 2607:5300:205:200::1c93,2607:5300:205:200::3121,51.222.12.133,51.222.14.30 [22:29:43] RECOVERY - mem151 PowerDNS Recursor on mem151 is OK: DNS OK: 0.112 seconds response time. miraheze.org returns 2607:5300:205:200::1c93,2607:5300:205:200::3121,51.222.12.133,51.222.14.30 [22:29:44] RECOVERY - cp24 PowerDNS Recursor on cp24 is OK: DNS OK: 0.031 seconds response time. miraheze.org returns 2001:41d0:801:2000::3a18,2001:41d0:801:2000::5d68,51.195.201.140,51.89.139.24 [22:29:45] RECOVERY - cp35 PowerDNS Recursor on cp35 is OK: DNS OK: 0.102 seconds response time. miraheze.org returns 2607:5300:205:200::1c93,2607:5300:205:200::3121,51.222.12.133,51.222.14.30 [22:29:45] RECOVERY - bast141 PowerDNS Recursor on bast141 is OK: DNS OK: 0.061 seconds response time. miraheze.org returns 2001:41d0:801:2000::3a18,2001:41d0:801:2000::5d68,51.195.201.140,51.89.139.24 [22:29:45] RECOVERY - os151 PowerDNS Recursor on os151 is OK: DNS OK: 0.116 seconds response time. miraheze.org returns 2607:5300:205:200::1c93,2607:5300:205:200::3121,51.222.12.133,51.222.14.30 [22:29:45] RECOVERY - os141 PowerDNS Recursor on os141 is OK: DNS OK: 0.590 seconds response time. miraheze.org returns 2001:41d0:801:2000::3a18,2001:41d0:801:2000::5d68,51.195.201.140,51.89.139.24 [22:29:46] RECOVERY - mon181 PowerDNS Recursor on mon181 is OK: DNS OK: 0.163 seconds response time. miraheze.org returns 2607:5300:205:200::1c93,2607:5300:205:200::3121,51.222.12.133,51.222.14.30 [22:29:49] RECOVERY - mw152 PowerDNS Recursor on mw152 is OK: DNS OK: 0.199 seconds response time. miraheze.org returns 2607:5300:205:200::1c93,2607:5300:205:200::3121,51.222.12.133,51.222.14.30 [22:29:49] RECOVERY - mw133 PowerDNS Recursor on mw133 is OK: DNS OK: 0.072 seconds response time. miraheze.org returns 2001:41d0:801:2000::3a18,2001:41d0:801:2000::5d68,51.195.201.140,51.89.139.24 [22:29:52] RECOVERY - mwtask141 PowerDNS Recursor on mwtask141 is OK: DNS OK: 0.045 seconds response time. miraheze.org returns 2001:41d0:801:2000::3a18,2001:41d0:801:2000::5d68,51.195.201.140,51.89.139.24 [22:29:58] RECOVERY - puppet181 PowerDNS Recursor on puppet181 is OK: DNS OK: 0.132 seconds response time. miraheze.org returns 2607:5300:205:200::1c93,2607:5300:205:200::3121,51.222.12.133,51.222.14.30 [22:30:02] RECOVERY - db182 PowerDNS Recursor on db182 is OK: DNS OK: 0.103 seconds response time. miraheze.org returns 2607:5300:205:200::1c93,2607:5300:205:200::3121,51.222.12.133,51.222.14.30 [22:30:03] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 5.84, 6.69, 6.37 [22:30:03] RECOVERY - swiftac111 PowerDNS Recursor on swiftac111 is OK: DNS OK: 0.149 seconds response time. miraheze.org returns 2001:41d0:801:2000::3a18,2001:41d0:801:2000::5d68,51.195.201.140,51.89.139.24 [22:30:08] PROBLEM - swiftobject122 PowerDNS Recursor on swiftobject122 is CRITICAL: CRITICAL - Plugin timed out while executing system call [22:30:15] RECOVERY - mw181 PowerDNS Recursor on mw181 is OK: DNS OK: 0.193 seconds response time. miraheze.org returns 2607:5300:205:200::1c93,2607:5300:205:200::3121,51.222.12.133,51.222.14.30 [22:30:24] RECOVERY - cloud18 PowerDNS Recursor on cloud18 is OK: DNS OK: 0.189 seconds response time. miraheze.org returns 2607:5300:205:200::1c93,2607:5300:205:200::3121,51.222.12.133,51.222.14.30 [22:30:25] RECOVERY - phab121 PowerDNS Recursor on phab121 is OK: DNS OK: 0.136 seconds response time. miraheze.org returns 2001:41d0:801:2000::3a18,2001:41d0:801:2000::5d68,51.195.201.140,51.89.139.24 [22:30:26] RECOVERY - mem141 PowerDNS Recursor on mem141 is OK: DNS OK: 0.184 seconds response time. miraheze.org returns 2001:41d0:801:2000::3a18,2001:41d0:801:2000::5d68,51.195.201.140,51.89.139.24 [22:30:29] RECOVERY - db101 PowerDNS Recursor on db101 is OK: DNS OK: 0.034 seconds response time. miraheze.org returns 2001:41d0:801:2000::3a18,2001:41d0:801:2000::5d68,51.195.201.140,51.89.139.24 [22:30:30] PROBLEM - swiftobject121 PowerDNS Recursor on swiftobject121 is CRITICAL: CRITICAL - Plugin timed out while executing system call [22:30:32] RECOVERY - db131 PowerDNS Recursor on db131 is OK: DNS OK: 0.064 seconds response time. miraheze.org returns 2001:41d0:801:2000::3a18,2001:41d0:801:2000::5d68,51.195.201.140,51.89.139.24 [22:30:32] RECOVERY - swiftobject181 PowerDNS Recursor on swiftobject181 is OK: DNS OK: 0.106 seconds response time. miraheze.org returns 2607:5300:205:200::1c93,2607:5300:205:200::3121,51.222.12.133,51.222.14.30 [22:30:38] RECOVERY - swiftproxy111 PowerDNS Recursor on swiftproxy111 is OK: DNS OK: 0.028 seconds response time. miraheze.org returns 2001:41d0:801:2000::3a18,2001:41d0:801:2000::5d68,51.195.201.140,51.89.139.24 [22:30:41] RECOVERY - swiftobject113 PowerDNS Recursor on swiftobject113 is OK: DNS OK: 1.467 second response time. miraheze.org returns 2001:41d0:801:2000::3a18,2001:41d0:801:2000::5d68,51.195.201.140,51.89.139.24 [22:30:44] RECOVERY - os131 PowerDNS Recursor on os131 is OK: DNS OK: 0.468 seconds response time. miraheze.org returns 2001:41d0:801:2000::3a18,2001:41d0:801:2000::5d68,51.195.201.140,51.89.139.24 [22:30:44] RECOVERY - graylog131 PowerDNS Recursor on graylog131 is OK: DNS OK: 0.270 seconds response time. miraheze.org returns 2001:41d0:801:2000::3a18,2001:41d0:801:2000::5d68,51.195.201.140,51.89.139.24 [22:30:45] RECOVERY - mw134 PowerDNS Recursor on mw134 is OK: DNS OK: 0.052 seconds response time. miraheze.org returns 2001:41d0:801:2000::3a18,2001:41d0:801:2000::5d68,51.195.201.140,51.89.139.24 [22:30:45] RECOVERY - mw132 PowerDNS Recursor on mw132 is OK: DNS OK: 0.059 seconds response time. miraheze.org returns 2001:41d0:801:2000::3a18,2001:41d0:801:2000::5d68,51.195.201.140,51.89.139.24 [22:30:46] RECOVERY - mw141 PowerDNS Recursor on mw141 is OK: DNS OK: 0.048 seconds response time. miraheze.org returns 2001:41d0:801:2000::3a18,2001:41d0:801:2000::5d68,51.195.201.140,51.89.139.24 [22:30:48] RECOVERY - swiftobject112 PowerDNS Recursor on swiftobject112 is OK: DNS OK: 0.238 seconds response time. miraheze.org returns 2001:41d0:801:2000::3a18,2001:41d0:801:2000::5d68,51.195.201.140,51.89.139.24 [22:30:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.27, 7.58, 7.27 [22:30:50] RECOVERY - mwtask181 PowerDNS Recursor on mwtask181 is OK: DNS OK: 0.099 seconds response time. miraheze.org returns 2607:5300:205:200::1c93,2607:5300:205:200::3121,51.222.12.133,51.222.14.30 [22:30:54] RECOVERY - cloud14 PowerDNS Recursor on cloud14 is OK: DNS OK: 0.023 seconds response time. miraheze.org returns 2001:41d0:801:2000::3a18,2001:41d0:801:2000::5d68,51.195.201.140,51.89.139.24 [22:30:54] RECOVERY - db142 PowerDNS Recursor on db142 is OK: DNS OK: 0.037 seconds response time. miraheze.org returns 2001:41d0:801:2000::3a18,2001:41d0:801:2000::5d68,51.195.201.140,51.89.139.24 [22:30:59] RECOVERY - mw142 PowerDNS Recursor on mw142 is OK: DNS OK: 0.040 seconds response time. miraheze.org returns 2001:41d0:801:2000::3a18,2001:41d0:801:2000::5d68,51.195.201.140,51.89.139.24 [22:31:01] RECOVERY - swiftobject111 PowerDNS Recursor on swiftobject111 is OK: DNS OK: 0.915 seconds response time. miraheze.org returns 2001:41d0:801:2000::3a18,2001:41d0:801:2000::5d68,51.195.201.140,51.89.139.24 [22:31:03] RECOVERY - swiftobject101 PowerDNS Recursor on swiftobject101 is OK: DNS OK: 2.787 seconds response time. miraheze.org returns 2001:41d0:801:2000::3a18,2001:41d0:801:2000::5d68,51.195.201.140,51.89.139.24 [22:31:12] RECOVERY - mw131 PowerDNS Recursor on mw131 is OK: DNS OK: 0.911 seconds response time. miraheze.org returns 2001:41d0:801:2000::3a18,2001:41d0:801:2000::5d68,51.195.201.140,51.89.139.24 [22:31:17] RECOVERY - swiftproxy181 PowerDNS Recursor on swiftproxy181 is OK: DNS OK: 0.107 seconds response time. miraheze.org returns 2607:5300:205:200::1c93,2607:5300:205:200::3121,51.222.12.133,51.222.14.30 [22:31:18] RECOVERY - swiftobject151 PowerDNS Recursor on swiftobject151 is OK: DNS OK: 0.114 seconds response time. miraheze.org returns 2607:5300:205:200::1c93,2607:5300:205:200::3121,51.222.12.133,51.222.14.30 [22:31:27] RECOVERY - mw143 PowerDNS Recursor on mw143 is OK: DNS OK: 0.150 seconds response time. miraheze.org returns 2001:41d0:801:2000::3a18,2001:41d0:801:2000::5d68,51.195.201.140,51.89.139.24 [22:31:38] RECOVERY - reports121 PowerDNS Recursor on reports121 is OK: DNS OK: 0.034 seconds response time. miraheze.org returns 2001:41d0:801:2000::3a18,2001:41d0:801:2000::5d68,51.195.201.140,51.89.139.24 [22:31:43] RECOVERY - prometheus151 PowerDNS Recursor on prometheus151 is OK: DNS OK: 0.202 seconds response time. miraheze.org returns 2607:5300:205:200::1c93,2607:5300:205:200::3121,51.222.12.133,51.222.14.30 [22:31:44] RECOVERY - mail121 PowerDNS Recursor on mail121 is OK: DNS OK: 0.458 seconds response time. miraheze.org returns 2001:41d0:801:2000::3a18,2001:41d0:801:2000::5d68,51.195.201.140,51.89.139.24 [22:32:08] RECOVERY - swiftobject122 PowerDNS Recursor on swiftobject122 is OK: DNS OK: 0.686 seconds response time. miraheze.org returns 2001:41d0:801:2000::3a18,2001:41d0:801:2000::5d68,51.195.201.140,51.89.139.24 [22:32:21] RECOVERY - swiftproxy131 PowerDNS Recursor on swiftproxy131 is OK: DNS OK: 0.047 seconds response time. miraheze.org returns 2001:41d0:801:2000::3a18,2001:41d0:801:2000::5d68,51.195.201.140,51.89.139.24 [22:32:32] RECOVERY - swiftobject121 PowerDNS Recursor on swiftobject121 is OK: DNS OK: 2.132 seconds response time. miraheze.org returns 2001:41d0:801:2000::3a18,2001:41d0:801:2000::5d68,51.195.201.140,51.89.139.24 [22:32:33] RECOVERY - test151 PowerDNS Recursor on test151 is OK: DNS OK: 0.192 seconds response time. miraheze.org returns 2607:5300:205:200::1c93,2607:5300:205:200::3121,51.222.12.133,51.222.14.30 [22:32:34] PROBLEM - cloud10 Puppet on cloud10 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[ulogd2] [22:32:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.65, 7.51, 7.30 [22:34:32] !log [void@mwtask141] python /home/void/fix_containers.py karwiki [22:34:38] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:36:49] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 4.19, 5.97, 6.74 [22:40:33] RECOVERY - cloud10 Puppet on cloud10 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [22:50:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.94, 6.91, 6.63 [22:52:49] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 6.44, 6.74, 6.61 [23:30:09] PROBLEM - mw143 HTTPS on mw143 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10000 milliseconds with 0 bytes received [23:30:59] PROBLEM - wiki.mahdiruiz.line.pm - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query line.pm. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [23:32:08] PROBLEM - mw143 HTTPS on mw143 is WARNING: HTTP WARNING: HTTP/2 404 - 285 bytes in 0.508 second response time [23:33:22] PROBLEM - os141 Current Load on os141 is CRITICAL: LOAD CRITICAL - total load average: 5.44, 3.81, 2.58 [23:33:45] PROBLEM - mw141 Current Load on mw141 is WARNING: LOAD WARNING - total load average: 10.73, 9.47, 6.86 [23:35:23] RECOVERY - os141 Current Load on os141 is OK: LOAD OK - total load average: 2.50, 3.31, 2.55 [23:35:45] RECOVERY - mw141 Current Load on mw141 is OK: LOAD OK - total load average: 5.16, 7.84, 6.58