[00:00:52] RECOVERY - db182 Puppet on db182 is OK: OK: Puppet is currently enabled, last run 10 seconds ago with 0 failures [00:00:59] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.67, 7.18, 7.11 [00:01:31] PROBLEM - db181 Puppet on db181 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): File[/etc/apt/keyrings/mariadb_release_signing_key.pgp] [00:01:49] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 7.16, 7.95, 7.77 [00:02:58] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.67, 7.27, 7.15 [00:03:33] PROBLEM - db112 Current Load on db112 is CRITICAL: CRITICAL - load average: 12.83, 7.33, 3.58 [00:06:58] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.84, 6.24, 6.73 [00:07:52] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 8.46, 7.75, 7.67 [00:09:53] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 6.93, 7.53, 7.61 [00:09:58] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 8.22, 7.66, 7.64 [00:11:54] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 8.45, 7.93, 7.75 [00:14:26] [02miraheze/CreateWiki] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/585c6f117069...e1e216f1a2e0 [00:14:29] [02miraheze/CreateWiki] 07Universal-Omega 03e1e216f - Remove comment [00:15:54] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 7.80, 7.88, 7.77 [00:16:59] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.50, 7.08, 6.98 [00:17:33] PROBLEM - db112 Current Load on db112 is WARNING: WARNING - load average: 4.33, 7.18, 6.81 [00:18:58] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.58, 7.26, 7.03 [00:19:33] RECOVERY - db112 Current Load on db112 is OK: OK - load average: 3.76, 6.03, 6.42 [00:20:26] miraheze/CreateWiki - Universal-Omega the build has errored. [00:20:58] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.41, 6.96, 6.95 [00:21:58] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 6.76, 7.72, 7.92 [00:24:59] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.36, 6.31, 6.72 [00:29:58] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 8.04, 7.30, 7.56 [00:31:31] RECOVERY - db181 Puppet on db181 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [00:31:56] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 9.94, 7.57, 7.31 [00:34:58] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.87, 7.14, 6.88 [00:37:58] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 7.03, 7.83, 7.87 [00:41:58] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 6.74, 7.89, 7.75 [00:44:58] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 6.23, 6.44, 6.72 [00:45:16] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 7.92, 6.35, 5.88 [00:47:58] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 8.60, 7.20, 7.36 [00:49:15] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 6.39, 6.46, 6.05 [00:49:58] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 8.22, 7.91, 7.70 [00:49:59] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 7.41, 7.25, 7.36 [00:51:58] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 7.83, 7.69, 7.63 [00:53:59] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 8.31, 7.36, 7.35 [00:55:34] PROBLEM - mw143 HTTPS on mw143 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10002 milliseconds with 0 bytes received [00:55:59] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 7.90, 7.26, 7.30 [00:57:29] PROBLEM - mw143 HTTPS on mw143 is WARNING: HTTP WARNING: HTTP/2 404 - 285 bytes in 0.528 second response time [00:59:27] PROBLEM - os141 Current Load on os141 is CRITICAL: LOAD CRITICAL - total load average: 4.03, 3.61, 3.16 [01:01:27] PROBLEM - os141 Current Load on os141 is WARNING: LOAD WARNING - total load average: 3.87, 3.64, 3.21 [01:01:58] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 9.26, 8.10, 7.74 [01:03:27] PROBLEM - os141 Current Load on os141 is CRITICAL: LOAD CRITICAL - total load average: 4.74, 3.99, 3.39 [01:03:58] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 7.06, 7.61, 7.60 [01:04:52] PROBLEM - db182 Puppet on db182 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 4 minutes ago with 1 failures. Failed resources (up to 3 shown): File[/etc/apt/keyrings/mariadb_release_signing_key.pgp] [01:05:27] PROBLEM - os141 Current Load on os141 is WARNING: LOAD WARNING - total load average: 3.75, 3.74, 3.37 [01:05:58] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 8.03, 7.24, 7.15 [01:09:29] PROBLEM - os141 Current Load on os141 is CRITICAL: LOAD CRITICAL - total load average: 5.22, 4.20, 3.62 [01:09:58] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 7.65, 7.51, 7.29 [01:13:29] PROBLEM - os141 Current Load on os141 is WARNING: LOAD WARNING - total load average: 3.27, 3.64, 3.53 [01:15:29] PROBLEM - os141 Current Load on os141 is CRITICAL: LOAD CRITICAL - total load average: 4.16, 3.70, 3.56 [01:15:59] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 6.97, 6.39, 5.87 [01:17:30] PROBLEM - os141 Current Load on os141 is WARNING: LOAD WARNING - total load average: 3.35, 3.41, 3.46 [01:17:56] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 5.70, 6.06, 5.81 [01:17:58] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 9.57, 8.25, 7.70 [01:19:30] PROBLEM - os141 Current Load on os141 is CRITICAL: LOAD CRITICAL - total load average: 4.54, 3.77, 3.58 [01:19:58] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 4.80, 6.16, 6.77 [01:21:26] PROBLEM - mw141 HTTPS on mw141 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10002 milliseconds with 0 bytes received [01:21:58] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 7.21, 7.74, 7.62 [01:23:26] PROBLEM - mw141 HTTPS on mw141 is WARNING: HTTP WARNING: HTTP/2 404 - 285 bytes in 0.536 second response time [01:23:37] PROBLEM - os141 Current Load on os141 is WARNING: LOAD WARNING - total load average: 3.21, 3.90, 3.71 [01:23:57] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 8.10, 7.13, 7.04 [01:25:57] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 7.39, 7.20, 7.07 [01:26:01] PROBLEM - cp34 HTTPS on cp34 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10004 milliseconds with 0 bytes received [01:27:56] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 8.10, 7.30, 7.11 [01:27:58] PROBLEM - cp34 HTTPS on cp34 is WARNING: HTTP WARNING: HTTP/2 404 - 3458 bytes in 0.949 second response time [01:29:37] RECOVERY - os141 Current Load on os141 is OK: LOAD OK - total load average: 2.02, 2.79, 3.28 [01:29:57] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 6.94, 7.17, 7.09 [01:30:52] RECOVERY - db182 Puppet on db182 is OK: OK: Puppet is currently enabled, last run 33 seconds ago with 0 failures [01:33:31] PROBLEM - db181 Puppet on db181 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): File[/etc/apt/keyrings/mariadb_release_signing_key.pgp] [01:33:57] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 8.59, 7.50, 7.22 [01:33:58] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 10.03, 8.37, 7.82 [01:35:57] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 7.98, 7.53, 7.26 [01:37:57] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 8.15, 7.79, 7.39 [01:37:58] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 6.86, 7.45, 7.55 [01:39:58] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 6.47, 7.38, 7.29 [01:41:44] PROBLEM - matomo121 Current Load on matomo121 is WARNING: LOAD WARNING - total load average: 3.09, 3.84, 3.19 [01:41:59] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 8.44, 7.68, 7.41 [01:43:44] RECOVERY - matomo121 Current Load on matomo121 is OK: LOAD OK - total load average: 1.78, 3.15, 3.02 [01:44:00] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 7.46, 7.69, 7.45 [01:45:19] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 8.57, 6.60, 5.93 [01:45:22] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.39, 6.73, 6.27 [01:46:00] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 8.24, 7.84, 7.53 [01:47:16] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 6.68, 6.43, 5.95 [01:47:20] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.57, 6.97, 6.42 [01:47:59] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 6.41, 7.23, 7.34 [01:49:19] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.07, 7.52, 6.67 [01:51:17] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.90, 7.17, 6.64 [01:51:33] PROBLEM - mw141 HTTPS on mw141 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Connection timed out after 10002 milliseconds [01:51:34] PROBLEM - mw143 HTTPS on mw143 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10005 milliseconds with 0 bytes received [01:52:16] PROBLEM - mw141 Current Load on mw141 is CRITICAL: LOAD CRITICAL - total load average: 29.35, 15.50, 9.45 [01:52:49] PROBLEM - mw142 Current Load on mw142 is WARNING: LOAD WARNING - total load average: 11.56, 9.92, 7.18 [01:52:52] PROBLEM - cp35 Varnish Backends on cp35 is CRITICAL: 1 backends are down. mw141 [01:53:29] PROBLEM - mw143 HTTPS on mw143 is WARNING: HTTP WARNING: HTTP/2 404 - 285 bytes in 0.511 second response time [01:53:33] PROBLEM - mw141 HTTPS on mw141 is WARNING: HTTP WARNING: HTTP/2 404 - 285 bytes in 0.528 second response time [01:54:16] PROBLEM - mw141 Current Load on mw141 is WARNING: LOAD WARNING - total load average: 8.04, 11.77, 8.80 [01:54:49] RECOVERY - mw142 Current Load on mw142 is OK: LOAD OK - total load average: 5.64, 8.19, 6.88 [01:54:52] RECOVERY - cp35 Varnish Backends on cp35 is OK: All 17 backends are healthy [01:55:13] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.54, 6.58, 6.54 [01:55:59] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 5.89, 6.19, 6.78 [01:56:16] RECOVERY - mw141 Current Load on mw141 is OK: LOAD OK - total load average: 5.20, 9.51, 8.33 [02:01:31] RECOVERY - db181 Puppet on db181 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [02:02:00] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 7.99, 7.40, 7.13 [02:03:58] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 8.85, 7.80, 7.52 [02:04:00] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 8.32, 7.61, 7.23 [02:08:59] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.17, 7.59, 6.68 [02:10:58] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.78, 7.60, 6.79 [02:12:58] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.32, 8.17, 7.10 [02:14:58] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.75, 7.89, 7.12 [02:15:15] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 7.46, 7.02, 6.36 [02:15:58] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 5.97, 7.86, 7.98 [02:18:59] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 15.11, 10.34, 8.17 [02:19:58] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 8.39, 8.40, 8.16 [02:21:16] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 10.39, 7.88, 6.86 [02:23:15] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 7.14, 7.68, 6.93 [02:26:35] PROBLEM - ping6 on cloud10 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 128.84 ms [02:28:38] PROBLEM - ping6 on cloud10 is WARNING: PING WARNING - Packet loss = 0%, RTA = 128.71 ms [02:29:15] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 4.59, 6.26, 6.60 [02:34:18] PROBLEM - db112 Current Load on db112 is CRITICAL: CRITICAL - load average: 18.09, 13.68, 7.55 [02:34:52] PROBLEM - db182 Puppet on db182 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): File[/etc/apt/keyrings/mariadb_release_signing_key.pgp] [02:34:58] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 5.23, 6.75, 7.72 [02:47:15] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 7.00, 6.96, 6.67 [02:49:15] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 5.06, 6.29, 6.46 [02:49:58] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 6.85, 7.38, 7.90 [02:50:58] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 10.06, 8.30, 7.64 [02:51:58] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 9.00, 7.94, 8.04 [02:53:15] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 6.86, 6.74, 6.61 [02:54:05] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 5.85, 7.27, 7.88 [02:54:58] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.21, 7.95, 7.70 [02:55:15] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 6.43, 6.64, 6.59 [02:56:34] PROBLEM - mw134 Current Load on mw134 is WARNING: LOAD WARNING - total load average: 11.82, 9.66, 8.27 [02:58:34] RECOVERY - mw134 Current Load on mw134 is OK: LOAD OK - total load average: 6.90, 8.72, 8.10 [03:00:06] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 8.27, 7.41, 7.68 [03:00:52] RECOVERY - db182 Puppet on db182 is OK: OK: Puppet is currently enabled, last run 25 seconds ago with 0 failures [03:01:30] RECOVERY - mon181 Backups Grafana on mon181 is OK: FILE_AGE OK: /var/log/grafana-backup.log is 67 seconds old and 93 bytes [03:02:06] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 7.98, 7.68, 7.75 [03:04:06] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 8.87, 7.86, 7.79 [03:06:58] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.73, 7.58, 7.46 [03:10:58] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.24, 7.65, 7.52 [03:13:58] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 7.03, 7.65, 8.00 [03:14:51] PROBLEM - db112 Disk Space on db112 is WARNING: DISK WARNING - free space: / 8931 MB (6% inode=99%); [03:17:58] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 8.17, 7.91, 8.01 [03:19:58] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 6.59, 7.39, 7.81 [03:21:58] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 8.41, 7.69, 7.86 [03:22:58] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.17, 8.17, 7.62 [03:23:58] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 6.55, 7.31, 7.71 [03:24:58] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.11, 7.67, 7.52 [03:25:33] PROBLEM - db112 Current Load on db112 is WARNING: WARNING - load average: 1.91, 3.67, 7.46 [03:27:33] RECOVERY - db112 Current Load on db112 is OK: OK - load average: 1.56, 2.95, 6.74 [03:27:58] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 8.88, 7.70, 7.76 [03:28:58] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.25, 7.97, 7.68 [03:29:58] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 7.89, 7.69, 7.75 [03:30:59] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.44, 7.45, 7.53 [03:31:58] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 11.01, 8.36, 7.95 [03:34:07] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 7.66, 7.76, 7.98 [03:34:52] PROBLEM - db182 Puppet on db182 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): File[/etc/apt/keyrings/mariadb_release_signing_key.pgp] [03:34:58] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.14, 7.91, 7.65 [03:35:58] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 7.40, 8.00, 7.91 [03:36:10] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 10.04, 8.42, 8.18 [03:36:58] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.72, 7.42, 7.51 [03:37:25] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 6.96, 6.47, 6.33 [03:37:58] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 8.87, 8.48, 8.10 [03:38:58] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.34, 8.22, 7.79 [03:41:20] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 6.35, 6.74, 6.50 [03:44:34] RECOVERY - deadprem.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'deadprem.wiki' will expire on Wed 31 Jan 2024 12:16:06 PM GMT +0000. [03:44:59] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.32, 7.61, 7.75 [03:46:59] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 10.02, 8.50, 8.06 [03:47:15] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 8.59, 7.49, 6.87 [03:49:15] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 5.52, 6.73, 6.67 [03:54:58] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.22, 7.68, 7.95 [03:58:58] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.54, 7.97, 7.97 [04:02:52] RECOVERY - db182 Puppet on db182 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [04:02:58] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.92, 7.76, 7.91 [04:04:58] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.20, 8.01, 7.98 [04:06:59] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.61, 7.53, 7.80 [04:07:58] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 6.20, 7.34, 7.92 [04:11:58] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 9.68, 7.57, 7.82 [04:12:58] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.06, 7.61, 7.69 [04:13:58] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 6.76, 7.25, 7.68 [04:14:59] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.09, 7.17, 7.53 [04:15:50] PROBLEM - deadprem.wiki - LetsEncrypt on sslhost is CRITICAL: connect to address deadprem.wiki and port 443: Network is unreachableHTTP CRITICAL - Unable to open TCP socket [04:16:19] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 6.46, 7.30, 7.97 [04:18:58] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.46, 7.54, 7.58 [04:19:03] RECOVERY - www.deadprem.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'deadprem.wiki' will expire on Wed 31 Jan 2024 12:16:06 PM GMT +0000. [04:19:58] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 8.70, 7.15, 7.40 [04:21:58] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 6.06, 6.82, 7.26 [04:22:58] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.77, 7.53, 7.61 [04:30:58] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.55, 7.60, 7.57 [04:31:58] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 8.18, 7.23, 7.21 [04:32:59] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.94, 7.17, 7.41 [04:33:58] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 5.03, 6.48, 6.95 [04:34:19] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 5.01, 5.73, 6.79 [04:37:58] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 8.24, 7.13, 7.08 [04:38:20] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 8.77, 7.15, 7.09 [04:39:58] RECOVERY - swiftobject101 Current Load on swiftobject101 is OK: OK - load average: 5.11, 6.36, 6.80 [04:40:20] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 7.81, 7.20, 7.11 [04:44:59] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.93, 6.24, 6.76 [04:47:58] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 6.93, 6.81, 6.83 [04:48:58] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.33, 6.63, 6.85 [04:49:58] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 8.63, 7.38, 7.02 [04:50:19] PROBLEM - www.deadprem.wiki - LetsEncrypt on sslhost is CRITICAL: connect to address www.deadprem.wiki and port 443: Network is unreachableHTTP CRITICAL - Unable to open TCP socket [04:51:58] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 7.73, 7.40, 7.07 [04:53:34] PROBLEM - mw143 HTTPS on mw143 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10004 milliseconds with 0 bytes received [04:53:58] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 10.21, 8.06, 7.33 [04:55:29] PROBLEM - mw143 HTTPS on mw143 is WARNING: HTTP WARNING: HTTP/2 404 - 285 bytes in 0.518 second response time [04:55:58] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 6.68, 7.30, 7.13 [04:56:58] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.85, 6.42, 6.74 [04:58:20] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 10.56, 7.46, 7.10 [04:59:58] RECOVERY - swiftobject101 Current Load on swiftobject101 is OK: OK - load average: 5.40, 6.37, 6.80 [05:03:31] PROBLEM - db181 Puppet on db181 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): File[/etc/apt/keyrings/mariadb_release_signing_key.pgp] [05:03:58] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 7.24, 7.14, 7.03 [05:04:23] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 7.70, 7.52, 7.23 [05:06:24] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 9.50, 8.05, 7.44 [05:13:58] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 11.40, 8.22, 7.42 [05:14:29] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 6.56, 7.91, 7.78 [05:15:52] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 12.12, 8.45, 7.29 [05:16:29] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 11.05, 9.02, 8.19 [05:17:40] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 6.88, 6.73, 6.07 [05:17:50] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.10, 7.95, 7.26 [05:19:37] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 5.76, 6.32, 5.99 [05:21:46] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.04, 7.90, 7.39 [05:23:35] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 6.95, 6.85, 6.28 [05:23:45] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.30, 7.18, 7.18 [05:25:32] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 6.33, 6.60, 6.25 [05:27:58] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 6.20, 7.80, 7.89 [05:28:33] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 7.38, 7.68, 7.90 [05:29:31] RECOVERY - db181 Puppet on db181 is OK: OK: Puppet is currently enabled, last run 8 seconds ago with 0 failures [05:33:36] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 6.07, 6.27, 6.75 [05:36:33] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 8.93, 7.35, 7.55 [05:37:32] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.90, 6.84, 6.90 [05:39:30] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.77, 6.49, 6.77 [05:40:34] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 7.35, 7.56, 7.62 [05:45:23] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.19, 6.79, 6.86 [05:47:22] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.03, 7.21, 7.00 [05:48:35] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 8.35, 7.76, 7.63 [05:50:35] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 7.68, 7.78, 7.66 [05:53:16] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.79, 7.23, 7.14 [05:54:36] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 8.30, 7.58, 7.59 [05:56:36] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 6.82, 7.29, 7.48 [05:56:39] PROBLEM - ping6 on cloud10 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 128.73 ms [05:58:43] PROBLEM - ping6 on cloud10 is WARNING: PING WARNING - Packet loss = 0%, RTA = 128.77 ms [06:00:36] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 8.63, 7.62, 7.54 [06:01:10] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.49, 6.41, 6.80 [06:01:58] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 8.11, 7.40, 7.30 [06:02:38] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 7.58, 7.68, 7.58 [06:03:58] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 6.03, 6.88, 7.12 [06:06:39] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 8.09, 8.00, 7.74 [06:10:59] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.26, 6.93, 6.71 [06:12:39] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 5.74, 7.37, 7.63 [06:13:58] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 8.54, 7.34, 7.14 [06:15:58] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 6.98, 6.85, 6.97 [06:16:58] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 6.27, 6.55, 6.60 [06:20:41] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 8.63, 7.24, 7.33 [06:21:58] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 9.35, 8.01, 7.37 [06:22:59] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.74, 7.17, 6.81 [06:23:58] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 6.64, 7.72, 7.37 [06:24:42] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 7.23, 7.49, 7.43 [06:24:58] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.40, 6.61, 6.66 [06:29:58] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 8.18, 7.81, 7.47 [06:30:46] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 8.94, 8.11, 7.69 [06:30:58] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.35, 7.43, 6.93 [06:32:47] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 5.79, 7.16, 7.40 [06:32:58] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.85, 7.35, 6.97 [06:33:27] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+1/-0/±1] 13https://github.com/miraheze/ssl/compare/42b9f9a06855...fd7062baa887 [06:33:29] [02miraheze/ssl] 07MirahezeSSLBot 03fd7062b - Bot: Add SSL cert for wiki.k2cho.me [06:34:02] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±2] 13https://github.com/miraheze/ssl/compare/fd7062baa887...925cb18257cc [06:34:05] [02miraheze/ssl] 07MirahezeSSLBot 03925cb18 - Bot: Add SSL cert for wiki.k2cho.me [06:34:25] !log [reception@mwtask181] sudo -u www-data php /srv/mediawiki/1.40/maintenance/run.php /srv/mediawiki/1.40/maintenance/sql.php --wiki=trollpastawiki (END - exit=2) [06:34:31] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:34:52] PROBLEM - db182 Puppet on db182 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): File[/etc/apt/keyrings/mariadb_release_signing_key.pgp] [06:34:54] miraheze/ssl - MirahezeSSLBot the build has errored. [06:35:58] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 6.80, 7.91, 7.65 [06:36:48] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 8.70, 7.66, 7.51 [06:36:58] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 6.18, 6.50, 6.70 [06:37:11] !log DROPPED kiskapediawiki on db142 and db121 (cw error) [06:37:13] PROBLEM - mw141 HTTPS on mw141 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Connection timed out after 10002 milliseconds [06:37:18] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:37:58] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 8.92, 8.13, 7.75 [06:39:13] PROBLEM - mw141 HTTPS on mw141 is WARNING: HTTP WARNING: HTTP/2 404 - 285 bytes in 0.818 second response time [06:40:51] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 7.96, 8.00, 7.71 [06:41:58] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 6.58, 7.43, 7.56 [06:43:22] PROBLEM - mw141 HTTPS on mw141 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10002 milliseconds with 0 bytes received [06:43:34] PROBLEM - mw143 HTTPS on mw143 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10003 milliseconds with 0 bytes received [06:45:22] PROBLEM - mw141 HTTPS on mw141 is WARNING: HTTP WARNING: HTTP/2 404 - 285 bytes in 0.580 second response time [06:45:29] PROBLEM - mw143 HTTPS on mw143 is WARNING: HTTP WARNING: HTTP/2 404 - 285 bytes in 0.607 second response time [06:46:37] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 8.05, 7.89, 7.72 [06:47:27] RECOVERY - www.deadprem.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'deadprem.wiki' will expire on Wed 31 Jan 2024 12:16:06 PM GMT +0000. [06:48:32] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 7.29, 7.83, 7.73 [06:51:57] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 5.92, 7.31, 7.06 [06:54:22] PROBLEM - cloud11 Puppet on cloud11 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[ulogd2] [06:59:36] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.65, 6.43, 6.75 [07:01:38] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 8.97, 7.69, 7.42 [07:02:14] RECOVERY - db182 Puppet on db182 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [07:03:37] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 7.92, 7.52, 7.38 [07:07:49] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 8.42, 7.75, 7.51 [07:09:44] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 7.25, 7.63, 7.50 [07:13:37] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 9.31, 8.03, 7.49 [07:18:58] PROBLEM - www.deadprem.wiki - LetsEncrypt on sslhost is CRITICAL: connect to address www.deadprem.wiki and port 443: Network is unreachableHTTP CRITICAL - Unable to open TCP socket [07:20:40] RECOVERY - cloud11 Puppet on cloud11 is OK: OK: Puppet is currently enabled, last run 49 seconds ago with 0 failures [07:21:37] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 7.50, 7.78, 7.69 [07:22:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.60, 7.12, 6.80 [07:25:26] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 8.02, 7.56, 7.29 [07:27:26] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 7.49, 7.49, 7.29 [07:27:37] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 8.42, 7.70, 7.65 [07:29:37] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 5.92, 7.24, 7.50 [07:31:38] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 10.56, 8.01, 7.72 [07:33:23] PROBLEM - db181 Puppet on db181 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): File[/etc/apt/keyrings/mariadb_release_signing_key.pgp] [07:33:27] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 8.07, 7.35, 7.24 [07:33:37] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 7.86, 7.81, 7.68 [07:34:49] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.08, 6.39, 6.69 [07:41:37] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 9.00, 8.53, 7.99 [07:43:37] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 6.39, 7.78, 7.78 [07:45:26] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 7.48, 7.96, 7.86 [07:45:37] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 8.87, 7.87, 7.79 [07:45:39] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.16, 6.93, 6.83 [07:46:54] !log [salt-user@mwtask141] Renamed wellreadwiki to wellredwiki using renamewiki.py [07:46:59] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:47:34] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.36, 6.41, 6.65 [07:47:37] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 7.06, 7.66, 7.73 [07:55:27] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 8.15, 7.39, 7.48 [07:57:25] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 7.15, 7.21, 7.40 [07:58:06] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.81, 7.86, 7.26 [08:00:01] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.13, 7.13, 7.06 [08:01:10] PROBLEM - ping6 on cloud10 is CRITICAL: PING CRITICAL - Packet loss = 50%, RTA = 128.72 ms [08:01:23] RECOVERY - db181 Puppet on db181 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [08:01:37] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 8.91, 7.64, 7.50 [08:03:08] PROBLEM - ping6 on cloud10 is WARNING: PING WARNING - Packet loss = 0%, RTA = 128.80 ms [08:03:25] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 8.15, 7.47, 7.41 [08:03:28] PROBLEM - db182 Puppet on db182 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): File[/etc/apt/keyrings/mariadb_release_signing_key.pgp] [08:05:37] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 6.89, 7.64, 7.58 [08:05:45] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 4.44, 6.11, 6.73 [08:09:36] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.98, 7.37, 7.09 [08:13:26] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.84, 7.91, 7.42 [08:13:38] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 8.93, 7.81, 7.60 [08:17:16] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.50, 7.75, 7.42 [08:19:26] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 6.61, 7.57, 7.77 [08:19:37] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 6.12, 7.58, 7.65 [08:21:06] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.04, 7.50, 7.40 [08:23:38] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 8.31, 7.40, 7.52 [08:25:38] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 7.94, 7.33, 7.46 [08:31:28] RECOVERY - db182 Puppet on db182 is OK: OK: Puppet is currently enabled, last run 51 seconds ago with 0 failures [08:31:37] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 8.02, 7.44, 7.42 [08:35:26] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 8.24, 7.32, 7.31 [08:35:37] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 7.18, 7.67, 7.55 [08:38:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.81, 7.62, 7.20 [08:39:08] RECOVERY - deadprem.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'deadprem.wiki' will expire on Wed 31 Jan 2024 12:16:06 PM GMT +0000. [08:39:59] PROBLEM - mw141 HTTPS on mw141 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10003 milliseconds with 0 bytes received [08:41:55] PROBLEM - mw141 HTTPS on mw141 is WARNING: HTTP WARNING: HTTP/2 404 - 285 bytes in 0.672 second response time [08:42:16] PROBLEM - mw141 Current Load on mw141 is CRITICAL: LOAD CRITICAL - total load average: 12.36, 9.74, 6.82 [08:42:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.72, 7.34, 7.18 [08:43:25] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 5.34, 7.54, 7.70 [08:44:15] RECOVERY - mw141 Current Load on mw141 is OK: LOAD OK - total load average: 6.91, 8.69, 6.79 [08:45:38] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 9.89, 8.07, 7.71 [08:47:37] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 5.56, 7.23, 7.46 [08:51:26] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 8.19, 7.33, 7.41 [08:51:59] PROBLEM - mw141 HTTPS on mw141 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10003 milliseconds with 0 bytes received [08:53:55] PROBLEM - mw141 HTTPS on mw141 is WARNING: HTTP WARNING: HTTP/2 404 - 285 bytes in 0.601 second response time [08:55:38] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 8.05, 7.43, 7.43 [08:57:26] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 7.13, 7.51, 7.52 [08:57:37] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 6.93, 7.31, 7.39 [08:58:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.23, 7.28, 7.06 [09:01:26] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 8.34, 8.00, 7.70 [09:01:37] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 10.05, 8.48, 7.81 [09:02:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.14, 7.29, 7.16 [09:03:26] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 6.16, 7.28, 7.47 [09:03:28] PROBLEM - db182 Puppet on db182 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): File[/etc/apt/keyrings/mariadb_release_signing_key.pgp] [09:05:37] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 6.58, 7.60, 7.61 [09:07:26] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 10.48, 8.57, 7.89 [09:10:15] PROBLEM - deadprem.wiki - LetsEncrypt on sslhost is CRITICAL: connect to address deadprem.wiki and port 443: Network is unreachableHTTP CRITICAL - Unable to open TCP socket [09:11:26] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 7.22, 7.97, 7.83 [09:12:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.27, 7.19, 7.10 [09:13:37] PROBLEM - mw142 HTTPS on mw142 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10000 milliseconds with 0 bytes received [09:13:59] PROBLEM - mw141 HTTPS on mw141 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10003 milliseconds with 0 bytes received [09:14:22] PROBLEM - mw143 HTTPS on mw143 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10003 milliseconds with 0 bytes received [09:14:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.07, 6.72, 6.94 [09:15:28] PROBLEM - mw142 Current Load on mw142 is WARNING: LOAD WARNING - total load average: 10.70, 9.15, 6.64 [09:15:28] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 10.55, 8.26, 7.91 [09:15:35] PROBLEM - mw142 HTTPS on mw142 is WARNING: HTTP WARNING: HTTP/2 404 - 285 bytes in 0.534 second response time [09:15:37] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 8.32, 7.23, 7.28 [09:15:55] PROBLEM - mw141 HTTPS on mw141 is WARNING: HTTP WARNING: HTTP/2 404 - 285 bytes in 0.514 second response time [09:16:17] PROBLEM - mw143 HTTPS on mw143 is WARNING: HTTP WARNING: HTTP/2 404 - 285 bytes in 0.537 second response time [09:17:28] RECOVERY - mw142 Current Load on mw142 is OK: LOAD OK - total load average: 4.59, 7.36, 6.29 [09:17:37] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 7.68, 7.37, 7.32 [09:18:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.86, 7.47, 7.18 [09:19:26] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 7.60, 7.85, 7.83 [09:19:38] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 8.02, 7.42, 7.33 [09:20:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.43, 7.13, 7.10 [09:23:37] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 7.76, 7.41, 7.34 [09:27:26] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 8.59, 7.20, 7.41 [09:29:26] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 7.87, 7.49, 7.49 [09:31:28] RECOVERY - db182 Puppet on db182 is OK: OK: Puppet is currently enabled, last run 27 seconds ago with 0 failures [09:32:50] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.79, 6.34, 6.77 [09:33:26] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 8.08, 7.60, 7.52 [09:35:37] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 9.45, 8.33, 7.62 [09:36:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.38, 7.65, 7.21 [09:37:37] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 7.13, 7.87, 7.53 [09:38:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.69, 7.32, 7.15 [09:43:26] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 5.56, 7.65, 7.99 [09:44:49] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.21, 6.25, 6.72 [09:47:38] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 8.08, 6.93, 7.12 [09:49:37] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 7.80, 7.10, 7.15 [09:50:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.09, 6.67, 6.73 [09:52:49] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.22, 6.11, 6.52 [09:53:38] RECOVERY - swiftobject101 Current Load on swiftobject101 is OK: OK - load average: 5.86, 6.25, 6.79 [09:57:37] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 7.12, 7.02, 7.01 [10:03:26] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 8.69, 7.24, 7.27 [10:03:37] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 10.73, 7.63, 7.13 [10:03:59] PROBLEM - mw141 HTTPS on mw141 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10003 milliseconds with 0 bytes received [10:04:21] PROBLEM - cp24 HTTPS on cp24 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10002 milliseconds with 0 bytes received [10:04:22] PROBLEM - mw143 HTTPS on mw143 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10000 milliseconds with 0 bytes received [10:05:37] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 7.78, 7.52, 7.15 [10:05:38] PROBLEM - mw142 HTTPS on mw142 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Connection timed out after 10002 milliseconds [10:05:55] PROBLEM - mw141 HTTPS on mw141 is WARNING: HTTP WARNING: HTTP/2 404 - 285 bytes in 0.602 second response time [10:06:13] PROBLEM - mw143 Current Load on mw143 is CRITICAL: LOAD CRITICAL - total load average: 15.79, 10.55, 6.79 [10:06:23] PROBLEM - mw141 MediaWiki Rendering on mw141 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:06:26] PROBLEM - mw143 HTTPS on mw143 is WARNING: HTTP WARNING: HTTP/2 404 - 285 bytes in 9.652 second response time [10:06:27] PROBLEM - mw141 Current Load on mw141 is CRITICAL: LOAD CRITICAL - total load average: 20.03, 12.65, 7.90 [10:06:31] PROBLEM - cp34 Varnish Backends on cp34 is CRITICAL: 2 backends are down. mw141 mw142 [10:06:54] PROBLEM - cp25 Varnish Backends on cp25 is CRITICAL: 2 backends are down. mw141 mw142 [10:07:19] PROBLEM - cp35 Varnish Backends on cp35 is CRITICAL: 2 backends are down. mw141 mw142 [10:07:24] PROBLEM - mw142 Current Load on mw142 is CRITICAL: LOAD CRITICAL - total load average: 14.18, 11.48, 7.51 [10:07:35] PROBLEM - mw142 HTTPS on mw142 is WARNING: HTTP WARNING: HTTP/2 404 - 285 bytes in 0.493 second response time [10:08:13] PROBLEM - mw143 Current Load on mw143 is WARNING: LOAD WARNING - total load average: 9.26, 11.09, 7.53 [10:08:23] PROBLEM - mw141 Current Load on mw141 is WARNING: LOAD WARNING - total load average: 9.20, 11.49, 8.08 [10:08:23] RECOVERY - mw141 MediaWiki Rendering on mw141 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 1.043 second response time [10:08:28] PROBLEM - cp24 HTTPS on cp24 is WARNING: HTTP WARNING: HTTP/2 404 - 3458 bytes in 0.589 second response time [10:08:31] RECOVERY - cp34 Varnish Backends on cp34 is OK: All 17 backends are healthy [10:08:52] RECOVERY - cp25 Varnish Backends on cp25 is OK: All 17 backends are healthy [10:09:19] RECOVERY - cp35 Varnish Backends on cp35 is OK: All 17 backends are healthy [10:09:24] RECOVERY - mw142 Current Load on mw142 is OK: LOAD OK - total load average: 5.99, 9.24, 7.17 [10:10:13] RECOVERY - mw143 Current Load on mw143 is OK: LOAD OK - total load average: 4.16, 8.53, 7.02 [10:10:20] RECOVERY - mw141 Current Load on mw141 is OK: LOAD OK - total load average: 3.35, 8.64, 7.43 [10:11:26] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 7.06, 7.80, 7.62 [10:15:37] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 9.26, 7.45, 7.12 [10:17:37] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 7.03, 7.13, 7.04 [10:19:37] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 8.12, 7.47, 7.17 [10:20:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.42, 7.37, 6.74 [10:21:26] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 8.19, 7.21, 7.31 [10:22:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 5.60, 6.92, 6.66 [10:23:26] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 7.29, 7.18, 7.29 [10:23:37] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 5.30, 7.07, 7.14 [10:24:49] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.39, 6.52, 6.55 [10:27:25] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 8.23, 7.44, 7.34 [10:29:26] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 6.94, 7.26, 7.29 [10:33:23] PROBLEM - db181 Puppet on db181 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): File[/etc/apt/keyrings/mariadb_release_signing_key.pgp] [10:35:26] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 8.31, 7.28, 7.22 [10:37:28] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 7.23, 7.45, 7.31 [10:40:16] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.56, 6.84, 6.56 [10:44:06] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 6.24, 6.77, 6.62 [10:44:08] PROBLEM - cp34 HTTPS on cp34 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10004 milliseconds with 0 bytes received [10:45:26] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 8.18, 7.61, 7.43 [10:45:37] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 8.20, 7.37, 7.08 [10:46:07] PROBLEM - cp34 HTTPS on cp34 is WARNING: HTTP WARNING: HTTP/2 404 - 3458 bytes in 0.610 second response time [10:47:37] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 7.33, 7.32, 7.09 [10:51:25] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 7.55, 7.90, 7.65 [11:01:23] RECOVERY - db181 Puppet on db181 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [11:01:37] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 8.42, 7.73, 7.30 [11:03:28] PROBLEM - db182 Puppet on db182 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): File[/etc/apt/keyrings/mariadb_release_signing_key.pgp] [11:03:37] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 7.84, 7.62, 7.30 [11:05:27] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 8.74, 7.81, 7.56 [11:05:37] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 9.35, 8.04, 7.48 [11:07:37] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 6.65, 7.54, 7.37 [11:09:37] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 9.10, 7.92, 7.51 [11:11:37] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 6.86, 7.51, 7.41 [11:13:25] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 5.77, 7.32, 7.61 [11:17:27] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 8.41, 7.15, 7.39 [11:19:25] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 6.99, 7.11, 7.35 [11:25:26] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 8.81, 7.80, 7.52 [11:25:37] PROBLEM - mw142 HTTPS on mw142 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10002 milliseconds with 0 bytes received [11:27:35] PROBLEM - mw142 HTTPS on mw142 is WARNING: HTTP WARNING: HTTP/2 404 - 285 bytes in 0.551 second response time [11:27:38] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 8.81, 7.72, 7.28 [11:28:26] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.90, 7.18, 6.50 [11:29:16] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 7.49, 6.69, 5.80 [11:30:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.61, 7.32, 6.63 [11:31:16] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 8.04, 7.04, 6.03 [11:31:28] RECOVERY - db182 Puppet on db182 is OK: OK: Puppet is currently enabled, last run 25 seconds ago with 0 failures [11:33:17] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 7.59, 7.32, 6.26 [11:33:59] PROBLEM - mw141 HTTPS on mw141 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10001 milliseconds with 0 bytes received [11:34:11] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.99, 7.88, 6.99 [11:35:55] PROBLEM - mw141 HTTPS on mw141 is WARNING: HTTP WARNING: HTTP/2 404 - 285 bytes in 0.504 second response time [11:37:16] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 8.52, 7.56, 6.57 [11:39:16] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 7.35, 7.52, 6.68 [11:49:17] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 9.85, 7.98, 7.19 [11:51:53] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 7.16, 7.57, 6.90 [11:55:16] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 5.69, 7.28, 7.24 [12:05:26] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 6.28, 6.59, 6.72 [12:09:16] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 6.42, 6.34, 6.77 [12:12:21] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 6.69, 6.88, 6.83 [12:14:20] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 8.30, 7.27, 6.97 [12:15:16] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 7.83, 6.84, 6.81 [12:16:20] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 7.22, 7.25, 7.00 [12:17:35] [02miraheze/MatomoAnalytics] 07translatewiki pushed 031 commit to 03master [+1/-0/±0] 13https://github.com/miraheze/MatomoAnalytics/compare/a0d1b69d24ab...00dfeb47902e [12:17:38] [02miraheze/MatomoAnalytics] 07translatewiki 0300dfeb4 - Localisation updates from https://translatewiki.net. [12:17:41] [02miraheze/landing] 07translatewiki pushed 031 commit to 03master [+0/-0/±5] 13https://github.com/miraheze/landing/compare/f1ea50827904...765f3efd8b63 [12:17:44] [02miraheze/landing] 07translatewiki 03765f3ef - Localisation updates from https://translatewiki.net. [12:17:47] [02miraheze/CreateWiki] 07translatewiki pushed 031 commit to 03master [+0/-0/±30] 13https://github.com/miraheze/CreateWiki/compare/e1e216f1a2e0...18a4f41572cf [12:17:50] [02miraheze/CreateWiki] 07translatewiki 0318a4f41 - Localisation updates from https://translatewiki.net. [12:17:51] [02miraheze/MirahezeMagic] 07translatewiki pushed 031 commit to 03master [+0/-0/±2] 13https://github.com/miraheze/MirahezeMagic/compare/6ade774e0603...21cae2bf59e2 [12:17:53] [02miraheze/MirahezeMagic] 07translatewiki 0321cae2b - Localisation updates from https://translatewiki.net. [12:17:55] [02miraheze/ManageWiki] 07translatewiki pushed 031 commit to 03master [+0/-0/±40] 13https://github.com/miraheze/ManageWiki/compare/cfff73cfca5c...b2124177227b [12:17:57] [02miraheze/ManageWiki] 07translatewiki 03b212417 - Localisation updates from https://translatewiki.net. [12:18:00] [02miraheze/RottenLinks] 07translatewiki pushed 031 commit to 03master [+0/-0/±22] 13https://github.com/miraheze/RottenLinks/compare/07283174091e...6eac535e79e1 [12:18:02] [02miraheze/RottenLinks] 07translatewiki 036eac535 - Localisation updates from https://translatewiki.net. [12:18:31] miraheze/landing - translatewiki the build passed. [12:22:47] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/1.40/maintenance/run.php /srv/mediawiki/1.40/extensions/SemanticMediaWiki/maintenance/setupStore.php --wiki=esnarutowiki (END - exit=0) [12:22:53] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:23:08] miraheze/MatomoAnalytics - translatewiki the build passed. [12:23:10] miraheze/RottenLinks - translatewiki the build passed. [12:23:19] miraheze/ManageWiki - translatewiki the build passed. [12:25:16] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 5.27, 6.21, 6.62 [12:26:20] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 5.44, 6.38, 6.73 [12:26:26] miraheze/MirahezeMagic - translatewiki the build passed. [12:27:08] !log [@test131] starting deploy of {'folders': '1.41/extensions/MirahezeMagic', 'versions': ['']} to [test131] [12:27:09] !log [@test131] finished deploy of {'folders': '1.41/extensions/MirahezeMagic', 'versions': ['']} to [test131] - SUCCESS in 0s [12:27:13] miraheze/CreateWiki - translatewiki the build passed. [12:27:14] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:27:22] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:29:16] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 7.95, 6.82, 6.76 [12:30:35] RECOVERY - wiki.conworlds.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.conworlds.org' will expire on Fri 01 Mar 2024 12:20:08 PM GMT +0000. [12:30:55] PROBLEM - wiki.conworlds.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.conworlds.org All nameservers failed to answer the query. [12:31:16] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 6.60, 6.77, 6.75 [12:32:59] !log [@mwtask181] starting deploy of {'folders': '1.40/extensions/MirahezeMagic', 'versions': ['']} to [mw131, mw132, mw133, mw134, mw141, mw142, mw143, mw181, mw182, mwtask181] [12:33:05] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:33:28] PROBLEM - db182 Puppet on db182 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): File[/etc/apt/keyrings/mariadb_release_signing_key.pgp] [12:33:38] !log [@mwtask181] finished deploy of {'folders': '1.40/extensions/MirahezeMagic', 'versions': ['']} to [mw131, mw132, mw133, mw134, mw141, mw142, mw143, mw181, mw182, mwtask181] - SUCCESS in 39s [12:33:44] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:43:16] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 6.95, 6.46, 6.55 [12:43:37] PROBLEM - mw142 HTTPS on mw142 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10003 milliseconds with 0 bytes received [12:45:16] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 6.56, 6.47, 6.54 [12:45:35] PROBLEM - mw142 HTTPS on mw142 is WARNING: HTTP WARNING: HTTP/2 404 - 285 bytes in 0.542 second response time [12:51:16] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 6.95, 7.04, 6.78 [12:53:16] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 5.27, 6.50, 6.62 [12:59:16] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 7.38, 6.78, 6.66 [13:01:28] RECOVERY - db182 Puppet on db182 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [13:03:16] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 9.49, 7.71, 7.02 [13:03:23] PROBLEM - db181 Puppet on db181 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 4 minutes ago with 1 failures. Failed resources (up to 3 shown): File[/etc/apt/keyrings/mariadb_release_signing_key.pgp] [13:05:16] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 7.49, 7.35, 6.96 [13:07:50] PROBLEM - wiki.aetherexplorers.science - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.aetherexplorers.science' expires in 15 day(s) (Sat 27 Jan 2024 12:43:42 PM GMT +0000). [13:08:05] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/925cb18257cc...ae8644e8866a [13:08:08] [02miraheze/ssl] 07MirahezeSSLBot 03ae8644e - Bot: Update SSL cert for wiki.aetherexplorers.science [13:08:57] miraheze/ssl - MirahezeSSLBot the build has errored. [13:09:16] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 5.90, 6.63, 6.76 [13:15:16] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 6.66, 6.89, 6.85 [13:16:58] RECOVERY - www.deadprem.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'deadprem.wiki' will expire on Wed 31 Jan 2024 12:16:06 PM GMT +0000. [13:18:02] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 7.69, 6.63, 6.17 [13:19:16] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 5.56, 6.46, 6.71 [13:20:01] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 6.51, 6.49, 6.17 [13:24:35] PROBLEM - talumn.neptune.wiki - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'talumn.neptune.wiki' expires in 15 day(s) (Sat 27 Jan 2024 01:14:10 PM GMT +0000). [13:30:34] PROBLEM - mw133 HTTPS on mw133 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Connection timed out after 10004 milliseconds [13:30:43] PROBLEM - cp35 HTTPS on cp35 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10004 milliseconds with 0 bytes received [13:31:23] RECOVERY - db181 Puppet on db181 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [13:32:34] PROBLEM - mw133 HTTPS on mw133 is WARNING: HTTP WARNING: HTTP/2 404 - 285 bytes in 0.520 second response time [13:34:46] PROBLEM - cp35 HTTPS on cp35 is WARNING: HTTP WARNING: HTTP/2 404 - 3458 bytes in 0.575 second response time [13:35:16] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 7.37, 6.95, 6.73 [13:37:28] RECOVERY - wiki.aetherexplorers.science - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.aetherexplorers.science' will expire on Wed 10 Apr 2024 12:07:55 PM GMT +0000. [13:43:16] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 5.88, 6.72, 6.80 [13:49:16] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 9.48, 7.44, 6.98 [13:53:16] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 6.77, 7.26, 7.04 [13:53:41] PROBLEM - txt-dex.com - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - txt-dex.com All nameservers failed to answer the query. [14:01:08] PROBLEM - swiftobject111 Puppet on swiftobject111 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [14:01:16] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 8.07, 7.29, 7.08 [14:02:43] PROBLEM - cp35 HTTPS on cp35 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10004 milliseconds with 0 bytes received [14:02:48] PROBLEM - cp25 HTTPS on cp25 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10003 milliseconds with 0 bytes received [14:04:40] PROBLEM - cp35 HTTPS on cp35 is WARNING: HTTP WARNING: HTTP/2 404 - 3458 bytes in 0.626 second response time [14:04:45] PROBLEM - cp25 HTTPS on cp25 is WARNING: HTTP WARNING: HTTP/2 404 - 3480 bytes in 0.568 second response time [14:06:33] PROBLEM - db121 Current Load on db121 is WARNING: WARNING - load average: 7.38, 7.72, 4.55 [14:06:46] RECOVERY - swiftobject111 Puppet on swiftobject111 is OK: OK: Puppet is currently enabled, last run 26 minutes ago with 0 failures [14:07:16] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 6.05, 7.43, 7.28 [14:08:48] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 7.13, 7.10, 6.46 [14:09:16] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 10.13, 8.39, 7.64 [14:12:33] RECOVERY - db121 Current Load on db121 is OK: OK - load average: 4.05, 5.85, 4.79 [14:13:16] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 7.18, 7.60, 7.49 [14:18:45] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 5.75, 6.66, 6.57 [14:23:15] PROBLEM - txt-dex.com - reverse DNS on sslhost is WARNING: LifetimeTimeout: The resolution lifetime expired after 5.404 seconds: Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out. [14:36:38] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 7.12, 6.29, 6.28 [14:39:16] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 5.70, 6.36, 6.75 [14:40:39] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 5.79, 6.09, 6.20 [14:48:00] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 6.89, 7.28, 6.22 [14:48:06] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 9.10, 7.39, 7.02 [14:48:58] PROBLEM - www.deadprem.wiki - LetsEncrypt on sslhost is CRITICAL: connect to address www.deadprem.wiki and port 443: Network is unreachableHTTP CRITICAL - Unable to open TCP socket [14:52:02] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 7.62, 7.78, 7.28 [14:52:41] PROBLEM - ping6 on cloud10 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 128.86 ms [14:53:48] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 8.06, 7.35, 6.58 [14:54:41] PROBLEM - ping6 on cloud10 is WARNING: PING WARNING - Packet loss = 0%, RTA = 128.72 ms [14:54:50] PROBLEM - mw132 Current Load on mw132 is WARNING: LOAD WARNING - total load average: 11.69, 10.15, 8.09 [14:54:53] PROBLEM - mw133 Current Load on mw133 is CRITICAL: LOAD CRITICAL - total load average: 14.06, 10.42, 7.82 [14:55:44] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 7.23, 7.20, 6.60 [14:56:04] PROBLEM - mw134 Current Load on mw134 is CRITICAL: LOAD CRITICAL - total load average: 12.44, 11.07, 8.94 [14:56:53] PROBLEM - mw133 Current Load on mw133 is WARNING: LOAD WARNING - total load average: 10.86, 10.27, 8.07 [14:58:32] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 7.14, 6.60, 6.37 [14:58:53] RECOVERY - mw133 Current Load on mw133 is OK: LOAD OK - total load average: 9.39, 9.87, 8.18 [14:59:01] PROBLEM - bast141 NTP time on bast141 is WARNING: NTP WARNING: Offset -0.1055094004 secs [15:00:04] PROBLEM - mw134 Current Load on mw134 is WARNING: LOAD WARNING - total load average: 9.35, 10.67, 9.29 [15:00:31] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 5.37, 5.97, 6.16 [15:02:04] RECOVERY - mw134 Current Load on mw134 is OK: LOAD OK - total load average: 8.19, 9.85, 9.16 [15:02:50] RECOVERY - mw132 Current Load on mw132 is OK: LOAD OK - total load average: 9.13, 10.10, 9.02 [15:03:28] PROBLEM - db182 Puppet on db182 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): File[/etc/apt/keyrings/mariadb_release_signing_key.pgp] [15:03:29] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 6.37, 6.73, 6.61 [15:03:48] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 8.31, 7.36, 7.23 [15:05:46] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 7.57, 7.29, 7.21 [15:13:01] RECOVERY - bast141 NTP time on bast141 is OK: NTP OK: Offset -0.09842029214 secs [15:16:20] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 7.77, 7.55, 7.01 [15:17:55] RECOVERY - www.deadprem.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'deadprem.wiki' will expire on Wed 31 Jan 2024 12:16:06 PM GMT +0000. [15:19:32] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 8.63, 7.77, 7.42 [15:22:20] PROBLEM - txt-dex.com - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - txt-dex.com All nameservers failed to answer the query. [15:23:27] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 5.26, 7.31, 7.39 [15:30:20] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 5.97, 6.47, 6.77 [15:31:28] RECOVERY - db182 Puppet on db182 is OK: OK: Puppet is currently enabled, last run 48 seconds ago with 0 failures [15:38:11] RECOVERY - deadprem.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'deadprem.wiki' will expire on Wed 31 Jan 2024 12:16:06 PM GMT +0000. [15:40:20] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 6.85, 6.72, 6.74 [15:42:21] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 6.29, 6.54, 6.67 [15:43:16] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 8.29, 7.69, 7.25 [15:46:21] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 8.94, 8.04, 7.28 [15:47:16] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 6.84, 7.44, 7.27 [15:48:58] PROBLEM - www.deadprem.wiki - LetsEncrypt on sslhost is CRITICAL: connect to address www.deadprem.wiki and port 443: Network is unreachableHTTP CRITICAL - Unable to open TCP socket [15:50:21] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 6.65, 7.28, 7.15 [15:51:48] PROBLEM - txt-dex.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for txt-dex.com could not be found [15:54:22] PROBLEM - swiftobject111 Puppet on swiftobject111 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [15:55:16] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 8.59, 7.44, 7.23 [15:57:00] RECOVERY - swiftobject111 Puppet on swiftobject111 is OK: OK: Puppet is currently enabled, last run 16 minutes ago with 0 failures [15:57:16] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 6.48, 6.99, 7.08 [16:03:34] [02miraheze/mw-config] 07OAuthority pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/e461263342ce...0da42410ac97 [16:03:35] [02miraheze/mw-config] 07OAuthority 030da4241 - add Screenplay to ManageWikiExtensions (T10902) [16:04:30] miraheze/mw-config - OAuthority the build has errored. [16:04:39] [02miraheze/mw-config] 07OAuthority pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/0da42410ac97...73c4477a039c [16:04:42] [02miraheze/mw-config] 07OAuthority 0373c4477 - fix [16:05:11] PROBLEM - mw133 Current Load on mw133 is CRITICAL: LOAD CRITICAL - total load average: 12.62, 9.83, 8.27 [16:05:42] miraheze/mw-config - OAuthority the build passed. [16:06:20] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 8.05, 7.12, 7.00 [16:07:09] RECOVERY - mw133 Current Load on mw133 is OK: LOAD OK - total load average: 9.57, 9.46, 8.31 [16:07:16] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 5.22, 6.21, 6.73 [16:08:02] !log [paladox@mwtask181] starting deploy of {'pull': 'config', 'config': True, 'versions': ['1.40']} to [mw131, mw132, mw133, mw134, mw141, mw142, mw143, mw181, mw182, mwtask181] [16:08:09] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:08:20] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 7.45, 7.08, 6.99 [16:08:51] !log [paladox@mwtask181] finished deploy of {'pull': 'config', 'config': True, 'versions': ['1.40']} to [mw131, mw132, mw133, mw134, mw141, mw142, mw143, mw181, mw182, mwtask181] - SUCCESS in 49s [16:08:57] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:09:34] [02miraheze/mw-config] 07OAuthority pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/73c4477a039c...a57050d7f6e7 [16:09:35] [02miraheze/mw-config] 07OAuthority 03a57050d - add $wgTranslateNumerals default config [16:10:21] PROBLEM - cp24 HTTPS on cp24 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10002 milliseconds with 0 bytes received [16:10:22] PROBLEM - mw143 HTTPS on mw143 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10003 milliseconds with 0 bytes received [16:10:36] miraheze/mw-config - OAuthority the build passed. [16:11:05] PROBLEM - mw133 Current Load on mw133 is WARNING: LOAD WARNING - total load average: 11.64, 10.83, 9.16 [16:11:16] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 8.05, 7.18, 7.03 [16:12:17] PROBLEM - mw143 HTTPS on mw143 is WARNING: HTTP WARNING: HTTP/2 404 - 285 bytes in 0.496 second response time [16:12:20] PROBLEM - cp24 HTTPS on cp24 is WARNING: HTTP WARNING: HTTP/2 404 - 3458 bytes in 0.680 second response time [16:12:20] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 8.12, 7.39, 7.11 [16:13:16] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 7.69, 7.17, 7.03 [16:14:20] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 7.58, 7.39, 7.14 [16:15:24] [02miraheze/mw-config] 07OAuthority pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/a57050d7f6e7...92e94fad7eea [16:15:25] [02miraheze/mw-config] 07OAuthority 0392e94fa - fix wgTranslateNumerals and make global [16:16:20] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 8.22, 7.58, 7.24 [16:16:22] miraheze/mw-config - OAuthority the build passed. [16:18:49] PROBLEM - mw134 Current Load on mw134 is WARNING: LOAD WARNING - total load average: 11.06, 10.23, 9.02 [16:18:59] RECOVERY - mw133 Current Load on mw133 is OK: LOAD OK - total load average: 8.47, 9.71, 9.37 [16:19:02] PROBLEM - mw132 Current Load on mw132 is WARNING: LOAD WARNING - total load average: 11.15, 10.19, 8.70 [16:19:12] PROBLEM - mw131 Current Load on mw131 is WARNING: LOAD WARNING - total load average: 10.79, 9.95, 8.64 [16:20:02] PROBLEM - os141 Current Load on os141 is CRITICAL: LOAD CRITICAL - total load average: 4.90, 3.36, 2.03 [16:21:12] PROBLEM - mw131 Current Load on mw131 is CRITICAL: LOAD CRITICAL - total load average: 12.60, 10.77, 9.10 [16:21:59] RECOVERY - os141 Current Load on os141 is OK: LOAD OK - total load average: 3.09, 3.19, 2.12 [16:22:21] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 5.78, 7.18, 7.28 [16:22:43] PROBLEM - cp35 HTTPS on cp35 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10003 milliseconds with 0 bytes received [16:22:44] RECOVERY - mw134 Current Load on mw134 is OK: LOAD OK - total load average: 6.82, 9.11, 8.87 [16:22:48] PROBLEM - cp25 HTTPS on cp25 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10002 milliseconds with 0 bytes received [16:22:53] RECOVERY - mw132 Current Load on mw132 is OK: LOAD OK - total load average: 6.01, 8.87, 8.55 [16:23:12] RECOVERY - mw131 Current Load on mw131 is OK: LOAD OK - total load average: 7.29, 9.62, 8.89 [16:23:37] PROBLEM - mw142 HTTPS on mw142 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10003 milliseconds with 0 bytes received [16:23:59] PROBLEM - mw141 HTTPS on mw141 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10003 milliseconds with 0 bytes received [16:24:40] PROBLEM - cp35 HTTPS on cp35 is WARNING: HTTP WARNING: HTTP/2 404 - 3458 bytes in 0.646 second response time [16:24:45] PROBLEM - cp25 HTTPS on cp25 is WARNING: HTTP WARNING: HTTP/2 404 - 3480 bytes in 0.623 second response time [16:24:51] !log [paladox@mwtask181] starting deploy of {'pull': 'config', 'config': True, 'versions': ['1.40']} to [mw131, mw132, mw133, mw134, mw141, mw142, mw143, mw181, mw182, mwtask181] [16:24:59] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:25:16] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 8.32, 7.37, 7.13 [16:25:35] PROBLEM - mw142 HTTPS on mw142 is WARNING: HTTP WARNING: HTTP/2 404 - 285 bytes in 0.690 second response time [16:25:38] RECOVERY - cloud11 IPMI Sensors on cloud11 is OK: IPMI Status: OK [16:25:48] PROBLEM - mw141 Current Load on mw141 is WARNING: LOAD WARNING - total load average: 9.18, 10.30, 8.47 [16:25:55] PROBLEM - mw141 HTTPS on mw141 is WARNING: HTTP WARNING: HTTP/2 404 - 285 bytes in 0.597 second response time [16:25:59] PROBLEM - os141 Current Load on os141 is CRITICAL: LOAD CRITICAL - total load average: 5.95, 4.61, 2.94 [16:26:45] !log [paladox@mwtask181] finished deploy of {'pull': 'config', 'config': True, 'versions': ['1.40']} to [mw131, mw132, mw133, mw134, mw141, mw142, mw143, mw181, mw182, mwtask181] - SUCCESS in 114s [16:26:51] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:27:16] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 7.51, 7.47, 7.20 [16:27:44] RECOVERY - mw141 Current Load on mw141 is OK: LOAD OK - total load average: 6.51, 9.18, 8.30 [16:27:53] !log [@test131] starting deploy of {'config': True, 'versions': ['']} to [test131] [16:27:54] !log [@test131] finished deploy of {'config': True, 'versions': ['']} to [test131] - SUCCESS in 0s [16:28:01] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:28:09] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:28:53] PROBLEM - mw133 Current Load on mw133 is WARNING: LOAD WARNING - total load average: 10.54, 9.74, 9.25 [16:29:12] PROBLEM - mw131 Current Load on mw131 is WARNING: LOAD WARNING - total load average: 11.85, 10.82, 9.58 [16:29:38] PROBLEM - cloud11 IPMI Sensors on cloud11 is CRITICAL: IPMI Status: Critical [Cntlr 2 Bay 8 = Critical] [16:29:58] PROBLEM - os141 Current Load on os141 is WARNING: LOAD WARNING - total load average: 2.72, 3.62, 2.93 [16:30:20] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 4.62, 5.81, 6.67 [16:30:33] PROBLEM - mw134 Current Load on mw134 is WARNING: LOAD WARNING - total load average: 11.51, 10.67, 9.62 [16:30:50] PROBLEM - mw132 Current Load on mw132 is WARNING: LOAD WARNING - total load average: 11.22, 10.54, 9.40 [16:30:53] PROBLEM - mw133 Current Load on mw133 is CRITICAL: LOAD CRITICAL - total load average: 13.32, 10.84, 9.69 [16:31:12] RECOVERY - mw131 Current Load on mw131 is OK: LOAD OK - total load average: 8.84, 9.95, 9.41 [16:31:57] RECOVERY - os141 Current Load on os141 is OK: LOAD OK - total load average: 2.08, 3.20, 2.87 [16:32:22] PROBLEM - cp24 HTTPS on cp24 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10003 milliseconds with 0 bytes received [16:32:30] PROBLEM - mw134 Current Load on mw134 is CRITICAL: LOAD CRITICAL - total load average: 12.17, 10.85, 9.79 [16:32:50] PROBLEM - mw132 Current Load on mw132 is CRITICAL: LOAD CRITICAL - total load average: 13.36, 11.00, 9.67 [16:34:22] PROBLEM - cp24 HTTPS on cp24 is WARNING: HTTP WARNING: HTTP/2 404 - 3480 bytes in 1.251 second response time [16:34:28] RECOVERY - mw134 Current Load on mw134 is OK: LOAD OK - total load average: 9.30, 10.08, 9.62 [16:34:50] RECOVERY - mw132 Current Load on mw132 is OK: LOAD OK - total load average: 9.00, 10.19, 9.54 [16:34:53] RECOVERY - mw133 Current Load on mw133 is OK: LOAD OK - total load average: 8.47, 10.16, 9.72 [16:38:50] PROBLEM - mw132 Current Load on mw132 is WARNING: LOAD WARNING - total load average: 8.89, 10.89, 10.12 [16:39:16] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 9.78, 7.90, 7.41 [16:39:37] PROBLEM - mw142 HTTPS on mw142 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10003 milliseconds with 0 bytes received [16:39:59] PROBLEM - mw141 HTTPS on mw141 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10003 milliseconds with 0 bytes received [16:40:18] PROBLEM - deadprem.wiki - LetsEncrypt on sslhost is CRITICAL: connect to address deadprem.wiki and port 443: Network is unreachableHTTP CRITICAL - Unable to open TCP socket [16:40:50] PROBLEM - mw132 Current Load on mw132 is CRITICAL: LOAD CRITICAL - total load average: 15.36, 11.98, 10.57 [16:41:35] PROBLEM - mw142 HTTPS on mw142 is WARNING: HTTP WARNING: HTTP/2 404 - 285 bytes in 0.659 second response time [16:41:55] PROBLEM - mw141 HTTPS on mw141 is WARNING: HTTP WARNING: HTTP/2 404 - 285 bytes in 0.586 second response time [16:42:16] PROBLEM - mw134 Current Load on mw134 is CRITICAL: LOAD CRITICAL - total load average: 12.12, 11.58, 10.39 [16:42:50] PROBLEM - mw132 Current Load on mw132 is WARNING: LOAD WARNING - total load average: 9.91, 11.45, 10.58 [16:42:53] PROBLEM - mw133 Current Load on mw133 is WARNING: LOAD WARNING - total load average: 9.30, 10.22, 9.91 [16:43:00] PROBLEM - os141 Current Load on os141 is WARNING: LOAD WARNING - total load average: 2.63, 3.48, 3.24 [16:43:12] PROBLEM - mw131 Current Load on mw131 is WARNING: LOAD WARNING - total load average: 9.84, 10.88, 9.97 [16:43:47] PROBLEM - wiki.gab.pt.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.gab.pt.eu.org All nameservers failed to answer the query. [16:44:14] PROBLEM - mw134 Current Load on mw134 is WARNING: LOAD WARNING - total load average: 10.98, 11.32, 10.43 [16:44:50] PROBLEM - mw132 Current Load on mw132 is CRITICAL: LOAD CRITICAL - total load average: 13.42, 12.16, 10.93 [16:44:53] PROBLEM - mw133 Current Load on mw133 is CRITICAL: LOAD CRITICAL - total load average: 14.34, 11.42, 10.36 [16:44:59] PROBLEM - os141 Current Load on os141 is CRITICAL: LOAD CRITICAL - total load average: 4.04, 3.74, 3.37 [16:45:16] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 7.78, 7.70, 7.48 [16:46:50] PROBLEM - mw132 Current Load on mw132 is WARNING: LOAD WARNING - total load average: 9.16, 10.82, 10.58 [16:46:54] PROBLEM - mw133 Current Load on mw133 is WARNING: LOAD WARNING - total load average: 10.27, 10.63, 10.19 [16:47:12] PROBLEM - mw131 Current Load on mw131 is CRITICAL: LOAD CRITICAL - total load average: 12.29, 10.78, 10.10 [16:48:09] RECOVERY - mw134 Current Load on mw134 is OK: LOAD OK - total load average: 6.56, 9.31, 9.86 [16:48:53] RECOVERY - mw133 Current Load on mw133 is OK: LOAD OK - total load average: 7.42, 9.97, 10.04 [16:48:59] PROBLEM - os141 Current Load on os141 is WARNING: LOAD WARNING - total load average: 3.05, 3.77, 3.50 [16:49:12] PROBLEM - mw131 Current Load on mw131 is WARNING: LOAD WARNING - total load average: 9.23, 10.39, 10.06 [16:50:20] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 7.70, 7.07, 6.74 [16:51:00] PROBLEM - os141 Current Load on os141 is CRITICAL: LOAD CRITICAL - total load average: 4.98, 4.05, 3.63 [16:51:16] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 8.95, 7.96, 7.61 [16:53:12] RECOVERY - mw131 Current Load on mw131 is OK: LOAD OK - total load average: 9.36, 9.94, 9.98 [16:53:16] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 7.16, 7.63, 7.54 [16:54:20] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 8.19, 7.25, 6.88 [16:54:50] PROBLEM - mw132 Current Load on mw132 is CRITICAL: LOAD CRITICAL - total load average: 13.85, 11.92, 11.05 [16:54:53] PROBLEM - mw133 Current Load on mw133 is CRITICAL: LOAD CRITICAL - total load average: 14.26, 11.01, 10.31 [16:56:04] PROBLEM - mw134 Current Load on mw134 is WARNING: LOAD WARNING - total load average: 11.16, 10.83, 10.23 [16:56:20] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 7.08, 6.95, 6.80 [16:56:50] PROBLEM - mw132 Current Load on mw132 is WARNING: LOAD WARNING - total load average: 8.83, 10.54, 10.64 [16:56:53] PROBLEM - mw133 Current Load on mw133 is WARNING: LOAD WARNING - total load average: 9.23, 10.30, 10.14 [16:58:53] RECOVERY - mw133 Current Load on mw133 is OK: LOAD OK - total load average: 7.13, 9.52, 9.90 [16:59:16] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 8.64, 7.67, 7.54 [17:00:04] RECOVERY - mw134 Current Load on mw134 is OK: LOAD OK - total load average: 8.93, 9.93, 10.02 [17:00:22] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 8.34, 7.41, 7.01 [17:00:50] RECOVERY - mw132 Current Load on mw132 is OK: LOAD OK - total load average: 8.59, 9.38, 10.15 [17:01:16] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 7.13, 7.43, 7.47 [17:02:20] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 6.80, 7.17, 6.98 [17:04:12] !log test131: install libsdl-pango-dev [17:04:20] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:06:34] PROBLEM - cp24 HTTPS on cp24 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10003 milliseconds with 0 bytes received [17:08:33] PROBLEM - cp24 HTTPS on cp24 is WARNING: HTTP WARNING: HTTP/2 404 - 3458 bytes in 0.742 second response time [17:09:04] PROBLEM - mw141 Current Load on mw141 is WARNING: LOAD WARNING - total load average: 9.61, 10.91, 8.66 [17:11:00] RECOVERY - mw141 Current Load on mw141 is OK: LOAD OK - total load average: 7.60, 9.75, 8.50 [17:13:16] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 8.56, 7.30, 7.22 [17:13:49] PROBLEM - wiki.gab.pt.eu.org - reverse DNS on sslhost is WARNING: SSL WARNING - rDNS OK but records conflict. {'NS': ['ns.ankh.fr.eu.org.', 'ns1.eu.org.', 'ns1.eriomem.net.'], 'CNAME': 'bouncingwiki.miraheze.org.'} [17:14:16] PROBLEM - test131 HTTPS on test131 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Connection timed out after 10001 milliseconds [17:14:21] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 8.70, 7.79, 7.31 [17:14:50] PROBLEM - mw132 Current Load on mw132 is WARNING: LOAD WARNING - total load average: 11.18, 10.23, 9.86 [17:14:50] PROBLEM - mw134 Current Load on mw134 is WARNING: LOAD WARNING - total load average: 11.31, 10.20, 9.80 [17:14:57] PROBLEM - mw133 Current Load on mw133 is WARNING: LOAD WARNING - total load average: 11.53, 10.31, 9.73 [17:15:16] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 7.81, 7.33, 7.23 [17:16:24] PROBLEM - test131 SSH on test131 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:16:33] PROBLEM - test131 MediaWiki Rendering on test131 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:16:58] RECOVERY - www.deadprem.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'deadprem.wiki' will expire on Wed 31 Jan 2024 12:16:06 PM GMT +0000. [17:17:16] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 8.38, 7.65, 7.35 [17:17:30] PROBLEM - test131 Current Load on test131 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [17:17:46] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 8.78, 7.20, 6.56 [17:18:21] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 5.16, 7.30, 7.29 [17:18:27] PROBLEM - test131 Redis Process on test131 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [17:18:37] PROBLEM - os141 Current Load on os141 is WARNING: LOAD WARNING - total load average: 0.55, 2.68, 3.92 [17:18:45] PROBLEM - mw134 Current Load on mw134 is CRITICAL: LOAD CRITICAL - total load average: 16.37, 12.61, 10.79 [17:18:50] PROBLEM - mw132 Current Load on mw132 is CRITICAL: LOAD CRITICAL - total load average: 14.28, 12.17, 10.74 [17:18:53] PROBLEM - test131 conntrack_table_size on test131 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [17:18:54] PROBLEM - mw133 Current Load on mw133 is CRITICAL: LOAD CRITICAL - total load average: 12.26, 10.91, 10.07 [17:19:12] PROBLEM - mw131 Current Load on mw131 is WARNING: LOAD WARNING - total load average: 10.65, 9.48, 8.94 [17:19:18] PROBLEM - test131 ferm_active on test131 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [17:19:22] PROBLEM - test131 php-fpm on test131 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [17:19:22] PROBLEM - test131 JobRunner Service on test131 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [17:19:22] PROBLEM - test131 poolcounter process on test131 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [17:19:46] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 7.79, 7.35, 6.69 [17:20:26] RECOVERY - test131 SSH on test131 is OK: SSH OK - OpenSSH_9.2p1 Debian-2+deb12u2 (protocol 2.0) [17:20:27] RECOVERY - test131 Redis Process on test131 is OK: PROCS OK: 1 process with args 'redis-server' [17:20:31] PROBLEM - test131 HTTPS on test131 is WARNING: HTTP WARNING: HTTP/2 404 - 285 bytes in 1.366 second response time [17:20:43] RECOVERY - test131 MediaWiki Rendering on test131 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 3.188 second response time [17:20:49] RECOVERY - test131 conntrack_table_size on test131 is OK: OK: nf_conntrack is 0 % full [17:20:50] PROBLEM - mw132 Current Load on mw132 is WARNING: LOAD WARNING - total load average: 11.48, 11.82, 10.79 [17:20:53] PROBLEM - mw133 Current Load on mw133 is WARNING: LOAD WARNING - total load average: 10.62, 10.79, 10.13 [17:21:12] RECOVERY - mw131 Current Load on mw131 is OK: LOAD OK - total load average: 8.08, 9.15, 8.90 [17:21:20] RECOVERY - test131 JobRunner Service on test131 is OK: PROCS OK: 1 process with args 'redisJobRunnerService' [17:21:20] RECOVERY - test131 poolcounter process on test131 is OK: PROCS OK: 1 process with UID = 998 (poolcounter), command name 'poolcounterd' [17:21:21] RECOVERY - test131 ferm_active on test131 is OK: OK ferm input default policy is set [17:21:21] RECOVERY - test131 php-fpm on test131 is OK: PROCS OK: 11 processes with command name 'php-fpm8.2' [17:22:31] RECOVERY - os141 Current Load on os141 is OK: LOAD OK - total load average: 0.54, 1.53, 3.17 [17:22:41] PROBLEM - mw134 Current Load on mw134 is WARNING: LOAD WARNING - total load average: 9.81, 11.48, 10.78 [17:22:53] RECOVERY - mw133 Current Load on mw133 is OK: LOAD OK - total load average: 7.71, 9.54, 9.75 [17:23:16] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 7.45, 7.76, 7.52 [17:23:45] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 5.54, 6.63, 6.57 [17:24:38] PROBLEM - mw134 Current Load on mw134 is CRITICAL: LOAD CRITICAL - total load average: 13.01, 12.02, 11.06 [17:26:32] [02miraheze/3d2png-deploy] 07paladox pushed 031 commit to 03master [+2414/-924/±85] 13https://github.com/miraheze/3d2png-deploy/compare/cee05f8c1f79...9719d56483a4 [17:26:34] [02miraheze/3d2png-deploy] 07paladox 039719d56 - Update 3d2png to support node 18 [17:26:36] PROBLEM - mw134 Current Load on mw134 is WARNING: LOAD WARNING - total load average: 9.76, 10.82, 10.71 [17:26:50] RECOVERY - mw132 Current Load on mw132 is OK: LOAD OK - total load average: 10.19, 9.73, 10.11 [17:29:16] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 8.09, 7.58, 7.47 [17:30:20] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 10.04, 7.65, 7.28 [17:32:21] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 6.57, 7.24, 7.18 [17:33:16] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 6.79, 7.50, 7.49 [17:34:21] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 8.09, 7.80, 7.40 [17:34:26] RECOVERY - mw134 Current Load on mw134 is OK: LOAD OK - total load average: 7.20, 8.71, 9.86 [17:36:20] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 7.48, 7.91, 7.51 [17:37:30] PROBLEM - swiftobject113 Puppet on swiftobject113 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [17:38:21] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 7.53, 8.08, 7.63 [17:39:17] PROBLEM - test131 Current Load on test131 is WARNING: LOAD WARNING - total load average: 0.16, 0.73, 3.99 [17:40:11] RECOVERY - swiftobject113 Puppet on swiftobject113 is OK: OK: Puppet is currently enabled, last run 23 minutes ago with 0 failures [17:40:21] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 7.43, 7.79, 7.58 [17:42:40] PROBLEM - cloud12 Puppet on cloud12 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[ulogd2] [17:43:14] RECOVERY - test131 Current Load on test131 is OK: LOAD OK - total load average: 0.19, 0.46, 3.14 [17:48:58] PROBLEM - www.deadprem.wiki - LetsEncrypt on sslhost is CRITICAL: connect to address www.deadprem.wiki and port 443: Network is unreachableHTTP CRITICAL - Unable to open TCP socket [17:49:16] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 5.34, 5.99, 6.73 [17:52:20] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 5.20, 5.87, 6.67 [17:57:38] RECOVERY - cloud11 IPMI Sensors on cloud11 is OK: IPMI Status: OK [18:01:23] PROBLEM - db181 Puppet on db181 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): File[/etc/apt/keyrings/mariadb_release_signing_key.pgp] [18:01:27] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 7.24, 7.10, 7.91 [18:01:38] PROBLEM - cloud11 IPMI Sensors on cloud11 is CRITICAL: IPMI Status: Critical [Cntlr 2 Bay 8 = Critical] [18:03:26] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 9.82, 8.07, 8.17 [18:10:39] RECOVERY - cloud12 Puppet on cloud12 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [18:11:51] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 6.97, 6.93, 6.62 [18:12:58] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 9.11, 7.37, 6.74 [18:15:47] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 5.88, 6.60, 6.58 [18:16:50] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 6.99, 7.69, 7.05 [18:18:22] PROBLEM - mw143 HTTPS on mw143 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10001 milliseconds with 0 bytes received [18:18:43] PROBLEM - cp35 HTTPS on cp35 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10003 milliseconds with 0 bytes received [18:19:56] PROBLEM - mw131 HTTPS on mw131 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10002 milliseconds with 0 bytes received [18:20:17] PROBLEM - mw143 HTTPS on mw143 is WARNING: HTTP WARNING: HTTP/2 404 - 285 bytes in 0.676 second response time [18:20:40] PROBLEM - cp35 HTTPS on cp35 is WARNING: HTTP WARNING: HTTP/2 404 - 3458 bytes in 0.884 second response time [18:21:52] PROBLEM - mw131 HTTPS on mw131 is WARNING: HTTP WARNING: HTTP/2 404 - 285 bytes in 0.642 second response time [18:22:39] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 4.26, 6.00, 6.55 [18:26:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.17, 6.87, 7.83 [18:30:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.36, 7.74, 7.96 [18:31:23] RECOVERY - db181 Puppet on db181 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [18:32:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.29, 7.30, 7.79 [18:34:04] PROBLEM - mw134 Current Load on mw134 is WARNING: LOAD WARNING - total load average: 10.46, 9.10, 8.23 [18:35:27] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 7.63, 7.40, 7.96 [18:37:27] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 10.06, 8.21, 8.18 [18:38:04] RECOVERY - mw134 Current Load on mw134 is OK: LOAD OK - total load average: 8.03, 8.88, 8.32 [18:40:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.56, 7.71, 7.77 [18:42:20] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 7.90, 6.49, 6.15 [18:42:40] PROBLEM - cloud12 Puppet on cloud12 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[ulogd2] [18:42:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.78, 7.43, 7.67 [18:46:20] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 8.08, 7.13, 6.46 [18:48:20] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 6.59, 6.73, 6.38 [18:48:50] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.34, 7.54, 7.57 [18:50:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.67, 7.43, 7.54 [18:55:25] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 5.53, 7.20, 7.82 [18:57:27] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 8.61, 7.72, 7.93 [18:59:25] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 6.79, 7.41, 7.79 [19:00:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.86, 7.57, 7.37 [19:01:26] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 8.01, 7.75, 7.87 [19:02:59] PROBLEM - mw134 HTTPS on mw134 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10002 milliseconds with 0 bytes received [19:03:37] PROBLEM - mw142 HTTPS on mw142 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10001 milliseconds with 0 bytes received [19:03:59] PROBLEM - mw141 HTTPS on mw141 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10003 milliseconds with 0 bytes received [19:04:04] PROBLEM - mw134 Current Load on mw134 is WARNING: LOAD WARNING - total load average: 11.35, 10.98, 9.03 [19:04:11] PROBLEM - mw131 Current Load on mw131 is CRITICAL: LOAD CRITICAL - total load average: 15.04, 11.68, 8.90 [19:04:25] PROBLEM - cp24 HTTPS on cp24 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10003 milliseconds with 0 bytes received [19:04:30] PROBLEM - mw142 Current Load on mw142 is CRITICAL: LOAD CRITICAL - total load average: 16.81, 11.36, 7.24 [19:04:46] PROBLEM - mw133 Current Load on mw133 is CRITICAL: LOAD CRITICAL - total load average: 15.05, 11.09, 8.66 [19:04:51] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.38, 7.31, 7.33 [19:04:51] PROBLEM - mw132 Current Load on mw132 is CRITICAL: LOAD CRITICAL - total load average: 16.50, 12.88, 9.58 [19:05:18] PROBLEM - swiftobject111 Puppet on swiftobject111 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [19:05:19] PROBLEM - cp35 Varnish Backends on cp35 is CRITICAL: 2 backends are down. mw133 mw134 [19:05:29] PROBLEM - mw133 HTTPS on mw133 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10003 milliseconds with 0 bytes received [19:05:41] PROBLEM - mw142 HTTPS on mw142 is WARNING: HTTP WARNING: HTTP/2 404 - 285 bytes in 6.030 second response time [19:05:59] PROBLEM - cp25 Varnish Backends on cp25 is CRITICAL: 1 backends are down. mw133 [19:05:59] PROBLEM - mw132 HTTPS on mw132 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10000 milliseconds with 0 bytes received [19:06:04] PROBLEM - mw134 Current Load on mw134 is CRITICAL: LOAD CRITICAL - total load average: 12.01, 12.44, 9.88 [19:06:10] PROBLEM - cp24 Varnish Backends on cp24 is CRITICAL: 1 backends are down. mw132 [19:06:13] PROBLEM - mw143 Current Load on mw143 is CRITICAL: LOAD CRITICAL - total load average: 21.89, 14.09, 8.29 [19:06:15] PROBLEM - mw141 Current Load on mw141 is CRITICAL: LOAD CRITICAL - total load average: 20.41, 13.95, 8.72 [19:06:30] PROBLEM - cp24 HTTPS on cp24 is WARNING: HTTP WARNING: HTTP/2 404 - 3458 bytes in 5.962 second response time [19:06:31] PROBLEM - cp34 Varnish Backends on cp34 is CRITICAL: 3 backends are down. mw132 mw141 mw142 [19:06:51] PROBLEM - cp25 HTTPS on cp25 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10001 milliseconds with 0 bytes received [19:08:02] PROBLEM - mw132 HTTPS on mw132 is WARNING: HTTP WARNING: HTTP/2 404 - 285 bytes in 8.085 second response time [19:08:03] RECOVERY - swiftobject111 Puppet on swiftobject111 is OK: OK: Puppet is currently enabled, last run 29 minutes ago with 0 failures [19:08:08] PROBLEM - mw141 HTTPS on mw141 is WARNING: HTTP WARNING: HTTP/2 404 - 285 bytes in 9.151 second response time [19:08:13] PROBLEM - wiki.andreijiroh.uk.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.andreijiroh.uk.eu.org All nameservers failed to answer the query. [19:08:18] PROBLEM - cp34 HTTPS on cp34 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10003 milliseconds with 0 bytes received [19:08:22] PROBLEM - mw143 HTTPS on mw143 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10001 milliseconds with 0 bytes received [19:08:31] RECOVERY - cp34 Varnish Backends on cp34 is OK: All 17 backends are healthy [19:09:37] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 5.38, 6.87, 7.76 [19:09:43] PROBLEM - mw133 HTTPS on mw133 is WARNING: HTTP WARNING: HTTP/2 404 - 285 bytes in 4.564 second response time [19:09:50] PROBLEM - mw142 HTTPS on mw142 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10003 milliseconds with 0 bytes received [19:10:13] PROBLEM - mw141 HTTPS on mw141 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10003 milliseconds with 0 bytes received [19:10:16] PROBLEM - cp34 HTTPS on cp34 is WARNING: HTTP WARNING: HTTP/2 404 - 3458 bytes in 0.684 second response time [19:10:39] RECOVERY - cloud12 Puppet on cloud12 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [19:10:45] PROBLEM - cp35 HTTPS on cp35 is CRITICAL: HTTP CRITICAL: HTTP/2 502 - 3370 bytes in 0.463 second response time [19:11:03] PROBLEM - cp25 HTTPS on cp25 is WARNING: HTTP WARNING: HTTP/2 404 - 3458 bytes in 9.707 second response time [19:11:18] PROBLEM - mw134 HTTPS on mw134 is WARNING: HTTP WARNING: HTTP/2 404 - 285 bytes in 9.967 second response time [19:11:56] PROBLEM - mw142 HTTPS on mw142 is WARNING: HTTP WARNING: HTTP/2 404 - 285 bytes in 8.965 second response time [19:12:20] PROBLEM - mw143 HTTPS on mw143 is WARNING: HTTP WARNING: HTTP/2 404 - 285 bytes in 0.545 second response time [19:12:24] PROBLEM - cp34 HTTPS on cp34 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10004 milliseconds with 0 bytes received [19:12:31] PROBLEM - cp34 Varnish Backends on cp34 is CRITICAL: 4 backends are down. mw141 mw142 mw134 mw143 [19:12:43] PROBLEM - cp35 HTTPS on cp35 is WARNING: HTTP WARNING: HTTP/2 404 - 3458 bytes in 1.456 second response time [19:13:13] PROBLEM - mw134 HTTPS on mw134 is CRITICAL: HTTP CRITICAL: HTTP/2 502 - 170 bytes in 0.396 second response time [19:13:38] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 8.24, 7.41, 7.75 [19:13:47] PROBLEM - wiki.gab.pt.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.gab.pt.eu.org All nameservers failed to answer the query. [19:13:54] PROBLEM - mw142 HTTPS on mw142 is CRITICAL: HTTP CRITICAL: HTTP/2 502 - 170 bytes in 0.396 second response time [19:14:44] PROBLEM - cp24 HTTPS on cp24 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10003 milliseconds with 0 bytes received [19:14:49] PROBLEM - cp35 HTTPS on cp35 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10001 milliseconds with 0 bytes received [19:15:11] PROBLEM - cp25 HTTPS on cp25 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10005 milliseconds with 0 bytes received [19:15:26] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 5.53, 7.13, 7.72 [19:15:37] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 7.21, 7.29, 7.66 [19:15:46] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 7.38, 6.48, 6.04 [19:15:57] PROBLEM - mw142 HTTPS on mw142 is WARNING: HTTP WARNING: HTTP/2 404 - 285 bytes in 5.996 second response time [19:16:18] PROBLEM - mw141 HTTPS on mw141 is WARNING: HTTP WARNING: HTTP/2 404 - 285 bytes in 0.535 second response time [19:16:35] PROBLEM - cp34 HTTPS on cp34 is WARNING: HTTP WARNING: HTTP/2 404 - 3458 bytes in 4.958 second response time [19:16:45] PROBLEM - cp24 HTTPS on cp24 is WARNING: HTTP WARNING: HTTP/2 404 - 3458 bytes in 2.152 second response time [19:16:53] PROBLEM - cp35 HTTPS on cp35 is WARNING: HTTP WARNING: HTTP/2 404 - 3480 bytes in 7.786 second response time [19:17:16] PROBLEM - cp25 HTTPS on cp25 is WARNING: HTTP WARNING: HTTP/2 404 - 3458 bytes in 9.145 second response time [19:17:19] PROBLEM - mw134 HTTPS on mw134 is WARNING: HTTP WARNING: HTTP/2 404 - 285 bytes in 6.618 second response time [19:17:38] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 10.46, 7.96, 7.83 [19:17:42] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 6.44, 6.35, 6.04 [19:17:58] RECOVERY - cp25 Varnish Backends on cp25 is OK: All 17 backends are healthy [19:17:59] PROBLEM - mw132 HTTPS on mw132 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10002 milliseconds with 0 bytes received [19:18:23] PROBLEM - mw141 HTTPS on mw141 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10003 milliseconds with 0 bytes received [19:19:19] RECOVERY - cp35 Varnish Backends on cp35 is OK: All 17 backends are healthy [19:19:26] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 8.48, 7.86, 7.87 [19:19:38] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 7.04, 7.51, 7.68 [19:19:57] PROBLEM - mw133 HTTPS on mw133 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10001 milliseconds with 0 bytes received [19:19:57] PROBLEM - mw132 HTTPS on mw132 is WARNING: HTTP WARNING: HTTP/2 404 - 285 bytes in 3.481 second response time [19:20:07] PROBLEM - mw142 HTTPS on mw142 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10002 milliseconds with 0 bytes received [19:20:13] RECOVERY - cp24 Varnish Backends on cp24 is OK: All 17 backends are healthy [19:20:24] PROBLEM - mw141 HTTPS on mw141 is WARNING: HTTP WARNING: HTTP/2 404 - 285 bytes in 5.894 second response time [19:20:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.58, 7.57, 7.23 [19:21:21] PROBLEM - mw134 HTTPS on mw134 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10001 milliseconds with 0 bytes received [19:21:26] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 7.83, 7.87, 7.88 [19:21:59] PROBLEM - cp25 Varnish Backends on cp25 is CRITICAL: 4 backends are down. mw131 mw132 mw141 mw134 [19:22:03] PROBLEM - mw133 HTTPS on mw133 is WARNING: HTTP WARNING: HTTP/2 404 - 285 bytes in 6.633 second response time [19:22:12] PROBLEM - mw143 HTTPS on mw143 is CRITICAL: HTTP CRITICAL: HTTP/2 502 - 170 bytes in 0.394 second response time [19:22:57] PROBLEM - cp24 HTTPS on cp24 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10001 milliseconds with 0 bytes received [19:23:08] PROBLEM - cp35 HTTPS on cp35 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10004 milliseconds with 0 bytes received [19:23:16] PROBLEM - mw134 HTTPS on mw134 is WARNING: HTTP WARNING: HTTP/2 404 - 285 bytes in 0.531 second response time [19:23:19] PROBLEM - cp35 Varnish Backends on cp35 is CRITICAL: 3 backends are down. mw131 mw132 mw134 [19:23:22] PROBLEM - cp25 HTTPS on cp25 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10002 milliseconds with 0 bytes received [19:23:26] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 8.01, 8.02, 7.94 [19:24:13] PROBLEM - mw142 HTTPS on mw142 is WARNING: HTTP WARNING: HTTP/2 404 - 285 bytes in 1.870 second response time [19:24:14] PROBLEM - cp24 Varnish Backends on cp24 is CRITICAL: 3 backends are down. mw141 mw142 mw143 [19:24:19] PROBLEM - mw143 HTTPS on mw143 is WARNING: HTTP WARNING: HTTP/2 404 - 285 bytes in 6.786 second response time [19:24:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 5.56, 6.76, 7.00 [19:25:38] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 8.08, 7.46, 7.56 [19:27:20] PROBLEM - cp35 HTTPS on cp35 is WARNING: HTTP WARNING: HTTP/2 404 - 3458 bytes in 9.609 second response time [19:27:25] PROBLEM - cp25 HTTPS on cp25 is WARNING: HTTP WARNING: HTTP/2 404 - 3458 bytes in 0.595 second response time [19:27:37] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 7.68, 7.80, 7.70 [19:29:03] PROBLEM - cp34 HTTPS on cp34 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10004 milliseconds with 0 bytes received [19:29:13] PROBLEM - cp24 HTTPS on cp24 is WARNING: HTTP WARNING: HTTP/2 404 - 3458 bytes in 0.717 second response time [19:29:54] PROBLEM - mw131 HTTPS on mw131 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10002 milliseconds with 0 bytes received [19:29:59] PROBLEM - mw132 HTTPS on mw132 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10002 milliseconds with 0 bytes received [19:30:49] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.87, 6.35, 6.76 [19:31:01] PROBLEM - cp34 HTTPS on cp34 is WARNING: HTTP WARNING: HTTP/2 404 - 3458 bytes in 0.619 second response time [19:31:27] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 7.26, 7.90, 7.96 [19:31:28] PROBLEM - cp25 HTTPS on cp25 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10001 milliseconds with 0 bytes received [19:31:32] PROBLEM - cp35 HTTPS on cp35 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10003 milliseconds with 0 bytes received [19:31:37] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 11.15, 8.70, 8.02 [19:31:48] PROBLEM - mw134 MediaWiki Rendering on mw134 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:32:22] PROBLEM - mw143 HTTPS on mw143 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10003 milliseconds with 0 bytes received [19:32:32] PROBLEM - mw142 HTTPS on mw142 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10002 milliseconds with 0 bytes received [19:33:09] PROBLEM - cp34 HTTPS on cp34 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10004 milliseconds with 0 bytes received [19:33:18] PROBLEM - mw134 HTTPS on mw134 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10003 milliseconds with 0 bytes received [19:33:55] PROBLEM - mw131 HTTPS on mw131 is WARNING: HTTP WARNING: HTTP/2 404 - 285 bytes in 0.576 second response time [19:34:07] PROBLEM - mw132 HTTPS on mw132 is WARNING: HTTP WARNING: HTTP/2 404 - 285 bytes in 8.990 second response time [19:34:16] PROBLEM - mw141 HTTPS on mw141 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10000 milliseconds with 0 bytes received [19:35:14] PROBLEM - cp34 HTTPS on cp34 is WARNING: HTTP WARNING: HTTP/2 404 - 3458 bytes in 6.659 second response time [19:35:29] PROBLEM - cp24 HTTPS on cp24 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10002 milliseconds with 0 bytes received [19:35:52] RECOVERY - mw134 MediaWiki Rendering on mw134 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.986 second response time [19:36:12] PROBLEM - mw132 HTTPS on mw132 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10002 milliseconds with 0 bytes received [19:36:23] PROBLEM - mw143 HTTPS on mw143 is WARNING: HTTP WARNING: HTTP/2 404 - 285 bytes in 3.278 second response time [19:36:37] PROBLEM - mw142 HTTPS on mw142 is WARNING: HTTP WARNING: HTTP/2 404 - 285 bytes in 0.538 second response time [19:37:22] PROBLEM - cp34 HTTPS on cp34 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10002 milliseconds with 0 bytes received [19:37:26] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 9.51, 8.32, 8.05 [19:37:30] PROBLEM - cp24 HTTPS on cp24 is WARNING: HTTP WARNING: HTTP/2 404 - 3458 bytes in 2.321 second response time [19:37:42] PROBLEM - cp25 HTTPS on cp25 is WARNING: HTTP WARNING: HTTP/2 404 - 3458 bytes in 5.290 second response time [19:37:46] PROBLEM - cp35 HTTPS on cp35 is WARNING: HTTP WARNING: HTTP/2 404 - 3458 bytes in 5.005 second response time [19:38:12] RECOVERY - wiki.andreijiroh.uk.eu.org - reverse DNS on sslhost is OK: SSL OK - wiki.andreijiroh.uk.eu.org reverse DNS resolves to cp34.miraheze.org - CNAME OK [19:38:16] PROBLEM - mw132 HTTPS on mw132 is WARNING: HTTP WARNING: HTTP/2 404 - 285 bytes in 9.407 second response time [19:38:31] RECOVERY - cp34 Varnish Backends on cp34 is OK: All 17 backends are healthy [19:38:44] PROBLEM - mw142 HTTPS on mw142 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10001 milliseconds with 0 bytes received [19:39:26] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 7.20, 7.98, 7.97 [19:39:37] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 7.00, 7.93, 7.96 [19:39:39] PROBLEM - cp24 HTTPS on cp24 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10002 milliseconds with 0 bytes received [19:39:54] PROBLEM - mw131 HTTPS on mw131 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10002 milliseconds with 0 bytes received [19:40:43] PROBLEM - mw142 HTTPS on mw142 is WARNING: HTTP WARNING: HTTP/2 404 - 285 bytes in 2.017 second response time [19:41:38] PROBLEM - cp34 HTTPS on cp34 is WARNING: HTTP WARNING: HTTP/2 404 - 3458 bytes in 9.538 second response time [19:41:39] PROBLEM - cp24 HTTPS on cp24 is WARNING: HTTP WARNING: HTTP/2 404 - 3458 bytes in 1.274 second response time [19:41:54] PROBLEM - mw131 HTTPS on mw131 is WARNING: HTTP WARNING: HTTP/2 404 - 285 bytes in 4.819 second response time [19:42:36] PROBLEM - mw133 HTTPS on mw133 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10003 milliseconds with 0 bytes received [19:43:39] PROBLEM - mw134 HTTPS on mw134 is WARNING: HTTP WARNING: HTTP/2 404 - 285 bytes in 6.303 second response time [19:43:46] PROBLEM - cp34 HTTPS on cp34 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10004 milliseconds with 0 bytes received [19:43:48] PROBLEM - wiki.gab.pt.eu.org - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query wiki.gab.pt.eu.org. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [19:43:59] PROBLEM - mw131 HTTPS on mw131 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10003 milliseconds with 0 bytes received [19:44:21] PROBLEM - mw132 HTTPS on mw132 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10003 milliseconds with 0 bytes received [19:44:34] PROBLEM - mw141 HTTPS on mw141 is WARNING: HTTP WARNING: HTTP/2 404 - 285 bytes in 3.130 second response time [19:44:40] PROBLEM - mw133 HTTPS on mw133 is WARNING: HTTP WARNING: HTTP/2 404 - 285 bytes in 4.427 second response time [19:44:53] PROBLEM - mw142 HTTPS on mw142 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10002 milliseconds with 0 bytes received [19:45:21] PROBLEM - cp34 Varnish Backends on cp34 is CRITICAL: 1 backends are down. mw142 [19:45:44] PROBLEM - mw134 HTTPS on mw134 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10003 milliseconds with 0 bytes received [19:45:47] PROBLEM - cp25 HTTPS on cp25 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10001 milliseconds with 0 bytes received [19:45:50] PROBLEM - cp34 HTTPS on cp34 is WARNING: HTTP WARNING: HTTP/2 404 - 3458 bytes in 6.084 second response time [19:46:20] PROBLEM - mw132 HTTPS on mw132 is WARNING: HTTP WARNING: HTTP/2 404 - 285 bytes in 3.983 second response time [19:46:29] PROBLEM - mw141 HTTPS on mw141 is CRITICAL: HTTP CRITICAL: HTTP/2 502 - 170 bytes in 0.396 second response time [19:46:46] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 6.96, 6.12, 5.73 [19:47:26] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 8.87, 7.72, 7.78 [19:47:44] PROBLEM - cp25 HTTPS on cp25 is WARNING: HTTP WARNING: HTTP/2 404 - 3458 bytes in 0.657 second response time [19:47:44] PROBLEM - mw134 HTTPS on mw134 is WARNING: HTTP WARNING: HTTP/2 404 - 285 bytes in 5.911 second response time [19:48:01] PROBLEM - mw131 HTTPS on mw131 is WARNING: HTTP WARNING: HTTP/2 404 - 285 bytes in 0.778 second response time [19:48:20] RECOVERY - cp24 Varnish Backends on cp24 is OK: All 17 backends are healthy [19:48:24] PROBLEM - mw141 HTTPS on mw141 is WARNING: HTTP WARNING: HTTP/2 404 - 285 bytes in 0.525 second response time [19:48:43] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 6.60, 6.07, 5.74 [19:48:58] PROBLEM - mw142 HTTPS on mw142 is WARNING: HTTP WARNING: HTTP/2 404 - 285 bytes in 0.644 second response time [19:49:11] RECOVERY - cp34 Varnish Backends on cp34 is OK: All 17 backends are healthy [19:49:19] RECOVERY - cp35 Varnish Backends on cp35 is OK: All 17 backends are healthy [19:49:37] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 8.85, 7.63, 7.65 [19:49:58] RECOVERY - cp25 Varnish Backends on cp25 is OK: All 17 backends are healthy [19:50:11] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.93, 6.38, 6.27 [19:52:05] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.73, 7.20, 6.58 [19:53:26] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 5.66, 7.52, 7.77 [19:55:38] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 7.06, 7.98, 7.87 [19:55:55] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.68, 7.37, 6.82 [19:56:13] PROBLEM - mw143 Current Load on mw143 is WARNING: LOAD WARNING - total load average: 3.28, 6.31, 11.64 [19:56:15] PROBLEM - mw141 Current Load on mw141 is WARNING: LOAD WARNING - total load average: 4.28, 6.77, 11.46 [19:56:24] PROBLEM - mw142 Current Load on mw142 is WARNING: LOAD WARNING - total load average: 5.81, 8.00, 11.97 [19:57:37] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 8.73, 8.22, 7.97 [19:58:09] PROBLEM - mw131 Current Load on mw131 is WARNING: LOAD WARNING - total load average: 4.87, 7.45, 11.40 [19:59:26] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 8.55, 7.50, 7.60 [19:59:44] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 11.94, 8.31, 7.25 [19:59:52] [02miraheze/.github] 07dependabot[bot] pushed 031 commit to 03dependabot/github_actions/actions/cache-3.3.3 [+0/-0/±1] 13https://github.com/miraheze/.github/commit/40fe2af40555 [19:59:55] [02miraheze/.github] 07dependabot[bot] 0340fe2af - Bump actions/cache from 3.3.2 to 3.3.3 [19:59:58] [02.github] 07dependabot[bot] created branch 03dependabot/github_actions/actions/cache-3.3.3 - 13https://github.com/miraheze/.github [19:59:59] [02.github] 07dependabot[bot] opened pull request 03#40: Bump actions/cache from 3.3.2 to 3.3.3 - 13https://github.com/miraheze/.github/pull/40 [20:00:01] [02.github] 07dependabot[bot] labeled pull request 03#40: Bump actions/cache from 3.3.2 to 3.3.3 - 13https://github.com/miraheze/.github/pull/40 [20:00:13] RECOVERY - mw143 Current Load on mw143 is OK: LOAD OK - total load average: 4.15, 5.02, 9.87 [20:00:15] RECOVERY - mw141 Current Load on mw141 is OK: LOAD OK - total load average: 5.92, 5.98, 10.03 [20:02:04] PROBLEM - mw134 Current Load on mw134 is WARNING: LOAD WARNING - total load average: 6.98, 8.04, 11.53 [20:03:28] PROBLEM - db182 Puppet on db182 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): File[/etc/apt/keyrings/mariadb_release_signing_key.pgp] [20:04:09] RECOVERY - mw131 Current Load on mw131 is OK: LOAD OK - total load average: 4.09, 6.92, 10.05 [20:04:23] RECOVERY - mw142 Current Load on mw142 is OK: LOAD OK - total load average: 6.41, 6.63, 9.72 [20:04:50] PROBLEM - mw132 Current Load on mw132 is WARNING: LOAD WARNING - total load average: 5.95, 8.02, 11.70 [20:05:29] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 5.73, 7.42, 7.31 [20:05:54] PROBLEM - mw133 Current Load on mw133 is WARNING: LOAD WARNING - total load average: 8.55, 9.05, 11.64 [20:08:04] RECOVERY - mw134 Current Load on mw134 is OK: LOAD OK - total load average: 6.14, 7.11, 9.99 [20:10:50] RECOVERY - mw132 Current Load on mw132 is OK: LOAD OK - total load average: 4.80, 6.08, 9.66 [20:11:49] RECOVERY - mw133 Current Load on mw133 is OK: LOAD OK - total load average: 5.59, 7.50, 10.19 [20:13:09] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.71, 7.87, 7.45 [20:15:03] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.61, 7.77, 7.47 [20:15:26] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 5.37, 6.92, 7.78 [20:16:22] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 7.67, 6.76, 6.27 [20:18:20] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 8.90, 7.24, 6.49 [20:18:53] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.54, 8.29, 7.70 [20:20:17] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 7.67, 7.10, 6.38 [20:20:20] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 6.18, 6.80, 6.42 [20:22:14] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 4.43, 6.26, 6.17 [20:27:25] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 5.27, 5.98, 6.76 [20:28:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.70, 7.73, 7.79 [20:31:28] RECOVERY - db182 Puppet on db182 is OK: OK: Puppet is currently enabled, last run 59 seconds ago with 0 failures [20:33:23] PROBLEM - db181 Puppet on db181 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): File[/etc/apt/keyrings/mariadb_release_signing_key.pgp] [20:37:08] PROBLEM - mw131 Current Load on mw131 is WARNING: LOAD WARNING - total load average: 10.27, 10.14, 8.63 [20:38:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.98, 7.06, 7.16 [20:41:08] RECOVERY - mw131 Current Load on mw131 is OK: LOAD OK - total load average: 8.37, 9.82, 8.89 [20:44:21] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 8.08, 6.74, 6.30 [20:48:20] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 6.96, 7.33, 6.69 [20:52:20] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 5.17, 6.37, 6.44 [20:52:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 5.93, 7.72, 7.95 [20:57:37] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 5.61, 7.20, 8.00 [20:59:23] RECOVERY - db181 Puppet on db181 is OK: OK: Puppet is currently enabled, last run 3 seconds ago with 0 failures [21:03:37] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 8.04, 7.56, 7.85 [21:05:37] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 7.13, 7.27, 7.70 [21:06:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 10.11, 7.59, 7.44 [21:07:37] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 8.57, 7.84, 7.86 [21:08:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.43, 7.38, 7.38 [21:18:20] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 6.72, 6.91, 6.49 [21:19:38] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 7.45, 7.84, 7.99 [21:20:20] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 6.17, 6.70, 6.46 [21:22:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.59, 7.59, 7.35 [21:23:37] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 11.05, 8.80, 8.29 [21:24:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.61, 7.86, 7.50 [21:24:54] [02mw-config] 07OAuthority closed pull request 03#5432: T11040: Create $wmgMirahezeContactPageFooter - 13https://github.com/miraheze/mw-config/pull/5432 [21:24:57] [02miraheze/mw-config] 07OAuthority pushed 031 commit to 03master [+0/-0/±3] 13https://github.com/miraheze/mw-config/compare/92e94fad7eea...c2f54f6ab4fc [21:24:59] [02miraheze/mw-config] 07redbluegreenhat 03c2f54f6 - T11040: Create $wmgMirahezeContactPageFooter (#5432) [21:25:52] miraheze/mw-config - OAuthority the build passed. [21:26:27] !log [@test131] starting deploy of {'config': True, 'versions': ['']} to [test131] [21:26:28] !log [@test131] finished deploy of {'config': True, 'versions': ['']} to [test131] - SUCCESS in 1s [21:26:33] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:26:39] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:27:37] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 5.61, 7.63, 7.97 [21:29:37] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 8.25, 7.70, 7.94 [21:30:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.81, 8.28, 7.70 [21:31:28] !log [@mwtask181] starting deploy of {'config': True, 'versions': ['']} to [mw131, mw132, mw133, mw134, mw141, mw142, mw143, mw181, mw182, mwtask181] [21:31:34] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:32:13] !log [@mwtask181] finished deploy of {'config': True, 'versions': ['']} to [mw131, mw132, mw133, mw134, mw141, mw142, mw143, mw181, mw182, mwtask181] - SUCCESS in 44s [21:32:19] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:34:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.86, 7.59, 7.56 [21:38:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.52, 7.83, 7.61 [21:40:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.03, 7.46, 7.50 [21:41:37] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 7.02, 7.49, 7.87 [21:44:59] !log [oa@puppet181] /root/ssl-certificate -d kinnikupedia.org -g -p -o [21:45:06] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:46:58] RECOVERY - www.deadprem.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'deadprem.wiki' will expire on Wed 31 Jan 2024 12:16:06 PM GMT +0000. [21:50:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.07, 7.56, 7.43 [21:53:37] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 8.11, 7.67, 7.67 [21:54:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.32, 7.08, 7.26 [21:55:37] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 5.81, 6.86, 7.37 [21:59:38] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 8.16, 7.28, 7.39 [22:02:49] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.35, 6.06, 6.73 [22:03:37] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 7.68, 7.81, 7.61 [22:05:37] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 8.24, 7.79, 7.61 [22:13:38] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 7.44, 7.61, 7.56 [22:17:38] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 8.92, 7.84, 7.62 [22:18:12] [02dns] 07OAuthority opened pull request 03#457: Add kinnikupedia.org (T11668) - 13https://github.com/miraheze/dns/pull/457 [22:18:51] [02dns] 07Universal-Omega closed pull request 03#457: Add kinnikupedia.org (T11668) - 13https://github.com/miraheze/dns/pull/457 [22:18:54] [02miraheze/dns] 07Universal-Omega pushed 031 commit to 03master [+1/-0/±0] 13https://github.com/miraheze/dns/compare/62967e0e0cb8...5b3f47f8a153 [22:18:55] [02miraheze/dns] 07OAuthority 035b3f47f - Add kinnikupedia.org (T11668) (#457) [22:18:58] PROBLEM - www.deadprem.wiki - LetsEncrypt on sslhost is CRITICAL: connect to address www.deadprem.wiki and port 443: Network is unreachableHTTP CRITICAL - Unable to open TCP socket [22:19:37] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 5.87, 7.21, 7.43 [22:23:03] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+1/-0/±1] 13https://github.com/miraheze/ssl/compare/ae8644e8866a...12ea1301f319 [22:23:04] [02miraheze/ssl] 07MirahezeSSLBot 0312ea130 - Bot: Add SSL cert for kinnikupedia.org [22:23:38] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 8.13, 7.62, 7.54 [22:23:55] miraheze/ssl - MirahezeSSLBot the build has errored. [22:24:38] [02miraheze/ssl] 07OAuthority pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/12ea1301f319...e83512cda280 [22:24:40] [02miraheze/ssl] 07OAuthority 03e83512c - remove duplicate key causing CI to fail [22:25:38] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 7.91, 7.74, 7.59 [22:27:37] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 8.31, 7.79, 7.62 [22:29:38] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 7.37, 7.46, 7.51 [22:31:37] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 9.19, 8.32, 7.83 [22:34:33] PROBLEM - mw142 Puppet on mw142 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[nginx] [22:36:22] PROBLEM - mwtask181 Puppet on mwtask181 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[nginx] [22:37:59] PROBLEM - os141 Current Load on os141 is WARNING: LOAD WARNING - total load average: 3.76, 3.02, 1.73 [22:38:05] PROBLEM - mw143 Puppet on mw143 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[nginx] [22:38:20] PROBLEM - mw134 Puppet on mw134 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[nginx] [22:38:44] PROBLEM - mw132 Puppet on mw132 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[nginx] [22:39:49] PROBLEM - mw141 Puppet on mw141 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[nginx] [22:39:57] RECOVERY - os141 Current Load on os141 is OK: LOAD OK - total load average: 3.08, 3.07, 1.91 [22:40:41] [02miraheze/puppet] 07Universal-Omega pushed 031 commit to 03ssl-yaml-duplicate [+0/-0/±1] 13https://github.com/miraheze/puppet/commit/57b36c473a6a [22:40:43] [02miraheze/puppet] 07Universal-Omega 0357b36c4 - ssl-certificate use pyyaml and check for duplicate keys [22:40:45] [02puppet] 07Universal-Omega created branch 03ssl-yaml-duplicate - 13https://github.com/miraheze/puppet [22:40:51] [02puppet] 07Universal-Omega opened pull request 03#3624: ssl-certificate use pyyaml and check for duplicate keys - 13https://github.com/miraheze/puppet/pull/3624 [22:41:23] PROBLEM - mwtask141 Puppet on mwtask141 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[nginx] [22:41:30] PROBLEM - cp24 Puppet on cp24 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[nginx] [22:42:21] miraheze/puppet - Universal-Omega the build has errored. [22:42:56] PROBLEM - cp35 Puppet on cp35 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[nginx] [22:43:13] [02puppet] 07Universal-Omega synchronize pull request 03#3624: ssl-certificate use pyyaml and check for duplicate keys - 13https://github.com/miraheze/puppet/pull/3624 [22:43:14] [02miraheze/puppet] 07Universal-Omega pushed 031 commit to 03ssl-yaml-duplicate [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/57b36c473a6a...cac2471d78e9 [22:43:16] [02miraheze/puppet] 07Universal-Omega 03cac2471 - Add comma [22:43:34] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.76, 7.19, 6.65 [22:44:05] PROBLEM - mw131 Puppet on mw131 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[nginx] [22:44:06] PROBLEM - os141 Current Load on os141 is CRITICAL: LOAD CRITICAL - total load average: 4.91, 3.77, 2.45 [22:44:27] miraheze/puppet - Universal-Omega the build has errored. [22:44:59] [02miraheze/puppet] 07Universal-Omega pushed 031 commit to 03ssl-yaml-duplicate [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/cac2471d78e9...17b54d4c2dce [22:45:01] [02miraheze/puppet] 07Universal-Omega 0317b54d4 - Add [22:45:03] [02puppet] 07Universal-Omega synchronize pull request 03#3624: ssl-certificate use pyyaml and check for duplicate keys - 13https://github.com/miraheze/puppet/pull/3624 [22:46:03] RECOVERY - os141 Current Load on os141 is OK: LOAD OK - total load average: 2.22, 3.18, 2.40 [22:46:25] miraheze/puppet - Universal-Omega the build has errored. [22:47:15] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.71, 6.63, 6.56 [22:47:50] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 6.72, 6.91, 6.20 [22:48:20] [02miraheze/puppet] 07Universal-Omega pushed 031 commit to 03ssl-yaml-duplicate [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/17b54d4c2dce...6e678980256f [22:48:22] [02miraheze/puppet] 07Universal-Omega 036e67898 - Add [22:48:25] [02puppet] 07Universal-Omega synchronize pull request 03#3624: ssl-certificate use pyyaml and check for duplicate keys - 13https://github.com/miraheze/puppet/pull/3624 [22:49:40] miraheze/puppet - Universal-Omega the build passed. [22:49:46] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 6.18, 6.51, 6.12 [22:51:16] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.57, 6.94, 6.72 [22:53:16] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.41, 7.41, 6.91 [22:56:00] PROBLEM - mw181 Puppet on mw181 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[nginx] [22:57:17] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.10, 7.33, 7.01 [22:57:18] PROBLEM - cp34 Puppet on cp34 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[nginx] [22:59:23] PROBLEM - mw182 Puppet on mw182 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[nginx] [23:00:33] RECOVERY - mw142 Puppet on mw142 is OK: OK: Puppet is currently enabled, last run 11 seconds ago with 0 failures [23:00:35] PROBLEM - cp25 Puppet on cp25 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[nginx] [23:00:42] PROBLEM - test131 Puppet on test131 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[nginx] [23:01:17] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 13.34, 9.23, 7.74 [23:02:42] PROBLEM - mw133 Puppet on mw133 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[nginx] [23:03:43] RECOVERY - mwtask181 Puppet on mwtask181 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [23:05:18] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.06, 7.41, 7.33 [23:05:46] RECOVERY - mw141 Puppet on mw141 is OK: OK: Puppet is currently enabled, last run 17 seconds ago with 0 failures [23:05:48] RECOVERY - mw143 Puppet on mw143 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [23:06:27] RECOVERY - mw134 Puppet on mw134 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [23:06:47] RECOVERY - mw132 Puppet on mw132 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [23:09:09] RECOVERY - cp24 Puppet on cp24 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [23:10:15] RECOVERY - mwtask141 Puppet on mwtask141 is OK: OK: Puppet is currently enabled, last run 44 seconds ago with 0 failures [23:10:59] RECOVERY - cp35 Puppet on cp35 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [23:11:58] RECOVERY - mw131 Puppet on mw131 is OK: OK: Puppet is currently enabled, last run 47 seconds ago with 0 failures [23:13:02] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 6.67, 7.20, 7.98 [23:13:19] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.36, 7.01, 7.10 [23:15:19] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.12, 6.75, 7.00 [23:16:35] RECOVERY - www.deadprem.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'deadprem.wiki' will expire on Wed 31 Jan 2024 12:16:06 PM GMT +0000. [23:17:19] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.19, 6.09, 6.72 [23:23:02] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 9.33, 7.65, 7.68 [23:24:45] RECOVERY - cp34 Puppet on cp34 is OK: OK: Puppet is currently enabled, last run 13 seconds ago with 0 failures [23:25:43] RECOVERY - mw181 Puppet on mw181 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [23:28:35] RECOVERY - test131 Puppet on test131 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [23:28:44] RECOVERY - cp25 Puppet on cp25 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [23:28:51] RECOVERY - mw182 Puppet on mw182 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [23:30:06] RECOVERY - mw133 Puppet on mw133 is OK: OK: Puppet is currently enabled, last run 17 seconds ago with 0 failures [23:35:02] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 6.72, 7.74, 7.91 [23:43:08] PROBLEM - cloud12 Puppet on cloud12 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[ulogd2] [23:45:02] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 9.14, 8.07, 7.87 [23:47:02] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 7.64, 7.91, 7.84 [23:47:09] PROBLEM - www.deadprem.wiki - LetsEncrypt on sslhost is CRITICAL: connect to address www.deadprem.wiki and port 443: Network is unreachableHTTP CRITICAL - Unable to open TCP socket [23:49:02] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 11.36, 8.96, 8.20 [23:50:24] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.27, 7.44, 6.88 [23:53:02] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 6.78, 7.86, 7.94 [23:55:02] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 9.72, 8.42, 8.12 [23:56:25] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.66, 6.38, 6.62 [23:59:02] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 7.24, 7.78, 7.93