[00:00:34] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 4.37, 3.40, 3.92 [00:02:33] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 2.47, 3.14, 3.77 [00:02:52] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.12, 3.82, 3.95 [00:03:05] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.81, 2.80, 2.44 [00:05:00] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.17, 3.11, 2.59 [00:08:33] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 2.67, 2.79, 3.39 [00:08:52] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.57, 3.99, 3.95 [00:10:16] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.24, 3.56, 3.97 [00:12:16] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.23, 4.11, 4.14 [00:12:40] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.19, 3.58, 3.19 [00:14:37] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.44, 3.76, 3.29 [00:15:39] PROBLEM - cp22 Current Load on cp22 is CRITICAL: CRITICAL - load average: 54.93, 22.92, 9.21 [00:16:35] PROBLEM - cp22 SSH on cp22 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:16:37] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.20, 3.33, 3.20 [00:18:00] PROBLEM - cp22 PowerDNS Recursor on cp22 is CRITICAL: CRITICAL - Plugin timed out while executing system call [00:18:16] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.53, 3.85, 4.00 [00:18:36] RECOVERY - cp22 SSH on cp22 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [00:18:52] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.30, 3.80, 3.95 [00:19:54] RECOVERY - cp22 PowerDNS Recursor on cp22 is OK: DNS OK: 0.402 seconds response time. miraheze.org returns 109.228.51.216,217.174.247.33,2a00:da00:1800:326::1,2a00:da00:1800:328::1 [00:22:52] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.26, 3.78, 3.91 [00:24:16] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.35, 3.65, 3.81 [00:25:31] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.43, 3.10, 2.54 [00:26:16] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.67, 3.56, 3.76 [00:26:52] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.86, 3.73, 3.86 [00:27:29] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.56, 2.53, 2.40 [00:32:45] PROBLEM - housing.wiki - reverse DNS on sslhost is WARNING: Timeout: The DNS operation timed out after 5.404958248138428 seconds [00:33:29] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.98, 3.84, 3.17 [00:34:49] [02puppet] 07paladox closed pull request 03#3051: swift: set conn_timeout and node_timeout for proxy-server - 13https://github.com/miraheze/puppet/pull/3051 [00:34:49] [url] Page not found · GitHub · GitHub | github.com [00:34:50] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/7208c8f8d32a...d70263bcaea6 [00:34:51] [url] Comparing 7208c8f8d32a...d70263bcaea6 · miraheze/puppet · GitHub | github.com [00:34:51] [02miraheze/puppet] 07paladox 03d70263b - swift: set conn_timeout and node_timeout for proxy-server (#3051) [00:34:54] [02miraheze/puppet] 07paladox deleted branch 03paladox-patch-9 [00:34:56] [02puppet] 07paladox deleted branch 03paladox-patch-9 - 13https://github.com/miraheze/puppet [00:34:56] ... [00:35:24] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.83, 4.92, 3.66 [00:36:11] RECOVERY - swiftproxy111 Puppet on swiftproxy111 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [00:36:43] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 6.40, 3.80, 2.96 [00:36:52] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 6.26, 4.35, 3.94 [00:37:43] RECOVERY - swiftproxy131 Puppet on swiftproxy131 is OK: OK: Puppet is currently enabled, last run 29 seconds ago with 0 failures [00:38:42] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.40, 3.44, 2.93 [00:39:43] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 2.68, 3.89, 3.52 [00:40:40] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 2.14, 2.92, 2.79 [00:40:52] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.34, 3.64, 3.74 [00:41:02] PROBLEM - cp22 Current Load on cp22 is WARNING: WARNING - load average: 0.52, 0.88, 3.85 [00:41:09] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.23, 3.80, 3.63 [00:43:04] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.45, 2.97, 3.34 [00:43:37] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 2.32, 3.03, 3.26 [00:44:54] RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 0.63, 0.94, 3.23 [00:48:16] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.02, 3.71, 3.59 [00:48:52] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 5.10, 4.07, 3.83 [00:50:33] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.95, 3.31, 2.95 [00:51:22] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 3.88, 3.66, 3.38 [00:52:16] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 2.88, 3.62, 3.60 [00:52:32] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 2.30, 2.90, 2.84 [00:52:52] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.49, 3.97, 3.86 [00:53:19] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 2.12, 3.08, 3.20 [00:54:52] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.09, 3.96, 3.86 [00:55:54] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.76, 3.78, 2.79 [00:56:16] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.65, 3.86, 3.68 [00:56:52] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.94, 3.93, 3.86 [00:57:51] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.92, 3.43, 2.79 [00:58:16] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.57, 3.74, 3.65 [00:59:49] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.91, 2.94, 2.69 [01:06:16] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.15, 3.64, 3.58 [01:06:38] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.04, 5.41, 3.82 [01:08:52] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.05, 3.73, 3.71 [01:09:50] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 4.22, 3.41, 3.14 [01:10:16] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.88, 3.92, 3.71 [01:10:37] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.27, 3.43, 3.40 [01:10:52] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.54, 3.72, 3.71 [01:11:47] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 3.20, 3.34, 3.15 [01:12:16] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.20, 4.01, 3.77 [01:12:37] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 0.49, 2.48, 3.06 [01:12:52] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 5.09, 3.93, 3.77 [01:15:38] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 4.32, 3.89, 3.41 [01:17:35] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 2.82, 3.42, 3.29 [01:20:16] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.01, 3.78, 3.92 [01:20:52] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 2.68, 3.93, 4.00 [01:21:30] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 3.17, 3.29, 3.27 [01:22:52] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 3.47, 4.02, 4.05 [01:24:46] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.66, 3.28, 3.02 [01:24:52] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.31, 3.87, 3.99 [01:26:16] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.45, 3.16, 2.78 [01:26:43] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 3.30, 3.25, 3.03 [01:26:52] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.38, 4.13, 4.08 [01:27:18] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 2.88, 3.45, 3.40 [01:28:52] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 2.94, 3.66, 3.91 [01:29:15] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 2.08, 2.88, 3.19 [01:30:12] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.01, 2.93, 2.82 [01:32:32] RECOVERY - housing.wiki - reverse DNS on sslhost is OK: SSL OK - housing.wiki reverse DNS resolves to cp32.miraheze.org - CNAME FLAT [01:36:16] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.10, 3.60, 3.63 [01:36:37] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.77, 3.57, 2.88 [01:38:16] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.50, 3.43, 3.56 [01:38:37] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.84, 3.89, 3.10 [01:40:16] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.38, 3.75, 3.66 [01:40:37] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.81, 4.07, 3.25 [01:42:16] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.66, 3.73, 3.66 [01:42:37] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.28, 3.97, 3.33 [01:42:52] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.32, 3.52, 3.59 [01:44:16] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.87, 4.11, 3.80 [01:45:45] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 3.77, 3.71, 3.29 [01:48:37] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.79, 2.93, 3.08 [01:48:52] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.30, 3.91, 3.83 [01:49:39] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 5.08, 4.11, 3.51 [01:50:37] [Grafana] !sre FIRING: The mediawiki job queue has more than 2500 unclaimed jobs https://grafana.miraheze.org/d/GtxbP1Xnk?orgId=1 [01:50:52] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.02, 4.03, 3.88 [01:51:36] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 2.99, 3.76, 3.46 [01:55:41] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.33, 3.57, 2.80 [01:58:16] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.48, 3.97, 3.99 [01:59:25] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 2.56, 3.15, 3.34 [01:59:36] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.50, 2.82, 2.70 [02:00:16] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.04, 4.01, 4.00 [02:02:16] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.37, 3.87, 3.95 [02:03:12] PROBLEM - wiki.albrusmusic.ru - LetsEncrypt on sslhost is CRITICAL: connect to address wiki.albrusmusic.ru and port 443: Network is unreachableHTTP CRITICAL - Unable to open TCP socket [02:04:52] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.16, 3.59, 3.89 [02:06:52] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.15, 3.63, 3.85 [02:08:38] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.32, 3.70, 2.85 [02:08:52] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.96, 3.75, 3.87 [02:10:37] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.25, 3.74, 2.99 [02:12:52] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.66, 3.82, 3.84 [02:14:37] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.68, 3.83, 3.19 [02:14:52] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.29, 3.73, 3.82 [02:16:16] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 5.93, 4.24, 3.95 [02:16:37] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.37, 3.40, 3.12 [02:20:37] [Grafana] !sre RESOLVED: High Job Queue Backlog https://grafana.miraheze.org/d/GtxbP1Xnk?orgId=1 [02:24:05] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.78, 2.59, 2.22 [02:26:03] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.65, 4.13, 2.85 [02:27:35] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 3.65, 3.63, 3.32 [02:28:01] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.45, 3.39, 2.73 [02:31:29] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 4.63, 3.83, 3.45 [02:32:28] RECOVERY - wiki.albrusmusic.ru - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.albrusmusic.ru' will expire on Mon 27 Feb 2023 14:21:38 GMT +0000. [02:32:52] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.21, 3.65, 3.65 [02:33:26] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 3.46, 3.68, 3.44 [02:35:09] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.71, 3.24, 2.79 [02:35:23] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 4.30, 3.81, 3.51 [02:36:30] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 4.54, 3.64, 3.20 [02:37:04] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.44, 3.51, 2.97 [02:38:28] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.88, 3.57, 3.22 [02:39:00] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 3.10, 3.37, 2.97 [02:39:17] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 3.28, 3.80, 3.60 [02:40:27] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 2.84, 3.28, 3.16 [02:40:53] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.31, 3.95, 3.89 [02:41:27] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 4.00, 3.21, 2.85 [02:42:16] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 2.92, 3.49, 3.87 [02:43:11] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 4.05, 3.47, 3.47 [02:43:23] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 2.90, 3.06, 2.83 [02:44:52] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.93, 4.26, 4.00 [02:46:16] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.52, 4.02, 3.99 [02:47:06] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 3.56, 3.65, 3.55 [02:49:03] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 5.20, 4.44, 3.86 [02:49:21] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 5.08, 3.78, 3.34 [02:51:20] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 3.01, 3.40, 3.25 [02:55:16] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.49, 3.44, 3.29 [02:59:14] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 2.83, 3.22, 3.24 [03:01:46] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 5.96, 4.35, 2.25 [03:03:10] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 4.10, 3.80, 3.50 [03:03:11] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 3.53, 3.86, 2.95 [03:03:46] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 2.17, 3.50, 2.19 [03:05:05] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 4.05, 3.64, 2.95 [03:05:09] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.82, 3.68, 3.48 [03:05:18] PROBLEM - ns1 NTP time on ns1 is WARNING: NTP WARNING: Offset 0.1418887973 secs [03:05:46] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.58, 2.83, 2.11 [03:06:29] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.12, 10.03, 8.43 [03:07:00] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 7.01, 4.24, 2.98 [03:08:24] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 5.63, 8.42, 8.04 [03:08:43] PROBLEM - wiki.albrusmusic.ru - reverse DNS on sslhost is WARNING: Timeout: The DNS operation timed out after 5.406853199005127 seconds [03:09:07] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 2.26, 2.94, 3.25 [03:10:47] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 2.29, 3.86, 3.45 [03:11:18] RECOVERY - ns1 NTP time on ns1 is OK: NTP OK: Offset 0.09641692042 secs [03:12:42] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 1.75, 3.18, 3.25 [03:16:37] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.26, 3.79, 3.65 [03:22:37] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.02, 2.67, 3.20 [03:23:54] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.89, 3.56, 2.78 [03:25:52] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.08, 3.50, 2.86 [03:26:33] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 2.34, 2.94, 3.84 [03:27:32] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/runJobs.php --wiki=twistedwonderlandwiki (END - exit=0) [03:27:37] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:27:49] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.59, 3.83, 3.05 [03:28:52] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.09, 3.36, 3.95 [03:29:47] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.72, 3.62, 3.09 [03:30:16] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.61, 3.50, 3.96 [03:31:45] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.59, 3.02, 2.94 [03:33:48] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 6.97, 3.83, 2.24 [03:34:33] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 2.21, 2.55, 3.32 [03:36:37] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.14, 4.06, 3.34 [03:38:38] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.72, 3.94, 3.39 [03:40:37] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.17, 3.81, 3.39 [03:41:46] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 1.39, 3.68, 3.12 [03:42:16] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 2.98, 2.92, 3.39 [03:42:37] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.60, 2.91, 3.11 [03:43:46] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 0.81, 2.75, 2.85 [03:50:44] [02miraheze/ErrorPages] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+1/-1/±0] 13https://github.com/miraheze/ErrorPages/commit/8605654f729d [03:50:46] [02miraheze/ErrorPages] 07Universal-Omega 038605654 - Remame db141Wiki.php to c3Wiki.php [03:50:49] [02ErrorPages] 07Universal-Omega created branch 03Universal-Omega-patch-1 - 13https://github.com/miraheze/ErrorPages [03:50:50] [url] Page not found · GitHub · GitHub | github.com [03:50:51] [02ErrorPages] 07Universal-Omega opened pull request 03#23: Remame db141Wiki.php to c3Wiki.php - 13https://github.com/miraheze/ErrorPages/pull/23 [03:50:52] ... [03:50:52] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 2.69, 2.95, 3.31 [03:51:50] miraheze/ErrorPages - Universal-Omega the build passed. [03:56:52] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 6.16, 4.05, 3.60 [03:58:52] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.51, 3.68, 3.51 [04:06:50] RECOVERY - wiki.albrusmusic.ru - reverse DNS on sslhost is OK: SSL OK - wiki.albrusmusic.ru reverse DNS resolves to cp22.miraheze.org - CNAME OK [04:07:02] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.18, 3.50, 3.23 [04:07:24] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 7.42, 4.82, 3.21 [04:09:00] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 2.68, 3.35, 3.21 [04:11:14] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.74, 3.82, 3.14 [04:13:10] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.36, 3.31, 3.03 [04:14:52] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 2.22, 3.10, 3.38 [04:16:48] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.68, 3.56, 3.33 [04:22:41] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 2.54, 3.12, 3.23 [04:26:39] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.78, 3.93, 2.90 [04:28:37] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.91, 3.45, 2.85 [04:30:35] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.65, 2.93, 2.73 [04:40:37] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.34, 3.97, 2.97 [04:42:37] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.28, 3.00, 2.73 [04:56:04] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.43, 3.06, 2.41 [04:58:02] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.31, 2.71, 2.35 [05:08:37] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 6.50, 4.96, 3.11 [05:10:40] PROBLEM - cloud10 Puppet on cloud10 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[ulogd2] [05:12:52] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.66, 3.63, 3.24 [05:18:37] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.04, 3.09, 3.47 [05:18:52] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 2.91, 3.39, 3.29 [05:20:37] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.04, 2.37, 3.15 [05:21:35] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 9.79, 4.51, 2.94 [05:22:52] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.74, 3.69, 3.45 [05:24:52] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.48, 3.91, 3.56 [05:26:25] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.45, 3.31, 3.07 [05:26:52] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.67, 3.86, 3.58 [05:27:29] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.24, 3.32, 3.00 [05:28:23] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 2.54, 3.02, 2.99 [05:34:52] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 3.13, 3.26, 3.40 [05:38:52] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.21, 3.65, 3.53 [05:40:40] RECOVERY - cloud10 Puppet on cloud10 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [05:44:52] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 2.80, 3.96, 3.80 [05:48:05] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=opentaxawiki --no-updates --username-prefix=mh:opentaxa /home/reception/wiki-opentaxamirahezeorg_w/opentaxamirahezeorg_w-20220626-history.xml (START) [05:48:10] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:48:47] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=opentaxawiki --no-updates --username-prefix=mh:opentaxa /home/reception/wiki-opentaxamirahezeorg_w/opentaxamirahezeorg_w-20220626-history.xml (END - exit=0) [05:48:48] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=opentaxawiki (START) [05:48:52] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:48:57] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:49:07] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=opentaxawiki (END - exit=0) [05:49:08] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/initSiteStats.php --wiki=opentaxawiki --active --update (END - exit=0) [05:49:11] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:49:16] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:51:29] !log reception@mwtask141:~$ sudo -u www-data php /srv/mediawiki/w/maintenance/dumpBackup.php --wiki yurinikolaiwiki --full > yurinikolaiwiki06122022.xml [05:51:33] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:52:44] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=opensynthwiki --no-updates --username-prefix=mh:opensynth /home/reception/ImportDump/opensynthwiki-20221206001153.xml (START) [05:52:45] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=opensynthwiki --no-updates --username-prefix=mh:opensynth /home/reception/ImportDump/opensynthwiki-20221206001153.xml (END - exit=256) [05:52:46] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=opensynthwiki (START) [05:52:50] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=opensynthwiki (END - exit=0) [05:52:51] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:52:51] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/initSiteStats.php --wiki=opensynthwiki --active --update (END - exit=0) [05:52:52] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=kilroywiki --no-updates --username-prefix=mh:kilroy /home/reception/ImportDump/kilroywiki-20221205220327.xml (START) [05:52:53] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=kilroywiki --no-updates --username-prefix=mh:kilroy /home/reception/ImportDump/kilroywiki-20221205220327.xml (END - exit=256) [05:52:54] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=kilroywiki (START) [05:52:55] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=kilroywiki (END - exit=0) [05:52:55] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:52:56] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/initSiteStats.php --wiki=kilroywiki --active --update (END - exit=0) [05:53:01] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:53:06] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:53:10] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:53:15] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:53:21] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:53:25] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:53:30] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:53:33] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:56:52] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 3.07, 3.10, 3.40 [05:57:08] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=hangoverswiki --no-updates /home/reception/ImportDump/hangoverswiki-20221206055555.xml (START) [05:57:13] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:59:18] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=hangoverswiki --no-updates /home/reception/ImportDump/hangoverswiki-20221206055555.xml (END - exit=0) [05:59:19] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=hangoverswiki (START) [05:59:24] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:59:29] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:01:19] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=hangoverswiki (END - exit=0) [06:01:20] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/initSiteStats.php --wiki=hangoverswiki --active --update (END - exit=0) [06:01:24] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:01:29] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:12:39] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.91, 3.71, 2.40 [06:14:39] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.79, 3.74, 2.58 [06:20:39] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 2.43, 3.20, 2.75 [06:25:46] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.15, 4.58, 3.32 [06:29:46] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 2.59, 3.91, 2.16 [06:31:39] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 0.88, 3.23, 3.30 [06:31:43] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importImages.php --wiki=hangoverswiki --summary=Imported from http://34.239.177.44 --search-recursively /home/reception/hangoverswiki --user Miraheze_maintenance_script (START) [06:31:49] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:33:41] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=fictiontopiawiki --no-updates --username-prefix=ficreationwiki /home/reception/ficreationwiki_xml_d3f3e37ea661d156c84e.xml (START) [06:33:46] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 0.38, 2.53, 2.06 [06:33:46] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:55:10] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 6.08, 3.54, 2.57 [06:55:21] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 4.13, 3.89, 3.18 [06:55:38] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.86, 3.80, 3.37 [06:55:51] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.28, 4.05, 3.35 [06:57:49] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.51, 3.80, 3.34 [06:59:15] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 2.74, 3.63, 3.27 [07:01:13] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 5.96, 4.27, 3.53 [07:01:44] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 5.24, 4.51, 3.71 [07:03:05] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.09, 3.28, 2.94 [07:03:10] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 3.75, 4.00, 3.52 [07:03:30] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.32, 3.76, 3.49 [07:05:07] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 3.88, 4.08, 3.61 [07:05:39] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.01, 3.84, 3.62 [07:07:04] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 3.04, 3.73, 3.54 [07:07:25] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.05, 4.00, 3.71 [07:10:58] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 2.26, 3.04, 3.31 [07:11:32] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 2.45, 3.17, 3.40 [07:17:14] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.22, 4.00, 3.74 [07:18:43] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 8.39, 4.88, 3.84 [07:21:16] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.32, 3.64, 3.53 [07:23:56] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.02, 12.90, 8.70 [07:24:07] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.86, 11.27, 7.96 [07:25:55] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 6.06, 10.68, 8.40 [07:26:07] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 5.87, 9.54, 7.73 [07:27:53] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 4.91, 8.84, 8.01 [07:31:04] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 2.36, 3.15, 3.39 [07:32:33] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 2.44, 3.31, 3.83 [07:32:57] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.14, 3.62, 3.98 [07:34:37] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=fictiontopiawiki --no-updates --username-prefix=ficreationwiki /home/reception/ficreationwiki_xml_d3f3e37ea661d156c84e.xml (END - exit=0) [07:34:38] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=fictiontopiawiki (START) [07:34:42] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:34:48] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:36:33] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 4.08, 3.52, 3.77 [07:36:37] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 6.32, 3.84, 2.22 [07:36:52] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 5.55, 3.94, 3.98 [07:38:33] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 2.74, 3.34, 3.68 [07:38:52] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.81, 3.80, 3.93 [07:40:37] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.90, 3.41, 2.41 [07:42:37] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.23, 4.05, 2.78 [07:42:52] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.34, 3.74, 3.85 [07:44:33] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 2.39, 2.84, 3.35 [07:44:37] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.98, 3.51, 2.75 [07:44:52] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.67, 3.66, 3.81 [07:46:37] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 0.82, 2.59, 2.50 [07:47:40] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.41, 3.73, 3.53 [07:48:33] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 3.12, 3.36, 3.48 [07:49:37] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.32, 3.84, 3.59 [07:51:35] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 2.67, 3.40, 3.46 [07:52:33] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 3.22, 3.17, 3.38 [07:53:33] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 2.33, 3.05, 3.32 [07:59:04] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.91, 3.45, 2.24 [08:00:52] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 2.80, 3.07, 3.36 [08:01:04] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.42, 2.66, 2.09 [08:04:59] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=fictiontopiawiki (END - exit=0) [08:05:00] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/initSiteStats.php --wiki=fictiontopiawiki --active --update (END - exit=0) [08:05:03] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [08:05:07] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [08:06:16] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.42, 3.55, 3.34 [08:08:16] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 3.12, 3.32, 3.27 [08:11:43] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.78, 3.64, 3.47 [08:13:41] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 5.84, 4.18, 3.67 [08:15:38] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.31, 3.78, 3.59 [08:16:33] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 3.72, 3.80, 3.44 [08:17:36] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.08, 3.88, 3.64 [08:19:34] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.37, 3.78, 3.64 [08:21:32] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 3.86, 4.10, 3.78 [08:22:33] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 2.67, 3.31, 3.34 [08:23:29] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 2.88, 3.75, 3.70 [08:29:22] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.85, 4.00, 3.76 [08:30:33] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 2.88, 3.41, 3.36 [08:31:20] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.38, 3.70, 3.68 [08:34:33] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 2.49, 3.00, 3.20 [08:38:37] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 6.27, 4.41, 2.58 [08:40:08] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importImages.php --wiki=hangoverswiki --summary=Imported from http://34.239.177.44 --search-recursively /home/reception/hangoverswiki --user Miraheze_maintenance_script (END - exit=0) [08:40:13] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [08:41:09] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 2.98, 3.12, 3.36 [08:43:26] Anyway I've opened a task about an issue with ballmedia, which I previously talked about. [08:43:26] https://phabricator.miraheze.org/T10078 [08:43:27] [url] ⚓ T10078 Template fetch failure for Ballmedia | phabricator.miraheze.org [08:44:37] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.81, 3.66, 2.93 [08:46:38] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.45, 4.25, 3.22 [08:48:37] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.92, 3.56, 3.11 [08:50:37] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 0.54, 2.51, 2.78 [08:50:55] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.48, 3.14, 3.16 [08:52:53] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 2.29, 2.84, 3.05 [09:24:56] PROBLEM - wiki.macc.nyc - reverse DNS on sslhost is WARNING: Timeout: The DNS operation timed out after 5.406239986419678 seconds [09:26:40] PROBLEM - wmworld.sktz.live - reverse DNS on sslhost is WARNING: Timeout: The DNS operation timed out after 5.407070159912109 seconds [09:27:04] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.92, 3.17, 1.77 [09:30:52] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 5.80, 4.12, 3.24 [09:30:56] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 5.55, 3.86, 3.03 [09:32:52] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.44, 3.82, 3.24 [09:32:53] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.46, 3.63, 3.04 [09:33:04] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.58, 3.25, 2.46 [09:33:09] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 3.23, 3.84, 3.16 [09:34:51] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 3.03, 3.38, 3.01 [09:36:52] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 2.53, 3.20, 3.12 [09:37:32] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.67, 4.07, 2.41 [09:39:04] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.58, 3.90, 3.06 [09:39:27] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.64, 3.94, 2.57 [09:41:04] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.19, 2.89, 2.79 [09:41:22] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.05, 2.91, 2.35 [09:42:55] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 2.54, 3.12, 3.13 [09:47:32] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.57, 3.54, 3.27 [09:49:40] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 4.36, 4.11, 3.55 [09:51:37] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 2.90, 3.83, 3.53 [09:53:26] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 2.92, 3.32, 3.29 [09:53:34] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 2.05, 3.19, 3.33 [10:11:05] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 3.67, 3.15, 3.02 [10:13:02] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 2.36, 2.75, 2.88 [10:22:16] PROBLEM - mw132 Current Load on mw132 is CRITICAL: CRITICAL - load average: 21.13, 11.96, 6.72 [10:24:49] PROBLEM - wmworld.sktz.live - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:26:13]