[00:01:14] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 7.48, 4.43, 3.31 [00:03:44] PROBLEM - cp22 Current Load on cp22 is WARNING: WARNING - load average: 3.07, 3.79, 2.75 [00:05:14] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.60, 3.87, 3.37 [00:05:44] RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 0.82, 2.72, 2.48 [00:09:14] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.90, 2.90, 3.11 [00:11:01] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.53, 2.93, 2.36 [00:11:50] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.01, 4.13, 3.20 [00:12:00] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 2.97, 3.66, 4.00 [00:13:01] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 2.11, 2.55, 2.28 [00:13:47] PROBLEM - cp22 Current Load on cp22 is CRITICAL: CRITICAL - load average: 13.55, 7.30, 4.41 [00:13:50] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.25, 3.01, 2.90 [00:15:40] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 3.14, 5.27, 3.23 [00:16:40] PROBLEM - cp22 PowerDNS Recursor on cp22 is CRITICAL: CRITICAL - Plugin timed out while executing system call [00:18:38] RECOVERY - cp22 PowerDNS Recursor on cp22 is OK: DNS OK: 0.195 seconds response time. miraheze.org returns 109.228.51.216,217.174.247.33,2a00:da00:1800:326::1,2a00:da00:1800:328::1 [00:21:34] PROBLEM - cp33 NTP time on cp33 is WARNING: NTP WARNING: Offset 0.2992790043 secs [00:25:14] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.84, 3.34, 3.01 [00:25:40] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 0.95, 3.28, 3.64 [00:26:00] PROBLEM - test131 Current Load on test131 is CRITICAL: CRITICAL - load average: 5.78, 4.19, 3.90 [00:27:14] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.05, 2.90, 2.89 [00:27:40] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.20, 2.67, 3.38 [00:33:44] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 7.56, 4.53, 3.40 [00:33:44] PROBLEM - cp22 Current Load on cp22 is WARNING: WARNING - load average: 0.30, 1.32, 3.62 [00:35:44] RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 0.79, 1.31, 3.35 [00:40:00] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 2.33, 3.47, 3.85 [00:41:42] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.87, 3.44, 3.44 [00:45:34] RECOVERY - cp33 NTP time on cp33 is OK: NTP OK: Offset -0.009442776442 secs [00:45:40] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.46, 2.92, 3.24 [00:48:00] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 2.70, 2.83, 3.38 [01:00:49] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.15, 4.33, 3.54 [01:02:45] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.18, 3.63, 3.37 [01:04:41] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 3.05, 3.31, 3.28 [01:09:34] PROBLEM - cp33 NTP time on cp33 is WARNING: NTP WARNING: Offset 0.1364977062 secs [01:11:34] RECOVERY - cp33 NTP time on cp33 is OK: NTP OK: Offset 0.04068681598 secs [01:15:47] PROBLEM - cp22 Current Load on cp22 is CRITICAL: CRITICAL - load average: 5.79, 4.10, 2.58 [01:17:19] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.81, 3.71, 3.47 [01:19:15] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.01, 3.10, 3.27 [01:19:44] RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 1.00, 3.02, 2.55 [01:24:44] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 7.01, 4.57, 2.86 [01:25:14] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.03, 3.62, 3.41 [01:28:39] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.12, 2.99, 2.63 [01:29:14] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.35, 3.29, 3.35 [01:45:44] PROBLEM - cp22 Current Load on cp22 is CRITICAL: CRITICAL - load average: 4.17, 2.91, 1.93 [01:47:25] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 6.46, 4.33, 3.18 [01:48:05] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.65, 2.89, 2.35 [01:49:44] RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 0.70, 2.64, 2.14 [01:50:04] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 3.30, 2.79, 2.36 [01:51:01] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.53, 3.13, 2.48 [01:51:23] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.81, 3.90, 3.30 [01:53:01] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 1.99, 2.63, 2.37 [01:55:23] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.57, 3.35, 3.21 [01:58:00] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 3.64, 3.51, 3.08 [02:00:00] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 2.87, 3.24, 3.03 [02:05:20] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.46, 3.54, 3.33 [02:09:19] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.18, 2.69, 3.06 [02:35:18] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.94, 5.45, 3.73 [02:45:59] PROBLEM - cp22 Current Load on cp22 is CRITICAL: CRITICAL - load average: 16.24, 9.92, 5.04 [02:46:34] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 6.14, 4.16, 3.06 [02:48:30] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.40, 3.79, 3.06 [02:48:57] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 4.47, 2.62, 1.61 [02:50:26] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.10, 3.23, 2.94 [02:50:55] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.84, 2.64, 1.77 [02:51:48] PROBLEM - cp22 Current Load on cp22 is WARNING: WARNING - load average: 0.16, 3.78, 3.89 [02:55:44] RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 1.37, 2.36, 3.28 [02:59:14] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.32, 3.71, 3.25 [03:01:14] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.67, 3.25, 3.13 [03:01:18] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.16, 3.47, 4.00 [03:05:18] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.05, 3.38, 3.77 [03:07:18] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.92, 3.22, 3.67 [03:09:18] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.48, 3.69, 3.78 [03:11:18] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.51, 2.79, 3.43 [03:15:18] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.00, 2.75, 3.31 [03:15:51] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.89, 3.62, 3.24 [03:19:43] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.78, 3.36, 3.23 [03:25:33] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.88, 3.74, 3.43 [03:29:25] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.31, 2.78, 3.15 [04:08:00] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.24, 3.71, 3.04 [04:08:09] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 7.68, 6.21, 4.16 [04:09:55] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.95, 3.14, 2.92 [04:16:07] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.73, 3.93, 3.99 [04:20:03] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 3.88, 2.68, 1.76 [04:22:01] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.95, 2.66, 1.89 [04:22:06] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.41, 2.52, 3.38 [04:32:32] miraheze/mw-config - AgentIsai the build passed. [04:34:48] miraheze/mw-config - AgentIsai the build has errored. [04:36:00] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 3.56, 3.17, 2.52 [04:36:08] miraheze/mw-config - AgentIsai the build passed. [04:38:00] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 1.72, 2.64, 2.41 [04:45:25] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.82, 3.20, 2.66 [04:47:24] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 2.58, 2.93, 2.63 [04:47:57] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 6.59, 4.38, 3.50 [04:48:01] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 4.87, 2.99, 2.10 [04:49:57] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.99, 3.54, 3.31 [04:50:01] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 3.39, 3.05, 2.24 [04:51:56] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 0.62, 2.54, 2.97 [05:03:23] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.40, 3.47, 2.91 [05:05:23] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 2.99, 3.20, 2.88 [05:07:01] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 4.13, 3.42, 2.79 [05:07:52] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.08, 3.80, 2.98 [05:09:01] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 1.98, 2.92, 2.69 [05:09:52] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.49, 2.78, 2.70 [05:14:31] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 5.08, 4.04, 3.13 [05:16:28] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 2.82, 3.59, 3.08 [05:17:46] PROBLEM - cp22 Current Load on cp22 is CRITICAL: CRITICAL - load average: 4.18, 3.64, 2.46 [05:19:44] RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 1.40, 2.90, 2.34 [05:20:22] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 2.59, 3.19, 3.03 [05:28:44] PROBLEM - test131 Current Load on test131 is CRITICAL: CRITICAL - load average: 4.07, 3.50, 3.03 [05:30:38] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 2.73, 3.20, 2.97 [05:33:45] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.48, 2.67, 2.30 [05:37:23] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 5.02, 3.52, 2.98 [05:37:44] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.68, 2.51, 2.36 [05:38:52] RECOVERY - wiki.slimeapedia.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.slimeapedia.org' will expire on Fri 23 Dec 2022 04:36:40 GMT +0000. [05:39:23] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 2.22, 3.08, 2.89 [05:41:01] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 4.03, 3.59, 3.07 [05:43:01] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.94, 3.67, 3.16 [05:43:46] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.59, 3.09, 2.91 [05:45:01] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 2.22, 3.20, 3.06 [05:45:44] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.39, 3.29, 2.99 [05:46:07] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.44, 4.22, 2.75 [05:48:05] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.78, 3.21, 2.56 [05:49:38] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.94, 3.83, 3.30 [05:51:35] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 2.16, 3.19, 3.13 [05:52:31] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 3.73, 3.63, 3.33 [05:57:27] PROBLEM - wiki.slimeapedia.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.slimeapedia.org All nameservers failed to answer the query. [06:02:02] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 2.73, 3.21, 3.29 [06:10:16] PROBLEM - wiki.slimeapedia.org - LetsEncrypt on sslhost is CRITICAL: connect to address wiki.slimeapedia.org and port 443: Network is unreachableHTTP CRITICAL - Unable to open TCP socket [06:12:08] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.28, 3.45, 2.79 [06:12:49] PROBLEM - test131 Current Load on test131 is CRITICAL: CRITICAL - load average: 4.26, 3.78, 3.48 [06:14:43] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 2.76, 3.42, 3.38 [06:16:00] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 6.07, 5.06, 3.59 [06:16:37] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 2.90, 3.20, 3.30 [06:18:56] PROBLEM - mw122 Disk Space on mw122 is WARNING: DISK WARNING - free space: / 2427 MB (10% inode=80%); [06:19:32] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 6.45, 4.16, 2.75 [06:19:52] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 0.99, 3.18, 3.18 [06:21:31] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.24, 2.95, 2.48 [06:23:44] PROBLEM - cloud14 Puppet on cloud14 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[ulogd2] [06:26:43] RECOVERY - mw122 Disk Space on mw122 is OK: DISK OK - free space: / 2431 MB (11% inode=80%); [06:27:25] PROBLEM - wiki.slimeapedia.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.slimeapedia.org could not be found [06:27:52] PROBLEM - wc.miraheze.org on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:27:59] PROBLEM - lcn.zfc.id.lv - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:28:05] PROBLEM - cp23 SSH on cp23 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:28:06] PROBLEM - ns1 GDNSD Datacenters on ns1 is CRITICAL: CRITICAL - 5 datacenters are down: 217.174.247.33/cpweb, 109.228.51.216/cpweb, 2a00:da00:1800:326::1/cpweb, 2a00:da00:1800:328::1/cpweb, 74.208.203.152/cpweb [06:28:09] PROBLEM - cnt.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:28:10] PROBLEM - small.polandballwiki.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:28:13] PROBLEM - pokemon2.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:28:28] PROBLEM - cp22 Current Load on cp22 is CRITICAL: CRITICAL - load average: 29.20, 17.89, 8.10 [06:28:47] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 14.98, 13.03, 7.38 [06:28:57] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 28.14, 20.25, 9.68 [06:29:00] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 3.72, 3.62, 3.39 [06:29:29] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.25, 7.56, 4.82 [06:29:47] RECOVERY - wc.miraheze.org on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Sat 11 Nov 2023 23:59:59 GMT +0000. [06:30:01] RECOVERY - cp23 SSH on cp23 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [06:30:06] RECOVERY - ns1 GDNSD Datacenters on ns1 is OK: OK - all datacenters are online [06:30:44] PROBLEM - mw122 Disk Space on mw122 is WARNING: DISK WARNING - free space: / 2414 MB (10% inode=80%); [06:30:54] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 2.64, 3.32, 3.31 [06:37:34] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 3.32, 3.61, 3.47 [06:39:28] PROBLEM - test131 Current Load on test131 is CRITICAL: CRITICAL - load average: 4.07, 3.83, 3.57 [06:41:22] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 2.76, 3.51, 3.49 [06:41:27] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.19, 3.32, 3.84 [06:43:16] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 2.72, 3.22, 3.38 [06:45:26] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 0.43, 1.79, 3.10 [06:46:35] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 0.61, 1.51, 3.79 [06:48:33] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 0.68, 1.20, 3.40 [06:49:00] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 4.00, 3.58, 3.48 [06:49:46] PROBLEM - cp22 Current Load on cp22 is WARNING: WARNING - load average: 0.56, 2.33, 3.86 [06:50:02] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.87, 2.45, 3.81 [06:51:43] RECOVERY - cloud14 Puppet on cloud14 is OK: OK: Puppet is currently enabled, last run 49 seconds ago with 0 failures [06:51:58] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 7.59, 4.07, 4.21 [06:52:48] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 2.23, 3.06, 3.30 [06:53:44] RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 0.85, 1.58, 3.19 [06:53:54] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.43, 3.57, 4.00 [06:56:35] RECOVERY - lcn.zfc.id.lv - LetsEncrypt on sslhost is OK: OK - Certificate 'lcn.zfc.id.lv' will expire on Thu 26 Jan 2023 19:45:16 GMT +0000. [06:56:49] RECOVERY - cnt.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Sat 11 Nov 2023 23:59:59 GMT +0000. [06:56:55] RECOVERY - small.polandballwiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'small.polandballwiki.com' will expire on Fri 23 Dec 2022 05:14:40 GMT +0000. [06:57:01] RECOVERY - pokemon2.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Sat 11 Nov 2023 23:59:59 GMT +0000. [06:59:42] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 7.06, 4.68, 4.26 [07:03:33] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 0.89, 2.90, 3.66 [07:05:20] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.43, 3.40, 2.78 [07:05:29] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.15, 2.30, 3.35 [07:13:18] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.24, 3.74, 3.46 [07:15:17] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 0.59, 2.61, 3.07 [07:46:41] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 3.29, 3.82, 3.17 [07:48:19] PROBLEM - cp22 Current Load on cp22 is CRITICAL: CRITICAL - load average: 8.89, 5.49, 3.11 [07:48:35] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 1.73, 3.10, 2.98 [07:49:11] PROBLEM - cp32 NTP time on cp32 is WARNING: NTP WARNING: Offset 0.1402588487 secs [07:50:15] PROBLEM - cp22 Current Load on cp22 is WARNING: WARNING - load average: 1.75, 3.87, 2.80 [07:52:12] RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 0.75, 2.83, 2.54 [07:52:24] PROBLEM - test131 Current Load on test131 is CRITICAL: CRITICAL - load average: 4.34, 3.74, 3.27 [07:53:11] RECOVERY - cp32 NTP time on cp32 is OK: NTP OK: Offset 0.07665213943 secs [07:54:18] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 3.02, 3.61, 3.28 [07:55:55] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.77, 3.14, 2.53 [07:56:12] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 2.05, 3.08, 3.13 [07:57:51] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.34, 3.60, 2.75 [08:01:43] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.60, 3.25, 2.86 [08:02:07] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.16, 3.57, 2.92 [08:04:07] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 13.77, 7.94, 4.62 [08:10:32] PROBLEM - test131 Current Load on test131 is CRITICAL: CRITICAL - load average: 4.28, 3.15, 2.89 [08:14:04] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 0.53, 3.15, 3.93 [08:16:14] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 1.83, 3.14, 3.05 [08:18:03] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 0.56, 1.80, 3.19 [08:25:14] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.56, 3.36, 2.65 [08:29:14] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.60, 4.00, 3.13 [08:31:14] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.27, 4.16, 3.30 [08:33:14] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.78, 3.13, 3.02 [08:46:43] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.58, 3.52, 2.50 [08:48:42] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.50, 2.77, 2.34 [08:59:04] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 3.50, 3.81, 3.29 [09:02:53] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 3.27, 3.37, 3.20 [09:08:48] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.82, 4.26, 3.02 [09:09:32] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 3.44, 3.59, 3.37 [09:10:48] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.67, 3.16, 2.76 [09:11:26] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 2.76, 3.27, 3.27 [09:28:33] PROBLEM - test131 Current Load on test131 is CRITICAL: CRITICAL - load average: 4.41, 3.63, 3.37 [09:30:28] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 2.14, 3.06, 3.19 [09:38:29] PROBLEM - mw121 Disk Space on mw121 is CRITICAL: DISK CRITICAL - free space: / 1316 MB (5% inode=80%); [10:00:14] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.13, 3.17, 2.69 [10:02:13] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 2.83, 3.11, 2.73 [10:02:58] PROBLEM - cp32 PowerDNS Recursor on cp32 is CRITICAL: CRITICAL - Plugin timed out while executing system call [10:03:02] PROBLEM - cp32 SSH on cp32 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:03:43] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 15.58, 10.10, 5.09 [10:04:59] RECOVERY - cp32 SSH on cp32 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [10:07:06] RECOVERY - cp32 PowerDNS Recursor on cp32 is OK: DNS OK: 7.026 seconds response time. miraheze.org returns 108.175.15.182,2607:f1c0:1800:26f::1,2607:f1c0:1800:8100::1,74.208.203.152 [10:13:28] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.16, 3.66, 3.13 [10:15:25] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 2.35, 3.16, 3.01 [10:16:38] PROBLEM - cp32 PowerDNS Recursor on cp32 is CRITICAL: CRITICAL - Plugin timed out while executing system call [10:18:08] PROBLEM - cp32 SSH on cp32 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:18:37] RECOVERY - cp32 PowerDNS Recursor on cp32 is OK: DNS OK: 3.222 seconds response time. miraheze.org returns 2607:f1c0:1800:26f::1,74.208.203.152 [10:20:08] RECOVERY - cp32 SSH on cp32 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [10:25:16] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.04, 3.90, 2.69 [10:27:14] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.08, 3.18, 2.57 [10:33:55] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.64, 3.08, 2.67 [10:35:54] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 2.47, 2.95, 2.68 [10:39:50] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.56, 3.50, 2.94 [10:41:49] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 2.23, 2.91, 2.78 [10:47:15] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.41, 3.53, 3.03 [10:47:58] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 0.49, 1.06, 3.63 [10:49:15] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 1.87, 2.84, 2.83 [10:49:57] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 0.55, 0.88, 3.26 [10:55:56] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.19, 3.51, 3.58 [10:57:55] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.90, 3.03, 3.41 [10:58:26] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 5.81, 4.13, 2.71 [10:59:54] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 0.42, 2.12, 3.03 [11:00:23] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.56, 3.03, 2.46 [11:00:30] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 4.59, 3.70, 2.59 [11:02:17] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.84, 3.91, 3.15 [11:02:26] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 2.88, 3.73, 2.76 [11:06:14] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.56, 3.14, 3.01 [11:06:18] RECOVERY - gluster102 Current Load on gluster102 is OK: OK - load average: 1.66, 2.94, 2.68 [11:10:01] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 18.86, 12.55, 6.93 [11:16:00] PROBLEM - test131 Current Load on test131 is CRITICAL: CRITICAL - load average: 7.07, 4.01, 2.88 [11:18:00] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 2.30, 3.28, 2.75 [11:19:15] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.84, 2.82, 2.31 [11:21:15] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 2.24, 2.61, 2.30 [11:25:14] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.04, 3.17, 2.17 [11:27:14] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.35, 2.43, 2.02 [11:31:55] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.54, 2.95, 3.95 [11:34:30] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 5.12, 3.72, 3.06 [11:35:53] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.14, 3.79, 3.36 [11:35:53] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.46, 3.19, 3.75 [11:36:27] RECOVERY - gluster102 Current Load on gluster102 is OK: OK - load average: 2.99, 3.38, 3.01 [11:37:52] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.04, 3.25, 3.22 [11:41:52] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.28, 3.67, 3.80 [11:45:27] PROBLEM - cp22 Current Load on cp22 is WARNING: WARNING - load average: 3.85, 3.25, 2.39 [11:45:51] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.33, 2.26, 3.18 [11:47:47] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.59, 3.86, 3.50 [11:49:19] RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 1.09, 2.64, 2.39 [11:51:47] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.31, 3.78, 3.52 [11:53:47] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.93, 3.38, 3.39 [11:59:46] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 3.66, 2.97, 2.90 [12:01:43] RECOVERY - gluster102 Current Load on gluster102 is OK: OK - load average: 2.37, 2.59, 2.76 [12:07:45] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 6.42, 5.00, 3.78 [12:11:44] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.48, 3.89, 3.70 [12:13:43] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.78, 3.02, 3.39 [12:21:42] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.59, 3.47, 3.37 [12:24:57] PROBLEM - cp32 NTP time on cp32 is WARNING: NTP WARNING: Offset 0.1974618137 secs [12:25:11] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.77, 4.11, 3.02 [12:27:08] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.46, 3.61, 2.98 [12:29:04] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.73, 2.97, 2.82 [12:31:17] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.40, 3.42, 3.16 [12:33:13] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.35, 3.10, 3.07 [12:35:15] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 3.79, 3.43, 2.58 [12:36:46] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.68, 2.96, 2.82 [12:37:06] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.51, 4.12, 3.50 [12:37:14] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 2.54, 3.16, 2.59 [12:39:52] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 4.11, 3.43, 2.94 [12:40:40] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.84, 2.92, 2.91 [12:40:58] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.71, 3.52, 3.40 [12:41:51] RECOVERY - gluster102 Current Load on gluster102 is OK: OK - load average: 2.00, 2.94, 2.83 [12:42:54] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.48, 3.18, 3.29 [12:50:31] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.75, 10.21, 9.10 [12:52:25] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.81, 9.76, 9.08 [12:56:14] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.16, 10.19, 9.39 [12:58:08] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.44, 9.43, 9.20 [12:59:55] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 5.34, 3.56, 2.52 [13:00:19] RECOVERY - cp32 NTP time on cp32 is OK: NTP OK: Offset 0.05994939804 secs [13:01:19] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.23, 3.53, 3.26 [13:01:55] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.27, 2.64, 2.30 [13:03:15] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.54, 2.82, 3.03 [13:14:52] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.98, 3.50, 3.01 [13:15:07] [02miraheze/mw-config] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://github.com/miraheze/mw-config/commit/16e090e3d549 [13:15:09] [02miraheze/mw-config] 07paladox 0316e090e - Switching wikis beginning with i, j and k to swift [13:15:12] [02mw-config] 07paladox created branch 03paladox-patch-1 - 13https://github.com/miraheze/mw-config [13:15:14] [02mw-config] 07paladox opened pull request 03#4972: Switching wikis beginning with i, j and k to swift - 13https://github.com/miraheze/mw-config/pull/4972 [13:15:17] [02mw-config] 07paladox closed pull request 03#4972: Switching wikis beginning with i, j and k to swift - 13https://github.com/miraheze/mw-config/pull/4972 [13:15:18] [02miraheze/mw-config] 07paladox deleted branch 03paladox-patch-1 [13:15:20] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/1a30c84bdc39...6c49191ffbe1 [13:15:22] [02miraheze/mw-config] 07paladox 036c49191 - Switching wikis beginning with i, j and k to swift (#4972) [13:15:23] !log [paladox@mwtask141] starting deploy of {'pull': 'config', 'config': True} to all [13:15:24] [02mw-config] 07paladox deleted branch 03paladox-patch-1 - 13https://github.com/miraheze/mw-config [13:15:29] !log [paladox@test131] starting deploy of {'pull': 'config', 'config': True} to all [13:15:31] !log [paladox@test131] DEPLOY ABORTED: Canary check failed for beta.betaheze.org@localhost [13:15:38] !log [paladox@test131] starting deploy of {'pull': 'config', 'config': True, 'force': True} to all [13:15:39] !log [paladox@test131] finished deploy of {'pull': 'config', 'config': True, 'force': True} to all - SUCCESS in 0s [13:15:39] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [13:15:56] !log [paladox@mwtask141] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 32s [13:15:57] !log [paladox@mwtask141] starting deploy of {'config': True} to all [13:16:04] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [13:16:14] !log [paladox@mwtask141] finished deploy of {'config': True} to all - SUCCESS in 17s [13:16:18] miraheze/mw-config - paladox the build passed. [13:16:22] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [13:16:26] miraheze/mw-config - paladox the build passed. [13:16:31] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.10, 9.74, 8.95 [13:16:34] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [13:16:45] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [13:16:54] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [13:16:59] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [13:17:06] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [13:17:15] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 2.77, 3.48, 3.07 [13:18:08] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.33, 10.31, 9.49 [13:18:44] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.55, 3.28, 3.05 [13:19:14] RECOVERY - gluster102 Current Load on gluster102 is OK: OK - load average: 2.08, 3.04, 2.96 [13:20:02] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.84, 9.95, 9.47 [13:20:20] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.03, 10.76, 9.49 [13:21:05] PROBLEM - test131 Current Load on test131 is CRITICAL: CRITICAL - load average: 6.27, 3.82, 2.67 [13:22:14] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 9.59, 10.19, 9.43 [13:23:08] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 6.09, 4.51, 3.55 [13:24:34] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.25, 4.27, 3.53 [13:27:58] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 6.72, 4.10, 2.83 [13:29:55] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 3.52, 3.99, 2.96 [13:30:22] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.31, 3.88, 3.59 [13:31:55] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 0.72, 2.75, 2.62 [13:32:17] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.93, 3.33, 3.40 [13:33:00] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 3.31, 3.73, 3.65 [13:36:11] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.24, 3.97, 3.65 [13:38:07] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.02, 3.52, 3.52 [13:38:54] RECOVERY - gluster102 Current Load on gluster102 is OK: OK - load average: 2.21, 2.82, 3.27 [13:40:03] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.51, 3.84, 3.63 [13:41:59] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.98, 3.93, 3.69 [13:42:49] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 3.38, 3.86, 3.66 [13:43:11] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 14.19, 11.28, 10.06 [13:43:56] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 6.82, 4.46, 3.87 [13:44:47] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 4.04, 3.80, 3.64 [13:46:02] PROBLEM - cloud11 IPMI Sensors on cloud11 is CRITICAL: IPMI Status: Critical [Cntlr 2 Bay 7 = Critical] [13:46:52] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.84, 3.97, 3.09 [13:46:59] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.28, 10.38, 10.03 [13:48:49] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 2.83, 3.63, 3.08 [13:48:54] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 9.63, 10.16, 9.99 [13:50:47] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 2.87, 3.33, 3.03 [13:53:34] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.82, 3.52, 2.83 [13:55:30] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.58, 3.10, 2.76 [13:56:37] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 2.91, 3.86, 3.98 [14:00:33] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 5.64, 4.35, 4.13 [14:02:32] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 2.26, 3.82, 3.99 [14:03:03] PROBLEM - cp22 Current Load on cp22 is CRITICAL: CRITICAL - load average: 4.32, 3.83, 2.58 [14:03:32] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.62, 3.33, 2.85 [14:05:03] RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 2.01, 2.98, 2.41 [14:05:30] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 1.68, 2.70, 2.68 [14:05:56] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.09, 3.43, 3.99 [14:06:32] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 7.37, 5.51, 3.57 [14:08:28] RECOVERY - gluster102 Current Load on gluster102 is OK: OK - load average: 1.79, 2.43, 3.29 [14:12:42] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.80, 10.01, 9.39 [14:13:21] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 5.38, 3.88, 3.18 [14:14:28] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 7.66, 4.14, 3.62 [14:15:19] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.05, 3.45, 3.10 [14:16:06] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.20, 4.34, 4.01 [14:16:28] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 3.64, 3.89, 3.60 [14:16:31] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.96, 9.29, 9.26 [14:19:58] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.09, 3.77, 3.85 [14:20:00] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 4.11, 3.33, 3.03 [14:20:20] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.55, 10.36, 9.67 [14:21:14] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 2.44, 3.27, 3.17 [14:21:54] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.66, 3.35, 3.07 [14:22:14] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.00, 9.38, 9.40 [14:23:47] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 2.36, 2.92, 2.94 [14:24:09] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.66, 3.11, 3.85 [14:24:28] RECOVERY - gluster102 Current Load on gluster102 is OK: OK - load average: 2.14, 2.76, 3.25 [14:25:56] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.17, 2.69, 3.31 [14:30:09] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.98, 3.80, 3.85 [14:31:40] PROBLEM - mw122 MediaWiki Rendering on mw122 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:31:47] PROBLEM - mw121 MediaWiki Rendering on mw121 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:32:09] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.30, 3.27, 3.64 [14:33:44] RECOVERY - mw122 MediaWiki Rendering on mw122 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 5.437 second response time [14:33:46] RECOVERY - mw121 MediaWiki Rendering on mw121 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.310 second response time [14:34:09] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 11.17, 5.94, 4.55 [14:37:21] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.63, 3.08, 2.60 [14:39:16] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.08, 2.70, 2.52 [14:44:09] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.76, 3.30, 3.86 [14:46:03] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.42, 3.05, 2.70 [14:48:03] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 2.40, 2.91, 2.70 [14:48:09] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.36, 3.09, 3.56 [14:52:09] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.89, 3.46, 3.62 [14:54:09] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.09, 2.63, 3.30 [14:56:48] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.86, 10.45, 9.21 [14:58:42] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.34, 9.90, 9.17 [15:00:00] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 7.09, 4.27, 3.33 [15:00:11] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 7.70, 4.79, 3.97 [15:00:28] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 6.22, 4.22, 3.10 [15:01:56] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.17, 3.61, 3.19 [15:03:56] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.56, 3.29, 3.13 [15:04:28] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 3.71, 3.88, 3.21 [15:08:28] RECOVERY - gluster102 Current Load on gluster102 is OK: OK - load average: 1.99, 2.85, 2.94 [15:10:50] PROBLEM - cp32 PowerDNS Recursor on cp32 is CRITICAL: CRITICAL - Plugin timed out while executing system call [15:10:52] PROBLEM - cp32 SSH on cp32 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:12:52] RECOVERY - cp32 PowerDNS Recursor on cp32 is OK: DNS OK: 1.456 second response time. miraheze.org returns 108.175.15.182,2607:f1c0:1800:26f::1,2607:f1c0:1800:8100::1,74.208.203.152 [15:12:52] RECOVERY - cp32 SSH on cp32 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [15:13:00] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.72, 10.31, 9.58 [15:13:56] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.46, 9.53, 9.20 [15:14:54] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.33, 9.55, 9.39 [15:17:14] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.49, 3.13, 2.43 [15:18:43] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.70, 11.14, 10.13 [15:19:14] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 2.28, 2.81, 2.39 [15:19:22] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.01, 3.09, 2.57 [15:21:19] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 3.39, 3.12, 2.63 [15:21:42] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 9.27, 9.79, 9.54 [15:22:31] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.01, 9.60, 9.74 [15:28:52] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.86, 3.32, 2.95 [15:30:49] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 2.12, 2.91, 2.84 [15:42:09] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.22, 2.61, 3.79 [15:43:57] [02miraheze/ManageWiki] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ManageWiki/compare/ac58165d4c4d...bac5ced33222 [15:43:59] [02miraheze/ManageWiki] 07Universal-Omega 03bac5ced - Make inactive-exempt-reason a selectorother field [15:46:00] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.24, 3.51, 3.07 [15:47:53] miraheze/ManageWiki - Universal-Omega the build passed. [15:47:56] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 3.17, 3.27, 3.03 [15:48:09] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.62, 2.62, 3.40 [15:54:23] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.61, 3.79, 2.90 [15:56:20] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.61, 3.44, 2.86 [15:58:16] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.04, 3.70, 3.03 [16:00:12] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.64, 2.86, 2.80 [16:08:10] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.73, 4.22, 3.65 [16:10:09] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.56, 3.40, 3.42 [16:12:09] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.23, 2.67, 3.15 [16:28:36] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 7.37, 4.88, 3.67 [16:33:01] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.21, 4.60, 3.74 [16:38:28] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 2.59, 3.91, 3.95 [16:40:28] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 3.97, 4.17, 4.04 [16:42:41] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.23, 3.84, 3.75 [16:44:37] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 7.74, 5.64, 4.44 [16:45:04] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.45, 3.63, 2.94 [16:47:01] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.72, 3.30, 2.92 [16:48:28] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 2.71, 3.74, 3.98 [16:50:14] PROBLEM - mw122 MediaWiki Rendering on mw122 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:50:28] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 4.43, 4.34, 4.19 [16:52:15] RECOVERY - mw122 MediaWiki Rendering on mw122 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 3.055 second response time [16:52:28] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 2.24, 3.55, 3.92 [16:54:53] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.83, 3.45, 3.11 [16:56:28] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 4.14, 4.03, 4.03 [16:56:49] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.95, 2.93, 2.95 [16:58:28] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 2.62, 3.44, 3.81 [17:00:04] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.78, 3.27, 3.90 [17:00:28] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 5.46, 4.16, 4.01 [17:02:00] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.15, 3.49, 3.90 [17:03:56] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.64, 3.08, 3.70 [17:08:28] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 1.93, 3.50, 3.94 [17:09:56] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.66, 3.12, 3.46 [17:10:33] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 6.59, 5.21, 3.63 [17:11:56] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.43, 2.71, 3.26 [17:12:13] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.65, 11.03, 9.68 [17:14:27] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.83, 3.59, 3.29 [17:14:28] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 5.04, 4.09, 4.02 [17:15:56] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.21, 3.45, 3.46 [17:16:24] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.00, 3.09, 3.14 [17:16:28] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 1.75, 3.27, 3.74 [17:17:03] PROBLEM - cp22 Current Load on cp22 is WARNING: WARNING - load average: 3.86, 3.16, 2.24 [17:17:56] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 3.35, 3.25, 3.37 [17:19:03] RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 1.68, 2.79, 2.23 [17:21:45] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.64, 9.28, 9.61 [17:24:28] RECOVERY - gluster102 Current Load on gluster102 is OK: OK - load average: 2.06, 2.72, 3.33 [17:30:37] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.85, 3.97, 3.34 [17:32:33] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.90, 3.52, 3.25 [17:34:29] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.26, 3.84, 3.39 [17:36:13] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 8.60, 5.48, 3.58 [17:36:25] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.02, 3.10, 3.17 [17:40:32] !log manually correct the read and write ACL for the miraheze-emiliabearwiki-local-public and miraheze-edcarewiki-local-public Swift containers [17:40:40] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:48:09] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.32, 3.17, 3.66 [17:50:08] PROBLEM - mw122 Disk Space on mw122 is CRITICAL: DISK CRITICAL - free space: / 1252 MB (5% inode=80%); [17:53:35] !log manually create the miraheze-liminalunderworldwiki-local-thumb swift container [17:53:45] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:53:57] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.33, 3.47, 2.82 [17:54:09] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.89, 2.73, 3.35 [17:55:56] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.16, 2.72, 2.62 [18:04:02] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.62, 10.88, 9.79 [18:05:57] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.68, 10.57, 9.82 [18:07:51] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.60, 9.72, 9.58 [18:10:03] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.93, 3.62, 3.33 [18:12:00] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 3.11, 3.36, 3.27 [18:12:07] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.03, 2.88, 2.24 [18:14:04] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 2.22, 2.62, 2.23 [18:16:06] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.28, 4.15, 3.25 [18:17:46] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 2.64, 3.51, 3.20 [18:19:44] RECOVERY - gluster102 Current Load on gluster102 is OK: OK - load average: 2.54, 3.24, 3.14 [18:23:39] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 5.45, 4.49, 3.68 [18:25:37] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 3.52, 3.94, 3.56 [18:27:56] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.77, 3.67, 3.72 [18:27:57] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 5.65, 3.14, 2.24 [18:29:33] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 4.74, 3.88, 3.59 [18:29:56] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 7.77, 4.89, 4.13 [18:31:32] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 3.64, 3.60, 3.51 [18:31:55] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.46, 2.82, 2.34 [18:33:30] RECOVERY - gluster102 Current Load on gluster102 is OK: OK - load average: 2.49, 3.09, 3.33 [18:33:56] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.80, 3.89, 3.87 [18:37:56] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.65, 2.81, 3.40 [18:38:26] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.35, 3.74, 2.88 [18:40:23] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.82, 3.07, 2.73 [18:44:03] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.38, 3.39, 2.61 [18:45:18] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 6.07, 4.60, 3.77 [18:46:03] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 3.13, 3.22, 2.65 [18:47:16] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 2.90, 3.97, 3.64 [18:49:14] RECOVERY - gluster102 Current Load on gluster102 is OK: OK - load average: 1.63, 3.06, 3.34 [18:59:03] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 5.08, 3.83, 3.36 [18:59:12] PROBLEM - mw141 Disk Space on mw141 is WARNING: DISK WARNING - free space: / 2600 MB (10% inode=82%); [19:01:02] RECOVERY - gluster102 Current Load on gluster102 is OK: OK - load average: 2.37, 3.04, 3.12 [19:01:10] RECOVERY - mw141 Disk Space on mw141 is OK: DISK OK - free space: / 2612 MB (11% inode=82%); [19:03:53] [02miraheze/CreateWiki] 07Universal-Omega pushed 031 commit to 03add-job [+1/-0/±0] 13https://github.com/miraheze/CreateWiki/commit/be4b83070af3 [19:03:56] [02miraheze/CreateWiki] 07Universal-Omega 03be4b830 - Add new SetContainersAccessJob [19:03:58] [02CreateWiki] 07Universal-Omega created branch 03add-job - 13https://github.com/miraheze/CreateWiki [19:04:00] [02CreateWiki] 07Universal-Omega opened pull request 03#351: Add new SetContainersAccessJob - 13https://github.com/miraheze/CreateWiki/pull/351 [19:04:36] [02miraheze/CreateWiki] 07Universal-Omega pushed 031 commit to 03add-job [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/be4b83070af3...2cec77df88cf [19:04:39] [02miraheze/CreateWiki] 07Universal-Omega 032cec77d - Update WikiManager.php [19:04:41] [02CreateWiki] 07Universal-Omega synchronize pull request 03#351: Add new SetContainersAccessJob - 13https://github.com/miraheze/CreateWiki/pull/351 [19:05:03] PROBLEM - mw141 Disk Space on mw141 is WARNING: DISK WARNING - free space: / 2602 MB (10% inode=82%); [19:07:33] [02miraheze/CreateWiki] 07Universal-Omega pushed 031 commit to 03add-job [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/2cec77df88cf...bfc2ebe450ce [19:07:36] [02miraheze/CreateWiki] 07Universal-Omega 03bfc2ebe - Update RemoteWiki.php [19:07:37] [02CreateWiki] 07Universal-Omega synchronize pull request 03#351: Add new SetContainersAccessJob - 13https://github.com/miraheze/CreateWiki/pull/351 [19:08:38] miraheze/CreateWiki - Universal-Omega the build has errored. [19:11:27] miraheze/CreateWiki - Universal-Omega the build has errored. [19:12:48] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 16.37, 12.47, 10.39 [19:16:36] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.64, 11.53, 10.49 [19:18:40] [02miraheze/CreateWiki] 07Universal-Omega pushed 031 commit to 03add-job [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/bfc2ebe450ce...5529c8b21ef9 [19:18:41] [02miraheze/CreateWiki] 07Universal-Omega 035529c8b - Update WikiManagerTest.php [19:18:44] [02CreateWiki] 07Universal-Omega synchronize pull request 03#351: Add new SetContainersAccessJob - 13https://github.com/miraheze/CreateWiki/pull/351 [19:21:32] miraheze/CreateWiki - Universal-Omega the build has errored. [19:22:04] [02miraheze/CreateWiki] 07Universal-Omega pushed 031 commit to 03add-job [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/5529c8b21ef9...eb33e2cf4bf9 [19:22:04] [02miraheze/CreateWiki] 07Universal-Omega 03eb33e2c - Update WikiManagerTest.php [19:22:06] [02CreateWiki] 07Universal-Omega synchronize pull request 03#351: Add new SetContainersAccessJob - 13https://github.com/miraheze/CreateWiki/pull/351 [19:22:19] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 9.30, 10.09, 10.14 [19:26:16] PROBLEM - cp32 NTP time on cp32 is WARNING: NTP WARNING: Offset 0.144682616 secs [19:26:17] miraheze/CreateWiki - Universal-Omega the build has errored. [19:27:12] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.88, 3.66, 3.00 [19:30:02] [02miraheze/CreateWiki] 07Universal-Omega pushed 031 commit to 03add-job [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/eb33e2cf4bf9...251ab44968e8 [19:30:05] [02miraheze/CreateWiki] 07Universal-Omega 03251ab44 - Update WikiManagerTest.php [19:30:06] [02CreateWiki] 07Universal-Omega synchronize pull request 03#351: Add new SetContainersAccessJob - 13https://github.com/miraheze/CreateWiki/pull/351 [19:31:05] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.18, 2.66, 2.77 [19:34:12] miraheze/CreateWiki - Universal-Omega the build has errored. [19:39:20] [02miraheze/CreateWiki] 07Universal-Omega pushed 031 commit to 03add-job [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/251ab44968e8...c37f4a4edb38 [19:39:21] [02miraheze/CreateWiki] 07Universal-Omega 03c37f4a4 - Update WikiManagerTest.php [19:39:22] [02CreateWiki] 07Universal-Omega synchronize pull request 03#351: Add new SetContainersAccessJob - 13https://github.com/miraheze/CreateWiki/pull/351 [19:40:00] [02miraheze/CreateWiki] 07Universal-Omega pushed 031 commit to 03add-job [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/c37f4a4edb38...f2d076a3d57b [19:40:01] [02miraheze/CreateWiki] 07Universal-Omega 03f2d076a - Update WikiManagerTest.php [19:40:03] [02CreateWiki] 07Universal-Omega synchronize pull request 03#351: Add new SetContainersAccessJob - 13https://github.com/miraheze/CreateWiki/pull/351 [19:44:13] miraheze/CreateWiki - Universal-Omega the build has errored. [19:44:17] [02CreateWiki] 07Universal-Omega synchronize pull request 03#351: Add new SetContainersAccessJob - 13https://github.com/miraheze/CreateWiki/pull/351 [19:44:20] [02miraheze/CreateWiki] 07Universal-Omega pushed 031 commit to 03add-job [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/f2d076a3d57b...749da71c3be4 [19:44:22] [02miraheze/CreateWiki] 07Universal-Omega 03749da71 - Update WikiManagerTest.php [19:48:12] miraheze/CreateWiki - Universal-Omega the build has errored. [19:48:16] RECOVERY - cp32 NTP time on cp32 is OK: NTP OK: Offset 0.08091768622 secs [20:04:04] [02miraheze/CreateWiki] 07Universal-Omega pushed 031 commit to 03add-job [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/749da71c3be4...9c9762610cff [20:04:07] [02miraheze/CreateWiki] 07Universal-Omega 039c97626 - Update WikiManagerTest.php [20:04:08] [02CreateWiki] 07Universal-Omega synchronize pull request 03#351: Add new SetContainersAccessJob - 13https://github.com/miraheze/CreateWiki/pull/351 [20:08:06] miraheze/CreateWiki - Universal-Omega the build has errored. [20:08:09] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 6.12, 4.00, 2.82 [20:10:26] [02miraheze/CreateWiki] 07Universal-Omega pushed 031 commit to 03add-job [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/9c9762610cff...7e6225557835 [20:10:28] [02miraheze/CreateWiki] 07Universal-Omega 037e62255 - Update WikiManagerTest.php [20:10:31] [02CreateWiki] 07Universal-Omega synchronize pull request 03#351: Add new SetContainersAccessJob - 13https://github.com/miraheze/CreateWiki/pull/351 [20:14:34] miraheze/CreateWiki - Universal-Omega the build has errored. [20:16:09] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.05, 3.87, 3.52 [20:18:09] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.28, 3.96, 3.57 [20:20:09] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.38, 3.45, 3.42 [20:22:09] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.64, 2.93, 3.24 [20:25:57] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.03, 4.11, 3.20 [20:29:56] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.03, 3.45, 3.19 [20:31:55] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 4.45, 3.02, 1.95 [20:31:57] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.00, 3.23, 3.16 [20:33:55] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.61, 2.55, 1.92 [20:45:56] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.19, 4.45, 3.19 [20:47:56] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.32, 3.58, 3.02 [20:49:22] [02miraheze/CreateWiki] 07Universal-Omega pushed 031 commit to 03add-job [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/7e6225557835...58907333f57f [20:49:25] [02miraheze/CreateWiki] 07Universal-Omega 035890733 - Update WikiManagerTest.php [20:49:36] [02CreateWiki] 07Universal-Omega synchronize pull request 03#351: Add new SetContainersAccessJob - 13https://github.com/miraheze/CreateWiki/pull/351 [20:49:56] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.76, 3.22, 2.94 [20:50:48] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.07, 3.69, 3.05 [20:52:16] PROBLEM - cp32 NTP time on cp32 is WARNING: NTP WARNING: Offset 0.2418727577 secs [20:52:45] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.30, 3.45, 3.03 [20:53:44] miraheze/CreateWiki - Universal-Omega the build has errored. [20:54:41] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.23, 2.92, 2.88 [20:56:16] RECOVERY - cp32 NTP time on cp32 is OK: NTP OK: Offset -0.01804211736 secs [21:05:27] [02miraheze/CreateWiki] 07Universal-Omega pushed 031 commit to 03add-job [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/58907333f57f...51f9f65c9898 [21:05:29] [02miraheze/CreateWiki] 07Universal-Omega 0351f9f65 - Update WikiManagerTest.php [21:05:31] [02CreateWiki] 07Universal-Omega synchronize pull request 03#351: Add new SetContainersAccessJob - 13https://github.com/miraheze/CreateWiki/pull/351 [21:08:29] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.77, 3.90, 3.22 [21:09:34] miraheze/CreateWiki - Universal-Omega the build has errored. [21:12:09] [02miraheze/CreateWiki] 07Universal-Omega pushed 031 commit to 03add-job [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/51f9f65c9898...250b0115e999 [21:12:11] [02miraheze/CreateWiki] 07Universal-Omega 03250b011 - Update WikiManagerTest.php [21:12:14] [02CreateWiki] 07Universal-Omega synchronize pull request 03#351: Add new SetContainersAccessJob - 13https://github.com/miraheze/CreateWiki/pull/351 [21:12:23] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.52, 3.69, 3.34 [21:14:20] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.84, 4.06, 3.49 [21:16:03] miraheze/CreateWiki - Universal-Omega the build has errored. [21:18:14] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.06, 3.54, 3.41 [21:22:09] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.38, 3.20, 3.32 [21:22:33] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 5.67, 3.52, 2.50 [21:24:28] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 3.92, 3.92, 2.79 [21:25:11] [02miraheze/CreateWiki] 07Universal-Omega pushed 031 commit to 03add-job [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/250b0115e999...c64a8d4ebc7a [21:25:14] [02miraheze/CreateWiki] 07Universal-Omega 03c64a8d4 - Update extension.json [21:25:15] [02CreateWiki] 07Universal-Omega synchronize pull request 03#351: Add new SetContainersAccessJob - 13https://github.com/miraheze/CreateWiki/pull/351 [21:26:09] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.26, 3.59, 3.47 [21:26:16] PROBLEM - cp32 NTP time on cp32 is WARNING: NTP WARNING: Offset 0.2049616277 secs [21:26:24] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 2.51, 3.33, 2.70 [21:27:57] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.18, 4.74, 3.52 [21:28:09] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.19, 3.01, 3.27 [21:29:24] miraheze/CreateWiki - Universal-Omega the build has errored. [21:30:39] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 8.99, 6.17, 3.71 [21:31:10] [02miraheze/CreateWiki] 07Universal-Omega pushed 031 commit to 03add-job [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/c64a8d4ebc7a...f5831c41f340 [21:31:12] [02miraheze/CreateWiki] 07Universal-Omega 03f5831c4 - Update WikiManagerTest.php [21:31:15] [02CreateWiki] 07Universal-Omega synchronize pull request 03#351: Add new SetContainersAccessJob - 13https://github.com/miraheze/CreateWiki/pull/351 [21:31:28] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 4.00, 4.75, 3.48 [21:31:57] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.64, 3.35, 3.25 [21:34:16] RECOVERY - cp32 NTP time on cp32 is OK: NTP OK: Offset 0.04072231054 secs [21:35:00] miraheze/CreateWiki - Universal-Omega the build has errored. [21:36:10] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.37, 3.83, 3.44 [21:42:00] [02miraheze/CreateWiki] 07Universal-Omega pushed 031 commit to 03add-job [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/f5831c41f340...cb4b8d82814f [21:42:03] [02miraheze/CreateWiki] 07Universal-Omega 03cb4b8d8 - Update WikiManagerTest.php [21:42:06] [02CreateWiki] 07Universal-Omega synchronize pull request 03#351: Add new SetContainersAccessJob - 13https://github.com/miraheze/CreateWiki/pull/351 [21:43:42] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.91, 10.17, 8.96 [21:45:42] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.09, 9.26, 8.76 [21:45:55] PROBLEM - cp22 Current Load on cp22 is CRITICAL: CRITICAL - load average: 5.01, 3.86, 2.69 [21:46:26] miraheze/CreateWiki - Universal-Omega the build has errored. [21:46:58] [02miraheze/CreateWiki] 07Universal-Omega pushed 031 commit to 03add-job [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/cb4b8d82814f...13f44066ec37 [21:46:59] [02miraheze/CreateWiki] 07Universal-Omega 0313f4406 - Update WikiManagerTest.php [21:47:02] [02CreateWiki] 07Universal-Omega synchronize pull request 03#351: Add new SetContainersAccessJob - 13https://github.com/miraheze/CreateWiki/pull/351 [21:47:52] RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 1.46, 2.90, 2.48 [21:49:59] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.66, 3.79, 3.93 [21:51:02] miraheze/CreateWiki - Universal-Omega the build has errored. [21:51:56] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.53, 4.20, 4.06 [21:53:56] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.50, 3.98, 4.00 [21:54:31] [02miraheze/CreateWiki] 07Universal-Omega pushed 031 commit to 03add-job [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/13f44066ec37...2f79209723bf [21:54:33] [02miraheze/CreateWiki] 07Universal-Omega 032f79209 - Update WikiManagerTest.php [21:54:35] [02CreateWiki] 07Universal-Omega synchronize pull request 03#351: Add new SetContainersAccessJob - 13https://github.com/miraheze/CreateWiki/pull/351 [21:55:56] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.57, 4.49, 4.20 [21:58:28] miraheze/CreateWiki - Universal-Omega the build has errored. [22:01:25] [02CreateWiki] 07Universal-Omega synchronize pull request 03#351: Add new SetContainersAccessJob - 13https://github.com/miraheze/CreateWiki/pull/351 [22:01:27] [02miraheze/CreateWiki] 07Universal-Omega pushed 031 commit to 03add-job [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/2f79209723bf...5438ad751526 [22:01:28] [02miraheze/CreateWiki] 07Universal-Omega 035438ad7 - Update WikiManagerTest.php [22:02:33] [02miraheze/CreateWiki] 07Universal-Omega pushed 031 commit to 03add-job [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/5438ad751526...60161f3fa5bc [22:02:34] [02miraheze/CreateWiki] 07Universal-Omega 0360161f3 - Update WikiManagerTest.php [22:02:37] [02CreateWiki] 07Universal-Omega synchronize pull request 03#351: Add new SetContainersAccessJob - 13https://github.com/miraheze/CreateWiki/pull/351 [22:04:09] [02miraheze/CreateWiki] 07github-actions[bot] pushed 031 commit to 03add-job [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/60161f3fa5bc...b29a05e73c0d [22:04:10] [02miraheze/CreateWiki] 07github-actions 03b29a05e - CI: lint code to MediaWiki standards [22:04:11] [02CreateWiki] 07github-actions[bot] synchronize pull request 03#351: Add new SetContainersAccessJob - 13https://github.com/miraheze/CreateWiki/pull/351 [22:06:44] miraheze/CreateWiki - Universal-Omega the build has errored. [22:11:14] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 4.20, 3.00, 2.31 [22:12:05] PROBLEM - wiki.hylormc.tk - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.hylormc.tk' expires in 15 day(s) (Thu 17 Nov 2022 21:52:31 GMT +0000). [22:15:14] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 2.25, 3.06, 2.54 [22:16:21] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.15, 3.32, 2.62 [22:16:48] [02miraheze/CreateWiki] 07Universal-Omega pushed 031 commit to 03add-job [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/b29a05e73c0d...c23276f2e303 [22:16:51] [02miraheze/CreateWiki] 07Universal-Omega 03c23276f - Update SetContainersAccessJob.php [22:16:52] [02CreateWiki] 07Universal-Omega synchronize pull request 03#351: Add new SetContainersAccessJob - 13https://github.com/miraheze/CreateWiki/pull/351 [22:17:56] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.50, 3.03, 3.84 [22:18:09] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.30, 3.07, 3.90 [22:18:18] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 2.04, 2.83, 2.52 [22:19:56] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.23, 4.03, 4.12 [22:19:59] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/b03af52220c7...fbcac2b7f594 [22:20:01] [02miraheze/ssl] 07MirahezeSSLBot 03fbcac2b - Bot: Update SSL cert for wiki.hylormc.tk [22:20:06] [02miraheze/CreateWiki] 07dependabot[bot] pushed 031 commit to 03dependabot/composer/mediawiki/mediawiki-codesniffer-40.0.1 [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/commit/68d730958529 [22:20:08] [02miraheze/CreateWiki] 07dependabot[bot] 0368d7309 - Update mediawiki/mediawiki-codesniffer requirement from 39.0.0 to 40.0.1 [22:20:10] [02CreateWiki] 07dependabot[bot] created branch 03dependabot/composer/mediawiki/mediawiki-codesniffer-40.0.1 - 13https://github.com/miraheze/CreateWiki [22:20:13] [02CreateWiki] 07dependabot[bot] opened pull request 03#352: Update mediawiki/mediawiki-codesniffer requirement from 39.0.0 to 40.0.1 - 13https://github.com/miraheze/CreateWiki/pull/352 [22:20:15] [02CreateWiki] 07dependabot[bot] labeled pull request 03#352: Update mediawiki/mediawiki-codesniffer requirement from 39.0.0 to 40.0.1 - 13https://github.com/miraheze/CreateWiki/pull/352 [22:20:16] [02CreateWiki] 07dependabot[bot] labeled pull request 03#352: Update mediawiki/mediawiki-codesniffer requirement from 39.0.0 to 40.0.1 - 13https://github.com/miraheze/CreateWiki/pull/352 [22:20:40] miraheze/CreateWiki - Universal-Omega the build has errored. [22:21:56] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.10, 3.54, 3.93 [22:24:28] [02miraheze/IncidentReporting] 07dependabot[bot] pushed 031 commit to 03dependabot/composer/mediawiki/mediawiki-codesniffer-40.0.1 [+0/-0/±1] 13https://github.com/miraheze/IncidentReporting/commit/f22a54f31c80 [22:24:29] [02miraheze/IncidentReporting] 07dependabot[bot] 03f22a54f - Update mediawiki/mediawiki-codesniffer requirement from 39.0.0 to 40.0.1 [22:24:30] [02IncidentReporting] 07dependabot[bot] created branch 03dependabot/composer/mediawiki/mediawiki-codesniffer-40.0.1 - 13https://github.com/miraheze/IncidentReporting [22:24:31] [02IncidentReporting] 07dependabot[bot] opened pull request 03#51: Update mediawiki/mediawiki-codesniffer requirement from 39.0.0 to 40.0.1 - 13https://github.com/miraheze/IncidentReporting/pull/51 [22:24:34] [02IncidentReporting] 07dependabot[bot] labeled pull request 03#51: Update mediawiki/mediawiki-codesniffer requirement from 39.0.0 to 40.0.1 - 13https://github.com/miraheze/IncidentReporting/pull/51 [22:24:35] [02IncidentReporting] 07dependabot[bot] labeled pull request 03#51: Update mediawiki/mediawiki-codesniffer requirement from 39.0.0 to 40.0.1 - 13https://github.com/miraheze/IncidentReporting/pull/51 [22:24:41] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 1.40, 2.80, 3.83 [22:25:56] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.76, 3.53, 3.78 [22:26:09] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.50, 3.29, 3.58 [22:27:52] miraheze/IncidentReporting - dependabot[bot] the build passed. [22:27:56] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.51, 2.92, 3.51 [22:28:09] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.04, 3.15, 3.50 [22:28:37] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 4.95, 3.22, 3.72 [22:30:01] [02miraheze/CreateWiki] 07Universal-Omega pushed 031 commit to 03add-job [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/c23276f2e303...3fedcc04431f [22:30:03] [02miraheze/CreateWiki] 07Universal-Omega 033fedcc0 - Update WikiManagerTest.php [22:30:04] [02CreateWiki] 07Universal-Omega synchronize pull request 03#351: Add new SetContainersAccessJob - 13https://github.com/miraheze/CreateWiki/pull/351 [22:30:09] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.01, 2.78, 3.32 [22:30:43] miraheze/CreateWiki - dependabot[bot] the build passed. [22:31:12] PROBLEM - mw121 MediaWiki Rendering on mw121 is CRITICAL: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - 314 bytes in 0.027 second response time [22:31:56] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.59, 2.75, 3.36 [22:32:34] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 3.11, 3.47, 3.77 [22:33:52] [discord] Getting repeated 500s [22:33:56] miraheze/CreateWiki - Universal-Omega the build has errored. [22:36:47] [02miraheze/CreateWiki] 07Universal-Omega pushed 031 commit to 03add-job [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/3fedcc04431f...7484c3241e37 [22:36:49] [02miraheze/CreateWiki] 07Universal-Omega 037484c32 - Update WikiManagerTest.php [22:36:50] [02CreateWiki] 07Universal-Omega synchronize pull request 03#351: Add new SetContainersAccessJob - 13https://github.com/miraheze/CreateWiki/pull/351 [22:38:11] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.93, 3.55, 3.44 [22:38:28] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 4.97, 3.59, 3.66 [22:38:53] [discord] @CosmicAlpha might you be able to reproduce? ^ [22:40:01] oh... [22:40:05] miraheze/CreateWiki - Universal-Omega the build has errored. [22:40:09] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.65, 3.87, 3.57 [22:40:29] [discord] cp32 is serving me when I get a 500 [22:40:46] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.58, 3.66, 3.47 [22:41:07] We ran out of disk space on MediaWiki servers [22:41:17] [discord] neat [22:41:24] mw121 and mw122 at least [22:42:09] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.39, 3.30, 3.39 [22:42:21] A ton of files in the tmp folders... [22:43:36] RECOVERY - mw121 Disk Space on mw121 is OK: DISK OK - free space: / 9501 MB (43% inode=80%); [22:43:43] RECOVERY - mw122 Disk Space on mw122 is OK: DISK OK - free space: / 9538 MB (43% inode=80%); [22:45:26] !log rm /tmp/*.* on mw121, mw122, and mw141 [22:46:18] !log rm /tmp/*.* on mw121, mw122, and mw141 [22:46:22] RECOVERY - mw141 Disk Space on mw141 is OK: DISK OK - free space: / 11619 MB (48% inode=82%); [22:46:33] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.07, 3.41, 3.53 [22:48:12] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 2.06, 2.92, 3.91 [22:48:29] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.65, 3.04, 3.37 [22:49:17] @paladox it seems due to having a lot in temp due to Swift in order to then upload it is stored in temp, this seems to be causing issues.... [22:50:14] PROBLEM - db112 Current Load on db112 is WARNING: WARNING - load average: 7.53, 6.11, 3.96 [22:51:00] hmm.... mw121 is still not working even though I deleted from /tmp... [22:52:12] PROBLEM - test131 Current Load on test131 is CRITICAL: CRITICAL - load average: 4.56, 3.94, 4.10 [22:52:14] RECOVERY - db112 Current Load on db112 is OK: OK - load average: 6.00, 6.50, 4.40 [22:53:24] miraheze/CreateWiki - Universal-Omega the build has errored. [22:54:12] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 2.40, 3.35, 3.86 [22:54:26] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.58, 2.64, 2.33 [22:54:28] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 1.45, 3.07, 3.80 [22:56:12] PROBLEM - test131 Current Load on test131 is CRITICAL: CRITICAL - load average: 4.32, 3.58, 3.87 [22:56:14] PROBLEM - db112 Current Load on db112 is WARNING: WARNING - load average: 6.86, 7.47, 5.31 [22:56:22] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.37, 2.36, 2.25 [22:58:12] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 3.07, 3.44, 3.79 [22:58:14] PROBLEM - db112 Current Load on db112 is CRITICAL: CRITICAL - load average: 11.81, 9.46, 6.29 [22:58:28] RECOVERY - gluster102 Current Load on gluster102 is OK: OK - load average: 1.67, 2.43, 3.36 [22:58:47] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 4.13, 3.25, 2.05 [23:00:42] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.57, 2.67, 1.98 [23:05:03] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.54, 3.65, 3.16 [23:06:12] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 2.01, 2.87, 3.40 [23:07:00] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 6.28, 4.28, 3.43 [23:10:12] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 3.72, 3.43, 3.51 [23:10:29] !log regenerate ManageWiki cache on mw121 [23:10:36] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:10:39] !log rm /tmp/*.* on mw121, mw122, and mw141 [23:10:45] RECOVERY - wiki.hylormc.tk - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.hylormc.tk' will expire on Mon 30 Jan 2023 21:19:53 GMT +0000. [23:10:52] RECOVERY - mw121 MediaWiki Rendering on mw121 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.953 second response time [23:11:19] !log rm /tmp/*.* on mw121, mw122, and mw141 [23:11:31] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:11:42] finally [23:12:12] PROBLEM - test131 Current Load on test131 is CRITICAL: CRITICAL - load average: 4.65, 3.96, 3.70 [23:12:13] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:14:03] PROBLEM - mw132 Current Load on mw132 is WARNING: WARNING - load average: 9.13, 10.69, 7.94 [23:14:11] [02miraheze/CreateWiki] 07Universal-Omega pushed 031 commit to 03add-job [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/7484c3241e37...0a6402d0578e [23:14:14] [02miraheze/CreateWiki] 07Universal-Omega 030a6402d - Use script [23:14:17] [02CreateWiki] 07Universal-Omega synchronize pull request 03#351: Add new SetContainersAccessJob - 13https://github.com/miraheze/CreateWiki/pull/351 [23:14:49] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.08, 3.64, 3.64 [23:15:09] [02miraheze/CreateWiki] 07Universal-Omega pushed 031 commit to 03add-job [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/0a6402d0578e...7b33144146ef [23:15:11] [02miraheze/CreateWiki] 07Universal-Omega 037b33144 - Update WikiManagerTest.php [23:15:13] [02CreateWiki] 07Universal-Omega synchronize pull request 03#351: Add new SetContainersAccessJob - 13https://github.com/miraheze/CreateWiki/pull/351 [23:16:03] RECOVERY - mw132 Current Load on mw132 is OK: OK - load average: 5.42, 8.80, 7.58 [23:16:12] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 3.07, 3.68, 3.66 [23:18:43] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.27, 2.68, 3.28 [23:19:42] miraheze/CreateWiki - Universal-Omega the build has errored. [23:22:14] PROBLEM - db112 Current Load on db112 is WARNING: WARNING - load average: 3.07, 5.06, 7.98 [23:26:12] PROBLEM - test131 Current Load on test131 is CRITICAL: CRITICAL - load average: 4.70, 3.95, 3.73 [23:27:02] miraheze/CreateWiki - Universal-Omega the build has errored. [23:27:34] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.29, 3.54, 3.52 [23:28:14] PROBLEM - db112 Current Load on db112 is CRITICAL: CRITICAL - load average: 37.08, 16.54, 11.12 [23:29:06] [02miraheze/CreateWiki] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/20e3bb5077c1...4ab1c09e05b1 [23:29:09] [02miraheze/CreateWiki] 07Universal-Omega 034ab1c09 - Support using CW_DB constant [23:29:31] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.70, 3.18, 3.38 [23:29:49] [02miraheze/CreateWiki] 07Universal-Omega pushed 032 commits to 03add-job [+0/-0/±2] 13https://github.com/miraheze/CreateWiki/compare/7b33144146ef...091aca04625b [23:29:51] [02miraheze/CreateWiki] 07Universal-Omega 03091aca0 - Merge branch 'master' into add-job [23:29:52] [02CreateWiki] 07Universal-Omega synchronize pull request 03#351: Add new SetContainersAccessJob - 13https://github.com/miraheze/CreateWiki/pull/351 [23:35:01] miraheze/CreateWiki - Universal-Omega the build has errored. [23:35:10] PROBLEM - mw131 Disk Space on mw131 is WARNING: DISK WARNING - free space: / 2598 MB (10% inode=82%); [23:36:12] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 2.53, 3.83, 3.92 [23:36:47] PROBLEM - mw142 MediaWiki Rendering on mw142 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [23:37:22] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.16, 3.43, 3.32 [23:37:40] miraheze/CreateWiki - Universal-Omega the build passed. [23:38:29] PROBLEM - wiki.mastodon.kr - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.mastodon.kr' expires in 15 day(s) (Thu 17 Nov 2022 23:31:22 GMT +0000). [23:38:43] RECOVERY - mw142 MediaWiki Rendering on mw142 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.621 second response time [23:39:19] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.15, 2.93, 3.15 [23:42:43] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/fbcac2b7f594...8da945f169a3 [23:42:45] [02miraheze/ssl] 07MirahezeSSLBot 038da945f - Bot: Update SSL cert for wiki.mastodon.kr [23:44:12] PROBLEM - test131 Current Load on test131 is CRITICAL: CRITICAL - load average: 4.34, 3.22, 3.47 [23:46:12] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 2.74, 3.03, 3.38 [23:51:03] PROBLEM - cp22 Current Load on cp22 is WARNING: WARNING - load average: 3.05, 3.97, 2.62 [23:53:03] RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 0.58, 2.71, 2.32 [23:55:11] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 3.56, 3.79, 3.54 [23:55:15] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 4.27, 3.12, 2.21 [23:57:10] PROBLEM - test131 Current Load on test131 is CRITICAL: CRITICAL - load average: 5.21, 4.20, 3.72 [23:57:14] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 3.32, 3.16, 2.34