[00:08:07] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 7.37, 7.83, 5.32 [00:11:03] PROBLEM - cp22 Current Load on cp22 is WARNING: WARNING - load average: 3.88, 2.71, 1.47 [00:13:02] RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 2.54, 2.41, 1.50 [00:15:39] PROBLEM - revi.wiki - PositiveSSLDV on sslhost is WARNING: WARNING - Certificate 'revi.wiki' expires in 30 day(s) (Thu 29 Dec 2022 23:59:59 GMT +0000). [00:16:58] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.28, 3.55, 3.16 [00:17:29] RECOVERY - cp32 NTP time on cp32 is OK: NTP OK: Offset 0.05759990215 secs [00:18:54] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 2.62, 3.28, 3.11 [00:21:34] [02mediawiki] 07alistair3149 edited a comment on pull request 03#11745: Bump skins/Citizen from `47d7be4` to `f041b2c` - 13https://github.com/miraheze/mediawiki/pull/11745#issuecomment-1328395173 [00:21:35] [url] Bump skins/Citizen from `47d7be4` to `f041b2c` by dependabot[bot] · Pull Request #11745 · miraheze/mediawiki · GitHub | github.com [00:22:07] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.82, 2.66, 3.85 [00:28:07] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.25, 2.05, 3.19 [00:28:39] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 6.89, 4.85, 3.18 [00:30:36] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.31, 3.88, 3.02 [00:31:29] PROBLEM - cp32 NTP time on cp32 is WARNING: NTP WARNING: Offset -0.1049751043 secs [00:32:33] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.18, 2.96, 2.79 [00:33:28] RECOVERY - cp32 NTP time on cp32 is OK: NTP OK: Offset -0.07319149375 secs [00:40:07] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.37, 7.86, 5.29 [00:46:07] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 0.85, 3.08, 3.94 [00:46:37] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.81, 3.18, 2.63 [00:48:36] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 1.50, 2.50, 2.45 [00:52:07] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.36, 3.21, 3.60 [00:52:08] PROBLEM - gluster122 Current Load on gluster122 is CRITICAL: CRITICAL - load average: 4.58, 3.93, 3.03 [00:54:04] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.69, 2.55, 2.08 [00:54:04] PROBLEM - gluster122 Current Load on gluster122 is WARNING: WARNING - load average: 3.52, 3.87, 3.12 [00:54:07] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.81, 3.67, 3.75 [00:56:00] PROBLEM - gluster122 Current Load on gluster122 is CRITICAL: CRITICAL - load average: 3.88, 4.11, 3.31 [00:56:01] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.03, 2.28, 2.03 [00:57:37] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 3.54, 3.17, 2.48 [00:57:57] PROBLEM - gluster122 Current Load on gluster122 is WARNING: WARNING - load average: 2.68, 3.72, 3.27 [00:58:07] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.02, 2.71, 3.33 [00:59:37] RECOVERY - gluster112 Current Load on gluster112 is OK: OK - load average: 1.85, 2.66, 2.38 [00:59:53] RECOVERY - gluster122 Current Load on gluster122 is OK: OK - load average: 1.85, 3.09, 3.09 [01:07:37] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 3.28, 3.67, 3.06 [01:08:07] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 7.61, 4.51, 3.58 [01:09:31] PROBLEM - cp32 NTP time on cp32 is WARNING: NTP WARNING: Offset 0.2713367641 secs [01:09:37] RECOVERY - gluster112 Current Load on gluster112 is OK: OK - load average: 2.46, 3.27, 2.98 [01:10:07] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.39, 3.59, 3.35 [01:12:07] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.47, 2.89, 3.13 [01:39:29] RECOVERY - cp32 NTP time on cp32 is OK: NTP OK: Offset 0.02784308791 secs [01:39:44] PROBLEM - gluster122 Current Load on gluster122 is CRITICAL: CRITICAL - load average: 5.85, 4.11, 3.23 [01:41:40] PROBLEM - gluster122 Current Load on gluster122 is WARNING: WARNING - load average: 2.84, 3.75, 3.22 [01:43:37] RECOVERY - gluster122 Current Load on gluster122 is OK: OK - load average: 2.02, 3.18, 3.07 [01:51:24] PROBLEM - gluster122 Current Load on gluster122 is WARNING: WARNING - load average: 2.83, 3.63, 3.32 [01:57:13] RECOVERY - gluster122 Current Load on gluster122 is OK: OK - load average: 2.04, 3.23, 3.27 [02:37:14] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 3.53, 3.52, 2.95 [02:38:42] PROBLEM - gluster122 Current Load on gluster122 is WARNING: WARNING - load average: 3.73, 3.73, 3.26 [02:41:03] RECOVERY - gluster112 Current Load on gluster112 is OK: OK - load average: 1.89, 2.85, 2.82 [02:42:35] RECOVERY - gluster122 Current Load on gluster122 is OK: OK - load average: 2.28, 3.18, 3.16 [02:56:11] PROBLEM - gluster122 Current Load on gluster122 is CRITICAL: CRITICAL - load average: 4.16, 3.33, 3.03 [02:58:20] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 6.84, 4.39, 3.37 [03:03:57] PROBLEM - gluster122 Current Load on gluster122 is WARNING: WARNING - load average: 1.84, 4.00, 3.85 [03:04:04] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 2.74, 3.65, 3.42 [03:04:54] PROBLEM - swiftac111 NTP time on swiftac111 is WARNING: NTP WARNING: Offset -0.1042068601 secs [03:05:59] RECOVERY - gluster112 Current Load on gluster112 is OK: OK - load average: 2.59, 3.26, 3.30 [03:06:59] RECOVERY - swiftac111 NTP time on swiftac111 is OK: NTP OK: Offset -0.08671435714 secs [03:09:46] PROBLEM - gluster122 Current Load on gluster122 is CRITICAL: CRITICAL - load average: 4.03, 3.83, 3.79 [03:13:38] PROBLEM - gluster122 Current Load on gluster122 is WARNING: WARNING - load average: 2.26, 3.27, 3.60 [03:17:31] RECOVERY - gluster122 Current Load on gluster122 is OK: OK - load average: 2.21, 2.82, 3.35 [03:28:04] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 3.62, 3.16, 3.06 [03:28:22] PROBLEM - cp22 NTP time on cp22 is WARNING: NTP WARNING: Offset 0.104482621 secs [03:30:33] PROBLEM - datacrondatabase.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for datacrondatabase.com could not be found [03:30:44] PROBLEM - datacrondatabase.com - LetsEncrypt on sslhost is CRITICAL: connect to address datacrondatabase.com and port 443: Network is unreachableHTTP CRITICAL - Unable to open TCP socket [03:31:53] RECOVERY - gluster112 Current Load on gluster112 is OK: OK - load average: 1.93, 2.87, 2.99 [03:38:07] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 8.52, 5.39, 3.13 [03:39:52] PROBLEM - gluster122 Current Load on gluster122 is CRITICAL: CRITICAL - load average: 4.29, 3.24, 3.08 [03:41:49] RECOVERY - gluster122 Current Load on gluster122 is OK: OK - load average: 2.72, 3.09, 3.05 [03:46:07] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.45, 3.44, 3.55 [03:48:07] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.63, 2.88, 3.33 [03:50:22] RECOVERY - cp22 NTP time on cp22 is OK: NTP OK: Offset 0.0942594707 secs [03:57:40] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.82, 3.87, 2.53 [03:58:31] PROBLEM - cp33 NTP time on cp33 is WARNING: NTP WARNING: Offset 0.2673497498 secs [03:59:28] RECOVERY - datacrondatabase.com - LetsEncrypt on sslhost is OK: OK - Certificate 'datacrondatabase.com' will expire on Thu 23 Feb 2023 22:23:59 GMT +0000. [03:59:39] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.55, 2.99, 2.37 [04:08:57] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.40, 3.07, 2.58 [04:10:52] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.52, 2.77, 2.52 [04:16:31] RECOVERY - cp33 NTP time on cp33 is OK: NTP OK: Offset -0.006696403027 secs [04:30:44] PROBLEM - datacrondatabase.com - LetsEncrypt on sslhost is CRITICAL: connect to address datacrondatabase.com and port 443: Network is unreachableHTTP CRITICAL - Unable to open TCP socket [04:38:07] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 9.16, 5.37, 3.39 [04:48:07] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 0.98, 3.01, 3.76 [04:50:07] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 0.79, 2.28, 3.40 [04:50:39] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 3.73, 3.60, 3.10 [04:52:33] RECOVERY - gluster112 Current Load on gluster112 is OK: OK - load average: 1.72, 2.94, 2.92 [04:55:02] PROBLEM - gluster122 Current Load on gluster122 is WARNING: WARNING - load average: 3.94, 3.51, 3.14 [04:55:40] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.99, 3.33, 2.11 [04:57:02] PROBLEM - gluster122 Current Load on gluster122 is CRITICAL: CRITICAL - load average: 4.09, 3.71, 3.26 [04:59:02] PROBLEM - gluster122 Current Load on gluster122 is WARNING: WARNING - load average: 3.43, 3.48, 3.22 [04:59:39] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.10, 2.63, 2.16 [05:01:03] RECOVERY - gluster122 Current Load on gluster122 is OK: OK - load average: 2.60, 3.04, 3.08 [05:04:59] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 3.98, 3.77, 3.33 [05:05:02] PROBLEM - gluster122 Current Load on gluster122 is CRITICAL: CRITICAL - load average: 5.90, 4.58, 3.70 [05:06:53] RECOVERY - gluster112 Current Load on gluster112 is OK: OK - load average: 1.45, 2.89, 3.05 [05:07:00] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.01, 2.75, 1.64 [05:08:08] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 7.94, 4.38, 3.15 [05:09:00] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.19, 2.43, 1.66 [05:12:07] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.59, 3.71, 3.28 [05:14:07] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.60, 2.98, 3.06 [05:16:26] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 4.72, 3.66, 3.20 [05:16:33] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 3.86, 3.26, 2.29 [05:18:33] RECOVERY - gluster102 Current Load on gluster102 is OK: OK - load average: 0.95, 2.39, 2.08 [05:20:15] RECOVERY - gluster112 Current Load on gluster112 is OK: OK - load average: 2.08, 3.37, 3.25 [05:27:02] PROBLEM - gluster122 Current Load on gluster122 is WARNING: WARNING - load average: 1.08, 2.62, 3.77 [05:33:02] PROBLEM - gluster122 Current Load on gluster122 is CRITICAL: CRITICAL - load average: 4.18, 3.06, 3.52 [05:36:07] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.46, 2.61, 2.20 [05:37:02] RECOVERY - gluster122 Current Load on gluster122 is OK: OK - load average: 2.61, 2.96, 3.38 [05:38:07] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 8.98, 5.02, 3.12 [05:58:07] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.02, 2.03, 3.68 [06:00:07] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 0.74, 1.62, 3.32 [06:01:58] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 3.66, 3.33, 2.96 [06:03:53] RECOVERY - gluster112 Current Load on gluster112 is OK: OK - load average: 2.77, 3.07, 2.90 [06:09:37] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 4.81, 3.92, 3.25 [06:10:07] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.78, 2.89, 3.04 [06:11:10] PROBLEM - gluster122 Current Load on gluster122 is WARNING: WARNING - load average: 3.79, 3.32, 2.66 [06:12:07] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.07, 3.21, 3.13 [06:13:36] PROBLEM - cp32 NTP time on cp32 is WARNING: NTP WARNING: Offset 0.436501354 secs [06:13:37] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 3.29, 3.77, 3.34 [06:14:07] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.43, 2.97, 3.05 [06:15:03] RECOVERY - gluster122 Current Load on gluster122 is OK: OK - load average: 1.79, 3.02, 2.73 [06:15:37] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 3.93, 4.08, 3.52 [06:17:37] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 3.01, 3.84, 3.51 [06:19:37] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 5.08, 4.36, 3.74 [06:21:02] PROBLEM - gluster122 Current Load on gluster122 is WARNING: WARNING - load average: 3.49, 3.49, 3.01 [06:25:37] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 3.89, 3.90, 3.75 [06:27:02] RECOVERY - gluster122 Current Load on gluster122 is OK: OK - load average: 1.81, 2.89, 2.97 [06:28:07] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 6.79, 4.74, 3.40 [06:33:37] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 4.29, 3.62, 3.62 [06:33:37] RECOVERY - cp32 NTP time on cp32 is OK: NTP OK: Offset -0.003061294556 secs [06:35:37] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 2.66, 3.34, 3.52 [06:37:37] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 4.64, 4.07, 3.78 [06:39:37] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 2.40, 3.25, 3.50 [06:43:37] RECOVERY - gluster112 Current Load on gluster112 is OK: OK - load average: 1.87, 2.68, 3.23 [06:49:54] PROBLEM - gluster122 Current Load on gluster122 is CRITICAL: CRITICAL - load average: 6.42, 4.24, 3.32 [06:53:46] PROBLEM - gluster122 Current Load on gluster122 is WARNING: WARNING - load average: 2.48, 3.64, 3.33 [06:54:07] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.66, 2.83, 3.82 [06:57:39] PROBLEM - gluster122 Current Load on gluster122 is CRITICAL: CRITICAL - load average: 6.07, 4.38, 3.65 [06:58:07] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.47, 2.26, 3.37 [07:01:32] PROBLEM - gluster122 Current Load on gluster122 is WARNING: WARNING - load average: 2.68, 3.91, 3.67 [07:08:08] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 21.07, 13.21, 7.29 [07:08:19] PROBLEM - cp32 PowerDNS Recursor on cp32 is CRITICAL: CRITICAL - Plugin timed out while executing system call [07:09:17] PROBLEM - gluster122 Current Load on gluster122 is CRITICAL: CRITICAL - load average: 4.49, 3.76, 3.62 [07:10:19] RECOVERY - cp32 PowerDNS Recursor on cp32 is OK: DNS OK: 4.779 seconds response time. miraheze.org returns 108.175.15.182,2607:f1c0:1800:26f::1,2607:f1c0:1800:8100::1,74.208.203.152 [07:13:00] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.07, 3.10, 2.02 [07:15:00] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.96, 3.49, 2.30 [07:17:00] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.80, 2.98, 2.27 [07:22:26] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 5.36, 4.55, 3.60 [07:27:03] PROBLEM - gluster122 Current Load on gluster122 is WARNING: WARNING - load average: 1.88, 3.02, 3.85 [07:28:07] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 0.99, 1.62, 3.91 [07:28:09] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 3.09, 3.78, 3.56 [07:30:04] RECOVERY - gluster112 Current Load on gluster112 is OK: OK - load average: 2.03, 3.09, 3.33 [07:34:07] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.05, 1.53, 3.16 [07:35:02] RECOVERY - gluster122 Current Load on gluster122 is OK: OK - load average: 1.39, 2.30, 3.21 [07:40:58] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.89, 3.24, 3.38 [07:42:53] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.63, 4.20, 3.74 [07:44:47] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.51, 3.19, 3.42 [07:46:42] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 0.54, 2.31, 3.08 [07:53:03] PROBLEM - gluster122 Current Load on gluster122 is CRITICAL: CRITICAL - load average: 5.62, 3.89, 3.19 [07:55:02] RECOVERY - gluster122 Current Load on gluster122 is OK: OK - load average: 1.69, 2.96, 2.93 [07:59:02] PROBLEM - gluster122 Current Load on gluster122 is WARNING: WARNING - load average: 3.91, 3.55, 3.18 [08:03:02] PROBLEM - gluster122 Current Load on gluster122 is CRITICAL: CRITICAL - load average: 4.43, 3.85, 3.38 [08:03:37] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 5.19, 4.22, 3.37 [08:05:02] RECOVERY - gluster122 Current Load on gluster122 is OK: OK - load average: 2.08, 3.31, 3.25 [08:05:37] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 2.23, 3.44, 3.19 [08:09:37] RECOVERY - gluster112 Current Load on gluster112 is OK: OK - load average: 2.89, 3.39, 3.25 [08:10:08] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 13.67, 7.65, 4.13 [08:13:03] PROBLEM - gluster122 Current Load on gluster122 is WARNING: WARNING - load average: 3.88, 3.64, 3.38 [08:15:02] PROBLEM - gluster122 Current Load on gluster122 is CRITICAL: CRITICAL - load average: 3.18, 4.24, 3.69 [08:15:37] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 2.74, 3.48, 3.32 [08:17:03] PROBLEM - gluster122 Current Load on gluster122 is WARNING: WARNING - load average: 1.99, 3.48, 3.48 [08:17:37] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 4.33, 3.41, 3.29 [08:18:07] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 0.81, 3.71, 3.83 [08:19:02] RECOVERY - gluster122 Current Load on gluster122 is OK: OK - load average: 1.02, 2.69, 3.19 [08:19:37] RECOVERY - gluster112 Current Load on gluster112 is OK: OK - load average: 2.56, 3.16, 3.22 [08:22:07] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 0.71, 2.02, 3.10 [08:49:39] PROBLEM - gluster122 Current Load on gluster122 is CRITICAL: CRITICAL - load average: 4.72, 3.02, 2.47 [08:51:35] PROBLEM - gluster122 Current Load on gluster122 is WARNING: WARNING - load average: 3.47, 3.07, 2.55 [08:53:32] PROBLEM - gluster122 Current Load on gluster122 is CRITICAL: CRITICAL - load average: 5.15, 3.70, 2.83 [08:55:28] RECOVERY - gluster122 Current Load on gluster122 is OK: OK - load average: 2.33, 3.21, 2.75 [09:05:37] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 3.69, 4.06, 3.22 [09:08:07] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.39, 3.34, 2.12 [09:09:37] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 2.64, 3.76, 3.32 [09:11:37] RECOVERY - gluster112 Current Load on gluster112 is OK: OK - load average: 1.38, 2.95, 3.07 [09:24:07] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.18, 2.49, 3.69 [09:27:40] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.52, 3.52, 1.90 [09:28:07] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.49, 1.87, 3.16 [09:43:39] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.03, 3.67, 3.83 [09:47:39] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 0.84, 2.05, 3.11 [09:52:14] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.51, 8.83, 5.96 [09:54:14] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 5.81, 7.64, 5.87 [09:55:46] PROBLEM - gluster122 Current Load on gluster122 is CRITICAL: CRITICAL - load average: 7.26, 4.18, 2.77 [09:57:43] RECOVERY - gluster122 Current Load on gluster122 is OK: OK - load average: 1.80, 3.10, 2.54 [10:03:08] PROBLEM - fid.koyomi-ya.net - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query koyomi-ya.net. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [10:33:01] RECOVERY - fid.koyomi-ya.net - reverse DNS on sslhost is OK: SSL OK - fid.koyomi-ya.net reverse DNS resolves to cp22.miraheze.org - CNAME OK [10:46:18] PROBLEM - gluster122 Current Load on gluster122 is WARNING: WARNING - load average: 3.70, 3.38, 2.80 [10:48:14] PROBLEM - gluster122 Current Load on gluster122 is CRITICAL: CRITICAL - load average: 4.21, 3.50, 2.90 [10:50:11] PROBLEM - gluster122 Current Load on gluster122 is WARNING: WARNING - load average: 2.71, 3.46, 2.98 [10:52:07] RECOVERY - gluster122 Current Load on gluster122 is OK: OK - load average: 1.75, 3.10, 2.92 [10:59:37] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 4.56, 3.63, 2.86 [10:59:43] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 9.92, 6.05, 2.99 [11:01:37] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 2.77, 3.42, 2.89 [11:02:07] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.45, 2.91, 1.76 [11:03:37] RECOVERY - gluster112 Current Load on gluster112 is OK: OK - load average: 1.75, 2.83, 2.74 [11:04:07] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 3.14, 3.04, 1.95 [11:06:32] PROBLEM - cp33 PowerDNS Recursor on cp33 is CRITICAL: CRITICAL - Plugin timed out while executing system call [11:08:29] RECOVERY - cp33 PowerDNS Recursor on cp33 is OK: DNS OK: 0.247 seconds response time. miraheze.org returns 108.175.15.182,2607:f1c0:1800:26f::1,2607:f1c0:1800:8100::1,74.208.203.152 [11:12:07] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.32, 4.73, 3.23 [11:18:07] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 0.92, 2.96, 2.98 [11:19:39] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 0.56, 1.70, 3.67 [11:21:39] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 0.87, 1.35, 3.29 [11:37:03] PROBLEM - gluster122 Current Load on gluster122 is WARNING: WARNING - load average: 3.64, 3.67, 2.91 [11:39:02] RECOVERY - gluster122 Current Load on gluster122 is OK: OK - load average: 2.48, 3.17, 2.82 [11:49:42] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 4.30, 3.68, 3.14 [11:51:37] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 3.44, 3.44, 3.10 [11:53:37] RECOVERY - gluster112 Current Load on gluster112 is OK: OK - load average: 2.55, 3.39, 3.15 [12:04:22] PROBLEM - cp22 NTP time on cp22 is WARNING: NTP WARNING: Offset 0.1140741408 secs [12:19:03] PROBLEM - gluster122 Current Load on gluster122 is WARNING: WARNING - load average: 3.58, 3.78, 3.02 [12:23:02] RECOVERY - gluster122 Current Load on gluster122 is OK: OK - load average: 1.62, 3.17, 2.98 [12:24:22] RECOVERY - cp22 NTP time on cp22 is OK: NTP OK: Offset 0.08359453082 secs [12:26:28] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 3.45, 3.11, 2.94 [12:28:23] RECOVERY - gluster112 Current Load on gluster112 is OK: OK - load average: 1.83, 2.61, 2.78 [12:35:46] PROBLEM - gluster122 Current Load on gluster122 is WARNING: WARNING - load average: 3.56, 3.20, 3.00 [12:36:01] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 5.67, 4.29, 3.40 [12:39:39] RECOVERY - gluster122 Current Load on gluster122 is OK: OK - load average: 2.16, 3.19, 3.09 [12:52:19] PROBLEM - gluster122 Current Load on gluster122 is CRITICAL: CRITICAL - load average: 4.81, 3.60, 3.25 [12:54:15] RECOVERY - gluster122 Current Load on gluster122 is OK: OK - load average: 2.60, 3.11, 3.10 [12:55:37] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 1.33, 2.87, 3.87 [12:55:56] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.78, 3.15, 1.96 [12:57:53] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.51, 3.57, 2.25 [13:02:03] PROBLEM - gluster122 Current Load on gluster122 is WARNING: WARNING - load average: 3.68, 3.78, 3.40 [13:05:56] RECOVERY - gluster122 Current Load on gluster122 is OK: OK - load average: 2.52, 3.27, 3.28 [13:07:39] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 0.68, 3.07, 3.05 [13:13:37] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 5.32, 4.25, 3.80 [13:13:46] PROBLEM - gluster122 Current Load on gluster122 is CRITICAL: CRITICAL - load average: 3.84, 4.03, 3.64 [13:17:37] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 1.91, 3.42, 3.61 [13:21:37] RECOVERY - gluster112 Current Load on gluster112 is OK: OK - load average: 1.84, 2.86, 3.35 [13:32:35] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.82, 3.14, 2.55 [13:34:33] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 2.65, 3.03, 2.59 [13:34:44] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 3.19, 3.43, 2.88 [13:36:41] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 2.03, 2.91, 2.75 [13:39:02] PROBLEM - gluster122 Current Load on gluster122 is WARNING: WARNING - load average: 2.56, 3.56, 3.98 [13:41:03] PROBLEM - gluster122 Current Load on gluster122 is CRITICAL: CRITICAL - load average: 4.48, 4.00, 4.09 [14:09:12] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 4.06, 3.95, 3.23 [14:11:07] RECOVERY - gluster112 Current Load on gluster112 is OK: OK - load average: 1.54, 3.10, 3.01 [14:25:44] PROBLEM - ping6 on ns1 is WARNING: PING WARNING - Packet loss = 0%, RTA = 135.09 ms [14:29:47] RECOVERY - ping6 on ns1 is OK: PING OK - Packet loss = 0%, RTA = 115.57 ms [14:39:56] PROBLEM - ping6 on ns1 is WARNING: PING WARNING - Packet loss = 0%, RTA = 143.82 ms [14:41:38] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 3.84, 2.99, 2.50 [14:43:37] RECOVERY - gluster112 Current Load on gluster112 is OK: OK - load average: 3.08, 2.97, 2.55 [14:50:32] PROBLEM - discordian.wiki - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for discordian.wiki could not be found [15:01:02] PROBLEM - gluster122 Current Load on gluster122 is WARNING: WARNING - load average: 0.54, 1.64, 3.76 [15:05:02] RECOVERY - gluster122 Current Load on gluster122 is OK: OK - load average: 2.33, 1.58, 3.22 [15:06:26] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 5.18, 4.32, 3.22 [15:11:33] !logreception@mwtask141:~$ sudo -u www-data php /srv/mediawiki/w/maintenance/dumpBackup.php --full --include-files --wiki androbotwiki > /home/reception/androbotwiki29112022.xml [15:11:38] !log reception@mwtask141:~$ sudo -u www-data php /srv/mediawiki/w/maintenance/dumpBackup.php --full --include-files --wiki androbotwiki > /home/reception/androbotwiki29112022.xml [15:11:49] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:12:40] [02miraheze/MirahezeMagic] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/MirahezeMagic/compare/08e21a6adedf...ad9fad21436b [15:12:41] [url] Comparing 08e21a6adedf...ad9fad21436b · miraheze/MirahezeMagic · GitHub | github.com [15:12:41] [02miraheze/MirahezeMagic] 07Reception123 03ad9fad2 - clarify that DD is disabled for swift purposes to avoid impression that it's related to db141 [15:13:15] PROBLEM - discordian.wiki - LetsEncrypt on sslhost is CRITICAL: connect to address discordian.wiki and port 443: Network is unreachableHTTP CRITICAL - Unable to open TCP socket [15:15:13] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/09ba7f5bd1eb...1498e51fa6c6 [15:15:14] [url] Comparing 09ba7f5bd1eb...1498e51fa6c6 · miraheze/ssl · GitHub | github.com [15:15:15] [02miraheze/ssl] 07MirahezeSSLBot 031498e51 - Bot: Add SSL cert for njtelimination.ml [15:20:55] [02miraheze/dns] 07Reception123 pushed 031 commit to 03master [+1/-0/±0] 13https://github.com/miraheze/dns/compare/1f051595bfb0...0d48d652774a [15:20:55] [url] Comparing 1f051595bfb0...0d48d652774a · miraheze/dns · GitHub | github.com [15:20:56] [02miraheze/dns] 07Reception123 030d48d65 - add njtelimination.ml zone [15:21:28] PROBLEM - cp32 NTP time on cp32 is WARNING: NTP WARNING: Offset 0.1306474209 secs [15:21:44] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+1/-0/±1] 13https://github.com/miraheze/ssl/compare/1498e51fa6c6...01a44e8287a4 [15:21:45] [url] Comparing 1498e51fa6c6...01a44e8287a4 · miraheze/ssl · GitHub | github.com [15:21:46] [02miraheze/ssl] 07MirahezeSSLBot 0301a44e8 - Bot: Add SSL cert for wiki.albrusmusic.ru [15:23:11] miraheze/MirahezeMagic - Reception123 the build passed. [15:24:56] PROBLEM - njtelimination.ml - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - njtelimination.ml All nameservers failed to answer the query. [15:27:38] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 3.23, 3.74, 3.87 [15:30:01] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/deleteBatch.php --wiki=spiritsofargonothwiki /home/recpetion/m.txt (START) [15:30:02] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/deleteBatch.php --wiki=spiritsofargonothwiki /home/recpetion/m.txt (END - exit=65280) [15:30:08] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:30:08] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/deleteBatch.php --wiki=spiritsofargonothwikiwiki /home/recpetion/m.txt (START) [15:30:09] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/deleteBatch.php --wiki=spiritsofargonothwikiwiki /home/recpetion/m.txt (END - exit=256) [15:30:14] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:30:21] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/deleteBatch.php --wiki=spiritsofargonothwikiwiki /home/reception/m.txt (START) [15:30:24] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/deleteBatch.php --wiki=spiritsofargonothwikiwiki /home/reception/m.txt (END - exit=0) [15:30:31] PROBLEM - test131 Puppet on test131 is CRITICAL: CRITICAL: Puppet has 2 failures. Last run 3 minutes ago with 2 failures. Failed resources (up to 3 shown): File[/etc/ssl/localcerts/njtelimination.ml.crt],File[/etc/ssl/private/njtelimination.ml.key] [15:30:37] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:30:49] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:30:55] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:31:04] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:31:48] PROBLEM - cp23 Puppet on cp23 is CRITICAL: CRITICAL: Puppet has 2 failures. Last run 2 minutes ago with 2 failures. Failed resources (up to 3 shown): File[/etc/ssl/localcerts/njtelimination.ml.crt],File[/etc/ssl/private/njtelimination.ml.key] [15:32:03] PROBLEM - cp33 Puppet on cp33 is CRITICAL: CRITICAL: Puppet has 2 failures. Last run 3 minutes ago with 2 failures. Failed resources (up to 3 shown): File[/etc/ssl/localcerts/njtelimination.ml.crt],File[/etc/ssl/private/njtelimination.ml.key] [15:32:04] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/deleteBatch.php --wiki=spiritsofargonothwikiwiki /home/reception/m.txt (START) [15:32:08] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/deleteBatch.php --wiki=spiritsofargonothwikiwiki /home/reception/m.txt (END - exit=0) [15:32:17] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:32:23] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:34:16] PROBLEM - mw142 Puppet on mw142 is CRITICAL: CRITICAL: Puppet has 2 failures. Last run 3 minutes ago with 2 failures. Failed resources (up to 3 shown): File[/etc/ssl/localcerts/njtelimination.ml.crt],File[/etc/ssl/private/njtelimination.ml.key] [15:35:35] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 4.88, 3.68, 3.75 [15:36:33] RECOVERY - ping6 on ns1 is OK: PING OK - Packet loss = 0%, RTA = 112.56 ms [15:37:35] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 2.95, 3.53, 3.70 [15:39:24] PROBLEM - ping6 on cp33 is WARNING: PING WARNING - Packet loss = 0%, RTA = 122.17 ms [15:39:47] PROBLEM - mw122 Puppet on mw122 is CRITICAL: CRITICAL: Puppet has 2 failures. Last run 3 minutes ago with 2 failures. Failed resources (up to 3 shown): File[/etc/ssl/localcerts/njtelimination.ml.crt],File[/etc/ssl/private/njtelimination.ml.key] [15:39:57] PROBLEM - mw141 Puppet on mw141 is CRITICAL: CRITICAL: Puppet has 2 failures. Last run 3 minutes ago with 2 failures. Failed resources (up to 3 shown): File[/etc/ssl/localcerts/njtelimination.ml.crt],File[/etc/ssl/private/njtelimination.ml.key] [15:40:01] PROBLEM - mw132 Puppet on mw132 is CRITICAL: CRITICAL: Puppet has 2 failures. Last run 2 minutes ago with 2 failures. Failed resources (up to 3 shown): File[/etc/ssl/localcerts/njtelimination.ml.crt],File[/etc/ssl/private/njtelimination.ml.key] [15:41:15] RECOVERY - cp32 NTP time on cp32 is OK: NTP OK: Offset 0.09321445227 secs [15:41:25] RECOVERY - ping6 on cp33 is OK: PING OK - Packet loss = 0%, RTA = 117.28 ms [15:41:46] PROBLEM - gluster122 Current Load on gluster122 is WARNING: WARNING - load average: 3.39, 3.67, 3.27 [15:43:27] PROBLEM - cp32 Puppet on cp32 is CRITICAL: CRITICAL: Puppet has 2 failures. Last run 2 minutes ago with 2 failures. Failed resources (up to 3 shown): File[/etc/ssl/localcerts/njtelimination.ml.crt],File[/etc/ssl/private/njtelimination.ml.key] [15:43:32] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 5.00, 3.78, 3.69 [15:43:45] RECOVERY - gluster122 Current Load on gluster122 is OK: OK - load average: 1.20, 2.73, 2.97 [15:43:52] PROBLEM - mwtask141 Puppet on mwtask141 is CRITICAL: CRITICAL: Puppet has 2 failures. Last run 3 minutes ago with 2 failures. Failed resources (up to 3 shown): File[/etc/ssl/localcerts/njtelimination.ml.crt],File[/etc/ssl/private/njtelimination.ml.key] [15:44:58] PROBLEM - mw131 Puppet on mw131 is CRITICAL: CRITICAL: Puppet has 2 failures. Last run 3 minutes ago with 2 failures. Failed resources (up to 3 shown): File[/etc/ssl/localcerts/njtelimination.ml.crt],File[/etc/ssl/private/njtelimination.ml.key] [15:45:08] PROBLEM - mw121 Puppet on mw121 is CRITICAL: CRITICAL: Puppet has 2 failures. Last run 3 minutes ago with 2 failures. Failed resources (up to 3 shown): File[/etc/ssl/localcerts/njtelimination.ml.crt],File[/etc/ssl/private/njtelimination.ml.key] [15:45:11] PROBLEM - cp22 Puppet on cp22 is CRITICAL: CRITICAL: Puppet has 2 failures. Last run 2 minutes ago with 2 failures. Failed resources (up to 3 shown): File[/etc/ssl/localcerts/njtelimination.ml.crt],File[/etc/ssl/private/njtelimination.ml.key] [15:47:31] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 3.52, 3.50, 3.57 [15:49:30] RECOVERY - gluster112 Current Load on gluster112 is OK: OK - load average: 1.97, 2.92, 3.35 [15:53:51] RECOVERY - njtelimination.ml - reverse DNS on sslhost is OK: SSL OK - njtelimination.ml reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [15:55:23] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 4.04, 3.51, 3.44 [16:05:11] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 2.67, 3.83, 3.76 [16:07:26] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.75, 3.59, 2.37 [16:09:24] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 6.49, 5.45, 3.25 [16:18:53] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 4.49, 3.91, 3.71 [16:21:14] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 0.80, 3.35, 4.00 [16:25:13] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.69, 2.33, 1.85 [16:26:48] [02ErrorPages] 07AgentIsai opened pull request 03#20: Modify to reflect current status - 13https://github.com/miraheze/ErrorPages/pull/20 [16:26:49] [url] Page not found · GitHub · GitHub | github.com [16:27:07] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.08, 2.50, 3.40 [16:27:13] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 6.43, 3.51, 2.31 [16:27:43] miraheze/ErrorPages - AgentIsai the build passed. [16:29:13] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.95, 2.90, 2.25 [16:29:26] [02ErrorPages] 07AgentIsai synchronize pull request 03#20: Modify to reflect current status - 13https://github.com/miraheze/ErrorPages/pull/20 [16:29:27] [url] Page not found · GitHub · GitHub | github.com [16:30:17] miraheze/ErrorPages - AgentIsai the build passed. [16:30:38] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 1.58, 3.27, 3.65 [16:34:33] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 4.17, 3.72, 3.75 [16:35:51] PROBLEM - ping6 on cp33 is WARNING: PING WARNING - Packet loss = 0%, RTA = 123.43 ms [16:35:53] [02ErrorPages] 07AgentIsai synchronize pull request 03#20: Modify to reflect current status - 13https://github.com/miraheze/ErrorPages/pull/20 [16:35:54] [url] Page not found · GitHub · GitHub | github.com [16:36:31] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 3.66, 3.79, 3.77 [16:36:51] miraheze/ErrorPages - AgentIsai the build passed. [16:37:28] [02ErrorPages] 07AgentIsai synchronize pull request 03#20: Modify to reflect current status - 13https://github.com/miraheze/ErrorPages/pull/20 [16:37:29] [url] Page not found · GitHub · GitHub | github.com [16:38:13] [02ErrorPages] 07AgentIsai synchronize pull request 03#20: Modify to reflect current status - 13https://github.com/miraheze/ErrorPages/pull/20 [16:38:13] [url] Page not found · GitHub · GitHub | github.com [16:38:22] miraheze/ErrorPages - AgentIsai the build passed. [16:39:07] miraheze/ErrorPages - AgentIsai the build passed. [16:39:53] RECOVERY - ping6 on cp33 is OK: PING OK - Packet loss = 0%, RTA = 115.28 ms [16:40:48] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 2.21, 4.23, 3.71 [16:42:46] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 0.86, 3.08, 3.35 [16:43:56] PROBLEM - ping6 on cp33 is WARNING: PING WARNING - Packet loss = 0%, RTA = 130.32 ms [16:44:22] RECOVERY - gluster112 Current Load on gluster112 is OK: OK - load average: 2.75, 2.93, 3.33 [16:44:58] [02miraheze/mediawiki] 07Reception123 pushed 031 commit to 03REL1_38 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/21529bcefeb2...4c005726f8bf [16:44:59] [url] Comparing 21529bcefeb2...4c005726f8bf · miraheze/mediawiki · GitHub | github.com [16:45:00] [02miraheze/mediawiki] 07Reception123 034c00572 - Update MirahezeMagic [16:45:10] !log [reception@mwtask141] starting deploy of {'world': True, 'l10n': True} to all [16:45:18] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:45:57] RECOVERY - ping6 on cp33 is OK: PING OK - Packet loss = 0%, RTA = 112.55 ms [16:57:11] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 4.32, 3.88, 3.44 [16:59:09] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 2.83, 3.56, 3.38 [17:01:06] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 4.09, 3.86, 3.51 [17:03:04] RECOVERY - gluster112 Current Load on gluster112 is OK: OK - load average: 2.46, 3.32, 3.36 [17:04:23] PROBLEM - ping6 on ns1 is WARNING: PING WARNING - Packet loss = 0%, RTA = 130.93 ms [17:06:56] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 3.45, 3.51, 3.45 [17:08:20] !log [reception@mwtask141] finished deploy of {'world': True, 'l10n': True} to all - SUCCESS in 1390s [17:08:36] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:08:54] RECOVERY - gluster112 Current Load on gluster112 is OK: OK - load average: 1.93, 2.88, 3.22 [17:10:05] [02ErrorPages] 07Reception123 closed pull request 03#20: Modify to reflect current status - 13https://github.com/miraheze/ErrorPages/pull/20 [17:10:06] [url] Page not found · GitHub · GitHub | github.com [17:10:08] PROBLEM - gluster122 Current Load on gluster122 is WARNING: WARNING - load average: 3.63, 3.16, 2.71 [17:10:08] [02miraheze/ErrorPages] 07Reception123 pushed 036 commits to 03master [+0/-0/±7] 13https://github.com/miraheze/ErrorPages/compare/37bc94f84a27...3adc23d9cfec [17:10:09] [url] Comparing 37bc94f84a27...3adc23d9cfec · miraheze/ErrorPages · GitHub | github.com [17:10:10] [02miraheze/ErrorPages] 07AgentIsai 0351c7dc3 - Update [17:10:12] [02miraheze/ErrorPages] 07AgentIsai 032e7f016 - Update en.json [17:10:15] [02miraheze/ErrorPages] 07AgentIsai 0345b21b2 - remove mention of bureaucrat [17:10:17] [02miraheze/ErrorPages] ... and 3 more commits. [17:10:30] !log [reception@mwtask141] starting deploy of {'config': True} to all [17:10:36] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:10:37] !log [reception@mwtask141] finished deploy of {'config': True} to all - SUCCESS in 7s [17:10:44] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:11:05] miraheze/ErrorPages - Reception123 the build passed. [17:12:08] RECOVERY - gluster122 Current Load on gluster122 is OK: OK - load average: 3.01, 2.94, 2.67 [17:12:09] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.49, 2.82, 2.43 [17:14:07] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.90, 2.34, 2.29 [17:18:16] RECOVERY - ping6 on ns1 is OK: PING OK - Packet loss = 0%, RTA = 112.48 ms [17:22:19] PROBLEM - ping6 on ns1 is WARNING: PING WARNING - Packet loss = 0%, RTA = 137.15 ms [17:24:18] RECOVERY - ping6 on ns1 is OK: PING OK - Packet loss = 0%, RTA = 112.73 ms [17:28:21] PROBLEM - ping6 on ns1 is WARNING: PING WARNING - Packet loss = 0%, RTA = 125.54 ms [17:30:20] RECOVERY - ping6 on ns1 is OK: PING OK - Packet loss = 0%, RTA = 117.26 ms [17:35:46] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.84, 4.78, 3.01 [17:39:50] RECOVERY - discordian.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'discordian.wiki' will expire on Thu 23 Feb 2023 22:24:57 GMT +0000. [17:40:13] !log [universalomega@mwtask141] starting deploy of {'pull': 'errorpages', 'errorpages': True} to all [17:40:18] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:40:20] PROBLEM - gluster122 Current Load on gluster122 is CRITICAL: CRITICAL - load average: 4.34, 4.16, 3.29 [17:40:21] !log [universalomega@mwtask141] finished deploy of {'pull': 'errorpages', 'errorpages': True} to all - SUCCESS in 7s [17:40:22] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 3.90, 3.75, 3.26 [17:40:27] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:42:16] RECOVERY - gluster122 Current Load on gluster122 is OK: OK - load average: 1.53, 3.26, 3.07 [17:42:22] RECOVERY - gluster112 Current Load on gluster112 is OK: OK - load average: 1.84, 3.05, 3.06 [17:44:03] PROBLEM - discordian.wiki - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - discordian.wiki All nameservers failed to answer the query. [17:45:46] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.31, 3.93, 3.87 [17:48:59] !log dump mhglobal and metawiki databases to backup to be safe, for global entries being removed for recreation requests [17:49:46] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 0.76, 2.22, 3.18 [17:50:08] PROBLEM - gluster122 Current Load on gluster122 is CRITICAL: CRITICAL - load average: 6.20, 4.24, 3.43 [17:50:55] !log dump mhglobal and metawiki databases to backup to be safe, for global entries being removed for recreation requests [17:51:25] hmm.... why not logging? [17:52:08] PROBLEM - gluster122 Current Load on gluster122 is WARNING: WARNING - load average: 3.48, 3.79, 3.35 [17:52:42] Logbot needs restarting [17:52:51] I’m mobile so I cannot do it [17:54:08] PROBLEM - gluster122 Current Load on gluster122 is CRITICAL: CRITICAL - load average: 5.75, 4.36, 3.60 [17:56:22] [02miraheze/ssl] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/01a44e8287a4...bf261eb580a2 [17:56:23] [url] Comparing 01a44e8287a4...bf261eb580a2 · miraheze/ssl · GitHub | github.com [17:56:25] [02miraheze/ssl] 07Universal-Omega 03bf261eb - Remove sslname from ndgnenawiki [17:59:50] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 3.62, 2.71, 1.52 [18:00:22] PROBLEM - mw141 MediaWiki Rendering on mw141 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:01:20] lol which service is it again? [18:01:50] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 2.15, 2.46, 1.56 [18:02:01] there we go... [18:02:20] !log restart logbot on mon141 [18:03:05] hmm... [18:03:59] !log restart logbot on mon141 [18:04:23] RECOVERY - mw141 MediaWiki Rendering on mw141 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.470 second response time [18:06:39] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.14, 3.95, 3.21 [18:06:40] hmm... [18:07:04] PROBLEM - mw121 MediaWiki Rendering on mw121 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:07:31] https://www.irccloud.com/pastebin/rdXUuuIB/ [18:08:28] paladox: ^ [18:08:37] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.51, 3.48, 3.14 [18:08:58] RECOVERY - mw121 MediaWiki Rendering on mw121 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.340 second response time [18:10:35] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.11, 2.98, 2.99 [18:12:41] !log restart logbot on mon141 [18:20:01] PROBLEM - mw132 MediaWiki Rendering on mw132 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:20:14] PROBLEM - mw131 MediaWiki Rendering on mw131 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:22:18] RECOVERY - mw131 MediaWiki Rendering on mw131 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 7.763 second response time [18:22:18] PROBLEM - cp32 Varnish Backends on cp32 is CRITICAL: 1 backends are down. mw131 [18:22:26] PROBLEM - cp33 Varnish Backends on cp33 is CRITICAL: 1 backends are down. mw131 [18:23:01] [Grafana] FIRING: Some MediaWiki Appservers are running out of PHP-FPM workers. https://grafana.miraheze.org/d/GtxbP1Xnk?orgId=1 [18:23:35] PROBLEM - cp22 Varnish Backends on cp22 is CRITICAL: 2 backends are down. mw131 mw132 [18:23:41] PROBLEM - cp23 Varnish Backends on cp23 is CRITICAL: 1 backends are down. mw131 [18:23:55] PROBLEM - mw122 MediaWiki Rendering on mw122 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:24:00] RECOVERY - mw132 MediaWiki Rendering on mw132 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.323 second response time [18:25:35] RECOVERY - cp22 Varnish Backends on cp22 is OK: All 14 backends are healthy [18:25:41] !log restart logbot on mon141 [18:25:41] RECOVERY - cp23 Varnish Backends on cp23 is OK: All 14 backends are healthy [18:25:51] RECOVERY - mw122 MediaWiki Rendering on mw122 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.270 second response time [18:25:53] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:26:04] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.66, 3.58, 2.31 [18:26:09] !log dump mhglobal database to backup to be safe, for global entries being removed for recreation requests [18:26:27] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:27:13] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.58, 3.91, 3.08 [18:27:59] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.10, 3.47, 2.43 [18:28:01] [Grafana] RESOLVED: PHP-FPM Worker Usage High https://grafana.miraheze.org/d/GtxbP1Xnk?orgId=1 [18:28:28] RECOVERY - cp33 Varnish Backends on cp33 is OK: All 14 backends are healthy [18:29:11] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.42, 3.05, 2.86 [18:29:54] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.24, 2.67, 2.25 [18:30:21] RECOVERY - cp32 Varnish Backends on cp32 is OK: All 14 backends are healthy [18:41:20] PROBLEM - discordian.wiki - reverse DNS on sslhost is WARNING: Timeout: The DNS operation timed out after 5.406259775161743 seconds [18:47:01] [02miraheze/CreateWiki] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/commit/cdc4414893e2 [18:47:04] [02miraheze/CreateWiki] 07Universal-Omega 03cdc4414 - Update WikiManager.php [18:47:06] [02CreateWiki] 07Universal-Omega created branch 03Universal-Omega-patch-1 - 13https://github.com/miraheze/CreateWiki [18:47:06] [url] Page not found · GitHub · GitHub | github.com [18:49:55] PROBLEM - db112 Current Load on db112 is CRITICAL: CRITICAL - load average: 8.22, 7.25, 5.13 [18:55:09] [02miraheze/CreateWiki] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/cdc4414893e2...6e2dc154de7f [18:55:10] [url] Comparing cdc4414893e2...6e2dc154de7f · miraheze/CreateWiki · GitHub | github.com [18:55:12] [02miraheze/CreateWiki] 07Universal-Omega 036e2dc15 - Update SpecialCreateWiki.php [18:55:13] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.47, 2.95, 2.06 [18:55:44] [02miraheze/CreateWiki] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/6e2dc154de7f...59608a9df279 [18:55:44] [url] Comparing 6e2dc154de7f...59608a9df279 · miraheze/CreateWiki · GitHub | github.com [18:55:45] [02miraheze/CreateWiki] 07Universal-Omega 0359608a9 - Update en.json [18:56:09] [02CreateWiki] 07Universal-Omega opened pull request 03#353: Allow choosing cluster from Special:CreateWiki - 13https://github.com/miraheze/CreateWiki/pull/353 [18:56:09] [url] Page not found · GitHub · GitHub | github.com [18:57:04] [02CreateWiki] 07Universal-Omega synchronize pull request 03#353: Allow choosing cluster from Special:CreateWiki - 13https://github.com/miraheze/CreateWiki/pull/353 [18:57:05] [url] Page not found · GitHub · GitHub | github.com [18:57:06] [02miraheze/CreateWiki] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/59608a9df279...fd0d9a0a2aed [18:57:07] [url] Comparing 59608a9df279...fd0d9a0a2aed · miraheze/CreateWiki · GitHub | github.com [18:57:07] [02miraheze/CreateWiki] 07Universal-Omega 03fd0d9a0 - Update SpecialCreateWiki.php [18:57:13] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.72, 2.77, 2.10 [18:57:55] PROBLEM - db112 Current Load on db112 is WARNING: WARNING - load average: 4.78, 7.60, 6.57 [18:58:30] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.88, 3.62, 3.01 [18:59:55] PROBLEM - db112 Current Load on db112 is CRITICAL: CRITICAL - load average: 11.44, 9.45, 7.42 [19:00:28] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 0.97, 2.75, 2.76 [19:01:06] miraheze/CreateWiki - Universal-Omega the build has errored. [19:03:51] [02CreateWiki] 07Universal-Omega synchronize pull request 03#353: Allow choosing cluster from Special:CreateWiki - 13https://github.com/miraheze/CreateWiki/pull/353 [19:03:52] [url] Page not found · GitHub · GitHub | github.com [19:03:52] [02miraheze/CreateWiki] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/fd0d9a0a2aed...77f26390f24c [19:03:53] [url] Comparing fd0d9a0a2aed...77f26390f24c · miraheze/CreateWiki · GitHub | github.com [19:03:54] [02miraheze/CreateWiki] 07Universal-Omega 0377f2639 - Update SpecialCreateWiki.php [19:08:18] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 9.57, 5.28, 3.57 [19:11:55] PROBLEM - db112 Current Load on db112 is WARNING: WARNING - load average: 3.78, 6.01, 7.57 [19:12:46] miraheze/CreateWiki - Universal-Omega the build passed. [19:15:55] RECOVERY - db112 Current Load on db112 is OK: OK - load average: 3.78, 4.65, 6.65 [19:16:09] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.30, 3.34, 3.59 [19:16:13] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.51, 3.27, 2.65 [19:18:06] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 0.85, 2.52, 3.26 [19:18:11] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 2.80, 2.99, 2.61 [19:20:06] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 3.58, 3.62, 3.13 [19:24:01] !log [universalomega@puppet141] sudo -u www-data ls /srv/mediawiki/cache/*decodedocdigitizewiki* on mw*, test131, and mwtask141 [19:24:01] RECOVERY - gluster112 Current Load on gluster112 is OK: OK - load average: 3.38, 3.39, 3.13 [19:24:20] !log [universalomega@puppet141] sudo -u www-data rm /srv/mediawiki/cache/*decodedocdigitizewiki* on mw*, test131, and mwtask141 [19:24:32] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:24:39] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM cw_wikis WHERE wiki_dbname='decodedocdigitizewiki'; [19:24:43] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localnames WHERE ln_wiki='decodedocdigitizewiki'; [19:24:44] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localuser WHERE lu_wiki='decodedocdigitizewiki'; [19:24:45] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:24:56] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:24:58] !log [universalomega@db101] MariaDB [metawiki]> DELETE FROM echo_unread_wikis WHERE euw_wiki='decodedocdigitizewiki'; [19:25:12] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:25:24] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:25:35] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:25:55] PROBLEM - db112 Current Load on db112 is CRITICAL: CRITICAL - load average: 8.99, 12.15, 9.21 [19:27:46] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03revert-4993-revert-4988-Universal-Omega-patch-2 [+0/-0/±2] 13https://github.com/miraheze/mw-config/commit/9bdc90663244 [19:27:48] [02miraheze/mw-config] 07Universal-Omega 039bdc906 - Revert "Revert "Pool db141 back in as c6" (#4993)" [19:27:49] [02mw-config] 07Universal-Omega created branch 03revert-4993-revert-4988-Universal-Omega-patch-2 - 13https://github.com/miraheze/mw-config [19:27:49] [url] Page not found · GitHub · GitHub | github.com [19:27:52] [02mw-config] 07Universal-Omega opened pull request 03#4995: Revert "Revert "Pool db141 back in as c6"" - 13https://github.com/miraheze/mw-config/pull/4995 [19:27:52] [url] Page not found · GitHub · GitHub | github.com [19:28:00] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 22.19, 10.16, 5.65 [19:28:27] [02mw-config] 07Universal-Omega closed pull request 03#4995: Revert "Revert "Pool db141 back in as c6"" - 13https://github.com/miraheze/mw-config/pull/4995 [19:28:27] ... [19:28:28] [02miraheze/mw-config] 07Universal-Omega deleted branch 03revert-4993-revert-4988-Universal-Omega-patch-2 [19:28:31] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±2] 13https://github.com/miraheze/mw-config/compare/6cd09d2a1af7...9ece3a7b09c3 [19:28:31] [url] Comparing 6cd09d2a1af7...9ece3a7b09c3 · miraheze/mw-config · GitHub | github.com [19:28:32] [02miraheze/mw-config] 07Universal-Omega 039ece3a7 - Revert "Revert "Pool db141 back in as c6"" (#4995) [19:28:33] [02mw-config] 07Universal-Omega deleted branch 03revert-4993-revert-4988-Universal-Omega-patch-2 - 13https://github.com/miraheze/mw-config [19:28:33] [url] Page not found · GitHub · GitHub | github.com [19:28:51] !log [universalomega@mwtask141] starting deploy of {'pull': 'config', 'config': True} to all [19:28:52] miraheze/mw-config - Universal-Omega the build passed. [19:28:56] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:28:59] !log [universalomega@mwtask141] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 8s [19:29:05] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:29:31] miraheze/mw-config - Universal-Omega the build passed. [19:36:08] PROBLEM - gluster122 Current Load on gluster122 is WARNING: WARNING - load average: 2.80, 2.75, 3.89 [19:40:40] !log move decodedocdigitizewiki to c6/db141 [19:41:20] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:44:08] RECOVERY - gluster122 Current Load on gluster122 is OK: OK - load average: 1.15, 2.33, 3.29 [19:44:31] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 4.35, 3.32, 2.96 [19:46:29] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 3.76, 3.36, 3.01 [19:48:26] RECOVERY - gluster112 Current Load on gluster112 is OK: OK - load average: 2.06, 3.04, 2.95 [19:49:46] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.31, 2.30, 3.88 [19:51:55] PROBLEM - db112 Current Load on db112 is WARNING: WARNING - load average: 1.53, 4.81, 7.67 [19:53:13] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.82, 2.62, 1.81 [19:55:13] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.31, 2.46, 1.85 [19:55:46] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.16, 2.34, 3.40 [19:55:55] RECOVERY - db112 Current Load on db112 is OK: OK - load average: 1.08, 2.84, 6.21 [19:56:22] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 4.12, 3.50, 3.13 [19:57:23] !log [@test131] starting deploy of {'config': True} to all [19:57:24] !log [@test131] finished deploy of {'config': True} to all - SUCCESS in 0s [19:57:40] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:57:44] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:58:22] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 3.82, 3.93, 3.36 [20:00:22] RECOVERY - gluster112 Current Load on gluster112 is OK: OK - load average: 2.12, 3.38, 3.23 [20:00:45] !log [universalomega@puppet141] sudo -u www-data rm /srv/mediawiki/cache/*itorawiki* on mw*, test131, and mwtask141 [20:00:51] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:01:51] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM cw_wikis WHERE wiki_dbname='itorawiki'; [20:01:52] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_settings WHERE s_dbname='itorawiki'; [20:01:53] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_namespaces WHERE ns_dbname='itorawiki'; [20:01:54] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_permissions WHERE perm_dbname='itorawiki'; [20:01:55] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localnames WHERE ln_wiki='itorawiki'; [20:01:56] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localuser WHERE lu_wiki='itorawiki'; [20:01:57] !log [universalomega@db101] MariaDB [metawiki]> DELETE FROM echo_unread_wikis WHERE euw_wiki='itorawiki'; [20:02:16] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:02:24] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:02:33] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:02:38] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:02:47] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:03:14] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:03:19] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:04:22] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 4.52, 4.68, 3.84 [20:06:22] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 2.83, 3.84, 3.62 [20:08:15] !log sudo bash /home/reception/privatebackups.sh /home/reception/privatewikis.txt /srv/mediawiki/w/maintenance/dumpBackup.php (wikibackups for private wikis, no db141) [20:08:22] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 4.13, 3.76, 3.60 [20:08:27] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:08:54] !log [universalomega@puppet141] sudo -u www-data rm /srv/mediawiki/cache/*pmuniversewiki* on mw*, test131, and mwtask141 [20:09:18] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:10:17] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM cw_wikis WHERE wiki_dbname='pmuniversewiki'; [20:10:18] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_settings WHERE s_dbname='pmuniversewiki'; [20:10:19] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_namespaces WHERE ns_dbname='pmuniversewiki'; [20:10:20] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_permissions WHERE perm_dbname='pmuniversewiki'; [20:10:21] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localnames WHERE ln_wiki='pmuniversewiki'; [20:10:22] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 3.63, 3.71, 3.60 [20:10:22] PROBLEM - gluster122 Current Load on gluster122 is CRITICAL: CRITICAL - load average: 10.71, 5.12, 3.78 [20:10:22] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localuser WHERE lu_wiki='pmuniversewiki'; [20:10:23] !log [universalomega@db101] MariaDB [metawiki]> DELETE FROM echo_unread_wikis WHERE euw_wiki='pmuniversewiki'; [20:10:25] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:10:57] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:11:03] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:11:18] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:11:33] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:11:43] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:12:09] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:12:22] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 6.87, 4.93, 4.07 [20:16:03] !log [universalomega@puppet141] sudo -u www-data rm /srv/mediawiki/cache/*theoballwikiwiki* on mw*, test131, and mwtask141 [20:16:08] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:17:56] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM cw_wikis WHERE wiki_dbname='theoballwikiwiki'; [20:17:57] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_settings WHERE s_dbname='theoballwikiwiki'; [20:17:58] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_namespaces WHERE ns_dbname='theoballwikiwiki'; [20:17:59] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_permissions WHERE perm_dbname='theoballwikiwiki'; [20:18:00] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localnames WHERE ln_wiki='theoballwikiwiki'; [20:18:01] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localuser WHERE lu_wiki='theoballwikiwiki'; [20:18:02] !log [universalomega@db101] MariaDB [metawiki]> DELETE FROM echo_unread_wikis WHERE euw_wiki='theoballwikiwiki'; [20:18:10] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:18:24] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:18:40] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:18:49] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:19:08] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:19:12] PROBLEM - wiki.seamly.net - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.seamly.net All nameservers failed to answer the query. [20:19:15] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:19:26] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:22:38] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+1/-0/±1] 13https://github.com/miraheze/ssl/compare/bf261eb580a2...c7ad89f15047 [20:22:39] [url] Comparing bf261eb580a2...c7ad89f15047 · miraheze/ssl · GitHub | github.com [20:22:40] [02miraheze/ssl] 07MirahezeSSLBot 03c7ad89f - Bot: Add SSL cert for njtelimination.ml [20:23:42] miraheze/ssl - MirahezeSSLBot the build has errored. [20:24:18] !log [universalomega@puppet141] sudo -u www-data rm /srv/mediawiki/cache/*forecastingwiki* on mw*, test131, and mwtask141 [20:24:28] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:27:01] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM cw_wikis WHERE wiki_dbname='forecastingwiki'; [20:27:02] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_settings WHERE s_dbname='forecastingwiki'; [20:27:03] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_namespaces WHERE ns_dbname='forecastingwiki'; [20:27:04] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_permissions WHERE perm_dbname='forecastingwiki'; [20:27:05] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localnames WHERE ln_wiki='forecastingwiki'; [20:27:06] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localuser WHERE lu_wiki='forecastingwiki'; [20:27:07] !log [universalomega@db101] MariaDB [metawiki]> DELETE FROM echo_unread_wikis WHERE euw_wiki='forecastingwiki'; [20:27:07] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:27:47] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:28:46] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:29:01] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:29:31] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:29:46] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:29:51] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:30:24] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 3.73, 3.62, 3.90 [20:32:32] PROBLEM - wiki.pacebi.org - LetsEncrypt on sslhost is CRITICAL: connect to address wiki.pacebi.org and port 443: Network is unreachableHTTP CRITICAL - Unable to open TCP socket [20:33:39] RECOVERY - mw142 Puppet on mw142 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [20:33:39] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=forecastingwiki --no-updates --username-prefix=mh:forecasting /home/universalomega/ImportDump/forecastingwiki-20221129203306.xml (START) [20:34:14] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:34:31] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=forecastingwiki --no-updates --username-prefix=mh:forecasting /home/universalomega/ImportDump/forecastingwiki-20221129203306.xml (END - exit=0) [20:34:32] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=forecastingwiki (START) [20:34:51] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:34:53] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=forecastingwiki (END - exit=0) [20:34:55] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/initSiteStats.php --wiki=forecastingwiki --active --update (END - exit=0) [20:34:58] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:35:21] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:35:26] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:36:08] RECOVERY - mw122 Puppet on mw122 is OK: OK: Puppet is currently enabled, last run 49 seconds ago with 0 failures [20:36:22] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 5.16, 4.09, 3.93 [20:37:15] RECOVERY - mw132 Puppet on mw132 is OK: OK: Puppet is currently enabled, last run 4 seconds ago with 0 failures [20:37:19] RECOVERY - mw141 Puppet on mw141 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [20:39:03] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 8.61, 4.41, 3.05 [20:41:52] RECOVERY - mwtask141 Puppet on mwtask141 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [20:41:56] PROBLEM - pmwiki.cubestudios.xyz - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for pmwiki.cubestudios.xyz could not be found [20:42:02] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=forecastingwiki (END - exit=0) [20:42:09] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:42:18] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/findMissingImages.php --wiki=forecastingwiki (END - exit=256) [20:42:23] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:42:40] RECOVERY - mw131 Puppet on mw131 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [20:42:58] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.59, 3.10, 2.86 [20:42:58] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/findMissingFiles.php --wiki=forecastingwiki (END - exit=0) [20:43:05] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:43:34] RECOVERY - cp22 Puppet on cp22 is OK: OK: Puppet is currently enabled, last run 44 seconds ago with 0 failures [20:43:56] RECOVERY - mw121 Puppet on mw121 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [20:45:22] RECOVERY - cp32 Puppet on cp32 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [20:48:33] RECOVERY - wiki.seamly.net - reverse DNS on sslhost is OK: SSL OK - wiki.seamly.net reverse DNS resolves to cp22.miraheze.org - CNAME OK [20:55:39] RECOVERY - cp33 Puppet on cp33 is OK: OK: Puppet is currently enabled, last run 49 seconds ago with 0 failures [20:56:45] !log [universalomega@puppet141] sudo -u www-data rm /srv/mediawiki/cache/*polandballwiki* on mw*, test131, and mwtask141 [20:57:05] RECOVERY - test131 Puppet on test131 is OK: OK: Puppet is currently enabled, last run 2 seconds ago with 0 failures [20:57:18] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:57:58] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM cw_wikis WHERE wiki_dbname='polandballwiki'; [20:57:59] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_settings WHERE s_dbname='polandballwiki'; [20:58:00] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_namespaces WHERE ns_dbname='polandballwiki'; [20:58:01] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_permissions WHERE perm_dbname='polandballwiki'; [20:58:03] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localnames WHERE ln_wiki='polandballwiki'; [20:58:06] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localuser WHERE lu_wiki='polandballwiki'; [20:58:08] !log [universalomega@db101] MariaDB [metawiki]> DELETE FROM echo_unread_wikis WHERE euw_wiki='polandballwiki'; [20:58:08] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:58:22] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 2.81, 3.50, 3.97 [20:58:24] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:58:28] RECOVERY - cp23 Puppet on cp23 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [20:58:36] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:58:58] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:59:11] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:59:22] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:59:28] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:00:45] !log [universalomega@puppet141] sudo -u www-data rm /srv/mediawiki/cache/*lgbta\wiki* on mw*, test131, and mwtask141 [21:00:50] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:00:53] !log [universalomega@puppet141] sudo -u www-data rm /srv/mediawiki/cache/*lgbtawiki* on mw*, test131, and mwtask141 [21:01:02] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:02:08] PROBLEM - gluster122 Current Load on gluster122 is WARNING: WARNING - load average: 1.83, 2.84, 3.88 [21:02:22] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 4.89, 3.97, 4.01 [21:02:30] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM cw_wikis WHERE wiki_dbname='lgbtawiki'; [21:02:31] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_settings WHERE s_dbname='lgbtawiki'; [21:02:32] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_namespaces WHERE ns_dbname='lgbtawiki'; [21:02:33] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_permissions WHERE perm_dbname='lgbtawiki'; [21:02:34] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localnames WHERE ln_wiki='lgbtawiki'; [21:02:35] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localuser WHERE lu_wiki='lgbtawiki'; [21:02:36] !log [universalomega@db101] MariaDB [metawiki]> DELETE FROM echo_unread_wikis WHERE euw_wiki='lgbtawiki'; [21:02:39] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:02:45] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:03:02] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:03:08] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:03:15] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:03:35] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:03:44] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:06:22] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 3.04, 3.78, 3.96 [21:10:08] RECOVERY - gluster122 Current Load on gluster122 is OK: OK - load average: 2.03, 2.46, 3.31 [21:10:22] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 4.22, 3.85, 3.93 [21:12:22] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 2.13, 3.17, 3.67 [21:13:14] PROBLEM - cp22 NTP time on cp22 is WARNING: NTP WARNING: Offset 0.1013289392 secs [21:15:14] RECOVERY - cp22 NTP time on cp22 is OK: NTP OK: Offset 0.07256144285 secs [21:19:03] PROBLEM - wiki.pacebi.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.pacebi.org could not be found [21:20:22] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 5.71, 4.00, 3.72 [21:20:53] PROBLEM - gluster122 Current Load on gluster122 is CRITICAL: CRITICAL - load average: 5.73, 3.65, 3.35 [21:22:48] RECOVERY - gluster122 Current Load on gluster122 is OK: OK - load average: 2.78, 3.26, 3.25 [21:23:13] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.43, 3.76, 2.39 [21:24:22] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 3.03, 3.82, 3.74 [21:26:41] PROBLEM - gluster122 Current Load on gluster122 is WARNING: WARNING - load average: 3.11, 3.94, 3.60 [21:27:13] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.09, 3.37, 2.61 [21:28:22] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 3.84, 4.01, 3.84 [21:28:37] PROBLEM - gluster122 Current Load on gluster122 is CRITICAL: CRITICAL - load average: 4.25, 3.99, 3.65 [21:30:22] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 3.68, 3.99, 3.87 [21:30:33] PROBLEM - gluster122 Current Load on gluster122 is WARNING: WARNING - load average: 3.01, 3.83, 3.64 [21:32:22] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 5.27, 4.62, 4.12 [21:32:29] PROBLEM - gluster122 Current Load on gluster122 is CRITICAL: CRITICAL - load average: 3.00, 4.04, 3.78 [21:33:12] PROBLEM - discordian.wiki - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - discordian.wiki All nameservers failed to answer the query. [21:33:29] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/extensions/ManageWiki/maintenance/toggleExtension.php --wiki=decodedocdigitizewiki approvedrevs --disable (END - exit=0) [21:33:52] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:40:42] !log [universalomega@puppet141] sudo -u www-data rm /srv/mediawiki/cache/*officeblockwiki* on mw*, test131, and mwtask141 [21:40:58] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM cw_wikis WHERE wiki_dbname='officeblockwiki'; [21:40:59] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_settings WHERE s_dbname='officeblockwiki'; [21:41:00] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_namespaces WHERE ns_dbname='officeblockwiki'; [21:41:01] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_permissions WHERE perm_dbname='officeblockwiki'; [21:41:02] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localnames WHERE ln_wiki='officeblockwiki'; [21:41:03] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localuser WHERE lu_wiki='officeblockwiki'; [21:41:04] !log [universalomega@db101] MariaDB [metawiki]> DELETE FROM echo_unread_wikis WHERE euw_wiki='officeblockwiki'; [21:41:48] PROBLEM - mw121 MediaWiki Rendering on mw121 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:41:54] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:42:20] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:42:25] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:42:34] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:42:44] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:42:49] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:42:55] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:43:00] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:43:48] PROBLEM - cp32 Varnish Backends on cp32 is CRITICAL: 1 backends are down. mw121 [21:43:52] RECOVERY - mw121 MediaWiki Rendering on mw121 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 9.862 second response time [21:45:14] PROBLEM - cp22 NTP time on cp22 is WARNING: NTP WARNING: Offset -0.113190949 secs [21:45:48] RECOVERY - cp32 Varnish Backends on cp32 is OK: All 14 backends are healthy [21:47:14] RECOVERY - cp22 NTP time on cp22 is OK: NTP OK: Offset -0.09308448434 secs [21:47:36] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.41, 3.33, 2.77 [21:47:41] !log sudo -u www-data php /srv/mediawiki/w/extensions/CentralAuth/maintenance/createLocalAccount.php VFDan --wiki officeblockwiki [21:47:49] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:48:02] !log sudo -u www-data php /srv/mediawiki/w/maintenance/createAndPromote.php VFDan --bureaucrat --sysop --force --wiki officeblockwiki [21:48:10] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:48:17] !log sudo -u www-data php /srv/mediawiki/w/extensions/CreateWiki/maintenance/populateMainPage.php --wiki officeblockwiki [21:48:51] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:49:34] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 3.21, 3.15, 2.76 [21:52:16] !log [universalomega@puppet141] sudo -u www-data rm /srv/mediawiki/cache/*deepgamingwiki* on mw*, test131, and mwtask141 [21:52:30] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM cw_wikis WHERE wiki_dbname='deepgamingwiki'; [21:52:31] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_settings WHERE s_dbname='deepgamingwiki'; [21:52:32] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_namespaces WHERE ns_dbname='deepgamingwiki'; [21:52:33] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_permissions WHERE perm_dbname='deepgamingwiki'; [21:52:34] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localnames WHERE ln_wiki='deepgamingwiki'; [21:52:34] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:52:35] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localuser WHERE lu_wiki='deepgamingwiki'; [21:52:36] !log [universalomega@db101] MariaDB [metawiki]> DELETE FROM echo_unread_wikis WHERE euw_wiki='deepgamingwiki'; [21:52:39] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:52:49] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:52:53] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:53:03] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:53:07] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:53:15] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:53:20] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:57:39] !log [universalomega@puppet141] sudo -u www-data rm /srv/mediawiki/cache/*lamostwiki* on mw*, test131, and mwtask141 [21:57:49] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:57:54] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM cw_wikis WHERE wiki_dbname='lamostwiki'; [21:57:55] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_settings WHERE s_dbname='lamostwiki'; [21:57:56] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_namespaces WHERE ns_dbname='lamostwiki'; [21:57:57] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_permissions WHERE perm_dbname='lamostwiki'; [21:57:58] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localnames WHERE ln_wiki='lamostwiki'; [21:57:59] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localuser WHERE lu_wiki='lamostwiki'; [21:58:00] !log [universalomega@db101] MariaDB [metawiki]> DELETE FROM echo_unread_wikis WHERE euw_wiki='lamostwiki'; [21:58:03] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:58:07] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:58:17] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:58:23] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:58:28] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:58:39] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:58:43] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:00:08] PROBLEM - gluster122 Current Load on gluster122 is WARNING: WARNING - load average: 1.49, 2.33, 3.96 [22:00:22] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 3.46, 3.35, 3.88 [22:01:51] PROBLEM - discordian.wiki - reverse DNS on sslhost is WARNING: Timeout: The DNS operation timed out after 5.407822370529175 seconds [22:06:08] RECOVERY - gluster122 Current Load on gluster122 is OK: OK - load average: 1.74, 1.92, 3.25 [22:06:22] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 6.41, 4.29, 4.03 [22:06:27] !log [universalomega@puppet141] sudo -u www-data rm /srv/mediawiki/cache/*agalaxytolookuponwiki* on mw*, test131, and mwtask141 [22:06:32] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:07:05] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM cw_wikis WHERE wiki_dbname='agalaxytolookuponwiki'; [22:07:06] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_settings WHERE s_dbname='agalaxytolookuponwiki'; [22:07:07] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_namespaces WHERE ns_dbname='agalaxytolookuponwiki'; [22:07:08] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_permissions WHERE perm_dbname='agalaxytolookuponwiki'; [22:07:09] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localnames WHERE ln_wiki='agalaxytolookuponwiki'; [22:07:10] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:07:10] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localuser WHERE lu_wiki='agalaxytolookuponwiki'; [22:07:11] !log [universalomega@db101] MariaDB [metawiki]> DELETE FROM echo_unread_wikis WHERE euw_wiki='agalaxytolookuponwiki'; [22:07:18] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:07:39] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:07:51] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:07:57] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:08:01] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:08:07] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:10:22] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 2.23, 3.68, 3.88 [22:11:23] !log [universalomega@puppet141] sudo -u www-data rm /srv/mediawiki/cache/*icarlyfanonwiki* on mw*, test131, and mwtask141 [22:11:35] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM cw_wikis WHERE wiki_dbname='icarlyfanonwiki'; [22:11:35] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:11:36] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_settings WHERE s_dbname='icarlyfanonwiki'; [22:11:37] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_namespaces WHERE ns_dbname='icarlyfanonwiki'; [22:11:38] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_permissions WHERE perm_dbname='icarlyfanonwiki'; [22:11:39] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localnames WHERE ln_wiki='icarlyfanonwiki'; [22:11:40] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:11:40] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localuser WHERE lu_wiki='icarlyfanonwiki'; [22:11:41] !log [universalomega@db101] MariaDB [metawiki]> DELETE FROM echo_unread_wikis WHERE euw_wiki='icarlyfanonwiki'; [22:11:46] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:11:58] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:12:03] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:12:08] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:12:15] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:12:22] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:14:01] !log [universalomega@puppet141] sudo -u www-data rm /srv/mediawiki/cache/*nishikawawiki* on mw*, test131, and mwtask141 [22:14:07] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:14:10] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM cw_wikis WHERE wiki_dbname='nishikawawiki'; [22:14:11] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_settings WHERE s_dbname='nishikawawiki'; [22:14:12] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_namespaces WHERE ns_dbname='nishikawawiki'; [22:14:13] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_permissions WHERE perm_dbname='nishikawawiki'; [22:14:14] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localnames WHERE ln_wiki='nishikawawiki'; [22:14:15] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localuser WHERE lu_wiki='nishikawawiki'; [22:14:16] !log [universalomega@db101] MariaDB [metawiki]> DELETE FROM echo_unread_wikis WHERE euw_wiki='nishikawawiki'; [22:14:16] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:14:25] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:14:32] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:14:36] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:14:44] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:14:49] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:14:53] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:15:01] PROBLEM - cp22 Current Load on cp22 is WARNING: WARNING - load average: 3.51, 2.56, 1.42 [22:17:01] PROBLEM - cp22 Current Load on cp22 is CRITICAL: CRITICAL - load average: 5.77, 4.22, 2.18 [22:17:02] !log [universalomega@puppet141] sudo -u www-data rm /srv/mediawiki/cache/*gensekaiwiki* on mw*, test131, and mwtask141 [22:17:10] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM cw_wikis WHERE wiki_dbname='gensekaiwiki'; [22:17:11] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_settings WHERE s_dbname='gensekaiwiki'; [22:17:12] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_namespaces WHERE ns_dbname='gensekaiwiki'; [22:17:13] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_permissions WHERE perm_dbname='gensekaiwiki'; [22:17:14] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localnames WHERE ln_wiki='gensekaiwiki'; [22:17:15] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localuser WHERE lu_wiki='gensekaiwiki'; [22:17:16] !log [universalomega@db101] MariaDB [metawiki]> DELETE FROM echo_unread_wikis WHERE euw_wiki='gensekaiwiki'; [22:17:21] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:17:36] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:17:44] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:17:58] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:18:03] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:18:09] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:18:15] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:18:21] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:19:01] RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 1.07, 2.94, 1.96 [22:20:22] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 3.66, 4.10, 3.98 [22:22:22] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 2.97, 3.80, 3.90 [22:24:59] !log [universalomega@puppet141] sudo -u www-data rm /srv/mediawiki/cache/*cparchiveswiki* on mw*, test131, and mwtask141 [22:25:08] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:25:11] !log [universalomega@puppet141] sudo -u www-data rm /srv/mediawiki/cache/*cpfanonwiki* on mw*, test131, and mwtask141 [22:25:13] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.83, 3.35, 2.24 [22:25:18] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:28:22] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 5.08, 4.04, 3.92 [22:28:26] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM cw_wikis WHERE wiki_dbname='cparchiveswiki'; [22:28:27] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_settings WHERE s_dbname='cparchiveswiki'; [22:28:28] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_namespaces WHERE ns_dbname='cparchiveswiki'; [22:28:29] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_permissions WHERE perm_dbname='cparchiveswiki'; [22:28:30] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localnames WHERE ln_wiki='cparchiveswiki'; [22:28:31] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localuser WHERE lu_wiki='cparchiveswiki'; [22:28:31] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:28:32] !log [universalomega@db101] MariaDB [metawiki]> DELETE FROM echo_unread_wikis WHERE euw_wiki='cparchiveswiki'; [22:28:43] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:28:48] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:28:53] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:28:59] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:29:03] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:29:07] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:29:13] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.09, 3.40, 2.56 [22:29:37] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM cw_wikis WHERE wiki_dbname='cpfanonwiki'; [22:29:38] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_settings WHERE s_dbname='cpfanonwiki'; [22:29:39] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_namespaces WHERE ns_dbname='cpfanonwiki'; [22:29:40] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_permissions WHERE perm_dbname='cpfanonwiki'; [22:29:41] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localnames WHERE ln_wiki='cpfanonwiki'; [22:29:42] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localuser WHERE lu_wiki='cpfanonwiki'; [22:29:43] !log [universalomega@db101] MariaDB [metawiki]> DELETE FROM echo_unread_wikis WHERE euw_wiki='cpfanonwiki'; [22:29:45] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:29:55] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:30:19] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:30:27] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:30:34] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:30:38] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:30:43] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:31:03] !log [universalomega@puppet141] sudo -u www-data rm /srv/mediawiki/cache/*cpwwiki* on mw*, test131, and mwtask141 [22:31:22] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:32:57] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM cw_wikis WHERE wiki_dbname='cpwwiki'; [22:32:58] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_settings WHERE s_dbname='cpwwiki'; [22:32:59] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_namespaces WHERE ns_dbname='cpwwiki'; [22:33:00] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_permissions WHERE perm_dbname='cpwwiki'; [22:33:01] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localnames WHERE ln_wiki='cpwwiki'; [22:33:02] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localuser WHERE lu_wiki='cpwwiki'; [22:33:03] !log [universalomega@db101] MariaDB [metawiki]> DELETE FROM echo_unread_wikis WHERE euw_wiki='cpwwiki'; [22:33:06] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:33:15] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:33:21] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:33:25] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:33:31] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:33:42] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:33:48] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:34:17] PROBLEM - discordian.wiki - LetsEncrypt on sslhost is CRITICAL: connect to address discordian.wiki and port 443: Network is unreachableHTTP CRITICAL - Unable to open TCP socket [22:36:41] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.03, 2.55, 1.74 [22:37:17] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM cw_wikis WHERE wiki_dbname='polandballwikisongcontestwiki'; [22:37:18] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_settings WHERE s_dbname='polandballwikisongcontestwiki'; [22:37:19] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_namespaces WHERE ns_dbname='polandballwikisongcontestwiki'; [22:37:20] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_permissions WHERE perm_dbname='polandballwikisongcontestwiki'; [22:37:21] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localnames WHERE ln_wiki='polandballwikisongcontestwiki'; [22:37:22] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localuser WHERE lu_wiki='polandballwikisongcontestwiki'; [22:37:23] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:37:23] !log [universalomega@db101] MariaDB [metawiki]> DELETE FROM echo_unread_wikis WHERE euw_wiki='polandballwikisongcontestwiki'; [22:37:31] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:37:36] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:37:41] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:37:46] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:37:51] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:38:06] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:39:59] !log [universalomega@puppet141] sudo -u www-data rm /srv/mediawiki/cache/*polcomwiki* on mw*, test131, and mwtask141 [22:40:10] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:40:22] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 3.14, 3.76, 3.96 [22:40:53] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM cw_wikis WHERE wiki_dbname='polcomwiki'; [22:40:54] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_settings WHERE s_dbname='polcomwiki'; [22:40:55] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_namespaces WHERE ns_dbname='polcomwiki'; [22:40:56] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_permissions WHERE perm_dbname='polcomwiki'; [22:40:58] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localnames WHERE ln_wiki='polcomwiki'; [22:40:59] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localuser WHERE lu_wiki='polcomwiki'; [22:41:00] !log [universalomega@db101] MariaDB [metawiki]> DELETE FROM echo_unread_wikis WHERE euw_wiki='polcomwiki'; [22:41:14] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:41:20] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:41:25] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:41:33] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:41:40] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:41:47] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:41:51] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:42:22] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 3.77, 4.00, 4.03 [22:42:34] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.09, 3.95, 2.70 [22:44:22] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 2.77, 3.39, 3.79 [22:44:44] !log [universalomega@puppet141] sudo -u www-data rm /srv/mediawiki/cache/*mogaiwiki* on mw*, test131, and mwtask141 [22:44:50] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:45:14] PROBLEM - cp22 NTP time on cp22 is WARNING: NTP WARNING: Offset 0.1320046782 secs [22:45:23] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM cw_wikis WHERE wiki_dbname='mogaiwiki'; [22:45:24] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_settings WHERE s_dbname='mogaiwiki'; [22:45:25] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_namespaces WHERE ns_dbname='mogaiwiki'; [22:45:26] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_permissions WHERE perm_dbname='mogaiwiki'; [22:45:27] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localnames WHERE ln_wiki='mogaiwiki'; [22:45:28] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localuser WHERE lu_wiki='mogaiwiki'; [22:45:29] !log [universalomega@db101] MariaDB [metawiki]> DELETE FROM echo_unread_wikis WHERE euw_wiki='mogaiwiki'; [22:45:30] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:45:34] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:45:46] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:45:51] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:45:57] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:46:03] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:46:09] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:46:30] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 7.99, 5.27, 3.45 [22:47:04] !log [universalomega@puppet141] sudo -u www-data rm /srv/mediawiki/cache/*cpshopswiki* on mw*, test131, and mwtask141 [22:47:10] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:47:24] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM cw_wikis WHERE wiki_dbname='cpshopswiki'; [22:47:25] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_settings WHERE s_dbname='cpshopswiki'; [22:47:26] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_namespaces WHERE ns_dbname='cpshopswiki'; [22:47:27] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_permissions WHERE perm_dbname='cpshopswiki'; [22:47:28] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localnames WHERE ln_wiki='cpshopswiki'; [22:47:29] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localuser WHERE lu_wiki='cpshopswiki'; [22:47:30] !log [universalomega@db101] MariaDB [metawiki]> DELETE FROM echo_unread_wikis WHERE euw_wiki='cpshopswiki'; [22:47:40] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:47:58] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:48:13] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:48:20] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:48:22] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 4.97, 4.08, 3.95 [22:48:25] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:48:34] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:48:40] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:49:03] !log [universalomega@puppet141] sudo -u www-data rm /srv/mediawiki/cache/*cpwptwiki* on mw*, test131, and mwtask141 [22:49:16] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM cw_wikis WHERE wiki_dbname='cpwptwiki'; [22:49:17] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_settings WHERE s_dbname='cpwptwiki'; [22:49:18] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_namespaces WHERE ns_dbname='cpwptwiki'; [22:49:19] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_permissions WHERE perm_dbname='cpwptwiki'; [22:49:20] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localnames WHERE ln_wiki='cpwptwiki'; [22:49:20] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:49:21] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localuser WHERE lu_wiki='cpwptwiki'; [22:49:22] !log [universalomega@db101] MariaDB [metawiki]> DELETE FROM echo_unread_wikis WHERE euw_wiki='cpwptwiki'; [22:49:34] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:49:44] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:49:54] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:50:10] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:50:15] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:50:21] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:50:25] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.29, 3.10, 2.98 [22:50:29] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:51:13] !log [universalomega@puppet141] sudo -u www-data rm /srv/mediawiki/cache/*ballmediawiki* on mw*, test131, and mwtask141 [22:51:31] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:51:36] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM cw_wikis WHERE wiki_dbname='ballmediawiki'; [22:51:37] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_settings WHERE s_dbname='ballmediawiki'; [22:51:38] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_namespaces WHERE ns_dbname='ballmediawiki'; [22:51:39] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_permissions WHERE perm_dbname='ballmediawiki'; [22:51:40] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localnames WHERE ln_wiki='ballmediawiki'; [22:51:41] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localuser WHERE lu_wiki='ballmediawiki'; [22:51:42] !log [universalomega@db101] MariaDB [metawiki]> DELETE FROM echo_unread_wikis WHERE euw_wiki='ballmediawiki'; [22:51:42] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:51:52] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:52:05] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:52:12] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:52:18] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:52:24] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:52:31] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:53:44] !log [universalomega@puppet141] sudo -u www-data rm /srv/mediawiki/cache/*polcompballanarchywiki* on mw*, test131, and mwtask141 [22:53:53] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:54:02] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM cw_wikis WHERE wiki_dbname='polcompballanarchywiki'; [22:54:03] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_settings WHERE s_dbname='polcompballanarchywiki'; [22:54:04] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_namespaces WHERE ns_dbname='polcompballanarchywiki'; [22:54:05] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_permissions WHERE perm_dbname='polcompballanarchywiki'; [22:54:06] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localnames WHERE ln_wiki='polcompballanarchywiki'; [22:54:07] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localuser WHERE lu_wiki='polcompballanarchywiki'; [22:54:07] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:54:08] !log [universalomega@db101] MariaDB [metawiki]> DELETE FROM echo_unread_wikis WHERE euw_wiki='polcompballanarchywiki'; [22:54:14] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:54:18] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:54:22] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 2.04, 3.40, 3.77 [22:54:23] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:54:34] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:54:54] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:55:03] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:56:22] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 5.95, 4.34, 4.06 [22:57:14] RECOVERY - cp22 NTP time on cp22 is OK: NTP OK: Offset 0.07575431466 secs [23:00:22] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 2.38, 3.73, 3.90 [23:08:22] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 4.96, 4.01, 3.90 [23:10:22] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 2.73, 3.58, 3.77 [23:13:04] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.23, 3.49, 2.84 [23:15:00] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 2.42, 3.09, 2.78 [23:16:22] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 4.38, 3.47, 3.59 [23:20:22] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 3.49, 3.55, 3.60 [23:22:22] RECOVERY - gluster112 Current Load on gluster112 is OK: OK - load average: 2.10, 2.94, 3.36 [23:25:16] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 7.70, 5.58, 3.10 [23:28:22] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 4.80, 3.52, 3.44 [23:30:22] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 3.38, 3.42, 3.41 [23:31:13] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.50, 3.37, 2.93 [23:31:50] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 3.89, 2.84, 1.61 [23:33:50] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.52, 2.50, 1.65 [23:36:22] RECOVERY - gluster112 Current Load on gluster112 is OK: OK - load average: 1.99, 2.89, 3.23 [23:48:50] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.67, 3.30, 2.92 [23:49:28] PROBLEM - cp32 NTP time on cp32 is WARNING: NTP WARNING: Offset 0.1886677146 secs [23:50:48] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.57, 3.76, 3.13 [23:52:47] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.75, 3.76, 3.21 [23:53:12] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 6.82, 4.41, 3.55 [23:54:45] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 2.59, 3.35, 3.13 [23:55:09] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 2.97, 3.70, 3.39 [23:58:29] [02CreateWiki] 07Universal-Omega closed pull request 03#353: Allow choosing cluster from Special:CreateWiki - 13https://github.com/miraheze/CreateWiki/pull/353 [23:58:30] [url] Page not found · GitHub · GitHub | github.com [23:59:04] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 4.19, 3.52, 3.35