[00:03:03] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.95, 3.39, 2.97 [00:05:00] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 3.12, 3.33, 3.00 [00:05:00] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.29, 3.48, 3.90 [00:14:56] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.05, 3.32, 3.50 [00:16:55] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.32, 2.83, 3.29 [00:20:20] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 2.15, 2.57, 3.86 [00:24:20] RECOVERY - gluster102 Current Load on gluster102 is OK: OK - load average: 1.44, 2.07, 3.37 [00:28:20] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 5.07, 4.08, 3.92 [00:30:20] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 3.40, 3.73, 3.81 [00:35:12] [02puppet] 07paladox closed pull request 03#2961: swiftobject114/5: reduce workers - 13https://github.com/miraheze/puppet/pull/2961 [00:35:14] [02miraheze/puppet] 07paladox deleted branch 03paladox-patch-5 [00:35:15] [02puppet] 07paladox deleted branch 03paladox-patch-5 - 13https://github.com/miraheze/puppet [00:35:18] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/507e9e4764da...f620fade87e8 [00:35:20] [02miraheze/puppet] 07paladox 03f620fad - swiftobject114/5: reduce workers (#2961) [00:35:56] RECOVERY - swiftobject114 Puppet on swiftobject114 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [00:36:21] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 5.24, 3.82, 3.72 [00:37:19] RECOVERY - swiftobject115 Puppet on swiftobject115 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [00:37:45] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 6.36, 4.16, 3.30 [00:40:25] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.13, 9.21, 8.03 [00:42:24] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.10, 8.69, 7.99 [00:47:41] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 1.80, 3.38, 3.46 [00:49:41] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.92, 2.95, 3.30 [00:50:20] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 1.91, 2.92, 3.72 [01:00:20] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 4.63, 4.79, 4.25 [01:00:35] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.71, 3.72, 3.49 [01:01:25] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 20.25, 8.40, 4.03 [01:02:35] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.16, 3.20, 3.33 [01:04:18] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.53, 3.10, 2.81 [01:06:16] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 2.81, 2.95, 2.79 [01:08:20] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 2.89, 3.61, 3.97 [01:11:10] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 0.91, 3.40, 3.94 [01:12:17] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.33, 9.50, 8.27 [01:14:17] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 9.40, 9.55, 8.45 [01:14:20] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 4.97, 3.67, 3.81 [01:14:49] PROBLEM - cp22 Current Load on cp22 is WARNING: WARNING - load average: 3.67, 2.85, 1.81 [01:15:09] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.10, 2.08, 3.26 [01:16:47] PROBLEM - cp22 Current Load on cp22 is CRITICAL: CRITICAL - load average: 4.38, 3.23, 2.06 [01:18:45] RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 3.07, 3.28, 2.24 [01:20:35] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.75, 5.00, 3.94 [01:22:02] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.60, 3.54, 2.70 [01:26:35] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.72, 3.58, 3.68 [01:27:09] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 3.52, 2.19, 2.41 [01:29:47] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.60, 3.78, 3.25 [01:31:09] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 6.61, 4.15, 3.12 [01:31:43] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.49, 3.16, 3.09 [01:32:17] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.04, 9.61, 8.60 [01:32:35] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.21, 3.55, 3.58 [01:33:09] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 2.48, 3.60, 3.06 [01:34:17] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 6.76, 8.55, 8.34 [01:35:09] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 0.45, 2.45, 2.70 [01:37:35] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.47, 3.25, 3.10 [01:37:44] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.43, 3.32, 3.03 [01:39:32] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.75, 2.92, 3.00 [01:39:42] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 3.24, 3.29, 3.06 [01:40:35] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.19, 3.54, 3.73 [01:45:35] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.59, 3.52, 3.23 [01:46:35] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.68, 2.57, 3.23 [01:47:33] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 4.75, 3.95, 3.42 [01:49:32] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 2.14, 3.43, 3.30 [01:51:30] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 2.94, 3.14, 3.21 [01:54:09] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.06, 3.17, 3.00 [01:56:05] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.98, 3.07, 2.98 [02:07:26] PROBLEM - scpvncommunitywiki.xyz - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Certificate 'scpvncommunitywiki.xyz' expires in 7 day(s) (Sat 05 Nov 2022 01:49:25 GMT +0000). [02:11:09] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 4.65, 3.41, 3.18 [02:11:27] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.04, 10.67, 9.46 [02:13:22] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.85, 10.52, 9.54 [02:15:05] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 2.92, 3.43, 3.26 [02:15:30] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.49, 3.17, 3.04 [02:17:03] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 2.80, 3.29, 3.23 [02:17:07] PROBLEM - wiki.otir.nl - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.otir.nl All nameservers failed to answer the query. [02:17:13] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.25, 9.25, 9.30 [02:17:29] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.95, 4.16, 3.40 [02:18:03] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.55, 3.48, 2.90 [02:20:01] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 3.18, 3.16, 2.84 [02:23:27] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.22, 3.54, 3.50 [02:24:55] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.78, 3.62, 3.38 [02:25:26] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.51, 3.25, 3.40 [02:26:53] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 4.48, 3.73, 3.43 [02:28:51] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.40, 3.68, 3.46 [02:29:23] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.38, 3.53, 3.50 [02:30:49] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 2.27, 3.20, 3.31 [02:31:23] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.66, 2.88, 3.26 [02:34:44] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.77, 3.54, 3.42 [02:36:20] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 1.67, 2.86, 3.97 [02:38:41] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 2.85, 3.26, 3.35 [02:42:20] RECOVERY - gluster102 Current Load on gluster102 is OK: OK - load average: 1.82, 2.42, 3.40 [02:46:36] PROBLEM - wiki.otir.nl - reverse DNS on sslhost is WARNING: Timeout: The DNS operation timed out after 5.406696557998657 seconds [02:51:27] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.58, 3.54, 3.38 [02:53:26] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 4.43, 3.82, 3.49 [02:54:45] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.21, 3.54, 2.67 [02:55:24] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 2.92, 3.45, 3.40 [02:56:44] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.35, 3.09, 2.62 [02:57:22] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 5.96, 4.20, 3.67 [02:57:54] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.78, 10.42, 9.07 [02:59:53] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.87, 10.24, 9.16 [03:00:37] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.88, 10.40, 9.19 [03:01:09] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 9.36, 5.21, 3.06 [03:01:51] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.95, 9.47, 9.02 [03:02:33] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 6.43, 8.69, 8.70 [03:03:03] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 2 datacenters are down: 74.208.203.152/cpweb, 2607:f1c0:1800:26f::1/cpweb [03:03:17] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.20, 3.81, 3.69 [03:03:26] PROBLEM - ns1 GDNSD Datacenters on ns1 is CRITICAL: CRITICAL - 2 datacenters are down: 74.208.203.152/cpweb, 2607:f1c0:1800:26f::1/cpweb [03:03:46] PROBLEM - cp33 NTP time on cp33 is WARNING: NTP WARNING: Offset 0.1231969595 secs [03:04:02] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 27.91, 21.85, 10.57 [03:05:03] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [03:05:09] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 0.92, 3.07, 2.70 [03:05:15] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 4.42, 3.90, 3.73 [03:05:26] RECOVERY - ns1 GDNSD Datacenters on ns1 is OK: OK - all datacenters are online [03:06:25] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.39, 9.61, 9.04 [03:07:13] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 2.15, 3.32, 3.54 [03:08:21] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 6.95, 8.62, 8.74 [03:09:12] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 1.77, 2.90, 3.37 [03:09:44] RECOVERY - cp33 NTP time on cp33 is OK: NTP OK: Offset 0.08155751228 secs [03:14:57] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 13.35, 8.18, 4.74 [03:15:04] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 8.39, 5.29, 3.14 [03:29:15] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.28, 2.02, 3.80 [03:29:48] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 5.63, 4.44, 3.72 [03:33:08] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.48, 1.98, 3.40 [03:33:45] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 2.83, 3.83, 3.66 [03:39:39] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 2.29, 3.02, 3.39 [03:46:51] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.58, 3.59, 3.93 [03:54:48] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.35, 2.54, 3.33 [04:11:08] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.92, 3.32, 3.06 [04:13:06] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 2.75, 3.14, 3.03 [04:13:39] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.93, 3.25, 3.01 [04:15:38] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.50, 4.57, 3.55 [04:17:37] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.82, 3.97, 3.46 [04:21:36] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.63, 4.09, 3.61 [04:23:35] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.62, 3.84, 3.57 [04:27:33] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.26, 3.13, 3.36 [04:30:48] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 4.12, 3.67, 3.26 [04:32:46] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.03, 3.48, 3.25 [04:34:45] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 1.59, 2.86, 3.05 [04:40:26] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.54, 3.72, 3.54 [04:42:25] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.95, 3.09, 3.34 [04:52:21] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.81, 3.98, 3.55 [04:52:57] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.88, 3.51, 2.64 [04:54:54] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 3.06, 3.19, 2.63 [04:56:19] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.77, 3.63, 3.54 [04:57:21] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.79, 3.36, 3.04 [04:59:20] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 1.50, 2.67, 2.83 [05:00:17] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.44, 3.77, 3.59 [05:02:17] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.13, 3.79, 3.64 [05:08:14] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.05, 2.97, 3.34 [05:11:40] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.54, 3.34, 2.71 [05:13:37] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.86, 3.63, 2.91 [05:15:33] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.61, 2.92, 2.74 [05:17:09] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.70, 3.59, 3.50 [05:19:09] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.32, 4.05, 3.66 [05:23:22] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.58, 3.52, 2.92 [05:24:54] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.76, 3.13, 2.78 [05:25:06] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.93, 3.83, 3.69 [05:25:18] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.94, 2.78, 2.72 [05:26:53] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 4.57, 3.46, 2.93 [05:28:51] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.13, 3.46, 3.01 [05:30:49] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 2.73, 3.19, 2.96 [05:31:04] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.61, 2.67, 3.23 [05:40:39] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 4.59, 3.61, 3.20 [05:42:37] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.83, 3.82, 3.33 [05:45:57] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.35, 3.89, 3.20 [05:46:34] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 2.41, 3.06, 3.14 [05:49:55] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.25, 3.50, 3.24 [05:51:54] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.41, 3.36, 3.24 [05:52:34] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 4.31, 3.61, 3.30 [05:53:33] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.77, 3.07, 2.70 [05:54:34] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.57, 3.72, 3.38 [05:57:25] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.33, 2.88, 2.72 [06:00:34] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 2.44, 3.11, 3.25 [06:12:53] RECOVERY - wiki.otir.nl - reverse DNS on sslhost is OK: SSL OK - wiki.otir.nl reverse DNS resolves to cp22.miraheze.org - CNAME OK [06:16:20] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 2.91, 2.89, 3.93 [06:18:20] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 4.96, 3.46, 4.00 [06:26:38] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.51, 3.31, 3.02 [06:28:29] PROBLEM - cp22 Current Load on cp22 is CRITICAL: CRITICAL - load average: 7.31, 5.81, 3.28 [06:29:09] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 3.85, 3.53, 2.57 [06:30:36] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 3.31, 3.39, 3.14 [06:32:28] PROBLEM - cp22 Current Load on cp22 is WARNING: WARNING - load average: 2.41, 3.86, 3.05 [06:33:09] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.18, 2.80, 2.57 [06:34:28] RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 1.57, 3.08, 2.86 [06:34:35] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.78, 3.93, 3.45 [06:36:35] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 6.37, 4.73, 3.79 [06:42:35] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 1.81, 3.58, 3.64 [06:46:28] PROBLEM - cp22 Current Load on cp22 is CRITICAL: CRITICAL - load average: 4.20, 3.79, 2.97 [06:46:35] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.10, 3.99, 3.80 [06:47:03] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.86, 3.78, 3.27 [06:48:28] RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 0.99, 2.73, 2.68 [06:48:35] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.52, 3.46, 3.63 [06:49:01] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 2.07, 3.19, 3.12 [06:56:35] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.87, 3.09, 3.37 [06:58:50] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 4.45, 3.67, 3.28 [07:00:49] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 3.01, 3.38, 3.22 [07:09:08] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.53, 3.42, 2.65 [07:11:08] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 3.20, 3.27, 2.69 [07:12:04] PROBLEM - zamlung.tk - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Certificate 'zamlung.tk' expires in 7 day(s) (Sat 05 Nov 2022 06:58:56 GMT +0000). [07:14:28] PROBLEM - cp22 Current Load on cp22 is CRITICAL: CRITICAL - load average: 4.63, 3.69, 2.92 [07:16:28] RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 1.55, 2.98, 2.76 [07:20:35] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.26, 3.47, 3.30 [07:21:28] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 4.13, 3.76, 3.26 [07:22:35] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 3.28, 3.33, 3.26 [07:23:27] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.63, 3.81, 3.34 [07:23:52] PROBLEM - cp32 NTP time on cp32 is WARNING: NTP WARNING: Offset 0.1400150061 secs [07:24:45] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.48, 3.04, 2.47 [07:25:25] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 1.74, 3.15, 3.16 [07:28:45] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 6.11, 3.81, 2.88 [07:32:44] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.42, 3.86, 3.13 [07:34:45] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 0.77, 2.71, 2.80 [07:41:52] RECOVERY - cp32 NTP time on cp32 is OK: NTP OK: Offset 0.09370803833 secs [07:42:20] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 1.76, 3.16, 3.98 [07:43:07] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.54, 3.45, 3.07 [07:44:20] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 5.92, 4.08, 4.20 [07:44:28] PROBLEM - cp22 Current Load on cp22 is CRITICAL: CRITICAL - load average: 4.24, 2.59, 1.82 [07:46:30] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.04, 3.22, 2.88 [07:47:03] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 2.88, 3.22, 3.08 [07:48:28] RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 1.27, 2.91, 2.24 [07:48:29] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.16, 2.81, 2.78 [07:54:44] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.64, 3.02, 2.44 [07:56:45] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 3.01, 2.76, 2.40 [07:58:51] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 4.68, 3.77, 3.22 [08:00:49] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 2.45, 3.39, 3.15 [08:04:20] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 2.57, 3.17, 3.87 [08:08:20] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 4.54, 3.34, 3.72 [08:10:20] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 3.05, 3.15, 3.60 [08:10:38] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.82, 3.46, 3.21 [08:12:36] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 3.36, 3.26, 3.15 [08:13:52] PROBLEM - cp32 NTP time on cp32 is WARNING: NTP WARNING: Offset -0.100669086 secs [08:14:28] PROBLEM - cp22 Current Load on cp22 is CRITICAL: CRITICAL - load average: 5.96, 3.59, 2.34 [08:15:52] RECOVERY - cp32 NTP time on cp32 is OK: NTP OK: Offset -0.08341172338 secs [08:16:20] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 4.01, 3.56, 3.64 [08:16:28] RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 2.83, 3.34, 2.41 [08:18:15] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.88, 3.35, 2.93 [08:20:14] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.42, 4.11, 3.26 [08:22:14] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.99, 3.22, 3.03 [08:23:29] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 4.60, 3.83, 3.42 [08:24:20] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 2.91, 3.80, 3.86 [08:24:45] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.43, 2.73, 2.11 [08:25:27] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.09, 3.55, 3.37 [08:28:20] RECOVERY - gluster102 Current Load on gluster102 is OK: OK - load average: 1.27, 2.54, 3.33 [08:28:45] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.33, 2.64, 2.24 [08:31:22] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 4.53, 3.87, 3.55 [08:32:44] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.07, 5.11, 3.44 [08:33:20] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 1.80, 3.14, 3.33 [08:34:44] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.30, 3.62, 3.09 [08:36:44] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 0.65, 2.58, 2.77 [08:42:20] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 7.05, 3.84, 3.25 [08:44:04] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.85, 3.96, 3.14 [08:44:28] PROBLEM - cp22 Current Load on cp22 is CRITICAL: CRITICAL - load average: 6.67, 4.18, 2.71 [08:46:03] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.60, 3.97, 3.26 [08:48:02] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.06, 3.31, 3.11 [08:48:28] RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 0.77, 2.83, 2.55 [08:50:20] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 2.20, 3.88, 3.75 [08:52:20] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 4.72, 4.30, 3.92 [08:54:20] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 1.22, 3.16, 3.55 [08:56:20] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 4.43, 3.97, 3.82 [08:58:20] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 2.54, 3.69, 3.75 [09:00:20] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 3.64, 4.08, 3.90 [09:00:55] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.01, 3.56, 3.30 [09:02:20] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 2.78, 3.64, 3.76 [09:02:55] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.61, 3.61, 3.35 [09:06:20] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 4.91, 3.95, 3.84 [09:06:53] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.51, 3.23, 3.26 [09:10:20] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 2.32, 3.60, 3.75 [09:14:20] RECOVERY - gluster102 Current Load on gluster102 is OK: OK - load average: 2.18, 2.70, 3.33 [09:31:42] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.81, 3.09, 2.87 [09:33:41] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.10, 3.66, 3.12 [09:35:40] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.11, 3.05, 2.96 [09:35:52] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 3.15, 3.65, 3.44 [09:37:49] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 5.31, 3.94, 3.54 [09:44:35] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.07, 3.51, 3.24 [09:45:34] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 2.76, 3.86, 3.77 [09:46:35] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 3.20, 3.40, 3.23 [09:49:26] RECOVERY - gluster102 Current Load on gluster102 is OK: OK - load average: 2.41, 2.79, 3.33 [09:57:09] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 3.49, 2.64, 2.10 [09:59:09] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 3.17, 3.04, 2.33 [10:09:51] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 5.05, 4.27, 3.43 [10:13:24] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.48, 3.46, 3.11 [10:15:40] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 2.86, 3.95, 3.63 [10:17:22] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.82, 3.31, 3.15 [10:17:36] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 3.92, 4.23, 3.79 [10:19:32] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 3.82, 3.85, 3.69 [10:23:19] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.68, 3.87, 3.37 [10:23:25] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 6.57, 4.83, 4.06 [10:25:18] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.76, 3.05, 3.12 [10:26:43] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 4.57, 3.70, 3.22 [10:30:39] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.89, 3.83, 3.41 [10:34:36] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 2.81, 3.38, 3.32 [10:47:15] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.52, 2.89, 2.08 [10:51:08] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.43, 2.75, 2.27 [11:10:18] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.43, 3.17, 3.06 [11:12:17] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 2.91, 3.14, 3.06 [11:12:57] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.47, 2.98, 2.92 [11:20:54] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.19, 2.96, 3.01 [11:24:51] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.75, 3.52, 3.24 [11:27:59] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 4.35, 3.62, 3.21 [11:31:56] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.43, 3.69, 3.35 [11:32:48] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.01, 3.63, 3.36 [11:33:54] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 2.10, 3.09, 3.17 [11:34:47] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.79, 3.44, 3.33 [11:36:47] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.60, 2.90, 3.15 [11:42:28] PROBLEM - cp22 Current Load on cp22 is CRITICAL: CRITICAL - load average: 4.64, 2.88, 1.90 [11:44:20] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 1.13, 2.14, 3.76 [11:44:28] RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 2.43, 2.79, 2.00 [11:48:20] RECOVERY - gluster102 Current Load on gluster102 is OK: OK - load average: 1.27, 2.01, 3.39 [11:52:35] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 4.68, 3.43, 3.12 [11:54:20] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 3.67, 3.46, 3.60 [11:54:34] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.48, 3.46, 3.18 [11:56:20] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 4.98, 3.71, 3.65 [11:56:34] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 2.73, 3.24, 3.14 [11:56:52] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.02, 3.50, 2.60 [11:58:49] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.33, 2.70, 2.42 [11:59:09] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 3.81, 2.77, 2.08 [11:59:35] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.47, 3.49, 3.07 [12:00:34] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.21, 3.43, 3.26 [12:02:34] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 4.56, 3.82, 3.42 [12:03:09] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.08, 2.21, 2.03 [12:04:34] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 2.33, 3.28, 3.27 [12:05:33] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.38, 4.18, 3.47 [12:07:32] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 1.99, 3.41, 3.28 [12:09:31] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.60, 3.25, 3.24 [12:13:27] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 4.30, 3.77, 3.46 [12:15:25] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 1.93, 3.22, 3.30 [12:15:28] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 7.02, 4.34, 3.60 [12:23:25] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.42, 3.48, 3.62 [12:25:15] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.72, 3.56, 3.37 [12:27:13] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 3.17, 3.37, 3.32 [12:30:44] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.93, 3.41, 2.80 [12:32:44] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.28, 2.60, 2.57 [12:32:46] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 8.75, 4.56, 2.95 [12:33:21] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 3.20, 3.12, 3.40 [12:34:43] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 2.34, 3.63, 2.81 [12:36:40] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.39, 2.74, 2.57 [12:37:19] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.56, 3.32, 3.46 [12:41:17] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.81, 2.78, 3.24 [12:54:11] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.65, 3.81, 3.39 [12:58:39] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 4.14, 3.79, 3.29 [13:00:07] PROBLEM - cp33 Varnish Backends on cp33 is CRITICAL: 2 backends are down. mw131 mw132 [13:00:38] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.24, 3.51, 3.24 [13:03:56] RECOVERY - cp33 Varnish Backends on cp33 is OK: All 14 backends are healthy [13:04:07] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 1.83, 3.40, 3.63 [13:04:34] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 4.44, 3.92, 3.47 [13:06:34] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.97, 3.97, 3.55 [13:08:34] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 4.17, 4.12, 3.66 [13:10:04] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.54, 3.00, 3.37 [13:10:27] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.66, 10.21, 8.96 [13:10:34] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.36, 3.81, 3.60 [13:12:34] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 4.34, 4.04, 3.71 [13:14:18] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.49, 9.46, 9.01 [13:15:06] PROBLEM - cp22 Current Load on cp22 is CRITICAL: CRITICAL - load average: 4.72, 3.95, 2.58 [13:16:01] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 6.77, 4.58, 3.84 [13:17:04] PROBLEM - cp22 Current Load on cp22 is WARNING: WARNING - load average: 2.28, 3.42, 2.56 [13:19:02] RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 0.87, 2.53, 2.33 [13:20:34] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.15, 3.80, 3.78 [13:28:49] PROBLEM - cp22 Current Load on cp22 is CRITICAL: CRITICAL - load average: 5.13, 3.11, 2.44 [13:29:42] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 7.03, 4.74, 3.00 [13:30:46] RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 2.71, 3.11, 2.54 [13:34:34] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 5.62, 4.07, 3.77 [13:35:31] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.12, 3.56, 3.17 [13:35:53] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.18, 3.17, 3.76 [13:36:34] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 2.64, 3.53, 3.61 [13:37:27] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 0.96, 2.71, 2.90 [13:42:08] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.06, 10.93, 9.50 [13:43:11] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.63, 10.33, 9.06 [13:43:50] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.55, 2.43, 3.26 [13:44:08] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.40, 11.02, 9.71 [13:44:34] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 2.02, 3.04, 3.39 [13:47:08] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 10.20, 10.00, 9.19 [13:48:34] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.30, 3.52, 3.54 [13:52:08] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.26, 11.86, 10.45 [13:52:34] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 6.50, 4.33, 3.81 [13:53:02] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.86, 10.83, 9.78 [13:54:08] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.44, 11.61, 10.53 [13:56:58] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.91, 11.07, 10.05 [13:58:08] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.07, 12.12, 10.98 [13:58:57] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.81, 9.91, 9.73 [14:00:08] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.50, 11.29, 10.82 [14:02:40] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.66, 3.79, 3.37 [14:04:20] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 2.40, 3.49, 3.92 [14:04:40] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.03, 3.49, 3.31 [14:05:10] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 4.12, 3.22, 2.71 [14:06:39] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.36, 2.85, 3.11 [14:07:04] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 3.15, 3.10, 2.72 [14:08:08] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.70, 9.18, 9.97 [14:10:20] RECOVERY - gluster102 Current Load on gluster102 is OK: OK - load average: 2.42, 2.72, 3.40 [14:10:35] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 2.60, 3.50, 3.97 [14:10:36] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.41, 3.14, 3.15 [14:12:36] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.58, 3.04, 3.12 [14:14:34] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 4.58, 3.74, 3.93 [14:14:43] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.07, 10.10, 9.44 [14:16:28] PROBLEM - cp22 Current Load on cp22 is CRITICAL: CRITICAL - load average: 6.12, 4.03, 2.73 [14:16:42] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.25, 10.52, 9.68 [14:18:28] RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 1.96, 3.26, 2.61 [14:18:34] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.79, 3.75, 3.89 [14:19:00] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.05, 10.38, 10.10 [14:20:34] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 4.42, 4.03, 3.98 [14:22:37] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.41, 9.29, 9.44 [14:24:20] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 14.03, 6.04, 4.09 [14:24:34] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 2.47, 3.70, 3.90 [14:24:46] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.08, 9.56, 9.91 [14:25:30] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 8.66, 5.64, 4.02 [14:27:08] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.12, 3.25, 2.49 [14:29:08] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.75, 3.14, 2.55 [14:29:24] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 3.95, 3.69, 2.56 [14:31:21] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 2.96, 3.25, 2.52 [14:33:39] PROBLEM - wiki.auraxis.co - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.auraxis.co All nameservers failed to answer the query. [14:38:45] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.09, 3.83, 2.57 [14:40:44] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.13, 2.74, 2.32 [14:42:34] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 4.77, 3.98, 3.77 [14:43:50] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.61, 3.42, 3.09 [14:45:45] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.91, 3.37, 3.12 [14:46:28] PROBLEM - cp22 Current Load on cp22 is CRITICAL: CRITICAL - load average: 5.48, 3.58, 2.31 [14:48:28] RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 1.95, 3.06, 2.29 [14:50:21] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-5 [+0/-0/±1] 13https://github.com/miraheze/puppet/commit/44a3a8b91c05 [14:50:22] [02miraheze/puppet] 07paladox 0344a3a8b - swift: increase workers for proxy [14:50:23] [02puppet] 07paladox created branch 03paladox-patch-5 - 13https://github.com/miraheze/puppet [14:50:24] [02puppet] 07paladox opened pull request 03#2964: swift: increase workers for proxy - 13https://github.com/miraheze/puppet/pull/2964 [14:50:52] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-5 [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/44a3a8b91c05...d36ec18bce5f [14:50:54] [02miraheze/puppet] 07paladox 03d36ec18 - Update swiftproxy131.yaml [14:50:57] [02puppet] 07paladox synchronize pull request 03#2964: swift: increase workers for proxy - 13https://github.com/miraheze/puppet/pull/2964 [14:54:35] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.92, 3.89, 3.88 [14:54:45] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.92, 3.07, 2.44 [14:56:45] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.25, 3.74, 2.75 [14:58:45] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.64, 2.87, 2.56 [15:01:04] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.51, 9.31, 8.93 [15:02:13] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.21, 3.47, 3.29 [15:04:08] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.45, 3.13, 3.19 [15:04:15] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.20, 9.58, 9.20 [15:05:01] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.49, 9.42, 9.11 [15:06:11] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 9.31, 9.42, 9.19 [15:08:34] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 2.30, 2.89, 3.35 [15:11:05] PROBLEM - mw121 MediaWiki Rendering on mw121 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:12:15] PROBLEM - mw122 MediaWiki Rendering on mw122 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:13:02] RECOVERY - mw121 MediaWiki Rendering on mw121 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.623 second response time [15:14:11] RECOVERY - mw122 MediaWiki Rendering on mw122 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 1.138 second response time [15:14:28] PROBLEM - cp22 Current Load on cp22 is CRITICAL: CRITICAL - load average: 4.71, 3.49, 2.49 [15:16:28] RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 1.22, 2.58, 2.27 [15:17:05] [Grafana] FIRING: Some MediaWiki Appservers are running out of PHP-FPM workers. https://grafana.miraheze.org/d/GtxbP1Xnk [15:17:27] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 4.32, 3.50, 3.34 [15:21:24] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.03, 3.42, 3.37 [15:22:05] [Grafana] RESOLVED: PHP-FPM Worker Usage High https://grafana.miraheze.org/d/GtxbP1Xnk [15:25:20] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 4.37, 3.71, 3.48 [15:27:19] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.35, 3.71, 3.52 [15:31:15] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 1.60, 2.74, 3.18 [15:32:59] PROBLEM - wiki.auraxis.co - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query auraxis.co. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [15:35:10] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.49, 3.13, 3.25 [15:37:08] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 4.53, 3.61, 3.41 [15:39:06] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.77, 3.71, 3.47 [15:41:04] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 5.14, 4.18, 3.67 [15:42:33] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.83, 9.63, 8.66 [15:44:31] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.25, 8.71, 8.42 [15:48:57] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.97, 3.92, 3.77 [15:53:09] [02miraheze/mw-config] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://github.com/miraheze/mw-config/commit/f929a00ef679 [15:53:10] [02miraheze/mw-config] 07paladox 03f929a00 - Switch wikis beginning with c to swift [15:53:11] [02mw-config] 07paladox created branch 03paladox-patch-1 - 13https://github.com/miraheze/mw-config [15:53:12] [02mw-config] 07paladox opened pull request 03#4946: Switch wikis beginning with c to swift - 13https://github.com/miraheze/mw-config/pull/4946 [15:53:36] [02mw-config] 07paladox closed pull request 03#4946: Switch wikis beginning with c to swift - 13https://github.com/miraheze/mw-config/pull/4946 [15:53:37] [02miraheze/mw-config] 07paladox deleted branch 03paladox-patch-1 [15:53:38] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/cf4fe3ea60c4...42836a7992a6 [15:53:40] [02miraheze/mw-config] 07paladox 0342836a7 - Switch wikis beginning with c to swift (#4946) [15:53:42] [02mw-config] 07paladox deleted branch 03paladox-patch-1 - 13https://github.com/miraheze/mw-config [15:53:54] !log [paladox@mwtask141] starting deploy of {'pull': 'config', 'config': True} to all [15:54:01] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:54:14] miraheze/mw-config - paladox the build passed. [15:54:16] !log [paladox@mwtask141] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 21s [15:54:17] !log [paladox@test131] starting deploy of {'pull': 'config', 'config': True} to all [15:54:20] !log [paladox@test131] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 3s [15:54:24] !log [paladox@mwtask141] starting deploy of {'config': True} to all [15:54:25] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-2 [+0/-0/±1] 13https://github.com/miraheze/mw-config/commit/bcb355df0cdd [15:54:27] [02miraheze/mw-config] 07Universal-Omega 03bcb355d - Use static-new for commonswiki [15:54:28] [02mw-config] 07Universal-Omega created branch 03Universal-Omega-patch-2 - 13https://github.com/miraheze/mw-config [15:54:30] [02mw-config] 07Universal-Omega opened pull request 03#4947: Use static-new for commonswiki - 13https://github.com/miraheze/mw-config/pull/4947 [15:54:30] !log [paladox@test131] starting deploy of {'config': True} to all [15:54:31] !log [paladox@test131] finished deploy of {'config': True} to all - SUCCESS in 0s [15:54:34] miraheze/mw-config - paladox the build passed. [15:54:39] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:54:45] !log [paladox@mwtask141] finished deploy of {'config': True} to all - SUCCESS in 21s [15:54:49] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.64, 3.34, 2.57 [15:54:55] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:55:11] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:55:24] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:55:32] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:55:34] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-2 [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/bcb355df0cdd...c67f7982e25d [15:55:37] [02miraheze/mw-config] 07Universal-Omega 03c67f798 - Update LocalSettings.php [15:55:38] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:55:39] miraheze/mw-config - Universal-Omega the build passed. [15:55:40] [02mw-config] 07Universal-Omega synchronize pull request 03#4947: Use static-new for commonswiki - 13https://github.com/miraheze/mw-config/pull/4947 [15:55:44] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:56:43] miraheze/mw-config - Universal-Omega the build passed. [15:56:46] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.73, 2.93, 2.53 [15:56:50] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 4.04, 3.61, 3.62 [15:58:49] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.32, 3.72, 3.68 [15:59:58] [02puppet] 07paladox closed pull request 03#2964: swift: increase workers for proxy - 13https://github.com/miraheze/puppet/pull/2964 [16:00:00] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±2] 13https://github.com/miraheze/puppet/compare/f620fade87e8...709a5a15f82e [16:00:01] [02miraheze/puppet] 07paladox 03709a5a1 - swift: increase workers for proxy (#2964) [16:00:03] [02puppet] 07paladox deleted branch 03paladox-patch-5 - 13https://github.com/miraheze/puppet [16:00:04] [02miraheze/puppet] 07paladox deleted branch 03paladox-patch-5 [16:00:31] [02miraheze/puppet] 07paladox pushed 031 commit to 03revert-2961-paladox-patch-5 [+0/-0/±1] 13https://github.com/miraheze/puppet/commit/b334d9b2488a [16:00:32] [02miraheze/puppet] 07paladox 03b334d9b - Revert "swiftobject114/5: reduce workers (#2961)" [16:00:35] [02puppet] 07paladox created branch 03revert-2961-paladox-patch-5 - 13https://github.com/miraheze/puppet [16:00:38] [02puppet] 07paladox opened pull request 03#2965: Revert "swiftobject114/5: reduce workers" - 13https://github.com/miraheze/puppet/pull/2965 [16:00:39] [02puppet] 07paladox closed pull request 03#2965: Revert "swiftobject114/5: reduce workers" - 13https://github.com/miraheze/puppet/pull/2965 [16:00:42] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/709a5a15f82e...363411ad81d1 [16:00:43] [02miraheze/puppet] 07paladox 03363411a - Revert "swiftobject114/5: reduce workers" (#2965) [16:00:45] [02miraheze/puppet] 07paladox deleted branch 03revert-2961-paladox-patch-5 [16:00:47] [02puppet] 07paladox deleted branch 03revert-2961-paladox-patch-5 - 13https://github.com/miraheze/puppet [16:02:19] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-2 [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/c67f7982e25d...14e238fd27d3 [16:02:22] [02miraheze/mw-config] 07Universal-Omega 0314e238f - Update GlobalSettings.php [16:02:25] [02mw-config] 07Universal-Omega synchronize pull request 03#4947: Use static-new for commonswiki - 13https://github.com/miraheze/mw-config/pull/4947 [16:02:37] [02mw-config] 07Universal-Omega edited pull request 03#4947: Use Swift for commonswiki - 13https://github.com/miraheze/mw-config/pull/4947 [16:03:30] miraheze/mw-config - Universal-Omega the build passed. [16:04:17] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.93, 10.13, 9.29 [16:06:17] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 9.42, 9.52, 9.15 [16:06:41] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 2.93, 3.06, 3.38 [16:08:01] [02mw-config] 07Universal-Omega closed pull request 03#4947: Use Swift for commonswiki - 13https://github.com/miraheze/mw-config/pull/4947 [16:08:02] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±3] 13https://github.com/miraheze/mw-config/compare/42836a7992a6...71a9273b06b9 [16:08:03] [02miraheze/mw-config] 07Universal-Omega 0371a9273 - Use Swift for commonswiki (#4947) [16:08:05] [02miraheze/mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-2 [16:08:06] [02mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-2 - 13https://github.com/miraheze/mw-config [16:08:31] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/deleteBatch.php --wiki=monstergirlencyclopediawiki --r=Requested at [[phab:T9754 [16:08:33] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/deleteBatch.php --wiki=monstergirlencyclopediawiki --r=Requested at [[phab:T9754 [16:08:53] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:08:59] miraheze/mw-config - Universal-Omega the build passed. [16:09:05] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:09:20] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/deleteBatch.php --wiki=monstergirlencyclopediawiki --r=Requested at [[phab:T9754 [16:09:34] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:09:52] !log [@mwtask141] starting deploy of {'config': True} to all [16:09:59] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:10:07] !log [@mwtask141] finished deploy of {'config': True} to all - SUCCESS in 14s [16:10:20] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:11:18] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.84, 3.80, 3.06 [16:15:09] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.52, 3.71, 3.19 [16:16:28] PROBLEM - cp22 Current Load on cp22 is CRITICAL: CRITICAL - load average: 4.31, 3.08, 2.37 [16:17:08] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.48, 3.95, 3.34 [16:18:28] RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 1.14, 2.28, 2.16 [16:19:08] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.41, 3.87, 3.40 [16:22:34] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 5.12, 3.97, 3.52 [16:23:08] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.57, 3.19, 3.23 [16:24:35] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.62, 3.68, 3.46 [16:26:34] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 2.90, 3.37, 3.37 [16:27:08] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.64, 3.65, 3.43 [16:27:23] !log [@test131] starting deploy of {'config': True} to all [16:27:24] !log [@test131] finished deploy of {'config': True} to all - SUCCESS in 0s [16:27:39] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:27:46] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:31:08] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.28, 3.97, 3.60 [16:32:18] PROBLEM - wiki.auraxis.co - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.auraxis.co All nameservers failed to answer the query. [16:35:08] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.36, 3.92, 3.69 [16:40:56] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-2 [+0/-0/±1] 13https://github.com/miraheze/mw-config/commit/0392911748be [16:40:57] [02miraheze/mw-config] 07Universal-Omega 030392911 - Update $wgLocalFileRepo for Swift [16:40:59] [02mw-config] 07Universal-Omega created branch 03Universal-Omega-patch-2 - 13https://github.com/miraheze/mw-config [16:41:00] [02mw-config] 07Universal-Omega opened pull request 03#4948: Update $wgLocalFileRepo for Swift - 13https://github.com/miraheze/mw-config/pull/4948 [16:41:08] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.73, 3.82, 3.65 [16:42:07] miraheze/mw-config - Universal-Omega the build passed. [16:43:08] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.37, 3.65, 3.62 [16:44:01] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-5 [+0/-0/±1] 13https://github.com/miraheze/puppet/commit/65d9895f0ff5 [16:44:02] [02miraheze/puppet] 07paladox 0365d9895 - swift: increase account/container workers to 24 [16:44:04] [02puppet] 07paladox created branch 03paladox-patch-5 - 13https://github.com/miraheze/puppet [16:44:05] [02puppet] 07paladox opened pull request 03#2966: swift: increase account/container workers to 24 - 13https://github.com/miraheze/puppet/pull/2966 [16:44:19] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 4.87, 3.87, 3.46 [16:44:19] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-5 [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/65d9895f0ff5...d223691a525f [16:44:21] [02miraheze/puppet] 07paladox 03d223691 - Update account-server.conf.erb [16:44:22] [02puppet] 07paladox synchronize pull request 03#2966: swift: increase account/container workers to 24 - 13https://github.com/miraheze/puppet/pull/2966 [16:44:28] [02puppet] 07paladox closed pull request 03#2966: swift: increase account/container workers to 24 - 13https://github.com/miraheze/puppet/pull/2966 [16:44:29] [02miraheze/puppet] 07paladox deleted branch 03paladox-patch-5 [16:44:30] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±2] 13https://github.com/miraheze/puppet/compare/363411ad81d1...c649f13a48fb [16:44:31] [02miraheze/puppet] 07paladox 03c649f13 - swift: increase account/container workers to 24 (#2966) [16:44:32] [02puppet] 07paladox deleted branch 03paladox-patch-5 - 13https://github.com/miraheze/puppet [16:46:17] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 2.97, 3.55, 3.40 [16:47:08] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 1.59, 2.83, 3.31 [16:50:13] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 3.03, 3.23, 3.30 [16:55:04] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.78, 10.46, 9.23 [16:55:37] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 15.72, 11.68, 9.58 [16:58:26] [02mw-config] 07paladox closed pull request 03#4948: Update $wgLocalFileRepo for Swift - 13https://github.com/miraheze/mw-config/pull/4948 [16:58:29] [02miraheze/mw-config] 07paladox deleted branch 03Universal-Omega-patch-2 [16:58:32] [02mw-config] 07paladox deleted branch 03Universal-Omega-patch-2 - 13https://github.com/miraheze/mw-config [16:58:33] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/71a9273b06b9...ff319a07c13b [16:58:35] [02miraheze/mw-config] 07Universal-Omega 03ff319a0 - Update $wgLocalFileRepo for Swift (#4948) [16:58:47] !log [paladox@mwtask141] starting deploy of {'pull': 'config', 'config': True} to all [16:58:54] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:58:55] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.45, 10.69, 9.62 [16:58:57] !log [paladox@mwtask141] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 10s [16:59:03] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:59:07] !log [paladox@mwtask141] starting deploy of {'config': True} to all [16:59:13] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:59:13] !log [paladox@mwtask141] finished deploy of {'config': True} to all - SUCCESS in 5s [16:59:18] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:59:28] !log [paladox@test131] starting deploy of {'pull': 'config', 'config': True} to all [16:59:28] miraheze/mw-config - paladox the build passed. [16:59:29] !log [paladox@test131] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 1s [16:59:32] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:59:34] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.03, 11.44, 10.06 [16:59:36] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:59:41] !log [paladox@test131] starting deploy of {'config': True} to all [16:59:42] !log [paladox@test131] finished deploy of {'config': True} to all - SUCCESS in 0s [16:59:54] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:00:04] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:01:32] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.16, 11.94, 10.41 [17:02:35] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.02, 2.72, 3.89 [17:02:46] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 14.59, 12.01, 10.33 [17:04:35] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.21, 3.26, 3.94 [17:05:29] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 7.60, 10.72, 10.39 [17:06:35] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.10, 2.78, 3.68 [17:07:54] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 4.26, 3.64, 3.33 [17:08:20] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 1.20, 1.80, 3.93 [17:09:26] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 14.50, 11.66, 10.77 [17:09:52] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.66, 3.61, 3.35 [17:12:35] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.41, 2.75, 3.36 [17:14:20] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 4.16, 2.50, 3.50 [17:15:22] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.16, 11.64, 11.28 [17:15:47] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 4.31, 3.71, 3.46 [17:16:14] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.01, 11.70, 11.46 [17:16:20] RECOVERY - gluster102 Current Load on gluster102 is OK: OK - load average: 2.24, 2.53, 3.40 [17:16:35] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.90, 3.16, 3.41 [17:17:45] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 2.84, 3.42, 3.39 [17:18:35] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.94, 2.78, 3.24 [17:19:43] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 2.14, 3.02, 3.25 [17:21:17] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 6.78, 8.78, 10.17 [17:23:38] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 4.43, 3.67, 3.43 [17:26:08] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.16, 10.64, 10.76 [17:29:10] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.68, 10.14, 10.22 [17:30:08] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.12, 10.89, 10.90 [17:31:08] PROBLEM - cp22 Current Load on cp22 is WARNING: WARNING - load average: 3.50, 2.55, 1.95 [17:31:36] PROBLEM - wiki.auraxis.co - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query auraxis.co. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [17:32:08] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.23, 11.65, 11.16 [17:33:06] RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 1.22, 2.02, 1.83 [17:33:06] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.06, 11.33, 10.67 [17:33:30] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.16, 3.99, 3.96 [17:35:05] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.43, 11.08, 10.65 [17:36:08] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.78, 11.92, 11.46 [17:39:24] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 4.04, 3.77, 3.84 [17:41:00] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 14.42, 12.63, 11.42 [17:43:20] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.42, 3.66, 3.80 [17:44:57] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.01, 11.39, 11.25 [17:45:19] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 4.55, 3.92, 3.87 [17:46:08] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.22, 11.07, 11.06 [17:47:17] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.64, 3.81, 3.84 [17:48:08] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.40, 9.58, 10.51 [17:48:54] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.80, 11.44, 11.23 [17:50:08] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.75, 10.41, 10.67 [17:50:53] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.12, 10.78, 11.03 [17:51:13] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 4.38, 3.78, 3.80 [17:52:08] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.47, 10.77, 10.78 [17:52:58] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.66, 11.50, 11.26 [17:54:03] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.63, 11.27, 11.20 [17:54:48] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.47, 10.03, 10.52 [17:56:01] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.61, 11.77, 11.39 [17:56:14] PROBLEM - www.journeytheword.wiki - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'www.journeytheword.wiki' expires in 15 day(s) (Sun 13 Nov 2022 17:43:24 GMT +0000). [17:56:49] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 4.36, 3.90, 3.83 [17:58:29] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.33, 3.22, 2.76 [17:58:43] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 14.61, 11.61, 10.97 [17:59:18] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/3c417d334f96...9c20e91a3348 [17:59:20] [02miraheze/ssl] 07MirahezeSSLBot 039c20e91 - Bot: Update SSL cert for www.journeytheword.wiki [17:59:56] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.28, 10.84, 11.17 [18:00:25] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.18, 2.72, 2.63 [18:00:47] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.29, 3.87, 3.84 [18:01:16] PROBLEM - wiki.auraxis.co - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.auraxis.co All nameservers failed to answer the query. [18:02:38] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.83, 11.68, 11.22 [18:03:44] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-2 [+0/-0/±1] 13https://github.com/miraheze/mw-config/commit/5a65a851e4e0 [18:03:46] [02miraheze/mw-config] 07Universal-Omega 035a65a85 - FileBackend: fix shardViaHashLevels [18:03:49] [02mw-config] 07Universal-Omega created branch 03Universal-Omega-patch-2 - 13https://github.com/miraheze/mw-config [18:03:52] [02mw-config] 07Universal-Omega opened pull request 03#4949: FileBackend: fix shardViaHashLevels - 13https://github.com/miraheze/mw-config/pull/4949 [18:04:36] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.51, 12.11, 11.43 [18:04:45] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 4.43, 4.04, 3.89 [18:05:01] miraheze/mw-config - Universal-Omega the build passed. [18:05:56] [02mw-config] 07paladox closed pull request 03#4949: FileBackend: fix shardViaHashLevels - 13https://github.com/miraheze/mw-config/pull/4949 [18:05:57] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/ff319a07c13b...8d82a4534f4c [18:05:59] [02miraheze/mw-config] 07Universal-Omega 038d82a45 - FileBackend: fix shardViaHashLevels (#4949) [18:06:00] [02miraheze/mw-config] 07paladox deleted branch 03Universal-Omega-patch-2 [18:06:03] [02mw-config] 07paladox deleted branch 03Universal-Omega-patch-2 - 13https://github.com/miraheze/mw-config [18:06:08] !log [paladox@mwtask141] starting deploy of {'pull': 'config', 'config': True} to all [18:06:17] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:06:24] !log [paladox@mwtask141] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 16s [18:06:26] !log [paladox@test131] starting deploy of {'pull': 'config', 'config': True} to all [18:06:28] !log [paladox@test131] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 1s [18:06:29] !log [paladox@mwtask141] starting deploy of {'config': True} to all [18:06:32] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:06:34] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.89, 11.75, 11.36 [18:06:35] !log [paladox@test131] starting deploy of {'config': True} to all [18:06:36] !log [paladox@test131] finished deploy of {'config': True} to all - SUCCESS in 0s [18:06:44] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 2.91, 3.60, 3.75 [18:06:44] PROBLEM - wiki.counterculturelabs.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.counterculturelabs.org' expires in 15 day(s) (Sun 13 Nov 2022 17:36:00 GMT +0000). [18:06:51] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:06:51] !log [paladox@mwtask141] finished deploy of {'config': True} to all - SUCCESS in 23s [18:06:56] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:07:01] miraheze/mw-config - paladox the build passed. [18:07:02] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:07:14] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:07:23] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:07:41] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:09:44] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 5.26, 8.29, 9.97 [18:09:50] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.65, 2.77, 2.07 [18:10:07] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.78, 3.88, 3.15 [18:11:45] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.12, 2.53, 2.06 [18:13:15] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/9c20e91a3348...1ab5a9cdbd85 [18:13:16] [02miraheze/ssl] 07MirahezeSSLBot 031ab5a9c - Bot: Update SSL cert for wiki.counterculturelabs.org [18:13:37] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.78, 10.43, 10.53 [18:13:58] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.71, 3.24, 3.06 [18:13:59] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 3.59, 3.01, 1.91 [18:14:28] PROBLEM - journeytheword.wiki - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'www.journeytheword.wiki' expires in 15 day(s) (Sun 13 Nov 2022 17:43:24 GMT +0000). [18:14:39] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 4.12, 3.43, 3.52 [18:15:57] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 3.25, 3.06, 2.06 [18:17:52] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.72, 3.58, 3.29 [18:18:19] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 6.41, 8.53, 9.99 [18:18:36] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.32, 3.49, 3.53 [18:19:30] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.58, 9.22, 9.98 [18:19:48] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.34, 3.05, 3.12 [18:21:57] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-2 [+0/-0/±1] 13https://github.com/miraheze/mw-config/commit/0710aeb3675f [18:21:59] [02miraheze/mw-config] 07Universal-Omega 030710aeb - FileBackend: set shardViaHashLevels levels to 0 [18:22:02] [02mw-config] 07Universal-Omega created branch 03Universal-Omega-patch-2 - 13https://github.com/miraheze/mw-config [18:22:03] [02mw-config] 07Universal-Omega opened pull request 03#4950: FileBackend: set shardViaHashLevels levels to 0 - 13https://github.com/miraheze/mw-config/pull/4950 [18:22:34] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 1.81, 2.67, 3.19 [18:23:07] miraheze/mw-config - Universal-Omega the build passed. [18:25:08] RECOVERY - www.journeytheword.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'www.journeytheword.wiki' will expire on Thu 26 Jan 2023 16:59:11 GMT +0000. [18:30:49] [02mw-config] 07Universal-Omega closed pull request 03#4950: FileBackend: set shardViaHashLevels levels to 0 - 13https://github.com/miraheze/mw-config/pull/4950 [18:30:51] [02miraheze/mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-2 [18:30:52] [02mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-2 - 13https://github.com/miraheze/mw-config [18:30:54] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/8d82a4534f4c...e653167fd233 [18:30:57] [02miraheze/mw-config] 07Universal-Omega 03e653167 - FileBackend: set shardViaHashLevels levels to 0 (#4950) [18:31:13] PROBLEM - wiki.auraxis.co - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query auraxis.co. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [18:31:52] miraheze/mw-config - Universal-Omega the build passed. [18:41:05] !log [@mwtask141] starting deploy of {'config': True} to all [18:41:11] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:41:13] !log [@mwtask141] finished deploy of {'config': True} to all - SUCCESS in 7s [18:41:22] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:41:35] PROBLEM - db121 Current Load on db121 is WARNING: WARNING - load average: 7.05, 5.19, 3.67 [18:43:09] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.81, 11.46, 10.24 [18:43:30] RECOVERY - journeytheword.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'www.journeytheword.wiki' will expire on Thu 26 Jan 2023 16:59:11 GMT +0000. [18:43:34] RECOVERY - db121 Current Load on db121 is OK: OK - load average: 3.27, 4.73, 3.71 [18:44:03] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.70, 3.33, 2.50 [18:45:06] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.89, 10.47, 10.02 [18:45:42] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.31, 10.01, 9.28 [18:47:04] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.22, 9.51, 9.71 [18:47:40] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.69, 9.43, 9.15 [18:48:03] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 2.08, 2.95, 2.56 [18:55:02] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.60, 3.11, 2.75 [18:55:28] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.44, 11.15, 9.95 [18:57:02] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 8.82, 4.37, 3.20 [18:57:30] !log [@test131] starting deploy of {'config': True} to all [18:57:31] !log [@test131] finished deploy of {'config': True} to all - SUCCESS in 0s [18:57:36] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:57:45] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:59:02] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.33, 3.78, 3.13 [18:59:24] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.40, 9.91, 9.73 [19:01:02] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.35, 3.95, 3.27 [19:01:10] PROBLEM - wiki.auraxis.co - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.auraxis.co All nameservers failed to answer the query. [19:03:02] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.86, 3.56, 3.21 [19:03:16] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 14.52, 11.78, 10.51 [19:04:58] RECOVERY - wiki.counterculturelabs.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.counterculturelabs.org' will expire on Thu 26 Jan 2023 17:13:09 GMT +0000. [19:05:02] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.21, 3.80, 3.34 [19:05:14] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.70, 11.05, 10.41 [19:06:37] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.49, 3.33, 2.69 [19:07:05] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 5.67, 3.99, 3.16 [19:07:12] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.70, 9.97, 10.10 [19:08:32] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.09, 3.13, 2.71 [19:09:02] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.36, 3.25, 3.24 [19:15:05] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.15, 3.68, 3.48 [19:16:14] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.45, 2.98, 2.69 [19:18:10] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.75, 2.83, 2.66 [19:19:05] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 4.07, 3.93, 3.62 [19:21:05] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.98, 3.78, 3.59 [19:22:42] PROBLEM - cp33 NTP time on cp33 is WARNING: NTP WARNING: Offset 0.1429646611 secs [19:23:05] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 4.29, 4.02, 3.71 [19:25:05] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.02, 3.69, 3.63 [19:35:05] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 2.63, 3.10, 3.36 [19:36:07] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.87, 2.93, 2.36 [19:38:07] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 3.25, 2.96, 2.44 [19:40:43] RECOVERY - cp33 NTP time on cp33 is OK: NTP OK: Offset 0.07976216078 secs [19:41:05] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.43, 3.30, 3.34 [19:44:03] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.93, 3.25, 2.14 [19:45:05] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 2.36, 2.83, 3.14 [19:46:03] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.95, 2.64, 2.04 [19:54:02] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 4.40, 3.99, 3.56 [19:56:01] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 2.84, 3.51, 3.43 [19:59:09] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 4.06, 3.38, 2.13 [19:59:58] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 1.80, 2.84, 3.20 [20:01:07] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 3.63, 3.84, 2.48 [20:03:06] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.60, 3.05, 2.35 [20:04:27] PROBLEM - miraheze.gq - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'miraheze.gq' expires in 15 day(s) (Sun 13 Nov 2022 19:52:02 GMT +0000). [20:05:18] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/1ab5a9cdbd85...5daf140c3942 [20:05:21] [02miraheze/ssl] 07MirahezeSSLBot 035daf140 - Bot: Update SSL cert for miraheze.gq [20:05:31] PROBLEM - swiftobject114 Puppet on swiftobject114 is WARNING: WARNING: Puppet is currently disabled, message: paladox, last run 16 minutes ago with 0 failures [20:06:41] PROBLEM - swiftobject115 Puppet on swiftobject115 is WARNING: WARNING: Puppet is currently disabled, message: paladox, last run 5 minutes ago with 0 failures [20:10:48] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.63, 9.87, 8.90 [20:11:02] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.53, 3.75, 3.08 [20:12:21] PROBLEM - wiki.macc.nyc - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.macc.nyc' expires in 15 day(s) (Sun 13 Nov 2022 19:57:37 GMT +0000). [20:12:46] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.51, 9.25, 8.79 [20:13:02] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.83, 3.56, 3.10 [20:13:13] PROBLEM - wiki.scpsharp.ga - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.scpsharp.ga' expires in 15 day(s) (Sun 13 Nov 2022 20:09:37 GMT +0000). [20:15:02] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.78, 3.34, 3.08 [20:15:40] !log reboot swiftobject114 and swiftobject115 [20:15:47] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:17:38] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/5daf140c3942...d29871a7f831 [20:17:40] [02miraheze/ssl] 07MirahezeSSLBot 03d29871a - Bot: Update SSL cert for wiki.macc.nyc [20:18:15] [02miraheze/puppet] 07paladox pushed 031 commit to 03revert-2965-revert-2961-paladox-patch-5 [+0/-0/±1] 13https://github.com/miraheze/puppet/commit/90f0c5ab35d7 [20:18:17] [02miraheze/puppet] 07paladox 0390f0c5a - Revert "Revert "swiftobject114/5: reduce workers" (#2965)" [20:18:19] [02puppet] 07paladox created branch 03revert-2965-revert-2961-paladox-patch-5 - 13https://github.com/miraheze/puppet [20:18:22] [02puppet] 07paladox opened pull request 03#2967: Revert "Revert "swiftobject114/5: reduce workers"" - 13https://github.com/miraheze/puppet/pull/2967 [20:18:27] PROBLEM - swiftobject114 Puppet on swiftobject114 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [20:18:36] [02miraheze/puppet] 07paladox pushed 031 commit to 03revert-2965-revert-2961-paladox-patch-5 [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/90f0c5ab35d7...2880d423b095 [20:18:38] [02miraheze/puppet] 07paladox 032880d42 - Update swiftobject115.yaml [20:18:41] [02puppet] 07paladox synchronize pull request 03#2967: Revert "Revert "swiftobject114/5: reduce workers"" - 13https://github.com/miraheze/puppet/pull/2967 [20:18:46] [02puppet] 07paladox edited pull request 03#2967: swiftobject114/5: reduce workers - 13https://github.com/miraheze/puppet/pull/2967 [20:19:19] PROBLEM - cloud11 SMART on cloud11 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [20:19:42] PROBLEM - swiftobject114 PowerDNS Recursor on swiftobject114 is CRITICAL: CRITICAL - Plugin timed out while executing system call [20:20:25] RECOVERY - swiftobject114 Puppet on swiftobject114 is OK: OK: Puppet is currently enabled, last run 4 minutes ago with 0 failures [20:20:28] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/d29871a7f831...516c091ddddc [20:20:31] [02miraheze/ssl] 07MirahezeSSLBot 03516c091 - Bot: Update SSL cert for wiki.scpsharp.ga [20:24:55] PROBLEM - cloud11 SMART on cloud11 is WARNING: WARNING: [cciss,2] - Reallocated_Sector_Ct is non-zero (3) --- [cciss,0] - Device is clean --- [cciss,1] - Device is clean --- [cciss,3] - Device is clean --- [cciss,4] - Device is clean --- [cciss,5] - Device is clean --- [cciss,6] - Device is clean| [20:25:57] [02puppet] 07paladox closed pull request 03#2967: swiftobject114/5: reduce workers - 13https://github.com/miraheze/puppet/pull/2967 [20:25:59] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±2] 13https://github.com/miraheze/puppet/compare/c649f13a48fb...b72be512b83f [20:26:01] [02miraheze/puppet] 07paladox 03b72be51 - swiftobject114/5: reduce workers (#2967) [20:26:02] [02miraheze/puppet] 07paladox deleted branch 03revert-2965-revert-2961-paladox-patch-5 [20:26:04] [02puppet] 07paladox deleted branch 03revert-2965-revert-2961-paladox-patch-5 - 13https://github.com/miraheze/puppet [20:28:00] PROBLEM - swiftobject114 Current Load on swiftobject114 is WARNING: WARNING - load average: 3.76, 0.87, 0.29 [20:29:16] RECOVERY - swiftobject115 Puppet on swiftobject115 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [20:29:54] PROBLEM - swiftobject114 Current Load on swiftobject114 is CRITICAL: CRITICAL - load average: 80.91, 27.34, 9.76 [20:30:11] PROBLEM - cloud11 SMART on cloud11 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [20:34:16] RECOVERY - miraheze.gq - LetsEncrypt on sslhost is OK: OK - Certificate 'miraheze.gq' will expire on Thu 26 Jan 2023 19:05:11 GMT +0000. [20:36:01] PROBLEM - cloud11 SMART on cloud11 is WARNING: WARNING: [cciss,2] - Reallocated_Sector_Ct is non-zero (3) --- [cciss,0] - Device is clean --- [cciss,1] - Device is clean --- [cciss,3] - Device is clean --- [cciss,4] - Device is clean --- [cciss,5] - Device is clean --- [cciss,6] - Device is clean| [20:37:42] RECOVERY - swiftobject114 PowerDNS Recursor on swiftobject114 is OK: DNS OK: 8.951 seconds response time. miraheze.org returns 109.228.51.216,217.174.247.33,2a00:da00:1800:326::1,2a00:da00:1800:328::1 [20:41:31] RECOVERY - wiki.macc.nyc - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.macc.nyc' will expire on Thu 26 Jan 2023 19:17:32 GMT +0000. [20:43:00] PROBLEM - lcn.zfc.id.lv - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'lcn.zfc.id.lv' expires in 15 day(s) (Sun 13 Nov 2022 20:37:14 GMT +0000). [20:44:02] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-2 [+0/-0/±1] 13https://github.com/miraheze/mw-config/commit/e78adb47fe4f [20:44:04] [02miraheze/mw-config] 07Universal-Omega 03e78adb4 - Use http method and swift proxies to render thumbnails [20:44:05] [02mw-config] 07Universal-Omega created branch 03Universal-Omega-patch-2 - 13https://github.com/miraheze/mw-config [20:44:06] [02mw-config] 07Universal-Omega opened pull request 03#4951: Use http method and swift proxies to render thumbnails - 13https://github.com/miraheze/mw-config/pull/4951 [20:45:21] miraheze/mw-config - Universal-Omega the build passed. [20:45:22] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/516c091ddddc...cf55b0d510d5 [20:45:25] [02miraheze/ssl] 07MirahezeSSLBot 03cf55b0d - Bot: Update SSL cert for lcn.zfc.id.lv [20:47:07] PROBLEM - pastport.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'pastport.org' expires in 15 day(s) (Sun 13 Nov 2022 20:28:20 GMT +0000). [20:49:52] !log enable mq-deadline on swiftobject* [20:49:57] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:51:38] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/cf55b0d510d5...be26c55179de [20:51:40] [02miraheze/ssl] 07MirahezeSSLBot 03be26c55 - Bot: Update SSL cert for pastport.org [20:54:23] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.95, 3.81, 2.94 [20:56:09] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.04, 3.61, 2.84 [20:58:05] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.87, 3.92, 3.05 [21:00:02] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/e653167fd233...6d883d153365 [21:00:03] [02miraheze/mw-config] 07Universal-Omega 036d883d1 - FileBackend: always enable transformVia404 if using Swift [21:00:38] PROBLEM - wiki.erisly.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.erisly.com' expires in 15 day(s) (Sun 13 Nov 2022 20:41:38 GMT +0000). [21:01:03] miraheze/mw-config - Universal-Omega the build passed. [21:01:57] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.55, 3.32, 3.01 [21:02:18] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 4.02, 3.68, 3.23 [21:04:17] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.40, 3.60, 3.26 [21:05:43] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 3.44, 3.36, 2.42 [21:05:51] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.29, 3.68, 3.25 [21:06:12] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/be26c55179de...83edd4e5b1e9 [21:06:13] [02miraheze/ssl] 07MirahezeSSLBot 0383edd4e - Bot: Update SSL cert for wiki.erisly.com [21:07:01] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.70, 9.67, 8.55 [21:07:42] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 2.49, 3.10, 2.44 [21:07:47] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.76, 3.33, 3.17 [21:08:14] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 2.28, 3.10, 3.14 [21:08:59] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 9.99, 9.93, 8.80 [21:09:58] !log [@mwtask141] starting deploy of {'config': True} to all [21:10:03] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:10:07] !log [@mwtask141] finished deploy of {'config': True} to all - SUCCESS in 9s [21:10:11] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:11:20] RECOVERY - wiki.scpsharp.ga - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.scpsharp.ga' will expire on Thu 26 Jan 2023 19:20:22 GMT +0000. [21:11:37] PROBLEM - test131 Current Load on test131 is CRITICAL: CRITICAL - load average: 4.85, 3.94, 2.92 [21:11:41] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.53, 3.82, 3.42 [21:12:23] RECOVERY - lcn.zfc.id.lv - LetsEncrypt on sslhost is OK: OK - Certificate 'lcn.zfc.id.lv' will expire on Thu 26 Jan 2023 19:45:16 GMT +0000. [21:13:37] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.79, 3.95, 3.50 [21:16:36] RECOVERY - pastport.org - LetsEncrypt on sslhost is OK: OK - Certificate 'pastport.org' will expire on Thu 26 Jan 2023 19:51:32 GMT +0000. [21:17:29] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.24, 3.81, 3.58 [21:19:31] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 2.53, 3.76, 3.39 [21:21:30] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 1.84, 3.16, 3.22 [21:27:07] !log [@test131] starting deploy of {'config': True} to all [21:27:08] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.54, 3.10, 3.39 [21:27:08] !log [@test131] finished deploy of {'config': True} to all - SUCCESS in 0s [21:27:19] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:27:27] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:30:23] RECOVERY - wiki.erisly.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.erisly.com' will expire on Thu 26 Jan 2023 20:06:06 GMT +0000. [21:31:02] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.98, 3.46, 3.51 [21:33:02] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 1.95, 2.93, 3.31 [21:44:41] PROBLEM - wiki.ssangyongsports.eu.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.ssangyongsports.eu.org' expires in 15 day(s) (Sun 13 Nov 2022 21:25:54 GMT +0000). [21:49:36] [02mw-config] 07Universal-Omega closed pull request 03#4951: Use http method and swift proxies to render thumbnails - 13https://github.com/miraheze/mw-config/pull/4951 [21:49:39] [02miraheze/mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-2 [21:49:41] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/6d883d153365...1afb39754157 [21:49:42] [02miraheze/mw-config] 07Universal-Omega 031afb397 - Use http method and swift proxies to render thumbnails (#4951) [21:49:44] [02mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-2 - 13https://github.com/miraheze/mw-config [21:50:43] miraheze/mw-config - Universal-Omega the build passed. [21:52:16] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-2 [+0/-0/±1] 13https://github.com/miraheze/mw-config/commit/4edd0aaa6982 [21:52:17] [02miraheze/mw-config] 07Universal-Omega 034edd0aa - Swift: set $wgUploadPath to img_auth if using private uploads [21:52:20] [02mw-config] 07Universal-Omega created branch 03Universal-Omega-patch-2 - 13https://github.com/miraheze/mw-config [21:52:22] [02mw-config] 07Universal-Omega opened pull request 03#4952: Swift: set $wgUploadPath to img_auth if using private uploads - 13https://github.com/miraheze/mw-config/pull/4952 [21:52:39] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/83edd4e5b1e9...16943bf68437 [21:52:42] [02miraheze/ssl] 07MirahezeSSLBot 0316943bf - Bot: Update SSL cert for wiki.ssangyongsports.eu.org [21:53:22] miraheze/mw-config - Universal-Omega the build passed. [21:57:13] !log [@test131] starting deploy of {'config': True} to all [21:57:14] !log [@test131] finished deploy of {'config': True} to all - SUCCESS in 0s [21:57:18] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:57:23] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:59:04] [02mw-config] 07Universal-Omega closed pull request 03#4952: Swift: set $wgUploadPath to img_auth if using private uploads - 13https://github.com/miraheze/mw-config/pull/4952 [21:59:07] [02miraheze/mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-2 [21:59:08] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/1afb39754157...2bdb05d04236 [21:59:09] [02miraheze/mw-config] 07Universal-Omega 032bdb05d - Swift: set $wgUploadPath to img_auth if using private uploads (#4952) [21:59:12] [02mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-2 - 13https://github.com/miraheze/mw-config [21:59:59] !log [paladox@mwtask141] starting deploy of {'pull': 'config', 'config': True} to all [22:00:03] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:00:04] miraheze/mw-config - Universal-Omega the build passed. [22:00:06] !log [paladox@mwtask141] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 7s [22:00:08] !log [paladox@mwtask141] starting deploy of {'config': True} to all [22:00:11] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:00:14] !log [paladox@mwtask141] finished deploy of {'config': True} to all - SUCCESS in 5s [22:00:15] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:00:19] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:00:26] !log [paladox@test131] starting deploy of {'pull': 'config', 'config': True} to all [22:00:27] !log [paladox@test131] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 1s [22:00:30] !log [paladox@test131] starting deploy of {'config': True} to all [22:00:31] !log [paladox@test131] finished deploy of {'config': True} to all - SUCCESS in 0s [22:00:31] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:00:37] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:00:46] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:00:59] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:03:45] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 3.76, 3.67, 2.77 [22:05:44] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.39, 2.87, 2.59 [22:10:16] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.35, 9.86, 8.05 [22:11:24] [02miraheze/puppet] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-2 [+0/-0/±1] 13https://github.com/miraheze/puppet/commit/6322cd188bf3 [22:11:25] [02miraheze/puppet] 07Universal-Omega 036322cd1 - mwtask141: increase PHP memory_limit to 500M [22:11:27] [02puppet] 07Universal-Omega created branch 03Universal-Omega-patch-2 - 13https://github.com/miraheze/puppet [22:11:33] [02puppet] 07Universal-Omega opened pull request 03#2968: mwtask141: increase PHP memory_limit to 500M - 13https://github.com/miraheze/puppet/pull/2968 [22:12:16] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 10.16, 9.86, 8.27 [22:14:02] [02puppet] 07Universal-Omega edited pull request 03#2968: mwtask141: increase PHP memory_limit to 512M - 13https://github.com/miraheze/puppet/pull/2968 [22:14:14] [02miraheze/puppet] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-2 [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/6322cd188bf3...25503c073315 [22:14:17] [02miraheze/puppet] 07Universal-Omega 0325503c0 - Update mwtask141.yaml [22:14:19] [02puppet] 07Universal-Omega synchronize pull request 03#2968: mwtask141: increase PHP memory_limit to 512M - 13https://github.com/miraheze/puppet/pull/2968 [22:15:38] PROBLEM - cp22 Current Load on cp22 is CRITICAL: CRITICAL - load average: 4.47, 3.24, 2.36 [22:16:10] [02puppet] 07Universal-Omega closed pull request 03#2968: mwtask141: increase PHP memory_limit to 512M - 13https://github.com/miraheze/puppet/pull/2968 [22:16:13] [02puppet] 07Universal-Omega deleted branch 03Universal-Omega-patch-2 - 13https://github.com/miraheze/puppet [22:16:16] [02miraheze/puppet] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/b72be512b83f...356cac55163d [22:16:17] [02miraheze/puppet] 07Universal-Omega 03356cac5 - mwtask141: increase PHP memory_limit to 512M (#2968) [22:16:18] [02miraheze/puppet] 07Universal-Omega deleted branch 03Universal-Omega-patch-2 [22:17:37] RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 1.21, 2.41, 2.16 [22:22:53] !log restart memcached on mem131 [22:23:18] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:24:50] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.44, 3.98, 2.93 [22:26:16] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 15.79, 11.90, 8.97 [22:26:16] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 16.68, 13.05, 10.14 [22:26:48] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.14, 3.51, 2.88 [22:27:20] PROBLEM - mw121 MediaWiki Rendering on mw121 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [22:29:17] RECOVERY - mw121 MediaWiki Rendering on mw121 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 2.158 second response time [22:30:43] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.66, 3.02, 2.89 [22:37:05] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 4.10, 3.28, 2.46 [22:39:05] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 2.29, 2.91, 2.43 [22:41:53] RECOVERY - wiki.ssangyongsports.eu.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.ssangyongsports.eu.org' will expire on Thu 26 Jan 2023 20:52:32 GMT +0000. [22:42:16] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.80, 11.19, 11.05 [22:44:16] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 7.81, 11.37, 11.87 [22:46:16] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.69, 11.57, 11.85 [22:46:16] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.49, 10.67, 10.76 [22:48:16] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.57, 10.15, 10.55 [22:48:16] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.79, 10.89, 11.60 [22:51:33] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.88, 3.05, 2.69 [22:52:16] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.82, 10.60, 10.57 [22:53:31] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.50, 4.01, 3.09 [22:56:16] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.47, 10.93, 10.74 [22:57:27] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.63, 3.62, 3.15 [22:58:16] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.70, 11.66, 11.03 [22:59:24] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 0.82, 2.63, 2.85 [23:00:16] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.83, 10.49, 10.65 [23:06:16] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.33, 10.62, 10.75 [23:06:16] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.38, 10.99, 10.71 [23:08:16] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.17, 10.33, 10.49 [23:12:16] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.40, 11.34, 11.21 [23:12:16] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 6.79, 8.93, 9.91 [23:30:16] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 6.25, 8.63, 10.02 [23:30:35] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.85, 3.67, 2.99 [23:31:25] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.18, 3.43, 2.37 [23:31:34] [02puppet] 07paladox synchronize pull request 03#2943: swift: increase node_timeout for proxy-server to 40s - 13https://github.com/miraheze/puppet/pull/2943 [23:31:35] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-4 [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/5d1139e6aad4...5534653f0934 [23:31:38] [02miraheze/puppet] 07paladox 035534653 - Update proxy-server.conf.erb [23:31:42] [02puppet] 07paladox edited pull request 03#2943: swift: increase node_timeout for proxy-server to 20s - 13https://github.com/miraheze/puppet/pull/2943 [23:32:32] [02puppet] 07paladox closed pull request 03#2943: swift: increase node_timeout for proxy-server to 20s - 13https://github.com/miraheze/puppet/pull/2943 [23:32:35] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/356cac55163d...efb1d990d2ab [23:32:38] [02miraheze/puppet] 07paladox 03efb1d99 - swift: increase node_timeout for proxy-server to 20s (#2943) [23:32:41] [02miraheze/puppet] 07paladox deleted branch 03paladox-patch-4 [23:32:43] [02puppet] 07paladox deleted branch 03paladox-patch-4 - 13https://github.com/miraheze/puppet [23:33:25] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.44, 2.88, 2.29 [23:34:27] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.03, 3.59, 3.10 [23:36:23] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.18, 3.09, 2.97 [23:41:37] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-4 [+0/-0/±1] 13https://github.com/miraheze/puppet/commit/f4b2215231e7 [23:41:39] [02miraheze/puppet] 07paladox 03f4b2215 - swift: increase node_timeout to 40s [23:41:41] [02puppet] 07paladox created branch 03paladox-patch-4 - 13https://github.com/miraheze/puppet [23:41:43] [02puppet] 07paladox opened pull request 03#2969: swift: increase node_timeout to 40s - 13https://github.com/miraheze/puppet/pull/2969 [23:41:53] [02puppet] 07paladox edited pull request 03#2969: swift: increase node_timeout to 40s - 13https://github.com/miraheze/puppet/pull/2969 [23:42:27] [02puppet] 07paladox synchronize pull request 03#2969: swift: increase node_timeout to 40s - 13https://github.com/miraheze/puppet/pull/2969 [23:42:29] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-4 [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/f4b2215231e7...7c4900842b5c [23:42:32] [02miraheze/puppet] 07paladox 037c49008 - Update proxy-server.conf.erb [23:42:43] [02puppet] 07paladox edited pull request 03#2969: swift: increase node_timeout to 40s - 13https://github.com/miraheze/puppet/pull/2969 [23:42:46] [02puppet] 07paladox closed pull request 03#2969: swift: increase node_timeout to 40s - 13https://github.com/miraheze/puppet/pull/2969 [23:42:49] [02miraheze/puppet] 07paladox deleted branch 03paladox-patch-4 [23:42:50] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/efb1d990d2ab...aa8a6d51070c [23:42:53] [02miraheze/puppet] 07paladox 03aa8a6d5 - swift: increase node_timeout to 40s (#2969) [23:42:56] [02puppet] 07paladox deleted branch 03paladox-patch-4 - 13https://github.com/miraheze/puppet [23:44:09] PROBLEM - swiftobject115 NTP time on swiftobject115 is WARNING: NTP WARNING: Offset 0.3542039394 secs [23:45:54] PROBLEM - cp22 Current Load on cp22 is CRITICAL: CRITICAL - load average: 5.82, 3.11, 1.93 [23:47:53] RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 1.39, 2.40, 1.82 [23:51:06] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 17.17, 11.95, 10.37 [23:53:04] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.47, 11.35, 10.36 [23:54:15] RECOVERY - swiftobject115 NTP time on swiftobject115 is OK: NTP OK: Offset -0.01166367531 secs [23:54:56] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-4 [+0/-0/±1] 13https://github.com/miraheze/puppet/commit/93abee3fa766 [23:54:59] [02miraheze/puppet] 07paladox 0393abee3 - Increase mediawiki::php::memory_limit to 512M for mw* [23:55:00] [02puppet] 07paladox created branch 03paladox-patch-4 - 13https://github.com/miraheze/puppet [23:55:12] [02puppet] 07paladox opened pull request 03#2970: Increase mediawiki::php::memory_limit to 512M for mw* - 13https://github.com/miraheze/puppet/pull/2970 [23:55:25] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-4 [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/93abee3fa766...a5e779c23b94 [23:55:26] [02miraheze/puppet] 07paladox 03a5e779c - Update mw121.yaml [23:55:29] [02puppet] 07paladox synchronize pull request 03#2970: Increase mediawiki::php::memory_limit to 512M for mw* - 13https://github.com/miraheze/puppet/pull/2970 [23:55:42] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-4 [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/a5e779c23b94...cc5c51fe1e18 [23:55:45] [02miraheze/puppet] 07paladox 03cc5c51f - Update mw122.yaml [23:55:48] [02puppet] 07paladox synchronize pull request 03#2970: Increase mediawiki::php::memory_limit to 512M for mw* - 13https://github.com/miraheze/puppet/pull/2970 [23:55:59] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-4 [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/cc5c51fe1e18...307ea41591ed [23:56:01] [02miraheze/puppet] 07paladox 03307ea41 - Update mw131.yaml [23:56:04] [02puppet] 07paladox synchronize pull request 03#2970: Increase mediawiki::php::memory_limit to 512M for mw* - 13https://github.com/miraheze/puppet/pull/2970 [23:56:09] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-4 [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/307ea41591ed...1740048518d2 [23:56:10] [02miraheze/puppet] 07paladox 031740048 - Update mw132.yaml [23:56:13] [02puppet] 07paladox synchronize pull request 03#2970: Increase mediawiki::php::memory_limit to 512M for mw* - 13https://github.com/miraheze/puppet/pull/2970 [23:56:19] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-4 [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/1740048518d2...4daf381f4e4e [23:56:21] [02miraheze/puppet] 07paladox 034daf381 - Update mw141.yaml [23:56:22] [02puppet] 07paladox synchronize pull request 03#2970: Increase mediawiki::php::memory_limit to 512M for mw* - 13https://github.com/miraheze/puppet/pull/2970 [23:56:31] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-4 [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/4daf381f4e4e...f1569c2d8074 [23:56:32] [02miraheze/puppet] 07paladox 03f1569c2 - Update mw142.yaml [23:56:35] [02puppet] 07paladox synchronize pull request 03#2970: Increase mediawiki::php::memory_limit to 512M for mw* - 13https://github.com/miraheze/puppet/pull/2970 [23:56:41] [02puppet] 07paladox edited pull request 03#2970: Increase mediawiki::php::memory_limit to 500M for mw* - 13https://github.com/miraheze/puppet/pull/2970 [23:56:59] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.63, 12.61, 11.06 [23:57:00] [02puppet] 07paladox closed pull request 03#2970: Increase mediawiki::php::memory_limit to 500M for mw* - 13https://github.com/miraheze/puppet/pull/2970 [23:57:03] [02miraheze/puppet] 07paladox deleted branch 03paladox-patch-4 [23:57:04] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±6] 13https://github.com/miraheze/puppet/compare/aa8a6d51070c...66d81c24c155 [23:57:05] [02miraheze/puppet] 07paladox 0366d81c2 - Increase mediawiki::php::memory_limit to 500M for mw* (#2970) [23:57:08] [02puppet] 07paladox deleted branch 03paladox-patch-4 - 13https://github.com/miraheze/puppet [23:57:52] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.46, 10.28, 9.51