[00:02:12] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.42, 3.75, 3.65 [00:04:36] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 15.13, 12.43, 11.52 [00:06:36] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.75, 11.46, 11.28 [00:08:06] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.01, 3.83, 3.80 [00:09:04] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.65, 11.34, 11.61 [00:10:36] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 16.45, 12.75, 11.73 [00:12:03] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.66, 3.88, 3.78 [00:14:01] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.18, 3.20, 3.54 [00:14:36] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.10, 11.57, 11.52 [00:15:04] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.01, 11.27, 11.44 [00:15:59] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.52, 2.94, 3.40 [00:17:04] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.17, 10.25, 11.05 [00:23:04] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.37, 8.87, 10.17 [00:24:05] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 2.23, 3.94, 5.75 [00:24:36] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.22, 9.00, 10.20 [00:25:48] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.54, 3.66, 3.39 [00:26:09] PROBLEM - wiki.zergmafia.top - reverse DNS on sslhost is WARNING: Timeout: The DNS operation timed out after 5.405882120132446 seconds [00:27:46] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.26, 3.43, 3.34 [00:28:05] RECOVERY - gluster102 Current Load on gluster102 is OK: OK - load average: 2.60, 3.21, 5.03 [00:29:45] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.97, 3.37, 3.33 [00:30:14] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 0.94, 1.61, 1.91 [00:31:04] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.95, 10.56, 10.36 [00:32:14] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.41, 1.94, 2.00 [00:33:40] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.09, 3.72, 3.51 [00:35:04] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.92, 9.35, 9.94 [00:35:21] [02puppet] 07Universal-Omega closed pull request 03#2815: nginx: minor cleanup - 13https://github.com/miraheze/puppet/pull/2815 [00:35:22] [url] Page not found · GitHub · GitHub | github.com [00:35:22] [02miraheze/puppet] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±2] 13https://github.com/miraheze/puppet/compare/fb9b39b0ce9d...a6a987b5dc8f [00:35:23] [url] Comparing fb9b39b0ce9d...a6a987b5dc8f · miraheze/puppet · GitHub | github.com [00:35:24] [02miraheze/puppet] 07Universal-Omega 03a6a987b - nginx: minor cleanup (#2815) [00:35:25] [02miraheze/puppet] 07Universal-Omega deleted branch 03nginx-cleanup [00:35:27] [02puppet] 07Universal-Omega deleted branch 03nginx-cleanup - 13https://github.com/miraheze/puppet [00:35:27] ... [00:35:40] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 1.85, 2.99, 3.27 [00:35:57] [02puppet] 07Universal-Omega edited pull request 03#2755: Convert memcached_servers to single nutcracker config in hiera - 13https://github.com/miraheze/puppet/pull/2755 [00:35:57] [url] Page not found · GitHub · GitHub | github.com [00:41:25] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.39, 10.67, 9.91 [00:41:33] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 2 datacenters are down: 2001:41d0:801:2000::4c25/cpweb, 2001:41d0:801:2000::1b80/cpweb [00:42:06] [02puppet] 07Universal-Omega synchronize pull request 03#2755: Convert memcached_servers to single nutcracker config in hiera - 13https://github.com/miraheze/puppet/pull/2755 [00:42:07] [url] Page not found · GitHub · GitHub | github.com [00:43:19] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.80, 10.21, 9.84 [00:43:40] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.01, 3.92, 3.57 [00:45:13] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.56, 9.99, 9.83 [00:45:33] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [00:45:40] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.84, 3.44, 3.43 [00:47:40] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.51, 3.09, 3.30 [00:51:04] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 1.93, 2.72, 3.83 [00:55:04] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 6.39, 4.18, 4.13 [00:55:40] RECOVERY - wiki.zergmafia.top - reverse DNS on sslhost is OK: SSL OK - wiki.zergmafia.top reverse DNS resolves to cp30.miraheze.org - CNAME OK [00:59:40] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.52, 3.48, 3.21 [01:01:40] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 1.49, 2.73, 2.97 [01:03:15] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.42, 1.53, 1.99 [01:09:15] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.15, 1.63, 1.85 [01:11:15] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.43, 1.56, 1.80 [01:13:15] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 3.28, 2.55, 2.15 [01:19:04] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.26, 3.33, 3.89 [01:19:15] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.73, 1.91, 1.99 [01:21:15] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.08, 2.05, 2.03 [01:23:04] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 8.44, 5.22, 4.45 [01:24:50] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.18, 10.46, 9.15 [01:26:14] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 0.97, 1.56, 1.92 [01:26:24] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 7.88, 6.66, 4.59 [01:26:44] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 9.60, 9.95, 9.11 [01:27:12] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.78, 11.38, 9.59 [01:31:08] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.84, 9.97, 9.46 [01:32:20] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 2.61, 5.18, 4.73 [01:34:14] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.99, 1.25, 1.63 [01:34:19] RECOVERY - gluster102 Current Load on gluster102 is OK: OK - load average: 2.00, 4.21, 4.43 [01:42:13] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.43, 1.86, 1.70 [01:45:15] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.12, 1.49, 1.92 [01:46:14] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.82, 1.89, 1.75 [01:48:14] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.59, 2.01, 1.80 [01:48:55] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 1.91, 1.67, 1.49 [01:50:51] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 1.70, 1.68, 1.51 [01:51:16] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.68, 1.83, 1.89 [01:52:14] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 0.85, 1.62, 1.71 [01:53:05] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 5.24, 5.39, 4.97 [01:54:14] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.14, 1.49, 1.64 [01:55:03] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 9.49, 6.01, 5.19 [01:55:15] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.84, 1.88, 1.91 [01:57:15] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.14, 1.96, 1.93 [01:59:15] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.42, 1.70, 1.84 [02:00:59] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 5.70, 5.53, 5.24 [02:01:15] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.99, 2.12, 1.97 [02:02:58] RECOVERY - gluster102 Current Load on gluster102 is OK: OK - load average: 2.35, 4.33, 4.84 [02:03:15] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.87, 1.89, 1.90 [02:09:15] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.05, 1.34, 1.64 [02:16:31] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.55, 9.59, 8.58 [02:16:48] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 10.29, 7.42, 5.54 [02:17:04] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 7.41, 4.83, 3.23 [02:17:06] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 3.14, 2.61, 1.96 [02:17:15] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.25, 1.85, 1.74 [02:18:29] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.16, 10.28, 8.93 [02:20:27] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.70, 10.12, 9.02 [02:22:25] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.73, 9.62, 8.98 [02:22:44] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 4.12, 5.96, 5.60 [02:28:04] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.55, 10.91, 9.71 [02:30:39] RECOVERY - gluster102 Current Load on gluster102 is OK: OK - load average: 4.02, 4.41, 4.99 [02:34:10] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.71, 11.97, 10.43 [02:36:08] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.45, 11.68, 10.54 [02:37:22] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 4.39, 3.61, 3.01 [02:37:35] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.58, 11.29, 10.47 [02:38:06] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.69, 11.63, 10.62 [02:38:44] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 1.92, 3.14, 3.82 [02:39:18] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 3.32, 3.40, 3.00 [02:39:30] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.33, 11.04, 10.49 [02:40:04] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.21, 10.59, 10.35 [02:40:42] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.59, 3.66, 3.92 [02:44:00] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.23, 9.88, 10.14 [02:44:39] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.25, 3.32, 3.78 [02:47:06] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.76, 9.61, 10.11 [02:49:52] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.53, 10.85, 10.47 [02:50:55] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.50, 10.27, 10.29 [02:52:32] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.09, 3.71, 3.73 [02:52:49] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 9.07, 9.76, 10.10 [02:54:30] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.09, 3.20, 3.55 [02:55:47] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.26, 10.84, 10.52 [02:57:17] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 5.93, 5.26, 4.76 [02:57:45] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.22, 10.90, 10.58 [03:00:24] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 1.73, 2.71, 3.24 [03:02:20] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.28, 10.19, 10.14 [03:03:39] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.09, 11.11, 10.69 [03:04:14] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 9.32, 9.89, 10.04 [03:07:11] RECOVERY - gluster102 Current Load on gluster102 is OK: OK - load average: 4.47, 5.05, 4.98 [03:08:03] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 15.16, 12.07, 10.87 [03:10:13] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 0.80, 1.43, 1.87 [03:15:27] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.05, 11.16, 11.79 [03:18:13] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.60, 2.06, 1.96 [03:21:22] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.67, 11.54, 11.91 [03:22:14] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.83, 1.94, 1.94 [03:25:04] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 1.39, 2.36, 3.76 [03:25:17] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 4.74, 7.84, 10.13 [03:27:04] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 6.76, 7.96, 10.16 [03:28:14] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.39, 1.40, 1.68 [03:28:26] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 1.79, 1.69, 1.45 [03:29:04] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.47, 3.22, 3.76 [03:35:04] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.32, 3.74, 3.91 [03:35:06] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.11, 1.74, 1.73 [03:37:01] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.00, 1.44, 1.62 [03:38:26] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 1.47, 1.65, 1.57 [03:41:04] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 6.65, 4.41, 3.99 [03:45:54] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 12.00, 10.81, 9.85 [03:47:38] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.59, 2.24, 1.92 [03:49:50] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.12, 10.12, 9.83 [03:50:07] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 2 datacenters are down: 2001:41d0:801:2000::4c25/cpweb, 2001:41d0:801:2000::1b80/cpweb [03:51:29] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.42, 1.99, 1.90 [03:52:04] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [03:57:15] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.58, 1.37, 1.68 [03:58:26] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 1.79, 1.48, 1.40 [04:00:26] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 1.27, 1.38, 1.37 [04:01:07] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.93, 1.75, 1.76 [04:01:30] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.16, 9.57, 9.35 [04:03:24] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 9.08, 8.96, 9.13 [04:07:04] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 1.39, 2.94, 3.81 [04:08:48] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.89, 1.49, 1.67 [04:11:04] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.45, 2.10, 3.25 [04:19:04] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.81, 3.41, 3.49 [04:20:22] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.52, 1.80, 1.66 [04:22:18] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.54, 1.62, 1.61 [04:22:44] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 6.77, 3.98, 2.73 [04:23:04] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.07, 2.92, 3.31 [04:24:44] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.66, 3.70, 2.78 [04:26:44] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 1.76, 3.05, 2.65 [04:27:04] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.92, 4.87, 3.99 [04:28:14] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.43, 1.97, 1.78 [04:30:13] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 1.99, 2.05, 1.83 [04:32:14] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.87, 1.62, 1.70 [04:33:15] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.12, 1.50, 1.99 [04:37:15] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.14, 1.73, 1.97 [04:38:14] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 3.01, 2.29, 1.93 [04:39:15] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.02, 1.51, 1.86 [04:41:17] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::4c25/cpweb [04:42:14] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.26, 1.66, 1.75 [04:44:14] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.03, 1.45, 1.66 [04:45:12] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [04:49:15] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.51, 1.47, 1.68 [04:50:14] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 3.44, 3.00, 2.23 [04:51:04] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.06, 3.16, 3.88 [04:55:04] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.62, 2.30, 3.36 [04:55:15] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.81, 1.79, 1.75 [04:56:14] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 0.79, 1.60, 1.84 [04:58:26] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 1.97, 1.65, 1.41 [04:59:15] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.48, 1.63, 1.69 [05:00:14] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.78, 1.23, 1.63 [05:00:26] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 0.99, 1.37, 1.33 [05:03:15] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.96, 1.91, 1.82 [05:05:15] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.19, 2.07, 1.89 [05:06:40] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::4c25/cpweb [05:09:15] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.92, 1.86, 1.83 [05:13:15] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.02, 1.95, 1.87 [05:15:15] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.88, 1.80, 1.82 [05:16:21] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.38, 10.03, 8.64 [05:18:19] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 9.62, 9.65, 8.66 [05:19:15] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.95, 1.31, 1.61 [05:22:13] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.26, 1.86, 1.72 [05:23:04] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 6.25, 4.84, 3.33 [05:23:15] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.89, 1.73, 1.72 [05:24:14] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 3.69, 2.58, 2.01 [05:24:16] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [05:24:34] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 5.90, 4.82, 3.23 [05:25:15] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.14, 1.72, 1.70 [05:26:33] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 7.50, 5.27, 3.55 [05:27:15] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.73, 1.75, 1.72 [05:28:14] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 0.87, 1.79, 1.83 [05:28:32] RECOVERY - gluster102 Current Load on gluster102 is OK: OK - load average: 4.51, 4.78, 3.57 [05:28:57] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 1.90, 1.78, 1.62 [05:29:15] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.93, 1.53, 1.65 [05:30:52] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 1.33, 1.61, 1.57 [05:32:13] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.18, 1.52, 1.70 [05:33:04] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 1.45, 3.31, 3.64 [05:33:57] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 2 datacenters are down: 2001:41d0:801:2000::4c25/cpweb, 2001:41d0:801:2000::1b80/cpweb [05:35:04] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.49, 2.69, 3.36 [05:37:52] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [05:39:04] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.04, 3.70, 3.63 [05:41:04] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.23, 3.54, 3.58 [05:43:04] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.45, 3.99, 3.72 [05:46:14] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.79, 1.64, 1.57 [05:48:14] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.30, 1.85, 1.65 [05:51:15] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 3.68, 2.51, 1.84 [05:56:14] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.40, 1.77, 1.76 [05:57:33] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::4c25/cpweb [05:59:04] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.24, 3.31, 3.92 [06:00:13] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.99, 1.50, 1.66 [06:01:04] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.55, 3.41, 3.86 [06:05:04] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.33, 3.77, 3.94 [06:05:15] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.47, 1.86, 1.99 [06:07:04] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.07, 4.15, 4.04 [06:08:26] PROBLEM - test131 Current Load on test131 is CRITICAL: CRITICAL - load average: 2.40, 1.77, 1.44 [06:10:05] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 6.74, 5.39, 4.00 [06:10:36] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 15.94, 10.43, 8.65 [06:12:05] RECOVERY - gluster102 Current Load on gluster102 is OK: OK - load average: 2.50, 4.42, 3.83 [06:12:36] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.56, 10.28, 8.85 [06:13:15] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.81, 2.10, 1.99 [06:14:36] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 9.24, 9.99, 8.92 [06:15:33] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [06:20:39] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.91, 1.73, 1.60 [06:23:33] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::1b80/cpweb [06:24:30] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.39, 1.52, 1.54 [06:26:18] PROBLEM - cloud14 Puppet on cloud14 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[ulogd2] [06:27:33] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [06:29:04] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.27, 3.08, 3.97 [06:33:15] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.64, 1.70, 1.98 [06:37:15] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.47, 1.90, 1.97 [06:39:15] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.32, 1.68, 1.88 [06:41:04] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.45, 2.51, 3.24 [06:45:15] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.64, 1.87, 1.87 [06:46:07] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::4c25/cpweb [06:47:15] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.27, 1.67, 1.79 [06:51:15] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.76, 2.08, 1.93 [06:52:18] RECOVERY - cloud14 Puppet on cloud14 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [07:05:15] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.08, 1.69, 1.93 [07:07:05] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.43, 1.98, 1.64 [07:07:38] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [07:09:01] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.05, 1.57, 1.53 [07:09:04] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.77, 3.51, 3.03 [07:11:33] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::1b80/cpweb [07:12:53] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.93, 1.92, 1.70 [07:13:04] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.41, 4.36, 3.50 [07:13:15] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.24, 1.87, 1.91 [07:14:48] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.28, 2.06, 1.78 [07:15:04] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.23, 3.99, 3.48 [07:15:15] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.31, 1.67, 1.83 [07:16:44] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.73, 1.90, 1.75 [07:17:04] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.97, 4.29, 3.63 [07:17:15] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.39, 1.97, 1.92 [07:18:39] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.10, 1.98, 1.79 [07:19:04] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.30, 3.66, 3.49 [07:19:15] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.67, 1.82, 1.86 [07:20:35] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.56, 1.84, 1.77 [07:21:04] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.39, 4.14, 3.69 [07:21:15] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 4.18, 2.60, 2.14 [07:22:26] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 1.10, 1.34, 2.00 [07:22:30] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 3.81, 2.48, 2.00 [07:23:04] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.67, 3.77, 3.59 [07:24:17] PROBLEM - cp21 Stunnel HTTP for mon141 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [07:26:21] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 0.59, 1.65, 1.78 [07:27:04] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.08, 2.89, 3.28 [07:27:33] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [07:28:16] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.78, 1.39, 1.67 [07:28:26] RECOVERY - cp21 Stunnel HTTP for mon141 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 36276 bytes in 0.038 second response time [07:30:26] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 0.96, 1.17, 1.65 [07:32:13] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.01, 1.88, 1.81 [07:34:14] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.60, 1.78, 1.78 [07:35:33] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::4c25/cpweb [07:35:55] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.51, 3.76, 3.58 [07:36:13] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.85, 1.47, 1.67 [07:37:15] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.63, 1.85, 1.97 [07:39:15] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.38, 2.00, 2.00 [07:39:51] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.41, 3.90, 3.62 [07:41:15] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.63, 1.87, 1.95 [07:41:49] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.27, 3.26, 3.42 [07:43:15] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.39, 2.06, 2.02 [07:43:52] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.30, 3.44, 3.45 [07:46:05] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 5.88, 4.40, 3.75 [07:48:05] RECOVERY - gluster102 Current Load on gluster102 is OK: OK - load average: 3.56, 3.98, 3.67 [07:49:15] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.52, 1.79, 1.90 [07:49:45] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.23, 3.54, 3.55 [07:50:14] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.88, 1.62, 1.52 [07:51:15] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 3.26, 2.37, 2.10 [07:51:43] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 6.00, 4.84, 4.04 [07:52:14] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.71, 2.22, 1.77 [07:53:41] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.29, 3.92, 3.81 [07:55:39] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.49, 4.23, 3.94 [07:56:13] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.19, 1.93, 1.78 [07:57:15] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.44, 1.86, 1.99 [07:57:37] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.84, 3.89, 3.86 [07:58:14] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.71, 2.65, 2.08 [07:59:35] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.19, 4.18, 3.95 [08:01:15] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 5.18, 2.77, 2.26 [08:01:23] PROBLEM - cp21 Stunnel HTTP for mon141 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:01:33] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.13, 3.67, 3.79 [08:02:14] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.13, 1.80, 1.86 [08:06:13] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.17, 1.46, 1.69 [08:06:22] RECOVERY - cp21 Stunnel HTTP for mon141 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 36230 bytes in 0.044 second response time [08:07:27] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.27, 4.41, 4.02 [08:09:15] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.66, 1.87, 2.00 [08:09:33] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [08:10:36] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.82, 10.22, 8.60 [08:12:36] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.66, 9.33, 8.47 [08:13:15] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.25, 1.97, 2.00 [08:13:33] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::4c25/cpweb [08:15:15] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.15, 1.64, 1.88 [08:15:33] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [08:19:14] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.67, 3.52, 3.83 [08:19:15] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 5.57, 2.20, 1.97 [08:25:07] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.53, 2.53, 3.29 [08:26:25] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::4c25/cpweb [08:37:34] PROBLEM - cp21 Stunnel HTTP for mon141 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [08:39:55] RECOVERY - cp21 Stunnel HTTP for mon141 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 36276 bytes in 7.272 second response time [08:41:15] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.16, 1.67, 1.97 [08:41:49] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/mw-config/commit/0166a44d5a78 [08:41:50] [url] Page not found · GitHub · GitHub | github.com [08:41:51] [02miraheze/mw-config] 07Universal-Omega 030166a44 - Update help message for Cargo [08:41:52] [02mw-config] 07Universal-Omega created branch 03Universal-Omega-patch-1 - 13https://github.com/miraheze/mw-config [08:41:52] ... [08:41:54] [02mw-config] 07Universal-Omega opened pull request 03#4890: Update help message for Cargo - 13https://github.com/miraheze/mw-config/pull/4890 [08:41:54] [url] Page not found · GitHub · GitHub | github.com [08:43:14] miraheze/mw-config - Universal-Omega the build passed. [08:43:18] [02mw-config] 07Universal-Omega synchronize pull request 03#4890: Update help message for Cargo - 13https://github.com/miraheze/mw-config/pull/4890 [08:43:18] ... [08:43:20] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/0166a44d5a78...2b17b95ba92e [08:43:20] [url] Comparing 0166a44d5a78...2b17b95ba92e · miraheze/mw-config · GitHub | github.com [08:43:21] [02miraheze/mw-config] 07Universal-Omega 032b17b95 - Update ManageWikiExtensions.php [08:44:26] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 1.92, 1.67, 1.53 [08:44:27] miraheze/mw-config - Universal-Omega the build passed. [08:45:51] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 6.04, 4.19, 3.32 [08:46:26] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 1.49, 1.60, 1.52 [08:47:49] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.79, 3.76, 3.25 [08:49:15] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.18, 1.34, 1.68 [08:49:47] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 8.28, 5.65, 4.00 [08:50:13] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.46, 2.08, 1.62 [08:50:26] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 1.88, 1.76, 1.61 [08:52:26] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 1.50, 1.65, 1.59 [08:54:13] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.35, 1.90, 1.68 [08:55:40] [02mw-config] 07Universal-Omega closed pull request 03#4890: Update help message for Cargo - 13https://github.com/miraheze/mw-config/pull/4890 [08:55:40] [url] Page not found · GitHub · GitHub | github.com [08:55:41] [02mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 - 13https://github.com/miraheze/mw-config [08:55:41] ... [08:55:43] [02miraheze/mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 [08:55:44] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/b736eea253e2...f4ae478c4e09 [08:55:45] [url] Comparing b736eea253e2...f4ae478c4e09 · miraheze/mw-config · GitHub | github.com [08:55:46] [02miraheze/mw-config] 07Universal-Omega 03f4ae478 - Update help message for Cargo (#4890) [08:56:07] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.49, 1.69, 1.75 [08:56:41] miraheze/mw-config - Universal-Omega the build passed. [08:57:03] !log [@test131] starting deploy of {'config': True} to all [08:57:04] !log [@test131] finished deploy of {'config': True} to all - SUCCESS in 0s [08:57:19] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [08:57:32] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [08:58:13] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.22, 1.59, 1.60 [08:59:40] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [09:01:59] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.30, 1.51, 1.65 [09:02:22] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 9.87, 6.63, 4.56 [09:03:33] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 2 datacenters are down: 2001:41d0:801:2000::4c25/cpweb, 2001:41d0:801:2000::1b80/cpweb [09:05:51] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.61, 1.94, 1.78 [09:08:18] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 4.85, 5.90, 4.86 [09:09:54] PROBLEM - cp21 Stunnel HTTP for mon141 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [09:10:03] !log [@mwtask141] starting deploy of {'config': True} to all [09:10:09] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [09:10:16] RECOVERY - gluster102 Current Load on gluster102 is OK: OK - load average: 3.25, 4.79, 4.57 [09:10:23] !log [@mwtask141] finished deploy of {'config': True} to all - SUCCESS in 19s [09:10:29] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [09:11:43] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.83, 1.97, 1.85 [09:11:56] RECOVERY - cp21 Stunnel HTTP for mon141 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 36230 bytes in 0.044 second response time [09:12:36] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.77, 9.67, 8.52 [09:13:22] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 1.40, 2.73, 3.78 [09:13:33] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [09:14:36] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.25, 9.41, 8.59 [09:15:20] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 0.60, 1.99, 3.38 [09:15:37] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.19, 1.93, 1.85 [09:17:34] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::4c25/cpweb [09:18:39] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.99, 1.93, 1.73 [09:20:35] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.54, 2.20, 1.85 [09:24:26] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 0.91, 1.70, 1.75 [09:26:21] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.11, 1.52, 1.67 [09:28:29] PROBLEM - cp21 Stunnel HTTP for mon141 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [09:32:42] RECOVERY - cp21 Stunnel HTTP for mon141 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 36276 bytes in 1.063 second response time [09:39:06] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03master [+1/-1/±0] 13https://github.com/miraheze/ImportDump/compare/702c3b6ec018...7e7b36c0e7c9 [09:39:07] [url] Comparing 702c3b6ec018...7e7b36c0e7c9 · miraheze/ImportDump · GitHub | github.com [09:39:08] [02miraheze/ImportDump] 07Universal-Omega 037e7b36c - Convert LICENSE to markdown [09:42:15] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/7e7b36c0e7c9...66b78ddea785 [09:42:16] [url] Comparing 7e7b36c0e7c9...66b78ddea785 · miraheze/ImportDump · GitHub | github.com [09:42:17] [02miraheze/ImportDump] 07Universal-Omega 0366b78dd - README: Update security information [09:42:56] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 14.65, 12.17, 9.89 [09:44:50] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.40, 11.26, 9.82 [09:45:33] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [09:49:33] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::1b80/cpweb [09:50:36] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 9.99, 10.15, 9.72 [09:51:06] miraheze/ImportDump - Universal-Omega the build has errored. [09:53:09] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/66b78ddea785...48b409a8192e [09:53:10] [url] Comparing 66b78ddea785...48b409a8192e · miraheze/ImportDump · GitHub | github.com [09:53:11] [02miraheze/ImportDump] 07Universal-Omega 0348b409a - lowercase templates for consistency [09:59:33] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [10:01:18] miraheze/ImportDump - Universal-Omega the build passed. [10:03:04] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 6.33, 4.28, 3.25 [10:03:33] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::1b80/cpweb [10:03:48] PROBLEM - cp21 Stunnel HTTP for mon141 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:05:33] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [10:05:55] RECOVERY - cp21 Stunnel HTTP for mon141 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 36276 bytes in 1.049 second response time [10:09:04] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.75, 3.86, 3.44 [10:11:33] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::4c25/cpweb [10:13:04] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.52, 3.16, 3.32 [10:14:57] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.64, 1.92, 1.72 [10:18:48] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 4.11, 2.55, 1.99 [10:23:04] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.58, 3.82, 3.51 [10:25:04] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 9.62, 6.07, 4.36 [10:27:15] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.24, 1.64, 1.92 [10:28:26] PROBLEM - test131 Current Load on test131 is CRITICAL: CRITICAL - load average: 2.70, 2.05, 1.60 [10:30:26] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 1.53, 1.83, 1.58 [10:32:15] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.18, 1.83, 1.92 [10:34:26] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 1.46, 1.70, 1.59 [10:35:15] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.68, 1.41, 1.68 [10:36:48] PROBLEM - cp21 Stunnel HTTP for mon141 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [10:38:54] RECOVERY - cp21 Stunnel HTTP for mon141 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 36276 bytes in 0.040 second response time [10:39:15] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.62, 2.15, 1.94 [10:39:33] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [10:41:22] PROBLEM - wiki.wisrail.de - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.wisrail.de All nameservers failed to answer the query. [10:42:14] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.44, 2.32, 2.07 [10:42:44] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.29, 11.47, 9.24 [10:45:07] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.28, 11.26, 9.72 [10:46:14] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.32, 1.80, 1.91 [10:46:36] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.93, 11.26, 9.64 [10:47:04] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.00, 3.34, 3.88 [10:47:06] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.11, 11.04, 9.85 [10:47:15] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.27, 1.94, 1.99 [10:47:33] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::4c25/cpweb [10:49:04] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.28, 9.72, 9.51 [10:50:14] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.63, 2.12, 2.00 [10:51:15] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 4.21, 2.62, 2.22 [10:52:13] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.43, 1.94, 1.95 [10:52:36] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 14.33, 11.70, 10.20 [10:53:04] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.86, 2.30, 3.23 [10:54:36] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.72, 11.69, 10.39 [10:55:04] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.95, 11.11, 10.19 [10:56:36] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 15.83, 13.20, 11.10 [10:57:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.27, 11.85, 10.57 [10:58:14] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.28, 2.20, 2.04 [10:59:04] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.78, 11.87, 10.74 [11:00:07] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 5.66, 3.77, 2.95 [11:01:04] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.46, 3.23, 3.29 [11:01:04] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 14.21, 12.61, 11.14 [11:02:03] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.19, 3.51, 2.96 [11:03:04] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.26, 3.45, 3.33 [11:04:00] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 3.33, 3.34, 2.96 [11:04:36] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.00, 11.21, 11.11 [11:05:04] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.59, 2.98, 3.17 [11:06:40] PROBLEM - cp21 Stunnel HTTP for mon141 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [11:07:04] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.13, 11.33, 11.17 [11:09:05] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 6.38, 4.48, 3.69 [11:10:14] RECOVERY - wiki.wisrail.de - reverse DNS on sslhost is OK: SSL OK - wiki.wisrail.de reverse DNS resolves to cp30.miraheze.org - CNAME OK [11:10:37] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 18.29, 12.94, 11.65 [11:11:04] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.28, 11.31, 11.13 [11:12:15] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.68, 1.86, 1.99 [11:13:05] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.23, 10.06, 10.69 [11:16:14] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.52, 1.99, 1.99 [11:17:35] RECOVERY - cp21 Stunnel HTTP for mon141 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 36276 bytes in 0.042 second response time [11:17:58] PROBLEM - cp20 APT on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [11:18:37] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.97, 11.45, 11.65 [11:20:00] RECOVERY - cp20 APT on cp20 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [11:26:14] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.61, 1.88, 1.99 [11:28:36] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.33, 8.94, 10.20 [11:29:04] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.76, 10.73, 10.81 [11:30:13] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.07, 1.79, 1.90 [11:31:04] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.92, 10.73, 10.79 [11:32:14] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.83, 1.72, 1.86 [11:32:36] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.39, 10.09, 10.41 [11:33:04] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 20.27, 13.41, 11.70 [11:33:33] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [11:34:36] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.36, 9.02, 9.98 [11:34:44] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.67, 3.35, 3.05 [11:35:04] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.04, 2.85, 3.97 [11:36:44] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 2.43, 2.96, 2.94 [11:37:04] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.83, 11.22, 11.23 [11:37:15] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 0.99, 1.54, 1.92 [11:37:33] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::4c25/cpweb [11:38:37] PROBLEM - cp21 Stunnel HTTP for mon141 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:39:15] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 5.78, 3.27, 2.50 [11:40:36] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 17.96, 12.50, 10.97 [11:41:46] PROBLEM - cp20 APT on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [11:42:14] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.04, 1.47, 1.69 [11:43:07] RECOVERY - cp21 Stunnel HTTP for mon141 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 36276 bytes in 7.263 second response time [11:45:04] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.77, 3.66, 3.73 [11:46:14] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.38, 1.91, 1.82 [11:46:36] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.70, 11.14, 10.95 [11:47:04] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.53, 3.61, 3.70 [11:49:04] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 9.83, 5.46, 4.33 [11:49:45] RECOVERY - cp20 APT on cp20 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [11:51:08] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 14.47, 8.51, 5.13 [11:51:33] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [11:52:37] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 16.47, 11.84, 11.07 [11:53:04] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 14.07, 11.28, 10.78 [11:53:40] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.92, 4.03, 2.95 [11:55:33] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::4c25/cpweb [11:57:40] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.79, 3.91, 3.14 [11:58:21] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 5.09, 4.32, 3.52 [11:58:26] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 1.81, 1.56, 1.36 [12:00:26] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 1.38, 1.49, 1.36 [12:01:40] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 3.55, 4.12, 3.42 [12:03:40] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.01, 3.70, 3.35 [12:07:33] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [12:09:40] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.44, 3.74, 3.44 [12:09:58] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.77, 3.81, 3.72 [12:11:34] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::1b80/cpweb [12:11:40] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.68, 3.29, 3.31 [12:14:26] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 1.86, 1.65, 1.46 [12:18:26] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 1.51, 1.67, 1.52 [12:18:31] PROBLEM - db131 NTP time on db131 is CRITICAL: NTP CRITICAL: Offset 0.7213141322 secs [12:21:35] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 4.83, 3.94, 3.72 [12:23:31] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.59, 3.83, 3.71 [12:27:24] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 4.80, 4.06, 3.81 [12:29:20] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.21, 3.79, 3.75 [12:30:30] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.94, 3.93, 3.46 [12:32:28] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.29, 3.64, 3.41 [12:33:12] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 4.21, 3.68, 3.70 [12:34:26] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.98, 3.38, 3.34 [12:35:00] PROBLEM - cp20 APT on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [12:35:08] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.03, 3.44, 3.61 [12:37:01] RECOVERY - cp20 APT on cp20 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [12:39:34] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [12:42:15] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.63, 3.96, 3.59 [12:44:14] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.45, 3.83, 3.59 [12:46:42] PROBLEM - cp21 Stunnel HTTP for mon141 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:47:33] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::4c25/cpweb [12:48:43] RECOVERY - cp21 Stunnel HTTP for mon141 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 36276 bytes in 2.100 second response time [12:48:47] RECOVERY - db131 NTP time on db131 is OK: NTP OK: Offset -0.007357746363 secs [12:50:08] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 3.27, 3.25, 3.40 [12:50:44] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 2.59, 3.11, 3.36 [12:52:29] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 3.78, 3.85, 5.97 [12:54:28] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 9.16, 5.32, 6.22 [12:56:26] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 4.40, 4.77, 5.91 [13:00:24] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 6.47, 4.89, 5.64 [13:02:22] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 5.35, 4.54, 5.39 [13:04:21] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 6.23, 4.99, 5.44 [13:04:44] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 4.01, 3.43, 3.24 [13:06:20] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 4.80, 5.26, 5.52 [13:06:44] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 2.28, 2.96, 3.09 [13:10:17] RECOVERY - gluster102 Current Load on gluster102 is OK: OK - load average: 3.73, 4.39, 5.10 [13:15:05] PROBLEM - cp21 Stunnel HTTP for mon141 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [13:15:33] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [13:17:11] RECOVERY - cp21 Stunnel HTTP for mon141 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 36276 bytes in 7.256 second response time [13:19:33] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::1b80/cpweb [13:20:36] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.67, 4.08, 3.45 [13:21:08] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 5.41, 5.67, 5.27 [13:23:07] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 7.84, 6.87, 5.78 [13:29:03] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 2.45, 4.99, 5.44 [13:30:27] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.47, 3.49, 3.62 [13:33:00] RECOVERY - gluster102 Current Load on gluster102 is OK: OK - load average: 3.22, 4.17, 5.01 [13:35:33] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [13:39:34] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::4c25/cpweb [13:40:54] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 7.88, 6.00, 5.42 [13:41:26] PROBLEM - cp21 Stunnel HTTP for mon141 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [13:43:57] RECOVERY - cp21 Stunnel HTTP for mon141 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 36276 bytes in 0.049 second response time [13:44:14] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 1.86, 2.82, 3.33 [13:50:07] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.28, 3.90, 3.57 [13:58:26] PROBLEM - test131 Current Load on test131 is CRITICAL: CRITICAL - load average: 2.17, 1.83, 1.51 [13:59:58] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.73, 3.77, 3.89 [14:00:26] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 1.85, 1.81, 1.54 [14:01:26] PROBLEM - cp21 Stunnel HTTP for mon141 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [14:01:56] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.32, 4.27, 4.07 [14:03:55] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.39, 3.94, 3.97 [14:03:57] RECOVERY - cp21 Stunnel HTTP for mon141 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 36276 bytes in 1.059 second response time [14:04:26] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 1.49, 1.69, 1.56 [14:05:27] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 4.66, 3.79, 3.24 [14:05:53] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.30, 4.35, 4.12 [14:07:23] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.52, 3.74, 3.30 [14:09:49] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.18, 3.79, 3.95 [14:11:15] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 1.31, 2.61, 2.94 [14:11:33] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [14:15:44] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.98, 3.85, 3.81 [14:17:33] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 2 datacenters are down: 2001:41d0:801:2000::4c25/cpweb, 2001:41d0:801:2000::1b80/cpweb [14:17:42] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.91, 3.72, 3.77 [14:19:40] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.07, 3.90, 3.83 [14:21:40] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.64, 3.85, 3.83 [14:23:40] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.11, 3.83, 3.81 [14:25:42] PROBLEM - cp21 Stunnel HTTP for mon141 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:27:58] RECOVERY - cp21 Stunnel HTTP for mon141 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 36276 bytes in 1.071 second response time [14:31:46] PROBLEM - cp20 APT on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [14:33:50] RECOVERY - cp20 APT on cp20 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [14:48:44] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 4.03, 3.59, 3.11 [14:50:44] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.54, 3.52, 3.14 [14:52:44] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 4.20, 3.76, 3.27 [14:53:41] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.55, 3.70, 4.00 [14:55:40] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 6.37, 4.48, 4.24 [14:58:44] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.05, 3.87, 3.51 [15:00:44] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 2.41, 3.26, 3.32 [15:01:07] PROBLEM - cp20 APT on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [15:01:40] PROBLEM - cp31 Stunnel HTTP for mw122 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:03:06] RECOVERY - cp20 APT on cp20 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [15:03:40] RECOVERY - cp31 Stunnel HTTP for mw122 on cp31 is OK: HTTP OK: HTTP/1.1 204 No Content - 352 bytes in 1.151 second response time [15:13:33] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [15:17:34] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::1b80/cpweb [15:20:06] PROBLEM - cp21 Stunnel HTTP for mon141 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [15:24:28] PROBLEM - cp30 Stunnel HTTP for mw121 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:25:33] PROBLEM - mw121 MediaWiki Rendering on mw121 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:25:34] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [15:26:10] PROBLEM - cp31 Stunnel HTTP for mw121 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:27:15] RECOVERY - cp21 Stunnel HTTP for mon141 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 36268 bytes in 0.063 second response time [15:27:43] RECOVERY - mw121 MediaWiki Rendering on mw121 is OK: HTTP OK: HTTP/1.1 200 OK - 29514 bytes in 9.886 second response time [15:28:06] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 4.41, 3.64, 3.26 [15:28:09] RECOVERY - cp31 Stunnel HTTP for mw121 on cp31 is OK: HTTP OK: HTTP/1.1 204 No Content - 352 bytes in 0.609 second response time [15:28:26] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 1.71, 1.63, 1.42 [15:28:28] RECOVERY - cp30 Stunnel HTTP for mw121 on cp30 is OK: HTTP OK: HTTP/1.1 204 No Content - 352 bytes in 0.255 second response time [15:29:33] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::4c25/cpweb [15:30:26] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 1.28, 1.48, 1.38 [15:31:58] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 2.45, 3.56, 3.34 [15:35:50] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 4.24, 3.75, 3.46 [15:37:47] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.23, 3.44, 3.37 [15:39:43] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 2.84, 3.18, 3.28 [15:42:26] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 1.82, 1.62, 1.46 [15:46:08] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 4.50, 4.10, 5.97 [15:46:26] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 1.64, 1.65, 1.51 [15:48:08] PROBLEM - cp21 Stunnel HTTP for mon141 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [15:49:26] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 4.66, 3.72, 3.38 [15:49:40] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.63, 3.68, 3.99 [15:51:22] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 2.75, 3.37, 3.30 [15:51:33] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [15:51:40] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.76, 4.25, 4.18 [15:52:05] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 10.14, 5.81, 5.94 [15:55:33] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::4c25/cpweb [15:56:05] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 3.93, 5.28, 5.79 [15:56:05] RECOVERY - cp21 Stunnel HTTP for mon141 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 36275 bytes in 1.068 second response time [15:57:33] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [15:58:05] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 6.10, 5.80, 5.93 [15:58:26] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 1.73, 1.70, 1.57 [16:00:26] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 1.20, 1.53, 1.52 [16:01:33] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::4c25/cpweb [16:05:33] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [16:07:40] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.09, 3.59, 3.96 [16:09:40] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.71, 4.22, 4.13 [16:11:33] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 2 datacenters are down: 2001:41d0:801:2000::4c25/cpweb, 2001:41d0:801:2000::1b80/cpweb [16:13:33] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [16:18:05] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 2.65, 4.34, 5.99 [16:18:54] PROBLEM - cp20 APT on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [16:19:33] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::4c25/cpweb [16:20:05] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 7.79, 5.53, 6.21 [16:23:12] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.82, 3.57, 3.94 [16:23:17] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 5.02, 5.22, 5.96 [16:23:38] RECOVERY - cp20 APT on cp20 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [16:25:09] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 3.82, 3.88, 4.02 [16:25:16] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 15.98, 9.49, 7.44 [16:26:49] PROBLEM - cp21 Stunnel HTTP for mon141 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [16:28:50] RECOVERY - cp21 Stunnel HTTP for mon141 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 36275 bytes in 3.182 second response time [16:30:33] PROBLEM - cp30 Stunnel HTTP for mw121 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:32:36] RECOVERY - cp30 Stunnel HTTP for mw121 on cp30 is OK: HTTP OK: HTTP/1.1 204 No Content - 352 bytes in 7.122 second response time [16:34:16] PROBLEM - gluster122 Current Load on gluster122 is WARNING: WARNING - load average: 3.94, 3.36, 2.71 [16:35:26] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 4.05, 3.86, 3.26 [16:36:12] RECOVERY - gluster122 Current Load on gluster122 is OK: OK - load average: 2.48, 2.99, 2.65 [16:39:17] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.28, 3.78, 3.37 [16:43:14] PROBLEM - cp20 APT on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [16:45:26] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [16:45:26] RECOVERY - cp20 APT on cp20 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [16:46:01] PROBLEM - cp21 Stunnel HTTP for mon141 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [16:47:01] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 2.19, 3.17, 3.27 [16:50:39] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 1.53, 2.77, 3.79 [16:51:19] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::4c25/cpweb [16:52:37] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.35, 3.53, 3.93 [16:53:07] RECOVERY - cp21 Stunnel HTTP for mon141 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 36275 bytes in 0.072 second response time [16:54:34] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.70, 3.50, 3.87 [16:56:32] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.11, 4.24, 4.10 [16:58:26] PROBLEM - cp21 Stunnel HTTP for mon141 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:01:04] RECOVERY - cp21 Stunnel HTTP for mon141 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 36275 bytes in 7.252 second response time [17:04:23] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.15, 3.32, 3.80 [17:14:11] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.50, 2.93, 3.35 [17:23:54] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.84, 3.99, 3.68 [17:25:24] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 1.97, 1.70, 1.49 [17:25:52] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.29, 4.04, 3.73 [17:27:24] PROBLEM - test131 Current Load on test131 is CRITICAL: CRITICAL - load average: 2.32, 1.88, 1.58 [17:27:50] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.91, 3.89, 3.71 [17:29:24] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 2.00, 1.95, 1.65 [17:29:54] !log sudo -u www-data php /srv/mediawiki/w/maintenance/namespaceDupes.php --wiki=slymodswiki --fix [17:31:09] !log temporarily locally modify /srv/mediawiki/w/maintenance/nukePage.php on mwtask141 to use Title::newFromID to use ID to nuke pages instead of name [17:31:46] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.72, 3.76, 3.64 [17:32:09] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:32:16] PROBLEM - dc.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:33:24] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 1.54, 1.69, 1.61 [17:34:03] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.77, 3.25, 3.04 [17:34:06] !log sudo -u www-data php /srv/mediawiki/w/maintenance/nukePage.php --wiki=slymodswiki 229 --delete (deletes _Honor Among Thieves) [17:34:19] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:34:32] !log sudo -u www-data php /srv/mediawiki/w/maintenance/nukePage.php --wiki=slymodswiki 231 --delete (deletes _Honour Among Thieves) [17:34:44] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:35:38] !log sudo -u www-data php /srv/mediawiki/w/maintenance/nukePage.php --wiki=slymodswiki 227 --delete (deletes Sly 2:_Band of Thieves) [17:36:17] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:36:22] !log undo local changes to /srv/mediawiki/w/maintenance/nukePage.php on mwtask141 [17:36:38] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:37:46] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.60, 3.33, 3.53 [17:37:55] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 2.41, 2.90, 2.95 [17:39:46] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.74, 4.40, 3.90 [17:40:30] PROBLEM - cp21 Stunnel HTTP for mon141 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [17:41:46] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.81, 3.93, 3.77 [17:45:46] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.65, 3.77, 3.69 [17:50:46] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [17:52:06] PROBLEM - cp20 APT on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [17:54:10] RECOVERY - cp20 APT on cp20 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [17:54:26] RECOVERY - cp21 Stunnel HTTP for mon141 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 36275 bytes in 0.048 second response time [17:54:32] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.67, 3.42, 3.23 [17:54:46] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::1b80/cpweb [17:56:32] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 3.35, 3.21, 3.17 [17:56:46] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [17:59:16] !log restart graylog-server on graylog121 [17:59:21] PROBLEM - cp31 Stunnel HTTP for mw122 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:59:37] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:00:00] !log disable puppet on mw* and mwtask141 [18:00:25] [02puppet] 07Universal-Omega closed pull request 03#2755: Convert memcached_servers to single nutcracker config in hiera - 13https://github.com/miraheze/puppet/pull/2755 [18:00:25] [url] Page not found · GitHub · GitHub | github.com [18:00:27] [02miraheze/puppet] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±2] 13https://github.com/miraheze/puppet/compare/a6a987b5dc8f...0ce715d97068 [18:00:27] [url] Comparing a6a987b5dc8f...0ce715d97068 · miraheze/puppet · GitHub | github.com [18:00:28] [02miraheze/puppet] 07Universal-Omega 030ce715d - Convert memcached_servers to single nutcracker config in hiera (#2755) [18:00:32] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 7.72, 6.17, 4.45 [18:00:35] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:01:29] PROBLEM - mwtask141 Puppet on mwtask141 is WARNING: WARNING: Puppet is currently disabled, message: reason not specified, last run 21 minutes ago with 0 failures [18:01:32] PROBLEM - mw121 Puppet on mw121 is WARNING: WARNING: Puppet is currently disabled, message: reason not specified, last run 20 minutes ago with 0 failures [18:01:37] PROBLEM - mw142 Puppet on mw142 is WARNING: WARNING: Puppet is currently disabled, message: reason not specified, last run 30 minutes ago with 0 failures [18:01:38] PROBLEM - mw131 Puppet on mw131 is WARNING: WARNING: Puppet is currently disabled, message: reason not specified, last run 20 minutes ago with 0 failures [18:01:50] PROBLEM - mw141 Puppet on mw141 is WARNING: WARNING: Puppet is currently disabled, message: reason not specified, last run 25 minutes ago with 0 failures [18:01:56] RECOVERY - dc.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [18:02:07] PROBLEM - cp30 Stunnel HTTP for mw122 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:02:37] PROBLEM - mw122 Puppet on mw122 is WARNING: WARNING: Puppet is currently disabled, message: reason not specified, last run 28 minutes ago with 0 failures [18:02:46] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::4c25/cpweb [18:02:54] PROBLEM - mw122 MediaWiki Rendering on mw122 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:02:56] PROBLEM - mw132 Puppet on mw132 is WARNING: WARNING: Puppet is currently disabled, message: reason not specified, last run 27 minutes ago with 0 failures [18:03:29] RECOVERY - cp31 Stunnel HTTP for mw122 on cp31 is OK: HTTP OK: HTTP/1.1 204 No Content - 352 bytes in 4.132 second response time [18:04:14] RECOVERY - cp30 Stunnel HTTP for mw122 on cp30 is OK: HTTP OK: HTTP/1.1 204 No Content - 352 bytes in 7.327 second response time [18:04:38] PROBLEM - test131 Puppet on test131 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [18:07:02] PROBLEM - roblox-wiki.tk - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - roblox-wiki.tk All nameservers failed to answer the query. [18:07:05] RECOVERY - mw122 MediaWiki Rendering on mw122 is OK: HTTP OK: HTTP/1.1 200 OK - 29523 bytes in 1.855 second response time [18:09:24] PROBLEM - test131 Current Load on test131 is CRITICAL: CRITICAL - load average: 2.41, 1.89, 1.51 [18:10:13] PROBLEM - cp21 Stunnel HTTP for mon141 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [18:12:12] RECOVERY - cp21 Stunnel HTTP for mon141 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 36229 bytes in 0.040 second response time [18:18:32] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 1.90, 3.25, 3.83 [18:23:46] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.91, 3.37, 3.98 [18:25:46] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.88, 3.69, 4.01 [18:26:32] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 4.78, 4.05, 3.94 [18:28:14] PROBLEM - cp20 APT on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [18:29:46] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.92, 3.41, 3.83 [18:30:46] RECOVERY - cp20 APT on cp20 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [18:31:46] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.01, 3.77, 3.90 [18:32:32] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 2.70, 3.78, 3.93 [18:35:04] PROBLEM - cp21 Stunnel HTTP for mon141 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:35:46] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.38, 3.63, 3.83 [18:36:43] RECOVERY - roblox-wiki.tk - reverse DNS on sslhost is OK: SSL OK - roblox-wiki.tk reverse DNS resolves to cp30.miraheze.org - NS RECORDS OK [18:39:46] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.71, 4.20, 3.98 [18:39:51] RECOVERY - cp21 Stunnel HTTP for mon141 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 36275 bytes in 1.055 second response time [18:42:14] PROBLEM - cp20 APT on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [18:44:16] RECOVERY - cp20 APT on cp20 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [18:48:32] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 2.56, 2.91, 3.31 [18:50:46] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [18:54:46] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::4c25/cpweb [18:54:49] [02miraheze/puppet] 07Universal-Omega pushed 031 commit to 03revert-2755-patch-421 [+0/-0/±2] 13https://github.com/miraheze/puppet/commit/3b419b74409c [18:54:50] [02miraheze/puppet] 07Universal-Omega 033b419b7 - Revert "Convert memcached_servers to single nutcracker config in hiera (#2755)" [18:54:52] [02puppet] 07Universal-Omega created branch 03revert-2755-patch-421 - 13https://github.com/miraheze/puppet [18:54:52] [url] Page not found · GitHub · GitHub | github.com [18:54:54] [02puppet] 07Universal-Omega opened pull request 03#2816: Revert "Convert memcached_servers to single nutcracker config in hiera" - 13https://github.com/miraheze/puppet/pull/2816 [18:54:54] [url] Page not found · GitHub · GitHub | github.com [18:55:11] [02puppet] 07Universal-Omega closed pull request 03#2816: Revert "Convert memcached_servers to single nutcracker config in hiera" - 13https://github.com/miraheze/puppet/pull/2816 [18:55:12] [url] Page not found · GitHub · GitHub | github.com [18:55:13] [02miraheze/puppet] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±2] 13https://github.com/miraheze/puppet/compare/0ce715d97068...413ea24d7904 [18:55:13] [url] Comparing 0ce715d97068...413ea24d7904 · miraheze/puppet · GitHub | github.com [18:55:14] [02miraheze/puppet] 07Universal-Omega 03413ea24 - Revert "Convert memcached_servers to single nutcracker config in hiera" (#2816) [18:55:16] [02miraheze/puppet] 07Universal-Omega deleted branch 03revert-2755-patch-421 [18:55:17] [02puppet] 07Universal-Omega deleted branch 03revert-2755-patch-421 - 13https://github.com/miraheze/puppet [18:55:18] [url] Page not found · GitHub · GitHub | github.com [18:55:50] RECOVERY - mw141 Puppet on mw141 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [18:56:00] !log re-enable puppet on mw* and mwtask141 [18:56:13] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:56:37] RECOVERY - mw122 Puppet on mw122 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [18:56:56] RECOVERY - mw132 Puppet on mw132 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [18:57:29] RECOVERY - mwtask141 Puppet on mwtask141 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [18:57:32] RECOVERY - mw121 Puppet on mw121 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [18:57:37] RECOVERY - mw142 Puppet on mw142 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [18:57:38] RECOVERY - mw131 Puppet on mw131 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [18:58:09] PROBLEM - cp21 Stunnel HTTP for mon141 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:58:38] RECOVERY - test131 Puppet on test131 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [19:00:31] RECOVERY - cp21 Stunnel HTTP for mon141 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 36260 bytes in 7.259 second response time [19:02:32] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.50, 3.37, 3.29 [19:03:14] PROBLEM - cp20 APT on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [19:08:32] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 2.57, 3.29, 3.33 [19:09:50] PROBLEM - cp31 Stunnel HTTP for mw122 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:10:02] PROBLEM - cp30 Stunnel HTTP for mw121 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:10:21] PROBLEM - mw121 MediaWiki Rendering on mw121 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:11:48] RECOVERY - cp31 Stunnel HTTP for mw122 on cp31 is OK: HTTP OK: HTTP/1.1 204 No Content - 352 bytes in 3.553 second response time [19:12:02] RECOVERY - cp30 Stunnel HTTP for mw121 on cp30 is OK: HTTP OK: HTTP/1.1 204 No Content - 352 bytes in 0.250 second response time [19:12:22] RECOVERY - mw121 MediaWiki Rendering on mw121 is OK: HTTP OK: HTTP/1.1 200 OK - 29514 bytes in 3.247 second response time [19:12:55] PROBLEM - cp21 Stunnel HTTP for mon141 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:14:03] RECOVERY - cp20 APT on cp20 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [19:15:04] RECOVERY - cp21 Stunnel HTTP for mon141 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 36267 bytes in 3.108 second response time [19:21:46] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.50, 3.10, 3.86 [19:26:46] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [19:27:46] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.53, 3.65, 3.80 [19:28:32] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 4.05, 3.57, 3.18 [19:29:18] PROBLEM - cp21 Stunnel HTTP for mon141 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [19:29:46] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.66, 3.73, 3.82 [19:30:46] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 2 datacenters are down: 2001:41d0:801:2000::4c25/cpweb, 2001:41d0:801:2000::1b80/cpweb [19:31:24] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 1.03, 1.44, 2.00 [19:31:46] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 7.48, 4.79, 4.17 [19:32:32] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.24, 3.45, 3.23 [19:34:32] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 2.98, 3.28, 3.19 [19:37:24] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 1.07, 1.17, 1.69 [19:38:02] RECOVERY - cp21 Stunnel HTTP for mon141 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 36275 bytes in 0.043 second response time [19:42:46] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [19:59:49] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.52, 3.63, 3.33 [20:01:34] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::4c25/cpweb [20:05:36] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 4.54, 3.88, 3.52 [20:11:24] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 2.69, 3.77, 3.66 [20:11:25] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [20:17:46] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.06, 3.11, 3.77 [20:19:07] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 2.18, 2.90, 3.28 [20:20:14] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::1b80/cpweb [20:22:12] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [20:23:46] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.22, 3.55, 3.71 [20:25:46] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.23, 3.06, 3.51 [20:29:24] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 1.77, 1.65, 1.40 [20:31:24] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 1.49, 1.57, 1.40 [20:33:46] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.41, 2.85, 3.27 [20:39:46] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.34, 3.45, 3.42 [20:41:24] PROBLEM - mw121 MediaWiki Rendering on mw121 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:41:46] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.51, 3.12, 3.30 [20:43:22] RECOVERY - mw121 MediaWiki Rendering on mw121 is OK: HTTP OK: HTTP/1.1 200 OK - 29514 bytes in 0.264 second response time [20:45:46] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.34, 3.71, 3.50 [20:51:42] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::4c25/cpweb [20:52:46] PROBLEM - mw122 MediaWiki Rendering on mw122 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:52:57] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 5.00, 3.88, 3.18 [20:53:41] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [20:53:50] PROBLEM - cp31 Stunnel HTTP for mw122 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:54:47] RECOVERY - mw122 MediaWiki Rendering on mw122 is OK: HTTP OK: HTTP/1.1 200 OK - 29514 bytes in 1.272 second response time [20:54:53] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.58, 3.72, 3.20 [20:55:24] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 1.97, 1.65, 1.48 [20:55:46] RECOVERY - cp31 Stunnel HTTP for mw122 on cp31 is OK: HTTP OK: HTTP/1.1 204 No Content - 352 bytes in 1.708 second response time [20:55:55] !log disable puppet on mw* and mwtask141 [20:56:05] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:56:39] PROBLEM - gametheorywiki.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'gametheorywiki.org' expires in 15 day(s) (Sun 25 Sep 2022 20:40:02 GMT +0000). [20:57:24] PROBLEM - test131 Current Load on test131 is CRITICAL: CRITICAL - load average: 3.00, 2.13, 1.68 [20:57:29] PROBLEM - mwtask141 Puppet on mwtask141 is WARNING: WARNING: Puppet is currently disabled, message: Universal Omega, last run 16 minutes ago with 0 failures [20:57:32] PROBLEM - mw121 Puppet on mw121 is WARNING: WARNING: Puppet is currently disabled, message: Universal Omega, last run 16 minutes ago with 0 failures [20:57:37] PROBLEM - mw142 Puppet on mw142 is WARNING: WARNING: Puppet is currently disabled, message: Universal Omega, last run 27 minutes ago with 0 failures [20:57:38] PROBLEM - mw131 Puppet on mw131 is WARNING: WARNING: Puppet is currently disabled, message: Universal Omega, last run 16 minutes ago with 0 failures [20:57:50] PROBLEM - mw141 Puppet on mw141 is WARNING: WARNING: Puppet is currently disabled, message: Universal Omega, last run 22 minutes ago with 0 failures [20:58:37] PROBLEM - mw122 Puppet on mw122 is WARNING: WARNING: Puppet is currently disabled, message: Universal Omega, last run 24 minutes ago with 0 failures [20:58:44] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 4.44, 3.92, 3.38 [20:58:56] PROBLEM - mw132 Puppet on mw132 is WARNING: WARNING: Puppet is currently disabled, message: Universal Omega, last run 23 minutes ago with 0 failures [20:59:46] PROBLEM - atnarsia.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'atnarsia.com' expires in 15 day(s) (Sun 25 Sep 2022 20:45:25 GMT +0000). [21:00:38] PROBLEM - test131 Puppet on test131 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [21:00:40] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.44, 3.60, 3.32 [21:02:36] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 2.11, 3.26, 3.24 [21:03:44] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/328c6bfd0260...15838535f5c1 [21:03:44] [url] Comparing 328c6bfd0260...15838535f5c1 · miraheze/ssl · GitHub | github.com [21:03:45] [02miraheze/ssl] 07MirahezeSSLBot 031583853 - Bot: Update SSL cert for gametheorywiki.org [21:04:39] RECOVERY - test131 Puppet on test131 is OK: OK: Puppet is currently enabled, last run 23 seconds ago with 0 failures [21:06:32] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.62, 3.64, 3.41 [21:09:57] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/15838535f5c1...f62e8cc3d592 [21:09:58] [url] Comparing 15838535f5c1...f62e8cc3d592 · miraheze/ssl · GitHub | github.com [21:09:59] [02miraheze/ssl] 07MirahezeSSLBot 03f62e8cc - Bot: Update SSL cert for atnarsia.com [21:11:24] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 1.24, 1.75, 1.88 [21:12:32] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 2.45, 3.24, 3.38 [21:15:24] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 0.90, 1.33, 1.68 [21:18:59] PROBLEM - cp30 Stunnel HTTP for mw121 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:23:06] RECOVERY - cp30 Stunnel HTTP for mw121 on cp30 is OK: HTTP OK: HTTP/1.1 204 No Content - 352 bytes in 5.891 second response time [21:23:26] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 4.36, 3.86, 3.51 [21:25:22] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.63, 3.72, 3.50 [21:26:16] RECOVERY - gametheorywiki.org - LetsEncrypt on sslhost is OK: OK - Certificate 'gametheorywiki.org' will expire on Thu 08 Dec 2022 20:03:38 GMT +0000. [21:27:17] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 5.19, 4.05, 3.63 [21:27:31] PROBLEM - wiki.virtualjet.net - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.virtualjet.net' expires in 15 day(s) (Sun 25 Sep 2022 21:20:59 GMT +0000). [21:29:13] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.22, 3.70, 3.55 [21:29:25] RECOVERY - atnarsia.com - LetsEncrypt on sslhost is OK: OK - Certificate 'atnarsia.com' will expire on Thu 08 Dec 2022 20:09:51 GMT +0000. [21:31:09] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 4.19, 3.68, 3.55 [21:33:05] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.88, 3.78, 3.61 [21:33:22] !log re-enable puppet on mw* and mwtask141 [21:33:29] RECOVERY - mwtask141 Puppet on mwtask141 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [21:33:30] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:33:32] RECOVERY - mw121 Puppet on mw121 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [21:33:37] RECOVERY - mw142 Puppet on mw142 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [21:33:38] RECOVERY - mw131 Puppet on mw131 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [21:33:46] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.98, 3.32, 3.98 [21:33:50] RECOVERY - mw141 Puppet on mw141 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [21:33:59] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/f62e8cc3d592...8b1dae8759a3 [21:34:00] [url] Comparing f62e8cc3d592...8b1dae8759a3 · miraheze/ssl · GitHub | github.com [21:34:01] [02miraheze/ssl] 07MirahezeSSLBot 038b1dae8 - Bot: Update SSL cert for wiki.virtualjet.net [21:34:37] RECOVERY - mw122 Puppet on mw122 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [21:34:56] RECOVERY - mw132 Puppet on mw132 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [21:35:46] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.40, 3.45, 3.92 [21:38:52] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 3.04, 3.15, 3.36 [21:41:46] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.97, 3.57, 3.86 [21:42:46] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.84, 3.84, 3.62 [21:46:45] [02miraheze/puppet] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/413ea24d7904...03aaa23e6e25 [21:46:46] [url] Comparing 413ea24d7904...03aaa23e6e25 · miraheze/puppet · GitHub | github.com [21:46:47] [02miraheze/puppet] 07Universal-Omega 0303aaa23 - prometheus-es-exporter: allow querying by host and level [21:52:32] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 4.23, 3.69, 3.59 [21:54:32] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 2.59, 3.35, 3.49 [21:56:32] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 4.21, 3.66, 3.58 [21:57:24] RECOVERY - wiki.virtualjet.net - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.virtualjet.net' will expire on Thu 08 Dec 2022 20:33:54 GMT +0000. [21:57:46] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.67, 3.44, 3.52 [21:58:32] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.79, 3.62, 3.57 [21:58:37] PROBLEM - es131 Puppet on es131 is WARNING: WARNING: Puppet is currently disabled, message: reason not specified, last run 11 minutes ago with 0 failures [21:59:46] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.03, 3.20, 3.42 [22:01:46] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.45, 3.00, 3.33 [22:05:46] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.57, 4.16, 3.71 [22:08:32] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 1.78, 2.85, 3.27 [22:15:46] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.49, 3.91, 3.87 [22:17:46] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 7.85, 5.34, 4.39 [22:25:46] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.58, 3.59, 3.93 [22:28:37] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.40, 10.30, 11.97 [22:29:24] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 1.87, 1.70, 1.49 [22:30:39] [02miraheze/puppet] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/03aaa23e6e25...8f1241fe3235 [22:30:40] [url] Comparing 03aaa23e6e25...8f1241fe3235 · miraheze/puppet · GitHub | github.com [22:30:41] [02miraheze/puppet] 07Universal-Omega 038f1241f - prometheus-es-exporter: use host as top level [22:31:24] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 1.55, 1.60, 1.47 [22:32:03] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.91, 9.80, 11.50 [22:32:20] [02miraheze/puppet] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/8f1241fe3235...14fb192baa14 [22:32:21] [url] Comparing 8f1241fe3235...14fb192baa14 · miraheze/puppet · GitHub | github.com [22:32:22] [02miraheze/puppet] 07Universal-Omega 0314fb192 - use api_module for name [22:32:37] RECOVERY - es131 Puppet on es131 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [22:34:14] [02miraheze/puppet] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/14fb192baa14...2c2d745ca885 [22:34:14] [url] Comparing 14fb192baa14...2c2d745ca885 · miraheze/puppet · GitHub | github.com [22:34:15] [02miraheze/puppet] 07Universal-Omega 032c2d745 - move level into channel [22:34:37] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.93, 11.25, 11.79 [22:39:24] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 1.83, 1.70, 1.56 [22:40:03] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.48, 11.31, 11.43 [22:41:46] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.40, 2.89, 3.36 [22:43:24] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 1.68, 1.70, 1.58 [22:44:37] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.53, 10.80, 11.73 [22:46:03] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.33, 11.14, 11.51 [22:52:02] [02miraheze/puppet] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/2c2d745ca885...efdb96201574 [22:52:03] [url] Comparing 2c2d745ca885...efdb96201574 · miraheze/puppet · GitHub | github.com [22:52:04] [02miraheze/puppet] 07Universal-Omega 03efdb962 - prometheus-es-exporter: allow api modules outside of host [22:54:03] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.14, 10.91, 11.16 [22:56:29] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.62, 3.48, 3.33 [22:58:27] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.74, 4.02, 3.55 [22:58:37] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.69, 11.63, 11.26 [23:02:08] [02miraheze/puppet] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/efdb96201574...d6fe1406af79 [23:02:08] [url] Comparing efdb96201574...d6fe1406af79 · miraheze/puppet · GitHub | github.com [23:02:09] [02miraheze/puppet] 07Universal-Omega 03d6fe140 - prometheus-es-exporter: allow level outside host or channel [23:30:01] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.06, 3.43, 3.15 [23:31:57] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 2.73, 3.11, 3.06 [23:37:47] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.44, 3.19, 3.08 [23:39:43] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 4.37, 3.54, 3.21 [23:41:04] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::1b80/cpweb [23:41:39] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.96, 3.53, 3.24 [23:45:00] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [23:45:30] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 2.75, 3.31, 3.24 [23:45:46] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.80, 3.48, 3.95 [23:55:46] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.64, 2.80, 3.38 [23:58:37] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.84, 11.03, 11.96 [23:59:46] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.37, 3.41, 3.52