[00:01:05] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.78, 1.86, 1.56 [00:03:10] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.26, 1.71, 1.39 [00:04:59] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.41, 1.91, 1.68 [00:05:10] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.78, 1.30, 1.27 [00:05:25] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 13.39, 11.72, 11.42 [00:07:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.41, 11.43, 11.34 [00:12:47] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.32, 1.69, 1.67 [00:19:25] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 14.89, 12.01, 11.44 [00:21:51] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.27, 1.86, 1.35 [00:22:37] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.98, 1.87, 1.75 [00:23:51] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.38, 1.61, 1.32 [00:24:34] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.25, 1.98, 1.80 [00:26:31] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.53, 1.81, 1.76 [00:27:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.72, 11.18, 11.44 [00:28:28] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.98, 1.48, 1.64 [00:33:25] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 13.15, 11.32, 11.30 [00:33:51] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.08, 1.77, 1.50 [00:37:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.35, 11.84, 11.55 [00:39:25] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.94, 11.87, 11.58 [00:43:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.28, 11.51, 11.50 [00:45:51] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.90, 1.97, 1.82 [00:47:51] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.82, 2.26, 1.94 [00:50:36] PROBLEM - db121 Current Load on db121 is CRITICAL: CRITICAL - load average: 10.45, 6.91, 3.80 [00:50:56] PROBLEM - cp31 Stunnel HTTP for mw102 on cp31 is CRITICAL: HTTP CRITICAL - No data received from host [00:51:00] PROBLEM - cp31 Stunnel HTTP for mw112 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:51:01] PROBLEM - cp31 Stunnel HTTP for mw111 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:51:06] PROBLEM - cp31 Stunnel HTTP for mw121 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:51:07] PROBLEM - mw101 MediaWiki Rendering on mw101 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:51:09] PROBLEM - cp30 Stunnel HTTP for mw121 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:51:15] PROBLEM - cp20 Stunnel HTTP for mw121 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:51:21] PROBLEM - mw102 MediaWiki Rendering on mw102 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:51:25] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 6.45, 7.77, 9.78 [00:51:38] PROBLEM - cp20 Stunnel HTTP for mw111 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:51:58] PROBLEM - mw111 MediaWiki Rendering on mw111 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:52:16] PROBLEM - cp21 Stunnel HTTP for mw111 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:52:46] PROBLEM - cp30 Stunnel HTTP for mw111 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:52:56] RECOVERY - cp31 Stunnel HTTP for mw102 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.329 second response time [00:52:59] RECOVERY - cp31 Stunnel HTTP for mw112 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.703 second response time [00:53:01] RECOVERY - cp31 Stunnel HTTP for mw121 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 0.440 second response time [00:53:01] RECOVERY - mw101 MediaWiki Rendering on mw101 is OK: HTTP OK: HTTP/1.1 200 OK - 28479 bytes in 0.376 second response time [00:53:05] RECOVERY - cp31 Stunnel HTTP for mw111 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 6.139 second response time [00:53:08] RECOVERY - cp30 Stunnel HTTP for mw121 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.340 second response time [00:53:12] RECOVERY - cp20 Stunnel HTTP for mw121 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.022 second response time [00:53:21] RECOVERY - mw102 MediaWiki Rendering on mw102 is OK: HTTP OK: HTTP/1.1 200 OK - 28479 bytes in 0.361 second response time [00:53:36] RECOVERY - cp20 Stunnel HTTP for mw111 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 3.093 second response time [00:53:50] PROBLEM - cp31 Varnish Backends on cp31 is CRITICAL: 1 backends are down. mw122 [00:53:56] RECOVERY - mw111 MediaWiki Rendering on mw111 is OK: HTTP OK: HTTP/1.1 200 OK - 28479 bytes in 0.455 second response time [00:53:57] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.94, 1.93, 1.80 [00:54:12] RECOVERY - cp21 Stunnel HTTP for mw111 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.019 second response time [00:54:36] PROBLEM - db121 Current Load on db121 is WARNING: WARNING - load average: 7.44, 7.31, 4.70 [00:54:42] RECOVERY - cp30 Stunnel HTTP for mw111 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.316 second response time [00:55:10] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.45, 1.74, 1.58 [00:55:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.54, 9.67, 10.12 [00:55:50] RECOVERY - cp31 Varnish Backends on cp31 is OK: All 14 backends are healthy [00:56:36] PROBLEM - db121 Current Load on db121 is CRITICAL: CRITICAL - load average: 8.28, 7.55, 5.10 [00:57:09] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.03, 1.55, 1.53 [00:57:25] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.70, 9.01, 9.83 [00:57:51] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.00, 1.58, 1.69 [00:58:36] RECOVERY - db121 Current Load on db121 is OK: OK - load average: 3.71, 6.37, 4.99 [01:08:04] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.49, 10.87, 10.45 [01:11:53] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.45, 11.54, 10.79 [01:13:33] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.28, 2.07, 1.80 [01:13:48] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.35, 10.70, 10.57 [01:15:33] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.98, 1.97, 1.79 [01:19:33] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.40, 1.61, 1.69 [01:21:26] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.95, 11.79, 11.05 [01:23:33] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.35, 1.86, 1.75 [01:27:33] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.38, 1.65, 1.69 [01:27:51] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.46, 1.74, 1.98 [01:31:33] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.10, 1.94, 1.82 [01:33:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.30, 11.90, 11.66 [01:33:33] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.76, 1.91, 1.82 [01:35:25] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 15.22, 13.15, 12.15 [01:37:51] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.36, 1.48, 1.70 [01:39:33] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.07, 1.88, 1.84 [01:43:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.45, 11.07, 11.75 [01:45:33] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.48, 1.88, 1.88 [01:47:05] PROBLEM - matomo101 Current Load on matomo101 is WARNING: WARNING - load average: 3.50, 3.37, 2.97 [01:49:00] RECOVERY - matomo101 Current Load on matomo101 is OK: OK - load average: 3.24, 3.28, 2.98 [01:49:33] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.35, 2.10, 1.97 [01:49:51] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.37, 1.78, 1.68 [01:51:25] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 13.25, 11.35, 11.42 [01:52:26] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 10.76, 9.28, 8.66 [01:54:26] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.64, 8.54, 8.46 [01:55:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.18, 11.77, 11.63 [01:55:51] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.72, 1.88, 1.80 [01:59:25] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.37, 11.72, 11.60 [01:59:51] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.36, 1.52, 1.66 [01:59:58] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.18, 1.72, 1.39 [02:01:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.53, 11.00, 11.34 [02:01:56] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.50, 1.59, 1.38 [02:03:25] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 14.03, 12.25, 11.76 [02:07:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.85, 10.70, 11.27 [02:11:25] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.36, 10.91, 11.20 [02:13:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.67, 10.93, 11.18 [02:17:51] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.74, 1.99, 1.68 [02:19:33] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 0.79, 1.41, 1.91 [02:21:25] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.06, 10.62, 10.74 [02:21:33] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 5.38, 2.29, 2.14 [02:23:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.42, 10.56, 10.71 [02:27:17] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 3.31, 2.65, 1.82 [02:27:25] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 13.57, 11.73, 11.09 [02:31:12] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.51, 1.96, 1.71 [02:31:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.40, 11.85, 11.32 [02:31:33] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.24, 1.72, 1.96 [02:33:25] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.73, 12.06, 11.46 [02:33:33] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 3.43, 2.05, 2.03 [02:35:10] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.05, 1.59, 1.62 [02:35:33] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.14, 1.62, 1.87 [02:37:42] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.89, 5.67, 4.10 [02:39:09] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.11, 1.75, 1.73 [02:39:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.82, 11.58, 11.66 [02:39:42] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 11.10, 7.48, 4.95 [02:43:10] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.18, 1.58, 1.67 [02:43:33] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.24, 1.41, 1.70 [02:46:25] [02mw-config] 07Universal-Omega closed pull request 03#4830: Fix default for `$wgRCMaxAge` - 13https://github.com/miraheze/mw-config/pull/4830 [02:46:26] [url] Page not found · GitHub · GitHub | github.com [02:46:27] [02mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-2 - 13https://github.com/miraheze/mw-config [02:46:28] ... [02:46:29] [02miraheze/mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-2 [02:51:25] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 8.95, 8.99, 10.02 [02:53:33] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.75, 1.63, 1.65 [02:53:41] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 4.25, 7.55, 6.95 [02:55:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.54, 10.18, 10.28 [02:55:33] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.36, 2.07, 1.82 [02:55:41] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 2.90, 5.99, 6.45 [02:59:33] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.68, 1.92, 1.81 [03:03:25] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.07, 11.26, 10.70 [03:05:33] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.39, 1.55, 1.69 [03:07:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.41, 11.92, 11.16 [03:10:49] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.16, 1.82, 1.60 [03:11:25] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 13.61, 12.25, 11.42 [03:13:51] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.40, 1.63, 1.93 [03:14:44] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.87, 1.46, 1.52 [03:15:33] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.04, 1.97, 1.77 [03:17:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.99, 11.53, 11.45 [03:17:33] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.14, 1.66, 1.68 [03:17:51] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.12, 1.75, 1.90 [03:21:33] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.39, 1.95, 1.79 [03:23:25] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 13.65, 12.12, 11.63 [03:23:33] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.36, 1.75, 1.74 [03:23:51] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.49, 1.89, 1.95 [03:25:33] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 3.61, 2.29, 1.93 [03:27:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.16, 10.73, 11.24 [03:29:33] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.03, 1.91, 1.88 [03:29:51] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.03, 1.36, 1.70 [03:33:33] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 5.20, 3.01, 2.26 [03:39:25] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 5.95, 8.36, 9.84 [03:41:33] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.88, 1.90, 2.00 [03:45:33] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.42, 2.07, 2.03 [03:47:33] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.05, 1.81, 1.95 [03:53:33] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.16, 1.92, 1.95 [03:55:33] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.48, 1.85, 1.93 [03:57:33] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 4.81, 3.06, 2.36 [04:04:08] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.20, 1.90, 1.69 [04:05:33] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.49, 1.77, 1.97 [04:05:53] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.18, 9.77, 9.43 [04:07:48] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.42, 8.87, 9.14 [04:11:33] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.07, 1.24, 1.65 [04:18:11] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.25, 1.83, 1.42 [04:20:08] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.50, 1.70, 1.42 [04:23:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.42, 9.62, 9.29 [04:25:25] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 10.09, 9.92, 9.45 [04:25:33] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 4.77, 2.46, 1.82 [04:27:33] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.49, 1.95, 1.71 [04:29:33] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.19, 1.62, 1.62 [04:43:33] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.03, 2.03, 1.73 [04:45:33] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.73, 1.56, 1.60 [04:47:51] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.19, 1.67, 1.96 [04:49:58] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.09, 9.96, 9.57 [04:51:51] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 0.18, 1.01, 1.63 [04:53:33] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.49, 1.93, 1.68 [04:53:47] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.40, 11.07, 10.11 [04:55:33] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.28, 1.65, 1.61 [05:01:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 7.62, 10.70, 10.62 [05:09:25] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 8.96, 9.64, 10.16 [05:23:17] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.88, 1.81, 1.49 [05:27:11] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.25, 1.53, 1.45 [05:58:38] [02miraheze/mediawiki] 07Reception123 pushed 031 commit to 03REL1_38 [+1/-0/±1] 13https://github.com/miraheze/mediawiki/compare/77fd6df63fea...eadf35060a0b [05:58:38] [url] Comparing 77fd6df63fea...eadf35060a0b · miraheze/mediawiki · GitHub | github.com [05:58:39] [02miraheze/mediawiki] 07Reception123 03eadf350 - Install PageProperties (T9432) [05:58:59] [02miraheze/mediawiki] 07Reception123 pushed 031 commit to 03REL1_38 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/eadf35060a0b...dae8a8c5442a [05:59:00] [url] Comparing eadf35060a0b...dae8a8c5442a · miraheze/mediawiki · GitHub | github.com [05:59:01] [02miraheze/mediawiki] 07Reception123 03dae8a8c - ignore dirty [06:07:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.80, 9.72, 8.68 [06:07:51] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.29, 1.65, 1.15 [06:09:25] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 8.10, 9.24, 8.64 [06:13:22] [02miraheze/mw-config] 07Reception123 pushed 031 commit to 03Reception123-patch-4 [+0/-0/±2] 13https://github.com/miraheze/mw-config/commit/b221d89d571d [06:13:23] [02miraheze/mw-config] 07Reception123 03b221d89 - add PageProperties ext. per T9432 [06:13:25] [02mw-config] 07Reception123 created branch 03Reception123-patch-4 - 13https://github.com/miraheze/mw-config [06:13:25] [url] Page not found · GitHub · GitHub | github.com [06:13:32] [02mw-config] 07Reception123 opened pull request 03#4831: add PageProperties ext. per T9432 - 13https://github.com/miraheze/mw-config/pull/4831 [06:13:32] [url] Page not found · GitHub · GitHub | github.com [06:14:15] [02miraheze/mw-config] 07github-actions[bot] pushed 031 commit to 03Reception123-patch-4 [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/b221d89d571d...f0d20ca21d74 [06:14:15] [url] Comparing b221d89d571d...f0d20ca21d74 · miraheze/mw-config · GitHub | github.com [06:14:16] [02miraheze/mw-config] 07github-actions 03f0d20ca - CI: lint code to MediaWiki standards [06:14:18] [02mw-config] 07github-actions[bot] synchronize pull request 03#4831: add PageProperties ext. per T9432 - 13https://github.com/miraheze/mw-config/pull/4831 [06:14:18] [url] Page not found · GitHub · GitHub | github.com [06:14:55] miraheze/mw-config - Reception123 the build passed. [06:15:46] [02mw-config] 07Universal-Omega commented on pull request 03#4831: add PageProperties ext. per T9432 - 13https://github.com/miraheze/mw-config/pull/4831#issuecomment-1200100029 [06:15:47] [url] add PageProperties ext. per T9432 by Reception123 · Pull Request #4831 · miraheze/mw-config · GitHub | github.com [06:15:49] !log [reception@test101] starting deploy of {'config': True, 'world': True, 'l10n': True} to all [06:15:54] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:16:52] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.61, 3.46, 3.94 [06:17:53] [02mw-config] 07Reception123 synchronize pull request 03#4831: add PageProperties ext. per T9432 - 13https://github.com/miraheze/mw-config/pull/4831 [06:17:53] [url] Page not found · GitHub · GitHub | github.com [06:17:55] [02miraheze/mw-config] 07Reception123 pushed 031 commit to 03Reception123-patch-4 [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/f0d20ca21d74...1dde8d9858a6 [06:17:55] [url] Comparing f0d20ca21d74...1dde8d9858a6 · miraheze/mw-config · GitHub | github.com [06:17:56] [02miraheze/mw-config] 07Reception123 031dde8d9 - Update ManageWikiExtensions.php [06:18:11] [02mw-config] 07Reception123 synchronize pull request 03#4831: add PageProperties ext. per T9432 - 13https://github.com/miraheze/mw-config/pull/4831 [06:18:11] [url] Page not found · GitHub · GitHub | github.com [06:18:12] [02miraheze/mw-config] 07Reception123 pushed 031 commit to 03Reception123-patch-4 [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/1dde8d9858a6...ed977f58625d [06:18:13] [url] Comparing 1dde8d9858a6...ed977f58625d · miraheze/mw-config · GitHub | github.com [06:18:14] [02miraheze/mw-config] 07Reception123 03ed977f5 - whoops [06:19:07] miraheze/mw-config - Reception123 the build passed. [06:19:18] miraheze/mw-config - Reception123 the build passed. [06:20:52] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.57, 3.85, 3.97 [06:22:52] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.02, 3.57, 3.85 [06:25:53] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.43, 10.76, 9.76 [06:27:02] !log [@test101] starting deploy of {'config': True} to all [06:27:04] !log [@test101] finished deploy of {'config': True} to all - SUCCESS in 1s [06:27:10] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:27:18] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:28:52] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.63, 3.68, 3.74 [06:29:17] PROBLEM - cp21 Current Load on cp21 is WARNING: WARNING - load average: 1.38, 1.80, 1.48 [06:29:42] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 8.59, 10.17, 9.78 [06:30:52] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.67, 3.67, 3.73 [06:31:15] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 0.94, 1.55, 1.43 [06:32:52] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.63, 3.88, 3.79 [06:33:32] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.14, 10.89, 10.13 [06:37:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.11, 10.58, 10.20 [06:41:22] !log [reception@test101] finished deploy of {'config': True, 'world': True, 'l10n': True} to all - SUCCESS in 1533s [06:41:29] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:44:00] !log [reception@test101] starting deploy of {'config': True} to all [06:44:03] !log [reception@test101] finished deploy of {'config': True} to all - SUCCESS in 2s [06:44:05] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:44:09] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:45:25] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 9.15, 10.04, 10.16 [06:49:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.18, 10.22, 10.22 [06:53:25] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.87, 11.24, 10.62 [06:53:35] !log [@test101] starting deploy of {'config': True} to all [06:53:37] !log [@test101] finished deploy of {'config': True} to all - SUCCESS in 1s [06:53:40] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:53:47] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:54:32] PROBLEM - mwtask111 Current Load on mwtask111 is CRITICAL: CRITICAL - load average: 4.43, 3.42, 2.31 [06:55:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.32, 11.32, 10.74 [06:58:32] RECOVERY - mwtask111 Current Load on mwtask111 is OK: OK - load average: 2.53, 3.27, 2.54 [07:09:25] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.39, 9.01, 9.89 [07:24:24] !log [@test101] starting deploy of {'config': True} to all [07:24:25] !log [@test101] finished deploy of {'config': True} to all - SUCCESS in 0s [07:24:29] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:24:33] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:28:52] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.51, 3.45, 3.94 [07:34:52] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.01, 3.60, 3.82 [07:38:52] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.54, 3.32, 3.67 [07:44:34] PROBLEM - cp21 Current Load on cp21 is WARNING: WARNING - load average: 1.80, 1.60, 1.35 [07:46:32] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 1.44, 1.51, 1.35 [07:47:35] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 1.91, 3.28, 3.91 [07:48:52] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.42, 4.30, 3.94 [07:49:35] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 3.90, 3.74, 4.01 [07:50:52] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.13, 3.97, 3.88 [07:52:52] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.01, 4.50, 4.09 [07:53:20] !log [@test101] starting deploy of {'config': True} to all [07:53:22] !log [@test101] finished deploy of {'config': True} to all - SUCCESS in 2s [07:53:26] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:53:32] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:56:52] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.74, 3.89, 3.97 [08:00:52] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.35, 3.99, 3.99 [08:22:48] !log [@test101] starting deploy of {'config': True} to all [08:22:49] !log [@test101] finished deploy of {'config': True} to all - SUCCESS in 0s [08:22:53] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [08:22:58] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [08:43:51] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.10, 1.29, 1.91 [08:47:51] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.06, 1.50, 1.84 [08:50:35] !log [@test101] starting deploy of {'config': True} to all [08:50:36] !log [@test101] finished deploy of {'config': True} to all - SUCCESS in 0s [08:50:41] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [08:50:52] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [08:51:51] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.89, 1.89, 1.94 [08:57:51] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.15, 1.40, 1.70 [09:14:59] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CRITICAL - load average: 2.37, 1.64, 1.30 [09:15:51] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.59, 2.05, 1.75 [09:18:56] PROBLEM - cp21 Current Load on cp21 is WARNING: WARNING - load average: 1.50, 1.79, 1.45 [09:20:54] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 1.18, 1.49, 1.37 [09:20:56] !log [@test101] starting deploy of {'config': True} to all [09:20:57] !log [@test101] finished deploy of {'config': True} to all - SUCCESS in 0s [09:21:00] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [09:21:05] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [09:33:39] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CRITICAL - load average: 3.40, 2.35, 1.77 [09:35:37] PROBLEM - cp21 Current Load on cp21 is WARNING: WARNING - load average: 1.52, 1.95, 1.69 [09:39:33] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 1.39, 1.62, 1.61 [09:50:12] !log [@test101] starting deploy of {'config': True} to all [09:50:14] !log [@test101] finished deploy of {'config': True} to all - SUCCESS in 0s [09:50:17] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [09:50:22] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [09:58:11] PROBLEM - cp21 Current Load on cp21 is WARNING: WARNING - load average: 1.71, 1.66, 1.62 [10:00:09] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CRITICAL - load average: 5.06, 2.39, 1.86 [10:04:05] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 0.80, 1.61, 1.67 [10:04:52] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.07, 3.42, 3.92 [10:07:51] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.32, 1.63, 1.93 [10:10:52] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.30, 3.59, 3.81 [10:15:51] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.33, 1.36, 1.66 [10:19:51] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.60, 2.00, 1.85 [10:20:50] !log [@test101] starting deploy of {'config': True} to all [10:20:52] !log [@test101] finished deploy of {'config': True} to all - SUCCESS in 1s [10:20:52] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.93, 3.93, 3.99 [10:20:55] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [10:21:00] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [10:23:51] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.45, 1.93, 1.88 [10:26:52] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.05, 3.82, 3.88 [10:27:38] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CRITICAL - load average: 2.49, 2.28, 1.81 [10:28:52] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.98, 3.78, 3.85 [10:29:36] PROBLEM - cp21 Current Load on cp21 is WARNING: WARNING - load average: 0.91, 1.72, 1.66 [10:29:51] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.29, 1.45, 1.67 [10:31:34] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 0.61, 1.36, 1.54 [10:37:35] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.46, 3.71, 3.96 [10:39:25] PROBLEM - cp21 Current Load on cp21 is WARNING: WARNING - load average: 1.72, 1.96, 1.78 [10:41:35] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.69, 3.86, 3.93 [10:42:52] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.70, 3.00, 3.39 [10:43:35] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.39, 3.61, 3.83 [10:45:20] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 0.91, 1.50, 1.64 [10:46:32] PROBLEM - eng.archiopedia.org - reverse DNS on sslhost is WARNING: SSL WARNING - rDNS OK but records conflict. {'NS': ['dns032.b.register.com.', 'dns179.a.register.com.', 'dns083.d.register.com.', 'dns025.c.register.com.'], 'CNAME': None} [10:46:52] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.72, 3.52, 3.52 [10:49:51] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.85, 1.73, 1.61 [10:49:58] !log [@test101] starting deploy of {'config': True} to all [10:49:59] !log [@test101] finished deploy of {'config': True} to all - SUCCESS in 0s [10:50:07] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [10:50:12] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [10:53:09] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CRITICAL - load average: 1.13, 2.12, 1.92 [10:53:35] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.31, 3.83, 3.74 [10:53:51] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.39, 1.60, 1.60 [10:56:52] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.90, 3.20, 3.37 [10:57:35] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.35, 3.79, 3.77 [10:59:03] PROBLEM - cp21 Current Load on cp21 is WARNING: WARNING - load average: 1.49, 1.94, 1.92 [10:59:51] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.34, 1.91, 1.71 [11:00:52] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 8.21, 4.92, 3.97 [11:01:01] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CRITICAL - load average: 3.38, 2.19, 2.00 [11:01:35] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.02, 3.80, 3.77 [11:02:16] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.32, 1.59, 1.15 [11:04:58] PROBLEM - cp21 Current Load on cp21 is WARNING: WARNING - load average: 1.23, 1.71, 1.84 [11:06:11] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 0.94, 1.42, 1.19 [11:06:56] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CRITICAL - load average: 5.02, 2.47, 2.07 [11:08:54] PROBLEM - cp21 Current Load on cp21 is WARNING: WARNING - load average: 1.53, 1.97, 1.93 [11:09:51] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.97, 2.00, 1.89 [11:10:52] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CRITICAL - load average: 2.30, 2.17, 2.01 [11:11:51] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.07, 2.00, 1.91 [11:14:48] PROBLEM - cp21 Current Load on cp21 is WARNING: WARNING - load average: 1.60, 1.95, 1.96 [11:16:03] RECOVERY - eng.archiopedia.org - reverse DNS on sslhost is OK: SSL OK - eng.archiopedia.org reverse DNS resolves to cp20.miraheze.org - CNAME OK [11:16:47] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CRITICAL - load average: 2.44, 2.23, 2.07 [11:17:55] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.95, 1.99, 1.48 [11:19:52] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 0.89, 1.56, 1.38 [11:20:42] !log [@test101] starting deploy of {'config': True} to all [11:20:43] PROBLEM - cp21 Current Load on cp21 is WARNING: WARNING - load average: 1.93, 1.99, 1.99 [11:20:43] !log [@test101] finished deploy of {'config': True} to all - SUCCESS in 0s [11:20:47] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [11:20:55] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [11:26:37] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CRITICAL - load average: 3.54, 2.43, 2.10 [11:28:35] PROBLEM - cp21 Current Load on cp21 is WARNING: WARNING - load average: 1.38, 1.99, 1.98 [11:30:34] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CRITICAL - load average: 1.62, 2.31, 2.13 [11:34:30] PROBLEM - cp21 Current Load on cp21 is WARNING: WARNING - load average: 1.18, 1.72, 1.93 [11:38:03] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.17, 10.89, 9.58 [11:39:58] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 8.62, 9.99, 9.40 [11:40:52] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.98, 3.72, 3.98 [11:42:23] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CRITICAL - load average: 2.74, 1.83, 1.86 [11:43:48] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.78, 10.30, 9.68 [11:44:21] PROBLEM - cp21 Current Load on cp21 is WARNING: WARNING - load average: 1.21, 1.54, 1.75 [11:44:52] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.29, 4.12, 4.04 [11:45:35] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.72, 3.58, 4.00 [11:45:42] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 9.65, 10.06, 9.66 [11:47:35] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.13, 4.18, 4.17 [11:48:17] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 0.84, 1.40, 1.65 [11:50:04] !log [@test101] starting deploy of {'config': True} to all [11:50:05] !log [@test101] finished deploy of {'config': True} to all - SUCCESS in 0s [11:50:10] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [11:50:14] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [11:51:26] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.17, 10.81, 10.03 [11:53:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.97, 10.47, 10.01 [11:55:35] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.55, 3.34, 3.83 [11:58:04] PROBLEM - cp21 Current Load on cp21 is WARNING: WARNING - load average: 1.26, 1.64, 1.71 [11:58:52] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.96, 3.59, 3.96 [11:59:25] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 10.07, 10.16, 10.03 [11:59:51] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.25, 1.60, 1.92 [12:00:02] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CRITICAL - load average: 2.13, 1.63, 1.68 [12:00:52] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.64, 3.89, 4.02 [12:02:01] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 1.35, 1.50, 1.63 [12:02:52] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.05, 3.54, 3.87 [12:07:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.77, 10.37, 10.10 [12:07:35] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.73, 3.91, 3.76 [12:09:51] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.36, 1.44, 1.69 [12:09:58] PROBLEM - cp21 Current Load on cp21 is WARNING: WARNING - load average: 1.76, 1.57, 1.55 [12:10:52] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.53, 3.91, 3.87 [12:11:35] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.73, 3.88, 3.79 [12:11:58] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 1.11, 1.47, 1.52 [12:12:52] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.39, 3.77, 3.82 [12:13:25] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 13.14, 11.53, 10.63 [12:13:35] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.18, 3.88, 3.80 [12:14:52] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 3.86, 4.02, 3.92 [12:15:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.59, 11.11, 10.59 [12:17:35] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.56, 3.70, 3.74 [12:18:52] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.04, 3.92, 3.94 [12:19:51] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.78, 2.24, 1.89 [12:20:20] !log [@test101] starting deploy of {'config': True} to all [12:20:22] !log [@test101] finished deploy of {'config': True} to all - SUCCESS in 2s [12:20:27] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:20:32] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:23:25] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 13.32, 11.50, 10.80 [12:23:51] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.26, 1.87, 1.84 [12:25:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.99, 11.73, 10.98 [12:27:51] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.18, 1.49, 1.69 [12:28:52] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.91, 2.95, 3.38 [12:29:35] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.17, 3.46, 3.55 [12:31:35] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.91, 3.41, 3.54 [12:35:35] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.33, 3.03, 3.37 [12:36:52] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.58, 3.17, 3.28 [12:38:52] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.83, 3.92, 3.54 [12:39:35] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.94, 3.90, 3.63 [12:40:52] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.61, 3.78, 3.54 [12:41:35] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.85, 3.95, 3.69 [12:42:52] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.81, 3.34, 3.40 [12:43:35] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.06, 4.07, 3.76 [12:43:51] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.48, 1.93, 1.67 [12:46:52] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.23, 3.57, 3.47 [12:50:51] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CRITICAL - load average: 5.64, 2.75, 1.86 [12:50:52] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.99, 3.92, 3.62 [12:51:09] !log [@test101] starting deploy of {'config': True} to all [12:51:10] !log [@test101] finished deploy of {'config': True} to all - SUCCESS in 0s [12:51:14] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:51:22] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:53:25] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.42, 11.15, 10.74 [12:56:52] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.24, 3.89, 3.64 [12:57:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.47, 11.62, 11.08 [12:58:52] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.59, 3.74, 3.61 [13:02:52] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.49, 3.85, 3.67 [13:03:35] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.33, 3.68, 3.90 [13:04:37] PROBLEM - cp21 Current Load on cp21 is WARNING: WARNING - load average: 0.96, 1.76, 1.88 [13:05:25] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.80, 11.52, 11.07 [13:06:52] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.10, 3.41, 3.58 [13:07:35] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.15, 3.91, 3.95 [13:09:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.05, 10.65, 10.84 [13:09:35] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.35, 3.60, 3.82 [13:10:32] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CRITICAL - load average: 2.12, 1.74, 1.80 [13:11:35] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.70, 3.82, 3.87 [13:12:30] PROBLEM - cp21 Current Load on cp21 is WARNING: WARNING - load average: 1.45, 1.66, 1.76 [13:13:14] PROBLEM - roblox-wiki.tk - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query roblox-wiki.tk. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [13:13:35] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.67, 3.60, 3.78 [13:15:35] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.79, 4.32, 4.01 [13:16:52] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.51, 3.83, 3.68 [13:18:25] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 1.35, 1.50, 1.66 [13:20:26] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 10.22, 9.35, 8.34 [13:20:51] !log [@test101] starting deploy of {'config': True} to all [13:20:52] !log [@test101] finished deploy of {'config': True} to all - SUCCESS in 0s [13:21:09] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [13:21:22] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [13:22:26] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 8.49, 8.87, 8.28 [13:23:19] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.76, 2.68, 1.74 [13:25:25] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.43, 11.65, 11.03 [13:27:14] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 0.62, 1.93, 1.68 [13:27:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.64, 11.31, 10.98 [13:28:13] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CRITICAL - load average: 2.06, 1.64, 1.61 [13:29:11] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 0.94, 1.59, 1.58 [13:29:34] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.29, 9.84, 9.02 [13:31:32] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.74, 9.22, 8.88 [13:32:10] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 0.88, 1.51, 1.59 [13:35:25] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 13.40, 12.08, 11.43 [13:37:51] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.50, 1.69, 1.96 [13:38:02] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CRITICAL - load average: 3.29, 2.47, 1.97 [13:41:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.78, 11.95, 11.72 [13:42:48] RECOVERY - roblox-wiki.tk - reverse DNS on sslhost is OK: SSL OK - roblox-wiki.tk reverse DNS resolves to cp21.miraheze.org - NS RECORDS OK [13:47:51] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.42, 1.92, 1.90 [13:47:58] PROBLEM - cp21 Current Load on cp21 is WARNING: WARNING - load average: 1.10, 1.82, 1.97 [13:48:45] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.92, 2.73, 1.85 [13:49:25] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.33, 10.71, 11.11 [13:50:22] !log [@test101] starting deploy of {'config': True} to all [13:50:23] !log [@test101] finished deploy of {'config': True} to all - SUCCESS in 1s [13:50:28] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [13:50:35] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [13:51:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.55, 11.11, 11.22 [13:52:40] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 0.89, 1.81, 1.67 [13:53:25] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.82, 11.57, 11.36 [13:53:58] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CRITICAL - load average: 2.31, 1.53, 1.74 [13:54:40] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.17, 1.60, 1.61 [13:57:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.38, 10.69, 11.13 [13:57:51] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.26, 1.68, 1.91 [14:01:25] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.37, 11.30, 11.29 [14:01:58] PROBLEM - cp21 Current Load on cp21 is WARNING: WARNING - load average: 1.29, 1.82, 1.88 [14:02:02] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.21, 10.86, 9.52 [14:04:02] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.26, 10.31, 9.49 [14:06:02] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 8.93, 9.72, 9.37 [14:07:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.76, 11.56, 11.48 [14:07:51] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.25, 1.46, 1.67 [14:07:58] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 0.75, 1.29, 1.63 [14:17:25] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 13.65, 11.28, 11.19 [14:19:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.01, 10.95, 11.08 [14:20:03] !log [@test101] starting deploy of {'config': True} to all [14:20:03] !log [@test101] finished deploy of {'config': True} to all - SUCCESS in 0s [14:20:21] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:20:26] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:21:25] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 13.45, 11.60, 11.28 [14:22:26] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 12.40, 10.05, 8.91 [14:23:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.23, 11.81, 11.43 [14:24:26] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 11.89, 10.50, 9.21 [14:26:26] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 9.26, 9.85, 9.12 [14:26:40] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.45, 1.99, 1.31 [14:27:43] [Grafana] FIRING: Some MediaWiki Appservers are running out of PHP-FPM workers. https://grafana.miraheze.org/d/GtxbP1Xnk [14:27:51] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.38, 1.91, 1.71 [14:28:40] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 0.73, 1.50, 1.21 [14:32:17] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.81, 10.15, 9.57 [14:32:43] [Grafana] RESOLVED: PHP-FPM Worker Usage High https://grafana.miraheze.org/d/GtxbP1Xnk [14:34:13] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 8.14, 9.35, 9.34 [14:35:25] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.17, 11.10, 10.96 [14:37:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.60, 10.53, 10.78 [14:39:33] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.15, 1.84, 1.39 [14:41:33] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.17, 1.53, 1.32 [14:45:25] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 10.20, 9.67, 10.20 [14:47:21] PROBLEM - cp21 Current Load on cp21 is WARNING: WARNING - load average: 1.62, 1.91, 1.69 [14:49:25] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 13.43, 11.34, 10.72 [14:50:41] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 11.41, 9.98, 9.00 [14:50:55] !log [@test101] starting deploy of {'config': True} to all [14:50:56] !log [@test101] finished deploy of {'config': True} to all - SUCCESS in 0s [14:51:01] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:51:06] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:51:17] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 1.19, 1.56, 1.61 [14:52:37] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 9.94, 9.71, 9.01 [14:55:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.29, 11.67, 11.13 [14:56:02] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 11.38, 10.31, 9.49 [14:56:31] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 10.88, 10.53, 9.51 [14:57:10] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CRITICAL - load average: 3.21, 2.32, 1.86 [14:58:26] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 8.78, 9.83, 9.37 [14:59:08] PROBLEM - cp21 Current Load on cp21 is WARNING: WARNING - load average: 1.67, 1.98, 1.78 [14:59:25] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 13.56, 12.33, 11.49 [15:02:02] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 14.14, 11.50, 10.16 [15:04:02] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.10, 10.67, 10.03 [15:06:02] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 8.46, 9.90, 9.82 [15:07:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.74, 11.46, 11.45 [15:08:58] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 1.13, 1.50, 1.67 [15:15:51] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.61, 1.78, 1.98 [15:17:51] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.74, 2.19, 2.11 [15:20:08] !log [@test101] starting deploy of {'config': True} to all [15:20:09] !log [@test101] finished deploy of {'config': True} to all - SUCCESS in 0s [15:20:15] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:20:20] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:21:25] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 13.71, 11.31, 10.92 [15:27:51] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.07, 1.58, 1.91 [15:31:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.74, 11.81, 11.61 [15:33:51] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.21, 1.34, 1.69 [15:35:25] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 14.24, 11.94, 11.62 [15:39:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.87, 11.50, 11.57 [15:47:51] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.55, 1.87, 1.65 [15:50:26] !log [@test101] starting deploy of {'config': True} to all [15:50:27] !log [@test101] finished deploy of {'config': True} to all - SUCCESS in 1s [15:50:33] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:50:39] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:51:25] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 13.54, 11.34, 11.06 [15:53:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.67, 10.77, 10.89 [15:53:51] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.15, 1.83, 1.76 [15:55:51] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.09, 1.58, 1.68 [15:57:25] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 13.88, 12.28, 11.44 [15:59:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.85, 11.02, 11.09 [16:02:05] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.85, 10.54, 9.41 [16:04:02] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 9.27, 9.97, 9.34 [16:05:12] !log created parsercache database on db121 [16:05:25] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 13.67, 11.43, 11.07 [16:05:41] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:06:41] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.50, 5.12, 3.10 [16:07:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.97, 10.82, 10.92 [16:11:51] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.28, 1.77, 1.59 [16:13:25] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 8.49, 8.94, 10.04 [16:18:22] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 0.51, 1.24, 1.95 [16:19:25] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.39, 10.73, 10.38 [16:20:29] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 10.72, 9.74, 8.76 [16:21:04] !log [@test101] starting deploy of {'config': True} to all [16:21:05] !log [@test101] finished deploy of {'config': True} to all - SUCCESS in 0s [16:21:09] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:21:14] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:21:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.41, 10.96, 10.51 [16:22:26] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 9.49, 9.56, 8.81 [16:24:13] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.85, 0.97, 1.60 [16:25:09] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-9 [+0/-0/±1] 13https://github.com/miraheze/puppet/commit/c177d708c8eb [16:25:10] [02miraheze/puppet] 07paladox 03c177d70 - mariadb: add grants for parsercache db [16:25:12] [02puppet] 07paladox created branch 03paladox-patch-9 - 13https://github.com/miraheze/puppet [16:25:12] [url] Page not found · GitHub · GitHub | github.com [16:25:13] [02puppet] 07paladox opened pull request 03#2714: mariadb: add grants for parsercache db - 13https://github.com/miraheze/puppet/pull/2714 [16:25:14] [url] Page not found · GitHub · GitHub | github.com [16:33:34] !log install nginx on cloud10 [16:33:38] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:35:25] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 14.09, 11.41, 10.75 [16:39:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.70, 10.96, 10.77 [16:41:31] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.15, 9.93, 9.06 [16:43:28] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.62, 9.58, 9.05 [16:48:39] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.61, 1.81, 1.45 [16:50:35] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.05, 1.54, 1.40 [16:50:58] !log [@test101] starting deploy of {'config': True} to all [16:50:59] !log [@test101] finished deploy of {'config': True} to all - SUCCESS in 0s [16:51:05] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:51:11] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:54:32] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.52, 1.73, 1.52 [16:58:26] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.08, 1.46, 1.47 [17:01:25] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 10.02, 9.80, 10.19 [17:03:51] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.59, 1.75, 1.97 [17:07:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.32, 10.50, 10.43 [17:11:25] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 8.69, 9.43, 10.01 [17:13:37] PROBLEM - roblox-wiki.tk - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query roblox-wiki.tk. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [17:13:51] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.13, 1.33, 1.66 [17:19:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.23, 10.21, 10.18 [17:19:51] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.30, 1.87, 1.78 [17:20:22] !log [@test101] starting deploy of {'config': True} to all [17:20:23] !log [@test101] finished deploy of {'config': True} to all - SUCCESS in 0s [17:20:27] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:20:32] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:21:25] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 9.98, 9.99, 10.10 [17:21:51] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.76, 1.94, 1.83 [17:25:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.31, 10.82, 10.42 [17:25:51] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.40, 1.54, 1.68 [17:29:25] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.44, 11.51, 10.77 [17:31:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.10, 11.08, 10.71 [17:35:25] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.79, 11.69, 11.02 [17:35:41] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.41, 1.74, 1.42 [17:37:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.27, 10.39, 10.60 [17:37:39] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.62, 1.64, 1.42 [17:43:11] PROBLEM - roblox-wiki.tk - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - roblox-wiki.tk All nameservers failed to answer the query. [17:43:28] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.91, 1.85, 1.56 [17:45:25] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.23, 9.26, 10.09 [17:50:23] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.99, 1.88, 1.58 [17:50:46] !log [@test101] starting deploy of {'config': True} to all [17:50:47] !log [@test101] finished deploy of {'config': True} to all - SUCCESS in 0s [17:50:52] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:50:58] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:51:18] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.03, 1.50, 1.53 [17:51:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.53, 10.66, 10.45 [17:54:16] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.95, 1.86, 1.65 [17:56:12] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.20, 1.97, 1.71 [17:59:25] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 9.30, 9.87, 10.14 [18:04:28] [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03dependabot/submodules/REL1_37/skins/chameleon-e08fffc [+0/-0/±1] 13https://github.com/miraheze/mediawiki/commit/7ed52f7fdf2b [18:04:29] [02miraheze/mediawiki] 07dependabot[bot] 037ed52f7 - Bump skins/chameleon from `a923c46` to `e08fffc` [18:04:31] [02miraheze/mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_37/skins/chameleon-e08fffc [18:04:32] [02mediawiki] 07Universal-Omega created branch 03dependabot/submodules/REL1_37/skins/chameleon-e08fffc - 13https://github.com/miraheze/mediawiki [18:04:33] [url] Page not found · GitHub · GitHub | github.com [18:04:34] [02mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_37/skins/chameleon-e08fffc - 13https://github.com/miraheze/mediawiki [18:04:34] ... [18:06:07] [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03dependabot/submodules/REL1_37/skins/chameleon-e08fffc [+0/-0/±1] 13https://github.com/miraheze/mediawiki/commit/7ed52f7fdf2b [18:06:08] [02miraheze/mediawiki] 07dependabot[bot] 037ed52f7 - Bump skins/chameleon from `a923c46` to `e08fffc` [18:06:10] [02mediawiki] 07Universal-Omega created branch 03dependabot/submodules/REL1_37/skins/chameleon-e08fffc - 13https://github.com/miraheze/mediawiki [18:06:10] ... [18:06:34] [02mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_37/skins/chameleon-e08fffc - 13https://github.com/miraheze/mediawiki [18:06:34] [url] Page not found · GitHub · GitHub | github.com [18:06:35] [02miraheze/mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_37/skins/chameleon-e08fffc [18:07:02] [02mediawiki] 07Universal-Omega commented on pull request 03#5522: Bump skins/chameleon from `a923c46` to `e08fffc` - 13https://github.com/miraheze/mediawiki/pull/5522#issuecomment-1200267586 [18:07:03] [url] Bump skins/chameleon from `a923c46` to `e08fffc` by dependabot[bot] · Pull Request #5522 · miraheze/mediawiki · GitHub | github.com [18:07:04] [02mediawiki] 07dependabot[bot] commented on pull request 03#5522: Bump skins/chameleon from `a923c46` to `e08fffc` - 13https://github.com/miraheze/mediawiki/pull/5522#issuecomment-1200267593 [18:07:04] [url] Bump skins/chameleon from `a923c46` to `e08fffc` by dependabot[bot] · Pull Request #5522 · miraheze/mediawiki · GitHub | github.com [18:07:24] [02mediawiki] 07Universal-Omega commented on pull request 03#5522: Bump skins/chameleon from `a923c46` to `e08fffc` - 13https://github.com/miraheze/mediawiki/pull/5522#issuecomment-1200267657 [18:07:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.47, 10.23, 10.16 [18:07:25] [url] Bump skins/chameleon from `a923c46` to `e08fffc` by dependabot[bot] · Pull Request #5522 · miraheze/mediawiki · GitHub | github.com [18:07:26] [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_37/skins/chameleon-e08fffc [+0/-0/±1] 13https://github.com/miraheze/mediawiki/commit/7ed52f7fdf2b [18:07:28] [02miraheze/mediawiki] 07dependabot[bot] 037ed52f7 - Bump skins/chameleon from `a923c46` to `e08fffc` [18:07:29] [02mediawiki] 07dependabot[bot] commented on pull request 03#5522: Bump skins/chameleon from `a923c46` to `e08fffc` - 13https://github.com/miraheze/mediawiki/pull/5522#issuecomment-1200267664 [18:07:29] [url] Bump skins/chameleon from `a923c46` to `e08fffc` by dependabot[bot] · Pull Request #5522 · miraheze/mediawiki · GitHub | github.com [18:07:31] [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_37/skins/chameleon-e08fffc - 13https://github.com/miraheze/mediawiki [18:07:31] [url] Page not found · GitHub · GitHub | github.com [18:07:41] [02miraheze/mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_37/skins/chameleon-e08fffc [18:07:43] [02mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_37/skins/chameleon-e08fffc - 13https://github.com/miraheze/mediawiki [18:07:43] [url] Page not found · GitHub · GitHub | github.com [18:12:45] RECOVERY - roblox-wiki.tk - reverse DNS on sslhost is OK: SSL OK - roblox-wiki.tk reverse DNS resolves to cp21.miraheze.org - NS RECORDS OK [18:13:25] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 9.63, 9.91, 10.14 [18:18:59] PROBLEM - cp31 Stunnel HTTP for mw112 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:19:10] PROBLEM - cp31 Stunnel HTTP for mw111 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:19:11] PROBLEM - mw122 MediaWiki Rendering on mw122 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 1595 bytes in 0.012 second response time [18:19:37] PROBLEM - cp31 Stunnel HTTP for mw122 on cp31 is CRITICAL: HTTP CRITICAL - No data received from host [18:20:01] PROBLEM - cp20 Stunnel HTTP for mw122 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:20:16] PROBLEM - cp21 Stunnel HTTP for mw111 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:20:26] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 11.87, 10.90, 9.35 [18:20:58] RECOVERY - cp31 Stunnel HTTP for mw112 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 0.321 second response time [18:21:08] RECOVERY - mw122 MediaWiki Rendering on mw122 is OK: HTTP OK: HTTP/1.1 200 OK - 28479 bytes in 0.333 second response time [18:21:09] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.50, 1.77, 1.54 [18:21:25] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.04, 11.32, 10.64 [18:21:34] RECOVERY - cp31 Stunnel HTTP for mw122 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 0.313 second response time [18:21:49] PROBLEM - cp30 Varnish Backends on cp30 is CRITICAL: 1 backends are down. mw122 [18:21:56] RECOVERY - cp20 Stunnel HTTP for mw122 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 0.024 second response time [18:22:16] RECOVERY - cp21 Stunnel HTTP for mw111 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 4.077 second response time [18:23:00] !log [@test101] starting deploy of {'config': True} to all [18:23:02] !log [@test101] finished deploy of {'config': True} to all - SUCCESS in 1s [18:23:05] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:23:17] RECOVERY - cp31 Stunnel HTTP for mw111 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 3.013 second response time [18:23:18] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:23:50] RECOVERY - cp30 Varnish Backends on cp30 is OK: All 14 backends are healthy [18:25:10] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.06, 1.85, 1.61 [18:26:26] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 8.76, 10.03, 9.48 [18:27:10] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.08, 1.58, 1.54 [18:33:10] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.65, 1.77, 1.66 [18:33:17] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 10.93, 9.52, 8.33 [18:35:08] [Grafana] FIRING: Some MediaWiki Appservers are running out of PHP-FPM workers. https://grafana.miraheze.org/d/GtxbP1Xnk [18:35:10] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.56, 1.69, 1.64 [18:35:11] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 8.67, 9.17, 8.34 [18:39:26] !log INSERT INTO slot_roles (role_id, role_name) VALUES (1, 'main'); on raidarrwiki [18:39:34] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:40:09] [Grafana] RESOLVED: PHP-FPM Worker Usage High https://grafana.miraheze.org/d/GtxbP1Xnk [18:41:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.75, 11.73, 11.98 [18:49:25] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.42, 11.50, 11.70 [18:49:49] PROBLEM - matomo101 Current Load on matomo101 is CRITICAL: CRITICAL - load average: 4.08, 3.14, 2.41 [18:51:49] RECOVERY - matomo101 Current Load on matomo101 is OK: OK - load average: 1.75, 2.63, 2.31 [18:53:33] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 6.54, 2.63, 1.65 [18:54:00] !log [@test101] starting deploy of {'config': True} to all [18:54:01] !log [@test101] finished deploy of {'config': True} to all - SUCCESS in 1s [18:54:09] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:54:20] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:57:33] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.96, 1.63, 1.46 [18:59:10] PROBLEM - test101 Puppet on test101 is WARNING: WARNING: Puppet is currently disabled, message: Out of sync, last run 4 minutes ago with 0 failures [19:00:49] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CRITICAL - load average: 1.84, 2.16, 1.52 [19:02:47] PROBLEM - cp21 Current Load on cp21 is WARNING: WARNING - load average: 1.10, 1.91, 1.52 [19:04:45] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 0.68, 1.56, 1.44 [19:08:49] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 10.65, 9.67, 8.60 [19:10:49] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 9.98, 9.60, 8.70 [19:11:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.75, 10.57, 11.68 [19:15:39] [02miraheze/mediawiki] 07MacFan4000 pushed 031 commit to 03dependabot/submodules/REL1_37/skins/chameleon-e08fffc [+0/-0/±1] 13https://github.com/miraheze/mediawiki/commit/7ed52f7fdf2b [19:15:40] [02miraheze/mediawiki] 07dependabot[bot] 037ed52f7 - Bump skins/chameleon from `a923c46` to `e08fffc` [19:15:42] [02mediawiki] 07MacFan4000 created branch 03dependabot/submodules/REL1_37/skins/chameleon-e08fffc - 13https://github.com/miraheze/mediawiki [19:15:42] [url] Page not found · GitHub · GitHub | github.com [19:15:52] [02mediawiki] 07MacFan4000 commented on pull request 03#5522: Bump skins/chameleon from `a923c46` to `e08fffc` - 13https://github.com/miraheze/mediawiki/pull/5522#issuecomment-1200279805 [19:15:53] [url] Bump skins/chameleon from `a923c46` to `e08fffc` by dependabot[bot] · Pull Request #5522 · miraheze/mediawiki · GitHub | github.com [19:15:54] [02mediawiki] 07dependabot[bot] commented on pull request 03#5522: Bump skins/chameleon from `a923c46` to `e08fffc` - 13https://github.com/miraheze/mediawiki/pull/5522#issuecomment-1200279808 [19:15:54] ... [19:16:53] [02mediawiki] 07MacFan4000 commented on pull request 03#5522: Bump skins/chameleon from `a923c46` to `e08fffc` - 13https://github.com/miraheze/mediawiki/pull/5522#issuecomment-1200279976 [19:16:53] [url] Bump skins/chameleon from `a923c46` to `e08fffc` by dependabot[bot] · Pull Request #5522 · miraheze/mediawiki · GitHub | github.com [19:16:55] [02mediawiki] 07dependabot[bot] commented on pull request 03#5522: Bump skins/chameleon from `a923c46` to `e08fffc` - 13https://github.com/miraheze/mediawiki/pull/5522#issuecomment-1200279985 [19:16:55] [url] Bump skins/chameleon from `a923c46` to `e08fffc` by dependabot[bot] · Pull Request #5522 · miraheze/mediawiki · GitHub | github.com [19:17:31] [02mediawiki] 07MacFan4000 deleted branch 03dependabot/submodules/REL1_37/skins/chameleon-e08fffc - 13https://github.com/miraheze/mediawiki [19:17:32] [url] Page not found · GitHub · GitHub | github.com [19:17:33] [02miraheze/mediawiki] 07MacFan4000 deleted branch 03dependabot/submodules/REL1_37/skins/chameleon-e08fffc [19:21:25] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.25, 10.33, 10.79 [19:28:02] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.80, 9.93, 9.06 [19:29:52] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.74, 1.69, 1.43 [19:30:02] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.18, 10.34, 9.29 [19:31:49] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.68, 1.64, 1.44 [19:34:02] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.43, 10.66, 9.75 [19:35:07] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 10.94, 10.19, 9.42 [19:36:02] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 8.46, 9.97, 9.61 [19:37:28] [02miraheze/mediawiki] 07MacFan4000 pushed 031 commit to 03dependabot/submodules/REL1_37/skins/chameleon-e08fffc [+0/-0/±1] 13https://github.com/miraheze/mediawiki/commit/7ed52f7fdf2b [19:37:29] [02miraheze/mediawiki] 07dependabot[bot] 037ed52f7 - Bump skins/chameleon from `a923c46` to `e08fffc` [19:37:31] [02mediawiki] 07MacFan4000 created branch 03dependabot/submodules/REL1_37/skins/chameleon-e08fffc - 13https://github.com/miraheze/mediawiki [19:37:31] [url] Page not found · GitHub · GitHub | github.com [19:40:54] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 8.63, 9.83, 9.57 [19:41:17] [02mediawiki] 07MacFan4000 deleted branch 03dependabot/submodules/REL1_37/skins/chameleon-e08fffc - 13https://github.com/miraheze/mediawiki [19:41:17] [url] Page not found · GitHub · GitHub | github.com [19:41:19] [02miraheze/mediawiki] 07MacFan4000 deleted branch 03dependabot/submodules/REL1_37/skins/chameleon-e08fffc [19:50:13] [Grafana] FIRING: Some MediaWiki Appservers are running out of PHP-FPM workers. https://grafana.miraheze.org/d/GtxbP1Xnk [19:50:35] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 12.89, 11.32, 10.27 [19:52:23] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.20, 10.36, 9.58 [19:52:31] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 10.32, 11.12, 10.33 [19:56:26] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 6.39, 9.26, 9.81 [19:56:52] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CRITICAL - load average: 2.28, 1.80, 1.30 [19:58:51] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 1.19, 1.51, 1.26 [20:00:12] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.94, 9.58, 9.60 [20:03:16] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.12, 10.81, 10.09 [20:06:41] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CRITICAL - load average: 3.04, 1.95, 1.47 [20:07:08] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 9.29, 9.92, 9.89 [20:10:13] [Grafana] RESOLVED: PHP-FPM Worker Usage High https://grafana.miraheze.org/d/GtxbP1Xnk [20:12:35] PROBLEM - cp21 Current Load on cp21 is WARNING: WARNING - load average: 1.01, 1.73, 1.59 [20:12:50] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.13, 10.44, 9.92 [20:14:34] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 1.10, 1.46, 1.51 [20:14:48] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 9.87, 10.06, 9.84 [20:19:44] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 3.44, 1.97, 1.41 [20:23:38] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.85, 1.94, 1.53 [20:27:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.28, 10.64, 11.65 [20:27:33] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.29, 1.50, 1.44 [20:35:25] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 14.85, 12.22, 11.74 [20:37:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.83, 11.10, 11.38 [20:40:30] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 1.74, 2.11, 1.69 [20:41:51] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.06, 1.33, 1.91 [20:42:07] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.38, 9.79, 9.29 [20:42:27] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.34, 1.83, 1.63 [20:44:04] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 9.71, 9.57, 9.26 [20:44:24] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.95, 1.56, 1.56 [20:44:36] PROBLEM - db121 Current Load on db121 is CRITICAL: CRITICAL - load average: 8.99, 5.36, 3.18 [20:46:36] RECOVERY - db121 Current Load on db121 is OK: OK - load average: 3.79, 4.99, 3.34 [20:49:51] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.23, 1.34, 1.67 [20:53:25] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 13.18, 11.76, 11.26 [20:57:10] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.71, 1.99, 1.52 [20:57:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.66, 11.25, 11.21 [20:59:10] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.60, 1.45, 1.37 [21:01:25] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.31, 11.54, 11.33 [21:02:16] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 11.32, 10.30, 9.40 [21:02:59] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.84, 1.79, 1.60 [21:04:12] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 8.63, 9.72, 9.30 [21:04:56] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.48, 1.69, 1.58 [21:05:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.32, 11.45, 11.34 [21:21:25] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.16, 10.92, 10.93 [21:21:26] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 11.57, 10.61, 9.29 [21:23:22] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 8.97, 10.18, 9.30 [21:23:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.32, 10.75, 10.85 [21:25:51] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.38, 1.93, 1.58 [21:33:51] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.86, 1.98, 1.77 [21:35:25] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 14.61, 11.37, 10.87 [21:35:51] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.17, 2.05, 1.82 [21:37:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.39, 10.74, 10.69 [21:46:02] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 11.25, 9.96, 9.08 [21:48:02] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 8.18, 9.24, 8.93 [21:49:25] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.40, 11.30, 10.84 [21:53:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.10, 10.68, 10.75 [21:56:29] [02miraheze/puppet] 07JohnFLewis pushed 031 commit to 03master [+2/-0/±1] 13https://github.com/miraheze/puppet/compare/2646f34c928d...c07035919da6 [21:56:30] [url] Comparing 2646f34c928d...c07035919da6 · miraheze/puppet · GitHub | github.com [21:56:31] [02miraheze/puppet] 07JohnFLewis 03c070359 - cloud: add 13 and 14 [21:59:11] [02miraheze/dns] 07JohnFLewis pushed 031 commit to 03master [+0/-0/±2] 13https://github.com/miraheze/dns/compare/d0e76de791d6...1eea61b4d21f [21:59:11] [url] Comparing d0e76de791d6...1eea61b4d21f · miraheze/dns · GitHub | github.com [21:59:12] [02miraheze/dns] 07JohnFLewis 031eea61b - add cloud13/14 [21:59:51] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.86, 1.96, 1.98 [22:01:51] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.13, 2.03, 2.01 [22:03:51] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.61, 1.89, 1.96 [22:05:51] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.02, 1.90, 1.95 [22:06:38] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.11, 1.83, 1.67 [22:07:51] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.80, 1.85, 1.92 [22:08:35] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.38, 2.05, 1.77 [22:09:25] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 9.23, 9.45, 10.07 [22:10:32] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.78, 1.88, 1.73 [22:12:28] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.13, 1.63, 1.66 [22:19:25] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 14.19, 10.88, 10.22 [22:22:16] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.03, 1.71, 1.62 [22:23:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.75, 11.84, 10.84 [22:23:51] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.27, 1.46, 1.66 [22:32:01] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 0.89, 1.84, 1.89 [22:35:25] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.05, 11.18, 10.80 [22:37:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.74, 10.91, 10.74 [22:41:25] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.29, 10.96, 10.74 [22:43:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.21, 10.80, 10.70 [22:43:42] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.49, 2.00, 1.87 [22:47:36] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 0.94, 1.75, 1.82 [22:50:11] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.97, 1.40, 1.09 [22:51:33] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 4.45, 3.48, 2.49 [22:54:06] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.00, 1.30, 1.13 [22:55:25] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.04, 10.51, 10.39 [23:01:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.75, 10.72, 10.67 [23:01:33] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 0.97, 1.48, 1.87 [23:03:25] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.57, 10.95, 10.72 [23:03:33] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.45, 1.10, 1.68 [23:05:47] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 1.89, 2.10, 1.56 [23:07:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.89, 11.77, 11.19 [23:09:51] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.31, 1.85, 1.57 [23:11:40] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 0.97, 1.79, 1.62 [23:13:25] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.85, 11.98, 11.36 [23:13:37] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.25, 2.18, 1.79 [23:15:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.99, 11.40, 11.21 [23:15:35] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.86, 1.66, 1.64 [23:15:51] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.97, 2.00, 1.74 [23:17:51] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.07, 2.04, 1.78 [23:19:51] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.82, 1.94, 1.78 [23:21:25] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 13.38, 11.98, 11.44 [23:21:51] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.63, 2.14, 1.87 [23:22:31] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 10.31, 9.88, 9.04 [23:23:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.42, 11.63, 11.40 [23:24:26] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 8.94, 9.47, 8.99 [23:31:25] PROBLEM - cloud13 Disk Space on cloud13 is CRITICAL: connect to address 2a10:6740::6:400 port 5666: No route to hostconnect to host 2a10:6740::6:400 port 5666: No route to host [23:31:29] PROBLEM - cloud13 PowerDNS Recursor on cloud13 is CRITICAL: connect to address 2a10:6740::6:400 port 5666: No route to hostconnect to host 2a10:6740::6:400 port 5666: No route to host [23:31:29] PROBLEM - cloud13 Puppet on cloud13 is CRITICAL: connect to address 2a10:6740::6:400 port 5666: No route to hostconnect to host 2a10:6740::6:400 port 5666: No route to host [23:31:29] PROBLEM - ping6 on cloud13 is CRITICAL: CRITICAL - Destination Unreachable (2a10:6740::6:400) [23:31:38] PROBLEM - cloud13 SMART on cloud13 is CRITICAL: connect to address 2a10:6740::6:400 port 5666: No route to hostconnect to host 2a10:6740::6:400 port 5666: No route to host [23:31:42] PROBLEM - cloud13 Current Load on cloud13 is CRITICAL: connect to address 2a10:6740::6:400 port 5666: No route to hostconnect to host 2a10:6740::6:400 port 5666: No route to host [23:31:50] PROBLEM - Host cloud13 is DOWN: CRITICAL - Destination Unreachable (2a10:6740::6:400) [23:37:53] RECOVERY - Host cloud13 is UP: PING OK - Packet loss = 0%, RTA = 0.51 ms [23:37:54] RECOVERY - cloud13 PowerDNS Recursor on cloud13 is OK: DNS OK: 0.173 seconds response time. miraheze.org returns 198.244.148.90,2001:41d0:801:2000::1b80,2001:41d0:801:2000::4c25,51.195.220.68 [23:37:54] RECOVERY - cloud13 Disk Space on cloud13 is OK: DISK OK - free space: / 24330 MB (85% inode=95%); [23:37:54] RECOVERY - ping6 on cloud13 is OK: PING OK - Packet loss = 0%, RTA = 1.19 ms [23:37:54] RECOVERY - cloud13 Puppet on cloud13 is OK: OK: Puppet is currently enabled, last run 1 second ago with 0 failures [23:37:54] PROBLEM - cloud13 SMART on cloud13 is WARNING: WARNING: [cciss,0] - No health status line found, Self-test log contains errors --- [cciss,1] - No health status line found, Self-test log contains errors --- [cciss,2] - No health status line found, Self-test log contains errors --- [cciss,3] - No health status line found, Self-test log contains errors --- [cciss,4] - No health status line found, Self-test log contains errors --- [cciss,5 [23:37:55] th status line found, Self-test log contains errors --- [cciss,6] - No health status line found, Self-test log contains errors| [23:37:55] RECOVERY - cloud13 Current Load on cloud13 is OK: OK - load average: 0.39, 0.19, 0.07 [23:38:04] PROBLEM - cloud13 IPMI Sensors on cloud13 is UNKNOWN: Error: ipmimonitoring/ipmi-sensors command not found! [23:38:04] PROBLEM - cloud13 NTP time on cloud13 is CRITICAL: connect to address 2a10:6740::6:400 port 5666: No route to hostconnect to host 2a10:6740::6:400 port 5666: No route to host [23:38:04] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.74, 2.00, 2.00 [23:38:06] RECOVERY - cloud13 NTP time on cloud13 is OK: NTP OK: Offset -0.0003982186317 secs [23:40:00] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 1.91, 2.01, 2.00 [23:40:44] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 13.19, 11.17, 10.99 [23:41:56] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.90, 1.97, 1.99 [23:42:04] PROBLEM - roblox-wiki.tk - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query roblox-wiki.tk. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [23:43:51] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.07, 1.98, 1.99 [23:44:40] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.33, 11.63, 11.26 [23:48:35] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.39, 11.87, 11.42 [23:48:35] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.06, 1.91, 1.63 [23:49:39] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.78, 1.94, 1.98 [23:49:52] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.88, 1.94, 1.53 [23:50:33] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.59, 11.82, 11.45 [23:51:52] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.11, 1.63, 1.46 [23:52:30] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.52, 12.19, 11.64 [23:54:28] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.62, 11.35, 11.41 [23:56:35] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.02, 1.75, 1.75 [23:58:35] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.27, 1.83, 1.77