[00:03:03] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.32, 2.01, 1.97 [00:03:12] PROBLEM - cp21 Stunnel HTTP for mw122 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:03:13] PROBLEM - cp31 Stunnel HTTP for mw122 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:03:14] PROBLEM - cp30 Stunnel HTTP for mw111 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:03:16] PROBLEM - mw122 MediaWiki Rendering on mw122 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:03:19] PROBLEM - cp30 Stunnel HTTP for mw122 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:03:35] RECOVERY - mw101 MediaWiki Rendering on mw101 is OK: HTTP OK: HTTP/1.1 200 OK - 28479 bytes in 0.423 second response time [00:03:40] RECOVERY - cp30 Stunnel HTTP for mw101 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.310 second response time [00:04:23] RECOVERY - mw111 MediaWiki Rendering on mw111 is OK: HTTP OK: HTTP/1.1 200 OK - 28479 bytes in 9.830 second response time [00:05:02] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.24, 1.68, 1.85 [00:07:51] PROBLEM - cp20 Stunnel HTTP for mw111 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:07:55] PROBLEM - cp20 Stunnel HTTP for mw122 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:07:55] PROBLEM - cp21 Stunnel HTTP for mw111 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:08:46] PROBLEM - mw111 MediaWiki Rendering on mw111 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:09:00] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.02, 1.38, 1.70 [00:09:05] PROBLEM - es101 Current Load on es101 is WARNING: WARNING - load average: 3.66, 3.10, 2.04 [00:09:24] RECOVERY - cp31 Stunnel HTTP for mw111 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 7.412 second response time [00:09:25] RECOVERY - cp30 Stunnel HTTP for mw111 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 6.264 second response time [00:09:40] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 0.69, 1.24, 1.89 [00:09:51] RECOVERY - cp20 Stunnel HTTP for mw111 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 2.886 second response time [00:09:53] RECOVERY - cp21 Stunnel HTTP for mw111 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.029 second response time [00:10:42] PROBLEM - cp21 Varnish Backends on cp21 is CRITICAL: 1 backends are down. mw111 [00:10:45] RECOVERY - mw111 MediaWiki Rendering on mw111 is OK: HTTP OK: HTTP/1.1 200 OK - 28479 bytes in 1.196 second response time [00:11:00] RECOVERY - es101 Current Load on es101 is OK: OK - load average: 3.28, 3.11, 2.16 [00:11:31] RECOVERY - cp30 Stunnel HTTP for mw122 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 9.965 second response time [00:11:33] RECOVERY - cp21 Stunnel HTTP for mw122 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 8.954 second response time [00:11:39] RECOVERY - cp31 Stunnel HTTP for mw122 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 7.357 second response time [00:12:00] RECOVERY - cp20 Stunnel HTTP for mw122 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 6.382 second response time [00:12:34] PROBLEM - cp31 Stunnel HTTP for mw102 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:12:42] RECOVERY - cp21 Varnish Backends on cp21 is OK: All 14 backends are healthy [00:13:34] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.25, 9.42, 9.32 [00:14:35] RECOVERY - cp31 Stunnel HTTP for mw102 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 4.378 second response time [00:15:25] RECOVERY - mw122 MediaWiki Rendering on mw122 is OK: HTTP OK: HTTP/1.1 200 OK - 28479 bytes in 4.473 second response time [00:15:34] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 9.95, 9.58, 9.39 [00:15:40] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.02, 1.25, 1.69 [00:20:02] [Grafana] FIRING: Some MediaWiki Appservers are running out of PHP-FPM workers. https://grafana.miraheze.org/d/GtxbP1Xnk [00:20:03] PROBLEM - cp31 Stunnel HTTP for mw112 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:21:52] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.86, 1.58, 1.57 [00:21:53] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.32, 9.60, 9.23 [00:22:04] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 11.35, 9.91, 9.13 [00:22:04] RECOVERY - cp31 Stunnel HTTP for mw112 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 3.233 second response time [00:25:50] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.94, 1.54, 1.57 [00:25:52] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.81, 11.20, 9.97 [00:26:04] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 8.69, 9.62, 9.24 [00:27:52] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.70, 10.95, 10.03 [00:28:03] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 1.68, 3.38, 1.93 [00:31:34] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.69, 9.70, 9.16 [00:32:03] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 0.52, 1.71, 1.56 [00:33:34] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.92, 9.30, 9.07 [00:34:03] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 0.33, 1.26, 1.41 [00:37:34] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.00, 10.12, 9.47 [00:39:34] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.98, 11.57, 10.08 [00:40:04] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 11.13, 10.43, 9.87 [00:41:34] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.96, 10.94, 10.04 [00:41:57] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.18, 10.48, 9.09 [00:42:04] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 9.62, 10.20, 9.87 [00:43:38] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 11.51, 11.04, 9.89 [00:43:57] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.29, 10.73, 9.35 [00:45:34] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.56, 11.43, 10.44 [00:45:57] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.41, 9.98, 9.25 [00:47:34] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.42, 10.55, 10.23 [00:47:37] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 8.33, 10.07, 9.79 [00:49:34] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 9.91, 10.09, 10.09 [00:49:52] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.49, 11.84, 11.20 [00:50:29] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.96, 2.00, 1.57 [00:51:52] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.83, 11.52, 11.15 [00:52:26] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.30, 1.67, 1.49 [01:02:39] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.69, 10.24, 9.71 [01:04:37] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 9.83, 10.11, 9.73 [01:05:34] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.20, 10.47, 9.97 [01:07:34] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.28, 10.91, 10.18 [01:09:34] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.27, 10.92, 10.27 [01:11:57] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.21, 10.62, 9.56 [01:13:34] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.41, 11.05, 10.42 [01:13:57] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.47, 10.96, 9.81 [01:15:34] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.35, 10.49, 10.28 [01:15:57] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.06, 9.96, 9.59 [01:17:34] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 9.21, 10.00, 10.12 [01:28:04] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.33, 10.12, 9.78 [01:30:02] [Grafana] RESOLVED: PHP-FPM Worker Usage High https://grafana.miraheze.org/d/GtxbP1Xnk [01:30:04] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 9.91, 9.99, 9.77 [01:33:34] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.24, 10.08, 9.94 [01:35:34] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 9.85, 10.15, 10.00 [01:35:52] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 13.91, 12.03, 11.16 [01:37:52] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.90, 11.58, 11.08 [01:39:34] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.25, 10.34, 10.07 [01:39:52] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.44, 11.90, 11.26 [01:41:34] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 9.40, 9.84, 9.91 [01:41:52] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.62, 11.49, 11.17 [01:45:34] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.74, 10.65, 10.22 [01:46:01] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.73, 2.21, 1.75 [01:48:00] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.65, 1.98, 1.71 [01:49:34] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.53, 9.96, 10.11 [01:49:59] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.14, 1.64, 1.62 [01:55:52] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.54, 11.12, 10.96 [01:59:52] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.45, 10.98, 11.00 [02:03:20] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.96, 11.06, 10.29 [02:03:34] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.98, 10.42, 10.01 [02:03:52] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.86, 9.03, 10.18 [02:05:18] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 8.41, 9.85, 9.92 [02:05:34] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.87, 9.45, 9.71 [02:05:57] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 9.48, 6.43, 4.86 [02:07:54] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 4.22, 5.56, 4.74 [02:09:34] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.17, 10.52, 10.08 [02:09:52] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.28, 10.88, 10.57 [02:10:13] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.78, 3.62, 3.98 [02:10:18] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.41, 3.45, 3.94 [02:11:01] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 12.10, 10.33, 9.50 [02:11:52] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.52, 10.47, 10.46 [02:12:13] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 6.54, 4.58, 4.28 [02:12:18] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.45, 4.11, 4.11 [02:13:34] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 9.62, 10.06, 9.99 [02:15:52] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.02, 11.32, 10.83 [02:17:34] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.78, 10.22, 10.09 [02:18:58] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 10.88, 11.46, 10.46 [02:19:52] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.91, 11.26, 10.98 [02:21:34] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 9.64, 9.86, 9.97 [02:23:52] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 13.01, 12.09, 11.36 [02:24:18] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.31, 3.90, 3.96 [02:27:52] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.37, 11.86, 11.49 [02:28:18] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 6.04, 4.40, 4.09 [02:28:26] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.85, 10.76, 10.30 [02:28:47] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.78, 1.54, 1.29 [02:29:52] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.24, 12.01, 11.59 [02:29:57] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.91, 9.87, 9.02 [02:31:57] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.37, 9.46, 8.99 [02:32:21] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.80, 11.52, 10.70 [02:32:37] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.22, 11.04, 10.24 [02:32:47] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.40, 1.59, 1.38 [02:34:35] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 11.26, 10.98, 10.31 [02:35:40] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.72, 1.76, 1.37 [02:35:40] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.40, 3.54, 4.00 [02:35:57] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 12.00, 10.58, 9.53 [02:36:16] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.58, 11.66, 10.95 [02:36:51] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 12.67, 11.48, 10.89 [02:37:40] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 3.04, 2.05, 1.51 [02:37:40] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.87, 4.03, 4.12 [02:37:57] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.99, 10.04, 9.47 [02:38:50] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.74, 11.10, 10.84 [02:39:40] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.35, 1.74, 1.46 [02:41:40] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.01, 1.49, 1.41 [02:41:52] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.27, 11.38, 11.79 [02:46:20] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 8.89, 9.72, 10.09 [02:47:46] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 8.25, 6.51, 5.11 [02:49:40] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 3.96, 6.77, 4.12 [02:49:46] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 5.68, 6.31, 5.23 [02:51:57] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 9.34, 9.55, 10.17 [02:53:52] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.70, 11.44, 11.44 [02:55:49] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.32, 10.23, 10.34 [02:55:52] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.21, 11.32, 11.40 [02:56:47] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 7.97, 9.51, 10.16 [02:57:52] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.01, 11.62, 11.50 [02:59:52] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.32, 11.50, 11.47 [03:00:47] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 11.94, 10.49, 10.38 [03:01:42] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.49, 9.65, 10.08 [03:01:46] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 8.51, 7.47, 6.38 [03:03:46] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.73, 7.39, 6.47 [03:04:04] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.35, 10.19, 9.94 [03:05:02] [Grafana] FIRING: Some MediaWiki Appservers are running out of PHP-FPM workers. https://grafana.miraheze.org/d/GtxbP1Xnk [03:05:52] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.80, 11.66, 11.43 [03:07:34] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.08, 10.57, 10.36 [03:08:04] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 8.74, 9.85, 9.89 [03:09:34] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.92, 9.92, 10.14 [03:09:40] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.13, 1.16, 1.87 [03:09:41] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.69, 3.50, 3.98 [03:09:46] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 8.12, 7.69, 6.86 [03:09:52] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.88, 11.36, 11.36 [03:10:13] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.87, 3.44, 3.96 [03:10:18] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.93, 3.61, 3.97 [03:10:47] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 12.69, 11.13, 10.73 [03:11:02] [02mw-config] 07Universal-Omega edited pull request 03#4816: Rename `$wgCosmosRailBlacklistedNamespaces` - 13https://github.com/miraheze/mw-config/pull/4816 [03:11:03] [url] Page not found · GitHub · GitHub | github.com [03:11:46] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 6.33, 7.15, 6.76 [03:12:47] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 11.88, 11.47, 10.91 [03:13:40] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.40, 1.11, 1.67 [03:13:46] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 8.50, 7.75, 7.04 [03:15:02] [Grafana] RESOLVED: PHP-FPM Worker Usage High https://grafana.miraheze.org/d/GtxbP1Xnk [03:15:30] [02mw-config] 07Universal-Omega synchronize pull request 03#4818: Rename and document `$wgUFEnablePersonalDataFunctions` - 13https://github.com/miraheze/mw-config/pull/4818 [03:15:31] [url] Page not found · GitHub · GitHub | github.com [03:15:32] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-5 [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/6571bb9d8dcc...38015ea58884 [03:15:32] [url] Comparing 6571bb9d8dcc...38015ea58884 · miraheze/mw-config · GitHub | github.com [03:15:33] [02miraheze/mw-config] 07Universal-Omega 0338015ea - Update LocalSettings.php [03:15:46] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 6.90, 7.51, 7.04 [03:16:56] miraheze/mw-config - Universal-Omega the build passed. [03:20:18] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.79, 2.75, 3.34 [03:20:47] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 6.39, 8.77, 9.94 [03:21:40] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.10, 3.72, 3.72 [03:22:13] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 6.01, 4.22, 3.85 [03:23:41] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.74, 3.59, 3.67 [03:23:52] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.48, 11.82, 11.40 [03:27:40] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.40, 3.77, 3.70 [03:27:52] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.33, 11.63, 11.47 [03:28:12] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.62, 3.79, 3.84 [03:30:13] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.06, 4.16, 3.96 [03:31:46] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 8.76, 7.52, 7.12 [03:35:41] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.56, 3.81, 3.79 [03:35:52] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.70, 11.67, 11.43 [03:36:13] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.86, 3.89, 3.96 [03:37:30] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.91, 3.80, 3.41 [03:37:40] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.76, 4.26, 3.96 [03:37:52] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.42, 10.86, 11.17 [03:38:13] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.56, 4.65, 4.27 [03:39:52] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.93, 11.55, 11.38 [03:40:23] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 11.00, 10.31, 10.02 [03:41:17] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.32, 3.58, 3.40 [03:41:46] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 6.56, 7.95, 7.68 [03:41:52] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.27, 10.62, 11.06 [03:43:10] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 3.17, 3.27, 3.30 [03:44:13] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.45, 3.68, 3.96 [03:44:18] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 9.25, 9.76, 9.87 [03:47:40] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.90, 3.76, 3.92 [03:47:53] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.17, 8.44, 9.93 [03:49:40] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.34, 3.90, 3.94 [03:51:40] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.25, 3.73, 3.88 [03:52:13] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.00, 3.95, 3.87 [03:52:22] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.61, 1.91, 1.50 [03:53:46] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 8.15, 7.64, 7.53 [03:54:13] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.34, 3.67, 3.78 [03:54:19] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.92, 1.61, 1.45 [03:55:46] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.06, 7.39, 7.45 [03:59:40] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.74, 2.85, 3.34 [04:00:13] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.35, 3.81, 3.79 [04:01:46] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 8.31, 7.44, 7.42 [04:04:13] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.58, 3.81, 3.79 [04:06:46] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.47, 10.39, 9.84 [04:08:44] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.58, 9.14, 9.44 [04:10:13] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.29, 3.71, 3.67 [04:11:51] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.72, 1.60, 1.29 [04:12:18] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.49, 3.68, 3.28 [04:13:50] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.45, 1.59, 1.33 [04:14:12] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.75, 3.21, 3.48 [04:14:18] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.60, 3.40, 3.23 [04:15:46] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 6.13, 7.50, 7.63 [04:20:13] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.17, 2.74, 3.19 [04:20:23] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.90, 3.53, 3.43 [04:22:22] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.37, 3.20, 3.32 [04:31:46] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 6.14, 6.16, 6.72 [04:33:11] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.09, 3.91, 3.48 [04:35:09] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.96, 3.49, 3.38 [04:35:37] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.04, 9.63, 8.70 [04:36:12] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.65, 9.78, 9.29 [04:37:07] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.28, 3.15, 3.27 [04:37:35] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 10.06, 9.80, 8.88 [04:38:10] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 8.75, 9.43, 9.23 [04:42:18] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.43, 3.06, 2.94 [04:43:01] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.79, 3.37, 3.30 [04:44:18] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 3.34, 3.33, 3.06 [04:45:46] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.46, 6.19, 6.09 [04:47:46] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 6.04, 6.22, 6.12 [04:48:14] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.94, 1.50, 1.19 [04:51:55] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.94, 10.74, 9.77 [04:52:09] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.79, 1.35, 1.22 [04:52:53] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.58, 3.37, 3.40 [04:56:39] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 6.92, 6.81, 6.42 [04:57:52] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 13.00, 11.60, 10.42 [04:58:36] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 5.74, 6.46, 6.34 [04:59:52] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.99, 11.52, 10.53 [05:02:44] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.37, 4.12, 3.64 [05:04:27] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 9.62, 7.98, 6.98 [05:04:42] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.55, 3.77, 3.56 [05:06:13] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.22, 3.88, 3.32 [05:06:25] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.49, 7.76, 7.03 [05:08:39] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 3.82, 4.16, 3.80 [05:10:20] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 5.51, 6.62, 6.74 [05:10:38] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.87, 3.83, 3.70 [05:12:12] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.96, 3.58, 3.40 [05:12:36] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.48, 3.88, 3.72 [05:13:52] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.29, 9.22, 9.92 [05:14:13] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.08, 3.19, 3.29 [05:14:35] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.81, 3.87, 3.74 [05:17:48] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.48, 4.21, 3.58 [05:18:31] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.05, 3.55, 3.62 [05:21:52] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.01, 10.37, 10.07 [05:22:28] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.77, 3.91, 3.77 [05:23:52] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.18, 10.49, 10.15 [05:24:27] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.22, 3.87, 3.76 [05:25:23] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.57, 3.66, 3.66 [05:25:52] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 9.24, 10.18, 10.09 [05:26:25] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.16, 3.30, 3.57 [05:30:22] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.71, 2.98, 3.37 [05:31:04] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.54, 2.89, 3.31 [05:38:14] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.49, 3.36, 3.34 [05:42:25] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.56, 3.75, 3.39 [05:44:10] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.92, 3.42, 3.39 [05:44:19] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.87, 3.43, 3.32 [05:46:08] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.33, 3.16, 3.31 [05:46:18] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.10, 2.96, 3.16 [05:50:03] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.53, 4.56, 3.85 [05:50:18] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.52, 3.78, 3.46 [05:50:23] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.28, 3.97, 3.34 [05:54:18] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.15, 3.28, 3.35 [05:55:59] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.93, 3.81, 3.75 [05:56:12] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.43, 3.80, 3.52 [06:02:13] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.03, 3.01, 3.30 [06:03:52] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.39, 10.13, 9.44 [06:03:52] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.13, 2.64, 3.21 [06:07:52] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.01, 10.87, 9.89 [06:09:52] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.64, 10.62, 9.91 [06:11:52] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 9.46, 10.13, 9.81 [06:15:42] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.71, 3.52, 3.24 [06:17:05] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.84, 3.37, 3.15 [06:17:40] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.87, 3.42, 3.25 [06:18:58] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 1.90, 2.89, 3.00 [06:19:40] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.94, 3.32, 3.23 [06:25:52] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.03, 10.80, 10.36 [06:27:52] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.24, 11.21, 10.56 [06:28:13] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.18, 3.77, 3.39 [06:30:13] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.06, 3.44, 3.31 [06:31:52] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.40, 11.29, 10.76 [06:32:13] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.75, 3.15, 3.22 [06:33:52] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.83, 11.72, 10.97 [06:37:52] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.09, 11.42, 11.03 [06:41:52] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 13.49, 12.12, 11.37 [06:43:52] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.80, 11.92, 11.38 [06:44:25] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.84, 3.69, 3.29 [06:44:57] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.55, 4.14, 3.54 [06:48:22] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.82, 3.80, 3.43 [06:48:46] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.28, 3.75, 3.51 [06:50:40] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.36, 3.24, 3.35 [06:51:52] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 13.68, 12.11, 11.56 [06:52:18] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 3.24, 3.38, 3.33 [06:53:52] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.84, 11.36, 11.36 [06:57:52] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 14.39, 12.27, 11.69 [06:59:52] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.00, 11.89, 11.63 [07:01:52] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 13.59, 12.44, 11.86 [07:07:32] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 10.70, 10.20, 9.21 [07:09:29] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.44, 3.20, 2.93 [07:09:31] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 9.81, 10.00, 9.26 [07:11:02] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.86, 4.12, 3.42 [07:11:23] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.32, 4.33, 3.40 [07:11:52] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.81, 11.42, 11.78 [07:14:51] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.97, 3.66, 3.41 [07:15:10] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.35, 3.92, 3.45 [07:16:45] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.98, 3.37, 3.32 [07:20:51] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.16, 3.04, 3.22 [07:25:52] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.08, 8.94, 10.13 [07:33:52] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.62, 10.08, 10.17 [07:34:42] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.98, 3.85, 3.16 [07:36:05] PROBLEM - hoodwiki.xyz - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'hoodwiki.xyz' expires in 15 day(s) (Sat 06 Aug 2022 07:29:47 GMT +0000). [07:36:41] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.96, 3.35, 3.05 [07:36:56] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.78, 3.61, 3.39 [07:36:56] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.02, 4.12, 3.44 [07:37:44] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/74336de3c62b...714cf5ae64d4 [07:37:44] [url] Comparing 74336de3c62b...714cf5ae64d4 · miraheze/ssl · GitHub | github.com [07:37:45] [02miraheze/ssl] 07MirahezeSSLBot 03714cf5a - Bot: Update SSL cert for hoodwiki.xyz [07:38:49] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.53, 3.16, 3.24 [07:38:51] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.31, 3.39, 3.25 [07:41:16] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 12.38, 10.67, 9.86 [07:43:15] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 10.21, 10.38, 9.85 [07:45:14] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 9.37, 10.01, 9.78 [07:47:52] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 10.06, 9.92, 10.19 [07:51:52] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.91, 10.55, 10.43 [07:53:52] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 8.06, 9.83, 10.19 [07:55:34] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.65, 10.31, 9.58 [07:56:26] PROBLEM - pokemonwiki.info - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'pokemonwiki.info' expires in 15 day(s) (Sat 06 Aug 2022 07:26:57 GMT +0000). [07:57:34] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 9.39, 9.76, 9.46 [07:57:48] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/714cf5ae64d4...291d02814beb [07:57:49] [url] Comparing 714cf5ae64d4...291d02814beb · miraheze/ssl · GitHub | github.com [07:57:50] [02miraheze/ssl] 07MirahezeSSLBot 03291d028 - Bot: Update SSL cert for pokemonwiki.info [07:58:22] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.76, 3.10, 2.86 [08:00:20] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.73, 2.88, 2.80 [08:05:38] RECOVERY - hoodwiki.xyz - LetsEncrypt on sslhost is OK: OK - Certificate 'hoodwiki.xyz' will expire on Wed 19 Oct 2022 06:37:38 GMT +0000. [08:13:32] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.90, 10.36, 10.27 [08:15:30] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 9.21, 9.90, 10.11 [08:18:52] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CRITICAL - load average: 2.08, 1.96, 1.45 [08:20:46] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 0.79, 1.55, 1.36 [08:21:22] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.82, 10.68, 10.39 [08:25:18] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.22, 10.98, 10.55 [08:26:42] PROBLEM - cp21 Current Load on cp21 is WARNING: WARNING - load average: 1.78, 1.71, 1.47 [08:27:16] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.47, 11.41, 10.77 [08:28:42] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 1.06, 1.58, 1.45 [08:33:10] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 10.16, 9.83, 10.20 [08:41:51] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 12.22, 9.75, 8.58 [08:43:50] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 10.93, 9.93, 8.78 [08:45:49] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 8.87, 9.21, 8.64 [08:54:26] RECOVERY - pokemonwiki.info - LetsEncrypt on sslhost is OK: OK - Certificate 'pokemonwiki.info' will expire on Wed 19 Oct 2022 06:57:42 GMT +0000. [09:07:26] PROBLEM - cp21 Current Load on cp21 is WARNING: WARNING - load average: 1.83, 1.51, 1.35 [09:09:20] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 1.32, 1.42, 1.33 [09:18:35] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.88, 10.51, 9.54 [09:24:28] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.76, 10.38, 9.47 [09:24:33] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 7.88, 9.25, 9.37 [09:32:30] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.96, 3.16, 2.79 [09:33:34] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.05, 10.10, 9.45 [09:34:18] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 14.01, 11.21, 10.23 [09:34:24] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.24, 2.83, 2.72 [09:36:58] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 11.42, 10.82, 10.06 [09:38:14] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.59, 10.83, 10.38 [09:40:12] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.48, 11.49, 10.67 [09:42:25] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 12.41, 11.00, 10.00 [09:43:34] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 9.09, 9.69, 9.68 [09:44:08] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.64, 11.59, 10.89 [09:44:24] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 10.88, 10.91, 10.08 [09:48:06] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.08, 3.15, 2.63 [09:48:22] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 12.15, 10.98, 10.26 [09:50:04] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.11, 2.79, 2.56 [09:50:22] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 10.00, 10.49, 10.16 [09:52:21] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 7.62, 9.69, 9.93 [09:53:59] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 13.63, 12.17, 11.34 [09:55:57] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.32, 11.71, 11.27 [09:56:19] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 10.45, 10.28, 10.11 [09:57:20] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CRITICAL - load average: 2.90, 2.03, 1.51 [09:57:34] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.64, 11.38, 10.32 [10:00:29] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 13.93, 11.55, 10.74 [10:01:34] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.81, 11.32, 10.54 [10:03:32] [Grafana] FIRING: Some MediaWiki Appservers are running out of PHP-FPM workers. https://grafana.miraheze.org/d/GtxbP1Xnk [10:03:34] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.31, 11.37, 10.63 [10:03:52] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.88, 11.95, 11.44 [10:04:24] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.45, 11.65, 11.03 [10:06:45] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 1.14, 2.12, 1.67 [10:07:34] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.74, 11.15, 10.77 [10:08:19] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.32, 11.74, 11.19 [10:08:42] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 0.82, 1.71, 1.57 [10:10:17] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 8.63, 10.80, 10.93 [10:10:39] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 0.78, 1.36, 1.46 [10:10:42] PROBLEM - cp21 Current Load on cp21 is WARNING: WARNING - load average: 1.15, 1.92, 1.91 [10:11:57] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.63, 10.24, 9.24 [10:13:57] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.39, 9.39, 9.07 [10:14:30] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 3.20, 3.07, 2.15 [10:15:34] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.01, 11.53, 11.03 [10:15:52] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.00, 11.69, 11.88 [10:16:41] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.47, 3.57, 2.99 [10:16:42] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CRITICAL - load average: 3.68, 2.25, 2.00 [10:17:34] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.23, 11.27, 10.99 [10:18:24] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.27, 1.95, 1.88 [10:19:52] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.70, 11.47, 11.68 [10:20:38] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.47, 3.82, 3.21 [10:20:42] PROBLEM - cp21 Current Load on cp21 is WARNING: WARNING - load average: 1.21, 1.85, 1.90 [10:21:52] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.48, 11.55, 11.69 [10:22:36] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.53, 3.80, 3.28 [10:23:52] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 13.48, 12.29, 11.95 [10:24:08] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 7.77, 9.20, 10.06 [10:24:15] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 0.53, 1.20, 1.59 [10:24:34] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.60, 3.28, 3.14 [10:26:43] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CRITICAL - load average: 10.53, 3.72, 2.46 [10:27:52] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.22, 11.97, 11.93 [10:28:13] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.24, 3.99, 3.24 [10:28:17] [02mw-config] 07LuciferianThomas opened pull request 03#4822: Update $wgTranslateBlacklist for hkrailwiki - 13https://github.com/miraheze/mw-config/pull/4822 [10:28:17] [url] Page not found · GitHub · GitHub | github.com [10:29:24] miraheze/mw-config - LuciferianThomas the build passed. [10:30:05] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 10.83, 10.24, 10.22 [10:30:13] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.89, 3.58, 3.18 [10:31:34] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.17, 11.09, 10.93 [10:32:04] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 9.89, 9.98, 10.12 [10:35:23] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.45, 3.49, 3.24 [10:35:52] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.89, 12.21, 11.98 [10:36:13] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.17, 4.09, 3.50 [10:37:22] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 3.10, 3.28, 3.19 [10:37:34] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.40, 11.77, 11.31 [10:37:52] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.41, 11.82, 11.89 [10:38:04] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 13.52, 11.15, 10.62 [10:38:18] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.12, 3.94, 3.38 [10:40:04] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 11.91, 11.30, 10.75 [10:40:13] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.09, 3.75, 3.51 [10:40:18] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.07, 3.58, 3.31 [10:42:18] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 3.06, 3.40, 3.28 [10:43:34] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.38, 11.50, 11.28 [10:43:58] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 10.25, 10.51, 10.23 [10:44:13] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.42, 3.19, 3.34 [10:44:42] PROBLEM - cp21 Current Load on cp21 is WARNING: WARNING - load average: 1.24, 1.47, 1.95 [10:45:34] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.25, 11.21, 11.18 [10:46:12] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.03, 3.48, 3.33 [10:47:34] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.54, 11.31, 11.20 [10:49:34] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.15, 11.14, 11.15 [10:49:55] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 9.42, 10.05, 10.16 [10:50:09] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.79, 3.38, 3.34 [10:51:52] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.08, 10.97, 11.13 [10:52:42] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CRITICAL - load average: 2.64, 1.64, 1.79 [10:54:42] PROBLEM - cp21 Current Load on cp21 is WARNING: WARNING - load average: 1.67, 1.66, 1.78 [10:55:52] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.61, 11.28, 11.27 [10:59:51] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 11.40, 10.53, 10.19 [11:00:04] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 13.10, 11.19, 10.77 [11:01:52] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 13.07, 12.08, 11.56 [11:02:04] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.70, 10.95, 10.76 [11:03:34] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.11, 11.65, 11.12 [11:05:34] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.36, 11.61, 11.18 [11:06:42] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 0.89, 1.37, 1.62 [11:07:52] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.56, 11.11, 11.41 [11:08:32] [Grafana] RESOLVED: PHP-FPM Worker Usage High https://grafana.miraheze.org/d/GtxbP1Xnk [11:10:45] [02miraheze/GlobalNewFiles] 07translatewiki pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/GlobalNewFiles/compare/8a793af2c581...375167b1edd5 [11:10:45] [url] Comparing 8a793af2c581...375167b1edd5 · miraheze/GlobalNewFiles · GitHub | github.com [11:10:46] [02miraheze/GlobalNewFiles] 07translatewiki 03375167b - Localisation updates from https://translatewiki.net. [11:10:47] [url] Main page - translatewiki.net | translatewiki.net [11:10:48] [02miraheze/CreateWiki] 07translatewiki pushed 031 commit to 03master [+1/-0/±2] 13https://github.com/miraheze/CreateWiki/compare/ce0c205c4285...ab596c6fdf87 [11:10:48] [url] Comparing ce0c205c4285...ab596c6fdf87 · miraheze/CreateWiki · GitHub | github.com [11:10:49] [02miraheze/CreateWiki] 07translatewiki 03ab596c6 - Localisation updates from https://translatewiki.net. [11:10:50] [url] Main page - translatewiki.net | translatewiki.net [11:10:51] [02miraheze/DataDump] 07translatewiki pushed 031 commit to 03master [+1/-0/±1] 13https://github.com/miraheze/DataDump/compare/32a3651646ad...9595615b59d2 [11:10:51] [url] Comparing 32a3651646ad...9595615b59d2 · miraheze/DataDump · GitHub | github.com [11:10:52] [02miraheze/DataDump] 07translatewiki 039595615 - Localisation updates from https://translatewiki.net. [11:10:53] [url] Main page - translatewiki.net | translatewiki.net [11:10:54] [02miraheze/MatomoAnalytics] 07translatewiki pushed 031 commit to 03master [+1/-0/±0] 13https://github.com/miraheze/MatomoAnalytics/compare/3d550db96fc5...1260bb116711 [11:10:54] [url] Comparing 3d550db96fc5...1260bb116711 · miraheze/MatomoAnalytics · GitHub | github.com [11:10:55] [02miraheze/MatomoAnalytics] 07translatewiki 031260bb1 - Localisation updates from https://translatewiki.net. [11:10:56] [url] Main page - translatewiki.net | translatewiki.net [11:10:57] [02miraheze/WikiDiscover] 07translatewiki pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/WikiDiscover/compare/6cd4a2bb8a9e...d011591989c9 [11:10:57] [url] Comparing 6cd4a2bb8a9e...d011591989c9 · miraheze/WikiDiscover · GitHub | github.com [11:10:58] [02miraheze/WikiDiscover] 07translatewiki 03d011591 - Localisation updates from https://translatewiki.net. [11:10:59] [url] Main page - translatewiki.net | translatewiki.net [11:11:00] [02miraheze/MirahezeMagic] 07translatewiki pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/MirahezeMagic/compare/1987f84656ef...2a7be60118a1 [11:11:00] [url] Comparing 1987f84656ef...2a7be60118a1 · miraheze/MirahezeMagic · GitHub | github.com [11:11:01] [02miraheze/MirahezeMagic] 07translatewiki 032a7be60 - Localisation updates from https://translatewiki.net. [11:11:02] [url] Main page - translatewiki.net | translatewiki.net [11:11:34] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.08, 10.99, 10.96 [11:13:34] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.53, 11.35, 11.10 [11:14:04] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.30, 10.96, 10.67 [11:14:36] miraheze/GlobalNewFiles - translatewiki the build passed. [11:15:34] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.25, 11.54, 11.20 [11:15:52] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.35, 11.64, 11.55 [11:16:18] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.10, 3.93, 3.31 [11:16:44] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.01, 4.31, 3.61 [11:17:32] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CRITICAL - load average: 2.34, 1.92, 1.77 [11:17:44] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 12.97, 11.42, 10.82 [11:17:52] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.21, 11.36, 11.46 [11:17:58] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.44, 10.32, 9.73 [11:18:04] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 11.79, 11.36, 10.92 [11:18:18] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.79, 4.00, 3.43 [11:19:26] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 1.24, 1.60, 1.67 [11:19:37] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.34, 3.95, 3.47 [11:19:57] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 10.05, 10.20, 9.75 [11:20:04] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.68, 11.79, 11.14 [11:20:41] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.65, 3.94, 3.67 [11:21:34] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.22, 11.06, 11.13 [11:21:42] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 10.03, 10.83, 10.74 [11:21:52] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.06, 11.65, 11.54 [11:21:56] miraheze/MatomoAnalytics - translatewiki the build passed. [11:21:58] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 11.07, 9.56, 8.87 [11:22:04] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.87, 11.42, 11.08 [11:22:14] miraheze/WikiDiscover - translatewiki the build passed. [11:22:18] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 1.62, 2.95, 3.15 [11:22:39] miraheze/DataDump - translatewiki the build passed. [11:23:34] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.17, 11.32, 11.20 [11:25:10] PROBLEM - cp21 Current Load on cp21 is WARNING: WARNING - load average: 1.82, 1.85, 1.72 [11:25:34] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.74, 11.04, 11.12 [11:25:52] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.62, 11.95, 11.71 [11:26:24] miraheze/CreateWiki - translatewiki the build passed. [11:26:36] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.24, 2.93, 3.31 [11:27:15] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.02, 3.61, 3.48 [11:27:34] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.13, 11.53, 11.27 [11:27:37] miraheze/MirahezeMagic - translatewiki the build passed. [11:27:50] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 9.97, 10.16, 9.41 [11:27:52] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.19, 11.94, 11.73 [11:28:04] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.97, 11.56, 11.18 [11:28:58] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 0.70, 1.42, 1.59 [11:29:10] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 3.32, 3.32, 3.38 [11:29:39] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 12.64, 11.06, 10.74 [11:29:57] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.92, 10.28, 9.82 [11:31:34] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.58, 11.73, 11.44 [11:31:57] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 9.47, 9.90, 9.73 [11:32:30] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.62, 3.83, 3.59 [11:33:34] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.30, 12.07, 11.58 [11:36:04] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.66, 11.57, 11.51 [11:36:27] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.30, 4.10, 3.76 [11:36:48] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.22, 3.88, 3.52 [11:37:34] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.95, 11.90, 11.67 [11:37:36] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.12, 3.93, 3.46 [11:37:36] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 11.97, 11.77, 11.25 [11:37:57] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.26, 11.13, 10.30 [11:38:04] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.60, 12.02, 11.68 [11:38:42] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.09, 3.56, 3.45 [11:39:29] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.95, 3.75, 3.44 [11:39:32] [Grafana] FIRING: Some MediaWiki Appservers are running out of PHP-FPM workers. https://grafana.miraheze.org/d/GtxbP1Xnk [11:39:34] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.75, 12.45, 11.91 [11:39:57] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.76, 10.80, 10.29 [11:40:04] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.95, 11.64, 11.61 [11:40:37] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.37, 3.82, 3.55 [11:41:23] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 3.60, 4.07, 3.61 [11:41:34] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.72, 11.75, 11.72 [11:41:35] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 14.46, 12.58, 11.64 [11:41:57] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.01, 11.24, 10.50 [11:42:32] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.53, 3.53, 3.46 [11:43:17] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.77, 3.94, 3.62 [11:43:34] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 10.61, 11.97, 11.55 [11:43:50] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 9.45, 7.49, 6.59 [11:43:57] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.14, 10.38, 10.28 [11:44:26] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.95, 3.27, 3.37 [11:45:33] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 13.76, 12.51, 11.78 [11:45:48] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.50, 7.38, 6.66 [11:46:04] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 13.17, 11.79, 11.59 [11:47:04] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.56, 3.19, 3.38 [11:47:34] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.12, 12.00, 11.75 [11:48:04] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 11.83, 11.75, 11.60 [11:48:18] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.24, 3.53, 3.82 [11:50:30] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 12.56, 11.05, 9.87 [11:51:34] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.83, 11.27, 11.59 [11:51:57] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.13, 9.53, 10.01 [11:52:15] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 6.25, 4.16, 3.94 [11:52:27] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.92, 10.02, 9.65 [11:53:30] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 10.35, 11.70, 11.81 [11:53:34] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.06, 11.42, 11.59 [11:54:13] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.92, 4.36, 3.67 [11:54:38] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 7.17, 5.31, 4.15 [11:55:29] PROBLEM - cp30 Stunnel HTTP for mw111 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:55:34] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.04, 11.40, 11.57 [11:55:35] PROBLEM - cp31 Stunnel HTTP for mw111 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:55:46] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 6.41, 6.72, 6.66 [11:57:34] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.85, 11.71, 11.65 [11:57:46] PROBLEM - mw111 MediaWiki Rendering on mw111 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:57:49] PROBLEM - cp20 Stunnel HTTP for mw111 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:58:16] PROBLEM - cp21 Stunnel HTTP for mw111 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:59:34] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.86, 11.32, 11.51 [11:59:52] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.32, 10.93, 11.85 [12:01:52] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.96, 11.70, 12.01 [12:03:58] RECOVERY - cp30 Stunnel HTTP for mw111 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 9.587 second response time [12:04:07] RECOVERY - cp31 Stunnel HTTP for mw111 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 9.368 second response time [12:04:09] RECOVERY - cp20 Stunnel HTTP for mw111 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 9.420 second response time [12:04:34] RECOVERY - cp21 Stunnel HTTP for mw111 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 5.678 second response time [12:05:34] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.18, 11.70, 11.56 [12:06:08] RECOVERY - mw111 MediaWiki Rendering on mw111 is OK: HTTP OK: HTTP/1.1 200 OK - 28480 bytes in 2.254 second response time [12:07:12] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 6.12, 5.78, 3.07 [12:07:34] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.97, 11.62, 11.56 [12:08:04] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 11.53, 10.05, 9.61 [12:08:04] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 8.93, 9.56, 10.19 [12:10:01] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 9.06, 9.62, 9.50 [12:10:18] PROBLEM - cp30 Stunnel HTTP for mw111 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:10:28] PROBLEM - cp20 Stunnel HTTP for mw111 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:10:31] PROBLEM - mw111 MediaWiki Rendering on mw111 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:10:31] PROBLEM - cp31 Stunnel HTTP for mw111 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:10:42] PROBLEM - cp21 Current Load on cp21 is WARNING: WARNING - load average: 1.81, 1.65, 1.47 [12:10:56] PROBLEM - cp21 Stunnel HTTP for mw111 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:11:23] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 13.32, 11.17, 11.22 [12:12:04] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.35, 9.93, 10.25 [12:12:43] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CRITICAL - load average: 2.10, 1.61, 1.46 [12:13:23] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 10.88, 11.09, 11.19 [12:13:25] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 10.80, 8.14, 7.09 [12:14:04] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 9.35, 9.65, 10.10 [12:14:42] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 1.05, 1.38, 1.40 [12:15:23] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 6.98, 7.87, 7.13 [12:16:57] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 0.33, 1.30, 1.93 [12:17:16] RECOVERY - cp21 Stunnel HTTP for mw111 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 8.598 second response time [12:18:41] RECOVERY - cp30 Stunnel HTTP for mw111 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 4.800 second response time [12:18:49] RECOVERY - cp20 Stunnel HTTP for mw111 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 3.079 second response time [12:18:56] RECOVERY - mw111 MediaWiki Rendering on mw111 is OK: HTTP OK: HTTP/1.1 200 OK - 28479 bytes in 4.267 second response time [12:18:58] RECOVERY - cp31 Stunnel HTTP for mw111 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 4.188 second response time [12:20:50] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 0.36, 0.88, 1.61 [12:21:16] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 8.33, 8.00, 7.38 [12:21:45] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 11.45, 10.56, 9.92 [12:23:13] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.15, 7.59, 7.29 [12:24:04] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.34, 9.64, 9.67 [12:25:34] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.16, 10.83, 10.81 [12:25:45] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 12.98, 11.09, 10.20 [12:26:12] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.12, 9.90, 9.39 [12:27:34] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.71, 10.99, 10.89 [12:27:45] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 10.53, 10.70, 10.17 [12:28:04] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 9.19, 9.75, 9.74 [12:28:09] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.73, 9.61, 9.35 [12:29:34] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.37, 11.32, 11.01 [12:29:45] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 9.23, 10.15, 10.03 [12:31:34] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.74, 11.41, 11.08 [12:32:04] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 13.23, 11.16, 10.27 [12:33:02] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 4.37, 5.79, 6.72 [12:33:26] PROBLEM - cp20 Stunnel HTTP for mw111 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:33:44] PROBLEM - cp31 Stunnel HTTP for mw111 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:33:45] PROBLEM - mw111 MediaWiki Rendering on mw111 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:34:03] PROBLEM - cp21 Stunnel HTTP for mw111 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:34:04] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.66, 10.39, 10.08 [12:34:19] PROBLEM - cp30 Stunnel HTTP for mw111 on cp30 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 328 bytes in 0.235 second response time [12:35:34] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.43, 11.47, 11.14 [12:36:04] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 9.69, 10.18, 10.04 [12:41:12] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 13.59, 11.38, 10.81 [12:41:34] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.74, 11.79, 11.40 [12:41:48] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.89, 7.33, 7.07 [12:42:04] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 11.02, 10.56, 10.22 [12:42:43] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.91, 11.01, 10.20 [12:43:34] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.06, 11.80, 11.45 [12:43:46] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 8.18, 7.47, 7.14 [12:44:04] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 10.02, 10.19, 10.11 [12:44:40] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.14, 10.15, 10.00 [12:45:10] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.38, 10.47, 10.57 [12:45:34] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.16, 11.31, 11.33 [12:45:46] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 5.62, 6.69, 6.89 [12:46:08] RECOVERY - cp20 Stunnel HTTP for mw111 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 8.781 second response time [12:46:13] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.47, 3.31, 3.96 [12:46:18] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.76, 3.33, 3.89 [12:47:46] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 10.44, 7.86, 7.28 [12:48:04] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.99, 10.72, 10.36 [12:48:13] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 3.96, 3.94, 4.13 [12:48:32] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.81, 10.36, 10.14 [12:49:46] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.64, 7.84, 7.35 [12:50:18] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.89, 4.12, 4.10 [12:50:29] PROBLEM - cp20 Stunnel HTTP for mw111 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:50:29] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 9.88, 9.94, 9.99 [12:51:46] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 8.41, 8.17, 7.54 [12:52:04] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 13.02, 11.53, 10.74 [12:52:19] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 10.76, 9.74, 9.34 [12:53:07] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 13.07, 11.29, 10.79 [12:53:21] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.95, 1.60, 1.14 [12:53:41] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.79, 3.34, 3.95 [12:53:46] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 6.77, 7.85, 7.51 [12:54:04] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.68, 11.00, 10.63 [12:54:13] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.27, 3.64, 3.95 [12:54:16] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 9.61, 9.55, 9.31 [12:55:06] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 11.31, 11.27, 10.84 [12:55:20] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.36, 1.49, 1.16 [12:55:40] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.54, 3.94, 4.07 [12:55:46] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 9.72, 8.22, 7.67 [12:56:12] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.90, 4.48, 4.24 [12:56:18] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.77, 10.59, 10.28 [12:57:05] RECOVERY - mw111 MediaWiki Rendering on mw111 is OK: HTTP OK: HTTP/1.1 200 OK - 28479 bytes in 5.656 second response time [12:57:06] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 12.40, 11.65, 11.04 [12:57:08] RECOVERY - cp31 Stunnel HTTP for mw111 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 4.939 second response time [12:57:14] RECOVERY - cp21 Stunnel HTTP for mw111 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 5.695 second response time [12:57:21] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CRITICAL - load average: 2.06, 1.77, 1.57 [12:57:46] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 6.63, 7.85, 7.62 [12:59:05] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 10.68, 11.20, 10.94 [12:59:15] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 1.54, 1.63, 1.54 [12:59:46] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 11.40, 8.64, 7.90 [13:00:12] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.63, 9.87, 10.10 [13:01:26] PROBLEM - cp21 Stunnel HTTP for mw111 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:01:28] PROBLEM - mw111 MediaWiki Rendering on mw111 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:01:34] PROBLEM - cp31 Stunnel HTTP for mw111 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:01:46] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.35, 7.96, 7.73 [13:02:04] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.89, 11.47, 10.88 [13:02:18] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.47, 3.69, 3.89 [13:03:04] PROBLEM - cp21 Current Load on cp21 is WARNING: WARNING - load average: 1.62, 1.91, 1.70 [13:03:34] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.43, 10.69, 10.83 [13:03:46] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 8.09, 8.14, 7.83 [13:04:04] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.30, 11.10, 10.82 [13:04:58] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 0.73, 1.56, 1.60 [13:07:46] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 5.85, 7.43, 7.65 [13:09:34] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.59, 11.69, 11.28 [13:10:18] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.40, 3.84, 3.79 [13:10:49] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.44, 10.53, 10.28 [13:11:00] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 12.18, 10.92, 10.69 [13:11:29] RECOVERY - cp20 Stunnel HTTP for mw111 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 1.087 second response time [13:11:34] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.23, 11.70, 11.31 [13:11:49] RECOVERY - mw111 MediaWiki Rendering on mw111 is OK: HTTP OK: HTTP/1.1 200 OK - 28479 bytes in 2.941 second response time [13:11:54] RECOVERY - cp21 Stunnel HTTP for mw111 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 0.676 second response time [13:11:57] RECOVERY - cp31 Stunnel HTTP for mw111 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 1.364 second response time [13:12:04] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.02, 10.57, 10.66 [13:12:10] RECOVERY - cp30 Stunnel HTTP for mw111 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 2.334 second response time [13:12:18] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 4.00, 3.79, 3.78 [13:14:04] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 11.04, 10.65, 10.67 [13:14:18] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 6.98, 4.77, 4.13 [13:14:44] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.21, 9.92, 10.13 [13:15:34] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.23, 11.76, 11.47 [13:17:46] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 5.20, 5.92, 6.70 [13:18:57] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 11.67, 11.46, 11.11 [13:20:04] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 13.19, 11.73, 11.11 [13:24:04] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.89, 11.83, 11.34 [13:24:42] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CRITICAL - load average: 2.30, 2.93, 2.09 [13:26:03] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.11, 1.32, 1.09 [13:28:03] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 0.47, 0.98, 1.00 [13:29:52] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.30, 11.66, 11.99 [13:31:52] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 14.04, 12.64, 12.31 [13:32:04] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 13.33, 11.97, 11.45 [13:32:27] PROBLEM - cp30 Stunnel HTTP for mw122 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:33:34] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.55, 11.54, 11.47 [13:34:04] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 11.86, 11.78, 11.43 [13:34:10] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.05, 10.11, 9.85 [13:35:21] PROBLEM - cp20 Stunnel HTTP for mw111 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:36:00] PROBLEM - mw111 MediaWiki Rendering on mw111 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:36:04] PROBLEM - cp30 Stunnel HTTP for mw111 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:36:07] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.20, 9.51, 9.67 [13:36:21] PROBLEM - cp31 Stunnel HTTP for mw111 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:36:35] RECOVERY - cp30 Stunnel HTTP for mw122 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 8.834 second response time [13:37:34] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.95, 11.99, 11.74 [13:38:42] PROBLEM - cp21 Current Load on cp21 is WARNING: WARNING - load average: 1.29, 1.76, 1.93 [13:39:27] RECOVERY - cp20 Stunnel HTTP for mw111 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 1.794 second response time [13:40:04] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.52, 11.52, 11.34 [13:40:10] RECOVERY - mw111 MediaWiki Rendering on mw111 is OK: HTTP OK: HTTP/1.1 200 OK - 28487 bytes in 5.003 second response time [13:40:12] RECOVERY - cp30 Stunnel HTTP for mw111 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 3.654 second response time [13:40:30] RECOVERY - cp31 Stunnel HTTP for mw111 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 3.397 second response time [13:40:49] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 14.02, 11.92, 11.20 [13:41:34] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.52, 12.10, 11.83 [13:41:57] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.38, 11.35, 10.35 [13:42:43] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CRITICAL - load average: 2.74, 2.04, 1.98 [13:44:04] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 11.95, 11.81, 11.51 [13:44:42] PROBLEM - cp21 Current Load on cp21 is WARNING: WARNING - load average: 1.05, 1.73, 1.88 [13:45:57] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.85, 11.79, 10.76 [13:49:34] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.16, 11.46, 11.76 [13:49:45] PROBLEM - cp21 Stunnel HTTP for mw111 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:49:56] PROBLEM - cp20 Stunnel HTTP for mw111 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:50:04] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.65, 11.55, 11.43 [13:51:57] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.71, 9.75, 10.18 [13:52:04] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.43, 10.65, 11.11 [13:52:15] PROBLEM - cp31 Stunnel HTTP for mw111 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:52:40] PROBLEM - cp30 Stunnel HTTP for mw111 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:52:51] PROBLEM - mw111 MediaWiki Rendering on mw111 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:54:42] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 1.38, 1.39, 1.63 [13:54:47] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 10.99, 11.56, 11.70 [13:58:42] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CRITICAL - load average: 2.08, 2.62, 2.11 [13:59:45] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 10.08, 10.67, 10.01 [14:00:04] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.31, 10.66, 10.81 [14:01:20] RECOVERY - mw111 MediaWiki Rendering on mw111 is OK: HTTP OK: HTTP/1.1 200 OK - 28487 bytes in 8.794 second response time [14:01:45] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 8.75, 9.79, 9.75 [14:02:15] RECOVERY - cp21 Stunnel HTTP for mw111 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 5.486 second response time [14:02:29] RECOVERY - cp20 Stunnel HTTP for mw111 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 2.210 second response time [14:02:42] PROBLEM - cp21 Current Load on cp21 is WARNING: WARNING - load average: 1.12, 1.77, 1.87 [14:02:50] RECOVERY - cp31 Stunnel HTTP for mw111 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 4.278 second response time [14:03:13] RECOVERY - cp30 Stunnel HTTP for mw111 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 6.656 second response time [14:03:34] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.14, 10.88, 10.97 [14:06:42] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 0.63, 1.30, 1.67 [14:06:47] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 13.35, 11.86, 11.54 [14:06:52] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 8.96, 6.97, 6.39 [14:07:45] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 11.55, 10.32, 9.95 [14:08:47] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 11.24, 11.66, 11.52 [14:08:49] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.83, 10.53, 10.08 [14:08:50] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 6.65, 6.64, 6.34 [14:12:47] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 13.37, 12.52, 11.88 [14:14:04] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 11.15, 12.00, 11.88 [14:15:45] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 8.41, 10.09, 10.10 [14:16:37] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.09, 9.58, 9.99 [14:16:39] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 9.08, 7.05, 6.50 [14:16:47] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 10.25, 11.95, 11.86 [14:18:04] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.70, 12.32, 12.03 [14:18:36] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.08, 7.05, 6.57 [14:18:47] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 12.62, 12.19, 11.95 [14:19:45] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 12.85, 11.54, 10.66 [14:20:04] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.31, 11.76, 11.87 [14:22:02] PROBLEM - cp30 Stunnel HTTP for mw111 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:22:05] PROBLEM - cp21 Stunnel HTTP for mw111 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:22:15] PROBLEM - cp20 Stunnel HTTP for mw111 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:22:16] PROBLEM - mw111 MediaWiki Rendering on mw111 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:22:47] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.68, 11.38, 11.73 [14:23:45] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 10.78, 11.68, 10.97 [14:23:49] PROBLEM - cp31 Stunnel HTTP for mw111 on cp31 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 328 bytes in 0.240 second response time [14:24:29] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 5.60, 6.52, 6.53 [14:24:47] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 12.69, 11.80, 11.84 [14:25:57] RECOVERY - cp31 Stunnel HTTP for mw111 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 9.895 second response time [14:26:16] RECOVERY - cp30 Stunnel HTTP for mw111 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 9.320 second response time [14:26:19] RECOVERY - cp21 Stunnel HTTP for mw111 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 9.252 second response time [14:26:28] RECOVERY - cp20 Stunnel HTTP for mw111 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 9.361 second response time [14:27:34] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.74, 11.29, 11.78 [14:28:35] RECOVERY - mw111 MediaWiki Rendering on mw111 is OK: HTTP OK: HTTP/1.1 200 OK - 28479 bytes in 5.723 second response time [14:29:34] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.80, 11.91, 11.94 [14:30:04] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.30, 11.52, 11.62 [14:30:47] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 11.07, 11.83, 11.86 [14:31:34] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.13, 11.67, 11.85 [14:32:18] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.19, 6.55, 6.44 [14:32:47] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 12.46, 11.95, 11.89 [14:33:34] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.35, 11.75, 11.84 [14:33:45] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.92, 9.11, 10.07 [14:36:13] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 5.69, 6.54, 6.49 [14:36:47] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 11.60, 11.49, 11.71 [14:38:41] PROBLEM - cp31 Stunnel HTTP for mw111 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:38:47] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 13.86, 12.27, 11.96 [14:38:50] PROBLEM - cp30 Stunnel HTTP for mw111 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:38:56] PROBLEM - cp21 Stunnel HTTP for mw111 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:39:01] PROBLEM - cp20 Stunnel HTTP for mw111 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:39:13] PROBLEM - mw111 MediaWiki Rendering on mw111 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:39:34] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.63, 11.76, 11.86 [14:40:56] RECOVERY - cp30 Stunnel HTTP for mw111 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 8.911 second response time [14:41:02] RECOVERY - cp21 Stunnel HTTP for mw111 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 8.793 second response time [14:41:07] RECOVERY - cp20 Stunnel HTTP for mw111 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 9.061 second response time [14:41:57] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.79, 11.23, 10.42 [14:42:57] PROBLEM - mw102 MediaWiki Rendering on mw102 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:42:57] RECOVERY - cp31 Stunnel HTTP for mw111 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 9.746 second response time [14:43:01] PROBLEM - cp20 Stunnel HTTP for mw102 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:43:25] RECOVERY - mw111 MediaWiki Rendering on mw111 is OK: HTTP OK: HTTP/1.1 200 OK - 28479 bytes in 7.115 second response time [14:43:34] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.89, 11.94, 11.88 [14:43:37] PROBLEM - cp30 Stunnel HTTP for mw102 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:44:33] PROBLEM - cp21 Stunnel HTTP for mw102 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:46:04] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.13, 11.76, 12.00 [14:46:37] RECOVERY - cp21 Stunnel HTTP for mw102 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 8.573 second response time [14:47:09] RECOVERY - mw102 MediaWiki Rendering on mw102 is OK: HTTP OK: HTTP/1.1 200 OK - 28479 bytes in 6.466 second response time [14:47:12] RECOVERY - cp20 Stunnel HTTP for mw102 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 4.962 second response time [14:47:34] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.05, 11.79, 11.87 [14:47:49] RECOVERY - cp30 Stunnel HTTP for mw102 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 2.610 second response time [14:47:57] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.58, 11.76, 10.91 [14:49:34] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 14.26, 12.65, 12.17 [14:49:57] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.80, 11.02, 10.74 [14:50:02] PROBLEM - cp21 Current Load on cp21 is WARNING: WARNING - load average: 1.97, 1.62, 1.33 [14:50:04] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 13.59, 12.46, 12.20 [14:50:30] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 14.61, 11.31, 10.42 [14:51:56] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 1.36, 1.52, 1.33 [14:52:25] PROBLEM - cp31 Stunnel HTTP for mw111 on cp31 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 328 bytes in 0.240 second response time [14:52:27] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 11.99, 11.28, 10.51 [14:52:34] PROBLEM - cp30 Stunnel HTTP for mw111 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:52:40] PROBLEM - cp21 Stunnel HTTP for mw111 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:52:42] PROBLEM - cp20 Stunnel HTTP for mw111 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:54:04] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.28, 11.16, 11.77 [14:55:09] PROBLEM - mw111 MediaWiki Rendering on mw111 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:55:57] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.81, 9.35, 10.13 [14:56:22] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 8.05, 9.74, 10.07 [14:56:39] RECOVERY - cp31 Stunnel HTTP for mw111 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 8.008 second response time [14:56:46] RECOVERY - cp30 Stunnel HTTP for mw111 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 7.816 second response time [14:56:47] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 10.00, 10.90, 11.70 [14:56:54] RECOVERY - cp21 Stunnel HTTP for mw111 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 8.079 second response time [14:56:54] RECOVERY - cp20 Stunnel HTTP for mw111 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 8.254 second response time [14:57:16] RECOVERY - mw111 MediaWiki Rendering on mw111 is OK: HTTP OK: HTTP/1.1 200 OK - 28479 bytes in 8.840 second response time [14:57:34] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.25, 11.65, 11.93 [14:57:43] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CRITICAL - load average: 3.27, 2.04, 1.55 [15:01:31] PROBLEM - cp21 Current Load on cp21 is WARNING: WARNING - load average: 1.52, 1.95, 1.63 [15:02:04] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 13.67, 12.08, 11.80 [15:03:26] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 1.01, 1.64, 1.56 [15:06:22] PROBLEM - cp20 Stunnel HTTP for mw111 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:06:24] PROBLEM - cp21 Stunnel HTTP for mw111 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:06:47] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 12.61, 12.07, 11.82 [15:07:53] PROBLEM - mw111 MediaWiki Rendering on mw111 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:08:04] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.59, 11.26, 11.58 [15:08:18] PROBLEM - cp31 Stunnel HTTP for mw111 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:08:18] PROBLEM - cp30 Stunnel HTTP for mw111 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:09:59] RECOVERY - mw111 MediaWiki Rendering on mw111 is OK: HTTP OK: HTTP/1.1 200 OK - 28479 bytes in 8.380 second response time [15:10:23] RECOVERY - cp30 Stunnel HTTP for mw111 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 7.071 second response time [15:10:23] RECOVERY - cp31 Stunnel HTTP for mw111 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 6.930 second response time [15:10:32] RECOVERY - cp20 Stunnel HTTP for mw111 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 6.937 second response time [15:10:36] RECOVERY - cp21 Stunnel HTTP for mw111 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 7.259 second response time [15:12:40] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.02, 10.82, 10.35 [15:13:34] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.08, 11.16, 11.44 [15:14:47] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 10.41, 11.97, 11.98 [15:14:57] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.72, 1.47, 1.08 [15:16:35] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 9.80, 10.07, 10.13 [15:16:46] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CRITICAL - load average: 2.01, 1.69, 1.50 [15:16:54] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.64, 1.15, 1.00 [15:17:34] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.54, 11.08, 11.39 [15:18:38] PROBLEM - mw111 MediaWiki Rendering on mw111 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:18:42] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 1.15, 1.47, 1.45 [15:18:47] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 12.24, 12.10, 12.02 [15:19:03] PROBLEM - cp20 Stunnel HTTP for mw111 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:20:04] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.09, 10.71, 10.95 [15:21:03] PROBLEM - cp30 Stunnel HTTP for mw111 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:21:07] PROBLEM - cp31 Stunnel HTTP for mw111 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:21:18] PROBLEM - cp21 Stunnel HTTP for mw111 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:21:45] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 11.66, 10.06, 9.39 [15:22:04] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 11.14, 10.81, 10.95 [15:24:47] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 11.57, 11.79, 11.94 [15:28:47] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 12.80, 11.86, 11.91 [15:29:14] RECOVERY - mw111 MediaWiki Rendering on mw111 is OK: HTTP OK: HTTP/1.1 200 OK - 28479 bytes in 8.066 second response time [15:29:18] RECOVERY - cp30 Stunnel HTTP for mw111 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 7.050 second response time [15:29:34] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.82, 10.68, 10.73 [15:29:34] RECOVERY - cp20 Stunnel HTTP for mw111 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 6.732 second response time [15:29:37] RECOVERY - cp31 Stunnel HTTP for mw111 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 7.443 second response time [15:29:45] RECOVERY - cp21 Stunnel HTTP for mw111 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 7.792 second response time [15:29:45] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 9.51, 10.10, 9.68 [15:30:47] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 11.89, 11.72, 11.85 [15:31:34] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.33, 10.70, 10.72 [15:32:04] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.66, 11.38, 10.99 [15:33:34] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.45, 11.12, 10.86 [15:36:03] PROBLEM - cp20 Stunnel HTTP for mw111 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:36:47] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 13.16, 12.15, 11.92 [15:36:51] PROBLEM - mw111 MediaWiki Rendering on mw111 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:36:52] PROBLEM - cp30 Stunnel HTTP for mw111 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:37:14] PROBLEM - cp31 Stunnel HTTP for mw111 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:38:04] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.75, 11.72, 11.40 [15:38:21] PROBLEM - cp21 Stunnel HTTP for mw111 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:38:47] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 10.62, 11.27, 11.61 [15:38:56] RECOVERY - mw111 MediaWiki Rendering on mw111 is OK: HTTP OK: HTTP/1.1 200 OK - 28479 bytes in 7.356 second response time [15:38:56] RECOVERY - cp30 Stunnel HTTP for mw111 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 7.052 second response time [15:39:19] RECOVERY - cp31 Stunnel HTTP for mw111 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 6.761 second response time [15:39:32] [Grafana] FIRING: Some MediaWiki Appservers are running out of PHP-FPM workers. https://grafana.miraheze.org/d/GtxbP1Xnk [15:39:34] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.98, 11.71, 11.25 [15:40:13] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.76, 3.56, 4.00 [15:40:15] RECOVERY - cp20 Stunnel HTTP for mw111 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 8.171 second response time [15:40:26] RECOVERY - cp21 Stunnel HTTP for mw111 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 8.301 second response time [15:41:43] PROBLEM - cloud10 Puppet on cloud10 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[ulogd2] [15:42:13] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 3.96, 3.94, 4.09 [15:43:34] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.03, 12.00, 11.44 [15:44:47] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 12.15, 11.50, 11.61 [15:45:34] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.64, 11.64, 11.37 [15:46:13] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.45, 3.72, 3.98 [15:46:30] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 11.63, 10.44, 9.86 [15:47:34] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.36, 12.29, 11.63 [15:47:57] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.58, 10.37, 9.86 [15:48:04] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.46, 11.59, 11.29 [15:49:57] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.94, 9.85, 9.77 [15:50:04] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.45, 11.16, 11.18 [15:50:13] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 7.33, 4.80, 4.29 [15:52:04] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.07, 11.70, 11.38 [15:52:22] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 12.52, 11.22, 10.32 [15:53:57] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.49, 10.22, 9.96 [15:55:34] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.27, 11.69, 11.62 [15:55:57] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.44, 10.98, 10.26 [15:56:16] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 11.94, 11.61, 10.70 [15:57:57] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.27, 11.10, 10.40 [15:58:04] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 8.84, 10.93, 11.27 [15:59:57] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.47, 10.02, 10.08 [16:00:09] PROBLEM - cp31 Stunnel HTTP for mw111 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:02:04] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 13.48, 11.54, 11.36 [16:02:16] RECOVERY - cp31 Stunnel HTTP for mw111 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 9.148 second response time [16:03:34] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.53, 11.62, 11.54 [16:04:04] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.36, 11.42, 11.36 [16:05:56] PROBLEM - cp30 Stunnel HTTP for mw111 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:06:33] PROBLEM - cp21 Stunnel HTTP for mw111 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:06:40] PROBLEM - cp31 Stunnel HTTP for mw111 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:06:47] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.20, 11.01, 11.81 [16:07:13] PROBLEM - mw111 MediaWiki Rendering on mw111 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:07:34] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.10, 11.65, 11.62 [16:09:17] RECOVERY - mw111 MediaWiki Rendering on mw111 is OK: HTTP OK: HTTP/1.1 200 OK - 28479 bytes in 6.364 second response time [16:09:43] RECOVERY - cloud10 Puppet on cloud10 is OK: OK: Puppet is currently enabled, last run 34 seconds ago with 0 failures [16:09:58] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 8.52, 9.35, 10.10 [16:10:04] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.18, 11.49, 11.37 [16:10:06] RECOVERY - cp30 Stunnel HTTP for mw111 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 5.633 second response time [16:10:43] RECOVERY - cp21 Stunnel HTTP for mw111 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 5.108 second response time [16:10:47] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 13.88, 11.76, 11.88 [16:10:52] RECOVERY - cp31 Stunnel HTTP for mw111 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 5.721 second response time [16:12:04] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.69, 11.14, 11.25 [16:12:43] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.26, 10.74, 10.35 [16:12:47] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 11.33, 11.68, 11.85 [16:13:34] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.20, 11.68, 11.56 [16:13:55] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-4 [+0/-0/±1] 13https://github.com/miraheze/mw-config/commit/5ab5e3a4544f [16:13:57] [02miraheze/mw-config] 07Universal-Omega 035ab5e3a - Rename `$wgTranslateBlacklist` [16:13:58] [02mw-config] 07Universal-Omega created branch 03Universal-Omega-patch-4 - 13https://github.com/miraheze/mw-config [16:13:59] [url] Page not found · GitHub · GitHub | github.com [16:14:02] [02mw-config] 07Universal-Omega opened pull request 03#4823: Rename `$wgTranslateBlacklist` - 13https://github.com/miraheze/mw-config/pull/4823 [16:14:03] [url] Page not found · GitHub · GitHub | github.com [16:14:04] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 13.17, 11.88, 11.51 [16:14:27] [02puppet] 07Universal-Omega opened pull request 03#2702: jobQueueCollector: add TranslatableBundleDeleteJob - 13https://github.com/miraheze/puppet/pull/2702 [16:14:27] [url] Page not found · GitHub · GitHub | github.com [16:14:40] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.56, 9.88, 10.10 [16:15:18] miraheze/mw-config - Universal-Omega the build passed. [16:15:34] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.79, 10.94, 11.31 [16:16:47] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 12.68, 11.70, 11.78 [16:19:34] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.15, 11.73, 11.52 [16:20:04] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 11.35, 11.82, 11.58 [16:20:18] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.56, 3.64, 3.99 [16:20:29] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.43, 10.80, 10.48 [16:21:34] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.93, 11.36, 11.42 [16:21:46] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 12.65, 11.63, 10.61 [16:22:47] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 11.32, 11.91, 11.93 [16:23:41] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.36, 3.52, 3.99 [16:23:45] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 11.14, 11.34, 10.63 [16:24:04] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.49, 11.77, 11.58 [16:24:18] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.63, 4.27, 4.12 [16:24:23] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.76, 9.40, 9.97 [16:24:40] PROBLEM - cp31 Stunnel HTTP for mw111 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:24:47] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 12.72, 12.26, 12.06 [16:24:49] PROBLEM - cp20 Stunnel HTTP for mw111 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:24:50] [02mw-config] 07Universal-Omega commented on pull request 03#4822: Update $wgTranslateBlacklist for hkrailwiki - 13https://github.com/miraheze/mw-config/pull/4822#issuecomment-1191694833 [16:24:50] [url] Update $wgTranslateBlacklist for hkrailwiki by LuciferianThomas · Pull Request #4822 · miraheze/mw-config · GitHub | github.com [16:24:56] PROBLEM - cp30 Stunnel HTTP for mw111 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:25:09] PROBLEM - mw111 MediaWiki Rendering on mw111 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:25:32] PROBLEM - cp21 Stunnel HTTP for mw111 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:25:34] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.13, 11.90, 11.60 [16:26:04] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 11.83, 11.61, 11.53 [16:26:47] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 10.59, 11.78, 11.92 [16:28:15] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.99, 11.07, 10.49 [16:29:34] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.18, 11.83, 11.66 [16:29:45] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.01, 9.41, 10.09 [16:29:46] RECOVERY - cp21 Stunnel HTTP for mw111 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 9.388 second response time [16:30:04] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 13.07, 11.77, 11.57 [16:30:12] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.92, 11.32, 10.66 [16:30:57] RECOVERY - cp31 Stunnel HTTP for mw111 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 3.110 second response time [16:31:02] RECOVERY - cp20 Stunnel HTTP for mw111 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 2.656 second response time [16:31:11] RECOVERY - cp30 Stunnel HTTP for mw111 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 3.707 second response time [16:31:25] RECOVERY - mw111 MediaWiki Rendering on mw111 is OK: HTTP OK: HTTP/1.1 200 OK - 28480 bytes in 3.109 second response time [16:32:18] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.10, 3.71, 3.93 [16:33:34] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.42, 12.15, 11.78 [16:34:18] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.16, 3.78, 3.92 [16:35:40] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.46, 3.96, 3.93 [16:37:24] PROBLEM - cp20 Stunnel HTTP for mw111 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:37:24] PROBLEM - cp31 Stunnel HTTP for mw111 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:37:37] PROBLEM - cp30 Stunnel HTTP for mw111 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:37:53] PROBLEM - mw111 MediaWiki Rendering on mw111 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:38:00] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.05, 11.14, 10.72 [16:38:09] PROBLEM - cp21 Stunnel HTTP for mw111 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:39:58] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.88, 10.71, 10.59 [16:40:47] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 12.76, 11.46, 11.39 [16:41:37] RECOVERY - cp20 Stunnel HTTP for mw111 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 9.841 second response time [16:41:39] RECOVERY - cp31 Stunnel HTTP for mw111 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 9.615 second response time [16:41:50] RECOVERY - cp30 Stunnel HTTP for mw111 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 8.675 second response time [16:42:04] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 11.27, 11.69, 11.84 [16:42:18] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 1.92, 3.58, 3.94 [16:43:57] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.03, 11.19, 10.80 [16:44:08] RECOVERY - mw111 MediaWiki Rendering on mw111 is OK: HTTP OK: HTTP/1.1 200 OK - 28479 bytes in 2.342 second response time [16:44:25] RECOVERY - cp21 Stunnel HTTP for mw111 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 3.177 second response time [16:47:57] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.59, 11.64, 11.09 [16:48:04] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 13.06, 12.21, 11.97 [16:48:12] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.54, 3.38, 3.89 [16:48:47] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 10.84, 11.85, 11.80 [16:49:45] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 11.13, 9.67, 9.29 [16:50:04] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.50, 11.63, 11.80 [16:50:18] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.12, 3.54, 3.72 [16:51:45] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 8.20, 9.04, 9.10 [16:52:18] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.83, 3.30, 3.61 [16:53:34] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.69, 10.53, 11.60 [16:54:04] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.72, 11.71, 11.75 [16:55:57] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.39, 8.85, 10.02 [16:56:04] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 11.01, 11.50, 11.67 [16:56:13] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 3.99, 4.04, 4.02 [16:57:32] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CRITICAL - load average: 2.59, 1.99, 1.39 [16:58:18] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 6.49, 4.48, 3.93 [16:59:26] PROBLEM - cp21 Current Load on cp21 is WARNING: WARNING - load average: 1.16, 1.71, 1.36 [16:59:34] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.00, 11.77, 11.78 [17:01:20] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 1.57, 1.68, 1.39 [17:01:34] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.57, 11.35, 11.63 [17:02:04] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.56, 12.15, 11.89 [17:02:25] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.22, 1.56, 1.36 [17:04:04] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.79, 11.64, 11.74 [17:04:18] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.32, 3.81, 3.83 [17:04:24] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.26, 1.36, 1.30 [17:04:47] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 13.74, 11.72, 11.31 [17:05:46] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.36, 6.75, 6.22 [17:08:18] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.27, 4.06, 3.92 [17:08:47] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 11.03, 11.63, 11.40 [17:09:34] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.51, 11.56, 11.51 [17:09:46] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 5.11, 6.37, 6.24 [17:10:18] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.61, 3.42, 3.70 [17:10:47] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 12.44, 11.77, 11.47 [17:11:34] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.61, 11.73, 11.59 [17:12:04] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.89, 11.06, 11.23 [17:13:57] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.38, 10.66, 10.15 [17:14:04] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.59, 10.94, 11.17 [17:14:18] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 6.32, 4.32, 3.95 [17:14:47] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 10.18, 11.88, 11.67 [17:15:57] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.49, 9.88, 9.93 [17:18:18] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.68, 3.84, 3.83 [17:20:18] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.14, 3.98, 3.88 [17:22:04] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.35, 11.27, 11.11 [17:22:11] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 11.64, 10.12, 9.33 [17:22:18] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.86, 3.98, 3.90 [17:24:04] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.88, 11.07, 11.05 [17:24:09] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 9.18, 9.91, 9.37 [17:24:47] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 12.11, 11.47, 11.42 [17:25:34] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.04, 11.01, 11.03 [17:26:47] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 11.96, 11.55, 11.46 [17:27:34] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.94, 11.20, 11.09 [17:28:18] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.92, 3.97, 3.83 [17:30:55] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 10.50, 10.33, 9.74 [17:32:04] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.29, 11.57, 11.25 [17:32:47] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 12.19, 11.48, 11.42 [17:32:53] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 9.93, 10.05, 9.70 [17:33:34] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.08, 11.69, 11.30 [17:33:46] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 6.90, 6.34, 6.12 [17:34:47] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 10.56, 11.11, 11.29 [17:36:04] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.61, 11.19, 11.19 [17:36:18] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.05, 3.89, 3.95 [17:36:47] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 12.06, 11.33, 11.33 [17:37:46] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 6.25, 6.38, 6.20 [17:38:04] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 13.45, 11.95, 11.47 [17:38:40] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.24, 10.19, 9.84 [17:40:18] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.28, 4.31, 4.08 [17:41:34] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.86, 11.62, 11.63 [17:42:04] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.98, 11.59, 11.47 [17:42:18] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.39, 3.62, 3.86 [17:43:34] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.38, 11.82, 11.69 [17:45:34] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.10, 11.20, 11.49 [17:48:13] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.20, 3.44, 3.98 [17:49:34] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.14, 11.44, 11.48 [17:50:04] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 13.06, 11.66, 11.51 [17:51:34] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.47, 10.64, 11.18 [17:51:39] PROBLEM - matomo101 Current Load on matomo101 is WARNING: WARNING - load average: 3.71, 3.56, 3.26 [17:52:04] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.04, 11.13, 11.35 [17:52:13] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.36, 3.77, 3.95 [17:52:18] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.03, 3.55, 3.55 [17:52:20] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 9.14, 10.13, 10.11 [17:53:35] RECOVERY - matomo101 Current Load on matomo101 is OK: OK - load average: 2.50, 3.15, 3.15 [17:54:03] PROBLEM - cp30 Stunnel HTTP for mw111 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:54:18] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.24, 3.43, 3.51 [17:54:47] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 8.81, 11.03, 11.87 [17:55:45] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 10.52, 10.22, 9.75 [17:56:06] RECOVERY - cp30 Stunnel HTTP for mw111 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 5.700 second response time [17:56:18] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.76, 3.80, 3.62 [17:58:47] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 12.72, 11.48, 11.83 [17:59:34] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.33, 11.55, 11.25 [18:00:04] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.30, 10.96, 11.07 [18:00:47] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 10.84, 11.13, 11.65 [18:01:03] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.35, 10.63, 10.28 [18:01:34] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.24, 11.09, 11.13 [18:01:40] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.32, 3.42, 3.86 [18:01:45] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 9.89, 10.07, 9.82 [18:02:18] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.40, 3.93, 3.79 [18:03:00] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.04, 9.42, 9.86 [18:04:04] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 11.22, 11.46, 11.29 [18:05:34] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.38, 11.91, 11.44 [18:06:13] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.36, 3.68, 4.00 [18:07:34] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.75, 11.29, 11.26 [18:07:40] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.37, 3.63, 3.78 [18:08:13] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.30, 4.51, 4.26 [18:09:34] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.02, 11.29, 11.24 [18:09:41] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.97, 3.45, 3.70 [18:10:47] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 13.22, 11.07, 11.34 [18:11:34] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.61, 10.62, 11.00 [18:12:18] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.91, 3.86, 3.74 [18:13:40] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.67, 3.75, 3.74 [18:15:34] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.76, 11.37, 11.18 [18:16:18] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.59, 3.99, 3.84 [18:16:47] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.02, 11.35, 11.58 [18:17:34] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.73, 10.58, 10.91 [18:21:40] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 1.85, 3.42, 3.78 [18:24:13] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.45, 3.41, 3.87 [18:24:18] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.02, 3.24, 3.49 [18:25:40] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.19, 3.41, 3.66 [18:26:13] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.39, 3.46, 3.81 [18:26:18] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.74, 3.30, 3.48 [18:26:54] PROBLEM - cp30 Stunnel HTTP for mw111 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:27:36] PROBLEM - cp31 Stunnel HTTP for mw111 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:27:42] PROBLEM - cp21 Stunnel HTTP for mw111 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:28:18] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.13, 3.84, 3.68 [18:28:47] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 7.82, 8.71, 10.15 [18:28:59] RECOVERY - cp30 Stunnel HTTP for mw111 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 7.725 second response time [18:29:40] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.11, 3.53, 3.68 [18:31:41] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.72, 4.29, 3.97 [18:32:04] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.27, 10.56, 10.46 [18:32:27] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.34, 1.41, 1.01 [18:32:28] PROBLEM - mw111 MediaWiki Rendering on mw111 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:32:35] PROBLEM - cp20 Stunnel HTTP for mw111 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:33:40] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.14, 3.85, 3.85 [18:34:04] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.76, 10.69, 10.53 [18:34:18] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.30, 3.75, 3.80 [18:34:24] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 0.99, 1.19, 0.97 [18:36:04] RECOVERY - cp31 Stunnel HTTP for mw111 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 5.352 second response time [18:36:05] RECOVERY - cp21 Stunnel HTTP for mw111 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 3.803 second response time [18:36:34] RECOVERY - mw111 MediaWiki Rendering on mw111 is OK: HTTP OK: HTTP/1.1 200 OK - 28479 bytes in 1.442 second response time [18:36:39] RECOVERY - cp20 Stunnel HTTP for mw111 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.026 second response time [18:37:41] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.09, 3.93, 3.86 [18:37:47] PROBLEM - cp31 Varnish Backends on cp31 is CRITICAL: 1 backends are down. mw111 [18:38:18] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.68, 4.07, 3.88 [18:38:41] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.35, 2.54, 1.77 [18:38:47] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 12.50, 11.12, 10.57 [18:39:34] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.51, 11.49, 10.98 [18:39:47] RECOVERY - cp31 Varnish Backends on cp31 is OK: All 14 backends are healthy [18:40:04] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.73, 11.71, 11.04 [18:40:13] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.07, 3.57, 3.91 [18:40:18] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.79, 3.96, 3.87 [18:41:34] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.24, 11.27, 10.96 [18:42:04] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.25, 11.18, 10.94 [18:42:13] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 3.79, 4.00, 4.04 [18:42:38] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.82, 1.60, 1.56 [18:44:13] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.61, 3.67, 3.90 [18:46:04] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.22, 11.47, 11.06 [18:47:41] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.80, 3.74, 3.94 [18:48:04] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 11.93, 11.74, 11.22 [18:49:34] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.07, 11.52, 11.12 [18:50:01] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 13.21, 10.85, 9.61 [18:50:04] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.74, 11.99, 11.37 [18:50:18] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.72, 2.85, 3.36 [18:51:58] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 8.76, 9.95, 9.43 [18:52:04] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.27, 11.23, 11.16 [18:52:58] PROBLEM - cp20 Stunnel HTTP for mw111 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:53:04] PROBLEM - mw111 MediaWiki Rendering on mw111 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:53:34] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.52, 11.31, 11.13 [18:53:41] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.20, 3.46, 3.68 [18:54:30] PROBLEM - cp31 Stunnel HTTP for mw111 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:54:45] PROBLEM - cp30 Stunnel HTTP for mw111 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:54:47] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 7.70, 10.81, 11.38 [18:55:40] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.36, 3.31, 3.59 [18:56:29] PROBLEM - cp21 Stunnel HTTP for mw111 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:57:34] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.82, 11.49, 11.19 [18:57:41] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.14, 3.58, 3.65 [18:58:18] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.09, 3.71, 3.52 [18:59:34] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.34, 10.95, 11.03 [19:00:04] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 13.87, 11.36, 11.01 [19:00:18] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.04, 3.63, 3.54 [19:02:13] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.07, 4.26, 3.83 [19:02:38] RECOVERY - cp21 Stunnel HTTP for mw111 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 6.631 second response time [19:02:49] RECOVERY - cp31 Stunnel HTTP for mw111 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 7.123 second response time [19:03:11] RECOVERY - cp30 Stunnel HTTP for mw111 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 7.577 second response time [19:03:30] RECOVERY - cp20 Stunnel HTTP for mw111 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 6.858 second response time [19:03:30] RECOVERY - mw111 MediaWiki Rendering on mw111 is OK: HTTP OK: HTTP/1.1 200 OK - 28480 bytes in 7.975 second response time [19:03:34] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.04, 10.71, 10.86 [19:03:40] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.26, 3.62, 3.66 [19:04:04] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.53, 11.01, 11.00 [19:06:13] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.42, 3.83, 3.75 [19:06:18] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.15, 3.81, 3.64 [19:06:47] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 9.34, 9.05, 10.08 [19:07:34] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.76, 11.30, 11.07 [19:09:34] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.04, 11.55, 11.19 [19:09:40] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.54, 4.08, 3.81 [19:10:13] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.62, 4.05, 3.84 [19:10:18] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.27, 3.55, 3.61 [19:10:47] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 12.03, 10.85, 10.59 [19:11:04] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.91, 1.99, 1.46 [19:11:34] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.57, 11.19, 11.10 [19:12:12] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.34, 9.82, 9.33 [19:12:18] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.61, 3.88, 3.72 [19:13:34] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.02, 11.37, 11.16 [19:14:04] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 9.87, 9.54, 10.20 [19:14:09] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 9.55, 9.57, 9.29 [19:14:59] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.35, 1.60, 1.41 [19:15:34] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.20, 11.25, 11.17 [19:16:13] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.84, 3.70, 3.79 [19:16:18] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.34, 3.83, 3.75 [19:16:47] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 11.34, 11.96, 11.28 [19:18:04] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.61, 10.19, 10.39 [19:20:04] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 14.24, 11.55, 10.85 [19:20:47] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 12.60, 12.06, 11.46 [19:21:34] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.22, 11.79, 11.38 [19:21:45] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 11.65, 10.04, 9.22 [19:22:11] PROBLEM - matomo101 Current Load on matomo101 is WARNING: WARNING - load average: 3.98, 3.35, 2.91 [19:22:13] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.73, 4.14, 3.97 [19:22:47] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.06, 11.19, 11.23 [19:22:57] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.24, 10.06, 9.59 [19:23:34] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.96, 11.82, 11.45 [19:24:04] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.09, 11.06, 10.89 [19:24:07] PROBLEM - matomo101 Current Load on matomo101 is CRITICAL: CRITICAL - load average: 4.40, 3.62, 3.05 [19:24:18] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.24, 3.83, 3.74 [19:25:34] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.33, 11.90, 11.52 [19:26:02] RECOVERY - matomo101 Current Load on matomo101 is OK: OK - load average: 2.02, 3.17, 2.97 [19:26:43] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.14, 1.69, 1.43 [19:27:34] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.79, 11.94, 11.58 [19:27:45] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 8.33, 10.00, 9.56 [19:28:11] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.77, 1.72, 1.46 [19:29:34] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.49, 12.35, 11.76 [19:30:04] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 13.86, 11.49, 11.00 [19:30:10] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.79, 1.42, 1.38 [19:30:39] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.98, 1.95, 1.59 [19:31:34] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.21, 11.51, 11.53 [19:31:40] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.30, 3.81, 4.00 [19:32:04] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 11.53, 11.73, 11.17 [19:32:29] PROBLEM - cp31 Stunnel HTTP for mw111 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:32:43] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.72, 9.82, 9.82 [19:32:46] PROBLEM - cp21 Stunnel HTTP for mw111 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:33:34] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.11, 12.01, 11.70 [19:34:34] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.21, 2.07, 1.72 [19:34:38] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 11.01, 10.52, 9.93 [19:36:04] PROBLEM - mw111 MediaWiki Rendering on mw111 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:36:08] PROBLEM - cp30 Stunnel HTTP for mw111 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:36:13] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.98, 3.67, 3.96 [19:36:18] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.27, 3.45, 3.89 [19:36:34] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.14, 10.36, 10.01 [19:37:49] PROBLEM - cp20 Stunnel HTTP for mw111 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:38:30] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.55, 1.78, 1.67 [19:38:32] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 8.12, 9.72, 9.79 [19:39:32] [Grafana] FIRING: Some MediaWiki Appservers are running out of PHP-FPM workers. https://grafana.miraheze.org/d/GtxbP1Xnk [19:39:34] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.92, 11.93, 11.82 [19:39:41] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 6.54, 4.31, 4.04 [19:40:28] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.97, 1.60, 1.63 [19:41:34] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.38, 12.50, 12.05 [19:41:40] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.51, 3.55, 3.80 [19:41:57] RECOVERY - cp20 Stunnel HTTP for mw111 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 4.623 second response time [19:42:21] RECOVERY - mw111 MediaWiki Rendering on mw111 is OK: HTTP OK: HTTP/1.1 200 OK - 28479 bytes in 4.054 second response time [19:42:24] RECOVERY - cp30 Stunnel HTTP for mw111 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 4.328 second response time [19:43:03] RECOVERY - cp31 Stunnel HTTP for mw111 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 3.524 second response time [19:43:19] RECOVERY - cp21 Stunnel HTTP for mw111 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 4.006 second response time [19:45:34] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.44, 11.51, 11.76 [19:46:13] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.26, 3.85, 3.82 [19:47:34] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.27, 11.73, 11.80 [19:47:40] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.00, 3.80, 3.75 [19:48:46] PROBLEM - mw111 MediaWiki Rendering on mw111 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:49:34] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.76, 10.66, 11.38 [19:49:46] PROBLEM - cp21 Stunnel HTTP for mw111 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:50:18] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 9.93, 5.59, 4.37 [19:50:47] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 7.13, 9.18, 10.13 [19:50:57] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.96, 1.76, 1.53 [19:51:32] PROBLEM - cp20 Stunnel HTTP for mw111 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:51:38] PROBLEM - cp31 Stunnel HTTP for mw111 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:51:41] PROBLEM - cp30 Stunnel HTTP for mw111 on cp30 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 328 bytes in 0.511 second response time [19:51:59] PROBLEM - mw112 MediaWiki Rendering on mw112 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:52:04] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 7.21, 8.83, 10.02 [19:52:12] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.63, 9.49, 10.04 [19:52:12] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.55, 2.04, 1.71 [19:52:16] PROBLEM - mw101 MediaWiki Rendering on mw101 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:52:37] PROBLEM - cp20 Stunnel HTTP for mw101 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:52:52] RECOVERY - mw111 MediaWiki Rendering on mw111 is OK: HTTP OK: HTTP/1.1 200 OK - 28479 bytes in 0.441 second response time [19:52:56] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.21, 1.94, 1.63 [19:53:00] PROBLEM - cp21 Stunnel HTTP for mw101 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:53:00] PROBLEM - mw122 MediaWiki Rendering on mw122 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:53:03] PROBLEM - cp30 Stunnel HTTP for mw122 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:53:05] PROBLEM - cp31 Stunnel HTTP for mw101 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:53:28] PROBLEM - cp30 Stunnel HTTP for mw101 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:53:29] RECOVERY - cp20 Stunnel HTTP for mw111 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.030 second response time [19:53:34] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.26, 10.64, 11.12 [19:53:36] RECOVERY - cp31 Stunnel HTTP for mw111 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.340 second response time [19:53:39] RECOVERY - cp30 Stunnel HTTP for mw111 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.328 second response time [19:53:47] PROBLEM - cp31 Varnish Backends on cp31 is CRITICAL: 2 backends are down. mw102 mw111 [19:53:49] PROBLEM - cp31 Stunnel HTTP for mw122 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:53:51] RECOVERY - cp21 Stunnel HTTP for mw111 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.022 second response time [19:53:52] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 7.76, 9.90, 11.81 [19:54:06] RECOVERY - mw112 MediaWiki Rendering on mw112 is OK: HTTP OK: HTTP/1.1 200 OK - 28479 bytes in 8.237 second response time [19:54:55] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.75, 1.96, 1.68 [19:55:13] PROBLEM - cp20 Stunnel HTTP for mw122 on cp20 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 328 bytes in 0.020 second response time [19:55:34] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.01, 10.36, 10.98 [19:56:07] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.28, 1.73, 1.67 [19:56:24] RECOVERY - mw101 MediaWiki Rendering on mw101 is OK: HTTP OK: HTTP/1.1 200 OK - 28479 bytes in 9.243 second response time [19:57:04] RECOVERY - cp21 Stunnel HTTP for mw101 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 5.987 second response time [19:57:06] RECOVERY - mw122 MediaWiki Rendering on mw122 is OK: HTTP OK: HTTP/1.1 200 OK - 28479 bytes in 7.779 second response time [19:57:10] RECOVERY - cp30 Stunnel HTTP for mw122 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 7.693 second response time [19:57:14] RECOVERY - cp20 Stunnel HTTP for mw122 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 7.255 second response time [19:57:16] RECOVERY - cp31 Stunnel HTTP for mw101 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 4.772 second response time [19:57:37] PROBLEM - cp30 Stunnel HTTP for mw112 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:57:37] PROBLEM - cp31 Stunnel HTTP for mw112 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:57:39] RECOVERY - cp30 Stunnel HTTP for mw101 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 7.160 second response time [19:57:47] RECOVERY - cp31 Varnish Backends on cp31 is OK: All 14 backends are healthy [19:58:05] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.71, 1.36, 1.54 [19:58:49] RECOVERY - cp20 Stunnel HTTP for mw101 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 8.096 second response time [19:58:53] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.12, 2.14, 1.80 [19:59:13] PROBLEM - mw111 MediaWiki Rendering on mw111 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:59:33] RECOVERY - cp30 Stunnel HTTP for mw112 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 0.974 second response time [19:59:35] RECOVERY - cp31 Stunnel HTTP for mw112 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.421 second response time [19:59:49] PROBLEM - cp20 Stunnel HTTP for mw111 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:59:58] PROBLEM - cp30 Stunnel HTTP for mw111 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:59:59] PROBLEM - cp31 Stunnel HTTP for mw111 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:00:02] RECOVERY - cp31 Stunnel HTTP for mw122 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 1.835 second response time [20:00:10] PROBLEM - cp21 Stunnel HTTP for mw111 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:00:52] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.56, 1.96, 1.78 [20:02:04] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.55, 10.34, 10.24 [20:02:47] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 12.29, 9.84, 9.42 [20:02:51] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.01, 1.65, 1.69 [20:03:08] PROBLEM - cp20 Stunnel HTTP for mw101 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:03:22] PROBLEM - cp21 Stunnel HTTP for mw101 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:03:34] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.15, 10.94, 10.84 [20:03:43] PROBLEM - cp31 Stunnel HTTP for mw101 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:03:50] PROBLEM - mw101 MediaWiki Rendering on mw101 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:03:52] PROBLEM - cp30 Stunnel HTTP for mw101 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:04:25] RECOVERY - cp21 Stunnel HTTP for mw111 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 9.780 second response time [20:04:47] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 10.40, 9.94, 9.50 [20:05:08] RECOVERY - cp20 Stunnel HTTP for mw101 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 5.218 second response time [20:05:16] RECOVERY - mw111 MediaWiki Rendering on mw111 is OK: HTTP OK: HTTP/1.1 200 OK - 28479 bytes in 0.717 second response time [20:05:20] RECOVERY - cp21 Stunnel HTTP for mw101 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 3.503 second response time [20:05:42] RECOVERY - cp31 Stunnel HTTP for mw101 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 1.249 second response time [20:05:46] RECOVERY - mw101 MediaWiki Rendering on mw101 is OK: HTTP OK: HTTP/1.1 200 OK - 28479 bytes in 1.011 second response time [20:05:50] RECOVERY - cp30 Stunnel HTTP for mw101 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 1.081 second response time [20:05:52] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 13.41, 11.45, 11.31 [20:06:00] RECOVERY - cp20 Stunnel HTTP for mw111 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 0.142 second response time [20:06:04] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.75, 11.11, 10.53 [20:06:10] RECOVERY - cp30 Stunnel HTTP for mw111 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 0.472 second response time [20:06:14] RECOVERY - cp31 Stunnel HTTP for mw111 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 0.433 second response time [20:06:47] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 13.41, 11.14, 9.99 [20:06:48] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 12.14, 10.86, 10.03 [20:06:49] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.58, 10.80, 10.26 [20:07:15] PROBLEM - cp30 Varnish Backends on cp30 is CRITICAL: 1 backends are down. mw111 [20:07:52] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.38, 10.52, 10.98 [20:08:04] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 11.76, 11.33, 10.69 [20:08:45] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.67, 10.33, 9.93 [20:08:46] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.70, 11.15, 10.46 [20:08:47] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 11.84, 11.44, 10.26 [20:09:15] RECOVERY - cp30 Varnish Backends on cp30 is OK: All 14 backends are healthy [20:09:34] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.55, 11.71, 11.32 [20:09:52] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.86, 11.40, 11.24 [20:10:42] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 9.07, 9.93, 9.84 [20:10:47] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 13.21, 12.02, 10.61 [20:11:34] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.17, 11.75, 11.37 [20:12:18] PROBLEM - cp20 Stunnel HTTP for mw111 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:12:30] PROBLEM - cp30 Stunnel HTTP for mw111 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:12:36] PROBLEM - cp31 Stunnel HTTP for mw111 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:12:43] PROBLEM - cp21 Stunnel HTTP for mw111 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:13:34] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.70, 11.83, 11.45 [20:13:45] PROBLEM - mw111 MediaWiki Rendering on mw111 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:14:04] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.01, 11.15, 10.81 [20:14:47] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 8.55, 11.18, 10.68 [20:16:04] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.19, 11.04, 10.83 [20:17:52] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.01, 11.81, 11.61 [20:18:32] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.66, 9.52, 10.04 [20:19:52] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.97, 12.00, 11.68 [20:21:40] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 1.22, 2.16, 1.69 [20:21:52] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.54, 11.65, 11.59 [20:22:24] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 11.03, 10.27, 9.78 [20:22:47] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 13.06, 11.86, 11.08 [20:23:40] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.58, 1.63, 1.55 [20:23:52] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.47, 12.01, 11.74 [20:24:21] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 9.07, 9.98, 9.74 [20:24:22] RECOVERY - mw111 MediaWiki Rendering on mw111 is OK: HTTP OK: HTTP/1.1 200 OK - 28479 bytes in 8.810 second response time [20:24:47] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 11.09, 11.74, 11.15 [20:26:47] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 12.32, 12.04, 11.33 [20:28:45] PROBLEM - mw111 MediaWiki Rendering on mw111 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:28:47] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 10.15, 11.27, 11.13 [20:29:34] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.97, 11.58, 11.28 [20:29:42] RECOVERY - cp21 Stunnel HTTP for mw111 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 9.811 second response time [20:30:53] RECOVERY - mw111 MediaWiki Rendering on mw111 is OK: HTTP OK: HTTP/1.1 200 OK - 28479 bytes in 9.913 second response time [20:31:09] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.89, 10.28, 10.12 [20:31:34] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.32, 11.49, 11.29 [20:31:49] RECOVERY - cp31 Stunnel HTTP for mw111 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 8.730 second response time [20:32:04] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 13.56, 11.50, 10.83 [20:32:47] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 12.60, 11.49, 11.21 [20:33:24] RECOVERY - cp20 Stunnel HTTP for mw111 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 7.264 second response time [20:33:41] RECOVERY - cp30 Stunnel HTTP for mw111 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 6.276 second response time [20:34:04] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.45, 11.00, 10.75 [20:36:47] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.34, 10.99, 11.12 [20:37:00] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 9.12, 9.69, 9.96 [20:37:34] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.30, 12.13, 11.63 [20:40:04] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.12, 11.08, 10.77 [20:40:47] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 12.98, 11.55, 11.26 [20:40:57] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.58, 11.82, 10.77 [20:42:04] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.64, 10.67, 10.66 [20:42:54] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.07, 10.94, 10.56 [20:43:34] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.36, 11.91, 11.75 [20:44:04] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.47, 11.38, 10.92 [20:46:47] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 10.62, 11.67, 11.49 [20:48:04] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 11.19, 11.32, 11.00 [20:50:47] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 12.47, 11.65, 11.49 [20:52:40] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 9.57, 9.54, 10.08 [20:54:47] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 11.35, 11.70, 11.58 [20:56:04] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 7.83, 8.80, 9.96 [20:57:32] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.81, 1.85, 1.57 [20:58:34] PROBLEM - cp21 Stunnel HTTP for mw111 on cp21 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 328 bytes in 0.063 second response time [20:58:37] PROBLEM - cp30 Stunnel HTTP for mw111 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:58:47] PROBLEM - cp31 Stunnel HTTP for mw111 on cp31 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 328 bytes in 0.557 second response time [20:58:55] PROBLEM - mw111 MediaWiki Rendering on mw111 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:59:17] PROBLEM - cp20 Stunnel HTTP for mw111 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:59:52] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.73, 11.19, 11.88 [21:00:55] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 3.55, 2.13, 1.58 [21:01:30] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.60, 1.70, 1.56 [21:02:04] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.02, 10.92, 10.53 [21:02:45] RECOVERY - cp21 Stunnel HTTP for mw111 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 5.537 second response time [21:02:47] RECOVERY - cp30 Stunnel HTTP for mw111 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 5.636 second response time [21:02:57] RECOVERY - cp31 Stunnel HTTP for mw111 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 3.261 second response time [21:03:03] RECOVERY - mw111 MediaWiki Rendering on mw111 is OK: HTTP OK: HTTP/1.1 200 OK - 28479 bytes in 2.747 second response time [21:03:24] RECOVERY - cp20 Stunnel HTTP for mw111 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 2.737 second response time [21:03:34] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.04, 11.56, 11.20 [21:03:52] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 13.68, 11.89, 11.94 [21:05:34] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.87, 11.80, 11.34 [21:07:09] PROBLEM - cp30 Stunnel HTTP for mw111 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:07:21] PROBLEM - cp31 Stunnel HTTP for mw111 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:07:26] PROBLEM - mw111 MediaWiki Rendering on mw111 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:07:34] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.78, 11.95, 11.44 [21:07:44] PROBLEM - cp20 Stunnel HTTP for mw111 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:08:04] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 11.19, 11.82, 11.18 [21:09:14] RECOVERY - cp30 Stunnel HTTP for mw111 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 8.475 second response time [21:09:34] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.59, 11.62, 11.39 [21:10:43] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.64, 1.62, 1.69 [21:11:57] RECOVERY - cp20 Stunnel HTTP for mw111 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 8.895 second response time [21:12:47] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 12.79, 11.20, 10.96 [21:13:58] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.68, 10.38, 10.28 [21:14:04] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.86, 11.50, 11.16 [21:14:47] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 10.43, 10.96, 10.91 [21:15:52] RECOVERY - cp31 Stunnel HTTP for mw111 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 8.222 second response time [21:15:55] RECOVERY - mw111 MediaWiki Rendering on mw111 is OK: HTTP OK: HTTP/1.1 200 OK - 28479 bytes in 8.797 second response time [21:15:57] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 10.11, 10.07, 10.17 [21:16:04] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 11.35, 11.33, 11.13 [21:20:52] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 12.63, 10.80, 9.85 [21:22:49] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 10.22, 10.42, 9.82 [21:23:32] PROBLEM - cp31 Stunnel HTTP for mw111 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:24:09] PROBLEM - cp21 Stunnel HTTP for mw111 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:24:11] PROBLEM - cp30 Stunnel HTTP for mw111 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:24:46] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 9.18, 9.84, 9.67 [21:25:39] PROBLEM - mw111 MediaWiki Rendering on mw111 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:25:50] PROBLEM - cp20 Stunnel HTTP for mw111 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:27:34] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.84, 11.54, 11.16 [21:27:57] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.41, 9.89, 9.78 [21:28:39] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 10.93, 10.66, 10.08 [21:28:47] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 8.13, 9.29, 10.03 [21:29:52] RECOVERY - cp20 Stunnel HTTP for mw111 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 8.305 second response time [21:29:54] RECOVERY - mw111 MediaWiki Rendering on mw111 is OK: HTTP OK: HTTP/1.1 200 OK - 28480 bytes in 9.286 second response time [21:29:57] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 9.98, 9.80, 9.76 [21:30:29] RECOVERY - cp21 Stunnel HTTP for mw111 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 7.240 second response time [21:30:29] RECOVERY - cp30 Stunnel HTTP for mw111 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 7.125 second response time [21:30:36] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 9.02, 9.89, 9.87 [21:31:34] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.68, 11.29, 11.15 [21:32:04] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.54, 11.62, 11.04 [21:33:34] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.59, 11.34, 11.15 [21:34:04] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.23, 10.90, 10.86 [21:34:05] RECOVERY - cp31 Stunnel HTTP for mw111 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 2.564 second response time [21:36:47] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 11.75, 10.62, 10.33 [21:37:34] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.19, 11.13, 11.21 [21:38:09] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.40, 1.63, 1.40 [21:39:34] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.35, 11.33, 11.25 [21:40:04] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.36, 11.41, 11.08 [21:40:07] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.01, 1.37, 1.33 [21:40:47] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 12.81, 11.48, 10.71 [21:41:43] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.58, 11.44, 10.38 [21:42:04] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 11.62, 11.68, 11.23 [21:43:34] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.92, 11.87, 11.52 [21:43:40] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.31, 11.11, 10.43 [21:45:34] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 11.51, 12.05, 11.65 [21:46:04] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.38, 11.96, 11.44 [21:46:47] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 11.81, 11.66, 11.09 [21:48:04] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 11.05, 11.80, 11.46 [21:52:04] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 10.02, 10.36, 9.81 [21:52:57] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.98, 1.77, 1.60 [21:56:55] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.47, 2.11, 1.77 [21:58:47] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 12.06, 11.59, 11.25 [21:58:54] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.58, 1.85, 1.72 [21:59:54] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 8.33, 10.01, 9.97 [22:00:47] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 11.60, 11.48, 11.25 [22:02:04] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.61, 11.71, 11.38 [22:02:47] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 12.51, 11.81, 11.40 [22:02:52] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.27, 1.56, 1.63 [22:06:04] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.98, 11.62, 11.47 [22:06:47] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 11.23, 11.63, 11.44 [22:07:06] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.51, 11.04, 10.65 [22:09:03] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.65, 10.87, 10.62 [22:10:47] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 14.01, 12.13, 11.63 [22:11:00] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.50, 11.48, 10.87 [22:12:58] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.08, 11.44, 10.94 [22:14:47] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 11.63, 11.97, 11.72 [22:16:04] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.47, 11.33, 11.21 [22:16:47] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 12.72, 12.28, 11.86 [22:19:45] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 13.03, 11.23, 10.37 [22:20:04] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.87, 11.55, 11.35 [22:21:34] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.50, 10.98, 11.89 [22:22:47] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.93, 11.85, 11.92 [22:23:45] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.31, 11.18, 10.64 [22:24:41] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.19, 10.95, 10.79 [22:24:47] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.87, 1.67, 1.49 [22:25:34] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.47, 11.59, 11.91 [22:25:45] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 12.02, 11.53, 10.83 [22:25:56] PROBLEM - cp20 Stunnel HTTP for mw111 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [22:26:06] PROBLEM - mw111 MediaWiki Rendering on mw111 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [22:26:10] PROBLEM - cp31 Stunnel HTTP for mw111 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [22:26:38] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.89, 10.93, 10.80 [22:26:47] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.56, 1.49, 1.43 [22:26:47] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 12.61, 12.23, 12.05 [22:27:45] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 10.96, 11.28, 10.83 [22:28:47] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 10.21, 11.43, 11.78 [22:29:34] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.58, 11.25, 11.74 [22:30:00] RECOVERY - cp20 Stunnel HTTP for mw111 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 0.539 second response time [22:30:13] RECOVERY - mw111 MediaWiki Rendering on mw111 is OK: HTTP OK: HTTP/1.1 200 OK - 28480 bytes in 1.961 second response time [22:30:17] RECOVERY - cp31 Stunnel HTTP for mw111 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 0.346 second response time [22:30:47] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 12.04, 11.73, 11.84 [22:31:34] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.21, 11.88, 11.92 [22:32:04] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 13.95, 11.67, 11.26 [22:32:47] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 10.58, 11.41, 11.72 [22:34:04] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 11.98, 11.76, 11.35 [22:34:47] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 13.94, 12.40, 12.04 [22:36:42] PROBLEM - cp21 Current Load on cp21 is WARNING: WARNING - load average: 1.13, 1.78, 1.23 [22:37:45] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.92, 9.29, 10.12 [22:39:17] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 3.73, 2.00, 1.38 [22:40:04] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 13.62, 12.15, 11.56 [22:40:42] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 0.41, 1.29, 1.18 [22:41:15] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.19, 1.63, 1.32 [22:42:04] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 11.69, 11.89, 11.54 [22:44:12] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.14, 10.98, 10.65 [22:46:09] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.33, 10.94, 10.67 [22:48:04] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.43, 11.70, 11.47 [22:48:47] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 11.11, 11.46, 11.90 [22:49:34] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.44, 11.46, 11.87 [22:50:04] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 11.96, 11.86, 11.56 [22:51:45] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 11.45, 10.55, 10.22 [22:52:47] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 12.11, 11.75, 11.92 [22:53:34] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.16, 11.95, 11.93 [22:56:47] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.19, 11.04, 11.65 [22:57:57] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.89, 9.66, 10.10 [22:59:34] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.18, 11.81, 11.92 [22:59:45] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 9.81, 10.13, 10.15 [23:00:04] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.18, 11.31, 11.36 [23:01:57] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.02, 10.48, 10.39 [23:03:34] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.37, 12.05, 11.95 [23:05:34] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.94, 11.57, 11.79 [23:06:04] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.29, 11.11, 11.35 [23:07:57] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.09, 9.35, 9.97 [23:09:52] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.38, 11.16, 11.88 [23:11:34] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.36, 11.32, 11.51 [23:11:52] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 13.06, 11.81, 12.02 [23:12:47] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 13.14, 10.97, 10.80 [23:13:52] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.51, 11.09, 11.74 [23:14:47] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 8.80, 9.95, 10.44 [23:15:34] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.80, 11.53, 11.56 [23:22:47] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 9.07, 9.71, 10.16 [23:24:04] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 7.86, 9.18, 10.17 [23:27:52] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.45, 11.88, 11.68 [23:28:04] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.33, 9.96, 10.29 [23:29:34] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.12, 8.88, 10.16 [23:29:52] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.51, 11.69, 11.64 [23:31:52] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.16, 11.64, 11.61 [23:32:04] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.87, 10.87, 10.53 [23:32:47] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 10.68, 9.93, 9.81 [23:33:34] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 14.62, 11.39, 10.85 [23:34:04] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.88, 10.95, 10.61 [23:34:18] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.30, 3.22, 3.80 [23:34:47] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 7.26, 9.17, 9.57 [23:35:34] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.59, 11.02, 10.79 [23:39:32] [Grafana] FIRING: Some MediaWiki Appservers are running out of PHP-FPM workers. https://grafana.miraheze.org/d/GtxbP1Xnk [23:39:52] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.90, 11.78, 11.81 [23:40:12] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.02, 10.21, 9.76 [23:41:52] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.02, 11.94, 11.86 [23:42:09] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.85, 10.73, 10.00 [23:42:18] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 6.03, 4.11, 3.91 [23:42:47] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 12.13, 11.10, 10.25 [23:43:52] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.02, 11.69, 11.79 [23:44:06] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.60, 10.06, 9.85 [23:44:16] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.24, 1.94, 1.53 [23:44:47] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 10.55, 10.78, 10.23 [23:47:34] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.29, 11.96, 11.36 [23:47:58] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.39, 10.72, 10.21 [23:49:34] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.89, 11.81, 11.38 [23:49:52] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.86, 11.90, 11.76 [23:51:57] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.76, 10.06, 10.08 [23:52:04] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 10.14, 10.02, 10.19 [23:52:45] PROBLEM - mw111 MediaWiki Rendering on mw111 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [23:52:47] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 7.42, 9.18, 9.84 [23:53:52] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.55, 11.67, 11.69 [23:54:07] PROBLEM - cp31 Stunnel HTTP for mw111 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [23:54:10] PROBLEM - cp21 Stunnel HTTP for mw111 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [23:54:10] PROBLEM - cp30 Stunnel HTTP for mw111 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [23:54:58] PROBLEM - cp20 Stunnel HTTP for mw111 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [23:55:52] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 14.49, 12.57, 12.01 [23:56:10] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.69, 1.87, 1.74 [23:56:11] RECOVERY - cp31 Stunnel HTTP for mw111 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 5.270 second response time [23:56:12] RECOVERY - cp21 Stunnel HTTP for mw111 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 4.634 second response time [23:56:12] RECOVERY - cp30 Stunnel HTTP for mw111 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 4.908 second response time [23:56:42] PROBLEM - cp21 Current Load on cp21 is WARNING: WARNING - load average: 1.75, 1.30, 0.86 [23:56:53] RECOVERY - mw111 MediaWiki Rendering on mw111 is OK: HTTP OK: HTTP/1.1 200 OK - 28479 bytes in 2.599 second response time [23:57:04] RECOVERY - cp20 Stunnel HTTP for mw111 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 8.316 second response time [23:58:42] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 0.44, 0.98, 0.80 [23:58:47] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 10.37, 9.96, 9.93