[00:01:18] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.08, 9.36, 9.48 [00:01:21] RECOVERY - mw121 MediaWiki Rendering on mw121 is OK: HTTP OK: HTTP/1.1 200 OK - 22220 bytes in 1.727 second response time [00:01:37] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.13, 9.58, 9.54 [00:01:56] RECOVERY - cp31 Stunnel HTTP for mw121 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 14562 bytes in 0.317 second response time [00:02:05] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 11.54, 10.48, 10.08 [00:02:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 11.20, 9.82, 9.61 [00:02:27] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.25, 2.90, 3.23 [00:02:57] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.83, 9.68, 8.90 [00:03:27] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.49, 9.68, 8.97 [00:03:37] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.27, 9.84, 9.64 [00:04:42] PROBLEM - mw101 Puppet on mw101 is CRITICAL: CRITICAL: Puppet has 283 failures. Last run 3 minutes ago with 283 failures. Failed resources (up to 3 shown): File[/etc/apt/trusted.gpg.d/puppetlabs.gpg],File[/usr/local/bin/puppet-enabled],File[authority certificates],File[/etc/apt/apt.conf.d/50unattended-upgrades] [00:04:52] PROBLEM - mw122 MediaWiki Rendering on mw122 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:04:55] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.92, 9.70, 9.00 [00:05:18] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 8.55, 9.29, 9.45 [00:05:24] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.91, 9.31, 8.92 [00:05:37] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.00, 9.54, 9.56 [00:06:05] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 8.45, 9.60, 9.84 [00:06:50] RECOVERY - mw122 MediaWiki Rendering on mw122 is OK: HTTP OK: HTTP/1.1 200 OK - 22220 bytes in 2.252 second response time [00:06:53] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.35, 9.63, 9.04 [00:07:19] PROBLEM - cp30 Stunnel HTTP for mw102 on cp30 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 328 bytes in 0.251 second response time [00:07:43] PROBLEM - cp20 Stunnel HTTP for mw102 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:08:01] PROBLEM - mw102 MediaWiki Rendering on mw102 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:08:05] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 10.12, 10.00, 9.96 [00:08:20] PROBLEM - cp21 Stunnel HTTP for mw102 on cp21 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 328 bytes in 0.099 second response time [00:08:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.19, 9.38, 9.59 [00:08:22] PROBLEM - cp31 Stunnel HTTP for mw102 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:08:52] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 4.85, 7.98, 8.52 [00:10:05] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 8.57, 9.28, 9.69 [00:10:33] PROBLEM - cp21 Stunnel HTTP for mw112 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:10:36] PROBLEM - cp30 Stunnel HTTP for mw111 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:10:37] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.53, 2.95, 3.38 [00:10:37] PROBLEM - cp20 Stunnel HTTP for mw112 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:10:43] PROBLEM - mw112 MediaWiki Rendering on mw112 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:10:45] PROBLEM - cp30 Stunnel HTTP for mw112 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:10:50] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.49, 7.83, 8.39 [00:10:56] PROBLEM - cp31 Stunnel HTTP for mw111 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:10:59] PROBLEM - cp20 Stunnel HTTP for mw111 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:11:04] PROBLEM - cp21 Stunnel HTTP for mw111 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:11:14] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.25, 9.00, 8.82 [00:11:30] PROBLEM - mw111 MediaWiki Rendering on mw111 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:11:56] PROBLEM - cp31 Stunnel HTTP for mw112 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:12:03] PROBLEM - cp21 Stunnel HTTP for mw121 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:12:28] PROBLEM - cp31 Stunnel HTTP for mw121 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:13:11] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 6.76, 8.19, 8.56 [00:13:19] PROBLEM - cp20 Stunnel HTTP for mw121 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:13:24] PROBLEM - cp30 Stunnel HTTP for mw121 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:13:30] RECOVERY - cp30 Stunnel HTTP for mw102 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 14548 bytes in 7.908 second response time [00:13:52] PROBLEM - mw121 MediaWiki Rendering on mw121 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:13:56] RECOVERY - cp31 Stunnel HTTP for mw112 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 14556 bytes in 4.926 second response time [00:14:07] RECOVERY - cp20 Stunnel HTTP for mw102 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 14562 bytes in 5.527 second response time [00:14:18] RECOVERY - mw102 MediaWiki Rendering on mw102 is OK: HTTP OK: HTTP/1.1 200 OK - 22220 bytes in 6.265 second response time [00:14:37] RECOVERY - cp21 Stunnel HTTP for mw112 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 14548 bytes in 0.754 second response time [00:14:39] RECOVERY - cp30 Stunnel HTTP for mw111 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 14556 bytes in 4.433 second response time [00:14:39] RECOVERY - cp31 Stunnel HTTP for mw102 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 14548 bytes in 6.433 second response time [00:14:42] RECOVERY - cp21 Stunnel HTTP for mw102 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 14548 bytes in 5.630 second response time [00:14:43] RECOVERY - mw112 MediaWiki Rendering on mw112 is OK: HTTP OK: HTTP/1.1 200 OK - 22220 bytes in 0.962 second response time [00:14:43] RECOVERY - cp20 Stunnel HTTP for mw112 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 14556 bytes in 0.269 second response time [00:14:58] RECOVERY - cp30 Stunnel HTTP for mw112 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 14562 bytes in 3.331 second response time [00:15:03] RECOVERY - cp31 Stunnel HTTP for mw111 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 14556 bytes in 0.404 second response time [00:15:04] RECOVERY - cp21 Stunnel HTTP for mw111 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 14562 bytes in 0.020 second response time [00:15:04] RECOVERY - cp20 Stunnel HTTP for mw111 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 14562 bytes in 0.030 second response time [00:15:07] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 6.89, 7.86, 8.39 [00:15:38] RECOVERY - mw111 MediaWiki Rendering on mw111 is OK: HTTP OK: HTTP/1.1 200 OK - 22220 bytes in 0.909 second response time [00:16:37] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.58, 4.01, 3.65 [00:17:18] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 7.08, 7.68, 8.36 [00:17:22] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.49, 2.98, 3.02 [00:18:35] PROBLEM - cp20 Stunnel HTTP for mw102 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:18:38] PROBLEM - mw102 MediaWiki Rendering on mw102 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:18:55] RECOVERY - cp31 Stunnel HTTP for mw121 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 14556 bytes in 9.915 second response time [00:19:04] PROBLEM - cp31 Stunnel HTTP for mw102 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:19:22] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.26, 2.61, 2.87 [00:19:36] RECOVERY - cp20 Stunnel HTTP for mw121 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 14562 bytes in 5.790 second response time [00:19:39] RECOVERY - cp30 Stunnel HTTP for mw121 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 14562 bytes in 6.032 second response time [00:19:49] PROBLEM - cp30 Stunnel HTTP for mw102 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:20:30] RECOVERY - cp21 Stunnel HTTP for mw121 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 14556 bytes in 5.994 second response time [00:21:18] PROBLEM - cp30 Stunnel HTTP for mw112 on cp30 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 328 bytes in 0.504 second response time [00:22:14] PROBLEM - cp31 Stunnel HTTP for mw112 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:22:15] RECOVERY - mw121 MediaWiki Rendering on mw121 is OK: HTTP OK: HTTP/1.1 200 OK - 22220 bytes in 0.574 second response time [00:22:37] PROBLEM - cp20 Stunnel HTTP for mw122 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:22:45] PROBLEM - cp30 Stunnel HTTP for mw122 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:22:54] PROBLEM - cp30 Stunnel HTTP for mw111 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:22:59] PROBLEM - mw112 MediaWiki Rendering on mw112 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:23:05] PROBLEM - cp21 Stunnel HTTP for mw112 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:23:07] PROBLEM - cp31 Stunnel HTTP for mw122 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:23:10] PROBLEM - cp20 Stunnel HTTP for mw112 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:23:15] RECOVERY - cp31 Stunnel HTTP for mw102 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 14556 bytes in 9.070 second response time [00:23:28] PROBLEM - cp21 Stunnel HTTP for mw111 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:23:33] PROBLEM - cp20 Stunnel HTTP for mw111 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:23:35] PROBLEM - cp21 Stunnel HTTP for mw102 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:23:36] PROBLEM - cp31 Stunnel HTTP for mw111 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:24:06] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 8.29, 8.48, 8.54 [00:24:10] PROBLEM - mw122 MediaWiki Rendering on mw122 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:24:11] PROBLEM - mw111 MediaWiki Rendering on mw111 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:24:21] PROBLEM - cp21 Stunnel HTTP for mw122 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:24:41] RECOVERY - cp20 Stunnel HTTP for mw122 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 14556 bytes in 6.832 second response time [00:24:49] RECOVERY - cp30 Stunnel HTTP for mw122 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 14556 bytes in 7.536 second response time [00:25:00] RECOVERY - mw102 MediaWiki Rendering on mw102 is OK: HTTP OK: HTTP/1.1 200 OK - 22220 bytes in 9.586 second response time [00:25:14] RECOVERY - cp31 Stunnel HTTP for mw122 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 14556 bytes in 8.713 second response time [00:25:30] RECOVERY - cp21 Stunnel HTTP for mw111 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 14556 bytes in 7.145 second response time [00:25:38] RECOVERY - cp20 Stunnel HTTP for mw111 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 14562 bytes in 7.341 second response time [00:25:39] RECOVERY - cp21 Stunnel HTTP for mw102 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 14556 bytes in 4.655 second response time [00:25:40] RECOVERY - cp31 Stunnel HTTP for mw111 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 14556 bytes in 5.934 second response time [00:25:56] RECOVERY - cp30 Stunnel HTTP for mw102 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 14562 bytes in 4.684 second response time [00:26:11] RECOVERY - mw122 MediaWiki Rendering on mw122 is OK: HTTP OK: HTTP/1.1 200 OK - 22220 bytes in 5.046 second response time [00:26:12] RECOVERY - mw111 MediaWiki Rendering on mw111 is OK: HTTP OK: HTTP/1.1 200 OK - 22220 bytes in 3.110 second response time [00:26:20] RECOVERY - cp21 Stunnel HTTP for mw122 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 14556 bytes in 3.979 second response time [00:26:25] RECOVERY - cp31 Stunnel HTTP for mw112 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 14548 bytes in 9.126 second response time [00:26:53] RECOVERY - cp30 Stunnel HTTP for mw111 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 14562 bytes in 0.317 second response time [00:27:04] RECOVERY - mw112 MediaWiki Rendering on mw112 is OK: HTTP OK: HTTP/1.1 200 OK - 22220 bytes in 6.927 second response time [00:27:09] RECOVERY - cp20 Stunnel HTTP for mw102 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 14548 bytes in 6.176 second response time [00:27:11] RECOVERY - cp21 Stunnel HTTP for mw112 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 14562 bytes in 3.503 second response time [00:27:18] RECOVERY - cp20 Stunnel HTTP for mw112 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 14556 bytes in 2.138 second response time [00:27:37] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.35, 8.75, 8.76 [00:27:41] RECOVERY - cp30 Stunnel HTTP for mw112 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 14562 bytes in 4.599 second response time [00:27:53] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.64, 9.29, 8.84 [00:28:05] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 10.16, 8.97, 8.83 [00:28:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.10, 9.11, 8.87 [00:28:37] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.85, 9.28, 8.60 [00:29:37] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.21, 8.92, 8.82 [00:30:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.46, 9.17, 8.93 [00:30:55] PROBLEM - cp31 Stunnel HTTP for mw102 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:31:24] PROBLEM - mw102 MediaWiki Rendering on mw102 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:31:37] PROBLEM - cp20 Stunnel HTTP for mw102 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:32:05] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.13, 9.26, 9.01 [00:32:16] PROBLEM - cp30 Stunnel HTTP for mw102 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:32:38] RECOVERY - mw101 Puppet on mw101 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [00:34:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.44, 9.37, 9.03 [00:34:27] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.40, 9.55, 8.92 [00:35:29] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.08, 9.74, 9.26 [00:36:38] PROBLEM - cp21 Stunnel HTTP for mw102 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:37:37] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.26, 8.14, 8.45 [00:38:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.72, 9.74, 9.29 [00:38:21] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.37, 9.74, 9.16 [00:42:16] PROBLEM - cp21 Stunnel HTTP for mw122 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:42:25] PROBLEM - mw122 MediaWiki Rendering on mw122 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:42:47] PROBLEM - mw111 MediaWiki Rendering on mw111 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:43:01] PROBLEM - cp30 Stunnel HTTP for mw111 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:43:12] PROBLEM - cp30 Stunnel HTTP for mw122 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:43:15] PROBLEM - cp20 Stunnel HTTP for mw122 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:43:37] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.28, 8.67, 8.60 [00:44:09] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 7.16, 7.77, 8.41 [00:44:10] RECOVERY - cp21 Stunnel HTTP for mw122 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 14556 bytes in 0.249 second response time [00:44:21] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.55, 7.91, 8.50 [00:44:21] RECOVERY - mw122 MediaWiki Rendering on mw122 is OK: HTTP OK: HTTP/1.1 200 OK - 22220 bytes in 0.581 second response time [00:44:49] RECOVERY - mw111 MediaWiki Rendering on mw111 is OK: HTTP OK: HTTP/1.1 200 OK - 22220 bytes in 3.274 second response time [00:44:59] RECOVERY - cp30 Stunnel HTTP for mw111 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 14562 bytes in 3.447 second response time [00:45:08] RECOVERY - cp30 Stunnel HTTP for mw122 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 14556 bytes in 0.453 second response time [00:45:13] RECOVERY - cp20 Stunnel HTTP for mw122 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 14556 bytes in 0.132 second response time [00:45:37] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 6.74, 7.96, 8.34 [00:47:18] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 11.45, 9.79, 9.35 [00:47:22] RECOVERY - cp21 Stunnel HTTP for mw102 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 14556 bytes in 9.602 second response time [00:48:37] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.92, 3.65, 3.97 [00:48:51] RECOVERY - cp20 Stunnel HTTP for mw102 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 14556 bytes in 8.547 second response time [00:48:53] RECOVERY - cp30 Stunnel HTTP for mw102 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 14548 bytes in 9.099 second response time [00:49:18] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 10.00, 9.81, 9.41 [00:49:20] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.85, 9.13, 8.49 [00:49:44] PROBLEM - cp20 Stunnel HTTP for mw112 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:49:49] PROBLEM - cp31 Stunnel HTTP for mw112 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:49:50] RECOVERY - cp31 Stunnel HTTP for mw102 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 14556 bytes in 9.546 second response time [00:50:22] RECOVERY - mw102 MediaWiki Rendering on mw102 is OK: HTTP OK: HTTP/1.1 200 OK - 22220 bytes in 3.188 second response time [00:51:26] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.95, 1.65, 1.27 [00:51:42] RECOVERY - cp20 Stunnel HTTP for mw112 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 14562 bytes in 0.336 second response time [00:51:48] RECOVERY - cp31 Stunnel HTTP for mw112 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 14556 bytes in 3.006 second response time [00:53:11] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.40, 9.39, 8.87 [00:53:17] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.94, 9.64, 8.85 [00:53:18] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 11.24, 10.46, 9.76 [00:53:25] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.88, 1.40, 1.22 [00:53:37] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 11.87, 9.93, 9.03 [00:54:05] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 10.70, 9.10, 8.70 [00:54:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.25, 9.52, 9.10 [00:54:37] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.44, 3.41, 3.68 [00:55:15] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.21, 9.67, 8.94 [00:56:37] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.94, 3.56, 3.70 [00:58:05] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 7.17, 9.44, 9.06 [00:58:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.55, 9.86, 9.42 [00:59:01] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.76, 9.55, 9.17 [00:59:11] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.57, 9.24, 8.96 [00:59:18] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 8.36, 9.69, 9.72 [00:59:37] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 7.57, 9.86, 9.44 [00:59:37] PROBLEM - cp21 Stunnel HTTP for mw111 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:00:21] PROBLEM - cp20 Stunnel HTTP for mw111 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:00:52] PROBLEM - cp30 Stunnel HTTP for mw111 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:01:14] PROBLEM - mw111 MediaWiki Rendering on mw111 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:02:05] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 6.23, 7.65, 8.41 [01:02:37] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.28, 3.45, 3.53 [01:02:53] PROBLEM - cp21 Stunnel HTTP for mw101 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:02:54] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 5.86, 7.51, 8.43 [01:03:08] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 5.22, 7.08, 8.14 [01:03:30] PROBLEM - cp31 Stunnel HTTP for mw111 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:03:37] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 5.23, 7.31, 8.48 [01:04:06] PROBLEM - cp31 Stunnel HTTP for mw102 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:04:37] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.12, 3.30, 3.46 [01:04:49] RECOVERY - cp21 Stunnel HTTP for mw101 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 14556 bytes in 1.882 second response time [01:05:28] RECOVERY - mw111 MediaWiki Rendering on mw111 is OK: HTTP OK: HTTP/1.1 200 OK - 22220 bytes in 6.517 second response time [01:05:35] RECOVERY - cp31 Stunnel HTTP for mw111 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 14548 bytes in 6.476 second response time [01:05:39] RECOVERY - cp21 Stunnel HTTP for mw111 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 14562 bytes in 5.924 second response time [01:06:06] RECOVERY - cp31 Stunnel HTTP for mw102 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 14562 bytes in 3.962 second response time [01:06:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.16, 8.34, 8.66 [01:06:34] RECOVERY - cp20 Stunnel HTTP for mw111 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 14562 bytes in 0.018 second response time [01:06:37] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.36, 3.55, 3.52 [01:06:56] RECOVERY - cp30 Stunnel HTTP for mw111 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 14548 bytes in 0.676 second response time [01:06:59] hellooo [01:07:18] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 11.57, 9.67, 9.37 [01:08:05] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.10, 8.63, 8.55 [01:08:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.81, 8.10, 8.54 [01:08:41] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.25, 8.90, 8.80 [01:09:09] PROBLEM - cp30 Stunnel HTTP for mw102 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:09:18] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.54, 9.50, 9.34 [01:09:56] PROBLEM - cp20 Stunnel HTTP for mw102 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:10:05] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 10.05, 9.04, 8.70 [01:10:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.69, 9.03, 8.83 [01:10:29] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.80, 8.94, 8.77 [01:10:30] PROBLEM - cp31 Stunnel HTTP for mw102 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:10:37] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.45, 3.84, 3.67 [01:11:18] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 12.13, 10.39, 9.68 [01:12:03] RECOVERY - cp20 Stunnel HTTP for mw102 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 14548 bytes in 7.939 second response time [01:12:05] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 7.68, 8.59, 8.58 [01:12:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.72, 8.99, 8.85 [01:12:24] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 11.53, 10.01, 9.19 [01:12:33] RECOVERY - cp31 Stunnel HTTP for mw102 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 14556 bytes in 7.032 second response time [01:12:34] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 6.32, 7.68, 8.35 [01:13:15] RECOVERY - cp30 Stunnel HTTP for mw102 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 14556 bytes in 7.697 second response time [01:14:37] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.65, 4.26, 3.83 [01:16:05] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 11.13, 9.71, 9.03 [01:16:37] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.09, 3.74, 3.70 [01:17:33] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.47, 3.51, 3.14 [01:17:53] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.19, 8.92, 8.57 [01:18:05] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 7.87, 8.86, 8.79 [01:18:09] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.60, 9.46, 9.26 [01:18:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.15, 9.91, 9.32 [01:18:21] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.97, 8.91, 8.70 [01:18:37] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.93, 4.46, 3.95 [01:18:57] PROBLEM - cp31 Stunnel HTTP for mw102 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:18:59] PROBLEM - cp21 Stunnel HTTP for mw102 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:19:14] PROBLEM - mw112 MediaWiki Rendering on mw112 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:19:31] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.12, 3.08, 3.03 [01:19:32] PROBLEM - cp30 Stunnel HTTP for mw102 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:19:49] PROBLEM - cp30 Stunnel HTTP for mw112 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:20:14] PROBLEM - cp21 Stunnel HTTP for mw112 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:20:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.38, 9.50, 9.23 [01:20:35] PROBLEM - mw102 MediaWiki Rendering on mw102 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:20:45] PROBLEM - cp20 Stunnel HTTP for mw102 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:21:15] PROBLEM - cp31 Stunnel HTTP for mw112 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:21:18] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 7.74, 9.81, 9.96 [01:21:24] PROBLEM - cp20 Stunnel HTTP for mw112 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:21:50] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.46, 8.33, 8.41 [01:22:05] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 6.42, 7.73, 8.35 [01:22:37] RECOVERY - mw102 MediaWiki Rendering on mw102 is OK: HTTP OK: HTTP/1.1 200 OK - 22220 bytes in 4.939 second response time [01:22:37] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.62, 3.28, 3.57 [01:22:47] RECOVERY - cp20 Stunnel HTTP for mw102 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 14562 bytes in 2.229 second response time [01:23:00] RECOVERY - cp31 Stunnel HTTP for mw102 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 14562 bytes in 0.557 second response time [01:23:07] RECOVERY - cp21 Stunnel HTTP for mw102 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 14562 bytes in 0.121 second response time [01:23:13] RECOVERY - cp31 Stunnel HTTP for mw112 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 14548 bytes in 2.495 second response time [01:23:15] RECOVERY - mw112 MediaWiki Rendering on mw112 is OK: HTTP OK: HTTP/1.1 200 OK - 22220 bytes in 2.691 second response time [01:23:27] RECOVERY - cp20 Stunnel HTTP for mw112 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 14562 bytes in 5.158 second response time [01:23:31] RECOVERY - cp30 Stunnel HTTP for mw102 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 14556 bytes in 0.382 second response time [01:24:05] RECOVERY - cp30 Stunnel HTTP for mw112 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 14556 bytes in 6.401 second response time [01:24:11] PROBLEM - cp21 Stunnel HTTP for mw121 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:24:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.90, 9.62, 9.28 [01:24:24] RECOVERY - cp21 Stunnel HTTP for mw112 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 14556 bytes in 6.927 second response time [01:24:37] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.02, 3.66, 3.66 [01:25:07] PROBLEM - cp30 Stunnel HTTP for mw121 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:25:50] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.15, 9.08, 9.01 [01:26:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.34, 9.34, 9.22 [01:26:51] PROBLEM - cp20 Stunnel HTTP for mw122 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:26:56] PROBLEM - mw122 MediaWiki Rendering on mw122 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:27:15] PROBLEM - cp21 Stunnel HTTP for mw122 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:27:24] PROBLEM - cp30 Stunnel HTTP for mw122 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:27:48] PROBLEM - cp31 Stunnel HTTP for mw122 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:28:16] PROBLEM - cp31 Stunnel HTTP for mw121 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:28:17] PROBLEM - cp20 Stunnel HTTP for mw121 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:28:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 11.44, 10.02, 9.47 [01:28:37] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.89, 3.56, 3.60 [01:28:52] RECOVERY - cp20 Stunnel HTTP for mw122 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 14562 bytes in 2.824 second response time [01:28:55] RECOVERY - mw122 MediaWiki Rendering on mw122 is OK: HTTP OK: HTTP/1.1 200 OK - 22220 bytes in 2.941 second response time [01:29:11] RECOVERY - cp21 Stunnel HTTP for mw122 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 14556 bytes in 1.790 second response time [01:29:16] RECOVERY - cp30 Stunnel HTTP for mw121 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 14556 bytes in 7.155 second response time [01:29:23] RECOVERY - cp30 Stunnel HTTP for mw122 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 14562 bytes in 2.433 second response time [01:29:48] RECOVERY - cp31 Stunnel HTTP for mw122 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 14562 bytes in 1.435 second response time [01:30:18] RECOVERY - cp20 Stunnel HTTP for mw121 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 14562 bytes in 4.430 second response time [01:30:20] RECOVERY - cp31 Stunnel HTTP for mw121 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 14556 bytes in 4.499 second response time [01:30:21] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 11.40, 9.57, 9.09 [01:30:30] RECOVERY - cp21 Stunnel HTTP for mw121 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 14556 bytes in 4.783 second response time [01:30:37] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.19, 2.98, 3.37 [01:31:18] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.77, 10.25, 10.00 [01:31:37] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.32, 9.28, 9.16 [01:31:41] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.52, 9.39, 8.92 [01:33:02] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.88, 9.64, 8.99 [01:34:21] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.67, 9.49, 9.20 [01:34:55] PROBLEM - mw102 MediaWiki Rendering on mw102 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:35:01] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 10.24, 9.82, 9.13 [01:35:18] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.30, 9.76, 9.86 [01:35:19] PROBLEM - cp31 Stunnel HTTP for mw102 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:35:22] PROBLEM - cp20 Stunnel HTTP for mw102 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:35:37] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.65, 9.69, 9.10 [01:35:39] PROBLEM - cp21 Stunnel HTTP for mw102 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:35:41] PROBLEM - cp30 Stunnel HTTP for mw102 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:36:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.34, 9.90, 9.70 [01:36:21] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.77, 10.00, 9.42 [01:37:00] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.34, 9.77, 9.20 [01:37:18] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 9.89, 10.09, 9.98 [01:37:35] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.47, 9.36, 9.06 [01:37:37] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.77, 9.61, 9.31 [01:37:45] RECOVERY - cp30 Stunnel HTTP for mw102 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 14556 bytes in 9.775 second response time [01:37:47] RECOVERY - cp21 Stunnel HTTP for mw102 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 14556 bytes in 8.804 second response time [01:38:59] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 11.03, 10.31, 9.47 [01:39:08] RECOVERY - mw102 MediaWiki Rendering on mw102 is OK: HTTP OK: HTTP/1.1 200 OK - 22220 bytes in 7.691 second response time [01:39:29] RECOVERY - cp31 Stunnel HTTP for mw102 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 14556 bytes in 7.839 second response time [01:39:38] RECOVERY - cp20 Stunnel HTTP for mw102 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 14556 bytes in 7.334 second response time [01:40:21] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.24, 9.79, 9.46 [01:40:58] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.83, 9.83, 9.38 [01:41:28] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.86, 3.90, 3.49 [01:41:37] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.68, 9.57, 9.41 [01:42:14] PROBLEM - cp21 Stunnel HTTP for mw102 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:42:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.72, 10.21, 9.90 [01:43:23] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.96, 3.42, 3.36 [01:43:28] PROBLEM - mw102 MediaWiki Rendering on mw102 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:43:37] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.06, 9.89, 9.56 [01:43:54] PROBLEM - cp31 Stunnel HTTP for mw102 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:43:57] PROBLEM - cp20 Stunnel HTTP for mw102 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:44:06] PROBLEM - cp30 Stunnel HTTP for mw102 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:44:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.45, 9.79, 9.78 [01:45:34] RECOVERY - mw102 MediaWiki Rendering on mw102 is OK: HTTP OK: HTTP/1.1 200 OK - 22220 bytes in 9.341 second response time [01:45:37] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.96, 9.86, 9.58 [01:45:39] PROBLEM - mw122 MediaWiki Rendering on mw122 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:45:40] PROBLEM - cp31 Stunnel HTTP for mw122 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:46:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.79, 10.13, 9.90 [01:46:21] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 12.15, 9.57, 9.30 [01:47:14] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.63, 3.14, 3.27 [01:47:18] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 8.89, 9.52, 9.88 [01:47:35] RECOVERY - mw122 MediaWiki Rendering on mw122 is OK: HTTP OK: HTTP/1.1 200 OK - 22220 bytes in 0.246 second response time [01:47:42] RECOVERY - cp31 Stunnel HTTP for mw122 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 14556 bytes in 3.611 second response time [01:47:56] PROBLEM - mw101 MediaWiki Rendering on mw101 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:48:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.50, 9.63, 9.76 [01:49:18] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.32, 9.70, 9.89 [01:49:44] PROBLEM - mw102 MediaWiki Rendering on mw102 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 1595 bytes in 0.012 second response time [01:49:54] RECOVERY - mw101 MediaWiki Rendering on mw101 is OK: HTTP OK: HTTP/1.1 200 OK - 22220 bytes in 2.190 second response time [01:50:21] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.37, 9.43, 9.35 [01:51:18] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.53, 9.49, 9.78 [01:51:23] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.84, 7.89, 8.44 [01:51:32] PROBLEM - cp31 Stunnel HTTP for mw112 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:51:52] PROBLEM - cp20 Stunnel HTTP for mw112 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:52:34] PROBLEM - cp21 Stunnel HTTP for mw112 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:52:55] PROBLEM - mw112 MediaWiki Rendering on mw112 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:52:57] RECOVERY - cp21 Stunnel HTTP for mw102 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 14556 bytes in 8.838 second response time [01:53:00] PROBLEM - cp30 Stunnel HTTP for mw112 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:53:18] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.48, 9.86, 9.88 [01:53:38] RECOVERY - cp31 Stunnel HTTP for mw112 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 14548 bytes in 9.490 second response time [01:53:58] RECOVERY - mw102 MediaWiki Rendering on mw102 is OK: HTTP OK: HTTP/1.1 200 OK - 22220 bytes in 9.843 second response time [01:53:58] RECOVERY - cp20 Stunnel HTTP for mw112 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 14562 bytes in 8.264 second response time [01:54:13] RECOVERY - cp31 Stunnel HTTP for mw102 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 14556 bytes in 7.896 second response time [01:54:21] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 11.55, 9.70, 9.41 [01:54:30] RECOVERY - cp30 Stunnel HTTP for mw102 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 14562 bytes in 7.345 second response time [01:54:39] RECOVERY - cp21 Stunnel HTTP for mw112 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 14556 bytes in 8.339 second response time [01:54:39] RECOVERY - cp20 Stunnel HTTP for mw102 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 14556 bytes in 5.375 second response time [01:55:09] RECOVERY - cp30 Stunnel HTTP for mw112 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 14556 bytes in 8.593 second response time [01:56:51] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 11.77, 9.63, 9.28 [01:57:02] RECOVERY - mw112 MediaWiki Rendering on mw112 is OK: HTTP OK: HTTP/1.1 200 OK - 22220 bytes in 8.749 second response time [01:57:37] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 11.38, 9.63, 9.36 [01:58:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.46, 9.36, 9.37 [01:59:15] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.28, 9.20, 8.71 [02:01:13] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.92, 9.55, 8.90 [02:07:08] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.66, 9.81, 9.20 [02:11:05] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.79, 9.72, 9.33 [02:12:35] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [02:16:31] PROBLEM - mw102 MediaWiki Rendering on mw102 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [02:16:42] PROBLEM - cp31 Stunnel HTTP for mw102 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [02:16:43] PROBLEM - cp30 Stunnel HTTP for mw102 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [02:16:59] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.03, 9.48, 9.30 [02:18:58] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.68, 9.78, 9.44 [02:21:49] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.45, 3.51, 3.11 [02:21:57] PROBLEM - cp20 Stunnel HTTP for mw102 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [02:22:05] PROBLEM - cp21 Stunnel HTTP for mw102 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [02:22:26] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 7.53, 4.02, 3.14 [02:24:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.43, 9.44, 9.95 [02:24:25] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.55, 3.72, 3.14 [02:24:39] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 8.09, 8.91, 9.85 [02:24:58] RECOVERY - cp30 Stunnel HTTP for mw102 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 14562 bytes in 8.686 second response time [02:25:00] RECOVERY - mw102 MediaWiki Rendering on mw102 is OK: HTTP OK: HTTP/1.1 200 OK - 22220 bytes in 9.468 second response time [02:25:04] RECOVERY - cp31 Stunnel HTTP for mw102 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 14556 bytes in 7.536 second response time [02:25:37] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.93, 9.38, 9.97 [02:26:09] RECOVERY - cp20 Stunnel HTTP for mw102 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 14562 bytes in 3.050 second response time [02:26:17] RECOVERY - cp21 Stunnel HTTP for mw102 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 14562 bytes in 4.178 second response time [02:26:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.62, 10.29, 10.18 [02:27:37] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.97, 10.07, 10.15 [02:28:21] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.81, 3.21, 3.05 [02:28:37] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 10.52, 9.84, 10.02 [02:28:52] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.01, 9.19, 9.13 [02:29:29] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.50, 3.78, 3.43 [02:32:49] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.73, 9.60, 9.33 [02:32:52] PROBLEM - mw101 MediaWiki Rendering on mw101 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [02:33:02] PROBLEM - cp31 Stunnel HTTP for mw101 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [02:33:19] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.92, 3.39, 3.35 [02:33:37] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.30, 9.66, 9.99 [02:34:33] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.60, 1.71, 1.36 [02:34:47] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 11.51, 10.25, 9.59 [02:34:50] RECOVERY - mw101 MediaWiki Rendering on mw101 is OK: HTTP OK: HTTP/1.1 200 OK - 22220 bytes in 1.911 second response time [02:35:01] RECOVERY - cp31 Stunnel HTTP for mw101 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 14562 bytes in 2.408 second response time [02:35:37] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.12, 9.77, 9.98 [02:36:32] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.59, 1.31, 1.26 [02:40:30] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.93, 1.72, 1.43 [02:42:40] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.70, 9.31, 9.51 [02:44:40] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.40, 9.57, 9.56 [02:46:27] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.04, 1.85, 1.58 [02:46:40] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.39, 9.52, 9.55 [02:48:26] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.61, 1.35, 1.43 [02:54:21] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.75, 9.64, 9.96 [02:56:21] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 12.43, 10.74, 10.33 [02:56:54] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.51, 3.53, 2.95 [02:57:19] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.71, 3.89, 2.93 [02:58:52] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 3.17, 3.39, 2.98 [02:59:16] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.07, 3.63, 2.96 [03:01:12] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.61, 3.29, 2.91 [03:02:47] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.61, 3.43, 3.08 [03:04:45] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.19, 2.92, 2.93 [03:06:41] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 11.02, 9.91, 9.56 [03:10:41] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.87, 9.66, 9.58 [03:19:37] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.91, 9.64, 10.00 [03:20:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.20, 9.05, 9.81 [03:22:40] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 11.11, 9.57, 9.31 [03:23:37] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 11.79, 9.98, 9.98 [03:24:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.93, 9.97, 9.99 [03:25:37] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.82, 9.60, 9.85 [03:28:40] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 7.88, 9.02, 9.24 [03:29:37] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.12, 9.64, 9.79 [03:34:40] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.58, 9.10, 9.14 [03:36:40] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.45, 8.88, 9.06 [03:37:37] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.00, 9.92, 9.97 [03:39:37] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.41, 10.03, 10.00 [03:48:41] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.70, 9.39, 9.04 [03:54:40] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.47, 9.70, 9.31 [03:56:37] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.08, 3.90, 3.31 [03:56:40] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 11.09, 10.32, 9.60 [04:00:37] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.07, 3.25, 3.21 [04:00:41] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.35, 9.82, 9.58 [04:04:40] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.92, 9.74, 9.58 [04:08:37] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.30, 3.27, 3.13 [04:08:41] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.48, 9.89, 9.70 [04:18:37] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.77, 3.62, 3.46 [04:19:48] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.02, 2.50, 1.87 [04:20:37] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.81, 3.09, 3.27 [04:24:40] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.30, 9.50, 9.36 [04:25:45] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.01, 1.69, 1.72 [04:26:40] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.22, 9.25, 9.28 [04:27:44] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.74, 1.41, 1.61 [04:28:05] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 7.66, 8.66, 9.86 [04:30:05] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.93, 10.19, 10.27 [04:32:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.83, 9.05, 9.92 [04:34:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 11.48, 10.30, 10.29 [04:34:21] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 7.60, 9.21, 9.93 [04:35:37] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.23, 9.26, 9.95 [04:41:37] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 11.42, 9.96, 9.94 [04:42:21] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.51, 9.68, 9.80 [04:42:40] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 6.25, 7.83, 8.47 [04:44:21] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.33, 9.69, 9.81 [04:45:37] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 7.56, 9.48, 9.82 [04:46:21] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 11.99, 10.25, 9.98 [04:46:40] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.77, 9.04, 8.81 [04:48:40] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 11.49, 9.44, 8.96 [04:50:40] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.58, 9.24, 8.93 [04:51:37] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 11.74, 10.03, 9.87 [04:52:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.55, 8.98, 9.91 [04:52:21] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.54, 9.88, 9.95 [04:53:37] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.54, 9.78, 9.79 [04:54:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.52, 9.58, 10.02 [04:54:21] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 11.55, 10.00, 9.95 [04:56:05] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.57, 9.60, 9.98 [04:56:21] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.14, 9.32, 9.69 [04:57:18] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.94, 9.24, 9.91 [04:57:37] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.32, 9.64, 9.69 [04:59:18] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 11.13, 10.01, 10.11 [04:59:37] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.09, 8.95, 9.43 [05:00:05] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 10.68, 9.53, 9.83 [05:00:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.02, 9.55, 9.99 [05:01:37] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.47, 9.33, 9.49 [05:03:37] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.60, 9.58, 9.57 [05:04:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.93, 11.24, 10.54 [05:05:18] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.05, 9.76, 9.99 [05:06:21] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.77, 9.70, 9.63 [05:07:18] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 11.77, 10.40, 10.19 [05:07:37] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.76, 9.73, 9.60 [05:08:21] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.87, 9.63, 9.61 [05:09:37] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.66, 9.21, 9.42 [05:11:37] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 11.13, 10.25, 9.79 [05:12:40] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 6.83, 7.65, 8.21 [05:13:37] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.93, 9.76, 9.68 [05:17:37] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.16, 9.43, 9.54 [05:18:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.67, 9.60, 9.99 [05:18:21] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 11.06, 9.04, 9.18 [05:19:37] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.17, 9.21, 9.44 [05:20:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 11.75, 10.25, 10.17 [05:24:05] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 7.88, 8.94, 9.81 [05:24:21] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.79, 9.76, 9.54 [05:25:37] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 11.20, 9.47, 9.40 [05:26:05] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 10.13, 9.35, 9.85 [05:26:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.24, 9.69, 9.99 [05:28:05] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 7.55, 8.80, 9.60 [05:28:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.19, 9.94, 10.05 [05:30:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.78, 9.55, 9.89 [05:31:18] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.61, 9.53, 9.96 [05:31:37] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.87, 9.33, 9.44 [05:32:06] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 10.71, 10.14, 9.96 [05:33:18] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 11.09, 10.04, 10.09 [05:33:37] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.43, 9.81, 9.60 [05:34:05] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 8.67, 9.40, 9.70 [05:34:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.84, 10.62, 10.14 [05:35:18] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 7.87, 9.27, 9.81 [05:35:37] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.87, 9.61, 9.56 [05:36:21] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 5.74, 7.32, 8.44 [05:37:37] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.76, 10.05, 9.73 [05:38:05] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 10.92, 9.50, 9.61 [05:39:18] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 11.81, 10.09, 9.96 [05:40:05] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.36, 9.53, 9.61 [05:41:06] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 1.49, 2.50, 1.60 [05:43:05] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 0.85, 1.95, 1.51 [05:44:05] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 10.06, 9.53, 9.55 [05:44:21] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.41, 8.65, 8.68 [05:46:05] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.00, 9.59, 9.57 [05:47:03] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.06, 1.51, 1.43 [05:48:05] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 11.10, 10.21, 9.81 [05:48:21] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 12.07, 9.71, 9.05 [05:50:21] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.71, 9.79, 9.17 [05:51:00] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.93, 1.92, 1.63 [05:52:21] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 11.45, 10.38, 9.46 [05:54:59] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.16, 1.49, 1.52 [05:56:21] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.09, 9.41, 9.31 [05:57:06] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 7.87, 8.60, 8.46 [06:03:01] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 6.96, 7.91, 8.28 [06:06:56] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.06, 8.94, 8.58 [06:08:54] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.66, 9.02, 8.67 [06:10:53] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.63, 9.48, 8.86 [06:12:35] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [06:12:51] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.37, 9.37, 8.90 [06:16:21] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.49, 8.95, 8.79 [06:22:21] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.81, 9.77, 9.26 [06:24:05] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 8.69, 9.21, 9.91 [06:28:05] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 10.42, 9.59, 9.90 [06:30:21] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.93, 9.85, 9.37 [06:32:21] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.59, 9.43, 9.29 [06:34:05] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 8.37, 9.62, 9.91 [06:34:40] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.62, 9.51, 9.09 [06:36:21] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.23, 9.36, 9.25 [06:36:40] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.22, 9.33, 9.10 [06:38:05] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.08, 10.65, 10.24 [06:38:21] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.73, 8.99, 9.12 [06:39:37] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.41, 9.25, 9.95 [06:41:37] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.78, 9.90, 10.11 [06:44:05] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.24, 9.79, 9.97 [06:45:18] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.32, 9.21, 9.90 [06:45:37] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.55, 9.34, 9.83 [06:46:05] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 11.04, 10.39, 10.18 [06:48:21] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 13.54, 10.52, 9.48 [06:50:05] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.44, 9.58, 9.89 [06:52:05] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 11.69, 10.45, 10.18 [06:52:21] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.29, 9.90, 9.55 [06:59:18] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 11.10, 9.11, 9.20 [07:00:05] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 8.87, 9.65, 9.98 [07:00:21] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.59, 8.76, 8.94 [07:01:18] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.45, 9.12, 9.20 [07:02:05] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 11.32, 10.73, 10.36 [07:02:21] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.49, 8.85, 8.95 [07:03:18] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.95, 9.77, 9.42 [07:04:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.88, 9.48, 9.99 [07:04:41] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.57, 9.37, 8.95 [07:05:18] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.83, 9.53, 9.36 [07:06:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 9.82, 9.78, 10.05 [07:06:40] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.49, 9.06, 8.89 [07:07:18] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.33, 9.79, 9.48 [07:07:37] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 11.56, 9.29, 9.07 [07:09:37] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.64, 9.23, 9.07 [07:11:37] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 15.11, 11.40, 9.89 [07:12:21] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.62, 7.83, 8.44 [07:14:41] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 6.72, 7.79, 8.44 [07:16:21] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.25, 8.64, 8.59 [07:18:21] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 7.82, 8.41, 8.52 [07:19:05] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CRITICAL - load average: 4.40, 4.93, 2.43 [07:19:37] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.02, 9.98, 9.94 [07:21:06] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 6.88, 6.14, 4.82 [07:21:37] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.82, 10.18, 10.01 [07:22:40] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 11.06, 9.36, 8.87 [07:23:06] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 5.21, 5.93, 4.91 [07:23:37] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.84, 9.95, 9.97 [07:24:40] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 7.89, 8.83, 8.74 [07:27:05] PROBLEM - cp21 Current Load on cp21 is WARNING: WARNING - load average: 1.03, 1.88, 1.90 [07:31:05] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 0.53, 1.11, 1.57 [07:31:37] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 11.07, 9.33, 9.58 [07:38:21] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.24, 7.86, 8.43 [07:44:40] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 5.97, 7.88, 8.46 [07:50:01] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.44, 9.08, 8.69 [07:54:32] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.83, 8.58, 8.58 [07:56:37] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.67, 3.98, 3.10 [07:58:28] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.29, 8.08, 8.37 [07:59:44] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.66, 8.16, 8.42 [08:00:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.13, 8.77, 9.78 [08:00:37] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 3.08, 3.14, 2.95 [08:01:37] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 7.96, 8.92, 9.69 [08:03:37] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.35, 9.67, 9.89 [08:04:05] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 7.91, 8.82, 9.77 [08:05:31] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.27, 9.01, 8.65 [08:05:37] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.30, 9.48, 9.80 [08:06:05] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 11.08, 9.31, 9.80 [08:06:20] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.56, 8.85, 8.49 [08:07:27] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.36, 8.73, 8.59 [08:07:37] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.65, 9.85, 9.89 [08:08:05] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 8.43, 9.05, 9.66 [08:08:18] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.53, 8.25, 8.30 [08:10:05] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 11.05, 9.69, 9.81 [08:12:05] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 8.53, 9.65, 9.81 [08:12:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.50, 9.75, 9.65 [08:13:18] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 6.68, 9.23, 10.00 [08:15:18] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.81, 9.66, 10.04 [08:17:18] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 8.33, 9.59, 10.00 [08:19:07] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 11.34, 9.93, 9.21 [08:19:18] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.44, 10.20, 10.18 [08:19:37] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.86, 9.68, 9.99 [08:23:00] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.89, 9.90, 9.35 [08:24:05] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 10.19, 9.36, 9.40 [08:26:05] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 7.05, 8.30, 8.99 [08:27:18] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 8.20, 9.40, 9.94 [08:27:35] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [08:30:05] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 10.35, 9.20, 9.19 [08:32:05] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 8.81, 9.29, 9.24 [08:32:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 6.94, 9.27, 9.83 [08:33:35] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [08:34:40] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.06, 7.39, 8.28 [08:38:35] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [08:39:18] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.25, 8.99, 9.33 [08:41:18] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.02, 9.10, 9.34 [08:41:35] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [08:42:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 11.40, 9.46, 9.46 [08:44:05] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 10.91, 9.77, 9.35 [08:44:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.80, 8.89, 9.26 [08:45:18] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 11.49, 10.07, 9.66 [08:45:37] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.16, 8.91, 8.83 [08:46:05] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 7.97, 9.10, 9.15 [08:46:35] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [08:49:37] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 7.72, 8.47, 8.68 [08:52:35] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [08:53:37] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.47, 9.19, 8.89 [08:56:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 11.05, 9.57, 9.24 [08:57:37] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.38, 9.96, 9.33 [08:58:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.26, 9.56, 9.29 [08:59:18] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 6.04, 8.92, 9.66 [08:59:37] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.30, 9.93, 9.38 [09:00:05] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 10.43, 9.36, 9.12 [09:03:18] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 11.24, 10.00, 9.91 [09:03:37] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.77, 9.66, 9.43 [09:04:05] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 8.64, 9.82, 9.46 [09:04:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 11.13, 9.83, 9.39 [09:05:18] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 8.62, 9.52, 9.75 [09:05:22] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.48, 8.57, 7.95 [09:07:18] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.08, 9.83, 9.84 [09:07:20] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.91, 8.37, 7.95 [09:08:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.03, 9.39, 9.36 [09:09:18] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.13, 9.57, 9.74 [09:09:37] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.16, 9.83, 9.55 [09:12:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 11.18, 9.84, 9.53 [09:13:18] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 11.08, 10.20, 9.96 [09:14:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.57, 9.47, 9.44 [09:14:34] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.22, 8.91, 8.49 [09:15:11] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.68, 8.73, 8.17 [09:16:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 11.46, 10.44, 9.81 [09:16:31] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.47, 9.27, 8.66 [09:17:10] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.72, 8.43, 8.14 [09:18:05] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 10.28, 9.74, 9.39 [09:18:27] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.85, 9.28, 8.73 [09:20:05] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.26, 9.60, 9.38 [09:20:24] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 13.94, 10.92, 9.39 [09:22:05] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 10.15, 9.86, 9.51 [09:22:21] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.31, 9.85, 9.18 [09:23:03] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.21, 9.36, 8.59 [09:23:40] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.00, 5.70, 4.76 [09:25:01] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.97, 9.06, 8.57 [09:25:18] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.44, 9.69, 9.89 [09:25:40] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 8.36, 6.56, 5.18 [09:27:18] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 11.05, 10.17, 10.04 [09:27:39] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 6.61, 6.56, 5.36 [09:28:58] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.29, 8.14, 8.31 [09:29:18] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 8.92, 9.55, 9.83 [09:29:37] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 7.96, 9.60, 9.99 [09:30:30] Ugh I don’t know what managed to occur but ive managed to get an echo notification from staffwiki that wont go away on metawiki could someone look into it [09:33:18] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 11.60, 10.12, 9.96 [09:35:18] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 8.18, 9.40, 9.72 [09:36:21] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 8.03, 7.87, 8.46 [09:37:35] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [09:38:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.10, 9.24, 9.80 [09:39:18] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.69, 9.78, 9.78 [09:39:35] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 6.81, 6.93, 6.17 [09:41:35] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 10.51, 8.13, 6.69 [09:41:35] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [09:42:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.07, 9.32, 9.67 [09:44:05] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 8.99, 9.36, 9.87 [09:44:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.08, 9.10, 9.54 [09:45:18] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 8.39, 9.80, 9.88 [09:47:37] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.76, 9.23, 9.22 [09:48:05] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 11.29, 9.83, 9.89 [09:49:18] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 11.20, 10.07, 9.94 [09:49:37] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.51, 8.81, 9.06 [09:53:18] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 8.15, 9.64, 9.85 [09:54:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.35, 9.38, 9.45 [09:54:21] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.25, 8.93, 8.37 [09:54:40] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.18, 8.44, 7.83 [09:55:18] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 11.70, 10.37, 10.08 [09:56:40] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.27, 7.94, 7.72 [09:57:18] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 8.12, 9.41, 9.77 [09:58:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.81, 9.44, 9.49 [10:00:21] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.27, 8.35, 8.34 [10:02:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 11.07, 9.46, 9.43 [10:03:37] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.58, 8.16, 8.47 [10:04:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.93, 9.95, 9.63 [10:05:18] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.19, 9.28, 9.45 [10:06:35] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [10:07:18] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 8.32, 8.87, 9.28 [10:09:18] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.69, 9.34, 9.39 [10:09:37] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.74, 8.52, 8.47 [10:11:37] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.91, 8.41, 8.44 [10:12:35] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [10:13:18] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.09, 9.60, 9.51 [10:14:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.18, 9.49, 9.41 [10:16:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.37, 9.09, 9.28 [10:17:18] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.78, 9.90, 9.61 [10:17:37] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.46, 8.77, 8.58 [10:19:18] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 7.87, 8.92, 9.27 [10:20:54] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.60, 8.91, 8.43 [10:21:18] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.16, 9.51, 9.45 [10:23:18] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.25, 9.35, 9.40 [10:23:37] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 6.50, 8.16, 8.47 [10:24:47] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 6.75, 8.11, 8.25 [10:25:18] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.44, 9.87, 9.59 [10:27:18] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 7.21, 8.93, 9.29 [10:27:25] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 6.80, 7.05, 8.00 [10:27:43] PROBLEM - diamowiki.ga - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - diamowiki.ga All nameservers failed to answer the query. [10:29:24] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 9.12, 7.55, 8.05 [10:29:37] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.66, 8.26, 8.36 [10:31:37] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.21, 7.79, 8.18 [10:33:18] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.28, 8.91, 9.06 [10:34:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.49, 9.60, 9.21 [10:35:18] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 8.49, 8.75, 8.99 [10:35:37] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.40, 8.69, 8.50 [10:36:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.95, 8.83, 8.96 [10:37:37] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.03, 8.32, 8.40 [10:41:18] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.42, 9.66, 9.25 [10:41:37] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.10, 10.13, 9.08 [10:43:18] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 8.39, 9.04, 9.07 [10:43:20] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 6.80, 7.27, 7.79 [10:43:37] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.08, 9.69, 9.06 [10:44:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.29, 9.24, 9.07 [10:45:20] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 8.05, 7.45, 7.79 [10:47:18] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 11.79, 10.22, 9.53 [10:48:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.44, 9.40, 9.22 [10:49:03] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.34, 8.65, 8.07 [10:49:19] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.72, 7.80, 7.88 [10:50:59] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.28, 8.59, 8.13 [10:53:18] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 8.22, 9.68, 9.58 [10:54:57] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 6.98, 8.04, 8.04 [10:57:37] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.94, 8.07, 8.49 [10:57:46] PROBLEM - diamowiki.ga - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 155, in main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 123, in main rdns_hostname = get_reverse_dnshostname(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 108, in get_reverse_dnshostname resolved_ip_addr = str(dns_resolver.resolve(hostn [10:57:46] AA')[0]) File "/usr/lib/python3/dist-packages/dns/resolver.py", line 1043, in resolve timeout = self._compute_timeout(start, lifetime) File "/usr/lib/python3/dist-packages/dns/resolver.py", line 950, in _compute_timeout raise Timeout(timeout=duration)dns.exception.Timeout: The DNS operation timed out after 5.408616542816162 seconds [11:01:37] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.04, 8.95, 8.79 [11:02:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.14, 10.02, 9.58 [11:03:18] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.17, 9.59, 9.35 [11:05:15] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 8.05, 7.54, 7.52 [11:05:37] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 6.88, 8.03, 8.46 [11:05:41] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.28, 9.41, 8.62 [11:07:18] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 8.32, 9.30, 9.29 [11:07:39] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 5.97, 8.03, 8.20 [11:09:37] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.14, 9.11, 8.82 [11:11:18] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 13.59, 10.76, 9.83 [11:12:35] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [11:14:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.61, 9.63, 9.83 [11:15:12] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 6.54, 7.56, 7.72 [11:16:35] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [11:17:10] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.24, 8.68, 8.16 [11:17:12] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 9.03, 8.05, 7.87 [11:17:37] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.30, 9.54, 9.33 [11:18:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.51, 10.04, 9.95 [11:19:06] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.15, 8.86, 8.29 [11:19:37] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 11.22, 9.90, 9.47 [11:21:25] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.53, 9.07, 8.41 [11:23:18] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.33, 9.89, 9.87 [11:23:23] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.03, 8.85, 8.43 [11:23:37] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 7.11, 9.46, 9.45 [11:25:10] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 6.24, 7.76, 7.90 [11:25:22] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.11, 8.25, 8.26 [11:26:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.73, 9.69, 9.92 [11:28:50] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 5.81, 7.87, 8.17 [11:29:18] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.61, 10.18, 9.99 [11:31:18] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 7.60, 9.50, 9.78 [11:34:05] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 7.71, 9.06, 9.85 [11:34:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.17, 10.33, 9.93 [11:38:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.36, 9.22, 9.61 [11:41:37] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 11.83, 9.95, 9.34 [11:42:05] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 10.71, 9.25, 9.50 [11:42:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.07, 9.54, 9.63 [11:43:06] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 8.20, 6.89, 6.98 [11:43:37] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.79, 9.67, 9.33 [11:44:05] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.37, 9.23, 9.47 [11:44:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.41, 9.32, 9.55 [11:45:06] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.57, 7.29, 7.13 [11:51:06] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 8.27, 7.49, 7.25 [11:51:18] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.61, 9.24, 9.37 [11:55:06] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 6.46, 7.31, 7.26 [11:55:18] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 8.50, 9.16, 9.34 [11:56:05] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.61, 10.33, 9.55 [11:57:37] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 5.33, 7.37, 8.20 [11:57:49] PROBLEM - diamowiki.ga - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - diamowiki.ga All nameservers failed to answer the query. [12:06:35] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [12:07:06] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 6.16, 6.40, 6.79 [12:08:05] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 7.19, 9.19, 9.57 [12:09:18] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 6.59, 7.58, 8.48 [12:10:20] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.97, 7.96, 8.47 [12:12:09] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.39, 8.57, 8.25 [12:13:35] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [12:14:04] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 6.76, 8.01, 8.09 [12:16:04] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.61, 7.23, 6.95 [12:16:05] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 11.81, 10.08, 9.83 [12:17:59] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 8.07, 8.40, 8.52 [12:18:03] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 9.70, 8.12, 7.31 [12:18:35] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [12:19:53] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 11.39, 9.19, 8.77 [12:20:03] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 6.19, 7.41, 7.15 [12:20:05] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 8.64, 9.57, 9.71 [12:21:35] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [12:21:47] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 7.37, 8.79, 8.70 [12:23:41] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 6.30, 7.95, 8.41 [12:27:52] PROBLEM - diamowiki.ga - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 155, in main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 123, in main rdns_hostname = get_reverse_dnshostname(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 108, in get_reverse_dnshostname resolved_ip_addr = str(dns_resolver.resolve(hostn [12:27:52] AA')[0]) File "/usr/lib/python3/dist-packages/dns/resolver.py", line 1043, in resolve timeout = self._compute_timeout(start, lifetime) File "/usr/lib/python3/dist-packages/dns/resolver.py", line 950, in _compute_timeout raise Timeout(timeout=duration)dns.exception.Timeout: The DNS operation timed out after 5.404914617538452 seconds [12:28:01] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 6.33, 6.43, 6.79 [12:31:59] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.48, 7.33, 7.11 [12:32:05] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 10.34, 9.17, 9.10 [12:33:59] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 8.60, 7.80, 7.31 [12:34:05] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 7.69, 8.71, 8.95 [12:35:43] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.13, 2.60, 1.75 [12:35:58] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 6.25, 7.21, 7.15 [12:36:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.08, 8.22, 7.73 [12:38:20] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.26, 8.23, 7.79 [12:39:32] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 0.87, 1.68, 1.56 [12:41:35] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [12:41:42] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.90, 9.97, 9.01 [12:42:06] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.57, 9.42, 8.58 [12:43:36] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 11.84, 10.28, 9.20 [12:44:05] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 14.42, 11.20, 9.88 [12:44:35] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [12:45:30] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 7.21, 9.30, 8.98 [12:45:47] PROBLEM - mw101 MediaWiki Rendering on mw101 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:45:55] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 5.83, 6.39, 6.71 [12:46:07] PROBLEM - cp21 Stunnel HTTP for mw101 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:46:27] PROBLEM - cp20 Stunnel HTTP for mw101 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:46:49] PROBLEM - cp30 Stunnel HTTP for mw101 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:46:55] PROBLEM - cp31 Stunnel HTTP for mw101 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:47:51] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 6.36, 7.72, 8.17 [12:48:10] RECOVERY - cp21 Stunnel HTTP for mw101 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 14562 bytes in 8.044 second response time [12:48:30] RECOVERY - cp20 Stunnel HTTP for mw101 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 14556 bytes in 5.854 second response time [12:48:49] RECOVERY - cp30 Stunnel HTTP for mw101 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 14548 bytes in 3.225 second response time [12:48:54] RECOVERY - cp31 Stunnel HTTP for mw101 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 14562 bytes in 3.237 second response time [12:49:18] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.01, 8.90, 8.84 [12:49:49] RECOVERY - mw101 MediaWiki Rendering on mw101 is OK: HTTP OK: HTTP/1.1 200 OK - 22220 bytes in 0.499 second response time [12:51:18] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 7.49, 8.35, 8.65 [12:51:43] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.21, 8.85, 8.50 [12:52:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.55, 7.93, 7.79 [12:53:38] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.77, 8.98, 8.61 [12:55:37] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.02, 8.48, 8.46 [12:56:20] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.07, 7.93, 7.88 [12:57:52] PROBLEM - diamowiki.ga - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - diamowiki.ga All nameservers failed to answer the query. [12:59:37] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.77, 9.11, 8.69 [13:00:05] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.14, 9.10, 9.99 [13:01:18] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.19, 9.24, 8.92 [13:01:37] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.58, 9.22, 8.78 [13:01:55] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.75, 1.75, 1.39 [13:02:05] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.53, 10.33, 10.33 [13:02:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.65, 8.46, 8.05 [13:03:37] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 11.32, 9.80, 9.03 [13:03:49] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.48, 1.58, 1.37 [13:04:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.64, 9.60, 8.54 [13:05:37] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.50, 9.37, 8.98 [13:06:08] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.68, 9.36, 8.17 [13:08:06] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 7.79, 8.85, 8.14 [13:08:21] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.75, 8.95, 8.10 [13:09:37] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.03, 9.96, 9.26 [13:10:05] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.28, 8.23, 7.99 [13:14:21] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 6.69, 7.96, 7.98 [13:20:21] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 11.99, 9.55, 8.54 [13:21:37] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.10, 9.93, 9.81 [13:22:21] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.59, 9.09, 8.50 [13:23:37] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.51, 9.78, 9.75 [13:27:55] PROBLEM - diamowiki.ga - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 155, in main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 123, in main rdns_hostname = get_reverse_dnshostname(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 108, in get_reverse_dnshostname resolved_ip_addr = str(dns_resolver.resolve(hostn [13:27:55] AA')[0]) File "/usr/lib/python3/dist-packages/dns/resolver.py", line 1043, in resolve timeout = self._compute_timeout(start, lifetime) File "/usr/lib/python3/dist-packages/dns/resolver.py", line 950, in _compute_timeout raise Timeout(timeout=duration)dns.exception.Timeout: The DNS operation timed out after 5.408199310302734 seconds [13:30:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.55, 9.53, 9.81 [13:30:21] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.25, 10.07, 9.20 [13:30:42] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 8.16, 7.43, 6.61 [13:32:21] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.63, 9.47, 9.08 [13:32:42] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 6.50, 7.01, 6.55 [13:33:37] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.12, 9.61, 9.94 [13:34:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 11.44, 10.42, 10.09 [13:34:21] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.05, 9.60, 9.17 [13:35:37] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 11.78, 10.35, 10.16 [13:36:21] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.09, 9.29, 9.13 [13:36:40] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.92, 9.10, 8.49 [13:38:21] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 12.56, 10.57, 9.62 [13:38:40] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 5.86, 6.49, 6.48 [13:39:37] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.74, 9.82, 10.00 [13:41:37] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.05, 10.77, 10.33 [13:44:21] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.29, 9.39, 9.42 [13:45:37] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.01, 9.75, 10.00 [13:47:37] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.57, 9.90, 10.01 [13:48:14] Please can someone (RhinosF1/Reception123) purge gratisdatawiki ? :) [13:48:21] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 12.83, 10.63, 9.85 [13:52:21] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.33, 9.80, 9.72 [13:52:40] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 11.02, 9.94, 9.17 [13:53:37] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.67, 9.69, 9.92 [13:54:41] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.44, 9.47, 9.10 [13:56:31] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.68, 2.62, 2.04 [13:56:40] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.07, 9.56, 9.17 [13:57:55] PROBLEM - diamowiki.ga - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - diamowiki.ga All nameservers failed to answer the query. [13:58:21] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 13.77, 10.42, 9.84 [13:58:27] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.20, 2.47, 2.06 [13:58:40] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.97, 9.84, 9.33 [14:00:40] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.12, 9.83, 9.38 [14:01:37] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.24, 9.55, 9.66 [14:02:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.70, 9.31, 9.89 [14:02:33] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.54, 6.52, 6.19 [14:02:41] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.31, 9.74, 9.40 [14:03:37] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.40, 9.11, 9.47 [14:04:32] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 4.97, 6.17, 6.11 [14:06:40] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.16, 9.81, 9.48 [14:07:37] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 11.17, 10.18, 9.84 [14:08:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.57, 9.86, 9.95 [14:08:40] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.79, 9.82, 9.52 [14:10:21] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.30, 9.55, 9.92 [14:10:30] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 8.10, 6.94, 6.40 [14:12:30] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 5.92, 6.56, 6.33 [14:12:40] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.38, 9.92, 9.61 [14:14:40] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 7.83, 8.99, 9.30 [14:15:37] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 6.96, 9.47, 9.90 [14:18:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.76, 9.42, 9.93 [14:18:28] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 8.14, 7.02, 6.54 [14:20:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.97, 9.63, 9.91 [14:20:21] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.86, 9.52, 9.51 [14:20:27] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 5.74, 6.53, 6.42 [14:22:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.56, 9.19, 9.72 [14:22:21] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.26, 9.22, 9.42 [14:22:37] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.12, 4.11, 3.07 [14:22:41] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.41, 8.98, 8.99 [14:23:07] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.51, 3.81, 2.91 [14:24:08] PROBLEM - cp21 Stunnel HTTP for mw101 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:24:13] sudden 504 [14:24:18] i mean, 503* [14:24:34] PROBLEM - cp20 Stunnel HTTP for mw101 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:24:37] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.30, 3.91, 3.13 [14:24:40] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 7.96, 8.37, 8.75 [14:24:50] PROBLEM - cp30 Stunnel HTTP for mw101 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:25:04] PROBLEM - cp31 Stunnel HTTP for mw101 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:25:05] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.13, 3.51, 2.91 [14:25:52] PROBLEM - mw101 MediaWiki Rendering on mw101 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:26:37] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.89, 4.51, 3.44 [14:27:04] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.13, 4.22, 3.24 [14:27:37] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 2.95, 6.65, 8.48 [14:27:58] PROBLEM - diamowiki.ga - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 155, in main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 123, in main rdns_hostname = get_reverse_dnshostname(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 108, in get_reverse_dnshostname resolved_ip_addr = str(dns_resolver.resolve(hostn [14:27:58] AA')[0]) File "/usr/lib/python3/dist-packages/dns/resolver.py", line 1043, in resolve timeout = self._compute_timeout(start, lifetime) File "/usr/lib/python3/dist-packages/dns/resolver.py", line 950, in _compute_timeout raise Timeout(timeout=duration)dns.exception.Timeout: The DNS operation timed out after 5.404260635375977 seconds [14:28:13] PROBLEM - cp31 Stunnel HTTP for mw122 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:28:20] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 3.18, 6.46, 8.47 [14:28:37] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 1.64, 3.42, 3.17 [14:28:40] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 3.36, 6.14, 7.82 [14:28:43] PROBLEM - cp30 Stunnel HTTP for mw102 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:28:54] PROBLEM - cp21 Stunnel HTTP for mw111 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:28:56] PROBLEM - cp21 Stunnel HTTP for mw102 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:28:57] PROBLEM - cp31 Stunnel HTTP for mw102 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:29:02] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.43, 3.97, 3.27 [14:29:18] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 6.31, 7.68, 9.83 [14:29:19] PROBLEM - cp31 Stunnel HTTP for mw111 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:29:21] PROBLEM - cp31 Stunnel HTTP for mw112 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:29:42] PROBLEM - cp30 Stunnel HTTP for mw112 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:30:03] PROBLEM - cp20 Stunnel HTTP for mw112 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:30:04] PROBLEM - cp21 Stunnel HTTP for mw112 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:30:05] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 7.56, 8.18, 9.85 [14:30:12] RECOVERY - cp31 Stunnel HTTP for mw122 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 14562 bytes in 0.576 second response time [14:30:21] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 5.40, 6.49, 8.14 [14:30:24] PROBLEM - mw112 MediaWiki Rendering on mw112 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:30:31] PROBLEM - cp20 Varnish Backends on cp20 is CRITICAL: 1 backends are down. mw122 [14:30:37] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 3.11, 3.26, 3.13 [14:30:38] RECOVERY - cp30 Stunnel HTTP for mw102 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 14556 bytes in 0.826 second response time [14:30:49] RECOVERY - cp21 Stunnel HTTP for mw111 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 14556 bytes in 0.447 second response time [14:30:54] RECOVERY - cp31 Stunnel HTTP for mw102 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 14548 bytes in 0.751 second response time [14:30:55] RECOVERY - cp21 Stunnel HTTP for mw102 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 14556 bytes in 0.020 second response time [14:31:19] RECOVERY - cp31 Stunnel HTTP for mw111 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 14556 bytes in 0.771 second response time [14:31:24] RECOVERY - cp31 Stunnel HTTP for mw112 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 14548 bytes in 7.442 second response time [14:31:45] RECOVERY - cp30 Stunnel HTTP for mw112 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 14556 bytes in 3.576 second response time [14:32:01] RECOVERY - cp21 Stunnel HTTP for mw112 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 14562 bytes in 0.019 second response time [14:32:01] RECOVERY - cp20 Stunnel HTTP for mw112 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 14556 bytes in 0.024 second response time [14:32:06] RECOVERY - mw101 MediaWiki Rendering on mw101 is OK: HTTP OK: HTTP/1.1 200 OK - 22220 bytes in 7.134 second response time [14:32:12] RECOVERY - cp21 Stunnel HTTP for mw101 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 14562 bytes in 7.078 second response time [14:32:19] RECOVERY - mw112 MediaWiki Rendering on mw112 is OK: HTTP OK: HTTP/1.1 200 OK - 22220 bytes in 0.417 second response time [14:32:31] RECOVERY - cp20 Varnish Backends on cp20 is OK: All 12 backends are healthy [14:32:52] RECOVERY - cp20 Stunnel HTTP for mw101 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 14562 bytes in 0.019 second response time [14:32:58] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.04, 3.90, 3.40 [14:33:06] RECOVERY - cp30 Stunnel HTTP for mw101 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 14556 bytes in 0.314 second response time [14:33:13] RECOVERY - cp31 Stunnel HTTP for mw101 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 14556 bytes in 0.321 second response time [14:35:37] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.72, 8.61, 8.45 [14:36:37] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.38, 4.10, 3.52 [14:38:37] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.15, 3.78, 3.48 [14:38:53] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.71, 3.71, 3.55 [14:39:37] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.02, 9.56, 8.94 [14:40:37] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.12, 3.20, 3.30 [14:41:18] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 13.31, 10.03, 9.69 [14:44:48] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.45, 3.00, 3.28 [14:45:18] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.69, 9.75, 9.66 [14:45:37] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 11.03, 9.79, 9.19 [14:47:37] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.80, 9.99, 9.35 [14:48:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.36, 9.21, 8.56 [14:49:07] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 12.02, 9.52, 8.60 [14:51:04] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.82, 9.57, 8.74 [14:51:18] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 11.90, 10.29, 9.85 [14:52:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.14, 9.43, 8.78 [14:53:18] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.81, 6.80, 5.99 [14:54:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.23, 8.66, 8.59 [14:54:57] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 8.20, 8.50, 8.47 [14:55:18] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 8.60, 7.42, 6.32 [14:57:12] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.93, 1.74, 1.49 [14:57:37] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 6.87, 7.55, 8.40 [14:57:57] PROBLEM - diamowiki.ga - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - diamowiki.ga All nameservers failed to answer the query. [14:58:05] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 11.90, 9.88, 9.24 [14:59:12] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.43, 1.50, 1.43 [14:59:35] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [14:59:44] @Reception123 could you look into this please [15:00:00] (I replied to something on discord) [15:00:25] @Joseph Zppix oh it's that annoying issue [15:00:42] I had it once before i dont remember what UO did to fix it [15:00:46] I'll have a look a bit later (please do feel free to ping if I forget) [15:00:48] but yes I thought it was fixed too [15:00:52] It was [15:01:03] Until i was on wiki last night when i noticed it [15:01:22] I wonder if migration or something broke the fix? [15:01:38] I cant see the notification since its on staff wiki so i cant tell you [15:02:05] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 7.92, 9.79, 9.42 [15:02:20] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 6.27, 7.84, 8.34 [15:02:53] I am going into work so if you need anything from my end feel free to ping me or dm me and ill check it as soon as i can [15:03:35] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [15:06:05] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 9.55, 10.03, 9.62 [15:06:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 11.64, 9.66, 8.93 [15:07:10] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.65, 8.17, 7.77 [15:08:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.24, 9.32, 8.92 [15:09:08] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 8.16, 8.08, 7.78 [15:09:18] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.65, 9.67, 9.95 [15:09:37] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.11, 8.46, 8.29 [15:11:18] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.79, 10.16, 10.10 [15:12:21] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.61, 8.86, 8.33 [15:18:21] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.97, 9.54, 8.75 [15:20:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.38, 9.00, 8.87 [15:22:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.47, 8.64, 8.75 [15:24:21] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.03, 9.28, 8.98 [15:25:37] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.09, 9.12, 8.75 [15:26:21] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.49, 9.69, 9.15 [15:28:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.36, 9.78, 9.21 [15:28:21] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.80, 9.72, 9.23 [15:29:37] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 7.42, 8.76, 8.75 [15:29:44] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.03, 8.61, 8.12 [15:30:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 6.47, 8.73, 8.91 [15:31:42] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.20, 8.31, 8.09 [15:33:18] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.37, 9.77, 9.98 [15:34:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 11.51, 9.99, 9.32 [15:36:21] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.27, 7.70, 8.42 [15:38:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.62, 9.51, 9.31 [15:40:21] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.97, 8.97, 8.77 [15:41:18] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 11.45, 9.82, 9.72 [15:41:29] PROBLEM - cp21 Stunnel HTTP for mw102 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:41:59] PROBLEM - cp20 Stunnel HTTP for mw102 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:42:21] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 5.78, 8.05, 8.48 [15:43:18] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 8.63, 9.47, 9.62 [15:43:27] RECOVERY - cp21 Stunnel HTTP for mw102 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 14556 bytes in 0.018 second response time [15:43:59] RECOVERY - cp20 Stunnel HTTP for mw102 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 14562 bytes in 0.024 second response time [15:44:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.44, 9.69, 9.41 [15:45:37] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 11.32, 9.57, 9.13 [15:47:18] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.39, 9.84, 9.73 [15:47:27] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.54, 9.01, 8.51 [15:48:21] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.67, 8.42, 8.32 [15:48:37] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.84, 3.12, 2.66 [15:49:25] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.06, 9.17, 8.61 [15:49:37] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.79, 9.88, 9.39 [15:50:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.70, 9.68, 9.58 [15:50:37] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 3.32, 3.08, 2.70 [15:51:23] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.51, 8.88, 8.57 [15:51:37] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.70, 10.09, 9.52 [15:52:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.97, 9.95, 9.67 [15:54:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.98, 9.77, 9.65 [15:54:21] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.45, 9.72, 9.02 [15:58:05] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.22, 3.15, 2.74 [15:58:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.27, 9.93, 9.72 [16:00:04] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.68, 2.91, 2.70 [16:00:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.65, 9.84, 9.71 [16:04:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.09, 10.33, 9.88 [16:05:13] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 5.98, 7.73, 8.31 [16:05:37] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.59, 9.99, 10.00 [16:07:37] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.12, 10.04, 10.01 [16:08:21] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 8.02, 8.25, 8.50 [16:09:37] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.63, 9.80, 9.92 [16:11:37] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.79, 10.36, 10.12 [16:12:05] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 7.26, 8.52, 9.80 [16:13:01] PROBLEM - cp30 Stunnel HTTP for mw122 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:13:05] PROBLEM - mw102 MediaWiki Rendering on mw102 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:13:06] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 2.50, 5.10, 7.84 [16:14:13] PROBLEM - cp21 Stunnel HTTP for mw122 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:14:17] PROBLEM - cp31 Stunnel HTTP for mw122 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:14:21] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.98, 8.93, 8.72 [16:14:26] PROBLEM - cp20 Stunnel HTTP for mw122 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:14:51] PROBLEM - mw122 MediaWiki Rendering on mw122 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:15:02] RECOVERY - mw102 MediaWiki Rendering on mw102 is OK: HTTP OK: HTTP/1.1 200 OK - 22220 bytes in 0.780 second response time [16:15:37] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.94, 9.86, 9.96 [16:16:05] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.72, 9.94, 10.00 [16:16:09] RECOVERY - cp21 Stunnel HTTP for mw122 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 14556 bytes in 2.338 second response time [16:16:17] RECOVERY - cp31 Stunnel HTTP for mw122 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 14562 bytes in 1.334 second response time [16:16:21] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.23, 9.15, 8.81 [16:16:24] RECOVERY - cp20 Stunnel HTTP for mw122 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 14556 bytes in 0.845 second response time [16:16:52] RECOVERY - mw122 MediaWiki Rendering on mw122 is OK: HTTP OK: HTTP/1.1 200 OK - 22220 bytes in 4.615 second response time [16:17:07] RECOVERY - cp30 Stunnel HTTP for mw122 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 14562 bytes in 2.934 second response time [16:17:37] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.35, 10.78, 10.29 [16:18:59] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.52, 8.46, 8.15 [16:19:06] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 3.39, 3.92, 6.41 [16:20:21] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.44, 9.60, 9.09 [16:20:57] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 8.41, 8.30, 8.12 [16:21:37] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.93, 9.78, 9.98 [16:22:21] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.36, 9.62, 9.14 [16:23:37] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.78, 11.00, 10.41 [16:24:52] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.45, 8.86, 8.36 [16:27:28] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.49, 3.32, 2.81 [16:28:21] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.15, 9.96, 9.50 [16:28:49] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 11.75, 9.73, 8.77 [16:29:23] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 3.34, 3.18, 2.82 [16:30:47] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 6.98, 8.70, 8.52 [16:32:46] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 6.52, 8.31, 8.42 [16:36:12] PROBLEM - cp21 Stunnel HTTP for mw122 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:38:05] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 8.64, 9.39, 9.92 [16:38:07] RECOVERY - cp21 Stunnel HTTP for mw122 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 14556 bytes in 0.144 second response time [16:44:05] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 11.64, 9.89, 9.89 [16:46:05] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 8.59, 9.15, 9.62 [16:48:05] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.03, 10.25, 9.96 [16:48:21] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 12.13, 9.69, 9.15 [16:50:05] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 8.61, 9.73, 9.82 [16:52:16] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.61, 3.67, 3.23 [16:53:23] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.41, 10.02, 8.96 [16:54:14] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.00, 3.83, 3.32 [16:57:37] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 7.89, 9.28, 9.87 [16:58:21] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 7.81, 9.54, 9.54 [17:00:09] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.42, 3.77, 3.46 [17:01:07] PROBLEM - cp31 Stunnel HTTP for mw122 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:01:16] PROBLEM - cp30 Stunnel HTTP for mw122 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:01:17] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.17, 9.90, 9.55 [17:02:05] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 10.12, 9.63, 9.64 [17:02:12] PROBLEM - cp21 Stunnel HTTP for mw122 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:02:52] PROBLEM - cp20 Stunnel HTTP for mw122 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:03:01] PROBLEM - mw122 MediaWiki Rendering on mw122 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:04:06] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.78, 3.36, 3.38 [17:05:13] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.34, 9.46, 9.36 [17:05:23] RECOVERY - cp31 Stunnel HTTP for mw122 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 14562 bytes in 9.979 second response time [17:05:27] RECOVERY - cp30 Stunnel HTTP for mw122 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 14548 bytes in 9.138 second response time [17:06:18] RECOVERY - cp21 Stunnel HTTP for mw122 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 14556 bytes in 7.648 second response time [17:07:05] RECOVERY - cp20 Stunnel HTTP for mw122 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 14548 bytes in 8.256 second response time [17:07:10] RECOVERY - mw122 MediaWiki Rendering on mw122 is OK: HTTP OK: HTTP/1.1 200 OK - 22220 bytes in 7.614 second response time [17:08:21] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.42, 9.48, 9.36 [17:09:10] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.68, 9.69, 9.53 [17:10:30] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 1.70, 4.33, 2.70 [17:11:37] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 11.59, 9.99, 9.65 [17:12:05] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 8.34, 9.68, 9.82 [17:14:21] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.07, 9.61, 9.45 [17:16:05] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.19, 10.45, 10.05 [17:16:27] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 0.66, 1.69, 1.99 [17:20:21] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 11.32, 9.75, 9.44 [17:20:25] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.77, 1.14, 1.68 [17:21:37] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 7.89, 9.48, 9.77 [17:24:21] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.75, 9.66, 9.50 [17:26:13] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.75, 1.58, 1.37 [17:28:06] PROBLEM - diamowiki.ga - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 155, in main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 123, in main rdns_hostname = get_reverse_dnshostname(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 108, in get_reverse_dnshostname resolved_ip_addr = str(dns_resolver.resolve(hostn [17:28:06] AA')[0]) File "/usr/lib/python3/dist-packages/dns/resolver.py", line 1043, in resolve timeout = self._compute_timeout(start, lifetime) File "/usr/lib/python3/dist-packages/dns/resolver.py", line 950, in _compute_timeout raise Timeout(timeout=duration)dns.exception.Timeout: The DNS operation timed out after 5.406161785125732 seconds [17:28:07] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 0.87, 1.32, 1.30 [17:28:53] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.36, 8.93, 8.77 [17:30:51] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 7.25, 8.17, 8.51 [17:31:37] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.62, 10.10, 9.88 [17:32:49] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 6.92, 7.87, 8.36 [17:41:40] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.91, 9.14, 8.73 [17:44:21] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.82, 9.24, 8.97 [17:45:37] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 6.30, 7.72, 8.25 [17:45:53] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.50, 3.08, 3.00 [17:46:21] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.34, 8.83, 8.85 [17:47:48] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.17, 2.87, 2.94 [17:47:59] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CRITICAL - load average: 2.37, 1.47, 1.00 [17:48:21] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.29, 9.27, 9.00 [17:49:58] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 1.19, 1.33, 1.01 [17:50:21] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.64, 9.24, 9.04 [17:53:29] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.51, 8.98, 8.60 [17:55:27] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.48, 9.35, 8.77 [17:56:21] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.26, 9.57, 9.17 [17:58:21] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.91, 9.86, 9.34 [17:59:24] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.00, 9.08, 8.82 [18:09:15] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.50, 9.60, 9.09 [18:11:13] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.97, 9.42, 9.09 [18:16:21] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.12, 9.27, 9.04 [18:18:21] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.53, 9.19, 9.02 [18:23:03] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.15, 9.00, 8.83 [18:25:01] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.91, 8.68, 8.72 [18:28:09] PROBLEM - diamowiki.ga - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - diamowiki.ga All nameservers failed to answer the query. [18:30:56] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 11.99, 9.83, 9.12 [18:32:21] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.79, 9.56, 9.07 [18:32:54] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 7.79, 9.26, 9.02 [18:34:05] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 7.35, 8.89, 9.74 [18:34:21] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.66, 9.52, 9.11 [18:36:27] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.52, 3.90, 2.98 [18:36:37] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.12, 3.66, 3.09 [18:38:05] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 10.56, 9.18, 9.62 [18:38:21] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.04, 9.24, 9.03 [18:38:49] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.52, 10.41, 9.52 [18:40:05] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.67, 9.37, 9.64 [18:40:21] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.22, 9.17, 9.03 [18:42:37] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.22, 3.72, 3.31 [18:42:46] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 7.12, 9.25, 9.30 [18:46:05] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 11.17, 9.71, 9.60 [18:46:27] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.10, 3.18, 3.15 [18:46:37] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.84, 2.87, 3.06 [18:48:22] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.71, 9.48, 9.14 [18:50:05] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 8.96, 9.97, 9.78 [18:51:26] PROBLEM - cp30 Stunnel HTTP for mw112 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:51:30] PROBLEM - cp31 Stunnel HTTP for mw112 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:52:05] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 9.81, 10.12, 9.87 [18:52:37] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.71, 3.35, 3.21 [18:52:43] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.71, 9.26, 9.11 [18:53:26] RECOVERY - cp31 Stunnel HTTP for mw112 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 14562 bytes in 0.322 second response time [18:53:26] RECOVERY - cp30 Stunnel HTTP for mw112 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 14562 bytes in 0.309 second response time [18:54:37] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.74, 4.24, 3.55 [18:54:41] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.54, 9.22, 9.11 [18:56:05] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.15, 9.62, 9.75 [18:56:21] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.47, 10.00, 9.68 [18:56:40] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 11.75, 9.86, 9.34 [18:58:05] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 11.05, 9.86, 9.80 [18:58:35] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 1.73, 2.41, 1.60 [18:58:40] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.81, 9.79, 9.38 [19:00:34] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 0.99, 1.95, 1.53 [19:00:40] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.64, 9.81, 9.41 [19:02:33] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.79, 1.51, 1.41 [19:02:37] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.28, 3.99, 3.79 [19:02:40] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.51, 9.34, 9.27 [19:03:22] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.67, 3.50, 3.32 [19:03:35] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [19:04:09] [02puppet] 07Universal-Omega opened pull request 03#2423: Allow static access from same domain - 13https://github.com/miraheze/puppet/pull/2423 [19:04:27] PROBLEM - cp20 Stunnel HTTP for mw101 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:04:37] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.42, 4.43, 3.96 [19:04:40] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.01, 9.42, 9.29 [19:05:18] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 8.44, 9.32, 9.92 [19:06:29] RECOVERY - cp20 Stunnel HTTP for mw101 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 14556 bytes in 4.750 second response time [19:06:40] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 7.48, 8.82, 9.10 [19:07:13] [02puppet] 07Universal-Omega closed pull request 03#2399: Replace `require_package` with `ensure_packages` - 13https://github.com/miraheze/puppet/pull/2399 [19:07:18] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.53, 9.86, 10.04 [19:07:22] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.15, 3.46, 3.20 [19:07:37] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 7.47, 9.27, 9.93 [19:09:37] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.42, 9.86, 10.07 [19:11:23] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 3.17, 3.38, 3.25 [19:11:37] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.30, 9.53, 9.94 [19:12:37] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.09, 3.77, 3.93 [19:13:37] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.85, 9.87, 10.00 [19:14:21] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.08, 9.06, 8.99 [19:15:02] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.91, 3.30, 3.37 [19:15:24] PROBLEM - mw102 MediaWiki Rendering on mw102 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:16:21] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.00, 8.92, 8.95 [19:16:40] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 6.58, 7.49, 8.41 [19:17:24] RECOVERY - mw102 MediaWiki Rendering on mw102 is OK: HTTP OK: HTTP/1.1 200 OK - 22220 bytes in 3.202 second response time [19:18:21] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 11.91, 9.89, 9.29 [19:20:41] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.32, 8.67, 8.69 [19:22:37] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.88, 2.48, 3.23 [19:24:21] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.92, 9.92, 9.57 [19:28:14] PROBLEM - diamowiki.ga - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 155, in main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 123, in main rdns_hostname = get_reverse_dnshostname(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 108, in get_reverse_dnshostname resolved_ip_addr = str(dns_resolver.resolve(hostn [19:28:14] AA')[0]) File "/usr/lib/python3/dist-packages/dns/resolver.py", line 1043, in resolve timeout = self._compute_timeout(start, lifetime) File "/usr/lib/python3/dist-packages/dns/resolver.py", line 950, in _compute_timeout raise Timeout(timeout=duration)dns.exception.Timeout: The DNS operation timed out after 5.406800985336304 seconds [19:28:40] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.75, 9.36, 8.94 [19:30:21] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.13, 9.47, 9.41 [19:30:41] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 7.15, 8.67, 8.76 [19:32:21] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.91, 9.59, 9.47 [19:40:21] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.33, 9.90, 9.62 [19:40:53] [02puppet] 07Universal-Omega synchronize pull request 03#2423: Allow static access from same domain - 13https://github.com/miraheze/puppet/pull/2423 [19:44:21] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.18, 9.72, 9.65 [19:44:40] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.28, 9.00, 8.79 [19:46:40] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.06, 8.67, 8.70 [19:46:57] PROBLEM - www.plan.eu.org - LetsEncrypt on sslhost is CRITICAL: connect to address www.plan.eu.org and port 443: Network is unreachableHTTP CRITICAL - Unable to open TCP socket [19:50:21] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 11.25, 9.92, 9.66 [19:50:41] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 11.33, 9.39, 8.93 [19:50:55] PROBLEM - www.plan.eu.org - reverse DNS on sslhost is WARNING: SSL WARNING - rDNS OK but records conflict. {'NS': ['NS.BORTZMEYER.eu.org.', 'GRA.WOLFHUGEL.EU.', 'NS1.eu.org.', 'NS1.ERIOMEM.NET.', 'NS3.KELTIA.NET.', 'DNS4.GANDI.NET.', 'AUTH1.DNS.ELM.NET.', 'HOBBES.BSD-DK.DK.', 'WOMBAT.BILLAUD.eu.org.'], 'CNAME': None} [19:54:21] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.47, 9.54, 9.60 [19:54:41] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.03, 9.49, 9.12 [19:56:40] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.41, 9.68, 9.22 [19:58:13] PROBLEM - diamowiki.ga - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - diamowiki.ga All nameservers failed to answer the query. [19:58:40] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.58, 9.04, 9.03 [20:00:01] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.85, 1.97, 1.36 [20:01:55] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.78, 1.91, 1.41 [20:02:41] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 6.74, 7.58, 8.41 [20:03:49] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.47, 1.68, 1.37 [20:08:21] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.21, 7.85, 8.48 [20:09:35] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.98, 4.05, 3.12 [20:10:05] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 7.75, 8.76, 9.94 [20:11:33] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.77, 3.82, 3.15 [20:12:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.04, 8.71, 9.91 [20:12:41] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.75, 9.69, 8.90 [20:14:05] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 10.19, 9.14, 9.77 [20:14:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 11.60, 9.79, 10.15 [20:14:21] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 11.20, 9.24, 8.77 [20:14:40] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.97, 9.06, 8.75 [20:15:30] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.47, 3.87, 3.29 [20:16:05] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 8.24, 8.77, 9.56 [20:16:41] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 11.72, 9.89, 9.07 [20:16:54] RECOVERY - www.plan.eu.org - LetsEncrypt on sslhost is OK: OK - Certificate 'www.plan.eu.org' will expire on Tue 05 Apr 2022 12:29:07 GMT +0000. [20:21:24] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.47, 3.75, 3.42 [20:22:21] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.65, 9.68, 9.31 [20:22:41] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.11, 9.55, 9.30 [20:24:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.20, 9.11, 9.82 [20:25:23] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 1.25, 2.70, 3.09 [20:26:05] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 10.48, 9.14, 9.19 [20:27:18] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 6.86, 9.11, 9.89 [20:28:08] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.76, 3.56, 3.14 [20:28:16] PROBLEM - diamowiki.ga - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 155, in main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 123, in main rdns_hostname = get_reverse_dnshostname(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 108, in get_reverse_dnshostname resolved_ip_addr = str(dns_resolver.resolve(hostn [20:28:17] AA')[0]) File "/usr/lib/python3/dist-packages/dns/resolver.py", line 1043, in resolve timeout = self._compute_timeout(start, lifetime) File "/usr/lib/python3/dist-packages/dns/resolver.py", line 950, in _compute_timeout raise Timeout(timeout=duration)dns.exception.Timeout: The DNS operation timed out after 5.405999660491943 seconds [20:29:37] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 7.68, 8.94, 9.74 [20:30:05] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.96, 9.64, 9.41 [20:30:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.93, 9.80, 9.85 [20:30:41] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 5.44, 7.25, 8.38 [20:32:05] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 11.29, 10.57, 9.81 [20:32:21] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.22, 9.09, 9.11 [20:33:53] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.51, 3.11, 3.09 [20:34:05] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 7.32, 9.62, 9.57 [20:34:21] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.33, 8.91, 9.05 [20:35:18] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.05, 9.02, 9.45 [20:35:37] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 11.05, 9.57, 9.71 [20:36:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.52, 9.81, 9.92 [20:37:18] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 6.42, 8.19, 9.10 [20:37:37] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 7.32, 8.62, 9.35 [20:38:35] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [20:40:21] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 6.57, 7.65, 8.45 [20:42:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.58, 9.29, 9.57 [20:43:18] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 12.56, 9.59, 9.29 [20:44:21] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.96, 8.60, 8.63 [20:46:05] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 10.28, 8.99, 9.07 [20:46:21] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.45, 9.01, 8.75 [20:47:18] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.71, 9.74, 9.42 [20:48:21] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.12, 9.00, 8.79 [20:48:35] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [20:50:05] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.52, 9.85, 9.46 [20:50:21] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 11.38, 10.02, 9.20 [20:51:18] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 11.99, 10.39, 9.72 [20:51:37] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.90, 9.62, 9.25 [20:52:05] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 10.79, 10.25, 9.66 [20:52:59] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.73, 1.71, 1.21 [20:53:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.45, 8.99, 8.30 [20:53:37] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.83, 9.28, 9.17 [20:54:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.23, 9.44, 9.72 [20:54:21] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 7.38, 8.95, 8.99 [20:54:59] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.99, 1.45, 1.17 [20:56:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.81, 9.78, 9.80 [20:57:22] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.27, 9.46, 8.62 [20:57:34] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.83, 2.81, 2.36 [20:58:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.78, 9.93, 9.87 [20:59:20] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.61, 9.68, 8.81 [20:59:30] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.13, 2.58, 2.33 [21:02:21] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 5.37, 7.35, 8.33 [21:04:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.01, 10.33, 9.93 [21:05:15] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.37, 10.24, 9.22 [21:05:37] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 11.08, 9.48, 9.32 [21:07:13] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.94, 9.66, 9.13 [21:09:11] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.36, 9.28, 8.85 [21:11:07] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.82, 9.56, 9.02 [21:16:57] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.24, 9.48, 9.05 [21:18:48] PROBLEM - www.plan.eu.org - LetsEncrypt on sslhost is CRITICAL: connect to address www.plan.eu.org and port 443: Network is unreachableHTTP CRITICAL - Unable to open TCP socket [21:19:03] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.88, 9.29, 8.98 [21:21:01] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.64, 9.23, 8.99 [21:22:50] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.62, 9.93, 9.43 [21:22:59] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 11.07, 9.85, 9.24 [21:24:46] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.12, 9.94, 9.49 [21:24:58] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.21, 9.16, 9.06 [21:26:43] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.55, 9.91, 9.54 [21:28:40] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 11.71, 10.29, 9.71 [21:28:54] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.62, 9.58, 9.20 [21:30:36] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 7.95, 9.39, 9.46 [21:30:53] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 7.36, 8.83, 8.98 [21:32:33] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.45, 9.72, 9.56 [21:34:30] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.22, 9.55, 9.52 [21:36:48] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.01, 9.34, 9.09 [21:37:18] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.51, 2.97, 2.78 [21:38:46] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.49, 9.00, 9.00 [21:39:14] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.51, 2.40, 2.59 [21:44:05] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.54, 9.27, 9.91 [21:44:41] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 6.66, 7.66, 8.40 [21:45:18] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 6.65, 8.62, 9.82 [21:46:05] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 10.56, 9.73, 9.99 [21:47:18] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.33, 9.09, 9.83 [21:48:21] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.92, 9.48, 9.27 [21:50:05] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.05, 9.69, 9.95 [21:50:21] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.90, 9.69, 9.38 [21:52:05] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 10.49, 9.97, 10.02 [21:56:05] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.75, 9.77, 9.95 [21:56:40] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.63, 9.14, 8.74 [22:01:37] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.17, 8.93, 9.92 [22:02:05] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.17, 10.88, 10.30 [22:04:40] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 11.32, 8.79, 8.58 [22:05:18] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 8.97, 9.47, 9.95 [22:06:05] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 7.94, 9.65, 9.97 [22:06:21] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.33, 7.85, 8.45 [22:06:40] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.20, 8.79, 8.60 [22:08:05] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 9.27, 9.86, 10.03 [22:09:37] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 11.72, 9.39, 9.63 [22:10:05] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.68, 9.73, 9.95 [22:11:18] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 12.66, 9.83, 9.80 [22:12:05] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 11.63, 10.25, 10.10 [22:12:21] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 7.95, 8.99, 8.83 [22:12:40] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.85, 8.42, 8.48 [22:13:37] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.49, 9.66, 9.73 [22:14:05] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 8.83, 9.79, 9.97 [22:16:21] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 12.36, 9.69, 9.04 [22:17:18] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 6.21, 8.63, 9.41 [22:18:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 6.10, 8.56, 9.89 [22:19:30] PROBLEM - cp31 Stunnel HTTP for mw112 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [22:19:59] PROBLEM - cp20 Stunnel HTTP for mw112 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [22:21:26] RECOVERY - cp31 Stunnel HTTP for mw112 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 14562 bytes in 0.322 second response time [22:21:58] RECOVERY - cp20 Stunnel HTTP for mw112 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 14562 bytes in 0.849 second response time [22:22:05] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 10.26, 8.77, 9.22 [22:24:05] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.01, 8.69, 9.13 [22:26:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.63, 9.08, 9.41 [22:26:21] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.31, 9.67, 9.69 [22:28:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.89, 9.41, 9.49 [22:32:05] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.22, 9.90, 9.35 [22:33:18] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.35, 9.30, 9.02 [22:34:05] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.00, 9.87, 9.41 [22:34:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.38, 10.16, 9.69 [22:35:18] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 8.34, 8.94, 8.93 [22:35:37] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 11.10, 9.92, 9.36 [22:36:05] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 9.72, 10.05, 9.55 [22:36:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.20, 9.61, 9.54 [22:36:21] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 6.45, 7.16, 8.37 [22:37:37] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.91, 9.62, 9.30 [22:38:05] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 8.50, 9.40, 9.37 [22:42:05] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 10.23, 9.73, 9.50 [22:43:35] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [22:44:01] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.37, 3.49, 3.00 [22:45:57] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.86, 3.51, 3.06 [22:46:05] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.97, 9.99, 9.66 [22:47:52] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.98, 3.16, 2.98 [22:49:11] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.87, 9.46, 8.72 [22:49:37] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 11.18, 10.00, 9.56 [22:50:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.50, 9.67, 9.42 [22:51:07] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.27, 8.73, 8.53 [22:51:18] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 12.74, 10.75, 9.66 [22:52:05] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 10.92, 9.90, 9.65 [22:52:35] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [22:53:37] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.22, 9.97, 9.70 [22:54:05] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 6.80, 8.68, 9.24 [22:56:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.48, 9.98, 9.73 [22:58:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.79, 10.25, 9.85 [22:58:54] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 6.73, 8.25, 8.47 [22:59:37] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 11.10, 9.91, 9.68 [23:00:01] !log [@test101] starting deploy of {'l10nupdate': True} to skip [23:00:03] !log [@mwtask111] starting deploy of {'l10nupdate': True} to all [23:00:07] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:00:21] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:01:37] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.88, 9.37, 9.51 [23:02:05] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 15.04, 11.18, 9.92 [23:03:37] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.39, 9.43, 9.49 [23:04:41] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.99, 8.68, 8.56 [23:05:08] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.64, 3.22, 2.92 [23:05:37] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.88, 9.48, 9.53 [23:06:37] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.60, 9.35, 8.81 [23:07:03] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 3.14, 3.10, 2.91 [23:07:37] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.75, 9.96, 9.70 [23:08:34] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.72, 9.36, 8.88 [23:11:37] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.17, 9.51, 9.62 [23:13:37] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 11.29, 10.01, 9.77 [23:14:15] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.51, 9.30, 8.43 [23:14:24] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.83, 9.59, 9.07 [23:16:13] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 7.64, 8.74, 8.34 [23:16:21] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.13, 9.04, 8.93 [23:19:34] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.18, 1.78, 1.04 [23:20:10] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.04, 8.92, 8.45 [23:20:21] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.43, 9.65, 9.17 [23:21:22] !log [@mwtask111] finished deploy of {'l10nupdate': True} to all - SUCCESS in 1278s [23:21:28] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.78, 3.41, 3.11 [23:21:32] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:21:34] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.52, 1.73, 1.12 [23:21:37] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.15, 9.73, 9.85 [23:22:08] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.49, 8.27, 8.27 [23:22:21] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.11, 9.37, 9.13 [23:23:23] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.98, 3.11, 3.03 [23:23:34] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.23, 1.55, 1.12 [23:24:22] !log [@test101] finished deploy of {'l10nupdate': True} to skip - SUCCESS in 1460s [23:24:29] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:27:35] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [23:28:05] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 7.51, 9.28, 9.85 [23:32:05] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.20, 10.60, 10.22 [23:32:35] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [23:34:05] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 7.97, 9.56, 9.89 [23:35:37] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 11.40, 10.01, 9.72 [23:35:54] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.38, 8.92, 8.41 [23:36:05] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 11.16, 10.21, 10.08 [23:37:37] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.90, 9.24, 9.46 [23:38:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.75, 9.15, 10.00 [23:38:21] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.10, 9.34, 8.97 [23:39:37] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 11.60, 9.95, 9.68 [23:39:51] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.74, 8.19, 8.22 [23:40:05] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 8.60, 9.63, 9.89 [23:40:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.37, 9.50, 10.01 [23:40:21] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.90, 9.10, 8.93 [23:43:37] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.56, 9.52, 9.61 [23:44:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.40, 8.89, 9.67 [23:45:37] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.56, 9.76, 9.67 [23:46:21] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 6.65, 7.55, 8.28 [23:47:37] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.90, 9.70, 9.65 [23:50:21] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.74, 9.12, 8.77 [23:52:05] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 10.34, 9.21, 9.36 [23:55:37] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 11.53, 10.12, 9.75 [23:56:05] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 8.46, 9.35, 9.41 [23:57:35] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [23:59:18] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.15, 9.67, 9.97 [23:59:37] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.73, 9.70, 9.66