[00:00:26] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.04, 1.39, 1.65 [00:01:14] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 2.00, 1.84, 1.32 [00:02:33] [Grafana] RESOLVED: PHP-FPM Worker Usage High https://grafana.miraheze.org/d/GtxbP1Xnk [00:03:54] PROBLEM - mw111 MediaWiki Rendering on mw111 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:04:21] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.31, 1.67, 1.73 [00:05:14] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.43, 1.67, 1.38 [00:05:57] RECOVERY - mw111 MediaWiki Rendering on mw111 is OK: HTTP OK: HTTP/1.1 200 OK - 27096 bytes in 6.319 second response time [00:06:20] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.69, 1.34, 1.60 [00:10:34] RECOVERY - cloud10 Puppet on cloud10 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [00:11:11] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 9.51, 9.04, 10.03 [00:15:14] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.05, 1.79, 1.54 [00:19:14] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.90, 1.81, 1.61 [00:25:11] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.19, 10.65, 10.20 [00:27:11] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 8.90, 10.00, 10.02 [00:30:32] [Grafana] FIRING: Some MediaWiki Appservers are running out of PHP-FPM workers. https://grafana.miraheze.org/d/GtxbP1Xnk [00:35:14] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 3.19, 2.12, 1.85 [00:35:32] [Grafana] RESOLVED: PHP-FPM Worker Usage High https://grafana.miraheze.org/d/GtxbP1Xnk [00:37:04] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.09, 1.61, 1.33 [00:41:04] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.94, 1.43, 1.33 [00:41:44] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.51, 1.99, 1.58 [00:43:42] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.68, 1.52, 1.45 [00:49:02] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.20, 1.94, 1.59 [00:50:01] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.88, 10.04, 9.80 [00:51:15] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.55, 1.93, 1.98 [00:55:58] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 9.43, 10.07, 9.97 [01:00:59] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.05, 1.67, 1.80 [01:01:14] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.42, 2.24, 2.09 [01:04:59] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.27, 1.39, 1.65 [01:06:20] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.34, 3.60, 3.97 [01:08:09] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.00, 3.39, 4.00 [01:08:20] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.51, 3.93, 4.04 [01:10:20] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.62, 3.37, 3.82 [01:11:56] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 10.80, 9.82, 8.97 [01:12:34] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.17, 2.88, 3.88 [01:13:14] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.48, 1.82, 1.99 [01:13:54] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 9.13, 9.17, 8.81 [01:14:20] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.16, 3.27, 3.63 [01:16:09] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.83, 3.59, 3.75 [01:18:09] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.10, 3.51, 3.71 [01:18:20] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.41, 3.47, 3.64 [01:20:09] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.36, 3.78, 3.77 [01:20:20] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.84, 3.88, 3.75 [01:21:56] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.04, 1.62, 1.51 [01:23:55] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.54, 1.62, 1.52 [01:24:09] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.23, 3.31, 3.61 [01:24:20] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.20, 3.85, 3.79 [01:25:36] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 11.14, 9.77, 9.18 [01:26:09] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.24, 3.65, 3.70 [01:26:20] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.47, 4.23, 3.95 [01:27:33] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 8.28, 9.09, 9.00 [01:28:09] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.48, 3.72, 3.72 [01:28:34] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 6.64, 4.40, 3.89 [01:29:14] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.52, 2.00, 1.92 [01:30:34] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.10, 3.84, 3.75 [01:30:34] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.83, 11.02, 10.04 [01:32:09] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.05, 3.94, 3.79 [01:32:33] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.79, 10.60, 10.02 [01:32:34] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.69, 4.15, 3.87 [01:33:33] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.16, 10.72, 9.14 [01:34:09] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.44, 3.64, 3.69 [01:34:20] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.45, 3.24, 3.61 [01:34:34] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.24, 3.46, 3.65 [01:35:14] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.65, 1.95, 1.95 [01:35:33] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 11.77, 10.72, 9.32 [01:37:14] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.04, 1.97, 1.95 [01:38:20] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.50, 2.77, 3.34 [01:38:34] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.54, 3.43, 3.56 [01:39:33] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 9.01, 9.76, 9.25 [01:40:34] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.33, 3.29, 3.48 [01:42:34] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.01, 3.45, 3.52 [01:43:14] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.93, 1.99, 1.97 [01:43:51] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.57, 1.76, 1.54 [01:44:34] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.67, 3.57, 3.56 [01:45:49] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.42, 6.96, 5.98 [01:47:09] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.98, 3.56, 3.51 [01:47:49] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 6.28, 6.69, 6.00 [01:48:01] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.88, 9.84, 8.97 [01:49:50] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.47, 1.66, 1.59 [01:49:59] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 9.49, 9.56, 8.96 [01:51:15] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.26, 1.90, 1.91 [01:52:09] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.69, 4.00, 3.70 [01:52:34] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 6.11, 4.74, 3.97 [01:52:56] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.80, 3.90, 3.60 [01:53:14] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.62, 1.81, 1.88 [01:53:49] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 3.60, 2.86, 2.08 [01:54:13] PROBLEM - phab121 Current Load on phab121 is CRITICAL: CRITICAL - load average: 5.29, 2.77, 1.30 [01:55:15] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.33, 1.98, 1.93 [01:56:10] PROBLEM - phab121 Current Load on phab121 is WARNING: WARNING - load average: 0.85, 1.91, 1.16 [01:58:09] RECOVERY - phab121 Current Load on phab121 is OK: OK - load average: 0.27, 1.34, 1.04 [01:58:27] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.96, 7.12, 6.47 [01:58:44] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.28, 3.47, 3.57 [01:59:48] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.26, 1.93, 1.93 [02:00:17] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.01, 11.36, 10.95 [02:01:47] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 3.84, 2.65, 2.19 [02:01:52] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.46, 9.53, 9.00 [02:02:16] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.76, 10.87, 10.83 [02:03:52] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.99, 8.90, 8.83 [02:04:15] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.26, 11.26, 10.97 [02:06:04] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 6.03, 6.59, 6.48 [02:08:13] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.10, 11.32, 11.11 [02:08:23] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.12, 3.86, 3.69 [02:11:10] PROBLEM - cloud12 Puppet on cloud12 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[ulogd2] [02:12:34] PROBLEM - cloud10 Puppet on cloud10 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[ulogd2] [02:12:46] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.77, 10.25, 9.63 [02:13:14] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.88, 1.92, 1.99 [02:14:43] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 8.97, 10.15, 9.68 [02:17:15] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.06, 1.93, 1.98 [02:19:14] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.62, 1.83, 1.94 [02:20:02] [Grafana] FIRING: Some MediaWiki Appservers are running out of PHP-FPM workers. https://grafana.miraheze.org/d/GtxbP1Xnk [02:20:06] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 6.73, 8.54, 9.93 [02:20:20] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.37, 3.51, 3.85 [02:23:14] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.08, 1.94, 1.96 [02:24:09] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.31, 3.57, 3.97 [02:25:15] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.89, 1.93, 1.95 [02:26:01] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.36, 10.49, 10.28 [02:26:09] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.44, 4.28, 4.18 [02:26:20] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.64, 4.18, 3.96 [02:27:15] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.36, 2.27, 2.09 [02:28:00] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.18, 10.60, 10.35 [02:30:02] [Grafana] RESOLVED: PHP-FPM Worker Usage High https://grafana.miraheze.org/d/GtxbP1Xnk [02:31:58] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 8.88, 9.89, 10.12 [02:34:09] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.61, 3.54, 3.98 [02:34:20] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.11, 3.75, 3.91 [02:35:14] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.75, 1.91, 1.99 [02:36:09] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.23, 4.27, 4.19 [02:38:20] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 6.82, 4.49, 4.12 [02:38:21] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.24, 2.46, 1.77 [02:39:10] RECOVERY - cloud12 Puppet on cloud12 is OK: OK: Puppet is currently enabled, last run 27 seconds ago with 0 failures [02:39:14] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.24, 2.00, 2.01 [02:40:20] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.33, 3.97, 3.97 [02:40:34] RECOVERY - cloud10 Puppet on cloud10 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [02:41:40] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.53, 1.73, 2.00 [02:44:16] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.47, 1.82, 1.71 [02:44:34] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.16, 3.18, 3.86 [02:45:14] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.69, 1.93, 1.98 [02:46:14] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.35, 1.64, 1.66 [02:46:20] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.98, 4.22, 4.05 [02:46:34] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.29, 3.76, 3.99 [02:47:14] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.51, 2.15, 2.06 [02:49:38] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.02, 1.17, 1.62 [02:50:09] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.50, 1.79, 1.73 [02:50:20] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.99, 3.90, 3.98 [02:52:08] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.05, 1.86, 1.76 [02:52:09] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.04, 3.27, 3.81 [02:52:34] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.87, 3.67, 3.95 [02:54:06] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.75, 1.42, 1.61 [03:00:09] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 6.18, 3.88, 3.71 [03:00:34] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.68, 3.32, 3.54 [03:02:34] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.46, 3.22, 3.47 [03:04:09] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.66, 3.46, 3.60 [03:04:34] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 3.25, 3.06, 3.37 [03:05:38] [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03REL1_38 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/508d1d535c0f...c5c1e5da9466 [03:05:39] [url] Comparing 508d1d535c0f...c5c1e5da9466 · miraheze/mediawiki · GitHub | github.com [03:05:40] [02miraheze/mediawiki] 07Universal-Omega 03c5c1e5d - Update Cosmos [03:05:54] !log [universalomega@test101] starting deploy of {'world': True, 'l10n': True, 'lang': 'en'} to all [03:06:00] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:06:09] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.75, 3.84, 3.70 [03:06:18] !log [universalomega@mwtask111] starting deploy of {'world': True, 'l10n': True, 'lang': 'en'} to all [03:06:20] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.38, 3.45, 3.56 [03:06:28] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:08:34] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.75, 4.50, 3.87 [03:10:34] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.50, 3.95, 3.73 [03:11:47] !log [universalomega@test101] finished deploy of {'world': True, 'l10n': True, 'lang': 'en'} to all - SUCCESS in 353s [03:11:54] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:12:09] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.82, 3.87, 3.81 [03:12:20] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.92, 3.57, 3.66 [03:12:34] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.83, 4.17, 3.83 [03:13:22] RECOVERY - test101 Puppet on test101 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [03:14:20] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.43, 3.96, 3.79 [03:14:34] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.93, 3.83, 3.76 [03:14:50] !log [universalomega@mwtask111] finished deploy of {'world': True, 'l10n': True, 'lang': 'en'} to all - SUCCESS in 511s [03:14:56] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:17:26] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.75, 10.59, 10.14 [03:18:20] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.78, 3.32, 3.56 [03:18:34] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.63, 3.85, 3.75 [03:20:20] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.05, 2.95, 3.40 [03:20:34] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.00, 3.43, 3.60 [03:21:32] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.91, 1.84, 1.59 [03:22:09] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.68, 3.97, 3.80 [03:22:34] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.69, 4.21, 3.86 [03:23:31] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.86, 2.23, 1.76 [03:24:20] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.21, 4.33, 3.85 [03:25:21] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.01, 11.07, 10.47 [03:25:31] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 0.91, 1.76, 1.65 [03:27:31] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.00, 1.53, 1.57 [03:31:18] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.22, 11.47, 10.86 [03:31:29] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.23, 1.76, 1.65 [03:33:29] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.52, 1.64, 1.62 [03:37:28] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.66, 1.80, 1.69 [03:39:28] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.97, 1.51, 1.60 [03:41:12] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.46, 11.22, 10.88 [03:43:11] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.21, 10.49, 10.67 [03:48:32] [Grafana] FIRING: Some MediaWiki Appservers are running out of PHP-FPM workers. https://grafana.miraheze.org/d/GtxbP1Xnk [03:53:11] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 8.82, 9.65, 10.19 [04:01:14] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.53, 1.80, 1.99 [04:01:23] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 3.26, 2.11, 1.65 [04:07:14] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.15, 1.93, 1.99 [04:08:32] [Grafana] RESOLVED: PHP-FPM Worker Usage High https://grafana.miraheze.org/d/GtxbP1Xnk [04:09:21] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.20, 1.95, 1.83 [04:11:41] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 11.14, 9.83, 8.89 [04:13:20] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.30, 1.55, 1.69 [04:13:38] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 7.99, 9.16, 8.76 [04:14:09] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.66, 3.22, 3.94 [04:16:20] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.64, 3.20, 3.90 [04:18:09] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.30, 3.69, 3.95 [04:18:20] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.18, 4.04, 4.12 [04:20:09] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.97, 3.74, 3.94 [04:22:18] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.83, 1.82, 1.75 [04:24:17] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.10, 1.90, 1.79 [04:26:09] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.01, 4.09, 3.98 [04:26:17] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.35, 1.76, 1.76 [04:28:17] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.91, 1.52, 1.67 [04:32:09] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.31, 3.74, 3.97 [04:34:20] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.31, 3.60, 3.90 [04:35:14] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.64, 1.79, 1.99 [04:36:20] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.06, 3.90, 3.96 [04:40:09] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.40, 3.93, 3.89 [04:42:09] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.14, 3.71, 3.82 [04:44:20] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.77, 3.83, 3.95 [04:46:20] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.18, 3.89, 3.93 [04:49:14] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.17, 1.92, 1.89 [04:50:20] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.89, 3.70, 3.88 [04:50:34] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 1.89, 3.18, 3.90 [04:53:14] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.69, 1.92, 1.92 [04:54:09] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.91, 3.00, 3.37 [04:59:35] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.84, 10.53, 9.68 [05:00:34] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.26, 3.95, 3.81 [05:01:34] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 9.54, 10.20, 9.66 [05:02:20] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 7.23, 4.75, 4.08 [05:04:20] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.73, 3.92, 3.86 [05:04:34] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.38, 3.79, 3.78 [05:04:56] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.93, 3.54, 3.46 [05:06:34] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.20, 3.83, 3.79 [05:08:34] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.51, 3.37, 3.63 [05:08:49] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.90, 3.27, 3.37 [05:10:34] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.18, 3.94, 3.79 [05:12:20] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.71, 4.12, 3.92 [05:12:34] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.80, 3.63, 3.71 [05:12:44] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.97, 3.97, 3.61 [05:16:20] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.80, 3.65, 3.80 [05:16:34] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 8.17, 4.32, 3.87 [05:16:37] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.06, 3.53, 3.51 [05:18:16] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query bellinrattin.it. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [05:19:15] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.42, 2.00, 1.88 [05:22:26] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.31, 3.72, 3.56 [05:23:06] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 1.57, 2.03, 1.54 [05:23:14] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.47, 1.89, 1.88 [05:24:23] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.31, 3.66, 3.56 [05:24:34] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.78, 3.98, 3.92 [05:25:05] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.67, 1.98, 1.59 [05:27:05] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.95, 1.55, 1.47 [05:27:14] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.02, 1.91, 1.88 [05:30:12] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.72, 3.22, 3.40 [05:30:20] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.81, 2.99, 3.34 [05:31:14] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.87, 1.93, 1.90 [05:34:34] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.45, 2.80, 3.34 [05:42:20] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.58, 4.01, 3.60 [05:44:09] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.88, 3.54, 3.47 [05:45:15] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.43, 1.51, 1.66 [05:46:09] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.15, 2.99, 3.27 [05:46:20] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.77, 3.50, 3.50 [05:47:56] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - dnd.bellinrattin.it All nameservers failed to answer the query. [05:49:14] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.97, 2.19, 1.90 [05:52:20] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.61, 3.79, 3.60 [05:53:02] [02miraheze/mw-config] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/28ac5332c0d2...11b92183600b [05:53:03] [url] Comparing 28ac5332c0d2...11b92183600b · miraheze/mw-config · GitHub | github.com [05:53:04] [02miraheze/mw-config] 07Reception123 0311b9218 - set wgDefaultUserOptions for rarewiki per T9469 [05:54:06] miraheze/mw-config - Reception123 the build passed. [05:54:20] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.99, 3.53, 3.51 [05:56:09] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.86, 3.35, 3.26 [05:56:20] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.41, 3.98, 3.69 [05:58:09] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.08, 2.95, 3.13 [05:58:20] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.89, 3.63, 3.60 [06:00:00] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.93, 4.11, 3.51 [06:00:20] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 3.95, 4.08, 3.79 [06:00:22] [02miraheze/dns] 07Reception123 pushed 031 commit to 03master [+1/-0/±0] 13https://github.com/miraheze/dns/compare/44fe4e9d9b85...7716a536864e [06:00:23] [url] Comparing 44fe4e9d9b85...7716a536864e · miraheze/dns · GitHub | github.com [06:00:24] [02miraheze/dns] 07Reception123 037716a53 - add rarewiki.org zone [06:01:58] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.87, 3.65, 3.41 [06:02:20] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.27, 3.51, 3.62 [06:03:55] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.04, 3.05, 3.22 [06:06:20] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.28, 2.47, 3.18 [06:08:37] [02miraheze/dns] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/dns/compare/7716a536864e...73d88a0aa8c3 [06:08:38] [url] Comparing 7716a536864e...73d88a0aa8c3 · miraheze/dns · GitHub | github.com [06:08:38] [02miraheze/dns] 07Reception123 0373d88a0 - add en.* to wikiyri.org zone [06:14:52] [02miraheze/ssl] 07Reception123 pushed 032 commits to 03master [+2/-0/±2] 13https://github.com/miraheze/ssl/compare/a04d393f3580...8544fa41e3eb [06:14:52] [url] Comparing a04d393f3580...8544fa41e3eb · miraheze/ssl · GitHub | github.com [06:14:53] [02miraheze/ssl] 07Reception123 03eb363d1 - add rarewiki.org cert [06:14:55] [02miraheze/ssl] 07Reception123 038544fa4 - add en.wikiyri.org cert [06:16:04] Reception123: https://github.com/miraheze/dns/pull/291 [06:16:04] [url] add en.wikiyri.org by MacFan4000 · Pull Request #291 · miraheze/dns · GitHub | github.com [06:16:06] miraheze/ssl - Reception123 the build has errored. [06:17:23] CosmicAlpha: ergh I keep missing those [06:17:36] as I said before might be good to add a comment on the task so I can see a PR has already been done [06:17:37] RECOVERY - dnd.bellinrattin.it - reverse DNS on sslhost is OK: SSL OK - dnd.bellinrattin.it reverse DNS resolves to cp20.miraheze.org - CNAME OK [06:17:56] [02dns] 07Reception123 closed pull request 03#291: add en.wikiyri.org - 13https://github.com/miraheze/dns/pull/291 [06:17:56] [url] Page not found · GitHub · GitHub | github.com [06:17:57] [02dns] 07Reception123 commented on pull request 03#291: add en.wikiyri.org - 13https://github.com/miraheze/dns/pull/291#issuecomment-1170812116 [06:17:57] [url] add en.wikiyri.org by MacFan4000 · Pull Request #291 · miraheze/dns · GitHub | github.com [06:23:41] !log [@mwtask111] starting deploy of {'config': True} to all [06:23:50] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:23:54] !log [@mwtask111] finished deploy of {'config': True} to all - SUCCESS in 13s [06:24:00] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:24:47] !log [@test101] starting deploy of {'config': True} to all [06:24:50] !log [@test101] finished deploy of {'config': True} to all - SUCCESS in 2s [06:24:53] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:25:01] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:26:22] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.45, 3.77, 3.26 [06:26:57] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.48, 3.43, 3.19 [06:27:05] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.18, 3.59, 3.17 [06:28:16] !log RENAMED supernovawiki to omnipendiumwiki [06:28:20] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.13, 4.34, 3.53 [06:28:21] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:30:45] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.82, 3.94, 3.42 [06:31:25] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 3.10, 4.01, 3.57 [06:31:28] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.55, 3.88, 3.48 [06:33:22] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.68, 3.85, 3.56 [06:34:37] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.32, 3.19, 3.23 [06:35:19] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.32, 3.20, 3.35 [06:35:21] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.10, 3.08, 3.26 [06:38:51] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.54, 9.95, 9.19 [06:40:32] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.05, 3.54, 3.32 [06:40:51] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 9.30, 9.74, 9.22 [06:41:07] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.40, 3.62, 3.48 [06:41:13] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.22, 4.34, 3.73 [06:42:32] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.33, 3.45, 3.31 [06:44:32] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 3.27, 3.40, 3.31 [06:44:51] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.50, 10.64, 9.75 [06:45:01] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.62, 3.26, 3.39 [06:45:06] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.03, 3.36, 3.49 [06:46:51] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 9.58, 10.16, 9.68 [06:47:03] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 1.93, 2.88, 3.30 [06:56:51] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.51, 10.51, 10.03 [07:00:51] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.94, 9.72, 9.86 [07:05:52] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.65, 6.64, 5.68 [07:07:51] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 5.43, 6.21, 5.64 [07:23:31] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.71, 1.59, 1.15 [07:25:31] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.41, 1.88, 1.31 [07:27:31] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.24, 1.62, 1.28 [07:39:51] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.44, 3.30, 3.03 [07:41:51] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.20, 3.44, 3.10 [07:45:47] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.88, 3.69, 3.22 [07:45:51] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.12, 3.86, 3.40 [07:46:32] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 3.73, 4.01, 3.18 [07:48:32] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.35, 3.54, 3.12 [07:48:34] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query bellinrattin.it. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [07:49:41] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.28, 3.03, 3.05 [07:50:32] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 3.35, 3.33, 3.08 [07:51:51] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.30, 3.03, 3.20 [08:17:12] RECOVERY - dnd.bellinrattin.it - reverse DNS on sslhost is OK: SSL OK - dnd.bellinrattin.it reverse DNS resolves to cp21.miraheze.org - CNAME OK [08:25:42] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CRITICAL - load average: 2.56, 1.59, 1.10 [08:27:42] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 1.09, 1.46, 1.12 [08:35:42] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.67, 10.64, 9.50 [08:40:39] PROBLEM - cp21 Current Load on cp21 is WARNING: WARNING - load average: 1.49, 1.72, 1.43 [08:41:33] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 9.39, 9.93, 9.55 [08:42:39] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 0.94, 1.47, 1.37 [08:59:24] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.27, 3.64, 3.16 [09:03:17] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 1.47, 2.77, 2.94 [09:22:05] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.73, 1.60, 1.36 [09:25:54] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.23, 1.85, 1.51 [09:27:49] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.08, 1.55, 1.44 [09:33:33] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 1.71, 2.22, 1.77 [09:37:31] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.41, 1.93, 1.77 [09:47:31] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 0.86, 1.55, 1.69 [09:57:51] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 8.78, 5.13, 3.55 [09:58:50] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.68, 4.04, 3.14 [09:58:57] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 6.18, 4.95, 3.47 [09:59:56] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.40, 1.75, 1.96 [10:02:41] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.33, 3.98, 3.33 [10:04:36] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 3.70, 4.13, 3.47 [10:06:32] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.83, 3.76, 3.42 [10:08:32] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.21, 3.95, 3.53 [10:09:56] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.03, 1.71, 1.82 [10:10:32] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.70, 3.38, 3.37 [10:11:40] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.13, 10.08, 8.99 [10:11:56] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.92, 1.76, 1.82 [10:13:37] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 9.15, 9.73, 8.99 [10:14:57] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.98, 3.71, 3.91 [10:15:38] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.63, 1.72, 1.54 [10:17:33] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 0.86, 1.40, 1.45 [10:17:51] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.36, 3.60, 3.91 [10:17:56] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.68, 2.07, 1.91 [10:18:57] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.77, 3.74, 3.84 [10:20:57] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.40, 3.47, 3.72 [10:21:31] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 2.00, 1.89, 1.66 [10:21:51] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.07, 4.28, 4.10 [10:22:32] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.60, 3.69, 3.52 [10:23:57] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.44, 1.90, 1.92 [10:25:31] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.12, 1.87, 1.69 [10:26:57] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.51, 3.94, 3.81 [10:27:31] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.24, 1.63, 1.62 [10:30:32] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.06, 4.12, 3.75 [10:30:57] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.54, 3.53, 3.70 [10:32:32] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.28, 3.44, 3.55 [10:33:31] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.74, 1.65, 1.61 [10:33:51] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.40, 3.32, 3.79 [10:33:56] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.34, 1.48, 1.69 [10:34:32] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.12, 2.98, 3.36 [10:34:57] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 1.34, 2.70, 3.34 [10:35:31] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 0.90, 1.45, 1.54 [10:35:51]