[00:04:12] PROBLEM - cp31 Disk Space on cp31 is WARNING: DISK WARNING - free space: / 3882 MB (10% inode=96%); [00:05:20] PROBLEM - cp30 Disk Space on cp30 is WARNING: DISK WARNING - free space: / 3773 MB (9% inode=96%); [00:06:12] RECOVERY - cp31 Disk Space on cp31 is OK: DISK OK - free space: / 11293 MB (29% inode=96%); [00:07:20] RECOVERY - cp30 Disk Space on cp30 is OK: DISK OK - free space: / 11256 MB (29% inode=96%); [00:37:33] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.43, 1.50, 1.93 [00:38:33] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 0.75, 1.35, 1.94 [00:39:33] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.31, 1.95, 2.05 [00:41:33] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.46, 1.71, 1.95 [00:44:33] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 16.15, 5.30, 3.09 [01:01:33] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.14, 2.01, 1.89 [01:03:33] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.45, 1.80, 1.83 [01:03:43] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 1.85, 1.73, 1.53 [01:06:33] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.03, 1.57, 1.96 [01:09:25] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 1.48, 1.65, 1.56 [01:10:33] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.76, 1.95, 2.00 [01:12:33] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.33, 1.74, 1.92 [01:14:33] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.77, 2.46, 2.18 [01:15:33] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.93, 1.48, 1.69 [01:21:33] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.13, 1.96, 1.82 [01:23:33] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.39, 1.69, 1.73 [01:25:33] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.04, 1.86, 1.79 [01:29:33] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.02, 1.63, 1.73 [01:33:33] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.64, 2.04, 1.85 [01:38:43] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 6.52, 4.07, 3.02 [01:40:12] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.80, 3.50, 2.65 [01:42:10] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.23, 4.13, 3.01 [01:43:33] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.53, 1.86, 1.94 [01:44:07] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.38, 3.56, 2.94 [01:46:43] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.14, 3.85, 3.44 [01:48:43] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.02, 3.28, 3.29 [01:49:33] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.47, 2.04, 1.97 [01:49:59] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.34, 2.57, 2.76 [01:51:33] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.18, 1.80, 1.90 [01:53:33] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.23, 1.90, 1.92 [01:57:33] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.13, 1.60, 1.79 [01:58:43] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.45, 3.80, 3.42 [02:00:43] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 1.97, 3.24, 3.27 [02:01:09] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 7.69, 9.99, 11.61 [02:03:33] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 3.03, 2.10, 1.89 [02:05:33] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.81, 2.00, 1.89 [02:07:09] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 14.50, 10.55, 11.12 [02:07:33] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.22, 2.06, 1.92 [02:12:33] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.76, 1.69, 1.99 [02:17:09] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.78, 12.00, 11.99 [02:18:33] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 3.26, 2.30, 2.11 [02:19:09] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 15.66, 12.88, 12.28 [02:29:35] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.09, 3.41, 3.00 [02:32:11] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.14, 3.76, 3.04 [02:34:09] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.08, 3.20, 2.92 [02:35:21] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.92, 3.33, 3.12 [02:44:33] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.02, 1.53, 1.97 [02:48:33] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 3.31, 2.01, 2.02 [02:52:33] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.37, 1.77, 1.93 [03:04:33] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.13, 1.83, 1.87 [03:08:33] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.87, 1.86, 1.87 [03:12:33] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.24, 2.05, 1.95 [03:30:46] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.51, 3.55, 2.93 [03:32:44] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.85, 3.12, 2.84 [03:55:09] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.71, 10.27, 11.87 [03:59:09] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 17.05, 12.87, 12.45 [04:06:33] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.40, 1.59, 1.97 [04:11:33] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.26, 1.48, 1.98 [04:14:33] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 4.20, 2.11, 1.97 [04:17:33] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.86, 2.11, 2.05 [04:19:33] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.79, 1.97, 2.00 [04:21:33] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 6.68, 3.78, 2.65 [04:24:28] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.81, 3.49, 2.66 [04:27:25] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.97, 3.51, 2.83 [04:29:00] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 1.74, 1.65, 1.43 [04:30:05] PROBLEM - mw122 MediaWiki Rendering on mw122 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [04:30:14] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.76, 3.44, 2.95 [04:31:22] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.14, 4.02, 3.15 [04:32:05] RECOVERY - mw122 MediaWiki Rendering on mw122 is OK: HTTP OK: HTTP/1.1 200 OK - 29514 bytes in 0.873 second response time [04:32:09] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.31, 3.76, 3.12 [04:35:00] PROBLEM - test131 Current Load on test131 is CRITICAL: CRITICAL - load average: 2.02, 1.83, 1.58 [04:35:22] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.43, 3.36, 3.05 [04:36:00] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.53, 3.45, 3.16 [04:37:00] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 1.56, 1.70, 1.56 [04:37:22] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.76, 3.23, 3.05 [04:37:55] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.85, 3.40, 3.19 [04:41:47] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.91, 3.41, 3.25 [04:43:42] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.21, 3.31, 3.26 [04:47:22] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.02, 3.63, 3.26 [04:49:09] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 7.41, 9.35, 11.77 [04:49:22] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.82, 3.03, 3.09 [04:51:33] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.97, 1.76, 1.99 [04:53:33] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.56, 1.87, 1.99 [04:55:33] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.50, 1.69, 1.91 [04:56:33] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.05, 1.53, 1.90 [04:58:33] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.64, 1.80, 1.94 [04:59:33] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.31, 1.62, 1.81 [05:00:33] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.82, 1.69, 1.88 [05:02:33] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.01, 1.82, 1.90 [05:03:09] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 6.19, 8.09, 9.85 [05:03:33] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.88, 2.00, 1.94 [05:04:33] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.82, 1.92, 1.93 [05:05:33] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 4.14, 2.67, 2.18 [05:06:50] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 6.20, 8.65, 11.81 [05:12:33] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 4.27, 2.09, 1.92 [05:14:33] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.36, 1.79, 1.84 [05:15:50] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::4c25/cpweb [05:16:50] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.75, 9.43, 10.47 [05:17:33] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.35, 1.77, 1.99 [05:18:33] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.86, 1.36, 1.66 [05:18:50] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.97, 8.90, 10.16 [05:19:47] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [05:21:33] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.07, 2.04, 2.05 [05:23:43] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 2 datacenters are down: 2001:41d0:801:2000::4c25/cpweb, 2001:41d0:801:2000::1b80/cpweb [05:25:42] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [05:29:33] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.78, 1.88, 1.99 [05:32:34] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 2 datacenters are down: 2001:41d0:801:2000::4c25/cpweb, 2001:41d0:801:2000::1b80/cpweb [05:33:33] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.14, 1.74, 1.89 [05:35:33] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.36, 1.56, 1.80 [05:39:33] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.34, 1.44, 1.70 [05:43:33] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.12, 1.75, 1.77 [05:45:16] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.31, 1.83, 1.61 [05:45:33] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.65, 1.67, 1.73 [05:47:33] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.70, 1.57, 1.68 [05:49:10] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.45, 1.86, 1.69 [05:50:21] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [05:51:07] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.40, 2.09, 1.79 [05:51:33] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.28, 1.90, 1.79 [05:53:33] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.89, 1.78, 1.75 [05:56:57] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.41, 1.85, 1.81 [05:57:33] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.35, 1.60, 1.68 [06:00:51] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 3.88, 2.25, 1.93 [06:05:11] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.89, 9.72, 8.80 [06:06:41] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.31, 2.00, 1.96 [06:07:07] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.88, 9.09, 8.68 [06:08:25] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.39, 1.80, 1.67 [06:08:38] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 1.95, 2.10, 2.00 [06:09:00] PROBLEM - test131 Current Load on test131 is CRITICAL: CRITICAL - load average: 2.37, 1.93, 1.57 [06:10:21] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.78, 1.84, 1.70 [06:10:35] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.76, 1.92, 1.94 [06:12:18] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.32, 1.70, 1.67 [06:13:09] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.42, 9.99, 9.38 [06:15:00] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::1b80/cpweb [06:15:09] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.76, 9.45, 9.26 [06:16:33] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.66, 1.25, 1.64 [06:22:33] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 3.07, 2.18, 1.88 [06:24:33] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.38, 1.87, 1.81 [06:26:33] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.43, 2.04, 1.87 [06:28:33] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.10, 1.65, 1.75 [06:30:33] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.38, 1.52, 1.68 [06:30:52] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.39, 1.71, 1.63 [06:32:49] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.15, 1.57, 1.59 [06:36:45] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.49, 2.56, 2.02 [06:40:42] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [06:42:34] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.65, 1.99, 1.95 [06:47:26] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.26, 1.70, 1.57 [06:48:24] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.64, 2.32, 2.08 [06:54:30] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::4c25/cpweb [06:58:07] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.08, 1.73, 1.98 [07:03:01] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.18, 1.90, 1.95 [07:04:57] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.18, 2.12, 2.03 [07:07:50] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.14, 1.67, 1.79 [07:08:51] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.45, 1.84, 1.94 [07:09:47] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.37, 1.67, 1.79 [07:10:48] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 1.95, 2.15, 2.06 [07:11:59] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.15, 10.63, 9.03 [07:12:44] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.30, 1.91, 1.99 [07:13:56] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.88, 9.53, 8.82 [07:15:36] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.27, 1.50, 1.69 [07:19:16] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 12.78, 5.96, 3.55 [07:19:33] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 3.63, 2.27, 1.92 [07:19:43] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 16.73, 11.39, 9.60 [07:20:04] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 11.41, 5.75, 3.55 [07:20:29] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 16.18, 11.20, 9.45 [07:22:09] PROBLEM - gluster122 Current Load on gluster122 is WARNING: WARNING - load average: 3.80, 3.04, 2.01 [07:22:33] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.37, 1.81, 1.85 [07:23:00] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 1.27, 1.48, 1.92 [07:24:08] RECOVERY - gluster122 Current Load on gluster122 is OK: OK - load average: 3.09, 2.95, 2.10 [07:24:33] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 0.84, 1.50, 1.73 [07:26:18] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.60, 10.24, 9.72 [07:27:00] PROBLEM - test131 Current Load on test131 is CRITICAL: CRITICAL - load average: 2.37, 1.71, 1.89 [07:28:14] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 14.27, 11.57, 10.24 [07:28:33] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.27, 1.40, 1.64 [07:29:00] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 1.66, 1.68, 1.87 [07:30:10] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.49, 10.95, 10.19 [07:35:00] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 1.17, 1.38, 1.67 [07:35:59] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.50, 11.19, 10.47 [07:36:05] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [07:37:55] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.23, 11.08, 10.52 [07:39:10] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.76, 11.39, 11.65 [07:43:00] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::4c25/cpweb [07:43:09] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.34, 11.89, 11.77 [07:45:09] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.92, 11.26, 11.57 [07:45:40] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.63, 9.35, 9.96 [07:46:26] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.60, 1.89, 1.68 [07:48:22] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.09, 1.92, 1.71 [07:49:35] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.29, 10.04, 10.07 [07:50:19] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.59, 1.73, 1.66 [07:51:09] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.44, 11.79, 11.61 [07:51:31] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.89, 9.67, 9.94 [07:53:09] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.24, 10.70, 11.22 [07:55:25] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.60, 10.99, 10.40 [07:56:10] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.02, 1.48, 1.61 [07:57:33] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.47, 1.73, 1.96 [07:59:00] PROBLEM - test131 Current Load on test131 is CRITICAL: CRITICAL - load average: 2.17, 1.85, 1.62 [07:59:33] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 3.44, 2.29, 2.13 [08:01:00] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 1.99, 1.91, 1.67 [08:01:14] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.05, 11.89, 11.02 [08:03:10] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 17.56, 13.41, 11.63 [08:03:33] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.29, 1.71, 1.92 [08:05:00] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 1.40, 1.69, 1.63 [08:10:50] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.88, 1.73, 1.64 [08:11:09] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 15.90, 12.30, 11.30 [08:12:46] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.16, 1.52, 1.58 [08:13:09] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.82, 11.57, 11.14 [08:15:33] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.48, 1.42, 1.66 [08:18:50] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.47, 11.66, 11.99 [08:19:40] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.13, 1.87, 1.72 [08:20:50] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.09, 11.71, 11.95 [08:23:09] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.33, 10.81, 10.69 [08:26:29] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [08:32:17] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.91, 1.99, 1.81 [08:34:14] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.18, 2.10, 1.88 [08:35:09] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.05, 11.91, 11.85 [08:35:20] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::4c25/cpweb [08:38:07] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.33, 1.86, 1.84 [08:42:50] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.47, 9.98, 11.83 [08:43:57] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.24, 1.54, 1.70 [08:47:09] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.14, 11.60, 11.63 [08:51:09] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.96, 11.39, 11.54 [08:51:46] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.29, 1.86, 1.73 [08:53:09] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.30, 11.96, 11.72 [08:53:42] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.36, 1.64, 1.67 [08:54:50] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.40, 11.92, 11.71 [08:55:09] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.78, 11.09, 11.44 [08:56:50] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.37, 10.83, 11.33 [09:03:33] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.84, 1.83, 1.73 [09:04:50] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 16.54, 12.51, 11.65 [09:05:33] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.03, 1.85, 1.75 [09:06:50] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.58, 11.22, 11.29 [09:07:33] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.46, 1.84, 1.77 [09:08:33] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.77, 1.76, 2.00 [09:09:33] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.94, 1.57, 1.68 [09:10:33] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.46, 1.95, 2.03 [09:11:09] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 14.07, 11.03, 10.69 [09:11:22] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.10, 3.05, 3.99 [09:12:33] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.06, 1.62, 1.90 [09:12:50] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 5.59, 7.95, 9.86 [09:13:09] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.23, 10.68, 10.62 [09:13:33] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 1.61, 2.14, 1.91 [09:15:33] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.92, 1.96, 1.86 [09:16:33] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.36, 1.80, 1.89 [09:17:22] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.32, 3.19, 3.67 [09:18:33] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.52, 1.78, 1.88 [09:18:43] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.48, 3.50, 3.94 [09:18:49] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [09:19:22] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.33, 3.12, 3.58 [09:22:33] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.07, 1.83, 1.86 [09:22:44] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::1b80/cpweb [09:23:22] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.81, 2.87, 3.37 [09:23:33] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.02, 1.37, 1.62 [09:24:33] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.49, 1.60, 1.76 [09:28:43] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.99, 2.95, 3.37 [09:28:50] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.23, 10.50, 9.77 [09:30:33] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.19, 1.48, 1.67 [09:30:50] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.85, 10.30, 9.79 [09:31:09] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.91, 9.85, 10.17 [09:32:50] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.03, 11.20, 10.17 [09:35:09] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.86, 10.67, 10.50 [09:36:50] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.20, 11.87, 10.75 [09:39:09] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.40, 11.27, 10.77 [09:40:50] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.72, 11.95, 11.00 [09:43:09] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.15, 11.86, 11.21 [09:44:04] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.41, 3.88, 3.51 [09:44:50] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.69, 11.88, 11.18 [09:45:00] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 1.81, 1.60, 1.41 [09:45:09] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 14.65, 12.76, 11.60 [09:47:00] PROBLEM - test131 Current Load on test131 is CRITICAL: CRITICAL - load average: 2.16, 1.72, 1.47 [09:47:09] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.94, 11.23, 11.18 [09:47:58] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.35, 3.26, 3.36 [09:48:50] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.38, 12.52, 11.58 [09:49:00] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 1.80, 1.71, 1.49 [09:50:25] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.20, 2.18, 1.75 [09:51:00] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 1.22, 1.56, 1.47 [09:51:51] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.82, 3.92, 3.57 [09:52:22] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.31, 1.84, 1.67 [09:53:09] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.51, 11.79, 11.36 [09:53:48] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.06, 3.18, 3.34 [09:54:18] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.23, 1.62, 1.61 [09:55:09] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.43, 11.30, 11.24 [09:56:59] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.53, 3.92, 3.50 [09:57:26] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 3.67, 2.50, 1.91 [09:57:40] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 3.49, 4.49, 3.95 [09:58:50] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.87, 11.91, 11.93 [09:59:38] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.82, 3.89, 3.79 [10:02:50] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 17.18, 12.56, 12.07 [10:04:43] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.59, 3.18, 3.34 [10:07:09] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.58, 8.93, 10.03 [10:07:10] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 0.63, 1.52, 1.76 [10:07:28] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.89, 2.80, 3.26 [10:09:07] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.62, 2.07, 1.93 [10:11:04] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.43, 1.85, 1.87 [10:11:09] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.13, 11.25, 10.74 [10:11:50] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.01, 1.62, 1.50 [10:13:35] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.01, 3.51, 3.44 [10:15:09] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.91, 11.11, 10.84 [10:16:05] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [10:16:14] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.55, 3.75, 3.47 [10:16:50] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.33, 11.23, 11.96 [10:16:54] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 3.47, 2.15, 1.94 [10:17:25] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.66, 3.17, 3.32 [10:18:11] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.41, 3.25, 3.31 [10:19:09] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.67, 11.45, 10.97 [10:20:05] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::4c25/cpweb [10:20:50] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 15.95, 12.96, 12.38 [10:21:17] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 6.18, 4.86, 3.95 [10:22:04] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.07, 4.13, 3.68 [10:25:08] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.24, 3.90, 3.75 [10:26:38] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.87, 1.90, 1.97 [10:26:50] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 6.43, 10.81, 11.93 [10:27:03] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.06, 3.99, 3.80 [10:27:09] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.34, 11.45, 11.63 [10:27:33] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.47, 1.94, 1.97 [10:29:33] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.55, 2.19, 2.05 [10:30:33] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.57, 1.23, 1.68 [10:31:33] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.55, 1.92, 1.97 [10:33:48] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.62, 3.97, 3.90 [10:34:44] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.48, 3.89, 3.93 [10:35:46] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.98, 4.14, 3.95 [10:36:50] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.56, 8.38, 10.06 [10:37:09] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 6.66, 7.78, 9.73 [10:37:33] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 6.17, 3.21, 2.37 [10:37:43] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.29, 3.74, 3.82 [10:43:36] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.62, 3.69, 3.73 [10:44:43] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.53, 4.17, 3.94 [10:45:33] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.89, 3.68, 3.72 [10:46:43] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.06, 3.88, 3.87 [10:47:33] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.15, 1.77, 1.99 [10:48:43] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 7.40, 4.57, 4.08 [10:49:28] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.72, 4.41, 3.97 [10:49:33] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.11, 1.99, 2.05 [10:52:33] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 3.35, 2.27, 1.78 [10:54:33] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.45, 1.95, 1.73 [10:54:43] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 1.89, 3.66, 3.92 [10:55:22] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.21, 3.49, 3.76 [10:56:43] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.69, 4.14, 4.03 [10:57:22] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.89, 4.27, 4.02 [10:58:33] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.28, 1.97, 1.77 [11:00:33] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.44, 1.65, 1.68 [11:04:33] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.37, 1.80, 1.75 [11:06:33] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.27, 1.63, 1.69 [11:06:43] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.65, 3.74, 3.97 [11:08:43] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 3.46, 3.91, 4.02 [11:10:43] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.15, 3.33, 3.80 [11:12:43] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.11, 3.55, 3.81 [11:13:22] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.60, 3.64, 3.97 [11:14:43] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.47, 3.70, 3.84 [11:15:22] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.13, 4.28, 4.19 [11:15:33] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 0.69, 1.10, 1.99 [11:17:22] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.94, 3.72, 3.99 [11:21:33] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 4.32, 2.55, 2.28 [11:22:43] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 1.50, 2.57, 3.26 [11:25:22] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.75, 2.75, 3.35 [11:29:00] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 1.92, 1.81, 1.51 [11:29:33] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 0.79, 1.46, 1.87 [11:31:33] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 3.05, 1.95, 1.98 [11:33:33] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.89, 1.83, 1.93 [11:33:35] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.23, 3.75, 3.38 [11:34:03] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.84, 1.70, 1.58 [11:35:00] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 1.39, 1.58, 1.51 [11:35:30] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.58, 3.30, 3.25 [11:36:00] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.42, 1.65, 1.58 [11:37:33] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 3.21, 2.24, 2.05 [11:39:33] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.44, 2.00, 1.99 [11:41:56] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.34, 9.96, 9.05 [11:43:33] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.67, 2.38, 2.13 [11:43:53] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 14.22, 11.18, 9.58 [11:45:46] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.84, 1.69, 1.60 [11:45:50] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.81, 11.00, 9.71 [11:47:43] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.60, 1.68, 1.61 [11:47:47] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.65, 10.04, 9.50 [11:49:53] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.55, 3.78, 3.49 [11:50:54] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.82, 3.53, 3.37 [11:52:50] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.93, 3.20, 3.26 [11:53:36] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 3.83, 2.57, 1.97 [11:53:48] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.07, 4.17, 3.69 [11:56:27] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.50, 10.53, 9.87 [11:56:29] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.67, 11.91, 10.59 [11:56:43] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.56, 4.64, 3.85 [11:58:05] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [11:58:25] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.36, 11.18, 10.47 [12:00:20] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.69, 10.06, 9.87 [12:02:17] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 9.85, 10.07, 10.15 [12:04:11] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.29, 11.49, 10.47 [12:05:00] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::4c25/cpweb [12:06:12] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 16.28, 13.91, 11.74 [12:08:04] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.16, 11.91, 10.91 [12:09:33] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.44, 1.77, 1.97 [12:10:01] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 14.62, 12.71, 11.30 [12:13:33] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.88, 2.15, 2.06 [12:15:33] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.69, 1.91, 1.98 [12:19:33] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.94, 2.18, 2.04 [12:23:38] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.11, 11.43, 11.66 [12:27:30] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 17.57, 13.65, 12.39 [12:31:33] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.75, 1.97, 1.98 [12:39:22] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.26, 3.51, 3.98 [12:39:33] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.48, 2.05, 1.97 [12:43:33] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.57, 2.00, 1.99 [12:45:22] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.47, 3.61, 3.81 [12:45:33] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 3.00, 2.19, 2.05 [12:47:22] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.03, 3.41, 3.71 [12:50:28] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [12:51:22] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.37, 4.40, 4.03 [12:58:19] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::4c25/cpweb [12:58:42] PROBLEM - roblox-wiki.tk - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query roblox-wiki.tk. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [13:09:33] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.08, 1.67, 1.94 [13:13:33] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.00, 2.03, 2.03 [13:17:00] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 1.77, 1.67, 1.51 [13:19:33] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.70, 1.90, 1.98 [13:21:00] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 1.40, 1.56, 1.51 [13:28:03] RECOVERY - roblox-wiki.tk - reverse DNS on sslhost is OK: SSL OK - roblox-wiki.tk reverse DNS resolves to cp30.miraheze.org - NS RECORDS OK [13:29:33] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.07, 1.34, 1.69 [13:33:33] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.58, 1.95, 1.86 [13:35:33] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.99, 1.92, 1.86 [13:40:05] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [13:41:33] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.32, 2.04, 1.91 [13:44:05] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::1b80/cpweb [14:05:22] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.80, 3.24, 3.96 [14:10:50] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.22, 10.64, 11.98 [14:11:22] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.64, 4.00, 4.05 [14:12:50] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 15.25, 11.78, 12.19 [14:15:22] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.56, 3.70, 3.95 [14:16:43] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.78, 3.49, 3.94 [14:20:44] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 6.99, 4.60, 4.22 [14:21:22] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 7.96, 4.63, 4.12 [14:34:05] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [14:38:05] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::1b80/cpweb [14:40:05] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [14:44:05] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::4c25/cpweb [14:59:00] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 1.93, 1.82, 1.54 [15:03:00] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 1.47, 1.69, 1.55 [15:28:05] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [15:37:58] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::4c25/cpweb [15:38:10] [02miraheze/puppet] 07JohnFLewis pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/90a67681428b...29c6f3cef454 [15:38:11] [url] Comparing 90a67681428b...29c6f3cef454 · miraheze/puppet · GitHub | github.com [15:38:12] [02miraheze/puppet] 07JohnFLewis 0329c6f3c - T9696: Fix IPMI sensor monitoring on Dell [15:51:05] RECOVERY - cloud13 IPMI Sensors on cloud13 is OK: IPMI Status: OK [15:51:10] RECOVERY - cloud14 IPMI Sensors on cloud14 is OK: IPMI Status: OK [16:16:50] [02miraheze/puppet] 07JohnFLewis pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/29c6f3cef454...7abe88ce4fc5 [16:16:50] [url] Comparing 29c6f3cef454...7abe88ce4fc5 · miraheze/puppet · GitHub | github.com [16:16:51] [02miraheze/puppet] 07JohnFLewis 037abe88c - T9696: Move SMART into HP as Dell IPMI checks disks [17:09:30] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [17:21:29] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::4c25/cpweb [17:48:39] PROBLEM - ns1 GDNSD Datacenters on ns1 is CRITICAL: CRITICAL - 2 datacenters are down: 51.195.220.68/cpweb, 2001:41d0:801:2000::4c25/cpweb [17:58:34] PROBLEM - gluster122 Current Load on gluster122 is CRITICAL: CRITICAL - load average: 4.57, 3.57, 2.96 [18:00:34] PROBLEM - gluster122 Current Load on gluster122 is WARNING: WARNING - load average: 3.89, 3.53, 3.02 [18:02:34] RECOVERY - gluster122 Current Load on gluster122 is OK: OK - load average: 2.92, 3.30, 3.00 [18:07:54] PROBLEM - test131 Current Load on test131 is CRITICAL: CRITICAL - load average: 2.12, 1.74, 1.47 [18:09:02] PROBLEM - test131 MediaWiki Rendering on test131 is CRITICAL: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - 824 bytes in 0.276 second response time [18:09:11] PROBLEM - db121 MariaDB on db121 is CRITICAL: Can't connect to MySQL server on 'db121.miraheze.org' (115) [18:12:20] Hug [18:12:25] Oh poo [18:12:45] JohnLewis, CosmicAlpha: Db121 down [18:12:47] Reception123: ^ [18:12:57] Voidwalker: ^ [18:13:50] !log restart mysql on db121 [18:13:57] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:14:06] db* is on my radar of things to deal with today [18:15:02] RECOVERY - test131 MediaWiki Rendering on test131 is OK: HTTP OK: HTTP/1.1 200 OK - 33367 bytes in 0.698 second response time [18:15:11] RECOVERY - db121 MariaDB on db121 is OK: Uptime: 90 Threads: 28 Questions: 28532 Slow queries: 1937 Opens: 2654 Open tables: 2648 Queries per second avg: 317.022 [18:15:15] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 7.21, 8.71, 11.73 [18:15:21] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.09, 1.49, 1.92 [18:15:41] JohnLewis: I did mention to paladox having it start auto in RO. I think they did the RO bit but obviously not restart=always [18:15:50] You might need to bring out of ro [18:17:21] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.78, 2.35, 2.21 [18:17:50] should be back up now [18:19:15] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 16.39, 11.64, 12.15 [18:20:10] Thanks JohnLewis [18:26:41] PROBLEM - roblox-wiki.tk - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query roblox-wiki.tk. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [18:55:47] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.03, 11.04, 12.00 [18:56:05] RECOVERY - roblox-wiki.tk - reverse DNS on sslhost is OK: SSL OK - roblox-wiki.tk reverse DNS resolves to cp31.miraheze.org - NS RECORDS OK [18:57:46] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 18.71, 12.85, 12.47 [19:20:45] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 1.23, 1.48, 1.93 [19:26:07] PROBLEM - cp20 HTTPS on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:26:23] PROBLEM - cp20 SSH on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:27:34] PROBLEM - cp20 Stunnel HTTP for phab121 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [19:27:38] PROBLEM - cp20 Stunnel HTTP for puppet141 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [19:27:38] PROBLEM - cp20 PowerDNS Recursor on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [19:27:38] PROBLEM - cp20 Stunnel HTTP for mw141 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [19:27:41] PROBLEM - cp20 Stunnel HTTP for reports121 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [19:27:43] PROBLEM - cp20 Stunnel HTTP for mw122 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [19:27:44] PROBLEM - cp20 Stunnel HTTP for mw131 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [19:27:45] PROBLEM - cp20 Stunnel HTTP for mwtask141 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [19:27:47] PROBLEM - cp20 HTTP 4xx/5xx ERROR Rate on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [19:27:56] PROBLEM - cp20 Stunnel HTTP for mon141 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [19:28:00] PROBLEM - cp20 Disk Space on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [19:28:00] PROBLEM - cp20 conntrack_table_size on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [19:28:02] PROBLEM - cp20 Stunnel HTTP for test131 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [19:28:04] PROBLEM - cp20 Stunnel HTTP for mw132 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [19:28:05] PROBLEM - cp20 Stunnel HTTP for mw142 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [19:28:05] PROBLEM - cp20 NTP time on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [19:28:06] PROBLEM - cp20 Stunnel HTTP for matomo131 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [19:28:11] PROBLEM - cp20 Stunnel HTTP for mw121 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [19:28:11] PROBLEM - cp20 Stunnel HTTP for mail121 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [19:28:13] PROBLEM - cp20 APT on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [19:28:14] PROBLEM - cp20 ferm_active on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [19:28:19] PROBLEM - cp20 Puppet on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [19:28:21] RECOVERY - cp20 SSH on cp20 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [19:28:21] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [19:28:26] PROBLEM - cp20 Varnish Backends on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [19:29:01] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 1.28, 1.40, 1.68 [19:38:44] PROBLEM - cp20 SSH on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:40:48] RECOVERY - cp20 SSH on cp20 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [19:44:32] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.59, 3.32, 3.93 [19:46:31] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 7.24, 4.79, 4.39 [19:55:34] RECOVERY - cp20 PowerDNS Recursor on cp20 is OK: DNS OK: 0.030 seconds response time. miraheze.org returns 149.56.140.43,149.56.141.75,2607:5300:201:3100::5ebc,2607:5300:201:3100::929a [19:55:37] RECOVERY - cp20 Stunnel HTTP for phab121 on cp20 is OK: HTTP OK: Status line output matched "500" - 2855 bytes in 1.100 second response time [19:55:48] PROBLEM - roblox-wiki.tk - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - roblox-wiki.tk All nameservers failed to answer the query. [19:55:58] RECOVERY - cp20 Stunnel HTTP for mw131 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 14738 bytes in 0.014 second response time [19:55:59] RECOVERY - cp20 Stunnel HTTP for reports121 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 10996 bytes in 1.090 second response time [19:56:05] RECOVERY - cp20 Disk Space on cp20 is OK: DISK OK - free space: / 14002 MB (36% inode=97%); [19:56:10] RECOVERY - cp20 HTTP 4xx/5xx ERROR Rate on cp20 is OK: OK - NGINX Error Rate is 0% [19:56:21] RECOVERY - cp20 conntrack_table_size on cp20 is OK: OK: nf_conntrack is 0 % full [19:56:33] RECOVERY - cp20 Stunnel HTTP for mw142 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 14738 bytes in 0.018 second response time [19:56:38] RECOVERY - cp20 Stunnel HTTP for mw122 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 14738 bytes in 7.426 second response time [19:56:40] RECOVERY - cp20 NTP time on cp20 is OK: NTP OK: Offset -0.001633018255 secs [19:56:56] RECOVERY - cp20 ferm_active on cp20 is OK: OK ferm input default policy is set [19:56:56] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 0.04, 0.06, 0.02 [19:56:57] RECOVERY - cp20 Stunnel HTTP for mw132 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 14738 bytes in 2.100 second response time [19:57:21] RECOVERY - cp20 Stunnel HTTP for mail121 on cp20 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 427 bytes in 1.018 second response time [19:58:34] PROBLEM - test131 Current Load on test131 is CRITICAL: CRITICAL - load average: 2.01, 1.65, 1.45 [19:58:48] RECOVERY - cp20 Stunnel HTTP for puppet141 on cp20 is OK: HTTP OK: Status line output matched "403" - 289 bytes in 0.015 second response time [19:58:52] RECOVERY - cp20 Stunnel HTTP for mwtask141 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 14736 bytes in 3.055 second response time [19:59:14] RECOVERY - cp20 Stunnel HTTP for mw121 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 14724 bytes in 1.169 second response time [19:59:18] RECOVERY - cp20 Stunnel HTTP for matomo131 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 100174 bytes in 2.326 second response time [19:59:52] RECOVERY - cp20 Stunnel HTTP for mon141 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 37547 bytes in 3.079 second response time [20:00:02] PROBLEM - cp20 SSH on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:00:29] RECOVERY - cp20 Stunnel HTTP for test131 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 14740 bytes in 1.034 second response time [20:00:34] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 1.41, 1.55, 1.44 [20:01:19] PROBLEM - cp20 Stunnel HTTP for mw131 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:02:18] PROBLEM - cp20 Stunnel HTTP for mw132 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:02:27] RECOVERY - cp20 Stunnel HTTP for mw141 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 14738 bytes in 0.016 second response time [20:02:30] PROBLEM - cp20 Stunnel HTTP for phab121 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [20:03:15] RECOVERY - cp20 Stunnel HTTP for mw131 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 14738 bytes in 1.028 second response time [20:04:08] RECOVERY - cp20 SSH on cp20 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [20:05:25] PROBLEM - cp20 Stunnel HTTP for reports121 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [20:05:42] PROBLEM - cp20 Stunnel HTTP for mwtask141 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [20:06:00] PROBLEM - cp20 Stunnel HTTP for mon141 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [20:06:31] PROBLEM - cp20 Stunnel HTTP for mw121 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [20:07:28] RECOVERY - cp20 Stunnel HTTP for reports121 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 10996 bytes in 0.048 second response time [20:07:40] RECOVERY - cp20 Stunnel HTTP for mwtask141 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 14742 bytes in 0.026 second response time [20:08:16] RECOVERY - cp20 Stunnel HTTP for mon141 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 37540 bytes in 1.056 second response time [20:08:32] PROBLEM - cp20 Stunnel HTTP for mw141 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [20:09:26] PROBLEM - cp20 Stunnel HTTP for test131 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [20:09:36] RECOVERY - cp20 Stunnel HTTP for phab121 on cp20 is OK: HTTP OK: Status line output matched "500" - 2855 bytes in 0.129 second response time [20:11:02] RECOVERY - cp20 Stunnel HTTP for mw141 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 14738 bytes in 1.029 second response time [20:11:08] PROBLEM - cp20 Disk Space on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [20:11:27] RECOVERY - cp20 Stunnel HTTP for mw121 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 14738 bytes in 0.024 second response time [20:12:22] RECOVERY - cp20 Stunnel HTTP for mw132 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 14738 bytes in 1.020 second response time [20:12:58] PROBLEM - cp20 Stunnel HTTP for reports121 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:13:03] RECOVERY - cp20 Disk Space on cp20 is OK: DISK OK - free space: / 14002 MB (36% inode=97%); [20:14:26] RECOVERY - cp20 Stunnel HTTP for test131 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 14726 bytes in 1.030 second response time [20:14:38] JohnLewis: is cp20 ok ^? [20:14:41] PROBLEM - cp20 Stunnel HTTP for mw131 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [20:14:57] RECOVERY - cp20 Stunnel HTTP for reports121 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 10996 bytes in 0.051 second response time [20:17:08] RECOVERY - cp20 Stunnel HTTP for mw131 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 14738 bytes in 0.014 second response time [20:18:18] PROBLEM - cp20 Stunnel HTTP for phab121 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:19:19] PROBLEM - cp20 Stunnel HTTP for mw142 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:19:43] PROBLEM - cp20 Stunnel HTTP for matomo131 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [20:20:29] RECOVERY - cp20 Stunnel HTTP for phab121 on cp20 is OK: HTTP OK: Status line output matched "500" - 2855 bytes in 1.076 second response time [20:21:17] RECOVERY - cp20 Stunnel HTTP for mw142 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 14738 bytes in 0.013 second response time [20:21:47] RECOVERY - cp20 Stunnel HTTP for matomo131 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 100174 bytes in 1.210 second response time [20:21:59] PROBLEM - cp20 Stunnel HTTP for mail121 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:23:53] PROBLEM - cp20 Stunnel HTTP for mw122 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:23:58] RECOVERY - cp20 Stunnel HTTP for mail121 on cp20 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 427 bytes in 0.012 second response time [20:24:01] PROBLEM - cp20 conntrack_table_size on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [20:24:41] RECOVERY - roblox-wiki.tk - reverse DNS on sslhost is OK: SSL OK - roblox-wiki.tk reverse DNS resolves to cp30.miraheze.org - NS RECORDS OK [20:25:54] RECOVERY - cp20 Stunnel HTTP for mw122 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 14732 bytes in 1.022 second response time [20:26:00] PROBLEM - cp20 Disk Space on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [20:26:28] RECOVERY - cp20 conntrack_table_size on cp20 is OK: OK: nf_conntrack is 0 % full [20:26:43] RhinosF1: cp20 is just being itself… I’m going to downtime both of the UK ones I think in a bit as it’s pointless monitoring broken infra [20:26:46] PROBLEM - gluster122 Current Load on gluster122 is CRITICAL: CRITICAL - load average: 4.23, 3.95, 3.19 [20:27:19] PROBLEM - cp20 SSH on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:27:41] JohnLewis: fair, paladox has mentioned the v6 issues [20:27:47] And OVH [20:27:57] Yeah… [20:28:43] RECOVERY - gluster122 Current Load on gluster122 is OK: OK - load average: 2.41, 3.31, 3.05 [20:32:54] JohnLewis: if the sales team are anything to go by, I wish you luck [20:33:21] It’s been 2 months so I’m already pretty annoyed [20:35:23] :( [20:40:27] RECOVERY - cp21 APT on cp21 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [20:40:27] PROBLEM - cp21 ferm_active on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [20:40:29] PROBLEM - cp21 Varnish Backends on cp21 is CRITICAL: 5 backends are down. mw121 mw122 mw131 mw132 mw141 [20:40:29] PROBLEM - cp21 Stunnel HTTP for mw132 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:40:29] RECOVERY - cp21 Stunnel HTTP for mw132 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 14738 bytes in 3.054 second response time [20:40:42] PROBLEM - cp21 Stunnel HTTP for matomo131 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [20:40:57] RECOVERY - cp21 Stunnel HTTP for puppet141 on cp21 is OK: HTTP OK: Status line output matched "403" - 289 bytes in 1.025 second response time [20:41:03] RECOVERY - cp21 Stunnel HTTP for mon141 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 37532 bytes in 1.053 second response time [20:41:27] RECOVERY - cp21 Stunnel HTTP for mw122 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 14732 bytes in 3.084 second response time [20:41:32] RECOVERY - cp21 Stunnel HTTP for reports121 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 10996 bytes in 5.119 second response time [20:41:47] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [20:42:36] RECOVERY - cp21 ferm_active on cp21 is OK: OK ferm input default policy is set [20:42:37] PROBLEM - cp21 SSH on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:42:42] RECOVERY - cp21 Stunnel HTTP for matomo131 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 100174 bytes in 7.744 second response time [20:47:48] PROBLEM - cp21 Stunnel HTTP for mw142 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [20:48:50] RECOVERY - cp21 SSH on cp21 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [20:49:50] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 0.00, 0.01, 0.00 [20:49:52] PROBLEM - cp21 Stunnel HTTP for mwtask141 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:51:50] RECOVERY - cp21 Stunnel HTTP for mwtask141 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 14728 bytes in 0.017 second response time [20:53:48] PROBLEM - cp21 ferm_active on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [20:53:53] PROBLEM - cp21 Stunnel HTTP for reports121 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:54:48] PROBLEM - cp21 Stunnel HTTP for mail121 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:55:52] RECOVERY - cp21 Stunnel HTTP for reports121 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 10996 bytes in 1.073 second response time [20:55:59] RECOVERY - cp21 ferm_active on cp21 is OK: OK ferm input default policy is set [20:56:58] RECOVERY - cp21 Stunnel HTTP for mail121 on cp21 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 427 bytes in 1.012 second response time [20:58:19] PROBLEM - cp21 PowerDNS Recursor on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [21:00:10] PROBLEM - cp21 Stunnel HTTP for test131 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:00:16] RECOVERY - cp21 PowerDNS Recursor on cp21 is OK: DNS OK: 0.139 seconds response time. miraheze.org returns 149.56.140.43,149.56.141.75,2607:5300:201:3100::5ebc,2607:5300:201:3100::929a [21:03:48] PROBLEM - cp21 Stunnel HTTP for mail121 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [21:04:27] RECOVERY - cp21 Stunnel HTTP for test131 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 14740 bytes in 2.074 second response time [21:05:08] RECOVERY - cp21 Stunnel HTTP for mw142 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 14738 bytes in 0.016 second response time [21:08:23] PROBLEM - cp21 Stunnel HTTP for mw141 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:09:01] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [21:09:03] RECOVERY - cp21 Stunnel HTTP for mail121 on cp21 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 427 bytes in 5.052 second response time [21:10:57] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 0.16, 0.15, 0.06 [21:12:19] PROBLEM - cp21 Stunnel HTTP for test131 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:12:51] PROBLEM - cp21 Stunnel HTTP for mw121 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:13:12] RECOVERY - cp21 Stunnel HTTP for mw141 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 14724 bytes in 0.152 second response time [21:47:14] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.35, 1.70, 1.99 [21:49:14] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.67, 2.00, 2.06 [21:49:39] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.06, 3.38, 3.95 [21:55:13] PROBLEM - roblox-wiki.tk - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query roblox-wiki.tk. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [21:56:27] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.50, 2.82, 3.97 [21:56:43] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 6.44, 9.60, 11.85 [21:59:27] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 1.64, 1.89, 1.64 [21:59:35] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.43, 3.48, 3.60 [22:00:27] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.92, 4.10, 4.18 [22:00:43] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 14.02, 11.82, 12.23 [22:01:24] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 1.36, 1.69, 1.60 [22:01:34] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.34, 3.36, 3.54 [22:06:27] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.69, 3.58, 3.92 [22:06:43] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.48, 10.90, 11.79 [22:07:31] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 3.01, 3.18, 3.39 [22:08:43] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.87, 11.60, 11.93 [22:10:27] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 13.23, 6.24, 4.74 [22:11:29] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.13, 4.82, 4.00 [22:30:44] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.69, 10.85, 11.79 [22:35:19] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.45, 3.21, 3.84 [22:40:14] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.72, 9.36, 11.85 [22:40:43] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.12, 8.45, 10.09 [22:43:16] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.01, 3.59, 3.72 [22:47:14] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.61, 3.60, 3.70 [22:48:14] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.48, 8.05, 10.14 [22:52:59] PROBLEM - roblox-wiki.tk - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - roblox-wiki.tk All nameservers failed to answer the query. [22:57:10] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.97, 3.10, 3.38 [23:02:43] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.05, 9.84, 9.16 [23:03:03] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.67, 11.24, 10.44 [23:04:27] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.68, 3.39, 3.87 [23:04:43] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.87, 10.72, 9.53 [23:04:58] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.43, 11.23, 10.55 [23:06:43] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.55, 10.83, 9.74 [23:08:43] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.93, 12.00, 10.34 [23:08:50] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.61, 11.47, 10.71 [23:10:46] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.03, 10.38, 10.42 [23:12:43] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.42, 11.78, 10.70 [23:14:27] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.93, 4.19, 3.89 [23:14:37] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.16, 9.48, 10.09 [23:15:14] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.38, 1.75, 2.00 [23:16:43] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.01, 9.88, 10.15 [23:17:14] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 1.71, 2.18, 2.16 [23:18:27] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.86, 3.58, 3.71 [23:20:27] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.23, 4.17, 3.91 [23:21:05] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.27, 3.28, 3.00 [23:21:51] RECOVERY - roblox-wiki.tk - reverse DNS on sslhost is OK: SSL OK - roblox-wiki.tk reverse DNS resolves to cp30.miraheze.org - NS RECORDS OK [23:22:23] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.26, 10.23, 10.32 [23:22:27] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.61, 3.65, 3.76 [23:23:05] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.19, 2.83, 2.87 [23:24:27] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.47, 4.16, 3.94 [23:26:15] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.92, 11.73, 10.90 [23:26:27] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.55, 3.64, 3.78 [23:26:43] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.14, 10.47, 10.33 [23:28:14] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.92, 11.57, 10.96 [23:28:43] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 14.87, 11.71, 10.78 [23:30:43] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.66, 11.14, 10.66 [23:32:27] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.65, 2.86, 3.36 [23:34:43] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.27, 11.45, 10.86 [23:36:44] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.65, 10.69, 10.65 [23:40:14] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.61, 10.71, 10.80 [23:40:43] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.22, 11.72, 11.04 [23:42:14] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.31, 9.99, 10.52 [23:42:43] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.80, 11.41, 11.02 [23:45:15] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.67, 3.66, 3.50 [23:46:14] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.32, 11.01, 10.77 [23:47:12] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.31, 3.74, 3.53 [23:48:14] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.72, 10.46, 10.60 [23:49:08] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.93, 3.40, 3.43 [23:51:04] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.31, 2.98, 3.26 [23:52:14] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 9.40, 9.57, 10.17 [23:52:43] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.33, 8.99, 9.95 [23:56:14] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.03, 10.34, 10.36 [23:58:14] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.59, 11.51, 10.79