[00:01:19] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.22, 3.77, 3.83 [00:01:49] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.00, 3.89, 3.67 [00:03:16] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 3.90, 4.09, 3.95 [00:03:18] PROBLEM - cp30 Disk Space on cp30 is WARNING: DISK WARNING - free space: / 3995 MB (10% inode=96%); [00:03:49] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 3.82, 4.02, 3.75 [00:05:15] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.10, 3.83, 3.88 [00:05:49] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.24, 3.36, 3.54 [00:08:07] RECOVERY - cp31 Disk Space on cp31 is OK: DISK OK - free space: / 10714 MB (27% inode=96%); [00:09:18] RECOVERY - cp30 Disk Space on cp30 is OK: DISK OK - free space: / 11090 MB (28% inode=96%); [00:11:49] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.03, 4.08, 3.75 [00:13:15] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.09, 2.87, 3.40 [00:13:49] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.03, 3.33, 3.52 [00:15:49] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.10, 2.93, 3.34 [00:33:15] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.71, 3.71, 3.43 [00:37:15] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.75, 2.94, 3.21 [00:51:56] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.19, 3.63, 3.29 [00:53:51] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 1.95, 3.06, 3.12 [01:02:01] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 6.90, 9.37, 11.67 [01:10:01] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.77, 11.10, 11.44 [01:12:01] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.81, 10.96, 11.38 [01:15:42] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.86, 10.78, 11.85 [01:17:42] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.38, 11.10, 11.82 [01:19:42] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.80, 11.08, 11.73 [01:20:01] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.07, 10.27, 10.83 [01:22:01] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.19, 10.92, 11.02 [01:24:41] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.03, 1.53, 1.87 [01:28:01] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.98, 8.91, 10.09 [01:28:41] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.87, 2.16, 2.05 [01:30:41] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.77, 1.96, 1.99 [01:31:42] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.51, 11.27, 11.30 [01:32:01] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.77, 10.30, 10.37 [01:34:01] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.43, 9.32, 9.99 [01:37:42] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.15, 11.75, 11.66 [01:40:41] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.56, 1.66, 1.76 [01:41:42] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.89, 11.54, 11.53 [01:42:01] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.45, 10.51, 10.12 [01:42:41] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.50, 1.52, 1.70 [01:43:42] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.99, 10.83, 11.30 [01:44:01] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.61, 9.54, 9.82 [01:50:41] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 5.46, 3.27, 2.31 [01:53:42] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.06, 10.35, 10.54 [01:54:01] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.71, 10.19, 9.79 [01:55:42] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.60, 9.87, 10.34 [01:56:01] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.83, 9.46, 9.56 [01:59:42] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.70, 11.44, 10.87 [02:00:31] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.32, 3.47, 2.87 [02:01:42] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.99, 10.85, 10.75 [02:02:01] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.22, 10.60, 9.96 [02:02:27] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.00, 2.93, 2.75 [02:03:42] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.17, 10.91, 10.76 [02:04:01] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.10, 10.62, 10.05 [02:05:42] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.24, 10.53, 10.66 [02:06:01] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 9.79, 10.03, 9.88 [02:11:42] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.88, 9.20, 10.04 [02:12:51] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.39, 10.34, 10.10 [02:14:46] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.80, 9.77, 9.91 [02:16:41] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.44, 1.72, 1.99 [02:18:41] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.73, 1.89, 2.01 [02:22:26] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.88, 10.68, 10.20 [02:23:42] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 15.58, 12.38, 10.89 [02:24:21] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.76, 11.56, 10.59 [02:28:10] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.44, 11.78, 10.93 [02:31:42] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.21, 11.25, 11.28 [02:32:41] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.54, 1.75, 1.99 [02:33:42] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.53, 12.34, 11.68 [02:35:49] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.59, 3.37, 2.89 [02:36:01] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.58, 9.40, 10.12 [02:36:41] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 4.07, 3.56, 2.68 [02:37:49] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.56, 2.99, 2.81 [02:40:01] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 16.82, 11.97, 10.93 [02:41:42] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.02, 11.91, 11.89 [02:43:42] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.65, 11.69, 11.78 [02:43:57] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 0.76, 1.61, 1.97 [02:44:01] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.96, 10.96, 10.84 [02:45:42] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.63, 10.16, 11.21 [02:47:57] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 9.57, 3.30, 2.44 [02:48:01] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 6.25, 8.66, 9.95 [02:53:42] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.90, 9.01, 10.10 [03:06:41] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.91, 1.64, 1.99 [03:09:15] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.07, 3.42, 2.89 [03:11:17] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.61, 3.01, 2.80 [03:12:41] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.04, 1.65, 1.85 [03:13:42] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.44, 10.90, 10.13 [03:14:41] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.61, 1.60, 1.81 [03:18:41] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 3.11, 2.24, 2.01 [03:19:42] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.94, 11.65, 10.77 [03:19:49] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.88, 3.46, 3.02 [03:20:41] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.72, 10.54, 9.73 [03:21:49] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 1.43, 2.69, 2.79 [03:22:36] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.59, 9.85, 9.58 [03:22:41] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.50, 1.95, 1.95 [03:25:42] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.23, 11.31, 10.84 [03:27:42] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.26, 10.93, 10.76 [03:30:41] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 3.07, 2.07, 1.94 [03:34:41] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.85, 1.94, 1.91 [03:35:42] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.35, 10.60, 10.52 [03:36:41] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.43, 2.20, 2.01 [03:38:52] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.37, 10.25, 9.74 [03:40:47] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 14.22, 11.40, 10.19 [03:41:42] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.57, 11.75, 11.23 [03:44:37] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.71, 11.53, 10.62 [03:44:41] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.40, 1.85, 1.98 [03:45:42] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.72, 11.99, 11.36 [03:46:31] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 14.30, 12.81, 11.20 [03:47:42] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.53, 11.29, 11.21 [03:48:26] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.25, 11.07, 10.76 [03:48:41] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.19, 2.10, 2.05 [03:52:16] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.07, 8.90, 9.94 [03:55:42] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.87, 8.99, 10.20 [04:00:41] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.57, 1.76, 1.97 [04:02:41] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 3.43, 2.23, 2.10 [04:03:42] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.48, 11.46, 10.65 [04:07:42] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.58, 10.63, 10.66 [04:09:57] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 0.89, 1.41, 1.90 [04:14:41] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.24, 1.71, 1.98 [04:15:15] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.31, 3.52, 3.13 [04:15:42] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 9.43, 9.51, 10.12 [04:15:57] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 18.25, 6.42, 3.49 [04:16:41] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.49, 2.02, 2.06 [04:17:15] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.35, 2.71, 2.88 [04:21:54] PROBLEM - wiki.minebox.fr - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.minebox.fr could not be found [04:26:38] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.24, 3.41, 2.96 [04:28:33] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.46, 3.09, 2.90 [04:39:57] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 0.97, 1.20, 1.95 [04:40:36] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.88, 11.21, 10.28 [04:44:35] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 9.17, 9.98, 9.97 [04:44:39] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 2 datacenters are down: 2001:41d0:801:2000::4c25/cpweb, 2001:41d0:801:2000::1b80/cpweb [04:45:57] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.71, 1.09, 1.67 [04:48:41] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.77, 1.81, 1.99 [04:51:57] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.99, 1.68, 1.73 [04:53:57] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.42, 1.60, 1.70 [04:54:41] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.74, 1.22, 1.67 [04:58:39] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [04:58:41] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.23, 1.64, 1.73 [04:59:57] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.54, 1.85, 1.75 [05:00:15] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.41, 3.35, 2.63 [05:00:30] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.21, 10.89, 9.86 [05:02:11] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.88, 2.83, 2.53 [05:02:29] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.31, 10.40, 9.81 [05:04:29] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.57, 10.13, 9.81 [05:08:41] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 0.84, 1.80, 1.97 [05:09:57] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.45, 1.74, 1.80 [05:17:57] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.13, 1.45, 1.65 [05:18:41] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.72, 1.93, 1.87 [05:21:57] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.94, 2.02, 1.83 [05:22:41] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.68, 1.73, 1.80 [05:23:57] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.68, 1.93, 1.82 [05:25:57] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 1.63, 2.02, 1.87 [05:26:41] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.06, 1.90, 1.85 [05:28:26] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 2 datacenters are down: 2001:41d0:801:2000::4c25/cpweb, 2001:41d0:801:2000::1b80/cpweb [05:28:41] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.88, 1.97, 1.89 [05:29:57] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.44, 1.84, 1.84 [05:32:41] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.14, 1.46, 1.70 [05:37:57] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.03, 1.66, 1.72 [05:38:41] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.82, 1.74, 1.73 [05:40:41] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.28, 1.56, 1.66 [05:45:57] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.27, 1.75, 1.82 [05:55:48] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [05:59:57] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.10, 2.10, 1.92 [06:01:57] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.38, 1.87, 1.86 [06:02:27] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.92, 1.65, 1.57 [06:06:24] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.46, 1.98, 1.72 [06:07:57] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.32, 1.48, 1.67 [06:08:22] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.78, 1.97, 1.75 [06:08:39] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 2 datacenters are down: 2001:41d0:801:2000::4c25/cpweb, 2001:41d0:801:2000::1b80/cpweb [06:12:20] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.57, 1.95, 1.77 [06:14:18] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.52, 1.78, 1.74 [06:16:17] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.51, 1.67, 1.70 [06:20:13] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 1.98, 2.12, 1.89 [06:21:45] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.24, 2.04, 1.85 [06:23:42] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.55, 1.89, 1.82 [06:24:10] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.25, 1.93, 1.90 [06:24:13] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.51, 3.71, 2.62 [06:25:15] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 8.02, 4.30, 2.76 [06:26:09] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 3.37, 2.65, 2.17 [06:26:36] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.39, 9.43, 7.94 [06:27:15] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.50, 3.72, 2.72 [06:27:35] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.14, 2.01, 1.87 [06:29:04] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.91, 10.76, 9.14 [06:29:15] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 6.22, 4.61, 3.16 [06:29:32] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.56, 1.86, 1.84 [06:30:03] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 5.20, 4.06, 2.68 [06:30:25] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.94, 11.23, 8.99 [06:31:15] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.84, 3.85, 3.06 [06:32:02] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 2.99, 3.60, 2.68 [06:32:20] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.74, 10.81, 9.07 [06:33:03] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 16.97, 12.05, 9.90 [06:33:25] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.75, 2.25, 1.98 [06:34:01] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 2.72, 3.29, 2.68 [06:35:15] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.05, 3.09, 2.93 [06:36:01] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.94, 1.96, 2.00 [06:38:00] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.59, 2.26, 2.10 [06:38:04] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.81, 11.61, 9.84 [06:39:15] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.29, 3.80, 3.28 [06:39:49] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.31, 3.95, 3.84 [06:41:15] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.12, 3.11, 3.08 [06:42:39] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [06:45:00] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.22, 11.36, 11.71 [06:45:55] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.06, 1.61, 1.90 [06:47:49] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.26, 2.81, 3.36 [06:48:01] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 7.52, 11.45, 11.56 [06:48:03] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 11.56, 6.25, 4.02 [06:48:33] PROBLEM - cp30 Stunnel HTTP for mwtask141 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:48:48] PROBLEM - mwtask141 MediaWiki Rendering on mwtask141 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:49:43] PROBLEM - cp31 Stunnel HTTP for mwtask141 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:49:52] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 3.83, 2.34, 2.09 [06:51:49] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.43, 3.47, 3.52 [06:56:01] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.18, 8.75, 10.15 [06:56:01] PROBLEM - mwtask141 SSH on mwtask141 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:57:35] PROBLEM - mon141 Current Load on mon141 is CRITICAL: CRITICAL - load average: 4.17, 11.38, 6.09 [06:57:44] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.16, 1.75, 1.95 [06:57:58] RECOVERY - mwtask141 SSH on mwtask141 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [06:58:03] RECOVERY - cp31 Stunnel HTTP for mwtask141 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 14742 bytes in 0.312 second response time [06:58:07] RECOVERY - mwtask141 MediaWiki Rendering on mwtask141 is OK: HTTP OK: HTTP/1.1 200 OK - 29520 bytes in 0.203 second response time [06:58:28] RECOVERY - cp30 Stunnel HTTP for mwtask141 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 14736 bytes in 0.328 second response time [06:59:28] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::4c25/cpweb [07:01:26] PROBLEM - mon141 Current Load on mon141 is WARNING: WARNING - load average: 0.37, 5.45, 4.82 [07:03:21] RECOVERY - mon141 Current Load on mon141 is OK: OK - load average: 0.28, 3.79, 4.28 [07:03:23] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 9.24, 9.33, 10.11 [07:11:14] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 3.73, 2.26, 2.00 [07:11:54] PROBLEM - mwtask141 MediaWiki Rendering on mwtask141 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:12:05] PROBLEM - mwtask141 SSH on mwtask141 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:12:17] PROBLEM - mwtask141 Check Gluster Clients on mwtask141 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [07:12:17] PROBLEM - mwtask141 PowerDNS Recursor on mwtask141 is CRITICAL: CRITICAL - Plugin timed out while executing system call [07:12:20] PROBLEM - cp31 Stunnel HTTP for mwtask141 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:12:24] PROBLEM - cp30 Stunnel HTTP for mwtask141 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:13:14] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.44, 1.86, 1.88 [07:13:41] PROBLEM - mwtask141 JobRunner Service on mwtask141 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [07:13:54] PROBLEM - mwtask141 ferm_active on mwtask141 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [07:14:09] PROBLEM - mwtask141 conntrack_table_size on mwtask141 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [07:14:09] PROBLEM - mwtask141 Puppet on mwtask141 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [07:15:14] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 3.54, 2.21, 1.99 [07:15:18] PROBLEM - mwtask141 nutcracker process on mwtask141 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [07:17:42] RECOVERY - mwtask141 nutcracker process on mwtask141 is OK: PROCS OK: 1 process with UID = 115 (nutcracker), command name 'nutcracker' [07:18:17] RECOVERY - mwtask141 SSH on mwtask141 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [07:18:29] RECOVERY - mwtask141 JobRunner Service on mwtask141 is OK: PROCS OK: 1 process with args 'redisJobRunnerService' [07:18:42] RECOVERY - cp31 Stunnel HTTP for mwtask141 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 14736 bytes in 8.080 second response time [07:18:53] RECOVERY - mwtask141 ferm_active on mwtask141 is OK: OK ferm input default policy is set [07:19:14] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.81, 1.89, 1.90 [07:19:23] RECOVERY - mwtask141 conntrack_table_size on mwtask141 is OK: OK: nf_conntrack is 0 % full [07:19:35] RECOVERY - mwtask141 Puppet on mwtask141 is OK: OK: Puppet is currently enabled, last run 24 seconds ago with 0 failures [07:19:39] RECOVERY - mwtask141 PowerDNS Recursor on mwtask141 is OK: DNS OK: 0.120 seconds response time. miraheze.org returns 149.56.140.43,149.56.141.75,2607:5300:201:3100::5ebc,2607:5300:201:3100::929a [07:19:41] RECOVERY - mwtask141 Check Gluster Clients on mwtask141 is OK: PROCS OK: 1 process with args '/usr/sbin/glusterfs' [07:20:00] RECOVERY - mwtask141 MediaWiki Rendering on mwtask141 is OK: HTTP OK: HTTP/1.1 200 OK - 29528 bytes in 0.217 second response time [07:20:33] RECOVERY - cp30 Stunnel HTTP for mwtask141 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 14742 bytes in 0.339 second response time [07:21:14] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 3.28, 2.37, 2.07 [07:27:14] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.16, 1.81, 1.93 [07:32:55] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [07:33:14] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.57, 2.16, 2.03 [07:35:14] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.44, 1.94, 1.96 [07:40:59] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.23, 1.66, 1.96 [07:41:14] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.17, 1.95, 1.96 [07:42:58] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.27, 2.03, 2.06 [07:43:14] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.49, 1.77, 1.89 [07:44:56] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.39, 1.85, 2.00 [07:45:25] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 1.03, 1.33, 3.78 [07:46:54] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.13, 2.13, 2.09 [07:47:14] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.06, 1.73, 1.83 [07:49:14] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.50, 1.70, 1.81 [07:49:23] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 1.05, 1.23, 3.19 [07:53:21] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 2 datacenters are down: 2001:41d0:801:2000::4c25/cpweb, 2001:41d0:801:2000::1b80/cpweb [07:56:46] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.81, 1.83, 1.99 [07:58:44] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 3.01, 2.01, 2.02 [07:59:14] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.50, 1.48, 1.67 [08:00:42] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.50, 1.76, 1.92 [08:10:34] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.41, 1.48, 1.68 [08:15:14] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.88, 2.55, 1.97 [08:23:14] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.37, 1.84, 1.86 [08:23:20] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.69, 2.09, 1.79 [08:25:18] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.67, 1.84, 1.73 [08:27:14] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.97, 1.29, 1.62 [08:27:17] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.16, 2.00, 1.80 [08:28:55] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [08:39:06] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.53, 1.95, 1.95 [08:41:05] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.70, 2.05, 1.97 [08:41:14] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.37, 2.69, 1.96 [08:41:36] PROBLEM - mwtask141 MediaWiki Rendering on mwtask141 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:41:44] PROBLEM - cp30 Stunnel HTTP for mwtask141 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:43:03] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.35, 1.92, 1.94 [08:43:06] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 10.48, 11.58, 6.12 [08:43:29] RECOVERY - mwtask141 MediaWiki Rendering on mwtask141 is OK: HTTP OK: HTTP/1.1 200 OK - 29520 bytes in 0.193 second response time [08:43:40] RECOVERY - cp30 Stunnel HTTP for mwtask141 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 14736 bytes in 0.307 second response time [08:45:14] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.24, 1.87, 1.79 [08:47:00] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.63, 2.05, 1.97 [08:47:45] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 2 datacenters are down: 2001:41d0:801:2000::4c25/cpweb, 2001:41d0:801:2000::1b80/cpweb [08:48:58] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.60, 1.84, 1.90 [08:50:56] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.62, 2.24, 2.04 [08:53:14] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.13, 1.90, 1.82 [08:54:53] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.52, 1.99, 1.99 [08:55:00] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 1.36, 2.65, 3.81 [08:55:14] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.17, 1.63, 1.73 [08:57:14] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.10, 1.47, 1.66 [08:58:57] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 1.18, 1.94, 3.25 [08:59:33] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 8.35, 4.00, 2.62 [09:01:33] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.85, 3.18, 2.48 [09:04:44] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.89, 1.27, 1.63 [09:04:52] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.42, 10.85, 9.00 [09:05:14] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.90, 1.61, 1.60 [09:05:33] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.53, 3.78, 2.91 [09:06:52] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.65, 10.80, 9.23 [09:07:14] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.16, 1.65, 1.63 [09:07:33] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 1.53, 3.15, 2.80 [09:08:24] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.96, 10.37, 9.47 [09:08:52] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.85, 9.87, 9.09 [09:10:24] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 9.55, 10.10, 9.48 [09:11:14] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 3.02, 2.21, 1.85 [09:13:04] PROBLEM - roblox-wiki.tk - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - roblox-wiki.tk All nameservers failed to answer the query. [09:13:14] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.10, 1.84, 1.77 [09:15:14] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.23, 1.63, 1.70 [09:21:14] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.50, 2.15, 1.89 [09:23:14] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.15, 1.76, 1.77 [09:23:33] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.57, 4.27, 3.04 [09:23:40] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.10, 3.74, 2.81 [09:24:24] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.51, 10.36, 9.48 [09:24:28] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 3.63, 2.68, 2.06 [09:24:55] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [09:27:14] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 3.79, 2.45, 2.02 [09:28:24] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.81, 10.86, 9.93 [09:28:52] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.63, 10.79, 9.30 [09:30:52] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 15.95, 12.46, 10.07 [09:30:55] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::1b80/cpweb [09:31:40] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.86, 3.93, 3.42 [09:32:52] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.41, 11.22, 9.91 [09:32:55] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [09:33:14] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 0.91, 1.98, 1.99 [09:34:23] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 6.54, 9.17, 9.68 [09:35:33] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 1.67, 3.53, 3.50 [09:35:40] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.23, 3.72, 3.42 [09:36:52] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.30, 9.84, 9.74 [09:37:33] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 1.80, 3.14, 3.37 [09:37:40] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.25, 3.22, 3.28 [09:41:14] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.23, 1.81, 1.86 [09:41:35] PROBLEM - mwtask141 MediaWiki Rendering on mwtask141 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:41:44] PROBLEM - cp30 Stunnel HTTP for mwtask141 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:41:51] PROBLEM - mwtask141 SSH on mwtask141 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:42:08] RECOVERY - roblox-wiki.tk - reverse DNS on sslhost is OK: SSL OK - roblox-wiki.tk reverse DNS resolves to cp31.miraheze.org - NS RECORDS OK [09:42:36] PROBLEM - cp31 Stunnel HTTP for mwtask141 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:42:55] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::4c25/cpweb [09:43:11] PROBLEM - mwtask141 php-fpm on mwtask141 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [09:43:14] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.87, 1.70, 1.81 [09:43:21] PROBLEM - mwtask141 Check Gluster Clients on mwtask141 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [09:43:22] PROBLEM - mwtask141 nutcracker process on mwtask141 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [09:43:30] PROBLEM - mwtask141 PowerDNS Recursor on mwtask141 is CRITICAL: CRITICAL - Plugin timed out while executing system call [09:44:56] PROBLEM - mwtask141 JobRunner Service on mwtask141 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [09:45:05] PROBLEM - mwtask141 Puppet on mwtask141 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [09:45:10] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [09:46:20] PROBLEM - mwtask141 conntrack_table_size on mwtask141 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [09:46:36] PROBLEM - mwtask141 ferm_active on mwtask141 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [09:47:14] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.29, 1.46, 1.68 [09:48:52] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.54, 9.86, 9.53 [09:49:40] RECOVERY - mwtask141 JobRunner Service on mwtask141 is OK: PROCS OK: 1 process with args 'redisJobRunnerService' [09:49:40] RECOVERY - mwtask141 PowerDNS Recursor on mwtask141 is OK: DNS OK: 0.877 seconds response time. miraheze.org returns 149.56.140.43,149.56.141.75,2607:5300:201:3100::5ebc,2607:5300:201:3100::929a [09:50:10] RECOVERY - mwtask141 SSH on mwtask141 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [09:50:10] RECOVERY - mwtask141 Puppet on mwtask141 is OK: OK: Puppet is currently enabled, last run 40 minutes ago with 0 failures [09:50:12] RECOVERY - mwtask141 php-fpm on mwtask141 is OK: PROCS OK: 3 processes with command name 'php-fpm7.4' [09:50:52] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.84, 9.35, 9.38 [09:50:57] RECOVERY - cp31 Stunnel HTTP for mwtask141 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 14728 bytes in 0.315 second response time [09:51:05] RECOVERY - mwtask141 nutcracker process on mwtask141 is OK: PROCS OK: 1 process with UID = 115 (nutcracker), command name 'nutcracker' [09:51:06] RECOVERY - mwtask141 Check Gluster Clients on mwtask141 is OK: PROCS OK: 1 process with args '/usr/sbin/glusterfs' [09:51:14] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.56, 2.09, 1.88 [09:51:24] RECOVERY - mwtask141 ferm_active on mwtask141 is OK: OK ferm input default policy is set [09:51:32] RECOVERY - mwtask141 conntrack_table_size on mwtask141 is OK: OK: nf_conntrack is 0 % full [09:51:45] RECOVERY - mwtask141 MediaWiki Rendering on mwtask141 is OK: HTTP OK: HTTP/1.1 200 OK - 29520 bytes in 0.239 second response time [09:51:59] RECOVERY - cp30 Stunnel HTTP for mwtask141 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 14728 bytes in 0.349 second response time [09:53:14] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.89, 1.95, 1.86 [09:59:14] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.63, 1.32, 1.62 [10:12:55] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [10:14:07] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.05, 1.72, 1.59 [10:17:58] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.50, 1.91, 1.73 [10:18:07] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 1.59, 1.70, 3.95 [10:21:50] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.04, 1.98, 1.80 [10:22:55] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::1b80/cpweb [10:23:45] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.84, 1.59, 1.68 [10:24:03] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 1.53, 1.62, 3.19 [10:29:34] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.11, 2.06, 1.85 [10:35:22] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.40, 1.85, 1.86 [10:43:14] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.41, 1.77, 1.79 [10:45:14] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.86, 1.77, 1.78 [10:49:14] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.13, 1.43, 1.63 [10:53:14] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.54, 1.72, 1.72 [10:55:14] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.33, 1.60, 1.68 [11:02:55] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [11:13:45] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::4c25/cpweb [11:16:28] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.16, 1.77, 2.00 [11:19:47] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.75, 2.13, 1.76 [11:21:34] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.54, 3.24, 2.52 [11:22:28] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.53, 1.99, 2.00 [11:23:33] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.29, 3.41, 2.66 [11:24:28] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.22, 1.67, 1.88 [11:25:33] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 3.31, 3.26, 2.69 [11:31:21] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.28, 1.83, 1.85 [11:32:28] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.37, 1.78, 1.82 [11:33:17] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 3.37, 2.34, 2.02 [11:36:57] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.40, 10.01, 8.76 [11:38:56] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 14.58, 10.72, 9.11 [11:39:48] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.05, 10.09, 8.91 [11:40:54] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.37, 10.14, 9.08 [11:41:14] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.37, 1.83, 1.91 [11:42:52] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 9.78, 9.92, 9.12 [11:43:47] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.26, 10.59, 9.56 [11:44:28]