[00:00:37] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.60, 1.87, 1.86 [00:02:35] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.81, 1.78, 1.83 [00:03:03] PROBLEM - mwtask111 SSH on mwtask111 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:05:36] PROBLEM - mwtask111 JobRunner Service on mwtask111 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [00:05:41] PROBLEM - mwtask111 nutcracker process on mwtask111 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [00:06:02] PROBLEM - mwtask111 ferm_active on mwtask111 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [00:06:58] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.89, 9.92, 9.72 [00:07:11] RECOVERY - mwtask111 SSH on mwtask111 is OK: SSH OK - OpenSSH_8.4p1 Debian-5 (protocol 2.0) [00:08:56] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 10.10, 9.89, 9.74 [00:11:31] PROBLEM - mwtask111 SSH on mwtask111 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:11:36] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.69, 1.82, 1.70 [00:12:26] PROBLEM - mwtask111 php-fpm on mwtask111 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [00:13:20] RECOVERY - mwtask111 nutcracker process on mwtask111 is OK: PROCS OK: 1 process with UID = 116 (nutcracker), command name 'nutcracker' [00:13:20] RECOVERY - mwtask111 JobRunner Service on mwtask111 is OK: PROCS OK: 1 process with args 'redisJobRunnerService' [00:13:29] RECOVERY - mwtask111 SSH on mwtask111 is OK: SSH OK - OpenSSH_8.4p1 Debian-5 (protocol 2.0) [00:13:36] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.50, 1.70, 1.67 [00:14:46] RECOVERY - mwtask111 ferm_active on mwtask111 is OK: OK ferm input default policy is set [00:18:35] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.62, 2.03, 1.88 [00:18:41] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.86, 10.42, 9.80 [00:19:46] PROBLEM - mwtask111 SSH on mwtask111 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:21:25] PROBLEM - mwtask111 JobRunner Service on mwtask111 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [00:21:38] PROBLEM - mwtask111 Check Gluster Clients on mwtask111 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [00:21:42] PROBLEM - mwtask111 nutcracker process on mwtask111 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [00:21:44] RECOVERY - mwtask111 SSH on mwtask111 is OK: SSH OK - OpenSSH_8.4p1 Debian-5 (protocol 2.0) [00:21:44] PROBLEM - mwtask111 ferm_active on mwtask111 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [00:22:36] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 9.83, 10.05, 9.78 [00:22:48] RECOVERY - mwtask111 php-fpm on mwtask111 is OK: PROCS OK: 3 processes with command name 'php-fpm7.4' [00:23:00] RECOVERY - mwtask111 conntrack_table_size on mwtask111 is OK: OK: nf_conntrack is 0 % full [00:23:01] RECOVERY - mwtask111 PowerDNS Recursor on mwtask111 is OK: DNS OK: 2.220 seconds response time. miraheze.org returns 198.244.148.90,2001:41d0:801:2000::1b80,2001:41d0:801:2000::4c25,51.195.220.68 [00:23:19] RECOVERY - mwtask111 JobRunner Service on mwtask111 is OK: PROCS OK: 1 process with args 'redisJobRunnerService' [00:26:38] RECOVERY - mwtask111 Check Gluster Clients on mwtask111 is OK: PROCS OK: 1 process with args '/usr/sbin/glusterfs' [00:27:18] RECOVERY - mwtask111 nutcracker process on mwtask111 is OK: PROCS OK: 1 process with UID = 116 (nutcracker), command name 'nutcracker' [00:27:19] RECOVERY - mwtask111 ferm_active on mwtask111 is OK: OK ferm input default policy is set [00:28:35] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.83, 1.98, 1.97 [00:30:27] RECOVERY - cp31 Stunnel HTTP for mwtask111 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15950 bytes in 0.423 second response time [00:30:35] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.11, 2.02, 1.99 [00:30:39] RECOVERY - cp21 Stunnel HTTP for mwtask111 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15950 bytes in 0.026 second response time [00:30:54] RECOVERY - cp20 Stunnel HTTP for mwtask111 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15950 bytes in 0.043 second response time [00:31:01] RECOVERY - cp30 Stunnel HTTP for mwtask111 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15950 bytes in 0.330 second response time [00:31:03] RECOVERY - mwtask111 MediaWiki Rendering on mwtask111 is OK: HTTP OK: HTTP/1.1 200 OK - 27073 bytes in 0.595 second response time [00:31:16] RECOVERY - mwtask111 HTTPS on mwtask111 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 553 bytes in 0.012 second response time [00:31:45] RECOVERY - mwtask111 Puppet on mwtask111 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [00:35:31] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.46, 3.23, 3.91 [00:38:09] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.25, 3.22, 3.98 [00:42:35] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.80, 1.93, 2.00 [00:44:09] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.91, 3.83, 3.90 [00:45:31] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.23, 3.41, 3.53 [00:46:35] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.31, 1.99, 2.00 [00:47:31] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.56, 3.22, 3.46 [00:48:09] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.45, 3.32, 3.70 [00:48:24] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.75, 1.67, 1.22 [00:49:31] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.85, 3.02, 3.35 [00:50:24] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.89, 1.69, 1.28 [00:50:46] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 1.70, 2.50, 3.80 [00:52:08] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.02, 2.71, 3.36 [00:52:24] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.90, 1.37, 1.21 [00:58:35] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.60, 1.86, 1.99 [01:00:46] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.17, 3.62, 3.71 [01:01:31] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.17, 3.38, 3.20 [01:02:08] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.51, 2.94, 3.07 [01:03:31] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.37, 3.02, 3.09 [01:04:09] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.15, 3.30, 3.18 [01:04:46] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.90, 3.83, 3.80 [01:06:08] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.87, 2.99, 3.07 [01:07:00] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.94, 1.73, 1.59 [01:08:55] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.11, 1.99, 1.72 [01:10:49] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.96, 1.89, 1.71 [01:12:46] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.10, 2.88, 3.40 [01:15:00] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.10, 3.68, 3.29 [01:16:32] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.10, 1.56, 1.64 [01:16:56] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.60, 3.44, 3.26 [01:18:35] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.12, 1.86, 1.82 [01:18:52] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.57, 3.24, 3.21 [01:22:35] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.53, 1.84, 1.83 [01:24:10] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.27, 2.23, 1.89 [01:28:16] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.70, 10.17, 9.27 [01:29:35] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.14, 4.18, 3.53 [01:29:53] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.60, 2.00, 1.90 [01:31:33] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.95, 3.66, 3.42 [01:31:47] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 1.98, 2.22, 2.01 [01:33:30] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.08, 3.57, 3.40 [01:33:42] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.42, 1.91, 1.92 [01:34:16] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.49, 11.08, 9.93 [01:35:27] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.90, 3.67, 3.31 [01:35:27] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.43, 3.43, 3.36 [01:35:37] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.09, 2.16, 2.02 [01:36:16] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.73, 11.25, 10.16 [01:36:35] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.43, 1.57, 1.69 [01:37:23] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.51, 3.60, 3.33 [01:37:46] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 3.91, 2.30, 1.63 [01:39:20] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.20, 3.18, 3.22 [01:39:36] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.35, 1.82, 1.92 [01:39:40] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.48, 1.93, 1.58 [01:41:20] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query dnd.bellinrattin.it. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [01:42:16] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.03, 11.56, 10.60 [01:43:29] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.82, 1.41, 1.44 [01:44:16] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.87, 11.63, 10.75 [01:45:14] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.25, 3.09, 3.39 [01:48:35] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.44, 1.90, 1.73 [01:51:36] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.24, 1.72, 1.76 [01:52:08] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 4.00, 3.32, 3.14 [01:53:37] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.76, 1.75, 1.77 [01:53:59] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 7.36, 4.77, 3.89 [01:54:09] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 7.11, 4.67, 3.64 [01:54:57] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 8.15, 5.04, 3.76 [01:55:36] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.04, 1.77, 1.77 [01:56:16] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.94, 11.05, 10.83 [01:56:35] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.28, 1.81, 1.83 [01:57:36] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.14, 1.55, 1.69 [01:58:16] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.96, 11.25, 10.93 [02:02:16] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.22, 11.40, 11.02 [02:04:16] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.95, 11.44, 11.07 [02:10:10] RECOVERY - dnd.bellinrattin.it - reverse DNS on sslhost is OK: SSL OK - dnd.bellinrattin.it reverse DNS resolves to cp20.miraheze.org - CNAME OK [02:10:35] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.14, 1.84, 1.82 [02:15:59] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.55, 3.72, 4.00 [02:17:53] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.66, 4.61, 4.30 [02:18:16] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.04, 10.42, 10.65 [02:20:16] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.34, 10.20, 10.56 [02:21:12] PROBLEM - mwtask111 Current Load on mwtask111 is WARNING: WARNING - load average: 2.68, 2.89, 3.84 [02:23:36] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.35, 4.89, 3.16 [02:28:16] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 13.28, 11.04, 10.70 [02:29:12] RECOVERY - mwtask111 Current Load on mwtask111 is OK: OK - load average: 2.51, 2.59, 3.30 [02:30:16] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.69, 10.55, 10.57 [02:32:16] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.29, 10.83, 10.64 [02:34:16] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.03, 10.24, 10.43 [02:38:35] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.51, 1.80, 1.96 [02:39:36] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.51, 1.42, 1.98 [02:40:16] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.23, 9.28, 10.05 [02:43:31] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.88, 3.69, 3.95 [02:45:36] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.14, 1.22, 1.69 [02:47:31] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 7.24, 5.05, 4.37 [02:48:35] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.26, 2.03, 1.97 [02:50:48] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.56, 2.73, 1.91 [02:52:16] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.28, 10.42, 10.10 [02:54:16] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 10.03, 10.12, 10.02 [02:54:35] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.59, 1.91, 1.96 [02:54:36] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.55, 1.62, 1.64 [02:58:16] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.01, 11.12, 10.49 [03:00:55] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.87, 10.04, 8.75 [03:02:54] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 8.82, 9.74, 8.81 [03:06:16] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.78, 11.01, 10.61 [03:08:16] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.82, 10.85, 10.58 [03:10:35] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.38, 1.52, 1.70 [03:11:03] [Grafana] FIRING: Some MediaWiki Appservers are running out of PHP-FPM workers. https://grafana.miraheze.org/d/GtxbP1Xnk [03:20:35] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.24, 2.02, 1.83 [03:21:02] [Grafana] RESOLVED: PHP-FPM Worker Usage High https://grafana.miraheze.org/d/GtxbP1Xnk [03:24:35] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.55, 1.91, 1.85 [03:26:03] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.53, 2.67, 1.83 [03:26:16] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 8.21, 9.58, 10.16 [03:29:52] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.78, 1.66, 1.60 [03:32:35] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.34, 1.52, 1.68 [03:42:20] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.57, 1.83, 1.69 [03:44:14] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.23, 1.55, 1.60 [03:49:24] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.27, 2.06, 1.85 [03:59:09] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 13.32, 9.22, 7.07 [03:59:31] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.69, 3.49, 3.90 [04:03:31] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.12, 3.97, 4.01 [04:05:31] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.86, 3.61, 3.88 [04:09:08] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 3.51, 6.91, 7.42 [04:09:10] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.73, 2.00, 2.00 [04:13:08] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 3.50, 5.29, 6.65 [04:13:31] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.15, 3.93, 3.91 [04:15:06] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.22, 1.97, 1.97 [04:17:31] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.84, 3.89, 3.91 [04:19:31] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.53, 4.42, 4.10 [04:22:46] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.84, 3.53, 3.99 [04:23:31] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.07, 3.60, 3.84 [04:24:46] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.10, 3.70, 4.00 [04:26:57] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.66, 1.84, 1.98 [04:28:08] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.29, 3.70, 3.92 [04:31:31] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.83, 2.83, 3.33 [04:32:46] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.92, 3.67, 3.92 [04:32:53] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.07, 1.87, 1.94 [04:34:08] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.79, 3.96, 3.92 [04:34:51] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.50, 1.69, 1.86 [04:36:46] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.71, 4.41, 4.15 [04:38:09] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.62, 3.47, 3.74 [04:40:09] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.21, 3.78, 3.82 [04:42:08] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.23, 3.95, 3.91 [04:44:08] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.91, 4.73, 4.20 [04:46:05] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.52, 3.52, 3.42 [04:46:42] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.03, 1.70, 1.75 [04:49:55] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.43, 3.02, 3.24 [04:53:45] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.54, 3.35, 3.33 [04:54:08] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.72, 3.74, 3.96 [04:55:39] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 3.09, 3.25, 3.30 [04:56:08] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 3.24, 3.88, 4.01 [04:56:35] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.29, 1.84, 1.89 [04:58:09] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.64, 3.45, 3.83 [05:00:46] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 1.80, 3.44, 3.91 [05:01:08] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.37, 6.08, 5.43 [05:02:35] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.81, 2.17, 2.00 [05:03:08] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 5.97, 5.81, 5.40 [05:04:46] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.45, 3.85, 3.95 [05:05:31] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.60, 3.37, 3.28 [05:06:46] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.90, 3.84, 3.93 [05:07:31] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.36, 3.93, 3.51 [05:09:31] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.25, 3.66, 3.46 [05:11:31] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 1.90, 3.13, 3.30 [05:12:46] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 6.22, 4.30, 4.00 [05:14:09] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.30, 4.06, 3.72 [05:14:24] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 4.41, 2.35, 1.42 [05:15:31] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.48, 4.23, 3.74 [05:16:08] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.25, 3.78, 3.67 [05:16:24] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.20, 1.94, 1.39 [05:16:46] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.41, 3.95, 3.94 [05:17:31] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.57, 3.89, 3.67 [05:18:24] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.87, 1.54, 1.31 [05:19:08] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.45, 6.68, 5.92 [05:20:09] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.36, 3.93, 3.73 [05:22:08] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.93, 3.94, 3.76 [05:22:46] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.10, 3.40, 3.62 [05:23:08] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 6.58, 6.32, 5.92 [05:24:46] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.82, 3.38, 3.58 [05:25:31] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 1.98, 2.99, 3.35 [05:28:09] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.99, 2.72, 3.29 [05:28:46] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 1.79, 2.63, 3.23 [05:40:10] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.15, 3.66, 3.47 [05:41:04] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.00, 4.34, 3.71 [05:43:00] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.51, 3.64, 3.52 [05:44:00] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 3.05, 3.33, 3.38 [05:46:53] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.15, 3.86, 3.60 [05:48:49] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.45, 3.41, 3.48 [05:50:04] PROBLEM - cp21 Stunnel HTTP for mw102 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [05:50:08] PROBLEM - mw101 MediaWiki Rendering on mw101 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [05:50:13] PROBLEM - cp31 Stunnel HTTP for mw101 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [05:50:19] PROBLEM - cp30 Stunnel HTTP for mw102 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [05:50:24] PROBLEM - cp20 Stunnel HTTP for mw101 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [05:50:26] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 22.20, 15.46, 10.91 [05:50:28] PROBLEM - cp31 Stunnel HTTP for mw112 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [05:50:32] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 12.14, 9.80, 7.42 [05:50:34] PROBLEM - mw112 MediaWiki Rendering on mw112 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [05:50:41] PROBLEM - cp20 Stunnel HTTP for mw102 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [05:50:45] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.26, 3.01, 3.32 [05:50:55] PROBLEM - mw102 MediaWiki Rendering on mw102 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [05:52:01] RECOVERY - cp21 Stunnel HTTP for mw102 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.023 second response time [05:52:07] RECOVERY - cp31 Stunnel HTTP for mw101 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.333 second response time [05:52:07] RECOVERY - mw101 MediaWiki Rendering on mw101 is OK: HTTP OK: HTTP/1.1 200 OK - 27065 bytes in 0.622 second response time [05:52:09] PROBLEM - cp30 Varnish Backends on cp30 is CRITICAL: 1 backends are down. mw111 [05:52:15] RECOVERY - cp30 Stunnel HTTP for mw102 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.309 second response time [05:52:18] RECOVERY - cp20 Stunnel HTTP for mw101 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 0.032 second response time [05:52:23] RECOVERY - cp31 Stunnel HTTP for mw112 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 0.330 second response time [05:52:24] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 6.74, 11.68, 10.07 [05:52:31] RECOVERY - mw112 MediaWiki Rendering on mw112 is OK: HTTP OK: HTTP/1.1 200 OK - 27065 bytes in 0.843 second response time [05:52:32] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 9.45, 9.73, 7.70 [05:52:40] RECOVERY - cp20 Stunnel HTTP for mw102 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 0.022 second response time [05:52:50] RECOVERY - mw102 MediaWiki Rendering on mw102 is OK: HTTP OK: HTTP/1.1 200 OK - 27065 bytes in 0.507 second response time [05:54:09] RECOVERY - cp30 Varnish Backends on cp30 is OK: All 14 backends are healthy [05:54:21] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 4.96, 9.29, 9.37 [05:54:46] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.14, 3.85, 3.37 [05:56:37] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.40, 3.36, 3.32 [05:58:33] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.57, 3.04, 3.21 [05:58:46] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.50, 3.23, 3.24 [06:11:20] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - dnd.bellinrattin.it All nameservers failed to answer the query. [06:16:08] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.05, 3.38, 3.14 [06:20:08] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.65, 3.26, 3.22 [06:36:44] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.73, 10.57, 9.09 [06:38:42] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.22, 10.26, 9.15 [06:40:39] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 9.93, 10.18, 9.26 [06:48:08] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.40, 3.46, 3.13 [06:50:09] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 6.09, 3.96, 3.32 [06:52:08] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.33, 3.58, 3.26 [06:53:20] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.43, 10.44, 9.83 [06:54:09] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.44, 3.75, 3.35 [06:57:30] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 4.00, 3.31, 3.05 [06:58:08] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.53, 3.60, 3.37 [06:59:13] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 8.36, 9.74, 9.76 [06:59:27] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.60, 3.02, 2.98 [07:00:09] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 3.38, 3.29, 3.27 [07:07:00] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.12, 10.82, 10.16 [07:07:08] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 8.38, 6.76, 5.84 [07:08:58] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 8.95, 10.11, 9.99 [07:09:08] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.76, 7.08, 6.07 [07:09:20] RECOVERY - dnd.bellinrattin.it - reverse DNS on sslhost is OK: SSL OK - dnd.bellinrattin.it reverse DNS resolves to cp21.miraheze.org - CNAME OK [07:11:08] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 5.60, 6.56, 6.00 [07:22:50] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.82, 3.60, 3.08 [07:24:48] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.74, 3.19, 2.98 [07:28:46] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.09, 3.69, 3.28 [07:30:46] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.69, 3.18, 3.13 [07:34:46] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.27, 3.93, 3.41 [07:38:14] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.04, 3.70, 3.11 [07:38:15] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.47, 4.21, 3.40 [07:40:46] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.97, 3.95, 3.61 [07:43:59] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.08, 3.21, 3.12 [07:44:09] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.10, 3.63, 3.44 [07:48:08] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.35, 3.32, 3.38 [07:48:46] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 1.99, 2.92, 3.28 [07:50:24] PROBLEM - mw111 NTP time on mw111 is WARNING: NTP WARNING: Offset 0.102940768 secs [07:53:43] PROBLEM - matomo101 NTP time on matomo101 is WARNING: NTP WARNING: Offset 0.1037113667 secs [07:54:46] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.56, 3.47, 3.37 [07:56:46] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 3.11, 3.30, 3.32 [08:12:27] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.44, 3.55, 3.33 [08:14:24] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.74, 3.21, 3.22 [08:21:09] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.68, 10.11, 9.15 [08:23:06] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 9.78, 9.94, 9.20 [08:26:06] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 7.08, 3.94, 3.26 [08:26:17] [02puppet] 07RhinosF1 synchronize pull request 03#2456: mw-python-tools: major improvements - 13https://github.com/miraheze/puppet/pull/2456 [08:26:18] [url] Page not found · GitHub · GitHub | github.com [08:27:41] [02puppet] 07RhinosF1 synchronize pull request 03#2456: mw-python-tools: major improvements - 13https://github.com/miraheze/puppet/pull/2456 [08:27:42] [url] Page not found · GitHub · GitHub | github.com [08:28:03] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.25, 3.51, 3.18 [08:29:54] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.08, 10.44, 9.72 [08:30:01] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.64, 3.21, 3.11 [08:31:51] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 10.17, 10.20, 9.71 [09:21:00] [02puppet] 07RhinosF1 synchronize pull request 03#2456: mw-python-tools: major improvements - 13https://github.com/miraheze/puppet/pull/2456 [09:21:01] [url] Page not found · GitHub · GitHub | github.com [09:24:50] [02puppet] 07RhinosF1 edited pull request 03#2456: mw-python-tools: major improvements - 13https://github.com/miraheze/puppet/pull/2456 [09:24:51] [url] Page not found · GitHub · GitHub | github.com [09:26:55] [02puppet] 07RhinosF1 synchronize pull request 03#2456: mw-python-tools: major improvements - 13https://github.com/miraheze/puppet/pull/2456 [09:26:56] [url] Page not found · GitHub · GitHub | github.com [09:41:31] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.86, 3.37, 2.88 [09:43:31] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.40, 2.91, 2.77 [09:46:09] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.95, 3.44, 2.88 [09:48:08] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 3.30, 3.26, 2.88 [09:53:50] [02puppet] 07RhinosF1 synchronize pull request 03#2456: mw-python-tools: major improvements - 13https://github.com/miraheze/puppet/pull/2456 [09:53:50] [url] Page not found · GitHub · GitHub | github.com [09:55:10] [02puppet] 07RhinosF1 edited pull request 03#2456: mw-python-tools: major improvements - 13https://github.com/miraheze/puppet/pull/2456 [09:55:10] ... [09:56:11] [02puppet] 07RhinosF1 synchronize pull request 03#2456: mw-python-tools: major improvements - 13https://github.com/miraheze/puppet/pull/2456 [09:56:11] ... [09:58:16] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.24, 9.63, 8.84 [10:00:16] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 9.82, 9.56, 8.91 [10:04:46] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.78, 3.01, 2.76 [10:06:16] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.76, 10.42, 9.56 [10:06:45] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 3.23, 3.00, 2.77 [10:10:16] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.34, 10.78, 9.84 [10:12:16] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.23, 10.89, 10.00 [10:20:50] [02puppet] 07RhinosF1 edited pull request 03#2456: mw-python-tools: major improvements - 13https://github.com/miraheze/puppet/pull/2456 [10:20:51] [url] Page not found · GitHub · GitHub | github.com [10:24:16] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 8.29, 9.72, 9.99 [10:41:02] PROBLEM - cloud12 Puppet on cloud12 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[ulogd2] [10:42:06] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.54, 3.73, 3.19 [10:42:46] RECOVERY - matomo101 NTP time on matomo101 is OK: NTP OK: Offset 0.09731590748 secs [10:44:03] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.12, 3.06, 3.00 [10:44:18] RECOVERY - mw111 NTP time on mw111 is OK: NTP OK: Offset 0.09457120299 secs [11:11:02] RECOVERY - cloud12 Puppet on cloud12 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [11:22:21] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.09, 3.63, 2.86 [11:23:05] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.71, 3.54, 2.96 [11:24:15] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.77, 3.28, 2.82 [11:25:03] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 1.84, 2.85, 2.77 [11:39:08] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 10.65, 7.70, 5.91 [11:39:33] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.78, 3.33, 2.92 [11:41:31] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.16, 3.57, 3.06 [11:44:46] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.43, 3.70, 3.24 [11:45:11] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.94, 3.68, 3.11 [11:45:31] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.14, 3.56, 3.18 [11:47:31] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 1.80, 3.03, 3.04 [11:48:46] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 1.72, 2.80, 2.99 [11:49:03] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.18, 2.92, 2.94 [11:49:08] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 5.52, 7.07, 6.71 [11:50:16] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.68, 9.57, 8.48 [11:52:16] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 8.81, 9.14, 8.45 [11:53:08] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 4.96, 6.34, 6.51 [11:54:46] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.54, 3.16, 3.05 [11:58:16] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.79, 10.47, 9.22 [11:58:46] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 3.07, 3.16, 3.08 [12:00:16] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.68, 11.20, 9.64 [12:01:41] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.87, 9.55, 8.46 [12:02:16] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.86, 11.09, 9.79 [12:03:40] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 6.27, 8.51, 8.23 [12:10:16] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 9.32, 9.73, 9.72 [12:11:08] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.08, 6.43, 6.19 [12:13:08] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 8.16, 7.07, 6.45 [12:15:08] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 6.20, 6.66, 6.37 [12:19:08] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 10.41, 8.33, 7.10 [12:22:46] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.27, 3.75, 3.14 [12:23:04] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.32, 3.46, 2.87 [12:26:54] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.64, 10.75, 10.23 [12:27:08] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 4.96, 6.97, 7.08 [12:28:46] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.76, 3.62, 3.32 [12:28:53] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.47, 3.08, 2.96 [12:31:08] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 8.30, 7.65, 7.29 [12:32:46] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.62, 4.01, 3.51 [12:33:08] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.13, 7.52, 7.30 [12:34:44] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.20, 4.11, 3.41 [12:34:57] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.74, 3.49, 3.06 [12:36:40] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.49, 3.37, 3.21 [12:36:46] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.02, 3.81, 3.57 [12:36:52] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 3.16, 3.32, 3.04 [12:39:08] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 5.41, 5.99, 6.66 [12:41:20] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - dnd.bellinrattin.it All nameservers failed to answer the query. [12:42:31] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.62, 3.50, 3.29 [12:42:34] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.26, 10.92, 10.49 [12:44:28] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.54, 3.77, 3.39 [12:44:32] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.08, 10.45, 10.39 [12:45:08] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.33, 6.66, 6.70 [12:46:24] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.89, 3.02, 3.16 [12:46:46] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.06, 3.93, 3.65 [12:49:08] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 6.32, 6.45, 6.59 [12:50:46] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.00, 3.67, 3.63 [12:52:46] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.86, 4.32, 3.88 [12:54:46] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.67, 3.60, 3.67 [12:56:46] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.29, 3.67, 3.67 [12:58:19] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 12.26, 10.91, 9.28 [12:58:46] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.94, 3.97, 3.79 [12:58:52] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.04, 3.95, 3.41 [13:00:15] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 11.90, 10.88, 9.43 [13:00:16] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.40, 11.12, 10.77 [13:00:46] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.59, 3.78, 3.41 [13:01:04] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.22, 3.86, 3.41 [13:02:41]