[00:00:01] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.58, 9.00, 9.57 [00:01:22] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 7.51, 8.80, 9.81 [00:01:28] PROBLEM - db111 Current Load on db111 is CRITICAL: CRITICAL - load average: 11.82, 7.42, 4.13 [00:02:27] PROBLEM - mw101 Puppet on mw101 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [00:02:28] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.97, 1.59, 1.24 [00:04:01] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.02, 9.62, 9.69 [00:04:28] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.65, 1.50, 1.24 [00:06:01] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.62, 9.23, 9.53 [00:06:54] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.91, 8.86, 8.62 [00:08:48] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.37, 8.22, 8.41 [00:11:22] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 11.05, 9.62, 9.58 [00:11:50] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.81, 9.03, 8.97 [00:12:01] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.41, 9.43, 9.46 [00:12:37] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.53, 9.46, 8.86 [00:13:22] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 8.09, 8.94, 9.33 [00:13:30] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 8.40, 7.87, 8.44 [00:13:50] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.45, 8.96, 8.95 [00:14:31] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.85, 8.92, 8.71 [00:15:22] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 11.02, 9.84, 9.62 [00:16:25] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.78, 8.29, 8.49 [00:17:22] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.57, 9.84, 9.66 [00:17:30] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 8.98, 8.42, 8.52 [00:17:50] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 6.05, 7.54, 8.40 [00:18:01] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.51, 9.83, 9.75 [00:19:30] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 7.60, 8.16, 8.41 [00:20:13] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.34, 8.91, 8.70 [00:21:50] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.57, 8.44, 8.59 [00:22:07] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.54, 9.36, 8.88 [00:23:22] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 11.07, 9.97, 9.68 [00:25:30] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 11.86, 9.46, 8.81 [00:25:50] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 6.41, 7.60, 8.22 [00:26:06] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.71, 9.61, 9.15 [00:26:46] PROBLEM - mw112 MediaWiki Rendering on mw112 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:26:50] PROBLEM - cp31 Stunnel HTTP for mw112 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:27:00] PROBLEM - cp21 Stunnel HTTP for mw112 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:27:30] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.35, 9.38, 8.87 [00:27:40] PROBLEM - cp30 Stunnel HTTP for mw112 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:28:01] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.49, 9.55, 9.49 [00:28:42] PROBLEM - cp20 Stunnel HTTP for mw112 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:29:22] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.39, 9.63, 9.65 [00:29:30] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 11.41, 9.83, 9.07 [00:29:50] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.43, 8.43, 8.40 [00:30:01] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.49, 9.51, 9.48 [00:31:30] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.67, 9.95, 9.22 [00:31:50] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.16, 8.86, 8.55 [00:32:06] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.24, 9.68, 9.31 [00:32:27] RECOVERY - mw101 Puppet on mw101 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [00:33:50] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.21, 8.70, 8.54 [00:34:01] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 11.79, 10.29, 9.74 [00:34:06] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.35, 9.09, 9.13 [00:35:30] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 10.99, 10.11, 9.41 [00:35:50] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.31, 8.31, 8.40 [00:36:01] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.24, 9.50, 9.52 [00:37:30] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 7.71, 8.94, 9.06 [00:39:10] RECOVERY - cp20 Stunnel HTTP for mw112 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 14556 bytes in 9.778 second response time [00:39:22] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.86, 8.99, 9.14 [00:39:50] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.58, 8.83, 8.61 [00:40:28] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.90, 3.08, 1.87 [00:41:55] RECOVERY - cp21 Stunnel HTTP for mw112 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 14562 bytes in 8.881 second response time [00:42:23] RECOVERY - cp30 Stunnel HTTP for mw112 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 14562 bytes in 2.732 second response time [00:45:22] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.16, 9.57, 9.40 [00:46:28] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.49, 2.00, 1.74 [00:46:45] PROBLEM - cp30 Stunnel HTTP for mw112 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:48:28] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.04, 1.66, 1.65 [00:49:50] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 6.88, 7.87, 8.41 [00:50:32] PROBLEM - cp21 Stunnel HTTP for mw112 on cp21 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 328 bytes in 0.010 second response time [00:51:03] PROBLEM - cp20 Stunnel HTTP for mw112 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:52:06] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.97, 9.35, 8.99 [00:52:35] RECOVERY - cp21 Stunnel HTTP for mw112 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 14562 bytes in 4.869 second response time [00:52:57] RECOVERY - cp30 Stunnel HTTP for mw112 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 14562 bytes in 0.334 second response time [00:52:59] RECOVERY - cp20 Stunnel HTTP for mw112 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 14562 bytes in 0.015 second response time [00:53:30] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 11.63, 9.96, 9.26 [00:53:55] RECOVERY - mw112 MediaWiki Rendering on mw112 is OK: HTTP OK: HTTP/1.1 200 OK - 22220 bytes in 2.406 second response time [00:54:01] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.69, 10.01, 9.60 [00:54:09] RECOVERY - cp31 Stunnel HTTP for mw112 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 14562 bytes in 0.334 second response time [00:55:22] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 11.79, 9.73, 9.31 [00:55:50] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.39, 9.71, 9.02 [00:56:06] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.95, 9.63, 9.20 [00:57:22] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.31, 9.83, 9.42 [00:57:30] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.22, 9.75, 9.39 [00:57:50] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.76, 9.15, 8.89 [00:58:01] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.05, 8.95, 9.30 [00:58:06] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 11.36, 10.45, 9.57 [01:00:01] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.15, 9.42, 9.43 [01:01:22] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.18, 9.43, 9.30 [01:01:30] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.61, 10.45, 9.67 [01:02:01] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.99, 9.16, 9.33 [01:02:06] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.69, 9.66, 9.48 [01:02:28] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.37, 1.75, 1.54 [01:02:42] PROBLEM - cp31 Stunnel HTTP for mw112 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:03:22] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 8.96, 9.48, 9.35 [01:03:30] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.03, 9.93, 9.58 [01:04:01] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.05, 10.09, 9.64 [01:04:06] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.76, 10.23, 9.71 [01:04:28] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.94, 1.44, 1.45 [01:04:45] RECOVERY - cp31 Stunnel HTTP for mw112 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 14562 bytes in 5.890 second response time [01:05:30] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 11.08, 10.30, 9.75 [01:05:50] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.93, 8.08, 8.48 [01:06:01] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.97, 9.81, 9.60 [01:07:30] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 8.67, 9.66, 9.59 [01:08:01] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.54, 10.03, 9.70 [01:08:39] PROBLEM - cp20 Stunnel HTTP for mw112 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:08:43] PROBLEM - cp30 Stunnel HTTP for mw112 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:08:51] PROBLEM - mw112 MediaWiki Rendering on mw112 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:10:01] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.52, 9.71, 9.62 [01:10:06] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 7.81, 9.41, 9.65 [01:10:40] RECOVERY - cp20 Stunnel HTTP for mw112 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 14556 bytes in 4.508 second response time [01:10:44] RECOVERY - cp30 Stunnel HTTP for mw112 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 14548 bytes in 4.565 second response time [01:10:52] RECOVERY - mw112 MediaWiki Rendering on mw112 is OK: HTTP OK: HTTP/1.1 200 OK - 22220 bytes in 5.829 second response time [01:11:22] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.36, 9.85, 9.51 [01:11:50] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 11.77, 9.96, 9.11 [01:12:01] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.17, 10.25, 9.85 [01:13:22] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.97, 9.96, 9.60 [01:13:31] PROBLEM - db111 APT on db111 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [01:15:22] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 11.00, 10.44, 9.83 [01:17:22] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 8.73, 9.64, 9.60 [01:18:42] PROBLEM - cp31 Stunnel HTTP for mw112 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:18:55] PROBLEM - cp20 Stunnel HTTP for mw112 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:19:20] PROBLEM - mw112 MediaWiki Rendering on mw112 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:19:30] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 10.08, 9.27, 9.39 [01:19:57] PROBLEM - cp21 Stunnel HTTP for mw112 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:20:25] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.87, 3.47, 2.99 [01:20:47] RECOVERY - cp31 Stunnel HTTP for mw112 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 14562 bytes in 7.501 second response time [01:20:58] RECOVERY - cp20 Stunnel HTTP for mw112 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 14562 bytes in 7.537 second response time [01:21:22] RECOVERY - mw112 MediaWiki Rendering on mw112 is OK: HTTP OK: HTTP/1.1 200 OK - 22220 bytes in 5.747 second response time [01:21:30] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 8.61, 9.02, 9.29 [01:21:57] RECOVERY - cp21 Stunnel HTTP for mw112 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 14556 bytes in 1.848 second response time [01:22:01] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.96, 9.93, 9.96 [01:22:19] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - dnd.bellinrattin.it All nameservers failed to answer the query. [01:22:23] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.88, 3.26, 2.97 [01:23:50] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 7.96, 9.62, 9.55 [01:25:22] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.48, 9.44, 9.43 [01:26:01] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.62, 10.44, 10.16 [01:27:22] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 8.78, 9.53, 9.50 [01:29:27] PROBLEM - cp20 Stunnel HTTP for mw112 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:29:30] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 10.20, 8.37, 8.69 [01:29:42] PROBLEM - cp30 Stunnel HTTP for mw112 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:29:46] PROBLEM - mw112 MediaWiki Rendering on mw112 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:29:50] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 11.32, 9.83, 9.57 [01:31:50] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.54, 9.75, 9.58 [01:32:01] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.16, 8.75, 9.52 [01:33:30] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 8.06, 8.81, 8.85 [01:33:34] PROBLEM - cp31 Stunnel HTTP for mw112 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:33:47] PROBLEM - cp21 Stunnel HTTP for mw112 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:34:53] PROBLEM - diamowiki.ga - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - diamowiki.ga All nameservers failed to answer the query. [01:36:06] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.04, 9.15, 8.96 [01:37:30] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 6.18, 7.49, 8.31 [01:37:48] RECOVERY - cp20 Stunnel HTTP for mw112 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 14562 bytes in 8.706 second response time [01:37:48] RECOVERY - cp31 Stunnel HTTP for mw112 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 14562 bytes in 8.864 second response time [01:38:03] RECOVERY - cp21 Stunnel HTTP for mw112 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 14548 bytes in 9.444 second response time [01:38:06] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.90, 8.86, 8.87 [01:38:07] RECOVERY - mw112 MediaWiki Rendering on mw112 is OK: HTTP OK: HTTP/1.1 200 OK - 22220 bytes in 8.931 second response time [01:38:11] RECOVERY - cp30 Stunnel HTTP for mw112 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 14562 bytes in 8.156 second response time [01:40:01] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.85, 9.64, 9.48 [01:41:22] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 11.58, 9.76, 9.28 [01:42:01] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.21, 9.65, 9.52 [01:42:10] PROBLEM - cp31 Stunnel HTTP for mw112 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:42:12] PROBLEM - cp20 Stunnel HTTP for mw112 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:42:27] PROBLEM - cp21 Stunnel HTTP for mw112 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:42:30] PROBLEM - mw112 MediaWiki Rendering on mw112 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:42:33] PROBLEM - cp30 Stunnel HTTP for mw112 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:43:22] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 8.14, 8.80, 8.98 [01:44:16] RECOVERY - cp20 Stunnel HTTP for mw112 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 14556 bytes in 9.077 second response time [01:44:17] RECOVERY - cp31 Stunnel HTTP for mw112 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 14562 bytes in 9.169 second response time [01:44:32] RECOVERY - cp21 Stunnel HTTP for mw112 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 14556 bytes in 7.534 second response time [01:44:34] RECOVERY - mw112 MediaWiki Rendering on mw112 is OK: HTTP OK: HTTP/1.1 200 OK - 22220 bytes in 8.042 second response time [01:44:37] RECOVERY - cp30 Stunnel HTTP for mw112 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 14556 bytes in 7.182 second response time [01:45:22] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 11.34, 9.66, 9.26 [01:45:50] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 11.42, 9.48, 9.28 [01:46:01] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.60, 10.08, 9.71 [01:46:06] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.12, 7.73, 8.35 [01:47:22] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.15, 9.38, 9.20 [01:47:50] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.64, 9.65, 9.38 [01:48:01] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.96, 9.97, 9.71 [01:50:13] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.71, 3.80, 2.76 [01:51:22] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.59, 9.54, 9.27 [01:52:13] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 1.96, 3.11, 2.63 [01:52:19] RECOVERY - dnd.bellinrattin.it - reverse DNS on sslhost is OK: SSL OK - dnd.bellinrattin.it reverse DNS resolves to cp21.miraheze.org - CNAME OK [01:54:01] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 11.29, 9.97, 9.69 [01:55:22] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.74, 9.40, 9.27 [01:56:01] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.36, 9.16, 9.42 [01:56:43] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 11.02, 9.47, 8.82 [01:57:22] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.16, 9.88, 9.47 [01:59:22] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.01, 9.20, 9.25 [02:00:31] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 6.77, 8.89, 8.81 [02:03:22] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.48, 9.30, 9.22 [02:03:50] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 11.36, 9.44, 9.12 [02:04:01] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.52, 9.31, 9.29 [02:04:20] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.12, 9.80, 9.16 [02:04:55] PROBLEM - diamowiki.ga - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 155, in main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 123, in main rdns_hostname = get_reverse_dnshostname(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 108, in get_reverse_dnshostname resolved_ip_addr = str(dns_resolver.resolve(hostn [02:04:55] AA')[0]) File "/usr/lib/python3/dist-packages/dns/resolver.py", line 1043, in resolve timeout = self._compute_timeout(start, lifetime) File "/usr/lib/python3/dist-packages/dns/resolver.py", line 950, in _compute_timeout raise Timeout(timeout=duration)dns.exception.Timeout: The DNS operation timed out after 5.406909942626953 seconds [02:05:22] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 7.26, 8.43, 8.91 [02:05:38] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 10.17, 9.16, 8.41 [02:05:50] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.36, 9.34, 9.13 [02:06:01] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.79, 9.14, 9.23 [02:06:14] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.26, 9.58, 9.19 [02:07:32] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.12, 9.02, 8.44 [02:08:01] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.24, 9.19, 9.21 [02:08:13] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.66, 3.15, 2.84 [02:09:50] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.30, 9.62, 9.28 [02:10:01] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.25, 8.71, 9.06 [02:10:13] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.76, 3.04, 2.84 [02:11:30] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 7.74, 8.35, 8.31 [02:12:38] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.62, 3.76, 3.26 [02:13:50] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.12, 9.91, 9.52 [02:14:01] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.09, 9.00, 9.06 [02:15:30] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 8.64, 8.51, 8.38 [02:16:01] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.75, 8.75, 8.96 [02:16:28] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.97, 2.94, 1.77 [02:16:33] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.00, 3.71, 3.37 [02:17:22] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.14, 9.66, 9.33 [02:18:06] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.16, 8.98, 8.97 [02:19:22] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.92, 9.42, 9.26 [02:20:06] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.44, 8.84, 8.93 [02:20:28] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 0.85, 1.73, 1.53 [02:20:28] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.60, 3.17, 3.23 [02:21:30] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 7.68, 8.30, 8.39 [02:21:50] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.50, 7.70, 8.49 [02:22:06] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.67, 9.70, 9.24 [02:22:28] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.15, 1.62, 1.52 [02:27:22] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 11.45, 9.97, 9.48 [02:30:06] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.00, 9.49, 9.40 [02:31:22] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.65, 9.97, 9.61 [02:36:01] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.43, 9.21, 8.91 [02:37:50] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.30, 8.14, 8.05 [02:38:01] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.90, 8.93, 8.83 [02:38:13] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 8.97, 8.44, 8.32 [02:39:22] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.57, 9.73, 9.49 [02:39:50] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.71, 9.14, 8.43 [02:40:07] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 6.14, 7.64, 8.05 [02:41:22] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.86, 9.83, 9.56 [02:41:22] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.80, 3.40, 3.06 [02:41:58] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.05, 3.48, 3.29 [02:42:06] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.31, 9.77, 9.47 [02:43:17] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.18, 2.88, 2.90 [02:43:22] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.66, 10.19, 9.73 [02:43:55] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 3.27, 3.33, 3.25 [02:43:55] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 11.30, 9.17, 8.55 [02:44:06] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.27, 9.29, 9.34 [02:45:50] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.24, 9.16, 8.62 [02:45:50] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.05, 9.85, 9.13 [02:46:01] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.99, 9.76, 9.23 [02:47:22] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.26, 10.00, 9.77 [02:48:01] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.04, 9.50, 9.21 [02:49:45] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.21, 3.72, 3.41 [02:49:53] PROBLEM - cp20 Stunnel HTTP for mw112 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [02:49:56] PROBLEM - mw112 MediaWiki Rendering on mw112 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [02:50:03] PROBLEM - cp30 Stunnel HTTP for mw112 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [02:50:16] PROBLEM - cp21 Stunnel HTTP for mw112 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [02:50:36] PROBLEM - cp31 Stunnel HTTP for mw112 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [02:51:32] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 7.63, 8.17, 8.34 [02:51:43] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.50, 3.39, 3.33 [02:52:09] RECOVERY - cp30 Stunnel HTTP for mw112 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 14548 bytes in 6.022 second response time [02:52:19] RECOVERY - cp21 Stunnel HTTP for mw112 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 14556 bytes in 4.796 second response time [02:52:40] RECOVERY - cp31 Stunnel HTTP for mw112 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 14562 bytes in 6.524 second response time [02:53:54] RECOVERY - cp20 Stunnel HTTP for mw112 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 14556 bytes in 0.019 second response time [02:53:59] RECOVERY - mw112 MediaWiki Rendering on mw112 is OK: HTTP OK: HTTP/1.1 200 OK - 22220 bytes in 1.070 second response time [02:59:58] PROBLEM - wiki.chippyapps.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.chippyapps.com could not be found [03:02:01] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 11.06, 9.45, 9.07 [03:02:06] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 6.35, 7.65, 8.37 [03:02:07] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.07, 8.69, 8.48 [03:03:50] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 11.00, 9.35, 9.09 [03:04:01] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 7.88, 8.33, 8.37 [03:04:54] PROBLEM - diamowiki.ga - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - diamowiki.ga All nameservers failed to answer the query. [03:06:06] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.67, 9.57, 9.02 [03:07:50] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.13, 8.95, 9.01 [03:08:06] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.03, 9.11, 8.90 [03:09:22] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 11.38, 9.20, 8.97 [03:10:36] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [03:11:50] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.23, 9.77, 9.35 [03:13:32] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.06, 8.67, 8.43 [03:13:35] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [03:13:50] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.35, 9.25, 9.22 [03:14:01] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.05, 9.84, 9.73 [03:15:22] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 8.75, 9.96, 9.55 [03:15:30] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 5.45, 7.60, 8.07 [03:16:01] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 11.03, 10.12, 9.83 [03:16:06] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 6.31, 7.87, 8.45 [03:16:30] RECOVERY - db111 APT on db111 is OK: APT OK: 9 packages available for upgrade (0 critical updates). [03:18:04] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.43, 9.49, 9.64 [03:19:40] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.04, 1.48, 1.13 [03:21:37] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.09, 1.28, 1.09 [03:22:06] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.65, 8.94, 8.64 [03:23:07] PROBLEM - db111 APT on db111 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [03:24:06] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.03, 8.71, 8.60 [03:25:22] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.36, 9.71, 9.51 [03:28:06] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.20, 8.96, 8.71 [03:30:06] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.52, 8.69, 8.63 [03:31:22] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 8.73, 9.35, 9.40 [03:31:50] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.70, 9.35, 9.03 [03:32:06] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 11.13, 9.64, 8.98 [03:32:13] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.64, 8.56, 8.13 [03:33:22] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.65, 9.81, 9.56 [03:33:50] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.56, 9.05, 8.97 [03:33:52] RECOVERY - db111 APT on db111 is OK: APT OK: 9 packages available for upgrade (0 critical updates). [03:34:06] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.54, 9.48, 9.01 [03:34:07] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 7.11, 7.87, 7.91 [03:34:55] PROBLEM - diamowiki.ga - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 155, in main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 123, in main rdns_hostname = get_reverse_dnshostname(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 108, in get_reverse_dnshostname resolved_ip_addr = str(dns_resolver.resolve(hostn [03:34:55] AA')[0]) File "/usr/lib/python3/dist-packages/dns/resolver.py", line 1043, in resolve timeout = self._compute_timeout(start, lifetime) File "/usr/lib/python3/dist-packages/dns/resolver.py", line 950, in _compute_timeout raise Timeout(timeout=duration)dns.exception.Timeout: The DNS operation timed out after 5.406429767608643 seconds [03:38:01] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.29, 9.08, 8.90 [03:40:01] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.12, 9.12, 8.94 [03:42:01] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.02, 9.34, 9.04 [03:42:32] PROBLEM - db111 APT on db111 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [03:43:22] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.11, 9.76, 9.60 [03:44:38] RECOVERY - db111 APT on db111 is OK: APT OK: 9 packages available for upgrade (0 critical updates). [03:45:22] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.98, 9.83, 9.62 [03:46:01] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.67, 8.69, 8.87 [03:47:22] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.11, 9.29, 9.44 [03:49:50] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.41, 7.99, 8.39 [03:50:06] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 8.20, 8.11, 8.50 [03:51:30] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.39, 8.28, 7.85 [03:54:01] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 6.62, 7.87, 8.43 [03:58:34] [02MirahezeMagic] 07MacFan4000 opened pull request 03#318: Requests for Adoption -> Requests for reopening wikis - 13https://github.com/miraheze/MirahezeMagic/pull/318 [03:59:22] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.12, 8.86, 8.87 [04:00:01] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.88, 8.85, 8.65 [04:01:22] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 8.15, 8.55, 8.75 [04:01:30] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 11.35, 9.64, 8.66 [04:01:58] miraheze/MirahezeMagic - MacFan4000 the build has errored. [04:02:01] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.44, 8.99, 8.69 [04:03:30] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.30, 9.44, 8.71 [04:04:01] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.69, 8.43, 8.52 [04:06:01] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 6.71, 8.01, 8.37 [04:06:59] I don’t think my change caused the build failure [04:09:22] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 7.17, 7.91, 8.42 [04:09:30] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 6.76, 7.95, 8.32 [04:13:22] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.15, 9.77, 9.07 [04:13:30] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.50, 8.61, 8.50 [04:15:22] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 8.28, 9.28, 8.98 [04:19:30] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 11.40, 9.87, 9.06 [04:21:31] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 7.25, 8.83, 8.78 [04:28:43] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.97, 8.63, 7.96 [04:30:38] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 11.87, 9.79, 8.45 [04:31:22] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.15, 9.40, 9.08 [04:31:30] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 11.87, 9.57, 9.03 [04:32:01] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.57, 9.20, 8.65 [04:32:34] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.56, 9.47, 8.48 [04:33:30] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 8.96, 9.52, 9.10 [04:34:01] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.91, 9.72, 8.90 [04:34:51] PROBLEM - diamowiki.ga - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - diamowiki.ga All nameservers failed to answer the query. [04:35:22] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.93, 9.95, 9.41 [04:36:01] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.55, 9.53, 8.95 [04:38:01] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.04, 9.55, 9.01 [04:40:17] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.76, 9.47, 8.83 [04:41:22] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 11.14, 10.36, 9.67 [04:43:22] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 8.04, 9.55, 9.47 [04:43:28] PROBLEM - db111 Current Load on db111 is WARNING: WARNING - load average: 2.92, 3.72, 7.86 [04:44:01] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.42, 9.61, 9.30 [04:44:08] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.51, 9.63, 9.09 [04:47:28] RECOVERY - db111 Current Load on db111 is OK: OK - load average: 2.65, 3.24, 6.72 [04:47:30] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 6.65, 7.74, 8.40 [04:50:01] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 11.22, 9.76, 9.42 [04:53:30] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 10.01, 8.84, 8.64 [04:53:35] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [04:54:01] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.12, 8.84, 9.18 [04:54:33] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 6.57, 8.26, 9.56 [04:55:22] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.46, 9.13, 9.06 [04:55:30] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 8.53, 8.95, 8.72 [04:57:22] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 8.17, 8.67, 8.90 [04:57:50] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.27, 9.64, 9.20 [04:58:01] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.18, 9.37, 9.30 [04:59:50] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 6.79, 8.65, 8.89 [05:00:01] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.08, 8.76, 9.11 [05:00:36] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [05:01:30] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 10.44, 9.41, 8.90 [05:03:30] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 7.68, 8.73, 8.72 [05:03:50] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.15, 9.32, 9.09 [05:04:01] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.71, 9.36, 9.23 [05:04:33] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 5.79, 7.23, 8.50 [05:05:50] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.08, 9.11, 9.03 [05:06:01] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.37, 8.99, 9.11 [05:07:30] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 7.71, 8.19, 8.50 [05:08:33] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.28, 8.14, 8.60 [05:10:33] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.38, 7.77, 8.40 [05:10:36] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [05:14:01] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 6.77, 7.44, 8.29 [05:14:35] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [05:19:22] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 12.65, 10.26, 9.33 [05:19:35] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [05:20:01] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 11.14, 8.88, 8.55 [05:20:33] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.85, 9.21, 8.55 [05:21:50] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.32, 7.86, 8.39 [05:22:01] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.05, 8.94, 8.62 [05:22:33] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.56, 9.14, 8.60 [05:22:35] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [05:23:22] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 6.92, 9.12, 9.13 [05:26:01] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.79, 9.81, 9.03 [05:27:22] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.25, 8.92, 8.99 [05:28:01] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.56, 9.24, 8.91 [05:28:33] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.16, 7.98, 8.29 [05:29:22] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.20, 9.06, 9.04 [05:30:01] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 5.83, 7.97, 8.48 [05:32:35] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [05:35:22] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 5.94, 7.33, 8.28 [05:36:01] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.70, 8.06, 8.29 [05:38:01] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.00, 7.64, 8.11 [05:50:35] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [05:53:22] PROBLEM - mwtask111 Current Load on mwtask111 is WARNING: WARNING - load average: 1.99, 1.59, 0.82 [05:55:07] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 8.76, 8.42, 8.27 [05:55:22] RECOVERY - mwtask111 Current Load on mwtask111 is OK: OK - load average: 1.32, 1.46, 0.87 [05:56:39] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.13, 8.41, 7.77 [05:58:34] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 6.20, 7.67, 7.58 [06:00:35] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [06:01:01] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 8.35, 8.40, 8.34 [06:01:33] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 10.02, 9.11, 8.32 [06:03:30] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 7.57, 8.61, 8.25 [06:03:35] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [06:05:30] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 7.29, 8.02, 8.06 [06:12:43] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.22, 9.31, 8.05 [06:13:35] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [06:22:21] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 5.70, 7.60, 7.84 [06:24:03] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.39, 9.00, 8.23 [06:26:00] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.41, 9.21, 8.37 [06:27:56] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.11, 8.37, 8.16 [06:31:49] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 8.82, 7.99, 7.54 [06:32:06] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.19, 8.66, 7.75 [06:33:00] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.17, 8.66, 8.27 [06:33:43] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 5.90, 7.19, 7.30 [06:34:55] PROBLEM - diamowiki.ga - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 155, in main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 123, in main rdns_hostname = get_reverse_dnshostname(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 108, in get_reverse_dnshostname resolved_ip_addr = str(dns_resolver.resolve(hostn [06:34:55] AA')[0]) File "/usr/lib/python3/dist-packages/dns/resolver.py", line 1043, in resolve timeout = self._compute_timeout(start, lifetime) File "/usr/lib/python3/dist-packages/dns/resolver.py", line 950, in _compute_timeout raise Timeout(timeout=duration)dns.exception.Timeout: The DNS operation timed out after 5.404500961303711 seconds [06:36:52] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.99, 8.49, 8.32 [06:40:06] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.68, 8.47, 8.10 [06:42:40] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.47, 8.85, 8.50 [06:44:36] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.39, 8.32, 8.35 [06:45:23] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.53, 8.10, 7.86 [06:47:17] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.08, 7.78, 7.76 [06:47:35] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [06:48:01] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.61, 9.08, 8.47 [06:49:59] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 6.77, 8.39, 8.30 [06:55:15] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.10, 8.71, 8.43 [06:57:10] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.97, 8.40, 8.35 [07:01:38] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 10.67, 8.68, 7.72 [07:03:32] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 7.72, 8.01, 7.57 [07:03:39] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 8.31, 8.52, 8.33 [07:04:51] PROBLEM - diamowiki.ga - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - diamowiki.ga All nameservers failed to answer the query. [07:05:37] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 7.60, 8.31, 8.29 [07:07:35] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [07:09:30] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.56, 8.67, 7.94 [07:11:29] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 8.74, 8.49, 8.31 [07:11:30] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 8.30, 8.46, 7.95 [07:15:25] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 7.84, 8.28, 8.25 [07:15:35] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [07:19:22] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.24, 9.34, 8.69 [07:20:35] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [07:20:50] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.58, 9.22, 8.44 [07:21:22] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.81, 9.42, 8.79 [07:21:28] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.28, 9.15, 7.96 [07:21:30] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.22, 8.69, 8.22 [07:22:45] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.79, 9.28, 8.55 [07:23:25] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.56, 8.74, 7.95 [07:25:35] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [07:27:18] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.16, 8.70, 8.04 [07:29:14] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.00, 8.71, 8.15 [07:29:22] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 8.24, 8.27, 8.44 [07:31:11] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 6.40, 7.87, 7.90 [07:31:30] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 11.18, 9.85, 8.93 [07:33:22] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.12, 9.46, 8.94 [07:33:30] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.35, 9.71, 8.99 [07:34:12] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.76, 9.49, 8.89 [07:36:06] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.54, 8.71, 8.68 [07:37:30] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 6.52, 7.83, 8.37 [07:39:22] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 6.89, 7.84, 8.34 [07:40:01] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.49, 8.17, 8.48 [07:40:35] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [07:41:50] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.43, 8.25, 7.62 [07:43:50] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 6.83, 7.62, 7.47 [07:45:07] [02miraheze/MirahezeMagic] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/MirahezeMagic/compare/09e2eddaf2d5...f1b085524dc4 [07:45:09] [02miraheze/MirahezeMagic] 07Reception123 03f1b0855 - slightly change wording for recaptcha errors [07:46:35] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [07:48:34] miraheze/MirahezeMagic - Reception123 the build has errored. [07:49:29] how can that error I just changed the words? [07:51:35] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [07:58:26] Reception123: not you [07:58:33] File an unbreak task though [07:58:56] unbreak? [07:59:20] Reception123: yes a CI failure for a deployed branch is UBN [07:59:47] It should block merges [08:02:01] We could make it High but I don't think it's UBN urgent [08:02:50] Reception123: in theory it blocks merges [08:02:56] so it should be [08:03:03] It's just that no one is around [08:03:12] well yeah, but merging from MM isn't really urgent is it? [08:03:35] It should be standard policy [08:03:46] How do we know a security issue won't come [08:03:52] And then we have no visibility [08:04:07] taavi: do you know of anything that might have caused it [08:04:36] A core change Jan 31 - Feb 3 to DB transactions [08:04:55] PROBLEM - diamowiki.ga - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 155, in main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 123, in main rdns_hostname = get_reverse_dnshostname(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 108, in get_reverse_dnshostname resolved_ip_addr = str(dns_resolver.resolve(hostn [08:04:55] AA')[0]) File "/usr/lib/python3/dist-packages/dns/resolver.py", line 1043, in resolve timeout = self._compute_timeout(start, lifetime) File "/usr/lib/python3/dist-packages/dns/resolver.py", line 950, in _compute_timeout raise Timeout(timeout=duration)dns.exception.Timeout: The DNS operation timed out after 5.40509819984436 seconds [08:23:59] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.83, 8.49, 7.77 [08:29:50] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.08, 8.00, 7.83 [08:34:39] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.06, 8.03, 7.55 [08:36:34] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.51, 7.75, 7.50 [08:47:50] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.29, 8.97, 8.12 [08:49:48] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 6.06, 8.09, 7.92 [09:04:53] PROBLEM - diamowiki.ga - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - diamowiki.ga All nameservers failed to answer the query. [09:09:35] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [09:12:22] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.21, 8.59, 8.04 [09:14:20] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 5.80, 7.57, 7.74 [09:14:35] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [09:30:54] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 155, in main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 136, in main records = check_records(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 86, in check_records cname = str(dns_resolver.resolve(hostname, 'CNAME')[0]) File "/usr/li [09:30:54] 3/dist-packages/dns/resolver.py", line 1040, in resolve (nameserver, port, tcp, backoff) = resolution.next_nameserver() File "/usr/lib/python3/dist-packages/dns/resolver.py", line 598, in next_nameserver raise NoNameservers(request=self.request, errors=self.errors)dns.resolver.NoNameservers: All nameservers failed to answer the query dnd.bellinrattin.it. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [09:34:55] PROBLEM - diamowiki.ga - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 155, in main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 123, in main rdns_hostname = get_reverse_dnshostname(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 108, in get_reverse_dnshostname resolved_ip_addr = str(dns_resolver.resolve(hostn [09:34:55] AA')[0]) File "/usr/lib/python3/dist-packages/dns/resolver.py", line 1043, in resolve timeout = self._compute_timeout(start, lifetime) File "/usr/lib/python3/dist-packages/dns/resolver.py", line 950, in _compute_timeout raise Timeout(timeout=duration)dns.exception.Timeout: The DNS operation timed out after 5.407446384429932 seconds [10:00:53] RECOVERY - dnd.bellinrattin.it - reverse DNS on sslhost is OK: SSL OK - dnd.bellinrattin.it reverse DNS resolves to cp21.miraheze.org - CNAME OK [10:21:18] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 4.09, 2.55, 1.63 [10:27:18] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 0.66, 1.72, 1.58 [10:29:18] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 0.55, 1.36, 1.46 [10:34:54] PROBLEM - diamowiki.ga - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - diamowiki.ga All nameservers failed to answer the query. [11:04:55] PROBLEM - diamowiki.ga - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 155, in main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 123, in main rdns_hostname = get_reverse_dnshostname(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 108, in get_reverse_dnshostname resolved_ip_addr = str(dns_resolver.resolve(hostn [11:04:55] AA')[0]) File "/usr/lib/python3/dist-packages/dns/resolver.py", line 1043, in resolve timeout = self._compute_timeout(start, lifetime) File "/usr/lib/python3/dist-packages/dns/resolver.py", line 950, in _compute_timeout raise Timeout(timeout=duration)dns.exception.Timeout: The DNS operation timed out after 5.405545949935913 seconds [11:50:36] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.76, 1.88, 1.03 [11:52:33] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.38, 1.31, 0.92 [11:53:35] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [11:58:35] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [12:08:13] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.28, 3.21, 2.50 [12:12:13] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.43, 3.53, 2.80 [12:14:13] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 3.02, 3.39, 2.84 [12:22:57] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.49, 3.60, 3.10 [12:24:52] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.35, 3.24, 3.03 [12:42:35] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [12:47:35] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [12:50:03] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.00, 3.85, 2.91 [12:52:01] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.14, 3.44, 2.87 [12:53:35] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [12:53:58] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.91, 3.36, 2.92 [13:03:35] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [13:05:50] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.66, 8.83, 7.62 [13:07:39] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - dnd.bellinrattin.it All nameservers failed to answer the query. [13:07:50] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 6.23, 8.06, 7.50 [13:12:35] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [13:15:50] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.99, 8.88, 8.06 [13:17:35] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [13:21:50] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 6.99, 8.18, 8.06 [13:31:36] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [13:34:13] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.44, 8.49, 7.83 [13:36:11] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.22, 8.99, 8.08 [13:36:38] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.38, 8.83, 8.34 [13:38:09] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 7.21, 8.27, 7.93 [13:38:34] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 6.46, 7.72, 7.98 [13:49:52] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.85, 9.27, 8.43 [13:50:33] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.91, 8.86, 7.80 [13:51:36] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [13:51:50] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 8.46, 9.06, 8.46 [13:52:33] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 6.97, 8.19, 7.69 [13:54:03] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.79, 9.42, 8.54 [13:54:58] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.32, 3.70, 3.29 [13:55:05] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.36, 8.99, 8.13 [13:55:59] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 7.31, 8.79, 8.42 [13:56:58] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.41, 3.29, 3.19 [13:56:59] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 6.88, 8.05, 7.88 [13:57:44] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 6.58, 8.11, 8.30 [13:57:55] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.28, 8.30, 8.29 [14:02:53] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.82, 2.14, 1.59 [14:03:30] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 8.77, 8.30, 7.66 [14:04:38] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 11.25, 9.76, 8.66 [14:04:47] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.07, 1.67, 1.48 [14:05:30] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 8.20, 8.24, 7.72 [14:05:35] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [14:06:33] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.66, 8.81, 8.44 [14:07:37] RECOVERY - dnd.bellinrattin.it - reverse DNS on sslhost is OK: SSL OK - dnd.bellinrattin.it reverse DNS resolves to cp20.miraheze.org - CNAME OK [14:10:35] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [14:13:36] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [14:14:22] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 11.62, 9.82, 8.90 [14:17:50] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.67, 9.39, 8.44 [14:18:01] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 11.45, 10.04, 9.10 [14:19:28] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.27, 8.65, 7.81 [14:19:50] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.72, 8.98, 8.40 [14:20:01] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.24, 9.23, 8.88 [14:21:25] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.50, 8.25, 7.78 [14:22:14] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 8.79, 9.95, 9.43 [14:23:50] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.44, 8.41, 8.30 [14:24:01] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.54, 9.66, 9.11 [14:26:01] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.59, 9.59, 9.15 [14:26:13] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.18, 8.45, 7.90 [14:28:07] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 8.29, 8.47, 7.98 [14:28:37] [02miraheze/mw-config] 07dependabot[bot] pushed 031 commit to 03dependabot/composer/php-parallel-lint/php-console-highlighter-1.0.0 [+0/-0/±1] 13https://github.com/miraheze/mw-config/commit/e25dd79d85a6 [14:28:39] [02miraheze/mw-config] 07dependabot[bot] 03e25dd79 - Update php-parallel-lint/php-console-highlighter requirement [14:28:40] [02mw-config] 07dependabot[bot] opened pull request 03#4476: Update php-parallel-lint/php-console-highlighter requirement from 0.5.0 to 1.0.0 - 13https://github.com/miraheze/mw-config/pull/4476 [14:28:42] [02mw-config] 07dependabot[bot] created branch 03dependabot/composer/php-parallel-lint/php-console-highlighter-1.0.0 - 13https://github.com/miraheze/mw-config [14:28:43] [02mw-config] 07dependabot[bot] labeled pull request 03#4476: Update php-parallel-lint/php-console-highlighter requirement from 0.5.0 to 1.0.0 - 13https://github.com/miraheze/mw-config/pull/4476 [14:28:44] [02mw-config] 07dependabot[bot] labeled pull request 03#4476: Update php-parallel-lint/php-console-highlighter requirement from 0.5.0 to 1.0.0 - 13https://github.com/miraheze/mw-config/pull/4476 [14:29:47] miraheze/mw-config - dependabot[bot] the build passed. [14:31:55] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.07, 9.12, 8.37 [14:34:01] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.28, 9.95, 9.33 [14:34:01] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 11.29, 9.30, 9.15 [14:35:44] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 10.36, 9.53, 8.67 [14:35:59] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 8.25, 8.78, 8.98 [14:37:38] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 7.27, 8.75, 8.50 [14:38:34] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.60, 9.13, 8.61 [14:39:54] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 11.19, 9.49, 9.19 [14:40:30] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.38, 9.22, 8.72 [14:45:30] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 7.38, 8.32, 8.46 [14:45:48] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 7.72, 9.58, 9.45 [14:48:01] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.20, 9.37, 9.58 [14:48:36] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [14:50:08] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 11.04, 9.93, 9.26 [14:52:04] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 7.74, 9.18, 9.07 [14:53:36] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [14:53:39] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 4.80, 7.06, 8.42 [14:57:33] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 8.84, 8.14, 8.56 [14:59:31] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 7.74, 8.03, 8.47 [15:00:01] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 11.52, 8.76, 8.86 [15:01:30] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 8.50, 8.70, 8.53 [15:01:50] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.84, 9.42, 9.03 [15:03:25] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.12, 8.98, 8.78 [15:04:54] PROBLEM - diamowiki.ga - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - diamowiki.ga All nameservers failed to answer the query. [15:07:22] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.27, 8.99, 8.79 [15:08:01] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.08, 9.85, 9.55 [15:09:50] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.84, 9.91, 9.48 [15:10:01] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.36, 9.88, 9.59 [15:11:22] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.36, 9.38, 8.98 [15:11:30] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 11.03, 9.40, 8.94 [15:12:01] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.79, 9.13, 9.35 [15:12:15] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.98, 3.66, 3.22 [15:13:22] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.57, 9.89, 9.23 [15:13:30] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.76, 9.31, 8.96 [15:13:50] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.82, 10.74, 9.87 [15:14:06] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.90, 8.62, 8.01 [15:15:22] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.25, 9.80, 9.29 [15:16:01] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.67, 9.65, 9.49 [15:16:11] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.23, 3.52, 3.28 [15:18:01] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.66, 9.83, 9.59 [15:18:06] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 8.44, 8.45, 8.06 [15:18:08] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.53, 3.18, 3.18 [15:22:01] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 11.22, 9.84, 9.57 [15:23:50] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 6.87, 9.12, 9.66 [15:24:01] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.09, 9.29, 9.39 [15:27:50] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.81, 9.78, 9.76 [15:28:37] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [15:29:50] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.58, 9.71, 9.74 [15:32:46] [02miraheze/GlobalNewFiles] 07dependabot[bot] pushed 031 commit to 03dependabot/composer/php-parallel-lint/php-console-highlighter-1.0.0 [+0/-0/±1] 13https://github.com/miraheze/GlobalNewFiles/commit/eaf6773ca794 [15:32:47] [02miraheze/GlobalNewFiles] 07dependabot[bot] 03eaf6773 - Update php-parallel-lint/php-console-highlighter requirement [15:32:49] [02GlobalNewFiles] 07dependabot[bot] created branch 03dependabot/composer/php-parallel-lint/php-console-highlighter-1.0.0 - 13https://github.com/miraheze/GlobalNewFiles [15:32:50] [02GlobalNewFiles] 07dependabot[bot] opened pull request 03#30: Update php-parallel-lint/php-console-highlighter requirement from 0.5.0 to 1.0.0 - 13https://github.com/miraheze/GlobalNewFiles/pull/30 [15:32:52] [02GlobalNewFiles] 07dependabot[bot] labeled pull request 03#30: Update php-parallel-lint/php-console-highlighter requirement from 0.5.0 to 1.0.0 - 13https://github.com/miraheze/GlobalNewFiles/pull/30 [15:32:53] [02GlobalNewFiles] 07dependabot[bot] labeled pull request 03#30: Update php-parallel-lint/php-console-highlighter requirement from 0.5.0 to 1.0.0 - 13https://github.com/miraheze/GlobalNewFiles/pull/30 [15:34:55] PROBLEM - diamowiki.ga - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 155, in main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 123, in main rdns_hostname = get_reverse_dnshostname(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 108, in get_reverse_dnshostname resolved_ip_addr = str(dns_resolver.resolve(hostn [15:34:55] AA')[0]) File "/usr/lib/python3/dist-packages/dns/resolver.py", line 1043, in resolve timeout = self._compute_timeout(start, lifetime) File "/usr/lib/python3/dist-packages/dns/resolver.py", line 950, in _compute_timeout raise Timeout(timeout=duration)dns.exception.Timeout: The DNS operation timed out after 5.406421184539795 seconds [15:35:22] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 11.05, 9.37, 8.98 [15:35:30] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 7.33, 8.08, 8.49 [15:36:35] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [15:37:22] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 7.73, 8.52, 8.70 [15:37:31] miraheze/GlobalNewFiles - dependabot[bot] the build passed. [15:39:27] [02GlobalNewFiles] 07RhinosF1 closed pull request 03#30: Update php-parallel-lint/php-console-highlighter requirement from 0.5.0 to 1.0.0 - 13https://github.com/miraheze/GlobalNewFiles/pull/30 [15:39:29] [02miraheze/GlobalNewFiles] 07RhinosF1 pushed 032 commits to 03master [+0/-0/±2] 13https://github.com/miraheze/GlobalNewFiles/compare/d34bbc45ef31...f3f317914697 [15:39:30] [02miraheze/GlobalNewFiles] 07RhinosF1 03f3f3179 - Merge pull request #30 from miraheze/dependabot/composer/php-parallel-lint/php-console-highlighter-1.0.0 [15:39:32] [02GlobalNewFiles] 07RhinosF1 deleted branch 03dependabot/composer/php-parallel-lint/php-console-highlighter-1.0.0 - 13https://github.com/miraheze/GlobalNewFiles [15:39:33] [02miraheze/GlobalNewFiles] 07RhinosF1 deleted branch 03dependabot/composer/php-parallel-lint/php-console-highlighter-1.0.0 [15:40:01] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 6.67, 7.44, 8.25 [15:41:35] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [15:41:50] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.99, 9.18, 8.99 [15:43:22] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.41, 8.80, 8.71 [15:43:50] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 7.07, 8.37, 8.73 [15:45:50] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 6.40, 7.69, 8.43 [15:46:01] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.84, 7.84, 8.07 [15:46:30] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.56, 3.44, 2.88 [15:46:36] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [15:47:02] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.18, 3.46, 3.12 [15:47:22] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.78, 9.41, 8.99 [15:47:29] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.92, 4.01, 3.38 [15:48:01] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 4.88, 6.88, 7.70 [15:48:27] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.94, 3.34, 2.91 [15:48:57] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.53, 3.19, 3.06 [15:49:26] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.23, 3.29, 3.19 [15:51:35] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [15:52:01] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.45, 8.18, 8.03 [15:55:00] miraheze/GlobalNewFiles - RhinosF1 the build passed. [15:59:22] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.99, 9.72, 9.16 [16:00:01] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.37, 8.24, 8.21 [16:00:10] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.93, 3.29, 2.89 [16:01:09] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.79, 3.13, 3.00 [16:01:22] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 7.71, 8.78, 8.88 [16:01:30] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.18, 8.55, 8.05 [16:02:07] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.72, 3.01, 2.84 [16:02:20] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.15, 3.79, 3.32 [16:02:35] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [16:03:07] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 3.01, 3.05, 2.98 [16:03:30] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 10.91, 9.28, 8.37 [16:04:14] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.80, 3.44, 3.25 [16:04:54] PROBLEM - diamowiki.ga - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - diamowiki.ga All nameservers failed to answer the query. [16:06:06] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.36, 8.32, 7.56 [16:07:30] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.84, 9.63, 8.75 [16:08:06] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 6.20, 7.64, 7.41 [16:10:01] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.26, 9.39, 8.71 [16:11:22] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.02, 9.40, 9.00 [16:11:30] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 10.27, 9.81, 9.02 [16:12:01] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.24, 8.64, 8.53 [16:12:13] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.60, 3.34, 3.34 [16:12:35] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [16:13:22] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 7.10, 8.43, 8.69 [16:13:30] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.66, 9.65, 9.05 [16:14:01] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 5.75, 7.66, 8.18 [16:16:13] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 6.02, 4.21, 3.66 [16:17:30] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 10.12, 9.98, 9.31 [16:18:13] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.08, 3.74, 3.55 [16:18:35] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [16:19:30] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.35, 9.65, 9.27 [16:20:13] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.15, 3.21, 3.38 [16:21:30] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 10.13, 9.79, 9.36 [16:22:19] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.79, 8.81, 8.06 [16:23:22] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 5.88, 7.58, 8.24 [16:23:30] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 8.44, 9.46, 9.31 [16:23:35] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [16:24:15] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.91, 8.49, 8.03 [16:29:22] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.04, 8.52, 8.37 [16:29:30] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 11.63, 9.78, 9.42 [16:29:50] [02miraheze/MatomoAnalytics] 07dependabot[bot] pushed 031 commit to 03dependabot/composer/php-parallel-lint/php-console-highlighter-1.0.0 [+0/-0/±1] 13https://github.com/miraheze/MatomoAnalytics/commit/9eb870125ad5 [16:29:52] [02miraheze/MatomoAnalytics] 07dependabot[bot] 039eb8701 - Update php-parallel-lint/php-console-highlighter requirement [16:29:54] [02MatomoAnalytics] 07dependabot[bot] created branch 03dependabot/composer/php-parallel-lint/php-console-highlighter-1.0.0 - 13https://github.com/miraheze/MatomoAnalytics [16:29:55] [02MatomoAnalytics] 07dependabot[bot] opened pull request 03#72: Update php-parallel-lint/php-console-highlighter requirement from 0.5.0 to 1.0.0 - 13https://github.com/miraheze/MatomoAnalytics/pull/72 [16:29:56] [02MatomoAnalytics] 07dependabot[bot] labeled pull request 03#72: Update php-parallel-lint/php-console-highlighter requirement from 0.5.0 to 1.0.0 - 13https://github.com/miraheze/MatomoAnalytics/pull/72 [16:29:58] [02MatomoAnalytics] 07dependabot[bot] labeled pull request 03#72: Update php-parallel-lint/php-console-highlighter requirement from 0.5.0 to 1.0.0 - 13https://github.com/miraheze/MatomoAnalytics/pull/72 [16:31:22] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 8.27, 8.29, 8.30 [16:32:35] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [16:33:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.05, 8.86, 8.54 [16:33:57] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 11.00, 9.47, 8.57 [16:34:27] miraheze/MatomoAnalytics - dependabot[bot] the build passed. [16:34:55] PROBLEM - diamowiki.ga - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 155, in main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 123, in main rdns_hostname = get_reverse_dnshostname(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 108, in get_reverse_dnshostname resolved_ip_addr = str(dns_resolver.resolve(hostn [16:34:55] AA')[0]) File "/usr/lib/python3/dist-packages/dns/resolver.py", line 1043, in resolve timeout = self._compute_timeout(start, lifetime) File "/usr/lib/python3/dist-packages/dns/resolver.py", line 950, in _compute_timeout raise Timeout(timeout=duration)dns.exception.Timeout: The DNS operation timed out after 5.404698610305786 seconds [16:35:52] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.81, 9.22, 8.59 [16:38:05] [02MatomoAnalytics] 07RhinosF1 closed pull request 03#72: Update php-parallel-lint/php-console-highlighter requirement from 0.5.0 to 1.0.0 - 13https://github.com/miraheze/MatomoAnalytics/pull/72 [16:38:06] [02miraheze/MatomoAnalytics] 07RhinosF1 pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/MatomoAnalytics/compare/aa56920a72cd...6f44fd3dded0 [16:38:08] [02miraheze/MatomoAnalytics] 07dependabot[bot] 036f44fd3 - Update php-parallel-lint/php-console-highlighter requirement (#72) [16:38:10] [02miraheze/MatomoAnalytics] 07RhinosF1 deleted branch 03dependabot/composer/php-parallel-lint/php-console-highlighter-1.0.0 [16:38:11] [02MatomoAnalytics] 07RhinosF1 deleted branch 03dependabot/composer/php-parallel-lint/php-console-highlighter-1.0.0 - 13https://github.com/miraheze/MatomoAnalytics [16:39:50] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.94, 9.80, 8.94 [16:40:13] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.16, 8.79, 8.43 [16:40:59] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.67, 9.45, 8.94 [16:41:50] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.56, 9.91, 9.11 [16:42:11] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.58, 9.48, 8.76 [16:42:53] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 6.78, 8.44, 8.63 [16:43:20] miraheze/MatomoAnalytics - RhinosF1 the build passed. [16:45:30] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 7.06, 9.09, 9.56 [16:48:19] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.68, 3.16, 2.89 [16:48:58] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.42, 3.45, 2.80 [16:50:31] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.06, 8.89, 8.69 [16:50:58] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 3.16, 3.28, 2.82 [16:52:13] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 1.85, 2.72, 2.80 [16:52:26] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.32, 8.42, 8.55 [16:56:15] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.14, 8.07, 8.41 [16:57:35] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [16:57:54] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 6.06, 7.88, 8.40 [16:59:50] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.23, 8.64, 8.74 [17:00:35] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [17:01:30] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 11.83, 9.67, 9.29 [17:01:48] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.77, 9.16, 8.76 [17:01:50] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 7.65, 8.27, 8.60 [17:03:30] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 8.60, 9.09, 9.12 [17:03:46] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.51, 9.27, 8.85 [17:03:50] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.58, 7.79, 8.37 [17:08:51] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 11.63, 9.87, 8.90 [17:09:40] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.23, 8.89, 8.76 [17:10:35] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [17:10:45] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.10, 9.55, 8.92 [17:10:56] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 12.92, 9.12, 7.86 [17:11:37] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.77, 9.38, 8.97 [17:11:50] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.13, 9.22, 8.72 [17:13:36] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [17:13:50] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.49, 8.47, 8.50 [17:14:34] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.56, 9.79, 9.13 [17:14:49] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.02, 9.14, 8.22 [17:15:30] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 6.59, 7.66, 8.36 [17:16:29] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.68, 9.57, 9.12 [17:17:31] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.89, 9.92, 9.25 [17:17:50] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.37, 9.33, 8.81 [17:19:29] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 8.99, 9.54, 9.20 [17:19:30] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 8.82, 8.50, 8.57 [17:19:50] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.09, 8.78, 8.67 [17:20:38] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 6.20, 8.06, 8.06 [17:21:36] [02miraheze/ManageWiki] 07dependabot[bot] pushed 031 commit to 03dependabot/composer/php-parallel-lint/php-console-highlighter-1.0.0 [+0/-0/±1] 13https://github.com/miraheze/ManageWiki/commit/97316404d515 [17:21:37] [02miraheze/ManageWiki] 07dependabot[bot] 039731640 - Update php-parallel-lint/php-console-highlighter requirement [17:21:39] [02ManageWiki] 07dependabot[bot] created branch 03dependabot/composer/php-parallel-lint/php-console-highlighter-1.0.0 - 13https://github.com/miraheze/ManageWiki [17:21:40] [02ManageWiki] 07dependabot[bot] opened pull request 03#341: Update php-parallel-lint/php-console-highlighter requirement from 0.5.0 to 1.0.0 - 13https://github.com/miraheze/ManageWiki/pull/341 [17:21:42] [02ManageWiki] 07dependabot[bot] labeled pull request 03#341: Update php-parallel-lint/php-console-highlighter requirement from 0.5.0 to 1.0.0 - 13https://github.com/miraheze/ManageWiki/pull/341 [17:21:43] [02ManageWiki] 07dependabot[bot] labeled pull request 03#341: Update php-parallel-lint/php-console-highlighter requirement from 0.5.0 to 1.0.0 - 13https://github.com/miraheze/ManageWiki/pull/341 [17:21:50] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.98, 9.61, 8.98 [17:23:50] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.49, 9.52, 9.05 [17:24:07] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.35, 10.23, 9.54 [17:26:01] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.16, 9.32, 9.28 [17:27:30] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 7.27, 8.17, 8.50 [17:28:28] miraheze/ManageWiki - dependabot[bot] the build passed. [17:28:36] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [17:31:30] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.59, 9.11, 8.81 [17:31:50] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.36, 10.02, 9.22 [17:32:01] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.15, 9.90, 9.49 [17:33:22] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.63, 9.35, 9.19 [17:33:35] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [17:34:24] [02MirahezeMagic] 07MacFan4000 commented on pull request 03#318: Requests for Adoption -> Requests for reopening wikis - 13https://github.com/miraheze/MirahezeMagic/pull/318#issuecomment-1044889013 [17:35:22] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.89, 9.66, 9.34 [17:35:50] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.30, 9.72, 9.32 [17:36:22] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.56, 8.61, 7.94 [17:37:22] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.64, 9.94, 9.48 [17:37:30] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 10.69, 9.83, 9.18 [17:38:01] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.74, 10.00, 9.79 [17:38:16] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.02, 8.01, 7.79 [17:38:33] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.14, 8.66, 8.13 [17:39:22] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 8.58, 9.55, 9.40 [17:39:30] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 7.34, 9.11, 9.01 [17:40:33] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 5.87, 7.51, 7.77 [17:41:22] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.14, 9.78, 9.50 [17:42:01] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 11.02, 9.87, 9.72 [17:43:30] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 11.10, 9.90, 9.35 [17:44:33] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.32, 8.39, 8.06 [17:46:33] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.14, 8.96, 8.31 [17:47:22] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 7.75, 9.85, 9.79 [17:47:30] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.50, 9.95, 9.54 [17:50:33] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.83, 10.00, 8.92 [17:50:33] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.82, 1.46, 0.96 [17:51:22] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.35, 10.27, 9.97 [17:51:30] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 10.45, 10.09, 9.67 [17:52:33] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.75, 1.24, 0.94 [17:53:22] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 7.73, 9.22, 9.62 [17:53:30] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.77, 9.95, 9.67 [17:56:01] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 6.86, 9.03, 9.71 [17:57:30] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 11.52, 10.53, 9.94 [17:58:35] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [17:59:50] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.02, 10.07, 9.31 [18:00:01] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 11.37, 10.28, 10.05 [18:01:22] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 11.11, 9.89, 9.72 [18:01:50] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.88, 9.59, 9.24 [18:03:22] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 8.09, 9.29, 9.53 [18:04:01] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.33, 9.85, 9.97 [18:04:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.76, 8.45, 8.03 [18:04:33] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 6.67, 7.85, 8.32 [18:04:35] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [18:07:22] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 11.37, 10.15, 9.81 [18:08:33] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 7.98, 8.65, 8.57 [18:10:33] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.69, 8.41, 8.50 [18:13:12] PROBLEM - mcdev.grantlmul.xyz - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'mcdev.grantlmul.xyz' expires in 15 day(s) (Sun 06 Mar 2022 18:08:12 GMT +0000). [18:13:35] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/48707874d1fa...341615a02aa9 [18:13:36] [02miraheze/ssl] 07MirahezeSSLBot 03341615a - Bot: Update SSL cert for mcdev.grantlmul.xyz [18:13:50] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.17, 9.21, 9.00 [18:14:01] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.42, 9.74, 9.68 [18:14:33] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.36, 8.87, 8.71 [18:16:06] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.39, 8.15, 8.22 [18:17:22] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 8.77, 9.90, 9.97 [18:18:01] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.27, 9.35, 9.53 [18:18:33] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.71, 8.92, 8.71 [18:19:30] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 8.53, 9.10, 9.81 [18:20:33] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.44, 9.11, 8.81 [18:22:01] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.17, 9.83, 9.69 [18:22:06] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.91, 9.00, 8.58 [18:24:01] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.61, 9.14, 9.46 [18:24:33] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.32, 9.30, 8.92 [18:25:22] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.60, 9.54, 9.68 [18:25:30] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 11.84, 10.14, 10.00 [18:26:06] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.61, 8.39, 8.44 [18:26:33] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.68, 9.41, 9.01 [18:28:01] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.83, 9.63, 9.54 [18:29:22] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.01, 9.49, 9.68 [18:30:01] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.88, 9.08, 9.37 [18:32:01] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.99, 9.81, 9.59 [18:32:22] PROBLEM - wiki.wallymer.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.wallymer.com' expires in 15 day(s) (Sun 06 Mar 2022 18:05:55 GMT +0000). [18:33:50] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.99, 9.71, 9.78 [18:34:33] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.08, 9.06, 8.90 [18:36:54] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.35, 9.12, 8.73 [18:37:16] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/341615a02aa9...295db45a401e [18:37:17] [02miraheze/ssl] 07MirahezeSSLBot 03295db45 - Bot: Update SSL cert for wiki.wallymer.com [18:38:33] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.64, 9.60, 9.18 [18:40:43] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.61, 8.30, 8.48 [18:41:22] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 11.02, 9.62, 9.30 [18:41:50] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.38, 10.99, 10.28 [18:42:01] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.35, 9.23, 9.69 [18:42:24] RECOVERY - mcdev.grantlmul.xyz - LetsEncrypt on sslhost is OK: OK - Certificate 'mcdev.grantlmul.xyz' will expire on Thu 19 May 2022 17:13:28 GMT +0000. [18:43:31] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 8.18, 9.36, 10.00 [18:44:01] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.54, 9.97, 9.91 [18:44:59] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.15, 3.71, 2.93 [18:45:22] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 8.84, 9.15, 9.16 [18:45:23] [02CreateWiki] 07RhinosF1 closed pull request 03#293: Add a missing apostrophe - 13https://github.com/miraheze/CreateWiki/pull/293 [18:45:24] [02miraheze/CreateWiki] 07RhinosF1 pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/4a7342fe9820...b05278c7464e [18:45:26] [02miraheze/CreateWiki] 07amire80 03b05278c - Add a missing apostrophe (#293) [18:45:30] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 11.55, 10.11, 10.19 [18:45:32] miraheze/CreateWiki - RhinosF1 the build passed. [18:45:40] [02CreateWiki] 07RhinosF1 commented on pull request 03#293: Add a missing apostrophe - 13https://github.com/miraheze/CreateWiki/pull/293#issuecomment-1044996737 [18:46:01] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.49, 9.75, 9.83 [18:46:58] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.68, 3.78, 3.05 [18:47:30] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.51, 9.52, 9.95 [18:48:01] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 11.35, 10.18, 9.96 [18:48:58] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.96, 3.18, 2.92 [18:49:22] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.18, 9.66, 9.39 [18:50:01] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.23, 9.78, 9.84 [18:50:13] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.34, 8.79, 8.57 [18:50:21] miraheze/CreateWiki - RhinosF1 the build passed. [18:51:22] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.09, 9.55, 9.39 [18:52:01] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 11.30, 10.16, 9.96 [18:52:08] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 8.21, 8.40, 8.45 [18:52:58] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.67, 3.82, 3.23 [18:53:22] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.18, 9.72, 9.47 [18:53:28] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.07, 1.97, 1.43 [18:54:01] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.87, 9.99, 9.93 [18:54:58] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.86, 3.44, 3.16 [18:55:18] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.77, 1.81, 1.29 [18:55:25] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.46, 1.79, 1.43 [18:55:50] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.62, 9.43, 9.99 [18:56:01] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 9.54, 10.06, 9.97 [18:56:06] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.38, 8.85, 8.66 [18:57:18] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.37, 1.60, 1.27 [18:57:23] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.89, 1.47, 1.35 [18:58:58] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.34, 3.52, 3.25 [18:59:30] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 10.40, 9.12, 9.33 [19:00:58] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.47, 3.39, 3.23 [19:01:14] RECOVERY - wiki.wallymer.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.wallymer.com' will expire on Thu 19 May 2022 17:37:10 GMT +0000. [19:01:22] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.12, 9.84, 9.75 [19:02:06] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 6.86, 8.18, 8.50 [19:02:58] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.68, 2.89, 3.07 [19:03:30] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 8.53, 9.77, 9.64 [19:03:47] PROBLEM - mw101 APT on mw101 is CRITICAL: APT CRITICAL: 18 packages available for upgrade (18 critical updates). [19:04:39] PROBLEM - mw122 APT on mw122 is CRITICAL: APT CRITICAL: 18 packages available for upgrade (18 critical updates). [19:05:22] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.16, 9.76, 9.71 [19:05:50] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.29, 9.26, 9.58 [19:07:50] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.87, 9.37, 9.57 [19:07:52] PROBLEM - mw111 APT on mw111 is CRITICAL: APT CRITICAL: 18 packages available for upgrade (18 critical updates). [19:08:33] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 8.13, 8.11, 8.48 [19:09:30] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 10.74, 10.06, 9.77 [19:11:27] PROBLEM - phab121 APT on phab121 is CRITICAL: APT CRITICAL: 18 packages available for upgrade (18 critical updates). [19:11:50] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.08, 10.55, 9.96 [19:12:11] PROBLEM - cloud12 Puppet on cloud12 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[ulogd2] [19:12:44] PROBLEM - mw102 APT on mw102 is CRITICAL: APT CRITICAL: 18 packages available for upgrade (18 critical updates). [19:13:30] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 7.80, 9.12, 9.50 [19:13:31] PROBLEM - mw121 APT on mw121 is CRITICAL: APT CRITICAL: 18 packages available for upgrade (18 critical updates). [19:15:20] PROBLEM - mail121 APT on mail121 is CRITICAL: APT CRITICAL: 19 packages available for upgrade (19 critical updates). [19:18:03] PROBLEM - jobchron121 APT on jobchron121 is CRITICAL: APT CRITICAL: 19 packages available for upgrade (19 critical updates). [19:19:28] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.95, 8.54, 8.49 [19:19:34] PROBLEM - test101 APT on test101 is CRITICAL: APT CRITICAL: 18 packages available for upgrade (18 critical updates). [19:20:06] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.91, 9.43, 8.68 [19:20:34] PROBLEM - mw112 APT on mw112 is CRITICAL: APT CRITICAL: 18 packages available for upgrade (18 critical updates). [19:21:30] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 11.14, 9.88, 9.66 [19:22:31] PROBLEM - matomo101 APT on matomo101 is CRITICAL: APT CRITICAL: 20 packages available for upgrade (20 critical updates). [19:23:22] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 8.33, 9.47, 10.00 [19:23:30] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.45, 9.71, 9.63 [19:24:06] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.83, 8.23, 8.34 [19:24:17] PROBLEM - mwtask111 APT on mwtask111 is CRITICAL: APT CRITICAL: 18 packages available for upgrade (18 critical updates). [19:25:50] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.16, 9.82, 9.99 [19:27:50] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.31, 9.77, 9.93 [19:28:46] PROBLEM - mon111 APT on mon111 is CRITICAL: APT CRITICAL: 25 packages available for upgrade (19 critical updates). [19:31:30] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.07, 9.93, 9.61 [19:31:50] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 7.99, 9.48, 9.82 [19:32:49] [02miraheze/RottenLinks] 07dependabot[bot] pushed 031 commit to 03dependabot/composer/php-parallel-lint/php-console-highlighter-1.0.0 [+0/-0/±1] 13https://github.com/miraheze/RottenLinks/commit/2e9076856fae [19:32:51] [02miraheze/RottenLinks] 07dependabot[bot] 032e90768 - Update php-parallel-lint/php-console-highlighter requirement [19:32:52] [02RottenLinks] 07dependabot[bot] created branch 03dependabot/composer/php-parallel-lint/php-console-highlighter-1.0.0 - 13https://github.com/miraheze/RottenLinks [19:32:54] [02RottenLinks] 07dependabot[bot] opened pull request 03#50: Update php-parallel-lint/php-console-highlighter requirement from 0.5.0 to 1.0.0 - 13https://github.com/miraheze/RottenLinks/pull/50 [19:32:55] [02RottenLinks] 07dependabot[bot] labeled pull request 03#50: Update php-parallel-lint/php-console-highlighter requirement from 0.5.0 to 1.0.0 - 13https://github.com/miraheze/RottenLinks/pull/50 [19:32:57] [02RottenLinks] 07dependabot[bot] labeled pull request 03#50: Update php-parallel-lint/php-console-highlighter requirement from 0.5.0 to 1.0.0 - 13https://github.com/miraheze/RottenLinks/pull/50 [19:33:30] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.58, 9.90, 9.66 [19:35:01] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.45, 9.09, 8.77 [19:36:57] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.59, 9.25, 8.87 [19:37:50] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.42, 9.04, 9.40 [19:38:44] PROBLEM - dnd.bellinrattin.it - LetsEncrypt on sslhost is CRITICAL: connect to address dnd.bellinrattin.it and port 443: Network is unreachableHTTP CRITICAL - Unable to open TCP socket [19:39:22] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.35, 9.09, 9.17 [19:39:30] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 11.55, 10.30, 9.82 [19:40:10] RECOVERY - cloud12 Puppet on cloud12 is OK: OK: Puppet is currently enabled, last run 49 seconds ago with 0 failures [19:40:11] [02RottenLinks] 07RhinosF1 closed pull request 03#50: Update php-parallel-lint/php-console-highlighter requirement from 0.5.0 to 1.0.0 - 13https://github.com/miraheze/RottenLinks/pull/50 [19:40:13] [02miraheze/RottenLinks] 07RhinosF1 pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/RottenLinks/compare/4172385a182c...e52a662258ab [19:40:14] [02miraheze/RottenLinks] 07dependabot[bot] 03e52a662 - Update php-parallel-lint/php-console-highlighter requirement (#50) [19:40:16] [02RottenLinks] 07RhinosF1 deleted branch 03dependabot/composer/php-parallel-lint/php-console-highlighter-1.0.0 - 13https://github.com/miraheze/RottenLinks [19:40:17] [02miraheze/RottenLinks] 07RhinosF1 deleted branch 03dependabot/composer/php-parallel-lint/php-console-highlighter-1.0.0 [19:40:24] miraheze/RottenLinks - dependabot[bot] the build passed. [19:41:22] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.74, 9.39, 9.28 [19:42:47] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.74, 9.33, 8.94 [19:43:22] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.14, 9.52, 9.33 [19:44:12] miraheze/RottenLinks - RhinosF1 the build passed. [19:44:27] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/99e51a94c358...8bd9371a74f2 [19:44:28] [02miraheze/puppet] 07paladox 038bd9371 - user: add ssh key for paladox [19:44:58] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.54, 3.47, 2.81 [19:45:50] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.09, 9.58, 9.67 [19:46:40] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.15, 8.99, 8.92 [19:46:58] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.56, 3.34, 2.86 [19:47:22] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.05, 9.79, 9.53 [19:48:37] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 13.70, 10.43, 9.43 [19:49:22] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.90, 10.17, 9.69 [19:49:50] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.27, 9.26, 9.47 [19:50:33] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 7.19, 9.20, 9.11 [19:51:22] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 8.32, 9.55, 9.53 [19:51:50] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.69, 9.11, 9.40 [19:53:50] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.76, 9.82, 9.63 [19:55:22] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.48, 9.99, 9.70 [19:55:50] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.71, 9.66, 9.59 [19:56:33] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 11.00, 9.16, 9.04 [19:57:22] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.08, 9.71, 9.63 [19:58:33] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.11, 9.15, 9.05 [20:00:01] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.12, 9.02, 9.86 [20:03:30] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 8.33, 9.40, 9.92 [20:04:01] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 11.35, 9.45, 9.78 [20:06:01] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.53, 9.14, 9.64 [20:06:33] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.03, 8.87, 8.87 [20:07:58] RECOVERY - dnd.bellinrattin.it - LetsEncrypt on sslhost is OK: OK - Certificate 'dnd.bellinrattin.it' will expire on Wed 18 May 2022 05:38:27 GMT +0000. [20:08:33] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 7.36, 8.25, 8.64 [20:08:33] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.17, 1.73, 1.22 [20:09:50] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.44, 8.86, 9.05 [20:10:33] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 5.89, 7.50, 8.32 [20:10:33] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.38, 1.27, 1.12 [20:11:50] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.85, 9.16, 9.16 [20:18:01] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.46, 8.79, 8.97 [20:20:33] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 11.10, 9.41, 8.58 [20:21:30] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 8.01, 7.88, 8.48 [20:24:01] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.89, 9.80, 9.39 [20:24:33] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 7.26, 8.90, 8.60 [20:24:35] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [20:24:48] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 1.70, 3.36, 2.17 [20:25:50] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 11.44, 9.97, 9.54 [20:26:48] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.66, 8.89, 8.04 [20:28:01] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 11.46, 10.02, 9.53 [20:28:35] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [20:30:01] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.24, 9.81, 9.52 [20:30:19] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 10.28, 9.30, 8.84 [20:30:33] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.33, 9.50, 8.92 [20:30:41] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.14, 1.74, 1.81 [20:32:13] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 8.78, 9.08, 8.81 [20:32:31] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.16, 8.24, 8.09 [20:32:33] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 7.18, 8.56, 8.65 [20:32:38] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.66, 1.33, 1.65 [20:33:50] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.48, 9.68, 9.67 [20:34:01] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 11.19, 9.84, 9.55 [20:35:12] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.49, 1.76, 1.33 [20:35:22] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.99, 9.49, 9.02 [20:35:50] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.69, 9.87, 9.72 [20:37:09] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.73, 1.39, 1.24 [20:37:50] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.19, 9.57, 9.63 [20:38:33] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.13, 9.14, 8.80 [20:40:33] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 7.41, 8.45, 8.59 [20:41:06] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.79, 9.06, 8.48 [20:42:01] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.22, 9.80, 9.80 [20:42:33] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 5.86, 7.55, 8.24 [20:45:50] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.02, 10.74, 10.11 [20:46:58] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.98, 3.84, 3.28 [20:48:42] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.75, 8.30, 8.40 [20:48:58] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.66, 3.81, 3.34 [20:49:50] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.77, 9.54, 9.76 [20:51:50] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.54, 9.94, 9.88 [20:52:01] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.62, 10.05, 9.85 [20:54:58] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.07, 3.18, 3.25 [20:56:01] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.89, 9.29, 9.60 [20:56:33] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.25, 8.79, 8.34 [20:57:50] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.89, 9.56, 9.74 [20:58:07] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.82, 1.92, 1.42 [20:58:33] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 7.54, 8.72, 8.40 [20:59:50] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 11.05, 10.18, 9.94 [21:00:01] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.86, 9.70, 9.66 [21:00:02] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.29, 1.63, 1.37 [21:00:33] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 6.16, 7.96, 8.17 [21:00:58] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.00, 3.61, 3.32 [21:01:30] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 10.61, 10.27, 9.45 [21:01:50] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 7.35, 9.13, 9.59 [21:02:01] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.44, 8.71, 9.30 [21:02:58] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.86, 3.22, 3.21 [21:03:30] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 7.43, 9.03, 9.08 [21:03:54] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 1.18, 2.35, 1.83 [21:04:01] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.95, 10.19, 9.75 [21:06:01] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.17, 9.75, 9.65 [21:09:46] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 0.91, 1.82, 1.82 [21:11:44] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.56, 1.39, 1.66 [21:11:50] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.43, 3.33, 3.24 [21:13:48] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.20, 3.60, 3.35 [21:14:01] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 11.47, 9.56, 9.46 [21:15:22] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 8.31, 9.39, 9.93 [21:16:01] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.30, 9.67, 9.53 [21:17:22] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.87, 10.01, 10.09 [21:17:42] [02miraheze/WikiDiscover] 07dependabot[bot] pushed 031 commit to 03dependabot/composer/php-parallel-lint/php-console-highlighter-1.0.0 [+0/-0/±1] 13https://github.com/miraheze/WikiDiscover/commit/45394b78956c [21:17:43] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.57, 3.81, 3.51 [21:17:44] [02miraheze/WikiDiscover] 07dependabot[bot] 0345394b7 - Update php-parallel-lint/php-console-highlighter requirement [21:17:45] [02WikiDiscover] 07dependabot[bot] created branch 03dependabot/composer/php-parallel-lint/php-console-highlighter-1.0.0 - 13https://github.com/miraheze/WikiDiscover [21:17:47] [02WikiDiscover] 07dependabot[bot] opened pull request 03#79: Update php-parallel-lint/php-console-highlighter requirement from 0.5.0 to 1.0.0 - 13https://github.com/miraheze/WikiDiscover/pull/79 [21:17:48] [02WikiDiscover] 07dependabot[bot] labeled pull request 03#79: Update php-parallel-lint/php-console-highlighter requirement from 0.5.0 to 1.0.0 - 13https://github.com/miraheze/WikiDiscover/pull/79 [21:17:50] [02WikiDiscover] 07dependabot[bot] labeled pull request 03#79: Update php-parallel-lint/php-console-highlighter requirement from 0.5.0 to 1.0.0 - 13https://github.com/miraheze/WikiDiscover/pull/79 [21:17:50] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.46, 9.16, 9.10 [21:18:01] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.41, 10.11, 9.72 [21:19:50] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 7.66, 8.46, 8.85 [21:20:01] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.13, 9.61, 9.58 [21:20:17] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.63, 9.19, 8.58 [21:21:22] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.22, 9.78, 10.00 [21:21:25] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.41, 3.05, 2.83 [21:21:38] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.43, 4.11, 3.69 [21:22:06] miraheze/WikiDiscover - dependabot[bot] the build passed. [21:22:18] [02miraheze/DataDump] 07dependabot[bot] pushed 031 commit to 03dependabot/composer/php-parallel-lint/php-console-highlighter-1.0.0 [+0/-0/±1] 13https://github.com/miraheze/DataDump/commit/17d179b9a2c3 [21:22:20] [02miraheze/DataDump] 07dependabot[bot] 0317d179b - Update php-parallel-lint/php-console-highlighter requirement [21:22:21] [02DataDump] 07dependabot[bot] created branch 03dependabot/composer/php-parallel-lint/php-console-highlighter-1.0.0 - 13https://github.com/miraheze/DataDump [21:22:23] [02DataDump] 07dependabot[bot] opened pull request 03#46: Update php-parallel-lint/php-console-highlighter requirement from 0.5.0 to 1.0.0 - 13https://github.com/miraheze/DataDump/pull/46 [21:22:24] [02DataDump] 07dependabot[bot] labeled pull request 03#46: Update php-parallel-lint/php-console-highlighter requirement from 0.5.0 to 1.0.0 - 13https://github.com/miraheze/DataDump/pull/46 [21:22:26] [02DataDump] 07dependabot[bot] labeled pull request 03#46: Update php-parallel-lint/php-console-highlighter requirement from 0.5.0 to 1.0.0 - 13https://github.com/miraheze/DataDump/pull/46 [21:23:22] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 11.97, 10.70, 10.31 [21:23:22] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.53, 2.92, 2.82 [21:23:35] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.79, 3.73, 3.61 [21:25:30] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 10.26, 9.52, 9.20 [21:26:01] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.85, 9.53, 9.43 [21:27:12] miraheze/DataDump - dependabot[bot] the build passed. [21:27:22] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.25, 9.59, 9.93 [21:29:22] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.06, 9.69, 9.92 [21:29:28] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.27, 4.47, 3.90 [21:31:22] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 8.28, 9.07, 9.66 [21:31:57] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.70, 8.24, 8.49 [21:32:01] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 6.70, 9.17, 9.45 [21:32:02] [02WikiDiscover] 07RhinosF1 closed pull request 03#79: Update php-parallel-lint/php-console-highlighter requirement from 0.5.0 to 1.0.0 - 13https://github.com/miraheze/WikiDiscover/pull/79 [21:32:03] [02miraheze/WikiDiscover] 07RhinosF1 pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/WikiDiscover/compare/d518d3b84cd2...49295c1fd203 [21:32:05] [02miraheze/WikiDiscover] 07dependabot[bot] 0349295c1 - Update php-parallel-lint/php-console-highlighter requirement (#79) [21:32:06] [02WikiDiscover] 07RhinosF1 deleted branch 03dependabot/composer/php-parallel-lint/php-console-highlighter-1.0.0 - 13https://github.com/miraheze/WikiDiscover [21:32:07] [02miraheze/WikiDiscover] 07RhinosF1 deleted branch 03dependabot/composer/php-parallel-lint/php-console-highlighter-1.0.0 [21:32:12] [02DataDump] 07RhinosF1 closed pull request 03#46: Update php-parallel-lint/php-console-highlighter requirement from 0.5.0 to 1.0.0 - 13https://github.com/miraheze/DataDump/pull/46 [21:32:14] [02miraheze/DataDump] 07RhinosF1 pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/DataDump/compare/eb04e22eff96...ed3de61283a1 [21:32:15] [02miraheze/DataDump] 07dependabot[bot] 03ed3de61 - Update php-parallel-lint/php-console-highlighter requirement (#46) [21:32:17] [02DataDump] 07RhinosF1 deleted branch 03dependabot/composer/php-parallel-lint/php-console-highlighter-1.0.0 - 13https://github.com/miraheze/DataDump [21:32:18] [02miraheze/DataDump] 07RhinosF1 deleted branch 03dependabot/composer/php-parallel-lint/php-console-highlighter-1.0.0 [21:33:23] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.82, 3.69, 3.72 [21:35:50] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.95, 9.42, 9.10 [21:36:31] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.89, 8.73, 7.89 [21:36:39] miraheze/WikiDiscover - RhinosF1 the build passed. [21:37:49] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.13, 8.50, 8.56 [21:37:50] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.33, 9.53, 9.20 [21:38:25] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.24, 8.32, 7.86 [21:38:52] miraheze/DataDump - RhinosF1 the build passed. [21:39:16] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.48, 4.04, 3.85 [21:39:22] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.05, 9.15, 9.47 [21:39:45] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.14, 7.93, 8.34 [21:41:22] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.53, 9.37, 9.51 [21:41:30] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 7.78, 9.61, 9.85 [21:43:50] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 11.91, 9.88, 9.36 [21:45:30] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 10.82, 10.16, 10.00 [21:47:22] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.35, 9.36, 9.41 [21:47:30] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.58, 9.97, 9.95 [21:47:50] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 7.82, 9.35, 9.32 [21:48:35] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [21:49:22] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.15, 8.97, 9.24 [21:50:36] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.18, 9.10, 8.67 [21:51:50] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.25, 9.87, 9.54 [21:52:33] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 6.91, 8.43, 8.50 [21:53:30] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 10.09, 9.35, 9.60 [21:55:30] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 8.67, 9.41, 9.61 [21:55:35] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [21:56:01] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.89, 10.10, 9.50 [21:57:40] [02mediawiki] 07RhinosF1 opened pull request 03#5408: Test - 13https://github.com/miraheze/mediawiki/pull/5408 [21:57:50] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 7.73, 9.70, 9.70 [21:58:00] [02mediawiki] 07RhinosF1 closed pull request 03#5408: Test - 13https://github.com/miraheze/mediawiki/pull/5408 [21:59:46] [02miraheze/mediawiki] 07RhinosF1 created branch 03master 13https://github.com/miraheze/mediawiki/commit/4d8a5a09e81ae70b542f7c58435783a5c5cd6e1d [21:59:47] [02mediawiki] 07RhinosF1 created branch 03master - 13https://github.com/miraheze/mediawiki [22:00:33] can somebody please review/merge my MirahezeMagic pr when they get a chance? [22:00:49] MacFan4000: which [22:00:58] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.98, 3.52, 3.92 [22:01:02] Reception123: I'm gonna redo it from a local master this time [22:01:15] It'll make it quicker when they actually cut [22:01:17] RhinosF1: https://github.com/miraheze/MirahezeMagic/pull/318 [22:01:18] [url] Requests for Adoption -> Requests for reopening wikis by MacFan4000 · Pull Request #318 · miraheze/MirahezeMagic · GitHub | github.com [22:01:30] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.63, 9.53, 9.41 [22:01:54] MacFan4000: https://phabricator.miraheze.org/T8784 [22:01:55] [url] ⚓ T8784 CI on MirahezeMagic is broken | phabricator.miraheze.org [22:02:01] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.68, 9.68, 9.64 [22:03:50] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.35, 9.43, 9.47 [22:05:30] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.85, 9.97, 9.63 [22:05:50] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.83, 9.83, 9.63 [22:10:35] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [22:10:58] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.46, 2.63, 3.33 [22:11:22] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.13, 9.21, 8.93 [22:11:50] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.69, 9.41, 9.39 [22:13:22] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 8.04, 8.91, 8.87 [22:13:50] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.63, 9.55, 9.45 [22:15:50] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 11.15, 9.93, 9.59 [22:16:35] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [22:16:58] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.31, 3.42, 3.44 [22:17:30] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 10.41, 9.13, 9.09 [22:18:58] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.83, 3.14, 3.33 [22:19:06] [02mw-config] 07ugochimobi commented on pull request 03#4475: propertyOrderUrl - 13https://github.com/miraheze/mw-config/pull/4475#issuecomment-1045269072 [22:19:30] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.46, 9.31, 9.18 [22:19:50] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.43, 9.19, 9.38 [22:24:01] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.78, 9.61, 9.25 [22:26:01] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.02, 9.23, 9.14 [22:26:05] [02miraheze/CreateWiki] 07dependabot[bot] pushed 031 commit to 03dependabot/composer/php-parallel-lint/php-console-highlighter-1.0.0 [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/commit/3158d580f9b2 [22:26:06] [02miraheze/CreateWiki] 07dependabot[bot] 033158d58 - Update php-parallel-lint/php-console-highlighter requirement [22:26:08] [02CreateWiki] 07dependabot[bot] opened pull request 03#294: Update php-parallel-lint/php-console-highlighter requirement from 0.5.0 to 1.0.0 - 13https://github.com/miraheze/CreateWiki/pull/294 [22:26:10] [02CreateWiki] 07dependabot[bot] created branch 03dependabot/composer/php-parallel-lint/php-console-highlighter-1.0.0 - 13https://github.com/miraheze/CreateWiki [22:26:11] [02CreateWiki] 07dependabot[bot] labeled pull request 03#294: Update php-parallel-lint/php-console-highlighter requirement from 0.5.0 to 1.0.0 - 13https://github.com/miraheze/CreateWiki/pull/294 [22:26:12] [02CreateWiki] 07dependabot[bot] labeled pull request 03#294: Update php-parallel-lint/php-console-highlighter requirement from 0.5.0 to 1.0.0 - 13https://github.com/miraheze/CreateWiki/pull/294 [22:30:23] [02miraheze/IncidentReporting] 07dependabot[bot] pushed 031 commit to 03dependabot/composer/php-parallel-lint/php-console-highlighter-1.0.0 [+0/-0/±1] 13https://github.com/miraheze/IncidentReporting/commit/216abc1eb63a [22:30:25] [02miraheze/IncidentReporting] 07dependabot[bot] 03216abc1 - Update php-parallel-lint/php-console-highlighter requirement [22:30:26] [02IncidentReporting] 07dependabot[bot] created branch 03dependabot/composer/php-parallel-lint/php-console-highlighter-1.0.0 - 13https://github.com/miraheze/IncidentReporting [22:30:28] [02IncidentReporting] 07dependabot[bot] opened pull request 03#35: Update php-parallel-lint/php-console-highlighter requirement from 0.5.0 to 1.0.0 - 13https://github.com/miraheze/IncidentReporting/pull/35 [22:30:29] [02IncidentReporting] 07dependabot[bot] labeled pull request 03#35: Update php-parallel-lint/php-console-highlighter requirement from 0.5.0 to 1.0.0 - 13https://github.com/miraheze/IncidentReporting/pull/35 [22:30:31] [02IncidentReporting] 07dependabot[bot] labeled pull request 03#35: Update php-parallel-lint/php-console-highlighter requirement from 0.5.0 to 1.0.0 - 13https://github.com/miraheze/IncidentReporting/pull/35 [22:31:30] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 11.50, 10.09, 9.28 [22:31:31] [02miraheze/mediawiki] 07RhinosF1 pushed 032 commits to 03REL1_37 [+1/-3/±129] 13https://github.com/miraheze/mediawiki/compare/4d8a5a09e81a...57516d3b4705 [22:31:33] [02miraheze/mediawiki] 07RhinosF1 03de29ef8 - Revert "install ES extensions" [22:31:34] [02miraheze/mediawiki] 07RhinosF1 0357516d3 - Merge branch 'REL1_37' of https://github.com/miraheze/mediawiki into REL1_37 [22:31:35] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [22:31:49] miraheze/CreateWiki - dependabot[bot] the build passed. [22:31:59] [02CreateWiki] 07RhinosF1 closed pull request 03#294: Update php-parallel-lint/php-console-highlighter requirement from 0.5.0 to 1.0.0 - 13https://github.com/miraheze/CreateWiki/pull/294 [22:32:01] [02miraheze/CreateWiki] 07RhinosF1 pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/b05278c7464e...7d4c3226eb0c [22:32:02] [02miraheze/CreateWiki] 07dependabot[bot] 037d4c322 - Update php-parallel-lint/php-console-highlighter requirement (#294) [22:32:04] [02CreateWiki] 07RhinosF1 deleted branch 03dependabot/composer/php-parallel-lint/php-console-highlighter-1.0.0 - 13https://github.com/miraheze/CreateWiki [22:32:05] [02miraheze/CreateWiki] 07RhinosF1 deleted branch 03dependabot/composer/php-parallel-lint/php-console-highlighter-1.0.0 [22:32:25] [02miraheze/mediawiki] 07RhinosF1 pushed 032 commits to 03master [+1/-3/±129] 13https://github.com/miraheze/mediawiki/compare/4d8a5a09e81a...57516d3b4705 [22:33:22] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.43, 9.26, 9.10 [22:33:32] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 7.58, 8.99, 8.97 [22:33:34] Agent: in a few seconds, we'll have the branch nearly ready for 1.38 mediawiki wise [22:34:26] miraheze/IncidentReporting - dependabot[bot] the build passed. [22:35:50] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.66, 7.53, 8.37 [22:37:22] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.12, 9.61, 9.33 [22:37:35] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [22:37:58] miraheze/CreateWiki - RhinosF1 the build passed. [22:41:22] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 11.33, 9.92, 9.46 [22:42:43] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 7.63, 8.96, 8.77 [22:43:22] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.79, 9.86, 9.50 [22:43:28] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.50, 3.51, 3.19 [22:43:30] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 7.73, 8.02, 8.50 [22:44:38] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.72, 8.22, 8.50 [22:44:57] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.88, 8.68, 7.99 [22:45:26] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.83, 3.16, 3.09 [22:46:54] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 6.71, 7.83, 7.76 [22:47:35] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [22:47:47] [02IncidentReporting] 07RhinosF1 closed pull request 03#35: Update php-parallel-lint/php-console-highlighter requirement from 0.5.0 to 1.0.0 - 13https://github.com/miraheze/IncidentReporting/pull/35 [22:47:49] [02miraheze/IncidentReporting] 07RhinosF1 pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/IncidentReporting/compare/3e173f6cb4fd...cad9014afecc [22:47:50] [02miraheze/IncidentReporting] 07dependabot[bot] 03cad9014 - Update php-parallel-lint/php-console-highlighter requirement (#35) [22:47:55] [02miraheze/IncidentReporting] 07dependabot[bot] deleted branch 03dependabot/composer/php-parallel-lint/php-console-highlighter-1.0.0 [22:47:56] [02IncidentReporting] 07dependabot[bot] deleted branch 03dependabot/composer/php-parallel-lint/php-console-highlighter-1.0.0 - 13https://github.com/miraheze/IncidentReporting [22:48:32] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.01, 8.89, 8.69 [22:49:22] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.45, 9.61, 9.46 [22:49:30] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 10.90, 9.28, 8.81 [22:50:35] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [22:50:49] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.69, 8.65, 8.14 [22:51:22] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.52, 9.72, 9.54 [22:52:01] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 11.40, 10.34, 9.55 [22:52:23] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.77, 9.28, 8.93 [22:52:31] miraheze/IncidentReporting - RhinosF1 the build passed. [22:52:46] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 6.50, 7.89, 7.92 [22:53:22] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 11.00, 10.17, 9.72 [22:54:24] !log created miraheze/mediawiki:master to clean out 1.38 conflicts [22:54:33] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:55:30] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 7.61, 9.24, 9.06 [22:56:01] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.38, 9.95, 9.63 [22:57:04] [02miraheze/mediawiki] 07RhinosF1 pushed 035 commits to 03master [+0/-0/±18] 13https://github.com/miraheze/mediawiki/compare/5346afc955f8...6aac35b61eb5 [22:57:05] [02miraheze/mediawiki] 07bwang 0324c9728 - Add template data to support TOC collapsible section arrows in Vector [22:57:07] [02miraheze/mediawiki] 07arlolra 03e415046 - Use link-title for manualthumb [22:57:08] [02miraheze/mediawiki] 07jenkins-bot 03fb9189b - Merge "Add template data to support TOC collapsible section arrows in Vector" [22:57:10] [02miraheze/mediawiki] ... and 2 more commits. [22:57:22] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.24, 9.98, 9.77 [22:59:22] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 11.23, 10.28, 9.90 [23:00:01] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 11.20, 9.83, 9.59 [23:00:02] !log [@test101] starting deploy of {'l10nupdate': True} to skip [23:00:03] !log [@mwtask111] starting deploy of {'l10nupdate': True} to all [23:00:13] [02miraheze/mediawiki] 07RhinosF1 pushed 03157 commits to 03REL1_37 [+12/-0/±846] 13https://github.com/miraheze/mediawiki/compare/57516d3b4705...95b7f9475c1a [23:00:13] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:00:15] [02miraheze/mediawiki] 07translatewiki 03b7062f2 - Localisation updates from https://translatewiki.net. [23:00:16] [02miraheze/mediawiki] 07supertassu 03b146b17 - MessageCacheTest: remove sunday from tested words [23:00:18] [02miraheze/mediawiki] 07jenkins-bot 031f8045b - Merge "Localisation updates from https://translatewiki.net." into REL1_37 [23:00:19] [02miraheze/mediawiki] ... and 154 more commits. [23:00:25] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:00:35] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [23:01:22] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 8.60, 9.81, 9.79 [23:01:30] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.27, 9.88, 9.26 [23:01:34] !log [rhinos@test101] starting deploy of {'world': True, 'l10n': True} to all [23:01:41] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:01:50] !log [rhinos@mwtask111] starting deploy of {'world': True, 'l10n': True} to skip [23:01:57] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:02:01] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.03, 9.32, 9.43 [23:02:01] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 6.62, 7.80, 8.41 [23:04:01] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.02, 10.38, 9.78 [23:05:22] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.12, 9.45, 9.59 [23:05:35] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [23:07:22] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 8.06, 8.90, 9.37 [23:07:30] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.56, 9.85, 9.48 [23:08:28] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.19, 2.31, 1.48 [23:09:22] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 11.17, 9.41, 9.48 [23:09:26] [02miraheze/mediawiki] 07RhinosF1 pushed 03158 commits to 03master [+12/-0/±892] 13https://github.com/miraheze/mediawiki/compare/6aac35b61eb5...fa6afd9b4e80 [23:09:28] [02miraheze/mediawiki] 07RhinosF1 03fa6afd9 - Merge branch 'REL1_37' [23:09:30] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 10.82, 10.17, 9.64 [23:10:01] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.71, 9.90, 9.79 [23:10:35] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [23:10:44] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.52, 10.28, 9.11 [23:11:22] PROBLEM - mwtask111 Current Load on mwtask111 is CRITICAL: CRITICAL - load average: 3.08, 1.89, 0.95 [23:11:30] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.78, 9.98, 9.63 [23:12:28] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.44, 1.86, 1.49 [23:12:40] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.62, 9.51, 8.97 [23:13:22] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 7.87, 9.12, 9.43 [23:13:35] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [23:14:28] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.35, 1.63, 1.44 [23:15:03] JohnLewis, paladox: !sre [23:15:25] ? [23:15:28] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.71, 1.97, 1.12 [23:15:30] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 10.10, 9.71, 9.58 [23:15:44] paladox: git is throwing some conflicts [23:15:46] on prod [23:15:51] where [23:16:01] https://www.irccloud.com/pastebin/XwVgrpXa/ [23:16:04] paladox: task [23:16:07] vendor [23:16:33] remove vendor, reset git and then run composer install [23:17:12] rm -rf vendor ; sudo -u www-data git reset --hard origin/REL1_37 ; sudo -u www-data git submodule update [23:17:22] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.39, 9.77, 9.60 [23:17:49] RhinosF1: [23:17:58] !log sudo -u www-data rm -rf vendor ; sudo -u www-data git reset --hard origin/REL1_37 ; sudo -u www-data git submodule update [23:18:01] paladox: running [23:18:11] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:18:15] ack [23:19:03] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - dnd.bellinrattin.it All nameservers failed to answer the query. [23:19:19] paladox: looks better [23:19:22] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 8.89, 9.55, 9.55 [23:19:22] PROBLEM - mwtask111 Current Load on mwtask111 is WARNING: WARNING - load average: 1.48, 1.91, 1.41 [23:19:24] ok [23:19:30] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 8.28, 9.48, 9.57 [23:20:06] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.05, 8.60, 8.12 [23:21:06] !log removed 3 extensions that weren't fully wiped [23:21:17] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:21:22] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 11.44, 10.07, 9.72 [23:21:30] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 11.60, 10.30, 9.86 [23:22:06] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 11.99, 9.14, 8.31 [23:22:18] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.68, 9.56, 9.10 [23:23:22] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.57, 9.98, 9.74 [23:23:30] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 8.86, 9.80, 9.74 [23:23:59] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 7.89, 8.99, 8.45 [23:24:06] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.86, 8.87, 8.31 [23:24:14] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.77, 9.46, 9.13 [23:24:51] PROBLEM - matomo101 Disk Space on matomo101 is WARNING: DISK WARNING - free space: / 1037 MB (10% inode=80%); [23:25:22] !log composer install && update on mwtask111 to recover deploy [23:25:22] RECOVERY - mwtask111 Current Load on mwtask111 is OK: OK - load average: 1.17, 1.54, 1.42 [23:25:30] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 10.74, 10.36, 9.96 [23:25:31] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:26:06] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 6.82, 8.29, 8.18 [23:26:54] !log [rhinos@mwtask111] starting deploy of {'world': True, 'l10n': True} to skip [23:27:05] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:27:22] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 11.19, 9.68, 9.57 [23:28:01] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.12, 8.97, 9.07 [23:29:22] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.41, 9.70, 9.61 [23:29:48] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.18, 9.14, 8.63 [23:30:01] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.84, 8.53, 8.90 [23:30:01] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 11.94, 9.61, 9.18 [23:30:06] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.76, 8.50, 8.27 [23:30:29] !log same on test101 [23:30:40] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:31:22] PROBLEM - mwtask111 Current Load on mwtask111 is WARNING: WARNING - load average: 1.85, 1.67, 1.50 [23:31:45] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 6.79, 8.30, 8.40 [23:31:57] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.13, 9.71, 9.30 [23:32:01] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 11.01, 9.49, 9.20 [23:32:06] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.70, 8.33, 8.25 [23:32:26] !log [@test101] finished deploy of {'l10nupdate': True} to skip - SUCCESS in 1943s [23:32:30] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:32:39] !log [@mwtask111] finished deploy of {'l10nupdate': True} to all - SUCCESS in 1956s [23:32:46] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:33:28] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 0.58, 1.66, 1.82 [23:33:30] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 6.68, 8.82, 9.58 [23:33:52] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 11.16, 10.00, 9.43 [23:34:19] !log [rhinos@test101] starting deploy of {'world': True, 'l10n': True} to all [23:34:28] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:34:34] !log [rhinos@test101] starting deploy of {'world': True, 'l10n': True} to skip [23:34:39] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:35:07] !log [rhinos@mwtask111] finished deploy of {'world': True, 'l10n': True} to skip - SUCCESS in 494s [23:35:17] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:35:22] RECOVERY - mwtask111 Current Load on mwtask111 is OK: OK - load average: 1.02, 1.54, 1.51 [23:35:29] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 0.49, 1.24, 1.64 [23:35:50] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.52, 9.57, 9.36 [23:36:06] !log [rhinos@mwtask111] starting deploy of {'world': True, 'l10n': True} to all [23:36:10] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:36:42] [02miraheze/mediawiki] 07RhinosF1 pushed 032 commits to 03master [+0/-0/±2] 13https://github.com/miraheze/mediawiki/compare/fa6afd9b4e80...26f331cc6555 [23:36:43] [02miraheze/mediawiki] 07arlolra 03bb36c06 - Check if link-title-query is set [23:36:45] [02miraheze/mediawiki] 07RhinosF1 0326f331c - Merge branch 'wikimedia:master' into master [23:38:01] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.87, 9.25, 9.30 [23:39:22] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.86, 9.02, 9.12 [23:39:50] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.14, 9.47, 9.34 [23:40:15] !log [rhinos@test101] finished deploy of {'world': True, 'l10n': True} to skip - SUCCESS in 340s [23:40:22] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:41:10] PROBLEM - cloud10 Puppet on cloud10 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[ulogd2] [23:41:50] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.87, 9.62, 9.41 [23:43:30] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 10.61, 9.86, 9.63 [23:44:01] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 5.48, 7.32, 8.50 [23:45:30] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.13, 9.65, 9.59 [23:47:22] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 7.37, 9.10, 9.38 [23:48:17] !log [rhinos@mwtask111] finished deploy of {'world': True, 'l10n': True} to all - SUCCESS in 730s [23:48:32] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:48:51] * RhinosF1 off to sleep [23:49:02] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 155, in main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 136, in main records = check_records(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 73, in check_records nameserversans = dns_resolver.resolve(root_domain, 'NS') File "/usr/l [23:49:02] n3/dist-packages/dns/resolver.py", line 1040, in resolve (nameserver, port, tcp, backoff) = resolution.next_nameserver() File "/usr/lib/python3/dist-packages/dns/resolver.py", line 598, in next_nameserver raise NoNameservers(request=self.request, errors=self.errors)dns.resolver.NoNameservers: All nameservers failed to answer the query bellinrattin.it. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [23:50:01] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.05, 9.00, 8.91 [23:50:51] RECOVERY - matomo101 Disk Space on matomo101 is OK: DISK OK - free space: / 2171 MB (22% inode=80%); [23:51:50] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.18, 9.06, 9.10 [23:52:19] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.74, 8.31, 8.05 [23:53:50] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.21, 8.51, 8.88 [23:55:22] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 7.47, 7.54, 8.46 [23:56:07] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.93, 8.14, 8.04 [23:57:30] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 5.14, 7.01, 8.09 [23:58:01] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.98, 9.11, 8.86