[00:00:49] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.43, 3.14, 2.69 [00:02:32] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 3.56, 7.60, 9.88 [00:02:44] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 16.04, 7.63, 4.35 [00:02:45] PROBLEM - cp31 Stunnel HTTP for mw121 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:02:55] PROBLEM - mw141 MediaWiki Rendering on mw141 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:02:55] PROBLEM - cp30 Stunnel HTTP for matomo131 on cp30 is CRITICAL: HTTP CRITICAL - No data received from host [00:03:01] PROBLEM - mw121 MediaWiki Rendering on mw121 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:03:03] PROBLEM - cp20 Stunnel HTTP for mw141 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:03:06] PROBLEM - mw142 HTTPS on mw142 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:03:10] PROBLEM - cp31 Stunnel HTTP for phab121 on cp31 is CRITICAL: HTTP CRITICAL - No data received from host [00:03:14] PROBLEM - cp31 Stunnel HTTP for reports121 on cp31 is CRITICAL: HTTP CRITICAL - No data received from host [00:03:15] PROBLEM - cp20 Stunnel HTTP for mw132 on cp20 is CRITICAL: HTTP CRITICAL - No data received from host [00:03:15] PROBLEM - cp31 Stunnel HTTP for mw131 on cp31 is CRITICAL: HTTP CRITICAL - No data received from host [00:03:16] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 1.71, 2.20, 1.56 [00:03:19] PROBLEM - cp30 Stunnel HTTP for mon141 on cp30 is CRITICAL: HTTP CRITICAL - No data received from host [00:03:23] PROBLEM - cp31 Stunnel HTTP for mw142 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:03:26] PROBLEM - cp20 Stunnel HTTP for mw131 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:03:27] PROBLEM - cp21 Stunnel HTTP for mw132 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:03:28] PROBLEM - cp21 Stunnel HTTP for mw131 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:03:29] PROBLEM - cp20 Stunnel HTTP for mw142 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:03:30] PROBLEM - cp30 Stunnel HTTP for mw121 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:03:30] PROBLEM - cp30 Stunnel HTTP for mw132 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:03:30] PROBLEM - cp31 Stunnel HTTP for mw132 on cp31 is CRITICAL: HTTP CRITICAL - No data received from host [00:03:35] PROBLEM - cp30 Stunnel HTTP for mw131 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:03:37] PROBLEM - mw131 HTTPS on mw131 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:03:37] PROBLEM - cp31 HTTP 4xx/5xx ERROR Rate on cp31 is WARNING: WARNING - NGINX Error Rate is 52% [00:03:38] PROBLEM - mw142 MediaWiki Rendering on mw142 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:03:39] PROBLEM - mw132 HTTPS on mw132 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:03:41] PROBLEM - mw131 MediaWiki Rendering on mw131 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:03:41] PROBLEM - mw132 MediaWiki Rendering on mw132 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:03:43] PROBLEM - cp20 Stunnel HTTP for mw121 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:03:47] PROBLEM - cp20 Stunnel HTTP for test131 on cp20 is CRITICAL: HTTP CRITICAL - No data received from host [00:03:47] PROBLEM - cp20 Stunnel HTTP for mwtask141 on cp20 is CRITICAL: HTTP CRITICAL - No data received from host [00:03:47] PROBLEM - cp30 Stunnel HTTP for mwtask141 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:03:53] PROBLEM - cp30 Stunnel HTTP for mw141 on cp30 is CRITICAL: HTTP CRITICAL - No data received from host [00:03:55] PROBLEM - cp21 HTTP 4xx/5xx ERROR Rate on cp21 is CRITICAL: CRITICAL - NGINX Error Rate is 60% [00:04:11] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 0.93, 2.27, 3.62 [00:04:15] PROBLEM - cp31 Varnish Backends on cp31 is CRITICAL: 7 backends are down. mw121 mw122 mw131 mw132 mw141 mw142 mediawiki [00:04:16] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.09, 1.97, 1.68 [00:04:55] RECOVERY - cp31 Stunnel HTTP for mw122 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.319 second response time [00:04:56] RECOVERY - cp30 Stunnel HTTP for matomo131 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 99061 bytes in 0.664 second response time [00:05:04] RECOVERY - mw142 HTTPS on mw142 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 545 bytes in 0.007 second response time [00:05:08] RECOVERY - cp31 Stunnel HTTP for reports121 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 10996 bytes in 0.271 second response time [00:05:08] RECOVERY - cp31 Stunnel HTTP for phab121 on cp31 is OK: HTTP OK: Status line output matched "500" - 2855 bytes in 0.290 second response time [00:05:12] RECOVERY - cp20 Stunnel HTTP for mw132 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.017 second response time [00:05:15] RECOVERY - cp30 Stunnel HTTP for mw122 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.313 second response time [00:05:16] RECOVERY - cp30 Stunnel HTTP for mon141 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 39170 bytes in 0.334 second response time [00:05:16] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.46, 1.60, 1.42 [00:05:23] RECOVERY - cp31 Stunnel HTTP for mw142 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.322 second response time [00:05:23] RECOVERY - cp21 Stunnel HTTP for mw132 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 0.017 second response time [00:05:23] RECOVERY - cp21 Stunnel HTTP for mw122 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.020 second response time [00:05:26] RECOVERY - cp31 Stunnel HTTP for mw132 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.324 second response time [00:05:28] RECOVERY - cp20 Stunnel HTTP for mw142 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.024 second response time [00:05:29] RECOVERY - cp30 Stunnel HTTP for mw132 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 0.337 second response time [00:05:33] RECOVERY - mw142 MediaWiki Rendering on mw142 is OK: HTTP OK: HTTP/1.1 200 OK - 29512 bytes in 0.265 second response time [00:05:34] PROBLEM - cp20 Varnish Backends on cp20 is CRITICAL: 3 backends are down. mw122 mw132 mw142 [00:05:38] RECOVERY - mw132 HTTPS on mw132 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 545 bytes in 0.014 second response time [00:05:38] RECOVERY - cp20 Stunnel HTTP for mw122 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.019 second response time [00:05:39] RECOVERY - mw132 MediaWiki Rendering on mw132 is OK: HTTP OK: HTTP/1.1 200 OK - 29512 bytes in 0.191 second response time [00:05:42] RECOVERY - mw122 MediaWiki Rendering on mw122 is OK: HTTP OK: HTTP/1.1 200 OK - 29512 bytes in 0.304 second response time [00:05:43] PROBLEM - cp30 Varnish Backends on cp30 is CRITICAL: 7 backends are down. mw121 mw122 mw131 mw132 mw141 mw142 mediawiki [00:05:44] RECOVERY - cp30 Stunnel HTTP for mwtask141 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15956 bytes in 0.334 second response time [00:05:55] RECOVERY - cp21 HTTP 4xx/5xx ERROR Rate on cp21 is OK: OK - NGINX Error Rate is 27% [00:06:11] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 0.28, 1.63, 3.22 [00:06:13] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.88, 1.54, 1.55 [00:06:16] PROBLEM - cp21 Varnish Backends on cp21 is CRITICAL: 5 backends are down. mw122 mw131 mw132 mw141 mw142 [00:07:31] PROBLEM - gluster111 PowerDNS Recursor on gluster111 is CRITICAL: CRITICAL - Plugin timed out while executing system call [00:08:21] PROBLEM - cp21 Stunnel HTTP for mw121 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:08:22] PROBLEM - cp31 Stunnel HTTP for mw141 on cp31 is CRITICAL: HTTP CRITICAL - No data received from host [00:08:25] PROBLEM - cp21 Stunnel HTTP for mw141 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:08:31] PROBLEM - cp20 HTTP 4xx/5xx ERROR Rate on cp20 is CRITICAL: CRITICAL - NGINX Error Rate is 68% [00:08:31] PROBLEM - mw121 HTTPS on mw121 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:08:32] PROBLEM - mw141 HTTPS on mw141 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:09:05] PROBLEM - cp20 Stunnel HTTP for reports121 on cp20 is CRITICAL: HTTP CRITICAL - No data received from host [00:09:25] PROBLEM - cp20 Stunnel HTTP for mw142 on cp20 is CRITICAL: HTTP CRITICAL - No data received from host [00:09:26] PROBLEM - cp21 Stunnel HTTP for mw132 on cp21 is CRITICAL: HTTP CRITICAL - No data received from host [00:09:28] PROBLEM - cp21 Stunnel HTTP for mw122 on cp21 is CRITICAL: HTTP CRITICAL - No data received from host [00:09:30] RECOVERY - gluster111 PowerDNS Recursor on gluster111 is OK: DNS OK: 0.137 seconds response time. miraheze.org returns 198.244.148.90,2001:41d0:801:2000::1b80,2001:41d0:801:2000::4c25,51.195.220.68 [00:09:37] RECOVERY - cp31 HTTP 4xx/5xx ERROR Rate on cp31 is OK: OK - NGINX Error Rate is 17% [00:09:39] RECOVERY - cp31 Stunnel HTTP for mw131 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 4.108 second response time [00:09:39] RECOVERY - cp30 Stunnel HTTP for mw131 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 0.333 second response time [00:09:40] RECOVERY - cp20 Stunnel HTTP for mw131 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 0.015 second response time [00:09:46] RECOVERY - mw131 HTTPS on mw131 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 545 bytes in 0.006 second response time [00:09:48] RECOVERY - mw131 MediaWiki Rendering on mw131 is OK: HTTP OK: HTTP/1.1 200 OK - 29512 bytes in 0.246 second response time [00:09:51] RECOVERY - cp20 Stunnel HTTP for mw121 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.826 second response time [00:09:52] RECOVERY - cp20 Stunnel HTTP for mwtask141 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15950 bytes in 0.021 second response time [00:09:52] RECOVERY - cp20 Stunnel HTTP for test131 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15954 bytes in 0.021 second response time [00:09:59] RECOVERY - cp30 Stunnel HTTP for mw141 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.323 second response time [00:10:18] RECOVERY - cp21 Stunnel HTTP for mw121 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.031 second response time [00:10:22] RECOVERY - cp31 Stunnel HTTP for mw141 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 0.329 second response time [00:10:22] RECOVERY - cp21 Stunnel HTTP for mw141 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.023 second response time [00:10:26] RECOVERY - mw141 HTTPS on mw141 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 545 bytes in 0.014 second response time [00:10:27] RECOVERY - mw121 HTTPS on mw121 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 545 bytes in 0.011 second response time [00:11:00] RECOVERY - cp31 Stunnel HTTP for mw121 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 0.340 second response time [00:11:00] RECOVERY - cp20 Stunnel HTTP for reports121 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 10996 bytes in 0.044 second response time [00:11:01] PROBLEM - cp31 Stunnel HTTP for mw122 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:11:02] RECOVERY - mw141 MediaWiki Rendering on mw141 is OK: HTTP OK: HTTP/1.1 200 OK - 29512 bytes in 0.416 second response time [00:11:08] RECOVERY - mw121 MediaWiki Rendering on mw121 is OK: HTTP OK: HTTP/1.1 200 OK - 29512 bytes in 0.273 second response time [00:11:15] RECOVERY - cp20 Stunnel HTTP for mw141 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.016 second response time [00:11:23] RECOVERY - cp20 Stunnel HTTP for mw142 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.016 second response time [00:11:26] RECOVERY - cp21 Stunnel HTTP for mw131 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 0.019 second response time [00:11:28] RECOVERY - cp30 Stunnel HTTP for mw121 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.320 second response time [00:11:28] RECOVERY - cp21 Stunnel HTTP for mw132 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 6.512 second response time [00:11:37] RECOVERY - cp21 Stunnel HTTP for mw122 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 8.951 second response time [00:12:27] PROBLEM - cp20 HTTP 4xx/5xx ERROR Rate on cp20 is WARNING: WARNING - NGINX Error Rate is 58% [00:12:56] PROBLEM - mw132 Current Load on mw132 is CRITICAL: CRITICAL - load average: 19.06, 11.02, 7.45 [00:12:56] RECOVERY - cp31 Stunnel HTTP for mw122 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.321 second response time [00:13:34] RECOVERY - cp20 Varnish Backends on cp20 is OK: All 14 backends are healthy [00:14:12] RECOVERY - cp31 Varnish Backends on cp31 is OK: All 14 backends are healthy [00:14:16] RECOVERY - cp21 Varnish Backends on cp21 is OK: All 14 backends are healthy [00:14:26] RECOVERY - cp20 HTTP 4xx/5xx ERROR Rate on cp20 is OK: OK - NGINX Error Rate is 6% [00:14:56] RECOVERY - mw132 Current Load on mw132 is OK: OK - load average: 8.97, 10.13, 7.57 [00:15:43] RECOVERY - cp30 Varnish Backends on cp30 is OK: All 14 backends are healthy [00:18:11] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.01, 3.51, 3.21 [00:24:17] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.73, 10.23, 8.76 [00:28:11] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.12, 3.75, 3.65 [00:29:54] PROBLEM - cp21 Stunnel HTTP for mw122 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:30:05] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.79, 11.22, 9.58 [00:30:26] PROBLEM - mw122 MediaWiki Rendering on mw122 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:31:53] RECOVERY - cp21 Stunnel HTTP for mw122 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 1.582 second response time [00:32:01] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 9.36, 10.04, 9.32 [00:32:25] RECOVERY - mw122 MediaWiki Rendering on mw122 is OK: HTTP OK: HTTP/1.1 200 OK - 29513 bytes in 2.019 second response time [00:34:11] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 7.19, 4.62, 3.94 [00:41:43] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 14.92, 12.90, 10.78 [00:48:07] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.76, 3.54, 3.97 [00:48:13] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.78, 1.58, 1.42 [00:50:10] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.09, 1.42, 1.38 [00:58:07] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.96, 4.33, 4.00 [00:59:07] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.45, 11.91, 11.82 [00:59:42] PROBLEM - cp31 Stunnel HTTP for mw122 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:59:58] PROBLEM - cp30 Stunnel HTTP for mw122 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:00:02] PROBLEM - cp20 Stunnel HTTP for mw122 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:00:04] PROBLEM - mw122 MediaWiki Rendering on mw122 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:00:07] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.74, 3.89, 3.87 [01:01:03] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.56, 13.09, 12.31 [01:01:32] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.98, 1.62, 1.31 [01:01:44] RECOVERY - cp31 Stunnel HTTP for mw122 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 6.084 second response time [01:01:58] RECOVERY - cp30 Stunnel HTTP for mw122 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 5.372 second response time [01:02:01] RECOVERY - cp20 Stunnel HTTP for mw122 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 4.900 second response time [01:02:06] RECOVERY - mw122 MediaWiki Rendering on mw122 is OK: HTTP OK: HTTP/1.1 200 OK - 29513 bytes in 5.804 second response time [01:02:54] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.85, 1.85, 1.60 [01:02:59] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.08, 11.43, 11.79 [01:03:30] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.10, 1.83, 1.43 [01:04:51] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.01, 1.59, 1.54 [01:07:27] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.22, 1.75, 1.50 [01:08:07] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.19, 3.45, 3.61 [01:09:25] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.56, 1.38, 1.39 [01:10:07] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 1.61, 2.90, 3.40 [01:11:41] PROBLEM - cp31 Stunnel HTTP for mw142 on cp31 is CRITICAL: HTTP CRITICAL - No data received from host [01:11:52] PROBLEM - cp30 Stunnel HTTP for mw121 on cp30 is CRITICAL: HTTP CRITICAL - No data received from host [01:12:12] PROBLEM - cp30 Stunnel HTTP for mw122 on cp30 is CRITICAL: HTTP CRITICAL - No data received from host [01:12:12] PROBLEM - mw121 MediaWiki Rendering on mw121 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:12:21] PROBLEM - cp31 Stunnel HTTP for mw121 on cp31 is CRITICAL: HTTP CRITICAL - No data received from host [01:12:32] PROBLEM - cp31 Stunnel HTTP for mw131 on cp31 is CRITICAL: HTTP CRITICAL - No data received from host [01:12:32] PROBLEM - mw141 HTTPS on mw141 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:12:43] PROBLEM - cp31 Stunnel HTTP for mw122 on cp31 is CRITICAL: HTTP CRITICAL - No data received from host [01:13:01] PROBLEM - cp21 Stunnel HTTP for mw122 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:13:20] PROBLEM - cp20 Stunnel HTTP for mw122 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:13:36] PROBLEM - mw122 MediaWiki Rendering on mw122 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:13:38] PROBLEM - mw142 MediaWiki Rendering on mw142 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:13:43] PROBLEM - cp30 Varnish Backends on cp30 is CRITICAL: 7 backends are down. mw121 mw122 mw131 mw132 mw141 mw142 mediawiki [01:13:47] RECOVERY - cp30 Stunnel HTTP for mw121 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.314 second response time [01:14:07] RECOVERY - mw121 MediaWiki Rendering on mw121 is OK: HTTP OK: HTTP/1.1 200 OK - 29512 bytes in 0.348 second response time [01:14:11] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 0.84, 2.21, 3.72 [01:14:16] PROBLEM - cp21 Varnish Backends on cp21 is CRITICAL: 1 backends are down. mw141 [01:14:20] RECOVERY - cp31 Stunnel HTTP for mw121 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.339 second response time [01:14:26] RECOVERY - mw141 HTTPS on mw141 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 545 bytes in 0.014 second response time [01:14:35] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 3.81, 7.37, 9.73 [01:14:55] PROBLEM - mw131 HTTPS on mw131 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:14:58] PROBLEM - cp30 Stunnel HTTP for mw131 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:15:27] PROBLEM - mw122 HTTPS on mw122 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:15:34] PROBLEM - cp20 Varnish Backends on cp20 is CRITICAL: 5 backends are down. mw121 mw131 mw132 mw141 mw142 [01:15:54] PROBLEM - cp31 Varnish Backends on cp31 is CRITICAL: 7 backends are down. mw121 mw122 mw131 mw132 mw141 mw142 mediawiki [01:16:11] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 0.18, 1.52, 3.28 [01:16:32] RECOVERY - cp31 Stunnel HTTP for mw131 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.331 second response time [01:16:52] RECOVERY - mw131 HTTPS on mw131 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 545 bytes in 0.006 second response time [01:16:56] RECOVERY - cp30 Stunnel HTTP for mw131 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 3.472 second response time [01:17:07] RECOVERY - cp21 Stunnel HTTP for mw122 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.019 second response time [01:17:09] RECOVERY - cp20 Stunnel HTTP for mw122 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 0.018 second response time [01:17:22] RECOVERY - mw122 HTTPS on mw122 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 545 bytes in 0.016 second response time [01:17:30] PROBLEM - cp20 HTTP 4xx/5xx ERROR Rate on cp20 is WARNING: WARNING - NGINX Error Rate is 56% [01:17:37] PROBLEM - cp31 HTTP 4xx/5xx ERROR Rate on cp31 is CRITICAL: CRITICAL - NGINX Error Rate is 68% [01:17:38] RECOVERY - mw142 MediaWiki Rendering on mw142 is OK: HTTP OK: HTTP/1.1 200 OK - 29512 bytes in 0.188 second response time [01:17:40] RECOVERY - mw122 MediaWiki Rendering on mw122 is OK: HTTP OK: HTTP/1.1 200 OK - 29512 bytes in 0.341 second response time [01:17:55] PROBLEM - cp21 HTTP 4xx/5xx ERROR Rate on cp21 is CRITICAL: CRITICAL - NGINX Error Rate is 62% [01:17:59] RECOVERY - cp31 Stunnel HTTP for mw142 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.315 second response time [01:18:05] RECOVERY - cp30 Stunnel HTTP for mw122 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 0.307 second response time [01:18:46] PROBLEM - mw141 HTTPS on mw141 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:18:47] RECOVERY - cp31 Stunnel HTTP for mw122 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 8.695 second response time [01:19:29] RECOVERY - cp20 HTTP 4xx/5xx ERROR Rate on cp20 is OK: OK - NGINX Error Rate is 15% [01:19:37] RECOVERY - cp31 HTTP 4xx/5xx ERROR Rate on cp31 is OK: OK - NGINX Error Rate is 32% [01:19:55] RECOVERY - cp21 HTTP 4xx/5xx ERROR Rate on cp21 is OK: OK - NGINX Error Rate is 1% [01:20:16] RECOVERY - cp21 Varnish Backends on cp21 is OK: All 14 backends are healthy [01:20:37] PROBLEM - cp30 Stunnel HTTP for mw141 on cp30 is CRITICAL: HTTP CRITICAL - No data received from host [01:20:39] PROBLEM - cp30 Stunnel HTTP for mw121 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:20:40] PROBLEM - cp30 Stunnel HTTP for mon141 on cp30 is CRITICAL: HTTP CRITICAL - No data received from host [01:20:41] PROBLEM - cp30 Stunnel HTTP for mw132 on cp30 is CRITICAL: HTTP CRITICAL - No data received from host [01:20:57] PROBLEM - mw141 MediaWiki Rendering on mw141 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:20:58] PROBLEM - cp20 Stunnel HTTP for mw141 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:21:27] PROBLEM - mw121 MediaWiki Rendering on mw121 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:21:41] PROBLEM - cp21 Stunnel HTTP for mw132 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:21:43] PROBLEM - cp20 Stunnel HTTP for mw121 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:21:44] PROBLEM - cp31 Stunnel HTTP for mw121 on cp31 is CRITICAL: HTTP CRITICAL - No data received from host [01:21:44] PROBLEM - cp20 Stunnel HTTP for mw142 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:21:45] PROBLEM - mw122 HTTPS on mw122 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:21:45] PROBLEM - cp31 Stunnel HTTP for mw132 on cp31 is CRITICAL: HTTP CRITICAL - No data received from host [01:21:46] PROBLEM - cp21 Stunnel HTTP for mw142 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:21:49] PROBLEM - cp21 Stunnel HTTP for mw121 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:21:58] PROBLEM - mw142 MediaWiki Rendering on mw142 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:22:01] PROBLEM - mw122 MediaWiki Rendering on mw122 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:22:33] RECOVERY - cp30 Stunnel HTTP for mw141 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.573 second response time [01:22:40] RECOVERY - cp30 Stunnel HTTP for mon141 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 39185 bytes in 0.384 second response time [01:22:40] RECOVERY - cp30 Stunnel HTTP for mw132 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 0.346 second response time [01:22:41] RECOVERY - cp30 Stunnel HTTP for mw121 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 7.525 second response time [01:22:45] RECOVERY - mw141 HTTPS on mw141 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 545 bytes in 0.006 second response time [01:22:48] PROBLEM - cp20 Stunnel HTTP for mw131 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:22:51] PROBLEM - cp30 Stunnel HTTP for mw131 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:22:51] RECOVERY - mw141 MediaWiki Rendering on mw141 is OK: HTTP OK: HTTP/1.1 200 OK - 29512 bytes in 0.356 second response time [01:22:52] PROBLEM - cp31 Stunnel HTTP for mw131 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:22:53] PROBLEM - cp31 Stunnel HTTP for mw122 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:22:56] RECOVERY - cp20 Stunnel HTTP for mw141 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 0.021 second response time [01:23:34] RECOVERY - cp20 Varnish Backends on cp20 is OK: All 14 backends are healthy [01:24:15] PROBLEM - mw131 MediaWiki Rendering on mw131 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:24:23] PROBLEM - cp21 Stunnel HTTP for mw131 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:25:24] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.56, 6.41, 11.75 [01:25:25] RECOVERY - mw121 MediaWiki Rendering on mw121 is OK: HTTP OK: HTTP/1.1 200 OK - 29512 bytes in 0.279 second response time [01:25:35] RECOVERY - cp31 Stunnel HTTP for mw132 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.324 second response time [01:25:41] RECOVERY - cp31 Stunnel HTTP for mw121 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.318 second response time [01:25:44] RECOVERY - cp20 Stunnel HTTP for mw121 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 0.020 second response time [01:25:52] RECOVERY - cp21 Stunnel HTTP for mw121 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.022 second response time [01:26:27] PROBLEM - cp31 HTTP 4xx/5xx ERROR Rate on cp31 is CRITICAL: CRITICAL - NGINX Error Rate is 82% [01:26:57] RECOVERY - cp30 Stunnel HTTP for mw131 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 7.210 second response time [01:27:02] RECOVERY - cp31 Stunnel HTTP for mw131 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.336 second response time [01:27:10] PROBLEM - cp21 Varnish Backends on cp21 is CRITICAL: 2 backends are down. mw121 mw122 [01:27:34] PROBLEM - cp20 Varnish Backends on cp20 is CRITICAL: 4 backends are down. mw121 mw122 mw132 mw141 [01:27:56] RECOVERY - mw122 HTTPS on mw122 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 545 bytes in 0.023 second response time [01:28:11] RECOVERY - mw122 MediaWiki Rendering on mw122 is OK: HTTP OK: HTTP/1.1 200 OK - 29512 bytes in 0.504 second response time [01:28:22] RECOVERY - cp31 HTTP 4xx/5xx ERROR Rate on cp31 is OK: OK - NGINX Error Rate is 30% [01:29:28] PROBLEM - mw121 MediaWiki Rendering on mw121 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 1595 bytes in 0.042 second response time [01:29:54] RECOVERY - cp21 Stunnel HTTP for mw132 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.020 second response time [01:30:03] RECOVERY - cp21 Stunnel HTTP for mw142 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.018 second response time [01:30:07] RECOVERY - mw142 MediaWiki Rendering on mw142 is OK: HTTP OK: HTTP/1.1 200 OK - 29512 bytes in 0.192 second response time [01:30:08] RECOVERY - cp20 Stunnel HTTP for mw142 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 0.023 second response time [01:30:54] PROBLEM - cp30 Stunnel HTTP for mw122 on cp30 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 328 bytes in 5.567 second response time [01:31:22] RECOVERY - mw121 MediaWiki Rendering on mw121 is OK: HTTP OK: HTTP/1.1 200 OK - 29512 bytes in 0.327 second response time [01:31:24] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 15.93, 9.23, 10.95 [01:31:33] PROBLEM - cp20 Stunnel HTTP for mw122 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:31:46] PROBLEM - cp21 Stunnel HTTP for mw122 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:32:30] PROBLEM - mw122 MediaWiki Rendering on mw122 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:32:31] RECOVERY - cp21 Stunnel HTTP for mw131 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.017 second response time [01:32:32] RECOVERY - mw131 MediaWiki Rendering on mw131 is OK: HTTP OK: HTTP/1.1 200 OK - 29512 bytes in 0.211 second response time [01:32:58] RECOVERY - cp20 Stunnel HTTP for mw131 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 0.017 second response time [01:34:11] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.35, 2.56, 2.20 [01:34:58] RECOVERY - cp30 Stunnel HTTP for mw122 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 5.311 second response time [01:35:03] RECOVERY - cp21 Varnish Backends on cp21 is OK: All 14 backends are healthy [01:35:33] RECOVERY - cp20 Stunnel HTTP for mw122 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.022 second response time [01:35:45] RECOVERY - cp21 Stunnel HTTP for mw122 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.019 second response time [01:35:49] RECOVERY - cp31 Varnish Backends on cp31 is OK: All 14 backends are healthy [01:36:34] RECOVERY - mw122 MediaWiki Rendering on mw122 is OK: HTTP OK: HTTP/1.1 200 OK - 29512 bytes in 0.349 second response time [01:36:51] RECOVERY - cp31 Stunnel HTTP for mw122 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.323 second response time [01:37:43] RECOVERY - cp30 Varnish Backends on cp30 is OK: All 14 backends are healthy [01:39:34] RECOVERY - cp20 Varnish Backends on cp20 is OK: All 14 backends are healthy [01:39:59] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 3.26, 2.03, 1.46 [01:40:11] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.73, 3.97, 3.00 [01:41:26] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.70, 9.90, 8.32 [01:43:52] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.89, 1.97, 1.58 [01:44:11] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 6.35, 4.58, 3.42 [01:45:18] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.83, 9.47, 8.54 [01:47:46] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.31, 1.63, 1.53 [01:50:06] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.19, 1.64, 1.26 [01:52:04] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.51, 1.53, 1.26 [01:52:07] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.13, 10.47, 9.30 [01:53:39] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 3.06, 2.58, 1.95 [01:54:07] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.65, 3.47, 2.77 [01:55:59] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 9.56, 9.94, 9.34 [01:56:07] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.99, 3.14, 2.73 [01:57:33] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.96, 1.96, 1.82 [01:57:57] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.75, 1.76, 1.46 [01:59:29] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 3.59, 2.73, 2.13 [01:59:53] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 17.51, 13.93, 11.10 [01:59:55] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.28, 1.55, 1.42 [02:09:13] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.26, 1.72, 1.91 [02:09:38] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.53, 4.28, 3.51 [02:11:32] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.54, 3.93, 3.47 [02:13:09] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.13, 1.85, 1.91 [02:15:09] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.12, 1.56, 1.80 [02:17:16] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.75, 3.26, 3.31 [02:19:09] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 24.17, 6.82, 3.48 [02:21:07] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.50, 3.49, 3.39 [02:24:56] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 3.15, 3.35, 3.37 [02:28:46] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.52, 3.70, 3.52 [02:31:12] PROBLEM - cp21 Stunnel HTTP for mw122 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [02:32:35] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.39, 3.10, 3.31 [02:32:45] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.49, 10.89, 11.91 [02:33:16] RECOVERY - cp21 Stunnel HTTP for mw122 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 6.607 second response time [02:35:18] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.39, 3.60, 3.96 [02:36:37] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 14.65, 11.42, 11.80 [02:37:18] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.69, 4.01, 4.06 [02:38:33] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.26, 11.39, 11.76 [02:39:18] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.10, 3.58, 3.89 [02:40:32] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 19.74, 13.76, 12.54 [02:42:09] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.16, 3.47, 3.41 [02:45:18] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 6.00, 4.32, 4.05 [02:47:18] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.53, 3.63, 3.83 [02:49:16] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.02, 1.59, 1.37 [02:51:16] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.29, 1.38, 1.32 [02:57:18] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 0.76, 2.20, 3.12 [02:58:07] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 6.94, 5.37, 4.20 [02:59:16] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.34, 1.91, 1.60 [02:59:58] PROBLEM - cp30 Stunnel HTTP for mw122 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [03:01:09] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.53, 1.73, 1.96 [03:01:18] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.26, 3.19, 3.29 [03:01:57] RECOVERY - cp30 Stunnel HTTP for mw122 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 4.271 second response time [03:03:09] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 4.94, 2.79, 2.30 [03:03:16] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.72, 1.43, 1.49 [03:03:18] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 3.02, 3.12, 3.26 [03:04:07] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.16, 3.91, 3.90 [03:07:09] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.18, 1.79, 1.99 [03:10:07] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.57, 3.66, 3.74 [03:12:07] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.29, 3.45, 3.28 [03:12:07] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.45, 3.45, 3.64 [03:14:01] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.98, 3.67, 3.38 [03:15:55] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.89, 4.15, 3.59 [03:17:09] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.43, 1.80, 1.87 [03:19:09] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.41, 1.67, 1.82 [03:19:43] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.12, 3.49, 3.47 [03:20:07] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.03, 3.82, 3.75 [03:21:09] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.79, 1.98, 1.91 [03:21:37] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.86, 3.25, 3.38 [03:22:07] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.56, 3.68, 3.71 [03:23:09] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.97, 1.96, 1.91 [03:24:07] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.96, 3.99, 3.81 [03:25:09] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.20, 2.09, 1.96 [03:25:26] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.82, 3.68, 3.54 [03:26:07] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.84, 3.64, 3.71 [03:27:09] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.16, 1.83, 1.89 [03:28:07] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 8.64, 5.29, 4.28 [03:29:18] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 6.00, 4.11, 3.68 [03:29:30] PROBLEM - mw122 MediaWiki Rendering on mw122 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [03:29:40] PROBLEM - cp31 Stunnel HTTP for mw122 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [03:29:43] PROBLEM - cp21 Stunnel HTTP for mw122 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [03:30:52] PROBLEM - cp20 Stunnel HTTP for mw122 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [03:30:58] PROBLEM - cp30 Stunnel HTTP for mw122 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [03:31:09] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 4.98, 2.70, 2.16 [03:31:18] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.80, 3.87, 3.64 [03:32:07] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.00, 3.97, 3.96 [03:32:54] RECOVERY - cp20 Stunnel HTTP for mw122 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 7.803 second response time [03:32:57] RECOVERY - cp30 Stunnel HTTP for mw122 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 4.625 second response time [03:33:39] RECOVERY - mw122 MediaWiki Rendering on mw122 is OK: HTTP OK: HTTP/1.1 200 OK - 29513 bytes in 6.131 second response time [03:33:49] RECOVERY - cp31 Stunnel HTTP for mw122 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 5.443 second response time [03:33:53] RECOVERY - cp21 Stunnel HTTP for mw122 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 3.713 second response time [03:37:09] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.59, 1.97, 1.98 [03:38:07] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.64, 3.92, 3.87 [03:39:18] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.48, 3.82, 3.61 [03:41:18] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.52, 3.66, 3.57 [03:45:09] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.25, 1.31, 1.63 [03:49:18] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 3.06, 3.23, 3.40 [03:51:09] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 3.60, 2.54, 2.01 [03:53:18] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.93, 4.36, 3.82 [03:56:07] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.11, 3.54, 4.00 [03:57:09] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 0.87, 1.80, 1.88 [03:57:18] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.05, 3.76, 3.75 [03:58:07] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.10, 4.45, 4.32 [03:59:18] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.27, 4.17, 3.89 [04:02:07] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 1.19, 2.83, 3.69 [04:05:09] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.07, 1.34, 1.63 [04:05:18] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.04, 3.36, 3.68 [04:06:07] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.32, 2.40, 3.30 [04:08:32] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.41, 10.40, 11.65 [04:10:32] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 14.08, 11.69, 11.96 [04:13:18] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.28, 3.69, 3.64 [04:14:32] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.60, 10.59, 11.49 [04:15:03] [02puppet] 07paladox closed pull request 03#2700: matomo: use debian package for composer - 13https://github.com/miraheze/puppet/pull/2700 [04:15:04] [url] Page not found · GitHub · GitHub | github.com [04:15:05] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/ebbd0281dd0a...41c302cfe0d1 [04:15:05] [url] Comparing ebbd0281dd0a...41c302cfe0d1 · miraheze/puppet · GitHub | github.com [04:15:06] [02miraheze/puppet] 07Universal-Omega 0341c302c - matomo: use debian package for composer (#2700) [04:15:18] [02puppet] 07paladox closed pull request 03#2701: reports: use debian package for composer - 13https://github.com/miraheze/puppet/pull/2701 [04:15:19] ... [04:15:20] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/41c302cfe0d1...13d63debba3a [04:15:20] [url] Comparing 41c302cfe0d1...13d63debba3a · miraheze/puppet · GitHub | github.com [04:15:21] [02miraheze/puppet] 07Universal-Omega 0313d63de - reports: use debian package for composer (#2701) [04:17:55] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.99, 1.86, 1.42 [04:19:18] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.39, 3.50, 3.66 [04:19:53] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.98, 1.55, 1.36 [04:26:32] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 16.17, 11.67, 11.17 [04:27:18] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 10.99, 5.17, 4.12 [04:27:39] PROBLEM - mw122 MediaWiki Rendering on mw122 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [04:28:35] PROBLEM - cp20 Stunnel HTTP for mw122 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [04:30:34] RECOVERY - cp20 Stunnel HTTP for mw122 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 4.730 second response time [04:31:44] RECOVERY - mw122 MediaWiki Rendering on mw122 is OK: HTTP OK: HTTP/1.1 200 OK - 29520 bytes in 2.034 second response time [04:32:11] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 1.64, 2.90, 3.96 [04:34:32] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.01, 10.97, 11.26 [04:36:46] PROBLEM - cp31 Stunnel HTTP for mw122 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [04:38:11] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.17, 3.56, 3.90 [04:38:50] RECOVERY - cp31 Stunnel HTTP for mw122 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 9.564 second response time [04:40:32] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 16.53, 13.01, 12.04 [04:42:07] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 7.46, 4.74, 3.27 [04:43:11] PROBLEM - cp31 Stunnel HTTP for mw122 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [04:43:39] PROBLEM - cp30 Stunnel HTTP for mw122 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [04:43:50] PROBLEM - cp20 Stunnel HTTP for mw122 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [04:44:02] PROBLEM - cp21 Stunnel HTTP for mw122 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [04:45:13] RECOVERY - cp31 Stunnel HTTP for mw122 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 6.939 second response time [04:45:30] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 3.09, 1.92, 1.41 [04:45:34] RECOVERY - cp30 Stunnel HTTP for mw122 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.343 second response time [04:45:45] RECOVERY - cp20 Stunnel HTTP for mw122 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.021 second response time [04:46:02] RECOVERY - cp21 Stunnel HTTP for mw122 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 2.144 second response time [04:46:07] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.47, 3.46, 3.08 [04:46:32] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.43, 11.48, 11.71 [04:47:27] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.80, 1.75, 1.40 [04:48:07] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 3.05, 3.22, 3.03 [04:51:21] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.45, 1.66, 1.44 [04:58:32] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 15.35, 11.89, 11.34 [04:59:11] PROBLEM - cp31 Stunnel HTTP for mw122 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [04:59:17] PROBLEM - cp30 Stunnel HTTP for mw122 on cp30 is CRITICAL: HTTP CRITICAL - No data received from host [05:00:07] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.22, 3.41, 3.19 [05:00:11] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 1.22, 2.96, 3.99 [05:00:17] PROBLEM - mw122 MediaWiki Rendering on mw122 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [05:01:47] PROBLEM - cp20 Stunnel HTTP for mw122 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [05:02:07] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 1.84, 2.90, 3.04 [05:02:21] RECOVERY - mw122 MediaWiki Rendering on mw122 is OK: HTTP OK: HTTP/1.1 200 OK - 29513 bytes in 7.647 second response time [05:02:32] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.29, 10.68, 10.96 [05:03:08] RECOVERY - cp30 Stunnel HTTP for mw122 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 2.775 second response time [05:03:13] RECOVERY - cp31 Stunnel HTTP for mw122 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 2.503 second response time [05:03:47] RECOVERY - cp20 Stunnel HTTP for mw122 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 3.610 second response time [05:06:32] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.32, 10.99, 10.91 [05:08:32] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.40, 10.50, 10.76 [05:10:32] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.95, 11.39, 11.04 [05:14:11] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.18, 3.11, 3.44 [05:14:32] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.41, 11.24, 11.15 [05:18:11] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.88, 3.51, 3.53 [05:20:11] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.12, 3.01, 3.34 [05:20:32] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.34, 11.92, 11.46 [05:22:32] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.86, 10.82, 11.11 [05:25:49] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.09, 2.04, 1.49 [05:26:11] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.90, 3.46, 3.45 [05:27:48] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.75, 1.59, 1.38 [05:28:11] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 1.62, 2.71, 3.17 [05:29:06] PROBLEM - mw141 MediaWiki Rendering on mw141 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [05:29:27] PROBLEM - cp31 Stunnel HTTP for mw121 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [05:29:28] PROBLEM - cp30 Stunnel HTTP for mw121 on cp30 is CRITICAL: HTTP CRITICAL - No data received from host [05:29:53] PROBLEM - cp20 Stunnel HTTP for mw121 on cp20 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 328 bytes in 0.011 second response time [05:29:53] PROBLEM - mw121 MediaWiki Rendering on mw121 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 1595 bytes in 2.802 second response time [05:30:32] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.03, 10.20, 10.58 [05:31:41] PROBLEM - cp31 Varnish Backends on cp31 is CRITICAL: 3 backends are down. mw121 mw122 mw141 [05:31:43] PROBLEM - cp30 Varnish Backends on cp30 is CRITICAL: 3 backends are down. mw121 mw122 mw141 [05:31:48] RECOVERY - mw121 MediaWiki Rendering on mw121 is OK: HTTP OK: HTTP/1.1 200 OK - 29512 bytes in 0.269 second response time [05:31:50] RECOVERY - cp20 Stunnel HTTP for mw121 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.021 second response time [05:32:32] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 4.89, 8.05, 9.74 [05:33:05] RECOVERY - mw141 MediaWiki Rendering on mw141 is OK: HTTP OK: HTTP/1.1 200 OK - 29512 bytes in 0.442 second response time [05:33:19] RECOVERY - cp30 Stunnel HTTP for mw121 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.334 second response time [05:33:25] RECOVERY - cp31 Stunnel HTTP for mw121 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 0.338 second response time [05:33:42] RECOVERY - cp31 Varnish Backends on cp31 is OK: All 14 backends are healthy [05:33:43] RECOVERY - cp30 Varnish Backends on cp30 is OK: All 14 backends are healthy [05:36:32] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.50, 9.96, 10.10 [05:38:32] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 10.15, 9.75, 9.99 [05:42:32] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.34, 10.28, 10.17 [05:44:32] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.38, 9.23, 9.80 [05:45:08] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.79, 3.62, 3.28 [05:47:07] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.91, 3.29, 3.20 [05:55:00] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.29, 3.65, 3.42 [05:56:59] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.94, 4.37, 3.70 [05:58:46] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.06, 4.11, 3.29 [06:00:17] PROBLEM - cp21 Varnish Backends on cp21 is CRITICAL: 1 backends are down. mw131 [06:02:35] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.37, 3.59, 3.26 [06:04:29] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 3.09, 3.40, 3.22 [06:08:16] RECOVERY - cp21 Varnish Backends on cp21 is OK: All 14 backends are healthy [06:09:25] PROBLEM - test131 Current Load on test131 is CRITICAL: CRITICAL - load average: 2.56, 1.52, 0.95 [06:09:59] PROBLEM - creativecommons.id - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:11:21] PROBLEM - cp20 Varnish Backends on cp20 is CRITICAL: 1 backends are down. mw121 [06:12:09] PROBLEM - unmade.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:12:19] PROBLEM - cp21 Varnish Backends on cp21 is CRITICAL: 2 backends are down. mw121 mw132 [06:13:22] RECOVERY - cp20 Varnish Backends on cp20 is OK: All 14 backends are healthy [06:13:25] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 1.69, 1.69, 1.16 [06:15:01] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.79, 3.53, 3.29 [06:16:55] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 1.73, 2.83, 3.06 [06:19:13] RECOVERY - cp21 Varnish Backends on cp21 is OK: All 14 backends are healthy [06:19:32] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::4c25/cpweb [06:19:58] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.06, 1.65, 1.28 [06:21:56] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.87, 1.39, 1.23 [06:21:57] PROBLEM - wikileague.cf - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:23:41] PROBLEM - cp20 Varnish Backends on cp20 is CRITICAL: 1 backends are down. mw131 [06:25:48] PROBLEM - nonbinary.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:27:25] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 1.89, 1.71, 1.45 [06:29:25] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 1.42, 1.65, 1.46 [06:29:33] PROBLEM - wiki.kachow.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:29:48] PROBLEM - trollpasta.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:33:32] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [06:34:20] PROBLEM - cp21 Varnish Backends on cp21 is CRITICAL: 2 backends are down. mw121 mw132 [06:35:27] PROBLEM - cp20 SSH on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:36:51] PROBLEM - cp20 HTTPS on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:36:59] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.99, 3.57, 3.23 [06:37:10] PROBLEM - www.project-patterns.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:37:26] RECOVERY - cp20 SSH on cp20 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [06:38:06] PROBLEM - worldsanskrit.net - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:38:52] RECOVERY - cp20 HTTPS on cp20 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 3407 bytes in 7.260 second response time [06:38:54] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.84, 3.37, 3.20 [06:40:03] PROBLEM - mh142.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:41:22] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 15.51, 12.40, 9.87 [06:41:41] PROBLEM - largedu.eu.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:41:55] RECOVERY - unmade.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [06:42:18] PROBLEM - wiki.minecraftathome.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:43:37] PROBLEM - bn.wikiyri.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:43:49] RECOVERY - cp20 Varnish Backends on cp20 is OK: All 14 backends are healthy [06:44:33] PROBLEM - phgalaxy.eu.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:45:02] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [06:45:05] PROBLEM - wiki.anglish.info - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:45:14] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.28, 11.71, 10.20 [06:45:24] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.19, 8.27, 11.64 [06:45:57] PROBLEM - wiki.ciptamedia.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:46:45] PROBLEM - betaheze.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:46:56] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 0.72, 1.10, 0.86 [06:47:10] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 6.47, 9.85, 9.70 [06:51:24] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.26, 9.62, 10.97 [06:51:32] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::1b80/cpweb [06:51:55] RECOVERY - wikileague.cf - LetsEncrypt on sslhost is OK: OK - Certificate 'wikileague.cf' will expire on Mon 22 Aug 2022 22:21:46 GMT +0000. [06:52:04] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.71, 1.72, 1.20 [06:52:50] PROBLEM - cp21 Stunnel HTTP for phab121 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [06:53:32] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [06:54:01] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.37, 1.48, 1.18 [06:54:50] RECOVERY - cp21 Stunnel HTTP for phab121 on cp21 is OK: HTTP OK: Status line output matched "500" - 2855 bytes in 1.086 second response time [06:55:12] RECOVERY - nonbinary.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'nonbinary.wiki' will expire on Tue 23 Aug 2022 02:51:23 GMT +0000. [06:55:59] PROBLEM - gametheorywiki.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:57:38] PROBLEM - cp20 Varnish Backends on cp20 is CRITICAL: 2 backends are down. mw121 mw141 [06:58:31] RECOVERY - wiki.kachow.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.kachow.org' will expire on Wed 12 Oct 2022 04:17:08 GMT +0000. [06:58:48] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CRITICAL - load average: 2.09, 2.33, 1.46 [06:58:58] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 3.97, 4.05, 3.43 [07:00:42] PROBLEM - cp21 Current Load on cp21 is WARNING: WARNING - load average: 1.61, 1.94, 1.41 [07:00:53] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.90, 3.64, 3.33 [07:01:33] PROBLEM - cp21 Stunnel HTTP for mw122 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:01:47] PROBLEM - www.zenbuddhism.info - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:01:55] PROBLEM - mcwiki.kirbygang.tk - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:02:27] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::4c25/cpweb [07:02:36] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 0.91, 1.62, 1.35 [07:02:43] PROBLEM - test3.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:02:47] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.28, 3.26, 3.23 [07:04:23] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [07:04:31] PROBLEM - knifepointhorror.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:05:40] RECOVERY - cp21 Stunnel HTTP for mw122 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 2.037 second response time [07:05:44] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.55, 1.88, 1.49 [07:07:07] PROBLEM - www.project-patterns.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'project-patterns.com' expires in 15 day(s) (Fri 19 Aug 2022 17:20:05 GMT +0000). [07:07:36] RECOVERY - creativecommons.id - LetsEncrypt on sslhost is OK: OK - Certificate 'creativecommons.id' will expire on Thu 27 Oct 2022 05:20:13 GMT +0000. [07:07:41] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.82, 1.50, 1.39 [07:07:51] RECOVERY - worldsanskrit.net - LetsEncrypt on sslhost is OK: OK - Certificate 'worldsanskrit.net' will expire on Sat 24 Sep 2022 13:22:32 GMT +0000. [07:08:12] PROBLEM - cp20 SSH on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:08:17] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 2 datacenters are down: 2001:41d0:801:2000::4c25/cpweb, 2001:41d0:801:2000::1b80/cpweb [07:08:42] RECOVERY - mh142.com - LetsEncrypt on sslhost is OK: OK - Certificate 'mh142.com' will expire on Tue 23 Aug 2022 00:06:10 GMT +0000. [07:09:39] RECOVERY - cp20 Varnish Backends on cp20 is OK: All 14 backends are healthy [07:10:18] RECOVERY - cp20 SSH on cp20 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [07:11:16] RECOVERY - largedu.eu.org - LetsEncrypt on sslhost is OK: OK - Certificate 'largedu.eu.org' will expire on Sun 30 Oct 2022 14:46:40 GMT +0000. [07:11:16] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.98, 1.89, 1.34 [07:11:38] RECOVERY - wiki.minecraftathome.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.minecraftathome.com' will expire on Wed 24 Aug 2022 02:32:00 GMT +0000. [07:12:32] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.56, 12.40, 9.68 [07:13:16] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.53, 1.61, 1.30 [07:13:35] RECOVERY - bn.wikiyri.org - LetsEncrypt on sslhost is OK: OK - Certificate 'bn.wikiyri.org' will expire on Mon 10 Oct 2022 04:05:24 GMT +0000. [07:13:36] PROBLEM - cp20 Varnish Backends on cp20 is CRITICAL: 1 backends are down. mw141 [07:14:28] RECOVERY - wiki.ciptamedia.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.ciptamedia.org' will expire on Tue 23 Aug 2022 08:44:56 GMT +0000. [07:15:03] RECOVERY - wiki.anglish.info - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.anglish.info' will expire on Wed 24 Aug 2022 03:18:35 GMT +0000. [07:16:29] PROBLEM - betaheze.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'betaheze.org' expires in 15 day(s) (Fri 19 Aug 2022 17:58:05 GMT +0000). [07:19:16] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.94, 1.98, 1.52 [07:19:47] PROBLEM - cp20 SSH on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:19:50] PROBLEM - cp20 HTTPS on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:20:07] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.10, 3.42, 3.34 [07:21:16] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.97, 1.59, 1.44 [07:21:46] RECOVERY - cp20 SSH on cp20 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [07:22:07] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.88, 3.26, 3.28 [07:22:32] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.30, 11.87, 10.79 [07:22:45] PROBLEM - reviews.thejoshmeister.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:23:47] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [07:23:56] RECOVERY - cp20 HTTPS on cp20 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 3407 bytes in 7.278 second response time [07:23:57] PROBLEM - metroidpedia.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:25:30] PROBLEM - dcmultiverse.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:25:35] RECOVERY - gametheorywiki.org - LetsEncrypt on sslhost is OK: OK - Certificate 'gametheorywiki.org' will expire on Sun 25 Sep 2022 20:40:02 GMT +0000. [07:25:53] PROBLEM - cp20 Stunnel HTTP for mw131 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:26:02] PROBLEM - cp21 HTTPS on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:27:54] PROBLEM - cp21 Stunnel HTTP for matomo131 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:28:07] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 8.62, 4.90, 3.78 [07:28:32] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.95, 11.74, 10.96 [07:30:02] RECOVERY - cp21 HTTPS on cp21 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 3406 bytes in 0.026 second response time [07:30:15] RECOVERY - cp20 Stunnel HTTP for mw131 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.017 second response time [07:30:18] PROBLEM - ecole.science - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:31:02] RECOVERY - mcwiki.kirbygang.tk - LetsEncrypt on sslhost is OK: OK - Certificate 'mcwiki.kirbygang.tk' will expire on Wed 05 Oct 2022 22:00:10 GMT +0000. [07:31:14] RECOVERY - www.zenbuddhism.info - LetsEncrypt on sslhost is OK: OK - Certificate 'www.zenbuddhism.info' will expire on Sat 17 Sep 2022 20:26:18 GMT +0000. [07:31:28] RECOVERY - test3.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [07:32:07] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 1.49, 3.24, 3.36 [07:32:10] PROBLEM - rare.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:32:38] PROBLEM - wikimoma.art - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:32:38] PROBLEM - arrieretoile.fr - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:32:51] RECOVERY - cp21 Stunnel HTTP for matomo131 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 99061 bytes in 0.156 second response time [07:34:16] RECOVERY - knifepointhorror.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'knifepointhorror.wiki' will expire on Sun 30 Oct 2022 15:35:11 GMT +0000. [07:35:24] PROBLEM - cp21 Stunnel HTTP for mwtask141 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [07:36:19] PROBLEM - cp20 Stunnel HTTP for mail121 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [07:37:10] PROBLEM - www.project-patterns.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:37:23] RECOVERY - cp21 Stunnel HTTP for mwtask141 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15950 bytes in 1.042 second response time [07:37:24] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.29, 10.39, 11.87 [07:38:18] RECOVERY - cp20 Stunnel HTTP for mail121 on cp20 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 427 bytes in 0.013 second response time [07:38:29] PROBLEM - atnarsia.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:38:32] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.59, 11.54, 11.74 [07:38:55] PROBLEM - cp20 HTTPS on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:39:27] PROBLEM - cp21 Stunnel HTTP for matomo131 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [07:41:33] RECOVERY - cp21 Stunnel HTTP for matomo131 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 99061 bytes in 1.167 second response time [07:41:47] PROBLEM - spcodex.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:42:07] RECOVERY - phgalaxy.eu.org - LetsEncrypt on sslhost is OK: OK - Certificate 'phgalaxy.eu.org' will expire on Sun 02 Oct 2022 05:33:18 GMT +0000. [07:42:11] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.16, 3.21, 3.99 [07:42:32] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 3.96, 7.64, 10.11 [07:43:24] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 24.61, 14.92, 12.91 [07:45:10] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::1b80/cpweb [07:45:24] PROBLEM - wiki.yumeka.icu - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:45:34] PROBLEM - eng.archiopedia.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:46:10] PROBLEM - cp20 Stunnel HTTP for mw122 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [07:46:13] PROBLEM - wiki.sketch.town - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:46:35] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.49, 3.79, 3.35 [07:47:06] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [07:47:23] PROBLEM - wiki.anglish.info - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:47:47] PROBLEM - ambientguitar.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:48:15] RECOVERY - cp20 Stunnel HTTP for mw122 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 3.076 second response time [07:48:30] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.75, 3.31, 3.22 [07:49:05] RECOVERY - cp20 HTTPS on cp20 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 3407 bytes in 0.016 second response time [07:49:56] PROBLEM - mario.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:50:11] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.92, 3.91, 3.96 [07:50:51] RECOVERY - cp21 Varnish Backends on cp21 is OK: All 14 backends are healthy [07:50:51] PROBLEM - wiki.mastodon.kr - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:51:24] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 5.16, 9.23, 11.48 [07:52:20] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.94, 3.79, 3.45 [07:52:29] RECOVERY - reviews.thejoshmeister.com - LetsEncrypt on sslhost is OK: OK - Certificate 'reviews.thejoshmeister.com' will expire on Thu 29 Sep 2022 08:42:34 GMT +0000. [07:53:56] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::4c25/cpweb [07:54:41] RECOVERY - dcmultiverse.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [07:54:58] PROBLEM - test2.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:56:09] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.71, 3.94, 3.56 [07:56:48] PROBLEM - zh.internetpedia.tk - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:57:23] RECOVERY - trollpasta.com - LetsEncrypt on sslhost is OK: OK - Certificate 'trollpasta.com' will expire on Mon 10 Oct 2022 06:29:05 GMT +0000. [07:57:24] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 24.12, 14.72, 12.69 [07:58:18] PROBLEM - cp21 Varnish Backends on cp21 is CRITICAL: 3 backends are down. mw121 mw131 mw132 [07:58:56] PROBLEM - cp20 SSH on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:59:14] PROBLEM - mw122 MediaWiki Rendering on mw122 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:59:39] RECOVERY - ecole.science - LetsEncrypt on sslhost is OK: OK - Certificate 'ecole.science' will expire on Mon 22 Aug 2022 21:07:09 GMT +0000. [08:00:07] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.42, 3.74, 3.63 [08:00:36] PROBLEM - cp21 Stunnel HTTP for reports121 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [08:00:57] RECOVERY - cp20 SSH on cp20 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [08:01:11] RECOVERY - mw122 MediaWiki Rendering on mw122 is OK: HTTP OK: HTTP/1.1 200 OK - 29512 bytes in 0.706 second response time [08:01:21] RECOVERY - wikimoma.art - LetsEncrypt on sslhost is OK: OK - Certificate 'wikimoma.art' will expire on Sat 17 Sep 2022 19:04:53 GMT +0000. [08:01:21] RECOVERY - arrieretoile.fr - LetsEncrypt on sslhost is OK: OK - Certificate 'arrieretoile.fr' will expire on Thu 13 Oct 2022 04:37:30 GMT +0000. [08:02:06] RECOVERY - rare.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [08:02:36] RECOVERY - cp21 Stunnel HTTP for reports121 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 10996 bytes in 1.063 second response time [08:03:42] PROBLEM - cp20 Stunnel HTTP for phab121 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:04:07] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.02, 2.80, 3.26 [08:04:57] PROBLEM - cp20 Stunnel HTTP for mail121 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:05:37] RECOVERY - cp20 Stunnel HTTP for phab121 on cp20 is OK: HTTP OK: Status line output matched "500" - 2855 bytes in 0.095 second response time [08:07:01] PROBLEM - www.project-patterns.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'project-patterns.com' expires in 15 day(s) (Fri 19 Aug 2022 17:20:05 GMT +0000). [08:07:03] PROBLEM - cp20 Stunnel HTTP for mw131 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [08:07:06] RECOVERY - cp20 Stunnel HTTP for mail121 on cp20 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 427 bytes in 2.029 second response time [08:07:07] RECOVERY - atnarsia.com - LetsEncrypt on sslhost is OK: OK - Certificate 'atnarsia.com' will expire on Sun 25 Sep 2022 20:45:25 GMT +0000. [08:07:21] PROBLEM - cp20 Stunnel HTTP for mw122 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [08:07:34] PROBLEM - mystiverse.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:09:18] RECOVERY - cp20 Stunnel HTTP for mw122 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 1.091 second response time [08:09:21] RECOVERY - cp20 Stunnel HTTP for mw131 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 4.619 second response time [08:09:24] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 6.37, 8.45, 11.45 [08:10:07] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 11.34, 7.42, 4.98 [08:11:30] PROBLEM - cp20 Stunnel HTTP for mw132 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [08:13:16] PROBLEM - cp21 Stunnel HTTP for test131 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [08:13:21] PROBLEM - wiki.harlonserver.net - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:13:38] RECOVERY - cp20 Stunnel HTTP for mw132 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 3.035 second response time [08:13:41] PROBLEM - wc.miraheze.org on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:13:57] PROBLEM - guia.cineastas.pt - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:15:09] RECOVERY - eng.archiopedia.org - LetsEncrypt on sslhost is OK: OK - Certificate 'eng.archiopedia.org' will expire on Sun 02 Oct 2022 05:35:50 GMT +0000. [08:15:24] RECOVERY - wiki.yumeka.icu - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.yumeka.icu' will expire on Sat 17 Sep 2022 18:24:18 GMT +0000. [08:15:30] RECOVERY - cp21 Stunnel HTTP for test131 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15954 bytes in 1.023 second response time [08:15:49] PROBLEM - avas.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:16:06] PROBLEM - betaheze.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:16:47] PROBLEM - cp21 Disk Space on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [08:17:26] RECOVERY - wiki.anglish.info - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.anglish.info' will expire on Wed 24 Aug 2022 03:18:35 GMT +0000. [08:17:32] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [08:17:41] RECOVERY - ambientguitar.org - LetsEncrypt on sslhost is OK: OK - Certificate 'ambientguitar.org' will expire on Mon 22 Aug 2022 22:13:35 GMT +0000. [08:18:15] PROBLEM - cp21 Stunnel HTTP for mw131 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:18:24] PROBLEM - cp21 Stunnel HTTP for mw132 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:18:42] RECOVERY - cp21 Disk Space on cp21 is OK: DISK OK - free space: / 10759 MB (27% inode=96%); [08:19:09] PROBLEM - cp20 Stunnel HTTP for mw131 on cp20 is CRITICAL: HTTP CRITICAL - No data received from host [08:19:12] PROBLEM - cp30 Stunnel HTTP for mw142 on cp30 is CRITICAL: HTTP CRITICAL - No data received from host [08:19:12] PROBLEM - cp30 Stunnel HTTP for mw132 on cp30 is CRITICAL: HTTP CRITICAL - No data received from host [08:19:14] PROBLEM - mw122 MediaWiki Rendering on mw122 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:19:17] PROBLEM - mw132 MediaWiki Rendering on mw132 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:19:18] PROBLEM - mw142 HTTPS on mw142 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:19:23] PROBLEM - cp30 Stunnel HTTP for mw122 on cp30 is CRITICAL: HTTP CRITICAL - No data received from host [08:19:24] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 2.76, 6.27, 9.31 [08:19:30] PROBLEM - cp30 Stunnel HTTP for mw131 on cp30 is CRITICAL: HTTP CRITICAL - No data received from host [08:19:31] PROBLEM - cp31 Stunnel HTTP for mw131 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:19:36] PROBLEM - wiki.zymonic.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:19:38] PROBLEM - cp20 Stunnel HTTP for mw141 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:19:46] PROBLEM - cp21 Stunnel HTTP for mw122 on cp21 is CRITICAL: HTTP CRITICAL - No data received from host [08:19:47] PROBLEM - cp21 Stunnel HTTP for mw121 on cp21 is CRITICAL: HTTP CRITICAL - No data received from host [08:19:49] RECOVERY - mario.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [08:19:50] PROBLEM - cp21 Stunnel HTTP for test131 on cp21 is CRITICAL: HTTP CRITICAL - No data received from host [08:19:51] PROBLEM - cp31 Stunnel HTTP for mw132 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:19:58] PROBLEM - cp21 Stunnel HTTP for mw141 on cp21 is CRITICAL: HTTP CRITICAL - No data received from host [08:20:00] PROBLEM - mw121 MediaWiki Rendering on mw121 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:20:02] PROBLEM - cp30 Stunnel HTTP for test131 on cp30 is CRITICAL: HTTP CRITICAL - No data received from host [08:20:08] PROBLEM - cp21 Stunnel HTTP for reports121 on cp21 is CRITICAL: HTTP CRITICAL - No data received from host [08:20:09] PROBLEM - cp31 Stunnel HTTP for mw122 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:20:11] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 0.38, 2.12, 3.56 [08:20:12] PROBLEM - mw121 HTTPS on mw121 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:20:12] PROBLEM - cp30 Stunnel HTTP for phab121 on cp30 is CRITICAL: HTTP CRITICAL - No data received from host [08:20:22] PROBLEM - cp30 HTTP 4xx/5xx ERROR Rate on cp30 is WARNING: WARNING - NGINX Error Rate is 49% [08:20:23] PROBLEM - mw122 HTTPS on mw122 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:20:23] PROBLEM - cp31 HTTPS on cp31 is CRITICAL: HTTP CRITICAL: HTTP/1.1 503 Backend fetch failed - 6116 bytes in 0.315 second response time [08:20:26] PROBLEM - cp20 Stunnel HTTP for mw132 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:20:26] PROBLEM - gluster102 PowerDNS Recursor on gluster102 is CRITICAL: CRITICAL - Plugin timed out while executing system call [08:20:32] PROBLEM - mw141 HTTPS on mw141 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:20:42] PROBLEM - mw131 MediaWiki Rendering on mw131 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:20:43] PROBLEM - cp31 Stunnel HTTP for mw141 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:20:49] PROBLEM - mw141 MediaWiki Rendering on mw141 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:21:01] PROBLEM - cp21 Stunnel HTTP for mw142 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:21:08] PROBLEM - cp20 HTTPS on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:21:10] PROBLEM - cp20 Stunnel HTTP for mw142 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:21:17] PROBLEM - cp21 HTTP 4xx/5xx ERROR Rate on cp21 is CRITICAL: CRITICAL - NGINX Error Rate is 67% [08:21:37] PROBLEM - cp31 HTTP 4xx/5xx ERROR Rate on cp31 is CRITICAL: CRITICAL - NGINX Error Rate is 96% [08:21:38] PROBLEM - mw142 MediaWiki Rendering on mw142 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:21:41] PROBLEM - cp31 Varnish Backends on cp31 is CRITICAL: 7 backends are down. mw121 mw122 mw131 mw132 mw141 mw142 mediawiki [08:21:43] PROBLEM - cp30 Varnish Backends on cp30 is CRITICAL: 7 backends are down. mw121 mw122 mw131 mw132 mw141 mw142 mediawiki [08:21:50] PROBLEM - cp30 Stunnel HTTP for mw141 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:21:54] PROBLEM - mw132 HTTPS on mw132 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:21:55] RECOVERY - mw121 MediaWiki Rendering on mw121 is OK: HTTP OK: HTTP/1.1 200 OK - 29512 bytes in 0.366 second response time [08:21:58] PROBLEM - cp31 Stunnel HTTP for mw142 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:22:00] PROBLEM - cp20 Stunnel HTTP for reports121 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [08:22:03] RECOVERY - cp30 Stunnel HTTP for test131 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15954 bytes in 0.319 second response time [08:22:08] RECOVERY - mw121 HTTPS on mw121 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 545 bytes in 0.008 second response time [08:22:10] PROBLEM - pokemonwiki.info - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:22:11] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 0.18, 1.46, 3.14 [08:22:13] RECOVERY - cp30 Stunnel HTTP for phab121 on cp30 is OK: HTTP OK: Status line output matched "500" - 2855 bytes in 0.296 second response time [08:22:18] RECOVERY - mw122 HTTPS on mw122 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 545 bytes in 0.014 second response time [08:22:22] RECOVERY - gluster102 PowerDNS Recursor on gluster102 is OK: DNS OK: 0.029 seconds response time. miraheze.org returns 198.244.148.90,2001:41d0:801:2000::1b80,2001:41d0:801:2000::4c25,51.195.220.68 [08:22:22] PROBLEM - cp30 HTTP 4xx/5xx ERROR Rate on cp30 is CRITICAL: CRITICAL - NGINX Error Rate is 93% [08:22:40] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 9.58, 6.60, 3.41 [08:23:09] RECOVERY - cp20 HTTPS on cp20 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 3407 bytes in 7.264 second response time [08:23:17] RECOVERY - mw122 MediaWiki Rendering on mw122 is OK: HTTP OK: HTTP/1.1 200 OK - 29512 bytes in 0.259 second response time [08:23:20] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 1.43, 2.03, 1.51 [08:23:21] RECOVERY - cp30 Stunnel HTTP for mw122 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 0.320 second response time [08:23:29] PROBLEM - cloud10 Current Load on cloud10 is WARNING: WARNING - load average: 42.61, 33.54, 19.46 [08:23:54] RECOVERY - cp21 Stunnel HTTP for mw122 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 1.024 second response time [08:23:56] RECOVERY - cp20 Stunnel HTTP for reports121 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 10996 bytes in 1.081 second response time [08:24:09] RECOVERY - cp31 Stunnel HTTP for mw122 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.310 second response time [08:24:20] RECOVERY - cp21 Stunnel HTTP for reports121 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 10996 bytes in 1.083 second response time [08:24:23] RECOVERY - wc.miraheze.org on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [08:24:40] RECOVERY - cp21 Stunnel HTTP for mw121 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.021 second response time [08:24:45] RECOVERY - test2.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [08:25:01] PROBLEM - mw131 HTTPS on mw131 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:25:10] RECOVERY - cp21 HTTP 4xx/5xx ERROR Rate on cp21 is OK: OK - NGINX Error Rate is 30% [08:25:17] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.40, 1.43, 1.35 [08:25:44] RECOVERY - zh.internetpedia.tk - LetsEncrypt on sslhost is OK: OK - Certificate 'zh.internetpedia.tk' will expire on Mon 22 Aug 2022 22:07:13 GMT +0000. [08:26:07] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 0.11, 1.68, 3.91 [08:26:20] RECOVERY - cp21 Stunnel HTTP for test131 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15954 bytes in 7.158 second response time [08:26:22] RECOVERY - cp30 HTTP 4xx/5xx ERROR Rate on cp30 is OK: OK - NGINX Error Rate is 37% [08:26:25] PROBLEM - cp20 Stunnel HTTP for mw121 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:26:26] PROBLEM - donkeykong.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:26:42] PROBLEM - en.famepedia.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:26:53] PROBLEM - aman.awiki.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:26:54] PROBLEM - cp20 Stunnel HTTP for phab121 on cp20 is CRITICAL: HTTP CRITICAL - No data received from host [08:27:13] PROBLEM - cp31 Stunnel HTTP for mw121 on cp31 is CRITICAL: HTTP CRITICAL - No data received from host [08:27:31] PROBLEM - gluster101 Gluster Disk Space on gluster101 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [08:27:34] PROBLEM - cp30 Stunnel HTTP for mw121 on cp30 is CRITICAL: HTTP CRITICAL - No data received from host [08:27:46] PROBLEM - wiki.kachow.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:28:04] PROBLEM - cp20 SSH on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:28:08] PROBLEM - mw121 MediaWiki Rendering on mw121 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:28:12] PROBLEM - allthetropes.orain.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:28:20] PROBLEM - cp31 Stunnel HTTP for mw122 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:28:25] PROBLEM - cp20 Stunnel HTTP for mwtask141 on cp20 is CRITICAL: HTTP CRITICAL - No data received from host [08:28:28] PROBLEM - publictestwiki.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:28:28] PROBLEM - mw121 HTTPS on mw121 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:28:36] PROBLEM - mw122 HTTPS on mw122 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:28:45] PROBLEM - cp30 Stunnel HTTP for mwtask141 on cp30 is CRITICAL: HTTP CRITICAL - No data received from host [08:28:47] PROBLEM - wiki.grottocenter.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:28:56] RECOVERY - mw141 MediaWiki Rendering on mw141 is OK: HTTP OK: HTTP/1.1 200 OK - 29512 bytes in 0.193 second response time [08:28:59] RECOVERY - mw131 MediaWiki Rendering on mw131 is OK: HTTP OK: HTTP/1.1 200 OK - 29513 bytes in 4.015 second response time [08:29:04] RECOVERY - mw131 HTTPS on mw131 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 545 bytes in 0.013 second response time [08:29:04] RECOVERY - cp31 Stunnel HTTP for mw141 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 2.751 second response time [08:29:09] RECOVERY - cp20 Stunnel HTTP for mw132 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 1.017 second response time [08:29:10] PROBLEM - cp21 Stunnel HTTP for mw122 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:29:15] PROBLEM - cp30 Stunnel HTTP for mw122 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:29:20] RECOVERY - cp31 Stunnel HTTP for mw121 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 8.160 second response time [08:29:27] PROBLEM - cp20 Stunnel HTTP for mail121 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:29:27] RECOVERY - gluster101 Gluster Disk Space on gluster101 is OK: DISK OK - free space: /mnt/mediawiki-static 1511313 MB (37% inode=84%); [08:29:28] RECOVERY - cp30 Stunnel HTTP for mw121 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 0.306 second response time [08:29:29] RECOVERY - cloud10 Current Load on cloud10 is OK: OK - load average: 29.61, 38.78, 26.94 [08:29:34] RECOVERY - cp30 Stunnel HTTP for mw131 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 0.335 second response time [08:29:34] RECOVERY - cp30 Stunnel HTTP for mw132 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 0.337 second response time [08:29:34] RECOVERY - cp30 Stunnel HTTP for mw142 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.317 second response time [08:29:39] RECOVERY - cp21 Stunnel HTTP for mw132 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 0.016 second response time [08:29:40] PROBLEM - cp20 HTTP 4xx/5xx ERROR Rate on cp20 is WARNING: WARNING - NGINX Error Rate is 46% [08:29:47] RECOVERY - mw132 MediaWiki Rendering on mw132 is OK: HTTP OK: HTTP/1.1 200 OK - 29512 bytes in 0.251 second response time [08:29:48] RECOVERY - mw142 MediaWiki Rendering on mw142 is OK: HTTP OK: HTTP/1.1 200 OK - 29512 bytes in 0.437 second response time [08:29:49] RECOVERY - mw142 HTTPS on mw142 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 545 bytes in 0.011 second response time [08:29:54] RECOVERY - cp30 Stunnel HTTP for mw141 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.315 second response time [08:29:56] PROBLEM - wiki.alathramc.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:29:59] PROBLEM - cp21 Stunnel HTTP for mw121 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:30:02] RECOVERY - mw121 MediaWiki Rendering on mw121 is OK: HTTP OK: HTTP/1.1 200 OK - 29512 bytes in 0.269 second response time [08:30:02] RECOVERY - cp20 Stunnel HTTP for mw142 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.023 second response time [08:30:06] RECOVERY - cp31 Stunnel HTTP for mw132 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.313 second response time [08:30:07] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.66, 1.66, 3.35 [08:30:09] RECOVERY - cp20 SSH on cp20 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [08:30:11] RECOVERY - cp31 Stunnel HTTP for mw131 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.319 second response time [08:30:16] RECOVERY - cp31 Stunnel HTTP for mw122 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.313 second response time [08:30:20] RECOVERY - mw132 HTTPS on mw132 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 545 bytes in 0.009 second response time [08:30:22] PROBLEM - cp30 HTTP 4xx/5xx ERROR Rate on cp30 is CRITICAL: CRITICAL - NGINX Error Rate is 93% [08:30:24] RECOVERY - mw121 HTTPS on mw121 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 545 bytes in 0.008 second response time [08:30:25] RECOVERY - cp31 Stunnel HTTP for mw142 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.312 second response time [08:30:28] PROBLEM - cp21 Stunnel HTTP for reports121 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [08:30:32] RECOVERY - mw122 HTTPS on mw122 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 545 bytes in 0.011 second response time [08:30:35] RECOVERY - cp21 Stunnel HTTP for mw141 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 1.033 second response time [08:30:44] PROBLEM - cp21 Stunnel HTTP for phab121 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [08:30:44] RECOVERY - mw141 HTTPS on mw141 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 545 bytes in 0.013 second response time [08:30:45] PROBLEM - cp20 Stunnel HTTP for test131 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [08:30:45] RECOVERY - cp30 Stunnel HTTP for mwtask141 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15956 bytes in 0.346 second response time [08:30:57] RECOVERY - cp20 Stunnel HTTP for mw121 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 1.043 second response time [08:30:57] RECOVERY - cp20 Stunnel HTTP for mw131 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 1.027 second response time [08:30:58] RECOVERY - cp20 Stunnel HTTP for phab121 on cp20 is OK: HTTP OK: Status line output matched "500" - 2855 bytes in 3.066 second response time [08:31:05] PROBLEM - tep.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:31:09] RECOVERY - cp30 Stunnel HTTP for mw122 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.314 second response time [08:31:15] RECOVERY - cp20 Stunnel HTTP for mw141 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.021 second response time [08:31:42] RECOVERY - cp21 Stunnel HTTP for mw122 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 2.031 second response time [08:31:57] RECOVERY - cp20 Stunnel HTTP for mail121 on cp20 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 427 bytes in 0.011 second response time [08:32:22] RECOVERY - cp30 HTTP 4xx/5xx ERROR Rate on cp30 is OK: OK - NGINX Error Rate is 1% [08:32:28] RECOVERY - cp21 Stunnel HTTP for reports121 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 10996 bytes in 1.082 second response time [08:32:30] RECOVERY - cp31 HTTPS on cp31 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 3387 bytes in 0.414 second response time [08:32:35] RECOVERY - cp21 Stunnel HTTP for mw121 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 7.213 second response time [08:32:35] PROBLEM - burnout.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:32:38] PROBLEM - cp20 HTTP 4xx/5xx ERROR Rate on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [08:32:40] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 1.01, 5.91, 5.42 [08:32:45] RECOVERY - cp20 Stunnel HTTP for test131 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15954 bytes in 3.055 second response time [08:32:50] RECOVERY - cp21 Stunnel HTTP for mw142 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.024 second response time [08:33:21] PROBLEM - hastursnotebook.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:33:32] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::1b80/cpweb [08:33:35] RECOVERY - cp20 Stunnel HTTP for mwtask141 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15950 bytes in 1.045 second response time [08:33:37] RECOVERY - cp31 HTTP 4xx/5xx ERROR Rate on cp31 is OK: OK - NGINX Error Rate is 4% [08:33:41] RECOVERY - cp31 Varnish Backends on cp31 is OK: All 14 backends are healthy [08:33:43] RECOVERY - cp30 Varnish Backends on cp30 is OK: All 14 backends are healthy [08:34:07] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.71, 3.20, 3.62 [08:34:36] RECOVERY - cp20 HTTP 4xx/5xx ERROR Rate on cp20 is OK: OK - NGINX Error Rate is 6% [08:34:40] RECOVERY - gluster102 Current Load on gluster102 is OK: OK - load average: 0.65, 4.18, 4.85 [08:34:52] PROBLEM - az.wikiretet.ga - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:35:16] RECOVERY - cp21 Stunnel HTTP for mw131 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.023 second response time [08:36:11] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.84, 2.99, 2.59 [08:36:15] RECOVERY - cp21 Stunnel HTTP for phab121 on cp21 is OK: HTTP OK: Status line output matched "500" - 2855 bytes in 7.237 second response time [08:36:40] PROBLEM - cp21 Stunnel HTTP for mw141 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:36:41] RECOVERY - mystiverse.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'mystiverse.wiki' will expire on Sat 01 Oct 2022 04:26:41 GMT +0000. [08:37:18] PROBLEM - www.sidem.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:37:25] PROBLEM - knifepointhorror.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:37:32] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [08:37:42] PROBLEM - cp20 Stunnel HTTP for mw141 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:38:11] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 3.31, 3.06, 2.67 [08:38:24] PROBLEM - cp20 Disk Space on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [08:38:38] RECOVERY - cp21 Stunnel HTTP for mw141 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 0.018 second response time [08:38:53] RECOVERY - cp21 Varnish Backends on cp21 is OK: All 14 backends are healthy [08:39:42] RECOVERY - spcodex.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'spcodex.wiki' will expire on Wed 24 Aug 2022 04:17:42 GMT +0000. [08:40:01] PROBLEM - cnt.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:40:03] PROBLEM - mh142.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:40:07] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 1.74, 2.75, 3.35 [08:40:22] RECOVERY - cp20 Disk Space on cp20 is OK: DISK OK - free space: / 10418 MB (27% inode=96%); [08:40:45] PROBLEM - lcn.zfc.id.lv - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:40:49] PROBLEM - wc.miraheze.org on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:42:04] PROBLEM - cp21 Stunnel HTTP for reports121 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [08:42:11] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.22, 3.89, 3.11 [08:42:38] RECOVERY - cp20 Stunnel HTTP for mw141 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.015 second response time [08:43:05] PROBLEM - cp20 HTTPS on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:43:09] PROBLEM - wiki.erisly.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:43:19] PROBLEM - cp21 Varnish Backends on cp21 is CRITICAL: 4 backends are down. mw121 mw131 mw132 mw142 [08:43:47] RECOVERY - guia.cineastas.pt - LetsEncrypt on sslhost is OK: OK - Certificate 'guia.cineastas.pt' will expire on Tue 23 Aug 2022 01:13:17 GMT +0000. [08:43:59] RECOVERY - wiki.sketch.town - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.sketch.town' will expire on Thu 13 Oct 2022 04:34:16 GMT +0000. [08:44:11] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 1.91, 3.14, 2.93 [08:45:03] RECOVERY - avas.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'avas.wiki' will expire on Mon 10 Oct 2022 04:52:24 GMT +0000. [08:45:06] RECOVERY - cp20 HTTPS on cp20 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 3407 bytes in 7.160 second response time [08:45:32] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::4c25/cpweb [08:45:51] PROBLEM - betaheze.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'betaheze.org' expires in 15 day(s) (Fri 19 Aug 2022 17:58:05 GMT +0000). [08:45:59] PROBLEM - cp31 Stunnel HTTP for mw122 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:46:57] PROBLEM - aresrocket.ml - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:46:58] PROBLEM - wildbowiki.net - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:46:59] RECOVERY - cp21 Stunnel HTTP for reports121 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 10996 bytes in 1.062 second response time [08:47:05] PROBLEM - www.journeytheword.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:47:06] RECOVERY - wc.miraheze.org on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [08:47:06] PROBLEM - mw122 MediaWiki Rendering on mw122 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:47:24] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 25.23, 15.69, 9.75 [08:47:26] PROBLEM - cp20 Stunnel HTTP for mw131 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [08:47:55] RECOVERY - cp31 Stunnel HTTP for mw122 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.335 second response time [08:48:20] PROBLEM - cp20 Stunnel HTTP for mon141 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:49:05] RECOVERY - mw122 MediaWiki Rendering on mw122 is OK: HTTP OK: HTTP/1.1 200 OK - 29513 bytes in 2.015 second response time [08:49:42] RECOVERY - cp20 Stunnel HTTP for mw131 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 2.041 second response time [08:50:09] PROBLEM - cp21 Stunnel HTTP for mw121 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [08:50:11] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.06, 3.57, 3.11 [08:50:32] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 22.55, 15.74, 9.45 [08:50:48] RECOVERY - wiki.mastodon.kr - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.mastodon.kr' will expire on Mon 05 Sep 2022 00:02:52 GMT +0000. [08:51:24] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.81, 11.10, 9.20 [08:51:35] RECOVERY - metroidpedia.com - LetsEncrypt on sslhost is OK: OK - Certificate 'metroidpedia.com' will expire on Wed 26 Oct 2022 18:29:18 GMT +0000. [08:51:53] RECOVERY - pokemonwiki.info - LetsEncrypt on sslhost is OK: OK - Certificate 'pokemonwiki.info' will expire on Wed 19 Oct 2022 06:57:42 GMT +0000. [08:52:00] PROBLEM - feathercare.net - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:52:07] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.03, 4.87, 4.03 [08:52:09] PROBLEM - mario.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:52:13] RECOVERY - cp21 Stunnel HTTP for mw121 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 1.049 second response time [08:52:17] PROBLEM - cp20 Stunnel HTTP for mw121 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [08:53:17] RECOVERY - cp20 Stunnel HTTP for mon141 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 39170 bytes in 1.066 second response time [08:53:24] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.76, 11.78, 9.66 [08:54:32] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.20, 11.21, 8.98 [08:55:28] RECOVERY - en.famepedia.org - LetsEncrypt on sslhost is OK: OK - Certificate 'en.famepedia.org' will expire on Mon 10 Oct 2022 05:45:28 GMT +0000. [08:56:05] RECOVERY - donkeykong.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [08:56:16] RECOVERY - aman.awiki.org - LetsEncrypt on sslhost is OK: OK - Certificate 'aman.awiki.org' will expire on Mon 22 Aug 2022 23:45:19 GMT +0000. [08:56:22] RECOVERY - cp20 Stunnel HTTP for mw121 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 1.065 second response time [08:56:32] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.05, 9.98, 8.79 [08:56:43] RECOVERY - wiki.kachow.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.kachow.org' will expire on Wed 12 Oct 2022 04:17:08 GMT +0000. [08:57:27] RECOVERY - publictestwiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'publictestwiki.com' will expire on Tue 23 Aug 2022 00:48:11 GMT +0000. [08:57:30] RECOVERY - allthetropes.orain.org - LetsEncrypt on sslhost is OK: OK - Certificate 'orain.org' will expire on Wed 26 Oct 2022 18:24:04 GMT +0000. [08:58:11] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.44, 3.95, 3.56 [08:58:32] PROBLEM - cp20 Stunnel HTTP for mw141 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:58:34] PROBLEM - cp21 Stunnel HTTP for mw121 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:58:55] RECOVERY - wiki.alathramc.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.alathramc.com' will expire on Tue 20 Sep 2022 12:13:47 GMT +0000. [08:59:46] RECOVERY - tep.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'tep.wiki' will expire on Tue 23 Aug 2022 08:40:10 GMT +0000. [09:00:11] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.07, 3.97, 3.61 [09:00:36] PROBLEM - cp21 Stunnel HTTP for test131 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [09:01:05] RECOVERY - cp20 Stunnel HTTP for mw141 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 3.075 second response time [09:01:35] PROBLEM - adadevelopersacademy.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:01:42] PROBLEM - cp21 HTTPS on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:01:44] PROBLEM - mw141 Current Load on mw141 is WARNING: WARNING - load average: 10.48, 10.88, 7.03 [09:02:11] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.30, 3.79, 3.59 [09:02:24] RECOVERY - burnout.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'burnout.wiki' will expire on Tue 01 Nov 2022 04:10:29 GMT +0000. [09:02:32] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 28.97, 16.89, 11.54 [09:02:37] RECOVERY - cp21 Stunnel HTTP for test131 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15954 bytes in 1.029 second response time [09:02:44] RECOVERY - hastursnotebook.org - LetsEncrypt on sslhost is OK: OK - Certificate 'hastursnotebook.org' will expire on Fri 21 Oct 2022 06:35:33 GMT +0000. [09:02:45] PROBLEM - cp21 Stunnel HTTP for mw132 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [09:03:24] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.09, 11.01, 10.81 [09:03:40] RECOVERY - cp21 HTTPS on cp21 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 3406 bytes in 3.041 second response time [09:03:44] RECOVERY - cp21 Stunnel HTTP for mw121 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 1.032 second response time [09:03:44] RECOVERY - mw141 Current Load on mw141 is OK: OK - load average: 4.81, 8.46, 6.60 [09:04:11] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.76, 3.88, 3.62 [09:04:46] RECOVERY - az.wikiretet.ga - LetsEncrypt on sslhost is OK: OK - Certificate 'az.wikiretet.ga' will expire on Tue 11 Oct 2022 04:40:37 GMT +0000. [09:05:12] RECOVERY - cp21 Stunnel HTTP for mw132 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.026 second response time [09:05:45] PROBLEM - cp21 SSH on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:06:11] RECOVERY - www.sidem.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'www.sidem.wiki' will expire on Tue 23 Aug 2022 12:59:12 GMT +0000. [09:06:11] PROBLEM - ns1 NTP time on ns1 is WARNING: NTP WARNING: Offset 0.1605067253 secs [09:06:38] PROBLEM - cp20 HTTPS on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:06:44] PROBLEM - miraheze.gq - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:06:54] RECOVERY - cp21 Varnish Backends on cp21 is OK: All 14 backends are healthy [09:07:10] PROBLEM - www.project-patterns.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:07:10] RECOVERY - knifepointhorror.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'knifepointhorror.wiki' will expire on Sun 30 Oct 2022 15:35:11 GMT +0000. [09:07:44] RECOVERY - cp21 SSH on cp21 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [09:08:43] RECOVERY - mh142.com - LetsEncrypt on sslhost is OK: OK - Certificate 'mh142.com' will expire on Tue 23 Aug 2022 00:06:10 GMT +0000. [09:09:03] PROBLEM - cp20 Stunnel HTTP for mw132 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:09:24] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 6.77, 8.57, 9.87 [09:10:04] PROBLEM - cp21 Stunnel HTTP for mail121 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [09:10:42] PROBLEM - cp21 Stunnel HTTP for mw142 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [09:10:43] RECOVERY - lcn.zfc.id.lv - LetsEncrypt on sslhost is OK: OK - Certificate 'lcn.zfc.id.lv' will expire on Wed 31 Aug 2022 21:26:51 GMT +0000. [09:10:43] RECOVERY - cp20 HTTPS on cp20 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 3407 bytes in 7.252 second response time [09:10:50] PROBLEM - www.marinebiodiversitymatrix.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:11:00] PROBLEM - gs.sidem.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:11:06] RECOVERY - cp20 Stunnel HTTP for mw132 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 5.051 second response time [09:11:17] RECOVERY - wiki.harlonserver.net - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.harlonserver.net' will expire on Wed 24 Aug 2022 16:27:40 GMT +0000. [09:11:32] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [09:11:47] PROBLEM - www.christipedia.nl - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:12:27] PROBLEM - cp21 Varnish Backends on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [09:12:32] RECOVERY - wiki.erisly.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.erisly.com' will expire on Wed 31 Aug 2022 21:21:26 GMT +0000. [09:12:56] PROBLEM - cp21 HTTP 4xx/5xx ERROR Rate on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [09:13:00] PROBLEM - www.obeymewiki.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:13:00] PROBLEM - wiki.simorgh.me - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:13:00] PROBLEM - wiki.parappa.dev - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:14:07] PROBLEM - cp21 SSH on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:14:16] PROBLEM - wiki.minebox.fr - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:14:32] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 7.15, 10.31, 11.27 [09:14:33] PROBLEM - phgalaxy.eu.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:15:05] PROBLEM - www.turtletown.ca - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:15:07] RECOVERY - cp21 HTTP 4xx/5xx ERROR Rate on cp21 is OK: OK - NGINX Error Rate is 5% [09:15:36] RECOVERY - aresrocket.ml - LetsEncrypt on sslhost is OK: OK - Certificate 'aresrocket.ml' will expire on Fri 14 Oct 2022 05:26:01 GMT +0000. [09:15:45] PROBLEM - betaheze.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:15:57] PROBLEM - wiki.rebirthofthenight.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:16:02] RECOVERY - cp21 SSH on cp21 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [09:16:05] RECOVERY - wildbowiki.net - LetsEncrypt on sslhost is OK: OK - Certificate 'wildbowiki.net' will expire on Tue 06 Sep 2022 20:59:02 GMT +0000. [09:16:38] RECOVERY - cp21 Stunnel HTTP for mail121 on cp21 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 427 bytes in 0.012 second response time [09:17:04] PROBLEM - cp21 Stunnel HTTP for mw141 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:17:18] PROBLEM - wiki.projectdiablo2.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:17:32] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::4c25/cpweb [09:17:35] PROBLEM - vrcdev.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:17:42] RECOVERY - cp21 Stunnel HTTP for mw142 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.031 second response time [09:18:08] PROBLEM - wiki.newnormal.fans - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:18:10] RECOVERY - wiki.zymonic.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.zymonic.com' will expire on Wed 24 Aug 2022 02:07:19 GMT +0000. [09:18:22] PROBLEM - wiki.meregos.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:18:25] PROBLEM - cp20 SSH on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:18:32] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 3.73, 7.01, 9.74 [09:19:09] RECOVERY - cp21 Stunnel HTTP for mw141 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.021 second response time [09:19:22] PROBLEM - wiki.openhatch.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:19:44] PROBLEM - cp20 Stunnel HTTP for mw131 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:20:04] PROBLEM - cp20 HTTPS on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:20:23] PROBLEM - cp20 Stunnel HTTP for mon141 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:20:39] PROBLEM - test1.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:20:55] PROBLEM - thestories.kr - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:21:17] PROBLEM - wiki.infomedia.co.uk - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:21:18] PROBLEM - wiki.milkywayidle.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:21:24] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 21.54, 13.96, 11.14 [09:21:32] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [09:21:45] PROBLEM - datacrondatabase.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:22:02] PROBLEM - wc.miraheze.org on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:22:09] PROBLEM - persist.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:22:31] RECOVERY - cp20 SSH on cp20 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [09:23:24] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.49, 11.92, 10.73 [09:24:11] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.31, 3.64, 3.91 [09:25:30] RECOVERY - cp20 Stunnel HTTP for mon141 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 39170 bytes in 7.325 second response time [09:25:32] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::1b80/cpweb [09:25:36] PROBLEM - portalsofphereon.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:26:11] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.33, 4.18, 4.07 [09:26:17] RECOVERY - cp20 HTTPS on cp20 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 3407 bytes in 7.249 second response time [09:26:32] PROBLEM - test2.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:26:52] PROBLEM - wiki.danvs.net - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:27:13] PROBLEM - pt.polandballwiki.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:28:09] RECOVERY - wiki.grottocenter.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.grottocenter.org' will expire on Mon 22 Aug 2022 22:30:31 GMT +0000. [09:28:11] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.33, 3.71, 3.91 [09:28:45] PROBLEM - cp20 Stunnel HTTP for mw132 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:29:24] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.28, 9.54, 10.07 [09:29:35] PROBLEM - www.iceria.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:29:46] PROBLEM - miraheze.ga - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:30:05] PROBLEM - christipedia.nl - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:31:31] RECOVERY - adadevelopersacademy.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'adadevelopersacademy.wiki' will expire on Mon 22 Aug 2022 22:51:43 GMT +0000. [09:31:31] PROBLEM - www.istpcomputing.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:31:38] PROBLEM - cp21 Disk Space on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [09:33:36] RECOVERY - cp21 Disk Space on cp21 is OK: DISK OK - free space: / 10478 MB (27% inode=96%); [09:33:48] PROBLEM - cp21 HTTPS on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:33:56] RECOVERY - cp20 Stunnel HTTP for mw132 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 2.035 second response time [09:35:24] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 14.00, 10.80, 10.24 [09:36:45] PROBLEM - cp21 SSH on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:37:01] PROBLEM - www.project-patterns.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'project-patterns.com' expires in 15 day(s) (Fri 19 Aug 2022 17:20:05 GMT +0000). [09:37:02] RECOVERY - wc.miraheze.org on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [09:37:13] PROBLEM - cp30 Stunnel HTTP for mw122 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:37:14] PROBLEM - mw122 MediaWiki Rendering on mw122 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:37:20] PROBLEM - cp21 Stunnel HTTP for mw122 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:37:22] PROBLEM - commonwealth.0um.io - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:37:33] RECOVERY - cnt.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [09:37:39] RECOVERY - cp20 Stunnel HTTP for mw131 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 5.078 second response time [09:37:48] RECOVERY - cp21 HTTPS on cp21 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 3404 bytes in 1.031 second response time [09:38:04] PROBLEM - cp31 Stunnel HTTP for mw122 on cp31 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 328 bytes in 5.043 second response time [09:38:11] RECOVERY - ns1 NTP time on ns1 is OK: NTP OK: Offset 0.08994147182 secs [09:38:11] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.98, 4.66, 4.20 [09:38:40] RECOVERY - cp21 SSH on cp21 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [09:38:57] PROBLEM - cp20 Stunnel HTTP for mw122 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:40:02] PROBLEM - monarchists.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:40:15] RECOVERY - www.marinebiodiversitymatrix.org - LetsEncrypt on sslhost is OK: OK - Certificate 'marinebiodiversitymatrix.org' will expire on Wed 24 Aug 2022 01:59:18 GMT +0000. [09:40:32] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 16.10, 12.58, 9.81 [09:40:44] RECOVERY - www.christipedia.nl - LetsEncrypt on sslhost is OK: OK - Certificate 'www.christipedia.nl' will expire on Sat 17 Sep 2022 18:34:21 GMT +0000. [09:41:12] RECOVERY - cp30 Stunnel HTTP for mw122 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.314 second response time [09:41:18] RECOVERY - mw122 MediaWiki Rendering on mw122 is OK: HTTP OK: HTTP/1.1 200 OK - 29512 bytes in 0.845 second response time [09:41:33] RECOVERY - wiki.parappa.dev - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.parappa.dev' will expire on Sun 18 Sep 2022 13:44:45 GMT +0000. [09:41:35] RECOVERY - www.obeymewiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'www.obeymewiki.com' will expire on Thu 01 Sep 2022 00:44:40 GMT +0000. [09:41:39] RECOVERY - wiki.simorgh.me - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.simorgh.me' will expire on Sun 02 Oct 2022 10:55:38 GMT +0000. [09:42:01] RECOVERY - cp21 Stunnel HTTP for mw122 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 3.054 second response time [09:42:04] RECOVERY - cp31 Stunnel HTTP for mw122 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.339 second response time [09:42:13] RECOVERY - cp20 Varnish Backends on cp20 is OK: All 14 backends are healthy [09:42:25] PROBLEM - cp21 Stunnel HTTP for mail121 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [09:43:11] RECOVERY - phgalaxy.eu.org - LetsEncrypt on sslhost is OK: OK - Certificate 'phgalaxy.eu.org' will expire on Sun 02 Oct 2022 05:33:18 GMT +0000. [09:43:19] PROBLEM - discordian.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:43:47] RECOVERY - cp20 Stunnel HTTP for mw122 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 1.031 second response time [09:43:52] RECOVERY - wiki.minebox.fr - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.minebox.fr' will expire on Fri 16 Sep 2022 18:05:33 GMT +0000. [09:44:27] RECOVERY - cp21 Stunnel HTTP for mail121 on cp21 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 427 bytes in 1.019 second response time [09:44:39] RECOVERY - www.turtletown.ca - LetsEncrypt on sslhost is OK: OK - Certificate 'www.turtletown.ca' will expire on Tue 20 Sep 2022 20:30:39 GMT +0000. [09:45:05] PROBLEM - largedu.eu.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:45:24] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 4.93, 10.87, 11.55 [09:45:28] PROBLEM - betaheze.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'betaheze.org' expires in 15 day(s) (Fri 19 Aug 2022 17:58:05 GMT +0000). [09:45:37] PROBLEM - cp21 Stunnel HTTP for mw142 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:45:48] RECOVERY - wiki.rebirthofthenight.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.rebirthofthenight.com' will expire on Wed 24 Aug 2022 02:49:21 GMT +0000. [09:45:58] PROBLEM - celeste.ink - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:46:07] PROBLEM - cp20 Varnish Backends on cp20 is CRITICAL: 4 backends are down. mw121 mw122 mw141 mw142 [09:46:11] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 1.26, 3.33, 3.93 [09:46:15] RECOVERY - vrcdev.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'vrcdev.wiki' will expire on Tue 20 Sep 2022 12:25:22 GMT +0000. [09:46:24] PROBLEM - cp21 Stunnel HTTP for mw132 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [09:46:32] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.58, 10.00, 9.69 [09:46:33] PROBLEM - cp30 Stunnel HTTP for mw121 on cp30 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 328 bytes in 8.567 second response time [09:46:41] PROBLEM - cp31 Stunnel HTTP for mw121 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:46:53] PROBLEM - mw121 MediaWiki Rendering on mw121 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:47:05] PROBLEM - cp30 Stunnel HTTP for mw122 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:47:12] RECOVERY - www.journeytheword.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'www.journeytheword.wiki' will expire on Wed 31 Aug 2022 18:13:33 GMT +0000. [09:47:25] RECOVERY - wiki.newnormal.fans - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.newnormal.fans' will expire on Fri 14 Oct 2022 16:20:05 GMT +0000. [09:47:29] PROBLEM - cp31 Stunnel HTTP for mw141 on cp31 is CRITICAL: HTTP CRITICAL - No data received from host [09:47:33] PROBLEM - cp20 HTTPS on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:47:42] PROBLEM - cp21 Stunnel HTTP for mw121 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:47:43] PROBLEM - cp30 Varnish Backends on cp30 is CRITICAL: 7 backends are down. mw121 mw122 mw131 mw132 mw141 mw142 mediawiki [09:47:52] PROBLEM - wiki.fossbots.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:48:08] PROBLEM - gluster101 Disk Space on gluster101 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [09:48:09] RECOVERY - wiki.meregos.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.meregos.com' will expire on Sat 17 Sep 2022 22:20:19 GMT +0000. [09:48:09] PROBLEM - popira.info - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:48:11] PROBLEM - cp31 Stunnel HTTP for mw122 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:48:16] PROBLEM - mw132 MediaWiki Rendering on mw132 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:48:27] PROBLEM - cp20 Stunnel HTTP for mw121 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:48:38] RECOVERY - wiki.openhatch.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.openhatch.org' will expire on Tue 23 Aug 2022 09:22:30 GMT +0000. [09:49:01] PROBLEM - cp20 Stunnel HTTP for mw122 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:49:05] PROBLEM - cp20 Stunnel HTTP for mw132 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [09:49:10] PROBLEM - cp21 Stunnel HTTP for reports121 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [09:49:24] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 1.97, 7.33, 10.07 [09:49:29] RECOVERY - cp31 Stunnel HTTP for mw141 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.330 second response time [09:49:40] PROBLEM - mw122 MediaWiki Rendering on mw122 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:49:41] PROBLEM - cp31 Varnish Backends on cp31 is CRITICAL: 7 backends are down. mw121 mw122 mw131 mw132 mw141 mw142 mediawiki [09:49:56] RECOVERY - thestories.kr - LetsEncrypt on sslhost is OK: OK - Certificate 'thestories.kr' will expire on Thu 01 Sep 2022 00:44:22 GMT +0000. [09:50:04] PROBLEM - gluster101 Disk Space on gluster101 is WARNING: DISK WARNING - free space: / 104530 MB (10% inode=82%); [09:50:07] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 0.24, 2.16, 3.63 [09:50:07] PROBLEM - cp30 HTTP 4xx/5xx ERROR Rate on cp30 is CRITICAL: CRITICAL - NGINX Error Rate is 87% [09:50:11] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 0.09, 1.74, 3.16 [09:50:14] RECOVERY - mw132 MediaWiki Rendering on mw132 is OK: HTTP OK: HTTP/1.1 200 OK - 29512 bytes in 0.203 second response time [09:50:27] PROBLEM - cp31 HTTP 4xx/5xx ERROR Rate on cp31 is CRITICAL: CRITICAL - NGINX Error Rate is 84% [09:50:33] RECOVERY - cp21 Stunnel HTTP for mw142 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 3.051 second response time [09:50:37] RECOVERY - test1.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [09:50:39] RECOVERY - wiki.infomedia.co.uk - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.infomedia.co.uk' will expire on Fri 21 Oct 2022 15:33:32 GMT +0000. [09:50:40] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 13.69, 6.08, 3.03 [09:50:43] PROBLEM - gluster102 PowerDNS Recursor on gluster102 is CRITICAL: CRITICAL - Plugin timed out while executing system call [09:51:06] RECOVERY - wiki.milkywayidle.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.milkywayidle.com' will expire on Fri 21 Oct 2022 06:32:46 GMT +0000. [09:51:07] RECOVERY - cp21 Stunnel HTTP for reports121 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 10996 bytes in 0.065 second response time [09:51:12] PROBLEM - cp21 Stunnel HTTP for mw122 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:51:23] PROBLEM - cp21 HTTP 4xx/5xx ERROR Rate on cp21 is WARNING: WARNING - NGINX Error Rate is 59% [09:51:27] RECOVERY - cp20 Stunnel HTTP for mw122 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.021 second response time [09:51:32] RECOVERY - datacrondatabase.com - LetsEncrypt on sslhost is OK: OK - Certificate 'datacrondatabase.com' will expire on Mon 22 Aug 2022 15:10:26 GMT +0000. [09:51:36] RECOVERY - feathercare.net - LetsEncrypt on sslhost is OK: OK - Certificate 'feathercare.net' will expire on Sat 27 Aug 2022 14:00:44 GMT +0000. [09:51:37] RECOVERY - mw122 MediaWiki Rendering on mw122 is OK: HTTP OK: HTTP/1.1 200 OK - 29512 bytes in 0.309 second response time [09:51:46] RECOVERY - persist.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'persist.wiki' will expire on Mon 10 Oct 2022 04:01:57 GMT +0000. [09:51:53] RECOVERY - cp21 Stunnel HTTP for mw121 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 1.040 second response time [09:52:05] RECOVERY - mario.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [09:52:11] PROBLEM - cp20 SSH on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:52:18] PROBLEM - cp20 Stunnel HTTP for mw142 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:52:36] RECOVERY - cp30 Stunnel HTTP for mw121 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 0.327 second response time [09:52:40] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 5.71, 5.94, 3.38 [09:52:56] RECOVERY - mw121 MediaWiki Rendering on mw121 is OK: HTTP OK: HTTP/1.1 200 OK - 29512 bytes in 0.309 second response time [09:52:58] RECOVERY - cp31 Stunnel HTTP for mw121 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.309 second response time [09:53:07] PROBLEM - buildabearwiki.info - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:53:08] RECOVERY - cp30 Stunnel HTTP for mw122 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.329 second response time [09:53:19] RECOVERY - cp21 Stunnel HTTP for mw122 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 2.037 second response time [09:53:30] PROBLEM - cp30 Stunnel HTTP for mw142 on cp30 is CRITICAL: HTTP CRITICAL - No data received from host [09:53:34] RECOVERY - cp21 HTTP 4xx/5xx ERROR Rate on cp21 is OK: OK - NGINX Error Rate is 24% [09:53:34] RECOVERY - cp20 Stunnel HTTP for mw121 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.020 second response time [09:53:43] RECOVERY - cp20 HTTPS on cp20 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 3407 bytes in 7.287 second response time [09:54:03] RECOVERY - cp30 HTTP 4xx/5xx ERROR Rate on cp30 is OK: OK - NGINX Error Rate is 2% [09:54:06] RECOVERY - cp31 Stunnel HTTP for mw122 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.314 second response time [09:54:07] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.84, 2.34, 3.35 [09:54:11] RECOVERY - cp20 SSH on cp20 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [09:54:16] RECOVERY - cp31 HTTP 4xx/5xx ERROR Rate on cp31 is OK: OK - NGINX Error Rate is 7% [09:55:08] RECOVERY - portalsofphereon.com - LetsEncrypt on sslhost is OK: OK - Certificate 'www.portalsofphereon.com' will expire on Sat 17 Sep 2022 20:30:32 GMT +0000. [09:55:28] RECOVERY - cp30 Stunnel HTTP for mw142 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 0.325 second response time [09:56:05] PROBLEM - cp21 SSH on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:56:09] RECOVERY - wiki.danvs.net - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.danvs.net' will expire on Tue 23 Aug 2022 02:16:10 GMT +0000. [09:56:12] RECOVERY - test2.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [09:56:24] RECOVERY - cp20 Stunnel HTTP for mw132 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 7.126 second response time [09:56:40] RECOVERY - gluster102 Current Load on gluster102 is OK: OK - load average: 1.80, 4.31, 3.33 [09:56:44] PROBLEM - cp30 Stunnel HTTP for mw132 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:56:48] PROBLEM - cp30 Stunnel HTTP for mw131 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:56:52] PROBLEM - mw131 MediaWiki Rendering on mw131 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:56:58] PROBLEM - cp31 Stunnel HTTP for mw132 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:57:46] RECOVERY - cp21 Stunnel HTTP for mw132 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 6.416 second response time [09:57:58] PROBLEM - cp30 HTTP 4xx/5xx ERROR Rate on cp30 is CRITICAL: CRITICAL - NGINX Error Rate is 79% [09:58:07] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.07, 4.05, 3.78 [09:58:08] RECOVERY - cp21 SSH on cp21 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [09:58:36] RECOVERY - miraheze.ga - LetsEncrypt on sslhost is OK: OK - Certificate 'miraheze.ga' will expire on Wed 24 Aug 2022 04:25:02 GMT +0000. [09:58:42] RECOVERY - cp30 Stunnel HTTP for mw132 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 0.330 second response time [09:58:49] RECOVERY - cp30 Stunnel HTTP for mw131 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 6.692 second response time [09:58:50] RECOVERY - mw131 MediaWiki Rendering on mw131 is OK: HTTP OK: HTTP/1.1 200 OK - 29512 bytes in 2.875 second response time [09:58:53] RECOVERY - cp31 Stunnel HTTP for mw132 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.313 second response time [09:58:56] RECOVERY - gluster102 PowerDNS Recursor on gluster102 is OK: DNS OK: 0.244 seconds response time. miraheze.org returns 198.244.148.90,2001:41d0:801:2000::1b80,2001:41d0:801:2000::4c25,51.195.220.68 [09:59:09] PROBLEM - cp21 Stunnel HTTP for test131 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [09:59:23] RECOVERY - www.iceria.org - LetsEncrypt on sslhost is OK: OK - Certificate 'www.iceria.org' will expire on Sat 17 Sep 2022 21:13:26 GMT +0000. [09:59:26] PROBLEM - cp31 Stunnel HTTP for mw142 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:59:44] PROBLEM - cp21 Stunnel HTTP for reports121 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:59:56] RECOVERY - cp30 HTTP 4xx/5xx ERROR Rate on cp30 is OK: OK - NGINX Error Rate is 27% [10:00:07] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.13, 3.93, 3.78 [10:00:07] PROBLEM - cp21 Stunnel HTTP for mw141 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:00:08] PROBLEM - wiki.grottocenter.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:00:31] PROBLEM - cp21 Stunnel HTTP for mw142 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:00:33] PROBLEM - mw142 HTTPS on mw142 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:00:50] PROBLEM - cp20 Stunnel HTTP for mw121 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [10:00:54] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [10:01:07] PROBLEM - threedomwiki.pcast.site - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:01:17] PROBLEM - cp20 Stunnel HTTP for phab121 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [10:01:23] PROBLEM - polandballwiki.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:01:32] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [10:01:33] RECOVERY - cp31 Stunnel HTTP for mw142 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 8.712 second response time [10:01:41] RECOVERY - cp21 Stunnel HTTP for reports121 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 10996 bytes in 0.046 second response time [10:01:43] RECOVERY - cp30 Varnish Backends on cp30 is OK: All 14 backends are healthy [10:01:45] PROBLEM - mw141 MediaWiki Rendering on mw141 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:01:56] PROBLEM - cp20 HTTPS on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:02:07] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.42, 3.89, 3.77 [10:02:13] RECOVERY - cp21 Stunnel HTTP for mw141 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 8.445 second response time [10:02:31] RECOVERY - mw142 HTTPS on mw142 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 545 bytes in 0.006 second response time [10:02:38] PROBLEM - wikimoma.art - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:02:43] PROBLEM - iol.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:02:47] PROBLEM - wiki.iurevar.world - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:02:51] PROBLEM - cp21 Stunnel HTTP for mw122 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [10:02:55] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 1.00, 0.83, 0.73 [10:03:02] PROBLEM - mcwiki.kirbygang.tk - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:03:07] PROBLEM - en.gyaanipedia.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:04:03] RECOVERY - cp21 Stunnel HTTP for test131 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15954 bytes in 0.019 second response time [10:04:07] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.14, 3.74, 3.74 [10:04:12] PROBLEM - cp20 Puppet on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [10:04:13] PROBLEM - cp20 Stunnel HTTP for mw122 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [10:04:32] RECOVERY - cp20 Stunnel HTTP for mw142 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 1.469 second response time [10:04:50] RECOVERY - cp21 Stunnel HTTP for mw122 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 1.033 second response time [10:04:54] PROBLEM - cp21 Stunnel HTTP for mwtask141 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:05:41] RECOVERY - cp31 Varnish Backends on cp31 is OK: All 14 backends are healthy [10:05:43] RECOVERY - mw141 MediaWiki Rendering on mw141 is OK: HTTP OK: HTTP/1.1 200 OK - 29512 bytes in 0.318 second response time [10:05:53] RECOVERY - cp20 Stunnel HTTP for mw121 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 8.324 second response time [10:05:57] PROBLEM - cp21 HTTPS on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:05:59] PROBLEM - www.dovearchives.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:06:07] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.56, 4.35, 3.96 [10:06:15] RECOVERY - cp20 Stunnel HTTP for phab121 on cp20 is OK: HTTP OK: Status line output matched "500" - 2855 bytes in 7.160 second response time [10:06:17] RECOVERY - commonwealth.0um.io - LetsEncrypt on sslhost is OK: OK - Certificate 'commonwealth.0um.io' will expire on Thu 20 Oct 2022 18:21:09 GMT +0000. [10:06:55] PROBLEM - cp21 Stunnel HTTP for mail121 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [10:06:57] RECOVERY - cp21 Stunnel HTTP for mwtask141 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15950 bytes in 1.060 second response time [10:07:06] PROBLEM - robloxapi.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:07:10] PROBLEM - www.project-patterns.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:08:04] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.35, 4.43, 3.59 [10:08:25] PROBLEM - cp20 Stunnel HTTP for mw131 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:08:57] RECOVERY - cp21 Stunnel HTTP for mail121 on cp21 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 427 bytes in 0.018 second response time [10:09:11] RECOVERY - cp20 Puppet on cp20 is OK: OK: Puppet is currently enabled, last run 14 minutes ago with 0 failures [10:10:02] PROBLEM - mw141 MediaWiki Rendering on mw141 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:10:03] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 0.84, 3.09, 3.20 [10:10:07] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.63, 3.91, 3.91 [10:10:13] RECOVERY - cp20 HTTPS on cp20 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 3407 bytes in 7.306 second response time [10:10:20] RECOVERY - gs.sidem.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'gs.sidem.wiki' will expire on Tue 23 Aug 2022 13:09:38 GMT +0000. [10:10:25] PROBLEM - cp31 Stunnel HTTP for mw121 on cp31 is CRITICAL: HTTP CRITICAL - No data received from host [10:10:45] PROBLEM - cp30 Stunnel HTTP for mw121 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:11:00] PROBLEM - mw121 MediaWiki Rendering on mw121 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:11:22] PROBLEM - cp20 Stunnel HTTP for mw121 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [10:11:28] PROBLEM - history.estill.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:11:43] PROBLEM - cp21 Stunnel HTTP for mw121 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:11:47] PROBLEM - wiki.qadrishattari.xyz - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:11:48] PROBLEM - wiki.hylormc.tk - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:12:05] RECOVERY - cp21 HTTPS on cp21 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 3405 bytes in 3.054 second response time [10:12:11] PROBLEM - cp30 Stunnel HTTP for mw122 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:12:12] RECOVERY - discordian.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'discordian.wiki' will expire on Fri 16 Sep 2022 18:03:24 GMT +0000. [10:12:16] PROBLEM - cp31 Stunnel HTTP for mw122 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:12:27] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 3 datacenters are down: 2001:41d0:801:2000::4c25/cpweb, 149.56.141.75/cpweb, 2607:5300:201:3100::5ebc/cpweb [10:12:31] PROBLEM - cp20 Stunnel HTTP for mw142 on cp20 is CRITICAL: HTTP CRITICAL - No data received from host [10:13:16] PROBLEM - wiki.minecraftathome.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:13:17] PROBLEM - mw122 MediaWiki Rendering on mw122 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:13:24] RECOVERY - cp20 Stunnel HTTP for mw121 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 3.067 second response time [10:13:26] PROBLEM - m.miraheze.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:13:41] PROBLEM - cp31 Varnish Backends on cp31 is CRITICAL: 5 backends are down. mw121 mw131 mw132 mw141 mw142 [10:14:01] RECOVERY - mw141 MediaWiki Rendering on mw141 is OK: HTTP OK: HTTP/1.1 200 OK - 29512 bytes in 0.206 second response time [10:14:07] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 1.02, 2.50, 3.34 [10:14:23] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [10:14:33] PROBLEM - phgalaxy.eu.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:14:36] PROBLEM - cp21 Stunnel HTTP for mw122 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:14:47] RECOVERY - largedu.eu.org - LetsEncrypt on sslhost is OK: OK - Certificate 'largedu.eu.org' will expire on Sun 30 Oct 2022 14:46:40 GMT +0000. [10:14:53] RECOVERY - celeste.ink - LetsEncrypt on sslhost is OK: OK - Certificate 'celeste.ink' will expire on Sat 24 Sep 2022 13:42:28 GMT +0000. [10:15:15] PROBLEM - mw131 MediaWiki Rendering on mw131 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:15:16] RECOVERY - mw122 MediaWiki Rendering on mw122 is OK: HTTP OK: HTTP/1.1 200 OK - 29512 bytes in 3.046 second response time [10:15:19] PROBLEM - mw131 HTTPS on mw131 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:15:20] PROBLEM - cp20 Stunnel HTTP for reports121 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [10:15:24] RECOVERY - m.miraheze.org - LetsEncrypt on sslhost is OK: OK - Certificate 'm.miraheze.org' will expire on Tue 06 Sep 2022 21:18:17 GMT +0000. [10:15:37] PROBLEM - cp30 HTTP 4xx/5xx ERROR Rate on cp30 is CRITICAL: CRITICAL - NGINX Error Rate is 81% [10:15:43] PROBLEM - cp30 Varnish Backends on cp30 is CRITICAL: 7 backends are down. mw121 mw122 mw131 mw132 mw141 mw142 mediawiki [10:16:06] PROBLEM - cp21 Stunnel HTTP for mw131 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:16:10] RECOVERY - cp30 Stunnel HTTP for mw122 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 0.325 second response time [10:16:16] RECOVERY - cp31 Stunnel HTTP for mw122 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 0.328 second response time [10:16:17] RECOVERY - cp20 Stunnel HTTP for mw122 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.019 second response time [10:16:20] RECOVERY - wiki.projectdiablo2.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.projectdiablo2.com' will expire on Tue 11 Oct 2022 03:46:46 GMT +0000. [10:16:22] PROBLEM - wiki.veloren.net - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:16:26] PROBLEM - cp21 Stunnel HTTP for mwtask141 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:16:42] RECOVERY - cp21 Stunnel HTTP for mw122 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 1.032 second response time [10:16:51] RECOVERY - cp30 Stunnel HTTP for mw121 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 2.299 second response time [10:17:01] RECOVERY - cp20 Stunnel HTTP for mw142 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 1.020 second response time [10:17:03] RECOVERY - mw121 MediaWiki Rendering on mw121 is OK: HTTP OK: HTTP/1.1 200 OK - 29512 bytes in 0.276 second response time [10:17:11] RECOVERY - mw131 MediaWiki Rendering on mw131 is OK: HTTP OK: HTTP/1.1 200 OK - 29512 bytes in 0.185 second response time [10:17:16] RECOVERY - mw131 HTTPS on mw131 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 545 bytes in 0.006 second response time [10:17:23] RECOVERY - cp20 Stunnel HTTP for reports121 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 10996 bytes in 1.064 second response time [10:17:28] RECOVERY - popira.info - LetsEncrypt on sslhost is OK: OK - Certificate 'popira.info' will expire on Sun 02 Oct 2022 11:12:21 GMT +0000. [10:17:35] RECOVERY - cp30 HTTP 4xx/5xx ERROR Rate on cp30 is OK: OK - NGINX Error Rate is 1% [10:17:37] PROBLEM - cp31 HTTP 4xx/5xx ERROR Rate on cp31 is WARNING: WARNING - NGINX Error Rate is 59% [10:17:51] RECOVERY - cp21 Stunnel HTTP for mw142 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 3.063 second response time [10:17:55] PROBLEM - cp30 Stunnel HTTP for mw131 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:18:12] PROBLEM - es.gyaanipedia.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:18:19] PROBLEM - mw141 MediaWiki Rendering on mw141 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:18:20] PROBLEM - cp30 Stunnel HTTP for mw141 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:18:25] PROBLEM - tensegritywiki.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:18:30] RECOVERY - cp31 Stunnel HTTP for mw121 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.334 second response time [10:18:37] RECOVERY - cp21 Stunnel HTTP for mwtask141 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15950 bytes in 1.035 second response time [10:18:38] PROBLEM - cp20 Stunnel HTTP for mon141 on cp20 is CRITICAL: HTTP CRITICAL - No data received from host [10:18:59] PROBLEM - cp20 Stunnel HTTP for mw132 on cp20 is CRITICAL: HTTP CRITICAL - No data received from host [10:19:18] PROBLEM - bn.wikiyri.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:19:23] PROBLEM - cp21 Stunnel HTTP for reports121 on cp21 is CRITICAL: HTTP CRITICAL - No data received from host [10:19:26] PROBLEM - cp20 Stunnel HTTP for mw141 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [10:19:36] PROBLEM - finalfantasy.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:19:37] PROBLEM - cp31 HTTP 4xx/5xx ERROR Rate on cp31 is CRITICAL: CRITICAL - NGINX Error Rate is 91% [10:19:48] RECOVERY - cp21 Stunnel HTTP for mw121 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.022 second response time [10:19:52] RECOVERY - cp20 Stunnel HTTP for mw131 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 5.619 second response time [10:19:52] PROBLEM - cp21 Stunnel HTTP for mw141 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:19:54] RECOVERY - cp30 Stunnel HTTP for mw131 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 4.763 second response time [10:19:59] PROBLEM - cp30 Stunnel HTTP for mw132 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:20:15] PROBLEM - savagepedia.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:20:21] RECOVERY - cp30 Stunnel HTTP for mw141 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 5.700 second response time [10:21:03] PROBLEM - cp21 Stunnel HTTP for mw132 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:21:12] RECOVERY - cp21 Stunnel HTTP for mw131 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 1.060 second response time [10:21:37] RECOVERY - cp31 HTTP 4xx/5xx ERROR Rate on cp31 is OK: OK - NGINX Error Rate is 26% [10:21:42] PROBLEM - cp21 Stunnel HTTP for test131 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:21:57] RECOVERY - cp21 Stunnel HTTP for mw141 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 6.584 second response time [10:21:58] RECOVERY - cp30 Stunnel HTTP for mw132 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 0.848 second response time [10:22:18] RECOVERY - mw141 MediaWiki Rendering on mw141 is OK: HTTP OK: HTTP/1.1 200 OK - 29512 bytes in 0.210 second response time [10:22:19] PROBLEM - puzzles.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:22:33] PROBLEM - cp31 Stunnel HTTP for mw122 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:22:37] PROBLEM - cp20 Stunnel HTTP for reports121 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:22:48] PROBLEM - cp20 Stunnel HTTP for mw122 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:23:00] PROBLEM - commons.gyaanipedia.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:23:16] PROBLEM - mw121 MediaWiki Rendering on mw121 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:23:21] PROBLEM - cp21 Stunnel HTTP for mw122 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:23:25] PROBLEM - cp21 Stunnel HTTP for mw142 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [10:23:26] PROBLEM - wiki.thesimswiki.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:23:28] PROBLEM - cp20 Stunnel HTTP for mw142 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [10:23:32] PROBLEM - wiki.mineland.eu - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:23:37] PROBLEM - guia.esporo.net - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:23:41] RECOVERY - cp21 Stunnel HTTP for test131 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15954 bytes in 1.049 second response time [10:23:44] PROBLEM - cp20 SSH on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:23:52] RECOVERY - cp20 Stunnel HTTP for mon141 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 39170 bytes in 0.056 second response time [10:24:02] PROBLEM - cp30 Stunnel HTTP for mw121 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:24:12] PROBLEM - lgbtqia.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:24:15] PROBLEM - cp21 Stunnel HTTP for mail121 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [10:24:16] RECOVERY - cp21 Stunnel HTTP for reports121 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 10996 bytes in 0.035 second response time [10:24:28] RECOVERY - cp31 Stunnel HTTP for mw122 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.340 second response time [10:24:42] PROBLEM - mw131 MediaWiki Rendering on mw131 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:24:47] PROBLEM - mw131 HTTPS on mw131 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:24:47] RECOVERY - cp20 Stunnel HTTP for reports121 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 10996 bytes in 0.073 second response time [10:24:55] PROBLEM - cp31 Stunnel HTTP for mw131 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:24:56] PROBLEM - cp31 Stunnel HTTP for mw121 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:25:03] PROBLEM - hi.gyaanipedia.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:25:31] PROBLEM - cp20 HTTPS on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:25:34] RECOVERY - cp20 Stunnel HTTP for mw141 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 1.041 second response time [10:25:37] PROBLEM - cp31 HTTP 4xx/5xx ERROR Rate on cp31 is WARNING: WARNING - NGINX Error Rate is 51% [10:25:45] PROBLEM - cp21 Stunnel HTTP for mw131 on cp21 is CRITICAL: HTTP CRITICAL - No data received from host [10:25:48] PROBLEM - cp20 Stunnel HTTP for mw121 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:25:49] PROBLEM - m.miraheze.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:25:54] PROBLEM - cp21 Stunnel HTTP for mw121 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [10:26:01] RECOVERY - cp30 Stunnel HTTP for mw121 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 3.864 second response time [10:26:19] RECOVERY - cp21 Stunnel HTTP for mail121 on cp21 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 427 bytes in 7.178 second response time [10:26:49] PROBLEM - www.pornwiki.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:26:59] PROBLEM - wiki.whentheycry.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:26:59] RECOVERY - pt.polandballwiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'pt.polandballwiki.com' will expire on Thu 29 Sep 2022 08:59:53 GMT +0000. [10:27:14] RECOVERY - mw121 MediaWiki Rendering on mw121 is OK: HTTP OK: HTTP/1.1 200 OK - 29512 bytes in 0.289 second response time [10:27:24] RECOVERY - cp21 Stunnel HTTP for mw122 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 1.052 second response time [10:27:25] RECOVERY - cp20 HTTPS on cp20 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 3407 bytes in 0.020 second response time [10:27:37] PROBLEM - cp31 HTTP 4xx/5xx ERROR Rate on cp31 is CRITICAL: CRITICAL - NGINX Error Rate is 62% [10:27:47] RECOVERY - m.miraheze.org - LetsEncrypt on sslhost is OK: OK - Certificate 'm.miraheze.org' will expire on Tue 06 Sep 2022 21:18:17 GMT +0000. [10:27:54] RECOVERY - cp20 Stunnel HTTP for mw121 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 7.238 second response time [10:27:57] RECOVERY - cp20 SSH on cp20 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [10:28:01] PROBLEM - mw142 MediaWiki Rendering on mw142 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:28:07] PROBLEM - mw142 HTTPS on mw142 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:28:12] PROBLEM - cp20 Stunnel HTTP for mw131 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [10:28:25] RECOVERY - cp20 Stunnel HTTP for mw142 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.025 second response time [10:28:44] RECOVERY - mw131 MediaWiki Rendering on mw131 is OK: HTTP OK: HTTP/1.1 200 OK - 29512 bytes in 0.225 second response time [10:28:50] RECOVERY - mw131 HTTPS on mw131 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 545 bytes in 0.016 second response time [10:28:54] RECOVERY - cp31 Stunnel HTTP for mw121 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.341 second response time [10:28:55] RECOVERY - cp31 Stunnel HTTP for mw131 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 0.321 second response time [10:28:59] PROBLEM - wc.miraheze.org on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:29:22] PROBLEM - cp20 HTTP 4xx/5xx ERROR Rate on cp20 is WARNING: WARNING - NGINX Error Rate is 41% [10:29:52] PROBLEM - miraheze.ga - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:29:56] RECOVERY - mw142 MediaWiki Rendering on mw142 is OK: HTTP OK: HTTP/1.1 200 OK - 29512 bytes in 0.184 second response time [10:30:05] RECOVERY - mw142 HTTPS on mw142 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 545 bytes in 0.006 second response time [10:30:06] PROBLEM - cp30 Stunnel HTTP for mw122 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:30:06] RECOVERY - cp21 Stunnel HTTP for mw142 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.034 second response time [10:30:11] PROBLEM - cp30 Stunnel HTTP for mw132 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:30:11] PROBLEM - tot.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:30:22] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 8.05, 6.55, 4.70 [10:30:22] RECOVERY - polandballwiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'www.polandballwiki.com' will expire on Thu 29 Sep 2022 08:52:53 GMT +0000. [10:30:30] PROBLEM - wiki.s23.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:30:47] PROBLEM - cp20 Stunnel HTTP for mw141 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:30:48] PROBLEM - wiki.cjgh.xyz - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:30:56] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::4c25/cpweb [10:31:02] RECOVERY - threedomwiki.pcast.site - LetsEncrypt on sslhost is OK: OK - Certificate 'threedomwiki.pcast.site' will expire on Mon 22 Aug 2022 22:02:33 GMT +0000. [10:31:26] RECOVERY - cp20 Stunnel HTTP for mw132 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 3.040 second response time [10:31:48] RECOVERY - wiki.iurevar.world - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.iurevar.world' will expire on Wed 21 Sep 2022 08:53:59 GMT +0000. [10:31:59] PROBLEM - cp21 Stunnel HTTP for mw122 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:32:05] RECOVERY - en.gyaanipedia.com - LetsEncrypt on sslhost is OK: OK - Certificate 'en.gyaanipedia.com' will expire on Thu 08 Sep 2022 07:04:52 GMT +0000. [10:32:10] RECOVERY - cp30 Stunnel HTTP for mw132 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 0.325 second response time [10:32:12] PROBLEM - cp30 Stunnel HTTP for mw141 on cp30 is CRITICAL: HTTP CRITICAL - No data received from host [10:32:15] RECOVERY - mcwiki.kirbygang.tk - LetsEncrypt on sslhost is OK: OK - Certificate 'mcwiki.kirbygang.tk' will expire on Wed 05 Oct 2022 22:00:10 GMT +0000. [10:32:18] PROBLEM - mw141 MediaWiki Rendering on mw141 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:32:21] PROBLEM - wiki.nevillepedia.eu - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:32:21] PROBLEM - cp20 HTTP 4xx/5xx ERROR Rate on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [10:32:22] PROBLEM - cp21 HTTPS on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:32:30] PROBLEM - cp31 Stunnel HTTP for mw122 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:32:39] PROBLEM - cp20 conntrack_table_size on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [10:32:45] PROBLEM - mw122 MediaWiki Rendering on mw122 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:32:47] RECOVERY - cp21 Stunnel HTTP for mw132 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 0.017 second response time [10:32:48] PROBLEM - cp31 Stunnel HTTP for mw141 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:32:50] PROBLEM - cp20 Stunnel HTTP for reports121 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [10:32:54] RECOVERY - cp20 Stunnel HTTP for mw122 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 5.528 second response time [10:33:03] PROBLEM - cp30 Stunnel HTTP for mw121 on cp30 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 328 bytes in 0.242 second response time [10:33:11] RECOVERY - cp21 Stunnel HTTP for mw131 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 7.387 second response time [10:33:19] PROBLEM - cp31 Stunnel HTTP for mw121 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:33:37] RECOVERY - cp31 HTTP 4xx/5xx ERROR Rate on cp31 is OK: OK - NGINX Error Rate is 4% [10:33:46] RECOVERY - cp20 Stunnel HTTP for mw131 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 6.619 second response time [10:33:59] RECOVERY - cp21 Stunnel HTTP for mw122 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 1.032 second response time [10:34:04] RECOVERY - cp30 Stunnel HTTP for mw122 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 0.330 second response time [10:34:07] RECOVERY - cp30 Stunnel HTTP for mw141 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.322 second response time [10:34:12] RECOVERY - mw141 MediaWiki Rendering on mw141 is OK: HTTP OK: HTTP/1.1 200 OK - 29512 bytes in 0.341 second response time [10:34:17] RECOVERY - cp21 HTTPS on cp21 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 3405 bytes in 0.017 second response time [10:34:19] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 2.49, 5.51, 4.79 [10:34:20] RECOVERY - cp20 HTTP 4xx/5xx ERROR Rate on cp20 is OK: OK - NGINX Error Rate is 7% [10:34:25] RECOVERY - cp31 Stunnel HTTP for mw122 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.312 second response time [10:34:38] RECOVERY - miraheze.gq - LetsEncrypt on sslhost is OK: OK - Certificate 'miraheze.gq' will expire on Wed 31 Aug 2022 20:33:05 GMT +0000. [10:34:40] RECOVERY - cp20 conntrack_table_size on cp20 is OK: OK: nf_conntrack is 4 % full [10:34:42] RECOVERY - mw122 MediaWiki Rendering on mw122 is OK: HTTP OK: HTTP/1.1 200 OK - 29512 bytes in 0.348 second response time [10:34:46] RECOVERY - cp20 Stunnel HTTP for reports121 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 10996 bytes in 0.039 second response time [10:34:49] RECOVERY - cp31 Stunnel HTTP for mw141 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 0.306 second response time [10:34:58] RECOVERY - cp30 Stunnel HTTP for mw121 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.323 second response time [10:35:03] PROBLEM - central.ballmedia.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:35:18] RECOVERY - cp31 Stunnel HTTP for mw121 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.313 second response time [10:35:46] RECOVERY - robloxapi.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'robloxapi.wiki' will expire on Mon 12 Sep 2022 18:36:58 GMT +0000. [10:35:58] RECOVERY - www.dovearchives.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'www.dovearchives.wiki' will expire on Mon 05 Sep 2022 14:22:04 GMT +0000. [10:36:17] RECOVERY - gluster102 Current Load on gluster102 is OK: OK - load average: 0.65, 3.88, 4.28 [10:36:19] PROBLEM - cp20 SSH on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:36:58] RECOVERY - cp21 Stunnel HTTP for mw121 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 3.066 second response time [10:37:00] PROBLEM - www.project-patterns.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'project-patterns.com' expires in 15 day(s) (Fri 19 Aug 2022 17:20:05 GMT +0000). [10:37:31] PROBLEM - cp20 Stunnel HTTP for mw132 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [10:37:41] RECOVERY - cp31 Varnish Backends on cp31 is OK: All 14 backends are healthy [10:37:43] RECOVERY - cp30 Varnish Backends on cp30 is OK: All 14 backends are healthy [10:37:46] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.94, 3.24, 2.07 [10:38:44] RECOVERY - cp20 Stunnel HTTP for mw141 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.016 second response time [10:39:34] RECOVERY - wc.miraheze.org on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [10:39:37] RECOVERY - cp20 Stunnel HTTP for mw132 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 2.045 second response time [10:39:47] PROBLEM - cp20 HTTPS on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:40:02] RECOVERY - history.estill.org - LetsEncrypt on sslhost is OK: OK - Certificate 'history.estill.org' will expire on Wed 24 Aug 2022 03:29:39 GMT +0000. [10:40:29] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.46, 3.77, 3.05 [10:40:38] RECOVERY - wiki.hylormc.tk - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.hylormc.tk' will expire on Sun 04 Sep 2022 22:31:11 GMT +0000. [10:40:38] PROBLEM - cp21 Stunnel HTTP for mw141 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [10:40:58] RECOVERY - wiki.qadrishattari.xyz - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.qadrishattari.xyz' will expire on Sat 01 Oct 2022 16:09:21 GMT +0000. [10:41:54] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.28, 8.26, 6.45 [10:42:33] RECOVERY - cp20 SSH on cp20 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [10:42:36] RECOVERY - wiki.minecraftathome.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.minecraftathome.com' will expire on Wed 24 Aug 2022 02:32:00 GMT +0000. [10:43:10] RECOVERY - phgalaxy.eu.org - LetsEncrypt on sslhost is OK: OK - Certificate 'phgalaxy.eu.org' will expire on Sun 02 Oct 2022 05:33:18 GMT +0000. [10:43:48] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.07, 9.74, 7.21 [10:43:53] RECOVERY - cp20 HTTPS on cp20 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 3407 bytes in 7.212 second response time [10:46:04] RECOVERY - wiki.veloren.net - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.veloren.net' will expire on Sat 15 Oct 2022 15:52:05 GMT +0000. [10:46:13] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.94, 3.98, 3.41 [10:46:18] RECOVERY - wiki.fossbots.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.fossbots.org' will expire on Sun 16 Oct 2022 13:11:42 GMT +0000. [10:46:27] PROBLEM - cp20 Stunnel HTTP for mail121 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:46:54] RECOVERY - cp21 Stunnel HTTP for mw141 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.026 second response time [10:47:28] RECOVERY - es.gyaanipedia.com - LetsEncrypt on sslhost is OK: OK - Certificate 'es.gyaanipedia.com' will expire on Thu 08 Sep 2022 07:18:15 GMT +0000. [10:47:36] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.86, 10.92, 8.44 [10:48:03] RECOVERY - tensegritywiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'tensegritywiki.com' will expire on Tue 23 Aug 2022 08:10:17 GMT +0000. [10:48:46] PROBLEM - wiki-tintin.cf - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:48:48] RECOVERY - finalfantasy.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [10:49:18] PROBLEM - cp21 Stunnel HTTP for phab121 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:49:30] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 6.65, 9.51, 8.22 [10:50:07] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.59, 3.37, 3.28 [10:50:11] RECOVERY - savagepedia.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'savagepedia.wiki' will expire on Wed 24 Aug 2022 04:44:37 GMT +0000. [10:51:23] RECOVERY - cp20 Stunnel HTTP for mail121 on cp20 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 427 bytes in 1.050 second response time [10:51:35] PROBLEM - enc.for.uz - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:51:46] RECOVERY - cp21 Stunnel HTTP for phab121 on cp21 is OK: HTTP OK: Status line output matched "500" - 2855 bytes in 0.087 second response time [10:52:06] RECOVERY - puzzles.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'www.puzzles.wiki' will expire on Thu 20 Oct 2022 16:22:25 GMT +0000. [10:52:19] RECOVERY - guia.esporo.net - LetsEncrypt on sslhost is OK: OK - Certificate 'guia.esporo.net' will expire on Tue 23 Aug 2022 02:23:57 GMT +0000. [10:52:32] RECOVERY - commons.gyaanipedia.com - LetsEncrypt on sslhost is OK: OK - Certificate 'commons.gyaanipedia.com' will expire on Thu 08 Sep 2022 06:46:28 GMT +0000. [10:52:54] PROBLEM - mediawiki.ecfin.eu - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:53:16] RECOVERY - wiki.thesimswiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'www.thesimswiki.com' will expire on Wed 24 Aug 2022 01:38:48 GMT +0000. [10:53:19] RECOVERY - wiki.mineland.eu - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.mineland.eu' will expire on Tue 23 Aug 2022 01:29:10 GMT +0000. [10:53:23] RECOVERY - lgbtqia.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'www.lgbtqia.wiki' will expire on Fri 07 Oct 2022 11:35:52 GMT +0000. [10:53:38] PROBLEM - programming.red - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:53:54] PROBLEM - royal-wiki.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:54:07] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 6.12, 4.45, 3.69 [10:54:07] PROBLEM - cp20 HTTPS on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:54:19] PROBLEM - mario.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:54:35] PROBLEM - cp20 Stunnel HTTP for mw131 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [10:56:06] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [10:58:04] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [10:58:05] PROBLEM - test2.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:58:48] RECOVERY - cp20 Stunnel HTTP for mw131 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.016 second response time [10:58:48] RECOVERY - miraheze.ga - LetsEncrypt on sslhost is OK: OK - Certificate 'miraheze.ga' will expire on Wed 24 Aug 2022 04:25:02 GMT +0000. [10:59:17] PROBLEM - cp20 SSH on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:59:19] PROBLEM - cp21 Stunnel HTTP for mon141 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:59:32] RECOVERY - wiki.grottocenter.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.grottocenter.org' will expire on Mon 22 Aug 2022 22:30:31 GMT +0000. [10:59:34] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.53, 3.64, 3.72 [10:59:50] RECOVERY - tot.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'tot.wiki' will expire on Tue 23 Aug 2022 12:51:08 GMT +0000. [11:00:05] PROBLEM - cp21 Stunnel HTTP for matomo131 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [11:00:16] RECOVERY - wikimoma.art - LetsEncrypt on sslhost is OK: OK - Certificate 'wikimoma.art' will expire on Sat 17 Sep 2022 19:04:53 GMT +0000. [11:00:26] RECOVERY - wiki.cjgh.xyz - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.cjgh.xyz' will expire on Mon 03 Oct 2022 20:57:39 GMT +0000. [11:00:29] RECOVERY - wiki.s23.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.s23.org' will expire on Wed 24 Aug 2022 03:08:19 GMT +0000. [11:00:40] PROBLEM - cp20 Stunnel HTTP for mw141 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [11:00:47] PROBLEM - wiki.recaptime.tk - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:00:54] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 26.49, 13.22, 8.62 [11:00:57] PROBLEM - trollpasta.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:01:02] PROBLEM - tech.teojingyao.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:01:14] PROBLEM - cp21 SSH on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:01:18] RECOVERY - cp20 SSH on cp20 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [11:01:30] PROBLEM - cp21 Stunnel HTTP for mw142 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [11:01:41] RECOVERY - wiki.nevillepedia.eu - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.nevillepedia.eu' will expire on Wed 24 Aug 2022 04:41:20 GMT +0000. [11:02:05] RECOVERY - cp21 Stunnel HTTP for matomo131 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 99061 bytes in 0.139 second response time [11:02:25] RECOVERY - cp20 HTTPS on cp20 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 3407 bytes in 7.165 second response time [11:02:26] PROBLEM - wiki.potabi.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:02:57] PROBLEM - cp20 Stunnel HTTP for mw122 on cp20 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 328 bytes in 3.048 second response time [11:02:59] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 0.48, 0.84, 0.72 [11:03:09] RECOVERY - cp21 SSH on cp21 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [11:03:23] PROBLEM - cp21 Stunnel HTTP for mw131 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:03:24] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 27.21, 19.17, 12.73 [11:03:30] RECOVERY - cp21 Stunnel HTTP for mw142 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 2.061 second response time [11:03:32] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.27, 3.98, 3.85 [11:03:49] PROBLEM - cp21 Stunnel HTTP for mw122 on cp21 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 328 bytes in 0.014 second response time [11:04:03] PROBLEM - wiki.chouverse.cludisciples.cyou - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:04:09] PROBLEM - cp31 Stunnel HTTP for mw122 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:04:15] PROBLEM - cp30 Stunnel HTTP for mw122 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:04:18] RECOVERY - cp21 Stunnel HTTP for mon141 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 39170 bytes in 1.053 second response time [11:04:27] PROBLEM - mw122 MediaWiki Rendering on mw122 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:04:46] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 5.75, 11.76, 9.34 [11:04:52] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::4c25/cpweb [11:05:05] RECOVERY - central.ballmedia.org - LetsEncrypt on sslhost is OK: OK - Certificate 'central.ballmedia.org' will expire on Mon 10 Oct 2022 06:35:15 GMT +0000. [11:05:27] RECOVERY - cp20 Stunnel HTTP for mw122 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 3.127 second response time [11:05:42] PROBLEM - cp31 Varnish Backends on cp31 is CRITICAL: 1 backends are down. mw122 [11:05:51] RECOVERY - cp21 Stunnel HTTP for mw131 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 1.053 second response time [11:06:04] RECOVERY - cp31 Stunnel HTTP for mw122 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.313 second response time [11:06:09] RECOVERY - cp30 Stunnel HTTP for mw122 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.347 second response time [11:06:20] PROBLEM - wiki.villagecollaborative.net - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:06:24] RECOVERY - mw122 MediaWiki Rendering on mw122 is OK: HTTP OK: HTTP/1.1 200 OK - 29512 bytes in 0.365 second response time [11:06:42] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 3.87, 9.07, 8.63 [11:06:48] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [11:08:04] RECOVERY - cp21 Stunnel HTTP for mw122 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 1.023 second response time [11:09:41] RECOVERY - cp31 Varnish Backends on cp31 is OK: All 14 backends are healthy [11:09:58] PROBLEM - replication-ops.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:10:29] PROBLEM - cp21 Stunnel HTTP for mw132 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [11:10:34] PROBLEM - cp20 Stunnel HTTP for reports121 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [11:10:42] [02miraheze/MirahezeMagic] 07translatewiki pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/MirahezeMagic/compare/8fc0344525cd...c67262cbd4cd [11:10:42] [url] Comparing 8fc0344525cd...c67262cbd4cd · miraheze/MirahezeMagic · GitHub | github.com [11:10:43] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::1b80/cpweb [11:10:43] [02miraheze/MirahezeMagic] 07translatewiki 03c67262c - Localisation updates from https://translatewiki.net. [11:10:44] [url] Main page - translatewiki.net | translatewiki.net [11:10:53] PROBLEM - beaconspace.unrestrictedlorefare.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:11:06] PROBLEM - wiki.beergeeks.co.il - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:12:03] RECOVERY - cp20 Stunnel HTTP for mw141 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.016 second response time [11:12:13] PROBLEM - cp20 Stunnel HTTP for mw131 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [11:12:26] RECOVERY - cp21 Stunnel HTTP for mw132 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 1.056 second response time [11:12:28] RECOVERY - cp20 Stunnel HTTP for reports121 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 10996 bytes in 0.032 second response time [11:12:39] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [11:12:53] PROBLEM - cp20 HTTPS on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:13:02] PROBLEM - cp21 Stunnel HTTP for phab121 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:13:27] PROBLEM - en.pornwiki.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:13:27] PROBLEM - cp21 Stunnel HTTP for mw121 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:13:46] RECOVERY - cp21 Varnish Backends on cp21 is OK: All 14 backends are healthy [11:14:28] RECOVERY - cp20 Stunnel HTTP for mw131 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 1.050 second response time [11:14:36] PROBLEM - wiki.helsinginpoytaroolipelaajat.fi - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:15:23] RECOVERY - cp21 Stunnel HTTP for mw121 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.017 second response time [11:16:03] PROBLEM - unmade.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:16:05] PROBLEM - wiki.otir.nl - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:16:14] PROBLEM - entw.ml - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:16:14] PROBLEM - dariawiki.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:16:33] PROBLEM - cp21 Disk Space on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [11:17:08] PROBLEM - cp20 Stunnel HTTP for mon141 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [11:17:09] PROBLEM - cp21 Stunnel HTTP for mw142 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:17:22] PROBLEM - cp21 Stunnel HTTP for test131 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:17:24] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 5.32, 9.39, 11.34 [11:17:38] PROBLEM - guia.cineastas.pt - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:17:41] PROBLEM - meta.gyaanipedia.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:17:53] PROBLEM - wiki.fossbots.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:18:04] RECOVERY - cp21 Stunnel HTTP for phab121 on cp21 is OK: HTTP OK: Status line output matched "500" - 2855 bytes in 3.167 second response time [11:18:11] RECOVERY - wiki-tintin.cf - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki-tintin.cf' will expire on Mon 10 Oct 2022 03:55:03 GMT +0000. [11:18:29] RECOVERY - cp21 Disk Space on cp21 is OK: DISK OK - free space: / 10057 MB (26% inode=96%); [11:18:57] PROBLEM - cp21 HTTPS on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:19:09] RECOVERY - cp20 Stunnel HTTP for mon141 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 39185 bytes in 2.062 second response time [11:19:21] RECOVERY - cp21 Stunnel HTTP for test131 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15954 bytes in 1.030 second response time [11:19:29] PROBLEM - wiki.starship.digital - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:19:43] PROBLEM - cp21 Varnish Backends on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [11:19:49] PROBLEM - inourownwords.online - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:20:02] PROBLEM - cp20 SSH on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:20:12] PROBLEM - wiki.counterculturelabs.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:20:25] PROBLEM - wc.miraheze.org on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:20:51] RECOVERY - cp21 HTTPS on cp21 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 3405 bytes in 0.016 second response time [11:21:01] miraheze/MirahezeMagic - translatewiki the build passed. [11:21:02] RECOVERY - cp20 HTTPS on cp20 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 3407 bytes in 3.055 second response time [11:21:16] RECOVERY - enc.for.uz - LetsEncrypt on sslhost is OK: OK - Certificate 'enc.for.uz' will expire on Tue 23 Aug 2022 01:42:45 GMT +0000. [11:21:22] PROBLEM - cp21 SSH on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:21:24] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 3.11, 6.17, 9.58 [11:21:39] PROBLEM - cp20 Stunnel HTTP for mw131 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [11:22:01] PROBLEM - yokaiwatchwiki.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:22:05] RECOVERY - cp21 Stunnel HTTP for mw142 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 2.086 second response time [11:22:07] RECOVERY - cp20 SSH on cp20 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [11:22:35] PROBLEM - wiki.cyberfurs.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:22:37] RECOVERY - hi.gyaanipedia.com - LetsEncrypt on sslhost is OK: OK - Certificate 'hi.gyaanipedia.com' will expire on Thu 08 Sep 2022 06:44:45 GMT +0000. [11:23:04] RECOVERY - programming.red - LetsEncrypt on sslhost is OK: OK - Certificate 'programming.red' will expire on Tue 23 Aug 2022 09:31:28 GMT +0000. [11:23:16] RECOVERY - royal-wiki.org - LetsEncrypt on sslhost is OK: OK - Certificate 'royal-wiki.org' will expire on Wed 28 Sep 2022 11:34:56 GMT +0000. [11:23:19] RECOVERY - cp21 SSH on cp21 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [11:23:38] RECOVERY - cp20 Stunnel HTTP for mw131 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 1.029 second response time [11:23:54] PROBLEM - cp21 Puppet on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [11:23:59] PROBLEM - dcmultiverse.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:24:12] RECOVERY - mario.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [11:24:18] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 2 datacenters are down: 2001:41d0:801:2000::4c25/cpweb, 2001:41d0:801:2000::1b80/cpweb [11:24:33] RECOVERY - wc.miraheze.org on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [11:24:44] RECOVERY - www.pornwiki.org - LetsEncrypt on sslhost is OK: OK - Certificate 'www.pornwiki.org' will expire on Sat 17 Sep 2022 20:10:50 GMT +0000. [11:27:45] RECOVERY - test2.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [11:28:27] PROBLEM - cp20 Stunnel HTTP for mw122 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:28:55] RECOVERY - christipedia.nl - LetsEncrypt on sslhost is OK: OK - Certificate 'www.christipedia.nl' will expire on Sat 17 Sep 2022 18:34:21 GMT +0000. [11:29:36] RECOVERY - wiki.recaptime.tk - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.recaptime.tk' will expire on Wed 26 Oct 2022 23:10:27 GMT +0000. [11:29:47] RECOVERY - trollpasta.com - LetsEncrypt on sslhost is OK: OK - Certificate 'trollpasta.com' will expire on Mon 10 Oct 2022 06:29:05 GMT +0000. [11:29:56] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [11:30:03] RECOVERY - www.istpcomputing.com - LetsEncrypt on sslhost is OK: OK - Certificate 'istpcomputing.com' will expire on Tue 11 Oct 2022 04:37:06 GMT +0000. [11:30:04] PROBLEM - miraheze.ga - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:30:15] RECOVERY - iol.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'iol.wiki' will expire on Thu 27 Oct 2022 14:58:25 GMT +0000. [11:30:29] PROBLEM - cp20 SSH on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:30:29] RECOVERY - tech.teojingyao.com - LetsEncrypt on sslhost is OK: OK - Certificate 'tech.teojingyao.com' will expire on Sat 08 Oct 2022 04:57:57 GMT +0000. [11:31:17] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.26, 1.43, 0.91 [11:31:36] RECOVERY - cp21 Puppet on cp21 is OK: OK: Puppet is currently enabled, last run 5 minutes ago with 0 failures [11:32:01] RECOVERY - wiki.potabi.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.potabi.com' will expire on Mon 10 Oct 2022 06:24:27 GMT +0000. [11:32:19] PROBLEM - cp20 HTTPS on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:32:44] RECOVERY - cp20 Stunnel HTTP for mw122 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 7.105 second response time [11:33:14] RECOVERY - wiki.chouverse.cludisciples.cyou - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.chouverse.cludisciples.cyou' will expire on Tue 23 Aug 2022 00:10:19 GMT +0000. [11:33:16] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.92, 1.19, 0.89 [11:33:35] PROBLEM - cp21 Stunnel HTTP for mw131 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:34:35] RECOVERY - cp20 SSH on cp20 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [11:35:23] PROBLEM - mw131 Current Load on mw131 is WARNING: WARNING - load average: 11.19, 8.61, 6.52 [11:35:45] PROBLEM - cp21 SSH on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:35:46] RECOVERY - cp21 Stunnel HTTP for mw131 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 1.036 second response time [11:35:58] PROBLEM - cp21 HTTPS on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:36:12] RECOVERY - wiki.villagecollaborative.net - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.villagecollaborative.net' will expire on Wed 24 Aug 2022 02:59:35 GMT +0000. [11:36:25] RECOVERY - cp20 HTTPS on cp20 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 3407 bytes in 7.213 second response time [11:37:21] RECOVERY - mw131 Current Load on mw131 is OK: OK - load average: 7.10, 8.19, 6.63 [11:37:27] PROBLEM - cp21 Stunnel HTTP for test131 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [11:37:39] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 0.39, 0.52, 0.66 [11:37:57] RECOVERY - cp21 HTTPS on cp21 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 3405 bytes in 4.174 second response time [11:38:49] RECOVERY - replication-ops.com - LetsEncrypt on sslhost is OK: OK - Certificate 'replication-ops.com' will expire on Tue 18 Oct 2022 15:32:39 GMT +0000. [11:39:12] RECOVERY - monarchists.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'monarchists.wiki' will expire on Wed 24 Aug 2022 16:50:46 GMT +0000. [11:39:24] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 29.41, 19.75, 13.56 [11:39:40] RECOVERY - cp21 Stunnel HTTP for test131 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15954 bytes in 0.025 second response time [11:40:23] RECOVERY - beaconspace.unrestrictedlorefare.com - LetsEncrypt on sslhost is OK: OK - Certificate 'beaconspace.unrestrictedlorefare.com' will expire on Tue 23 Aug 2022 00:32:44 GMT +0000. [11:40:43] PROBLEM - cp20 Stunnel HTTP for reports121 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:41:02] RECOVERY - wiki.beergeeks.co.il - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.beergeeks.co.il' will expire on Mon 22 Aug 2022 21:21:00 GMT +0000. [11:41:25] PROBLEM - cp20 Stunnel HTTP for mw141 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [11:41:58] RECOVERY - cp21 SSH on cp21 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [11:42:21] PROBLEM - cp21 Stunnel HTTP for matomo131 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [11:42:44] RECOVERY - cp20 Stunnel HTTP for reports121 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 10996 bytes in 0.027 second response time [11:42:50] RECOVERY - en.pornwiki.org - LetsEncrypt on sslhost is OK: OK - Certificate 'en.pornwiki.org' will expire on Sat 17 Sep 2022 22:00:09 GMT +0000. [11:43:21] RECOVERY - wiki.helsinginpoytaroolipelaajat.fi - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.helsinginpoytaroolipelaajat.fi' will expire on Mon 29 Aug 2022 12:44:24 GMT +0000. [11:44:02] PROBLEM - lcn.zfc.id.lv - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:44:33] PROBLEM - cp21 Stunnel HTTP for mw132 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:44:34] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 19.53, 13.31, 9.34 [11:44:37] PROBLEM - betaheze.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:44:53] RECOVERY - wiki.otir.nl - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.otir.nl' will expire on Fri 26 Aug 2022 04:20:05 GMT +0000. [11:44:57] PROBLEM - zh.gyaanipedia.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:44:57] PROBLEM - cp20 SSH on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:45:24] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 3.79, 9.86, 11.21 [11:45:37] PROBLEM - wiki.site97.fr - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:45:49] RECOVERY - unmade.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [11:46:03] PROBLEM - nenawiki.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:46:29] PROBLEM - cloudwiki.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:46:32] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 6.94, 10.58, 8.82 [11:46:56] RECOVERY - cp20 SSH on cp20 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [11:47:00] RECOVERY - cp21 Stunnel HTTP for mw132 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.023 second response time [11:47:02] RECOVERY - wiki.fossbots.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.fossbots.org' will expire on Sun 16 Oct 2022 13:11:42 GMT +0000. [11:47:49] RECOVERY - cp21 Stunnel HTTP for matomo131 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 99061 bytes in 0.250 second response time [11:48:05] PROBLEM - wiki.projectdiablo2.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:48:15] PROBLEM - miraheze.tk - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:48:30] PROBLEM - cp20 HTTPS on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:48:32] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.27, 9.62, 8.66 [11:48:59] RECOVERY - wiki.starship.digital - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.starship.digital' will expire on Wed 24 Aug 2022 02:44:01 GMT +0000. [11:49:06] RECOVERY - inourownwords.online - LetsEncrypt on sslhost is OK: OK - Certificate 'inourownwords.online' will expire on Fri 02 Sep 2022 12:36:55 GMT +0000. [11:49:24] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 2.95, 6.00, 9.31 [11:49:30] RECOVERY - bn.wikiyri.org - LetsEncrypt on sslhost is OK: OK - Certificate 'bn.wikiyri.org' will expire on Mon 10 Oct 2022 04:05:24 GMT +0000. [11:49:32] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [11:49:32] RECOVERY - wiki.counterculturelabs.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.counterculturelabs.org' will expire on Wed 31 Aug 2022 18:20:36 GMT +0000. [11:49:33] PROBLEM - es.gyaanipedia.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:49:36] PROBLEM - wiki.zymonic.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:49:45] PROBLEM - icclopedia.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:50:33] PROBLEM - wiki.slimelab.net - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:51:21] RECOVERY - mediawiki.ecfin.eu - LetsEncrypt on sslhost is OK: OK - Certificate 'mediawiki.ecfin.eu' will expire on Mon 22 Aug 2022 23:01:19 GMT +0000. [11:51:59] RECOVERY - yokaiwatchwiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'yokaiwatchwiki.com' will expire on Tue 01 Nov 2022 02:48:17 GMT +0000. [11:52:10] PROBLEM - speleo.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:52:12] RECOVERY - wiki.cyberfurs.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.cyberfurs.org' will expire on Wed 24 Aug 2022 05:10:07 GMT +0000. [11:52:35] RECOVERY - cp20 HTTPS on cp20 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 3407 bytes in 7.183 second response time [11:52:56] PROBLEM - solaswiki.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:52:59] PROBLEM - www.bluepageswiki.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:53:00] RECOVERY - cp20 Stunnel HTTP for mw141 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 7.069 second response time [11:53:11] RECOVERY - dcmultiverse.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [11:53:24] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 15.99, 11.43, 10.67 [11:53:26] PROBLEM - cp20 SSH on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:53:51] PROBLEM - wiki.kachow.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:53:54] PROBLEM - cp21 Stunnel HTTP for mon141 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [11:54:32] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 18.47, 12.49, 9.90 [11:55:24] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.02, 10.11, 10.27 [11:55:27] RECOVERY - cp20 SSH on cp20 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [11:55:59] PROBLEM - www.publictestwiki.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:56:04] RECOVERY - wiki.whentheycry.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.whentheycry.org' will expire on Wed 24 Aug 2022 02:57:37 GMT +0000. [11:56:27] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::4c25/cpweb [11:57:21] PROBLEM - nonbinary.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:57:24] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.04, 10.69, 10.45 [11:58:06] RECOVERY - cp21 Stunnel HTTP for mon141 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 39185 bytes in 1.042 second response time [11:58:07] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.13, 3.35, 3.99 [11:58:32] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 4.84, 11.74, 10.56 [11:59:01] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.19, 3.28, 3.92 [11:59:56] PROBLEM - cp21 Stunnel HTTP for phab121 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [12:00:24] PROBLEM - cp20 Puppet on cp20 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): File[/etc/apt/trusted.gpg.d/puppetlabs.gpg] [12:00:29] PROBLEM - wiki.virtualjet.net - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:00:32] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 3.72, 9.24, 9.80 [12:01:06] PROBLEM - cp20 Stunnel HTTP for mw141 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [12:01:25] PROBLEM - cp21 Stunnel HTTP for mw121 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:01:52] RECOVERY - cp21 Stunnel HTTP for phab121 on cp21 is OK: HTTP OK: Status line output matched "500" - 2855 bytes in 0.092 second response time [12:02:33] PROBLEM - uncyclopediakr.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:02:43] PROBLEM - test3.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:02:57] PROBLEM - wc.miraheze.org on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:03:05] RECOVERY - cp20 Stunnel HTTP for mw141 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 1.031 second response time [12:03:21] PROBLEM - wiki.pacebi.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:03:29] RECOVERY - cp21 Stunnel HTTP for mw121 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 0.051 second response time [12:04:10] PROBLEM - mcwiki.kirbygang.tk - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:04:12] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [12:04:26] PROBLEM - cyberlaw.ccdcoe.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:04:56] RECOVERY - wc.miraheze.org on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [12:05:24] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 3.67, 9.87, 10.99 [12:05:34] PROBLEM - fc.songcontests.eu - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:05:34] PROBLEM - rct.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:06:16] PROBLEM - cp21 Stunnel HTTP for mw142 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [12:06:52] PROBLEM - ndg.nenawiki.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:06:53] PROBLEM - cp20 HTTPS on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:07:00] PROBLEM - wiki.dereric.gq - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:07:06] PROBLEM - robloxapi.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:07:24] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 3.46, 7.69, 10.05 [12:07:25] PROBLEM - cp21 Stunnel HTTP for test131 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [12:08:07] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.98, 2.79, 3.38 [12:08:55] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.89, 3.53, 3.63 [12:09:01] PROBLEM - microworldwiki.ga - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:09:23] PROBLEM - wc.miraheze.org on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:09:38] RECOVERY - cp21 Stunnel HTTP for test131 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15954 bytes in 1.065 second response time [12:09:55] PROBLEM - az.wikiretet.ga - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:09:59] PROBLEM - creativecommons.id - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:10:03] PROBLEM - mh142.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:10:46] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [12:10:52] PROBLEM - www.sdiy.info - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:11:25] RECOVERY - cp21 Stunnel HTTP for mw142 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 1.038 second response time [12:11:31] PROBLEM - wiki.fbpml.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:12:07] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.45, 3.41, 3.53 [12:12:32] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 25.00, 15.21, 10.86 [12:12:47] PROBLEM - wikipanel.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:12:56] PROBLEM - theapplesecretswiki.ml - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:13:04] PROBLEM - wiki.exputra.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:13:19] PROBLEM - wiki.ct777.cf - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:13:25] PROBLEM - wiki.beergeeks.co.il - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:14:07] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.61, 4.12, 3.79 [12:14:25] RECOVERY - zh.gyaanipedia.com - LetsEncrypt on sslhost is OK: OK - Certificate 'zh.gyaanipedia.com' will expire on Thu 08 Sep 2022 06:29:43 GMT +0000. [12:14:34] PROBLEM - hololive.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:14:43] RECOVERY - nenawiki.org - LetsEncrypt on sslhost is OK: OK - Certificate 'nenawiki.org' will expire on Tue 23 Aug 2022 01:35:44 GMT +0000. [12:14:48] PROBLEM - celeste.ink - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:14:52] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.56, 3.94, 3.78 [12:16:04] RECOVERY - cloudwiki.org - LetsEncrypt on sslhost is OK: OK - Certificate 'cloudwiki.org' will expire on Sun 23 Oct 2022 16:49:57 GMT +0000. [12:16:09] RECOVERY - meta.gyaanipedia.com - LetsEncrypt on sslhost is OK: OK - Certificate 'meta.gyaanipedia.com' will expire on Thu 08 Sep 2022 07:12:19 GMT +0000. [12:16:29] PROBLEM - cp21 Stunnel HTTP for matomo131 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [12:17:03] RECOVERY - cp20 HTTPS on cp20 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 3407 bytes in 0.016 second response time [12:17:28] RECOVERY - wiki.projectdiablo2.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.projectdiablo2.com' will expire on Tue 11 Oct 2022 03:46:46 GMT +0000. [12:17:32] RECOVERY - guia.cineastas.pt - LetsEncrypt on sslhost is OK: OK - Certificate 'guia.cineastas.pt' will expire on Tue 23 Aug 2022 01:13:17 GMT +0000. [12:18:29] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 1.47, 0.92, 1.03 [12:18:32] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.77, 10.97, 10.44 [12:18:48] RECOVERY - wiki.zymonic.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.zymonic.com' will expire on Wed 24 Aug 2022 02:07:19 GMT +0000. [12:18:48] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 2 datacenters are down: 2001:41d0:801:2000::4c25/cpweb, 2001:41d0:801:2000::1b80/cpweb [12:18:49] RECOVERY - es.gyaanipedia.com - LetsEncrypt on sslhost is OK: OK - Certificate 'es.gyaanipedia.com' will expire on Thu 08 Sep 2022 07:18:15 GMT +0000. [12:18:50] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.98, 4.38, 3.98 [12:18:54] PROBLEM - cp21 HTTPS on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:19:02] RECOVERY - icclopedia.org - LetsEncrypt on sslhost is OK: OK - Certificate 'icclopedia.org' will expire on Wed 24 Aug 2022 03:23:05 GMT +0000. [12:19:10] RECOVERY - wiki.slimelab.net - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.slimelab.net' will expire on Sat 01 Oct 2022 16:16:26 GMT +0000. [12:19:24] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 22.00, 12.97, 10.24 [12:20:32] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 4.33, 8.56, 9.62 [12:20:59] RECOVERY - buildabearwiki.info - LetsEncrypt on sslhost is OK: OK - Certificate 'buildabearwiki.info' will expire on Fri 16 Sep 2022 17:59:19 GMT +0000. [12:21:26] RECOVERY - cp21 Stunnel HTTP for matomo131 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 99061 bytes in 1.266 second response time [12:22:03] RECOVERY - speleo.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'speleo.wiki' will expire on Mon 22 Aug 2022 22:45:26 GMT +0000. [12:22:14] RECOVERY - wc.miraheze.org on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [12:22:41] RECOVERY - solaswiki.org - LetsEncrypt on sslhost is OK: OK - Certificate 'solaswiki.org' will expire on Sat 03 Sep 2022 15:10:56 GMT +0000. [12:22:42] PROBLEM - cp20 Stunnel HTTP for mail121 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [12:22:48] RECOVERY - wiki.kachow.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.kachow.org' will expire on Wed 12 Oct 2022 04:17:08 GMT +0000. [12:22:54] RECOVERY - www.bluepageswiki.org - LetsEncrypt on sslhost is OK: OK - Certificate 'www.bluepageswiki.org' will expire on Sat 17 Sep 2022 22:39:35 GMT +0000. [12:23:32] PROBLEM - lgbtqia.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:23:35] PROBLEM - erawikisource.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:24:44] RECOVERY - cp20 Stunnel HTTP for mail121 on cp20 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 427 bytes in 3.447 second response time [12:25:02] RECOVERY - cp21 HTTPS on cp21 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 3406 bytes in 3.065 second response time [12:26:09] PROBLEM - cp21 Stunnel HTTP for test131 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [12:26:37] PROBLEM - cp20 SSH on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:26:44] RECOVERY - nonbinary.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'nonbinary.wiki' will expire on Tue 23 Aug 2022 02:51:23 GMT +0000. [12:27:01] PROBLEM - cp21 Stunnel HTTP for phab121 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:27:54] RECOVERY - miraheze.ga - LetsEncrypt on sslhost is OK: OK - Certificate 'miraheze.ga' will expire on Wed 24 Aug 2022 04:25:02 GMT +0000. [12:28:07] PROBLEM - phytinfo.cf - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:28:32] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 20.05, 13.46, 10.91 [12:28:38] RECOVERY - cp20 SSH on cp20 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [12:29:23] PROBLEM - cp21 Stunnel HTTP for mw131 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:30:12] RECOVERY - wiki.virtualjet.net - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.virtualjet.net' will expire on Sun 25 Sep 2022 21:20:59 GMT +0000. [12:30:55] PROBLEM - cp21 Stunnel HTTP for mwtask141 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [12:31:12] RECOVERY - uncyclopediakr.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [12:31:22] RECOVERY - cp21 Stunnel HTTP for test131 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15954 bytes in 0.019 second response time [12:31:27] PROBLEM - wikipariksha.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:31:35] RECOVERY - test3.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [12:31:46] PROBLEM - cp21 Stunnel HTTP for mw122 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [12:31:56] PROBLEM - cp21 Disk Space on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [12:31:56] RECOVERY - cp21 Stunnel HTTP for phab121 on cp21 is OK: HTTP OK: Status line output matched "500" - 2855 bytes in 3.110 second response time [12:32:32] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.09, 11.52, 10.76 [12:32:44] RECOVERY - wiki.pacebi.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.pacebi.org' will expire on Mon 10 Oct 2022 06:45:00 GMT +0000. [12:32:51] RECOVERY - cp21 Stunnel HTTP for mwtask141 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15950 bytes in 0.018 second response time [12:33:09] PROBLEM - cp21 Stunnel HTTP for mw142 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:33:24] RECOVERY - mcwiki.kirbygang.tk - LetsEncrypt on sslhost is OK: OK - Certificate 'mcwiki.kirbygang.tk' will expire on Wed 05 Oct 2022 22:00:10 GMT +0000. [12:33:34] RECOVERY - cyberlaw.ccdcoe.org - LetsEncrypt on sslhost is OK: OK - Certificate 'cyberlaw.ccdcoe.org' will expire on Tue 23 Aug 2022 03:06:24 GMT +0000. [12:33:44] RECOVERY - cp21 Stunnel HTTP for mw122 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.130 second response time [12:33:55] RECOVERY - cp21 Disk Space on cp21 is OK: DISK OK - free space: / 9838 MB (25% inode=96%); [12:34:02] RECOVERY - cp21 Stunnel HTTP for mw131 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 1.048 second response time [12:34:11] RECOVERY - fc.songcontests.eu - LetsEncrypt on sslhost is OK: OK - Certificate 'fc.songcontests.eu' will expire on Mon 22 Aug 2022 22:44:59 GMT +0000. [12:34:11] RECOVERY - rct.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'rct.wiki' will expire on Mon 22 Aug 2022 21:33:31 GMT +0000. [12:34:32] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 3.98, 8.92, 9.90 [12:34:52] PROBLEM - cp20 Stunnel HTTP for mon141 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:34:58] PROBLEM - experimyco.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:35:08] RECOVERY - cp21 Stunnel HTTP for mw142 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 1.044 second response time [12:35:23] PROBLEM - cp20 Stunnel HTTP for mw141 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [12:35:46] RECOVERY - robloxapi.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'robloxapi.wiki' will expire on Mon 12 Sep 2022 18:36:58 GMT +0000. [12:36:08] RECOVERY - ndg.nenawiki.org - LetsEncrypt on sslhost is OK: OK - Certificate 'nenawiki.org' will expire on Tue 23 Aug 2022 01:35:44 GMT +0000. [12:36:30] PROBLEM - cp20 HTTPS on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:37:10] PROBLEM - www.project-patterns.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:37:16] PROBLEM - mw131 Current Load on mw131 is CRITICAL: CRITICAL - load average: 22.73, 15.31, 9.48 [12:37:22] PROBLEM - wiki.zergmafia.top - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:37:28] RECOVERY - cp20 Stunnel HTTP for mw141 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 7.086 second response time [12:38:07] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.33, 3.42, 3.95 [12:38:07] RECOVERY - microworldwiki.ga - LetsEncrypt on sslhost is OK: OK - Certificate 'microworldwiki.ga' will expire on Mon 26 Sep 2022 05:41:37 GMT +0000. [12:38:31] RECOVERY - cp20 HTTPS on cp20 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 3407 bytes in 7.302 second response time [12:38:42] RECOVERY - mh142.com - LetsEncrypt on sslhost is OK: OK - Certificate 'mh142.com' will expire on Tue 23 Aug 2022 00:06:10 GMT +0000. [12:38:42] RECOVERY - creativecommons.id - LetsEncrypt on sslhost is OK: OK - Certificate 'creativecommons.id' will expire on Thu 27 Oct 2022 05:20:13 GMT +0000. [12:38:52] PROBLEM - cp21 Stunnel HTTP for mwtask141 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:39:00] PROBLEM - cp20 SSH on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:39:16] PROBLEM - mw131 Current Load on mw131 is WARNING: WARNING - load average: 6.65, 11.68, 8.83 [12:39:17] RECOVERY - cp20 Stunnel HTTP for mon141 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 39170 bytes in 0.035 second response time [12:40:02] PROBLEM - www.hoolehistoryheritagesociety.org.uk - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:40:07] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [12:40:32] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 27.70, 15.87, 12.04 [12:40:34] PROBLEM - ipv6bolivia.tk - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:40:38] PROBLEM - cp21 Stunnel HTTP for phab121 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [12:40:47] RECOVERY - www.sdiy.info - LetsEncrypt on sslhost is OK: OK - Certificate 'sdiy.info' will expire on Sat 17 Sep 2022 21:29:52 GMT +0000. [12:41:01] RECOVERY - cp20 SSH on cp20 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [12:41:03] RECOVERY - cp21 Stunnel HTTP for mwtask141 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15942 bytes in 0.017 second response time [12:41:16] RECOVERY - mw131 Current Load on mw131 is OK: OK - load average: 3.24, 8.79, 8.12 [12:41:27] PROBLEM - metroid.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:41:36] PROBLEM - www.programming.red - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:41:39] PROBLEM - cp20 Stunnel HTTP for mw121 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:41:47] PROBLEM - wc.miraheze.org on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:41:48] PROBLEM - wiki.globasa.net - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:41:54] RECOVERY - wikipanel.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wikipanel.org' will expire on Sun 02 Oct 2022 04:51:38 GMT +0000. [12:42:14] PROBLEM - wiki.meeusen.net - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:42:44] PROBLEM - cp20 Stunnel HTTP for phab121 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [12:42:57] RECOVERY - cp21 Stunnel HTTP for phab121 on cp21 is OK: HTTP OK: Status line output matched "500" - 2855 bytes in 7.227 second response time [12:43:00] PROBLEM - wiki.parappa.dev - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:43:33] PROBLEM - cp21 Stunnel HTTP for mw121 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:43:42] RECOVERY - cp20 Stunnel HTTP for mw121 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 7.310 second response time [12:43:42] RECOVERY - celeste.ink - LetsEncrypt on sslhost is OK: OK - Certificate 'celeste.ink' will expire on Sat 24 Sep 2022 13:42:28 GMT +0000. [12:43:47] RECOVERY - dariawiki.org - LetsEncrypt on sslhost is OK: OK - Certificate 'dariawiki.org' will expire on Mon 22 Aug 2022 22:44:29 GMT +0000. [12:43:47] RECOVERY - entw.ml - LetsEncrypt on sslhost is OK: OK - Certificate 'entw.ml' will expire on Tue 01 Nov 2022 04:38:34 GMT +0000. [12:44:05] PROBLEM - en.pornwiki.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:44:33] PROBLEM - wiki.digitalefitheid.nl - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:44:36] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.19, 3.76, 3.98 [12:44:40] RECOVERY - cp20 Stunnel HTTP for phab121 on cp20 is OK: HTTP OK: Status line output matched "500" - 2855 bytes in 0.053 second response time [12:44:42] PROBLEM - m.miraheze.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:44:45] PROBLEM - cp20 Stunnel HTTP for reports121 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:44:50] PROBLEM - wiki.funkey-project.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:45:07] RECOVERY - wiki.site97.fr - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.site97.fr' will expire on Tue 18 Oct 2022 15:25:34 GMT +0000. [12:45:07] PROBLEM - smashbroswiki.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:45:22] PROBLEM - cp21 HTTPS on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:46:03] PROBLEM - wiki.ameristraliagov.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:46:03] PROBLEM - correypedia.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:46:07] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.57, 3.28, 3.55 [12:46:14] PROBLEM - hi.famepedia.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:46:30] PROBLEM - mw142 Current Load on mw142 is WARNING: WARNING - load average: 10.05, 10.96, 8.12 [12:46:32] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 3.50, 10.87, 11.63 [12:46:41] RECOVERY - m.miraheze.org - LetsEncrypt on sslhost is OK: OK - Certificate 'm.miraheze.org' will expire on Tue 06 Sep 2022 21:18:17 GMT +0000. [12:46:47] RECOVERY - cp20 Stunnel HTTP for reports121 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 10996 bytes in 1.055 second response time [12:47:23] PROBLEM - www.connorjwat.net - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:47:40] PROBLEM - www.lgbtqia.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:47:43] PROBLEM - meta.gyaanipedia.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:47:54] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::4c25/cpweb [12:47:58] PROBLEM - wiki.thunis.eu - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:48:07] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.81, 3.17, 3.49 [12:48:30] RECOVERY - mw142 Current Load on mw142 is OK: OK - load average: 5.02, 8.74, 7.65 [12:48:42] PROBLEM - cp20 Stunnel HTTP for mw122 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:50:07] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.11, 3.49, 3.56 [12:50:24] PROBLEM - wiki.zymonic.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:50:32] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 4.19, 6.89, 9.79 [12:50:39] PROBLEM - opendatascot.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:50:47] PROBLEM - icclopedia.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:51:14] PROBLEM - inourownwords.online - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:51:27] RECOVERY - cp21 HTTPS on cp21 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 3406 bytes in 0.017 second response time [12:51:46] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [12:51:48] PROBLEM - wiki.teessidehackspace.org.uk - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:52:07] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.77, 3.72, 3.65 [12:52:31] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.84, 4.24, 4.04 [12:52:46] PROBLEM - enc.for.uz - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:53:04] RECOVERY - erawikisource.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [12:53:47] PROBLEM - wiki.infomedia.co.uk - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:54:16] RECOVERY - cp21 Stunnel HTTP for mw121 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 1.024 second response time [12:54:32] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.58, 10.04, 10.37 [12:54:34] PROBLEM - cp20 SSH on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:54:56] PROBLEM - cp20 Stunnel HTTP for mw121 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:54:58] PROBLEM - wikileague.cf - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:55:17] RECOVERY - www.publictestwiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'publictestwiki.com' will expire on Tue 23 Aug 2022 00:48:11 GMT +0000. [12:55:40] PROBLEM - jp.popira.info - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:56:07] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 6.04, 4.11, 3.76 [12:56:29] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.14, 3.84, 3.95 [12:56:33] RECOVERY - cp20 SSH on cp20 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [12:56:46] RECOVERY - cp20 Puppet on cp20 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [12:56:47] RECOVERY - wc.miraheze.org on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [12:56:49] RECOVERY - phytinfo.cf - LetsEncrypt on sslhost is OK: OK - Certificate 'phytinfo.cf' will expire on Thu 27 Oct 2022 15:20:29 GMT +0000. [12:57:05] RECOVERY - cp20 Stunnel HTTP for mw121 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 5.876 second response time [12:57:50] PROBLEM - cp21 Stunnel HTTP for mon141 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:59:32] PROBLEM - zamlung.tk - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:59:43] PROBLEM - wiki.recaptime.tk - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:59:50] RECOVERY - cp21 Stunnel HTTP for mon141 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 39170 bytes in 1.041 second response time [12:59:55] PROBLEM - wiki.dunmoore.net - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:00:18] PROBLEM - scpvncommunitywiki.xyz - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:00:27] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.20, 4.30, 4.09 [13:00:31] RECOVERY - wikipariksha.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wikipariksha.com' will expire on Wed 24 Aug 2022 05:18:49 GMT +0000. [13:00:37] PROBLEM - cp21 Stunnel HTTP for mw121 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [13:00:42] PROBLEM - tot.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:00:58] PROBLEM - roll-of-arms.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:01:05] PROBLEM - allthetropes.orain.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:01:10] RECOVERY - cp20 Stunnel HTTP for mw122 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.018 second response time [13:01:12] PROBLEM - chakra.moe - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:02:07] PROBLEM - slupe.fp64.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:02:56] PROBLEM - en.gyaanipedia.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:02:56] RECOVERY - cp21 Stunnel HTTP for mw121 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 7.151 second response time [13:02:57] PROBLEM - wiki.s23.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:03:08] PROBLEM - runzeppelin.ru - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:04:04] PROBLEM - cp20 SSH on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:04:16] PROBLEM - antiguabarbudacalypso.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:04:29] RECOVERY - experimyco.com - LetsEncrypt on sslhost is OK: OK - Certificate 'experimyco.com' will expire on Thu 15 Sep 2022 05:36:04 GMT +0000. [13:04:29] PROBLEM - abeyancewiki.bumblebee-studios.se - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:04:35] RECOVERY - wiki.dereric.gq - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.dereric.gq' will expire on Sat 22 Oct 2022 22:30:02 GMT +0000. [13:04:38] PROBLEM - heavyironmodding.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:06:27] PROBLEM - cp20 Stunnel HTTP for mw122 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:06:32] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 2.80, 8.56, 10.90 [13:06:45] PROBLEM - cp21 Stunnel HTTP for phab121 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [13:06:54] PROBLEM - wiki.wilderyogi.eu - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:07:00] PROBLEM - www.wikiretet.ga - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:07:00] PROBLEM - www.project-patterns.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'project-patterns.com' expires in 15 day(s) (Fri 19 Aug 2022 17:20:05 GMT +0000). [13:07:25] PROBLEM - cp21 Stunnel HTTP for mail121 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [13:07:32] PROBLEM - cp20 Stunnel HTTP for mon141 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [13:07:37] PROBLEM - wiki.ieg123.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:08:17] RECOVERY - cp20 SSH on cp20 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [13:08:29] PROBLEM - atnarsia.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:08:32] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 3.53, 6.84, 9.98 [13:08:49] PROBLEM - replication-ops.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:09:14] PROBLEM - cp21 SSH on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:09:41] RECOVERY - cp21 Stunnel HTTP for mail121 on cp21 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 427 bytes in 1.022 second response time [13:09:47] PROBLEM - cp20 Stunnel HTTP for mw121 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [13:09:54] RECOVERY - az.wikiretet.ga - LetsEncrypt on sslhost is OK: OK - Certificate 'az.wikiretet.ga' will expire on Tue 11 Oct 2022 04:40:37 GMT +0000. [13:10:19] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::4c25/cpweb [13:10:31] RECOVERY - ipv6bolivia.tk - LetsEncrypt on sslhost is OK: OK - Certificate 'ipv6bolivia.tk' will expire on Tue 23 Aug 2022 13:09:22 GMT +0000. [13:10:39] RECOVERY - wiki.globasa.net - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.globasa.net' will expire on Mon 10 Oct 2022 05:36:34 GMT +0000. [13:10:41] PROBLEM - cp20 Stunnel HTTP for phab121 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [13:11:09] RECOVERY - wiki.exputra.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.exputra.com' will expire on Fri 16 Sep 2022 18:09:57 GMT +0000. [13:11:16] RECOVERY - cp21 SSH on cp21 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [13:11:34] PROBLEM - pokemon2.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:11:37] PROBLEM - cp20 HTTPS on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:11:39] RECOVERY - wiki.parappa.dev - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.parappa.dev' will expire on Sun 18 Sep 2022 13:44:45 GMT +0000. [13:11:51] RECOVERY - wiki.ct777.cf - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.ct777.cf' will expire on Sun 02 Oct 2022 10:59:59 GMT +0000. [13:11:52] RECOVERY - cp20 Stunnel HTTP for mw121 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 2.055 second response time [13:11:54] PROBLEM - wiki.leapit.no - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:12:23] RECOVERY - theapplesecretswiki.ml - LetsEncrypt on sslhost is OK: OK - Certificate 'theapplesecretswiki.ml' will expire on Mon 17 Oct 2022 19:49:07 GMT +0000. [13:12:37] RECOVERY - cp20 Stunnel HTTP for phab121 on cp20 is OK: HTTP OK: Status line output matched "500" - 2855 bytes in 1.105 second response time [13:12:43] PROBLEM - cp21 Stunnel HTTP for mw122 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [13:13:10] RECOVERY - wiki.digitalefitheid.nl - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.digitalefitheid.nl' will expire on Wed 21 Sep 2022 08:49:04 GMT +0000. [13:13:10] PROBLEM - taswin.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:13:25] RECOVERY - cp20 Stunnel HTTP for mw122 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 1.100 second response time [13:13:25] RECOVERY - en.pornwiki.org - LetsEncrypt on sslhost is OK: OK - Certificate 'en.pornwiki.org' will expire on Sat 17 Sep 2022 22:00:09 GMT +0000. [13:13:27] RECOVERY - wiki.beergeeks.co.il - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.beergeeks.co.il' will expire on Mon 22 Aug 2022 21:21:00 GMT +0000. [13:13:38] RECOVERY - cp20 HTTPS on cp20 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 3407 bytes in 7.271 second response time [13:14:13] RECOVERY - lcn.zfc.id.lv - LetsEncrypt on sslhost is OK: OK - Certificate 'lcn.zfc.id.lv' will expire on Wed 31 Aug 2022 21:26:51 GMT +0000. [13:14:15] PROBLEM - betaheze.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'betaheze.org' expires in 15 day(s) (Fri 19 Aug 2022 17:58:05 GMT +0000). [13:14:23] RECOVERY - smashbroswiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'smashbroswiki.com' will expire on Sat 22 Oct 2022 05:43:00 GMT +0000. [13:14:35] RECOVERY - cp21 Stunnel HTTP for phab121 on cp21 is OK: HTTP OK: Status line output matched "500" - 2855 bytes in 1.083 second response time [13:14:38] RECOVERY - wiki.ameristraliagov.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.ameristraliagov.com' will expire on Thu 20 Oct 2022 03:45:43 GMT +0000. [13:14:40] RECOVERY - wiki.funkey-project.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.funkey-project.com' will expire on Tue 23 Aug 2022 08:26:19 GMT +0000. [13:14:42] RECOVERY - correypedia.org - LetsEncrypt on sslhost is OK: OK - Certificate 'correypedia.org' will expire on Thu 01 Sep 2022 00:41:01 GMT +0000. [13:14:49] RECOVERY - cp21 Stunnel HTTP for mw122 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 4.664 second response time [13:14:51] RECOVERY - cp20 Stunnel HTTP for mon141 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 39170 bytes in 0.033 second response time [13:15:03] RECOVERY - hi.famepedia.org - LetsEncrypt on sslhost is OK: OK - Certificate 'hi.famepedia.org' will expire on Tue 18 Oct 2022 14:04:28 GMT +0000. [13:15:29] PROBLEM - cp21 Stunnel HTTP for mw142 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [13:15:49] RECOVERY - miraheze.tk - LetsEncrypt on sslhost is OK: OK - Certificate 'miraheze.tk' will expire on Tue 23 Aug 2022 07:48:08 GMT +0000. [13:16:53] RECOVERY - www.connorjwat.net - LetsEncrypt on sslhost is OK: OK - Certificate 'www.connorjwat.net' will expire on Mon 22 Aug 2022 22:20:46 GMT +0000. [13:16:56] PROBLEM - grayravens.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:17:15] RECOVERY - www.lgbtqia.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'www.lgbtqia.wiki' will expire on Fri 07 Oct 2022 11:35:52 GMT +0000. [13:17:29] PROBLEM - cp21 Stunnel HTTP for mwtask141 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [13:17:34] RECOVERY - cp21 Stunnel HTTP for mw142 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 1.037 second response time [13:17:44] RECOVERY - wiki.thunis.eu - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.thunis.eu' will expire on Tue 23 Aug 2022 01:47:24 GMT +0000. [13:18:32] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 16.75, 11.27, 10.08 [13:19:27] PROBLEM - cp20 Stunnel HTTP for mw142 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:19:36] RECOVERY - wiki.zymonic.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.zymonic.com' will expire on Wed 24 Aug 2022 02:07:19 GMT +0000. [13:19:55] RECOVERY - cp21 Stunnel HTTP for mwtask141 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15950 bytes in 0.027 second response time [13:20:04] RECOVERY - icclopedia.org - LetsEncrypt on sslhost is OK: OK - Certificate 'icclopedia.org' will expire on Wed 24 Aug 2022 03:23:05 GMT +0000. [13:20:11] RECOVERY - opendatascot.org - LetsEncrypt on sslhost is OK: OK - Certificate 'opendatascot.org' will expire on Thu 01 Sep 2022 00:46:11 GMT +0000. [13:20:32] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.85, 9.83, 9.70 [13:20:56] RECOVERY - wiki.teessidehackspace.org.uk - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.teessidehackspace.org.uk' will expire on Wed 21 Sep 2022 09:01:23 GMT +0000. [13:21:41] RECOVERY - cp20 Stunnel HTTP for mw142 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.021 second response time [13:22:04] RECOVERY - lgbtqia.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'www.lgbtqia.wiki' will expire on Fri 07 Oct 2022 11:35:52 GMT +0000. [13:22:24] RECOVERY - enc.for.uz - LetsEncrypt on sslhost is OK: OK - Certificate 'enc.for.uz' will expire on Tue 23 Aug 2022 01:42:45 GMT +0000. [13:23:09] RECOVERY - wiki.infomedia.co.uk - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.infomedia.co.uk' will expire on Fri 21 Oct 2022 15:33:32 GMT +0000. [13:23:09] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.97, 1.54, 1.15 [13:23:32] PROBLEM - cp20 Stunnel HTTP for test131 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [13:24:09] PROBLEM - cp21 Stunnel HTTP for test131 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [13:24:59] PROBLEM - cp20 SSH on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:25:09] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.88, 1.31, 1.11 [13:25:29] RECOVERY - cp20 Stunnel HTTP for test131 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15954 bytes in 0.025 second response time [13:27:38] PROBLEM - cp21 HTTPS on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:28:11] RECOVERY - zamlung.tk - LetsEncrypt on sslhost is OK: OK - Certificate 'zamlung.tk' will expire on Mon 22 Aug 2022 23:50:28 GMT +0000. [13:28:18] PROBLEM - mazakwiki.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:28:18] PROBLEM - kunwok.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:28:32] RECOVERY - wiki.recaptime.tk - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.recaptime.tk' will expire on Wed 26 Oct 2022 23:10:27 GMT +0000. [13:28:32] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.28, 10.25, 9.71 [13:29:14] RECOVERY - cp20 SSH on cp20 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [13:29:30] RECOVERY - roll-of-arms.com - LetsEncrypt on sslhost is OK: OK - Certificate 'roll-of-arms.com' will expire on Thu 27 Oct 2022 15:02:13 GMT +0000. [13:29:32] RECOVERY - wiki.dunmoore.net - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.dunmoore.net' will expire on Sun 02 Oct 2022 10:05:42 GMT +0000. [13:29:34] PROBLEM - cp21 Stunnel HTTP for mon141 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [13:29:37] PROBLEM - cp20 Puppet on cp20 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): File[/etc/apt/trusted.gpg.d/puppetlabs.gpg] [13:29:48] PROBLEM - johanloopmans.nl - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:29:56] PROBLEM - cp20 Stunnel HTTP for mw131 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [13:29:59] RECOVERY - chakra.moe - LetsEncrypt on sslhost is OK: OK - Certificate 'chakra.moe' will expire on Wed 26 Oct 2022 18:41:37 GMT +0000. [13:30:21] PROBLEM - cp21 Stunnel HTTP for mw132 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:30:25] RECOVERY - tot.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'tot.wiki' will expire on Tue 23 Aug 2022 12:51:08 GMT +0000. [13:30:32] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 6.12, 8.83, 9.27 [13:31:22] RECOVERY - cp21 Stunnel HTTP for test131 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15954 bytes in 1.044 second response time [13:31:38] RECOVERY - cp21 HTTPS on cp21 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 3406 bytes in 0.020 second response time [13:31:40] RECOVERY - cp21 Stunnel HTTP for mon141 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 39177 bytes in 7.104 second response time [13:31:46] RECOVERY - slupe.fp64.org - LetsEncrypt on sslhost is OK: OK - Certificate 'slupe.fp64.org' will expire on Tue 04 Oct 2022 18:47:51 GMT +0000. [13:32:02] RECOVERY - runzeppelin.ru - LetsEncrypt on sslhost is OK: OK - Certificate 'runzeppelin.ru' will expire on Wed 24 Aug 2022 05:02:45 GMT +0000. [13:32:02] RECOVERY - en.gyaanipedia.com - LetsEncrypt on sslhost is OK: OK - Certificate 'en.gyaanipedia.com' will expire on Thu 08 Sep 2022 07:04:52 GMT +0000. [13:32:27] PROBLEM - wiki.chouverse.cludisciples.cyou - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:32:56] RECOVERY - wiki.s23.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.s23.org' will expire on Wed 24 Aug 2022 03:08:19 GMT +0000. [13:33:00] PROBLEM - cp20 HTTPS on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:33:20] PROBLEM - threedomwiki.pcast.site - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:33:28] PROBLEM - cp20 Stunnel HTTP for mw141 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [13:33:40] RECOVERY - abeyancewiki.bumblebee-studios.se - LetsEncrypt on sslhost is OK: OK - Certificate 'abeyancewiki.bumblebee-studios.se' will expire on Wed 24 Aug 2022 16:26:15 GMT +0000. [13:34:03] RECOVERY - antiguabarbudacalypso.com - LetsEncrypt on sslhost is OK: OK - Certificate 'antiguabarbudacalypso.com' will expire on Tue 23 Aug 2022 01:05:30 GMT +0000. [13:34:06] PROBLEM - wiki.potabi.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:34:12] PROBLEM - cp21 PowerDNS Recursor on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [13:34:24] PROBLEM - cp20 Stunnel HTTP for mw122 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:34:32] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 20.47, 11.93, 10.17 [13:34:45] PROBLEM - nonciclopedia.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:34:55] RECOVERY - cp20 HTTPS on cp20 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 3407 bytes in 1.017 second response time [13:35:16] RECOVERY - cp21 Stunnel HTTP for mw132 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.018 second response time [13:35:32] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [13:35:35] PROBLEM - cp21 Stunnel HTTP for mw121 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:35:58] RECOVERY - cp20 Stunnel HTTP for mw141 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 0.673 second response time [13:36:12] RECOVERY - wiki.wilderyogi.eu - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.wilderyogi.eu' will expire on Mon 26 Sep 2022 06:35:10 GMT +0000. [13:36:23] RECOVERY - cp21 PowerDNS Recursor on cp21 is OK: DNS OK: 0.316 seconds response time. miraheze.org returns 198.244.148.90,2001:41d0:801:2000::1b80,2001:41d0:801:2000::4c25,51.195.220.68 [13:36:28] RECOVERY - cp20 Stunnel HTTP for mw122 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 3.043 second response time [13:36:49] PROBLEM - mw122 MediaWiki Rendering on mw122 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:36:49] PROBLEM - cp21 Stunnel HTTP for mail121 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:36:53] PROBLEM - cp31 Stunnel HTTP for mw122 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:37:10] PROBLEM - www.project-patterns.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:37:13] RECOVERY - wiki.ieg123.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.ieg123.com' will expire on Fri 14 Oct 2022 17:56:38 GMT +0000. [13:37:22] PROBLEM - cp21 Stunnel HTTP for mw122 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:37:37] RECOVERY - cp20 Stunnel HTTP for mw131 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 4.773 second response time [13:37:39] RECOVERY - replication-ops.com - LetsEncrypt on sslhost is OK: OK - Certificate 'replication-ops.com' will expire on Tue 18 Oct 2022 15:32:39 GMT +0000. [13:37:44] PROBLEM - cp30 Stunnel HTTP for mw121 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:37:44] PROBLEM - txt-dex.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:38:17] PROBLEM - cp20 Stunnel HTTP for mw142 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:38:19] PROBLEM - mw121 MediaWiki Rendering on mw121 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:38:43] PROBLEM - cp30 Stunnel HTTP for mw141 on cp30 is CRITICAL: HTTP CRITICAL - No data received from host [13:38:47] PROBLEM - cp31 Stunnel HTTP for mw121 on cp31 is CRITICAL: HTTP CRITICAL - No data received from host [13:38:56] PROBLEM - mw132 MediaWiki Rendering on mw132 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:38:57] PROBLEM - cp20 Stunnel HTTP for mw121 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:39:15] RECOVERY - www.programming.red - LetsEncrypt on sslhost is OK: OK - Certificate 'programming.red' will expire on Tue 23 Aug 2022 09:31:28 GMT +0000. [13:39:35] RECOVERY - wiki.fbpml.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.fbpml.org' will expire on Sat 01 Oct 2022 15:33:56 GMT +0000. [13:39:38] PROBLEM - mw142 MediaWiki Rendering on mw142 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:39:41] PROBLEM - cp31 Stunnel HTTP for mw132 on cp31 is CRITICAL: HTTP CRITICAL - No data received from host [13:39:46] PROBLEM - cp31 Stunnel HTTP for mw131 on cp31 is CRITICAL: HTTP CRITICAL - No data received from host [13:39:49] PROBLEM - mw131 HTTPS on mw131 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:39:54] RECOVERY - metroid.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [13:40:09] RECOVERY - www.hoolehistoryheritagesociety.org.uk - LetsEncrypt on sslhost is OK: OK - Certificate 'www.hoolehistoryheritagesociety.org.uk' will expire on Sat 01 Oct 2022 16:03:14 GMT +0000. [13:40:10] PROBLEM - cp21 Stunnel HTTP for mw131 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [13:40:11] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.11, 2.97, 3.87 [13:40:12] RECOVERY - pokemon2.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [13:40:38] RECOVERY - cp30 Stunnel HTTP for mw141 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.317 second response time [13:40:46] RECOVERY - cp31 Stunnel HTTP for mw121 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.338 second response time [13:40:49] RECOVERY - wiki.leapit.no - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.leapit.no' will expire on Sun 30 Oct 2022 08:12:03 GMT +0000. [13:40:56] RECOVERY - mw132 MediaWiki Rendering on mw132 is OK: HTTP OK: HTTP/1.1 200 OK - 29520 bytes in 2.025 second response time [13:41:01] RECOVERY - cp20 Stunnel HTTP for mw121 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 1.030 second response time [13:41:03] PROBLEM - cp21 conntrack_table_size on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [13:41:19] PROBLEM - wiki.mostly.vet - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:41:32] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::4c25/cpweb [13:41:33] RECOVERY - mw142 MediaWiki Rendering on mw142 is OK: HTTP OK: HTTP/1.1 200 OK - 29520 bytes in 0.205 second response time [13:41:36] RECOVERY - cp31 Stunnel HTTP for mw132 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 0.321 second response time [13:41:43] RECOVERY - cp30 Stunnel HTTP for mw121 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.328 second response time [13:41:46] RECOVERY - cp21 Stunnel HTTP for mail121 on cp21 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 427 bytes in 1.016 second response time [13:41:46] RECOVERY - mw131 HTTPS on mw131 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 545 bytes in 0.006 second response time [13:41:47] RECOVERY - cp31 Stunnel HTTP for mw131 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.333 second response time [13:41:47] PROBLEM - www.christipedia.nl - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:41:57] PROBLEM - wiki.globasa.net - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:42:00] PROBLEM - cp30 Stunnel HTTP for mw122 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:42:05] RECOVERY - cp21 Stunnel HTTP for mw131 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.023 second response time [13:42:08] RECOVERY - hololive.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'hololive.wiki' will expire on Tue 23 Aug 2022 02:02:38 GMT +0000. [13:42:11] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.26, 3.49, 3.95 [13:42:18] RECOVERY - mw121 MediaWiki Rendering on mw121 is OK: HTTP OK: HTTP/1.1 200 OK - 29520 bytes in 0.298 second response time [13:42:32] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 3.75, 9.08, 10.08 [13:42:36] PROBLEM - wikipanel.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:42:54] RECOVERY - cp21 Stunnel HTTP for mw121 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 3.104 second response time [13:43:02] RECOVERY - cp21 conntrack_table_size on cp21 is OK: OK: nf_conntrack is 6 % full [13:43:20] PROBLEM - www.permanentfuturelab.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:43:29] PROBLEM - civwiki.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:43:39] PROBLEM - cp20 Stunnel HTTP for matomo131 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [13:43:40] PROBLEM - cp21 Stunnel HTTP for test131 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [13:43:41] PROBLEM - cp31 Varnish Backends on cp31 is CRITICAL: 3 backends are down. mw121 mw131 mw142 [13:43:43] PROBLEM - cp30 Varnish Backends on cp30 is CRITICAL: 3 backends are down. mw121 mw141 mw142 [13:43:54] RECOVERY - cp21 Stunnel HTTP for mw122 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 9.992 second response time [13:44:04] RECOVERY - cp30 Stunnel HTTP for mw122 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 9.095 second response time [13:44:11] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.61, 3.63, 3.95 [13:44:11] PROBLEM - cp21 SSH on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:44:25] PROBLEM - m.miraheze.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:44:31] PROBLEM - discordian.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:44:33] PROBLEM - wiki.digitalefitheid.nl - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:44:38] PROBLEM - cp21 Stunnel HTTP for phab121 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [13:44:48] PROBLEM - celeste.ink - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:44:53] RECOVERY - cp31 Stunnel HTTP for mw122 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 0.309 second response time [13:45:05] RECOVERY - mw122 MediaWiki Rendering on mw122 is OK: HTTP OK: HTTP/1.1 200 OK - 29520 bytes in 0.545 second response time [13:45:09] PROBLEM - cp20 HTTPS on cp20 is CRITICAL: HTTP CRITICAL: HTTP/1.1 503 Backend fetch failed - 6120 bytes in 3.051 second response time [13:45:12] PROBLEM - hellointernet.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:45:18] PROBLEM - zh.gyaanipedia.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:45:27] PROBLEM - cp20 Stunnel HTTP for phab121 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [13:45:32] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [13:45:36] PROBLEM - wc.miraheze.org on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:45:41] RECOVERY - cp31 Varnish Backends on cp31 is OK: All 14 backends are healthy [13:45:43] RECOVERY - cp30 Varnish Backends on cp30 is OK: All 14 backends are healthy [13:45:55] PROBLEM - cp20 SSH on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:46:11] RECOVERY - meta.gyaanipedia.com - LetsEncrypt on sslhost is OK: OK - Certificate 'meta.gyaanipedia.com' will expire on Thu 08 Sep 2022 07:12:19 GMT +0000. [13:46:23] RECOVERY - m.miraheze.org - LetsEncrypt on sslhost is OK: OK - Certificate 'm.miraheze.org' will expire on Tue 06 Sep 2022 21:18:17 GMT +0000. [13:46:25] RECOVERY - grayravens.com - LetsEncrypt on sslhost is OK: OK - Certificate 'grayravens.com' will expire on Sun 18 Sep 2022 13:03:26 GMT +0000. [13:46:34] PROBLEM - lcn.zfc.id.lv - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:46:34] RECOVERY - cp21 Stunnel HTTP for phab121 on cp21 is OK: HTTP OK: Status line output matched "500" - 2855 bytes in 0.050 second response time [13:46:43] PROBLEM - cp21 HTTPS on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:47:04] RECOVERY - cp20 HTTPS on cp20 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 3388 bytes in 0.346 second response time [13:47:15] PROBLEM - www.turtletown.ca - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:47:30] RECOVERY - cp20 Stunnel HTTP for phab121 on cp20 is OK: HTTP OK: Status line output matched "500" - 2855 bytes in 1.064 second response time [13:48:11] RECOVERY - cp21 SSH on cp21 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [13:48:17] PROBLEM - vitriol.spoon.army - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:48:19] PROBLEM - wiki.rebirthofthenight.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:48:19] PROBLEM - fanon.polandballwiki.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:49:32] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::1b80/cpweb [13:49:45] PROBLEM - wiki.bikinibottomdiscord.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:50:05] RECOVERY - inourownwords.online - LetsEncrypt on sslhost is OK: OK - Certificate 'inourownwords.online' will expire on Fri 02 Sep 2022 12:36:55 GMT +0000. [13:50:07] RECOVERY - cp21 Stunnel HTTP for test131 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15954 bytes in 0.018 second response time [13:50:08] PROBLEM - animefeet.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:50:34] RECOVERY - cp20 Stunnel HTTP for mw142 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.018 second response time [13:50:40] RECOVERY - cp20 Stunnel HTTP for matomo131 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 99061 bytes in 0.269 second response time [13:50:54] RECOVERY - cp20 Varnish Backends on cp20 is OK: All 14 backends are healthy [13:51:09] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.38, 1.60, 1.12 [13:51:32] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [13:51:48] PROBLEM - icclopedia.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:52:07] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.07, 2.56, 3.69 [13:52:11] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.56, 3.77, 3.82 [13:52:16] RECOVERY - cp20 SSH on cp20 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [13:52:47] RECOVERY - cp21 HTTPS on cp21 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 3407 bytes in 0.016 second response time [13:52:53] PROBLEM - www.arru.xyz - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:52:55] PROBLEM - commons.gyaanipedia.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:53:09] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.16, 1.44, 1.12 [13:53:24] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 5.84, 7.26, 11.47 [13:53:28] PROBLEM - cp21 Stunnel HTTP for mw132 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [13:53:39] PROBLEM - cp21 Stunnel HTTP for reports121 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [13:54:07] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 6.61, 4.08, 4.11 [13:54:07] PROBLEM - recaptime.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:54:15] RECOVERY - cp20 Puppet on cp20 is OK: OK: Puppet is currently enabled, last run 1 second ago with 0 failures [13:54:29] PROBLEM - enc.for.uz - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:54:52] PROBLEM - cp20 Varnish Backends on cp20 is CRITICAL: 1 backends are down. mw141 [13:55:02] PROBLEM - dc.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:55:03] RECOVERY - wikileague.cf - LetsEncrypt on sslhost is OK: OK - Certificate 'wikileague.cf' will expire on Mon 22 Aug 2022 22:21:46 GMT +0000. [13:55:13] PROBLEM - cp20 Stunnel HTTP for mw122 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [13:55:15] PROBLEM - buildabearwiki.info - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:55:25] RECOVERY - cp21 Stunnel HTTP for mw132 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.025 second response time [13:55:42] RECOVERY - jp.popira.info - LetsEncrypt on sslhost is OK: OK - Certificate 'jp.popira.info' will expire on Mon 10 Oct 2022 06:13:03 GMT +0000. [13:56:11] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.34, 3.79, 3.85 [13:56:13] PROBLEM - mario.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:56:14] RECOVERY - wc.miraheze.org on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [13:57:07] PROBLEM - bluearchive.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:57:11] RECOVERY - mazakwiki.org - LetsEncrypt on sslhost is OK: OK - Certificate 'mazakwiki.org' will expire on Wed 26 Oct 2022 18:25:25 GMT +0000. [13:57:16] PROBLEM - mw131 Current Load on mw131 is CRITICAL: CRITICAL - load average: 12.78, 8.26, 6.13 [13:57:29] RECOVERY - kunwok.org - LetsEncrypt on sslhost is OK: OK - Certificate 'kunwok.org' will expire on Wed 24 Aug 2022 04:11:39 GMT +0000. [13:57:30] PROBLEM - cp20 Stunnel HTTP for mw142 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [13:57:56] RECOVERY - scpvncommunitywiki.xyz - LetsEncrypt on sslhost is OK: OK - Certificate 'scpvncommunitywiki.xyz' will expire on Tue 23 Aug 2022 02:34:15 GMT +0000. [13:58:11] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.76, 4.41, 4.08 [13:59:09] PROBLEM - pwiki.arkcls.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:59:16] RECOVERY - mw131 Current Load on mw131 is OK: OK - load average: 10.00, 9.19, 6.77 [13:59:24] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 6.90, 7.38, 10.19 [13:59:27] RECOVERY - johanloopmans.nl - LetsEncrypt on sslhost is OK: OK - Certificate 'www.johanloopmans.nl' will expire on Sat 17 Sep 2022 20:00:57 GMT +0000. [13:59:29] RECOVERY - cp20 Stunnel HTTP for mw142 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 1.039 second response time [13:59:46] PROBLEM - www.winenjoy.net - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:59:48] RECOVERY - allthetropes.orain.org - LetsEncrypt on sslhost is OK: OK - Certificate 'orain.org' will expire on Wed 26 Oct 2022 18:24:04 GMT +0000. [14:00:14] RECOVERY - cp20 Stunnel HTTP for mw122 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 4.554 second response time [14:00:15] PROBLEM - cp21 Stunnel HTTP for mw121 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [14:00:50] PROBLEM - cp20 Stunnel HTTP for mw121 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:01:12] PROBLEM - chakra.moe - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:01:15] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [14:01:32] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 2 datacenters are down: 2001:41d0:801:2000::4c25/cpweb, 2001:41d0:801:2000::1b80/cpweb [14:01:38] RECOVERY - wiki.chouverse.cludisciples.cyou - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.chouverse.cludisciples.cyou' will expire on Tue 23 Aug 2022 00:10:19 GMT +0000. [14:02:17] PROBLEM - www.istpcomputing.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:02:51] RECOVERY - cp20 Stunnel HTTP for mw121 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 2.105 second response time [14:03:08] RECOVERY - threedomwiki.pcast.site - LetsEncrypt on sslhost is OK: OK - Certificate 'threedomwiki.pcast.site' will expire on Mon 22 Aug 2022 22:02:33 GMT +0000. [14:03:09] RECOVERY - heavyironmodding.org - LetsEncrypt on sslhost is OK: OK - Certificate 'heavyironmodding.org' will expire on Fri 30 Sep 2022 17:38:06 GMT +0000. [14:03:13] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 0.37, 0.35, 0.45 [14:03:24] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.56, 11.65, 11.49 [14:03:46] PROBLEM - cp21 Stunnel HTTP for test131 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:03:49] PROBLEM - m.miraheze.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:04:20] PROBLEM - cp21 Stunnel HTTP for mw142 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:04:32] RECOVERY - www.wikiretet.ga - LetsEncrypt on sslhost is OK: OK - Certificate 'www.wikiretet.ga' will expire on Tue 11 Oct 2022 04:42:43 GMT +0000. [14:05:12] RECOVERY - cp21 Stunnel HTTP for mw121 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 3.105 second response time [14:05:47] RECOVERY - m.miraheze.org - LetsEncrypt on sslhost is OK: OK - Certificate 'm.miraheze.org' will expire on Tue 06 Sep 2022 21:18:17 GMT +0000. [14:06:04] RECOVERY - atnarsia.com - LetsEncrypt on sslhost is OK: OK - Certificate 'atnarsia.com' will expire on Sun 25 Sep 2022 20:45:25 GMT +0000. [14:06:17] RECOVERY - cp21 Stunnel HTTP for mw142 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 0.385 second response time [14:06:32] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.41, 11.35, 9.76 [14:06:36] PROBLEM - cp20 HTTPS on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:06:45] PROBLEM - cp21 SSH on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:07:03] PROBLEM - www.project-patterns.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'project-patterns.com' expires in 15 day(s) (Fri 19 Aug 2022 17:20:05 GMT +0000). [14:07:24] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 3.53, 7.48, 9.83 [14:07:47] PROBLEM - cp21 Stunnel HTTP for mw132 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:08:04] RECOVERY - cp21 Stunnel HTTP for test131 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15954 bytes in 3.042 second response time [14:08:32] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 4.72, 9.01, 9.09 [14:08:48] RECOVERY - cp21 SSH on cp21 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [14:09:04] PROBLEM - cp20 SSH on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:09:09] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.96, 2.17, 1.50 [14:09:38] RECOVERY - cp21 Stunnel HTTP for reports121 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 10996 bytes in 1.070 second response time [14:10:32] PROBLEM - cp20 Stunnel HTTP for phab121 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [14:10:44] RECOVERY - www.christipedia.nl - LetsEncrypt on sslhost is OK: OK - Certificate 'www.christipedia.nl' will expire on Sat 17 Sep 2022 18:34:21 GMT +0000. [14:10:47] RECOVERY - wiki.globasa.net - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.globasa.net' will expire on Mon 10 Oct 2022 05:36:34 GMT +0000. [14:10:52] RECOVERY - taswin.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [14:11:02] RECOVERY - cp20 SSH on cp20 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [14:11:09] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.03, 1.70, 1.41 [14:11:42] RECOVERY - wikipanel.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wikipanel.org' will expire on Sun 02 Oct 2022 04:51:38 GMT +0000. [14:12:12] RECOVERY - wiki.meeusen.net - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.meeusen.net' will expire on Sat 17 Sep 2022 21:26:27 GMT +0000. [14:12:16] RECOVERY - www.permanentfuturelab.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'permanentfuturelab.wiki' will expire on Tue 23 Aug 2022 00:31:22 GMT +0000. [14:12:46] RECOVERY - cp20 HTTPS on cp20 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 3404 bytes in 7.229 second response time [14:12:54] RECOVERY - cp21 Stunnel HTTP for mw132 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.022 second response time [14:12:59] RECOVERY - cp20 Stunnel HTTP for phab121 on cp20 is OK: HTTP OK: Status line output matched "500" - 2855 bytes in 0.069 second response time [14:13:03] RECOVERY - civwiki.org - LetsEncrypt on sslhost is OK: OK - Certificate 'civwiki.org' will expire on Sat 17 Sep 2022 21:39:52 GMT +0000. [14:13:06] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [14:13:10] RECOVERY - wiki.digitalefitheid.nl - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.digitalefitheid.nl' will expire on Wed 21 Sep 2022 08:49:04 GMT +0000. [14:13:24] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 15.20, 12.26, 11.05 [14:13:25] RECOVERY - discordian.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'discordian.wiki' will expire on Fri 16 Sep 2022 18:03:24 GMT +0000. [14:13:49] RECOVERY - celeste.ink - LetsEncrypt on sslhost is OK: OK - Certificate 'celeste.ink' will expire on Sat 24 Sep 2022 13:42:28 GMT +0000. [14:14:18] RECOVERY - hellointernet.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [14:14:45] RECOVERY - zh.gyaanipedia.com - LetsEncrypt on sslhost is OK: OK - Certificate 'zh.gyaanipedia.com' will expire on Thu 08 Sep 2022 06:29:43 GMT +0000. [14:15:09] PROBLEM - biblestrength.net - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:15:21] PROBLEM - cp20 Stunnel HTTP for mail121 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [14:15:24] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.67, 11.29, 10.88 [14:16:31] RECOVERY - lcn.zfc.id.lv - LetsEncrypt on sslhost is OK: OK - Certificate 'lcn.zfc.id.lv' will expire on Wed 31 Aug 2022 21:26:51 GMT +0000. [14:16:49] RECOVERY - www.turtletown.ca - LetsEncrypt on sslhost is OK: OK - Certificate 'www.turtletown.ca' will expire on Tue 20 Sep 2022 20:30:39 GMT +0000. [14:17:30] RECOVERY - cp20 Stunnel HTTP for mail121 on cp20 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 427 bytes in 2.024 second response time [14:17:42] RECOVERY - fanon.polandballwiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'fanon.polandballwiki.com' will expire on Tue 25 Oct 2022 07:14:58 GMT +0000. [14:18:03] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 0.29, 0.28, 0.37 [14:18:05] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.32, 1.72, 1.52 [14:18:08] RECOVERY - vitriol.spoon.army - LetsEncrypt on sslhost is OK: OK - Certificate 'vitriol.spoon.army' will expire on Tue 23 Aug 2022 01:40:06 GMT +0000. [14:18:10] RECOVERY - wiki.rebirthofthenight.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.rebirthofthenight.com' will expire on Wed 24 Aug 2022 02:49:21 GMT +0000. [14:19:03] RECOVERY - wiki.bikinibottomdiscord.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.bikinibottomdiscord.org' will expire on Mon 22 Aug 2022 21:26:08 GMT +0000. [14:20:02] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 3.30, 2.11, 1.67 [14:20:50] PROBLEM - wikicryptos.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:21:05] RECOVERY - icclopedia.org - LetsEncrypt on sslhost is OK: OK - Certificate 'icclopedia.org' will expire on Wed 24 Aug 2022 03:23:05 GMT +0000. [14:21:11] PROBLEM - vmcodex.net - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:21:24] PROBLEM - cp21 Disk Space on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [14:21:24] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 6.68, 8.74, 9.87 [14:21:35] PROBLEM - mediawiki.ecfin.eu - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:22:21] PROBLEM - marinebiodiversitymatrix.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:22:23] RECOVERY - www.arru.xyz - LetsEncrypt on sslhost is OK: OK - Certificate 'www.arru.xyz' will expire on Sat 17 Sep 2022 21:47:49 GMT +0000. [14:23:10] PROBLEM - wc.miraheze.org on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:23:15] PROBLEM - zenith.nsmbu.net - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:23:23] RECOVERY - cp21 Disk Space on cp21 is OK: DISK OK - free space: / 9488 MB (24% inode=96%); [14:23:28] PROBLEM - wiki.yumeka.icu - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:23:56] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 0.92, 1.71, 1.63 [14:24:09] RECOVERY - enc.for.uz - LetsEncrypt on sslhost is OK: OK - Certificate 'enc.for.uz' will expire on Tue 23 Aug 2022 01:42:45 GMT +0000. [14:24:23] PROBLEM - commons.ballmedia.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:24:42] RECOVERY - buildabearwiki.info - LetsEncrypt on sslhost is OK: OK - Certificate 'buildabearwiki.info' will expire on Fri 16 Sep 2022 17:59:19 GMT +0000. [14:25:52] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.57, 1.32, 1.49 [14:26:55] PROBLEM - cp20 Stunnel HTTP for test131 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:27:00] PROBLEM - cp20 Stunnel HTTP for mw141 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:27:25] RECOVERY - wc.miraheze.org on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [14:27:32] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [14:27:43] PROBLEM - www.journeytheword.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:27:52] PROBLEM - cp20 Stunnel HTTP for mwtask141 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [14:28:52] RECOVERY - cp20 Stunnel HTTP for test131 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15940 bytes in 0.018 second response time [14:28:57] PROBLEM - publictestwiki.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:28:59] RECOVERY - cp20 Stunnel HTTP for mw141 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 1.036 second response time [14:29:24] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 15.53, 11.35, 10.34 [14:29:44] PROBLEM - cp20 HTTPS on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:29:48] PROBLEM - cp20 SSH on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:29:52] PROBLEM - cp21 Stunnel HTTP for mwtask141 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:30:32] PROBLEM - commonswiki.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:30:52] PROBLEM - wiki.nowchess.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:31:23] PROBLEM - encyclopediaofastrobiology.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:31:46] RECOVERY - cp20 SSH on cp20 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [14:31:48] RECOVERY - cp21 Stunnel HTTP for mwtask141 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15950 bytes in 0.021 second response time [14:31:50] PROBLEM - cp20 PowerDNS Recursor on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [14:32:33] PROBLEM - uncyclopediakr.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:32:47] RECOVERY - cp20 Stunnel HTTP for mwtask141 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15950 bytes in 1.046 second response time [14:32:54] PROBLEM - nottingham.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:33:09] RECOVERY - nonciclopedia.org - LetsEncrypt on sslhost is OK: OK - Certificate 'nonciclopedia.org' will expire on Wed 24 Aug 2022 04:38:47 GMT +0000. [14:33:38] PROBLEM - cp21 Stunnel HTTP for mw122 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:33:49] RECOVERY - cp20 HTTPS on cp20 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 3405 bytes in 7.243 second response time [14:34:18] PROBLEM - smashbros.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:34:27] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::4c25/cpweb [14:34:56] RECOVERY - wiki.zergmafia.top - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.zergmafia.top' will expire on Tue 06 Sep 2022 20:57:49 GMT +0000. [14:35:16] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.73, 1.63, 1.20 [14:36:07] PROBLEM - cp21 HTTPS on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:36:33] RECOVERY - txt-dex.com - LetsEncrypt on sslhost is OK: OK - Certificate 'txt-dex.com' will expire on Sat 29 Oct 2022 14:13:35 GMT +0000. [14:36:46] RECOVERY - cp20 PowerDNS Recursor on cp20 is OK: DNS OK: 0.302 seconds response time. miraheze.org returns 198.244.148.90,2001:41d0:801:2000::1b80,2001:41d0:801:2000::4c25,51.195.220.68 [14:37:06] PROBLEM - wiki.ravynos.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:37:10] PROBLEM - www.project-patterns.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:37:16] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.42, 1.48, 1.19 [14:38:05] RECOVERY - cp21 HTTPS on cp21 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 3407 bytes in 3.059 second response time [14:38:38] PROBLEM - burnout.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:39:11] PROBLEM - cp20 Stunnel HTTP for mw132 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [14:40:00] RECOVERY - cp21 Stunnel HTTP for mw122 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 1.029 second response time [14:40:57] PROBLEM - cp20 Stunnel HTTP for mw142 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:41:01] PROBLEM - puritwiki.p-e.kr - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:41:52] PROBLEM - www.trollpasta.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:42:12] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [14:43:03] RECOVERY - cp20 Stunnel HTTP for mw142 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.021 second response time [14:43:17] PROBLEM - slymods.info - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:43:21] PROBLEM - wiki.wikimedia.cat - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:43:53] PROBLEM - cp20 HTTPS on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:44:16] RECOVERY - cp20 Stunnel HTTP for mw132 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 3.653 second response time [14:44:34] PROBLEM - sdiy.info - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:44:38] PROBLEM - smashbroswiki.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:44:57] PROBLEM - cp21 Stunnel HTTP for mw141 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [14:45:09] PROBLEM - agentisai.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:45:39] PROBLEM - wiki.minecraftathome.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:45:51] PROBLEM - cp21 Stunnel HTTP for mw142 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:45:54] RECOVERY - cp20 HTTPS on cp20 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 3405 bytes in 7.290 second response time [14:46:05] PROBLEM - wiki.otir.nl - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:47:03] RECOVERY - cp21 Stunnel HTTP for mw141 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 7.323 second response time [14:47:24] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 4.71, 8.65, 11.12 [14:48:16] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=lehmarkwiki --no-updates --username-prefix=templatewiki /mnt/mediawiki-static/metawiki/ImportDump/lehmarkwiki-20220804055212.xml (START) [14:48:25] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:48:31] PROBLEM - m.miraheze.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:48:51] RECOVERY - animefeet.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [14:49:09] PROBLEM - largedu.eu.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:49:52] RECOVERY - wikicryptos.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wikicryptos.org' will expire on Wed 24 Aug 2022 05:45:16 GMT +0000. [14:50:22] PROBLEM - cp20 SSH on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:50:25] PROBLEM - wiki.rebirthofthenight.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:50:44] PROBLEM - wiki.thunis.eu - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:51:24] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 4.91, 6.55, 9.67 [14:51:54] RECOVERY - marinebiodiversitymatrix.org - LetsEncrypt on sslhost is OK: OK - Certificate 'marinebiodiversitymatrix.org' will expire on Wed 24 Aug 2022 01:59:18 GMT +0000. [14:51:56] PROBLEM - wiki.shaazzz.ir - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:52:07] PROBLEM - cp20 Stunnel HTTP for mw131 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:52:09] RECOVERY - commons.gyaanipedia.com - LetsEncrypt on sslhost is OK: OK - Certificate 'commons.gyaanipedia.com' will expire on Thu 08 Sep 2022 06:46:28 GMT +0000. [14:52:12] PROBLEM - wiki.aoemods.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:52:20] RECOVERY - cp20 SSH on cp20 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [14:52:40] RECOVERY - m.miraheze.org - LetsEncrypt on sslhost is OK: OK - Certificate 'm.miraheze.org' will expire on Tue 06 Sep 2022 21:18:17 GMT +0000. [14:52:50] RECOVERY - zenith.nsmbu.net - LetsEncrypt on sslhost is OK: OK - Certificate 'zenith.nsmbu.net' will expire on Mon 10 Oct 2022 05:53:48 GMT +0000. [14:52:54] PROBLEM - programming.red - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:53:14] RECOVERY - cp21 Stunnel HTTP for mw142 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 4.619 second response time [14:53:21] RECOVERY - wiki.yumeka.icu - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.yumeka.icu' will expire on Sat 17 Sep 2022 18:24:18 GMT +0000. [14:53:36] RECOVERY - recaptime.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [14:53:53] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 2 datacenters are down: 2001:41d0:801:2000::4c25/cpweb, 2001:41d0:801:2000::1b80/cpweb [14:54:09] RECOVERY - commons.ballmedia.org - LetsEncrypt on sslhost is OK: OK - Certificate 'commons.ballmedia.org' will expire on Mon 10 Oct 2022 06:16:04 GMT +0000. [14:54:20] RECOVERY - cp20 Stunnel HTTP for mw131 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.020 second response time [14:55:24] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 27.63, 16.70, 13.00 [14:55:40] RECOVERY - bluearchive.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'bluearchive.wiki' will expire on Mon 22 Aug 2022 15:22:46 GMT +0000. [14:56:08] PROBLEM - mw122 MediaWiki Rendering on mw122 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:56:09] RECOVERY - mario.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [14:56:12] PROBLEM - cp20 HTTPS on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:56:20] PROBLEM - cp31 Stunnel HTTP for mw122 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:57:07] PROBLEM - cp20 Stunnel HTTP for mw122 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:57:24] PROBLEM - cp21 Stunnel HTTP for mw122 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:57:34] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=lehmarkwiki --no-updates --username-prefix=templatewiki /mnt/mediawiki-static/metawiki/ImportDump/lehmarkwiki-20220804055212.xml (END - exit=0) [14:57:35] RECOVERY - pwiki.arkcls.com - LetsEncrypt on sslhost is OK: OK - Certificate 'pwiki.arkcls.com' will expire on Tue 23 Aug 2022 08:39:11 GMT +0000. [14:57:35] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=lehmarkwiki (START) [14:57:39] PROBLEM - cp30 Stunnel HTTP for mw122 on cp30 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 328 bytes in 6.744 second response time [14:57:42] RECOVERY - www.journeytheword.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'www.journeytheword.wiki' will expire on Wed 31 Aug 2022 18:13:33 GMT +0000. [14:57:57] RECOVERY - publictestwiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'publictestwiki.com' will expire on Tue 23 Aug 2022 00:48:11 GMT +0000. [14:58:04] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:58:09] RECOVERY - cp20 HTTPS on cp20 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 3405 bytes in 3.051 second response time [14:58:15] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:58:24] RECOVERY - cp31 Stunnel HTTP for mw122 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 9.456 second response time [14:58:50] PROBLEM - cp20 SSH on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:58:55] RECOVERY - chakra.moe - LetsEncrypt on sslhost is OK: OK - Certificate 'chakra.moe' will expire on Wed 26 Oct 2022 18:41:37 GMT +0000. [14:59:03] PROBLEM - cp20 Stunnel HTTP for mw132 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [14:59:23] PROBLEM - cp20 Puppet on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [14:59:30] RECOVERY - www.winenjoy.net - LetsEncrypt on sslhost is OK: OK - Certificate 'www.winenjoy.net' will expire on Sun 02 Oct 2022 10:20:46 GMT +0000. [14:59:30] RECOVERY - cp21 Stunnel HTTP for mw122 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 1.384 second response time [14:59:33] RECOVERY - cp20 Stunnel HTTP for mw122 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 0.033 second response time [14:59:33] RECOVERY - cp30 Stunnel HTTP for mw122 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.309 second response time [15:00:12] RECOVERY - mw122 MediaWiki Rendering on mw122 is OK: HTTP OK: HTTP/1.1 200 OK - 29512 bytes in 0.754 second response time [15:00:13] RECOVERY - encyclopediaofastrobiology.org - LetsEncrypt on sslhost is OK: OK - Certificate 'encyclopediaofastrobiology.org' will expire on Mon 22 Aug 2022 22:32:53 GMT +0000. [15:00:28] RECOVERY - commonswiki.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [15:00:36] RECOVERY - wiki.nowchess.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.nowchess.org' will expire on Wed 24 Aug 2022 02:12:36 GMT +0000. [15:00:51] RECOVERY - cp20 SSH on cp20 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [15:01:04] PROBLEM - cp21 Puppet on cp21 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): File[/etc/apt/trusted.gpg.d/puppetlabs.gpg] [15:01:12] RECOVERY - uncyclopediakr.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [15:01:17] PROBLEM - wc.miraheze.org on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:01:25] RECOVERY - www.istpcomputing.com - LetsEncrypt on sslhost is OK: OK - Certificate 'istpcomputing.com' will expire on Tue 11 Oct 2022 04:37:06 GMT +0000. [15:01:39] RECOVERY - cp20 Puppet on cp20 is OK: OK: Puppet is currently enabled, last run 6 minutes ago with 0 failures [15:02:29] PROBLEM - cp20 ferm_active on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [15:03:10] RECOVERY - smashbros.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [15:03:11] RECOVERY - wiki.potabi.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.potabi.com' will expire on Mon 10 Oct 2022 06:24:27 GMT +0000. [15:03:16] RECOVERY - wc.miraheze.org on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [15:03:58] RECOVERY - cp20 Stunnel HTTP for mw132 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 1.027 second response time [15:04:26] RECOVERY - cp20 ferm_active on cp20 is OK: OK ferm input default policy is set [15:05:46] RECOVERY - wiki.ravynos.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.ravynos.com' will expire on Thu 01 Sep 2022 00:45:42 GMT +0000. [15:06:37] PROBLEM - m33ks.ml - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:07:03] PROBLEM - www.project-patterns.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'project-patterns.com' expires in 15 day(s) (Fri 19 Aug 2022 17:20:05 GMT +0000). [15:07:22] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.66, 10.24, 8.35 [15:07:37] PROBLEM - cp20 Stunnel HTTP for mw121 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [15:08:11] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.56, 1.84, 1.46 [15:08:26] RECOVERY - burnout.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'burnout.wiki' will expire on Tue 01 Nov 2022 04:10:29 GMT +0000. [15:09:18] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 6.99, 8.95, 8.09 [15:09:48] RECOVERY - cp20 Stunnel HTTP for mw121 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.021 second response time [15:10:09] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.10, 1.58, 1.41 [15:10:18] RECOVERY - puritwiki.p-e.kr - LetsEncrypt on sslhost is OK: OK - Certificate 'puritwiki.p-e.kr' will expire on Thu 29 Sep 2022 02:01:07 GMT +0000. [15:10:45] RECOVERY - www.trollpasta.com - LetsEncrypt on sslhost is OK: OK - Certificate 'trollpasta.com' will expire on Mon 10 Oct 2022 06:29:05 GMT +0000. [15:11:10] RECOVERY - wiki.mostly.vet - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.mostly.vet' will expire on Fri 02 Sep 2022 12:38:42 GMT +0000. [15:11:10] PROBLEM - cp20 SSH on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:12:06] RECOVERY - slymods.info - LetsEncrypt on sslhost is OK: OK - Certificate 'slymods.info' will expire on Fri 21 Oct 2022 06:31:32 GMT +0000. [15:12:14] PROBLEM - proficientprofit.click - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:12:15] RECOVERY - wiki.wikimedia.cat - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.wikimedia.cat' will expire on Mon 10 Oct 2022 04:52:56 GMT +0000. [15:13:12] PROBLEM - cp21 PowerDNS Recursor on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [15:13:13] RECOVERY - sdiy.info - LetsEncrypt on sslhost is OK: OK - Certificate 'sdiy.info' will expire on Sat 17 Sep 2022 21:29:52 GMT +0000. [15:13:54] RECOVERY - smashbroswiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'smashbroswiki.com' will expire on Sat 22 Oct 2022 05:43:00 GMT +0000. [15:14:00] RECOVERY - biblestrength.net - LetsEncrypt on sslhost is OK: OK - Certificate 'biblestrength.net' will expire on Wed 07 Sep 2022 18:16:09 GMT +0000. [15:14:31] PROBLEM - cp20 Stunnel HTTP for matomo131 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [15:14:45] RECOVERY - wiki.otir.nl - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.otir.nl' will expire on Fri 26 Aug 2022 04:20:05 GMT +0000. [15:14:48] RECOVERY - agentisai.com - LetsEncrypt on sslhost is OK: OK - Certificate 'www.agentisai.com' will expire on Wed 28 Sep 2022 11:24:06 GMT +0000. [15:14:59] RECOVERY - wiki.minecraftathome.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.minecraftathome.com' will expire on Wed 24 Aug 2022 02:32:00 GMT +0000. [15:15:07] RECOVERY - cp21 PowerDNS Recursor on cp21 is OK: DNS OK: 0.200 seconds response time. miraheze.org returns 198.244.148.90,2607:5300:201:3100::5ebc,2607:5300:201:3100::929a,51.195.220.68 [15:15:17] RECOVERY - cp20 SSH on cp20 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [15:15:34] PROBLEM - cp20 HTTPS on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:16:02] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.34, 1.81, 1.60 [15:16:03] PROBLEM - correypedia.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:16:43] RECOVERY - cp20 Stunnel HTTP for matomo131 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 99061 bytes in 2.182 second response time [15:16:50] PROBLEM - wiki.umbranet.mandelbrotgames.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:17:26] PROBLEM - eng.archiopedia.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:18:00] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.52, 1.65, 1.56 [15:19:32] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [15:19:36] PROBLEM - wiki.zymonic.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:19:48] PROBLEM - encyclopediarobotica.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:20:02] RECOVERY - mediawiki.ecfin.eu - LetsEncrypt on sslhost is OK: OK - Certificate 'mediawiki.ecfin.eu' will expire on Mon 22 Aug 2022 23:01:19 GMT +0000. [15:20:10] PROBLEM - cp21 Stunnel HTTP for reports121 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [15:20:15] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.86, 3.76, 2.34 [15:20:16] RECOVERY - wiki.rebirthofthenight.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.rebirthofthenight.com' will expire on Wed 24 Aug 2022 02:49:21 GMT +0000. [15:20:29] PROBLEM - piwik.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:20:33] RECOVERY - wiki.thunis.eu - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.thunis.eu' will expire on Tue 23 Aug 2022 01:47:24 GMT +0000. [15:20:33] PROBLEM - wiki.slimelab.net - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:20:36] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=lehmarkwiki (END - exit=0) [15:20:37] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/initSiteStats.php --wiki=lehmarkwiki --active --update (END - exit=0) [15:21:27] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:21:41] RECOVERY - wiki.shaazzz.ir - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.shaazzz.ir' will expire on Tue 23 Aug 2022 09:06:44 GMT +0000. [15:21:42] RECOVERY - wiki.aoemods.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.aoemods.com' will expire on Sat 01 Oct 2022 04:12:34 GMT +0000. [15:21:46] PROBLEM - cp20 SSH on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:22:08] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:22:11] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 0.96, 2.65, 2.10 [15:22:11] PROBLEM - pubwiki.lab.co.pl - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:22:14] PROBLEM - wiki.insideearth.info - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:22:21] RECOVERY - programming.red - LetsEncrypt on sslhost is OK: OK - Certificate 'programming.red' will expire on Tue 23 Aug 2022 09:31:28 GMT +0000. [15:22:52] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.49, 11.00, 9.32 [15:23:37] PROBLEM - guia.esporo.net - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:23:42] PROBLEM - houkai2.cyou - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:23:44] RECOVERY - cp20 SSH on cp20 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [15:24:31] RECOVERY - cp21 Stunnel HTTP for reports121 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 10996 bytes in 3.084 second response time [15:24:48] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 4.43, 8.63, 8.65 [15:24:56] RECOVERY - dc.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [15:24:58] PROBLEM - squareenix.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:25:44] RECOVERY - cp20 HTTPS on cp20 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 3405 bytes in 0.021 second response time [15:26:00] PROBLEM - lgbtqia.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:26:48] PROBLEM - cp20 Stunnel HTTP for test131 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:26:56] PROBLEM - mw132 Current Load on mw132 is CRITICAL: CRITICAL - load average: 18.22, 11.43, 7.35 [15:27:21] PROBLEM - wikileague.cf - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:27:32] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::4c25/cpweb [15:27:42] RECOVERY - cp21 Puppet on cp21 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [15:28:46] RECOVERY - cp20 Stunnel HTTP for test131 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15954 bytes in 0.018 second response time [15:29:32] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [15:29:54] PROBLEM - www.rothwell-leeds.co.uk - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:30:00] PROBLEM - cp21 Stunnel HTTP for test131 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [15:30:07] PROBLEM - cp20 Stunnel HTTP for mon141 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [15:30:21] PROBLEM - m.miraheze.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:30:38] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 23.33, 13.79, 10.33 [15:30:56] RECOVERY - mw132 Current Load on mw132 is OK: OK - load average: 8.02, 10.12, 7.80 [15:32:05] RECOVERY - cp21 Stunnel HTTP for test131 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15940 bytes in 1.025 second response time [15:32:15] RECOVERY - cp20 Stunnel HTTP for mon141 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 39170 bytes in 1.042 second response time [15:32:27] RECOVERY - m.miraheze.org - LetsEncrypt on sslhost is OK: OK - Certificate 'm.miraheze.org' will expire on Tue 06 Sep 2022 21:18:17 GMT +0000. [15:32:38] PROBLEM - wikimoma.art - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:32:41] PROBLEM - cp21 HTTPS on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:32:49] PROBLEM - tr.wikiretet.ga - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:34:03] PROBLEM - cp20 SSH on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:34:32] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 7.11, 11.24, 10.17 [15:34:34] PROBLEM - cp20 Stunnel HTTP for mw132 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:34:36] RECOVERY - cp21 HTTPS on cp21 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 3407 bytes in 0.018 second response time [15:34:39] PROBLEM - wiki.consid.vn - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:35:05] PROBLEM - wiki.ssangyongsports.eu.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:35:11] PROBLEM - wc.miraheze.org on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:36:04] RECOVERY - cp20 SSH on cp20 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [15:36:32] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 4.13, 8.83, 9.42 [15:37:10] PROBLEM - www.project-patterns.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:37:18] PROBLEM - www.sidem.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:37:37] PROBLEM - txt-dex.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:37:46] PROBLEM - cp20 HTTPS on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:37:47] PROBLEM - allthetropes.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:38:21] PROBLEM - cp21 Stunnel HTTP for mw131 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [15:38:24] PROBLEM - dc-multiverse.dcwikis.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:38:26] PROBLEM - gs.sidem.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:38:53] RECOVERY - cp20 Stunnel HTTP for mw132 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 0.016 second response time [15:39:24] PROBLEM - wiki.meower.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:39:31] PROBLEM - cp20 Stunnel HTTP for mw142 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [15:39:59] PROBLEM - creativecommons.id - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:40:00] PROBLEM - cp21 Stunnel HTTP for reports121 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [15:40:24] RECOVERY - cp21 Stunnel HTTP for mw131 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 7.130 second response time [15:40:28] PROBLEM - cp20 SSH on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:41:32] RECOVERY - cp20 Stunnel HTTP for mw142 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.022 second response time [15:41:49] PROBLEM - wiki.scvo.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:41:56] PROBLEM - wiki.leapit.no - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:41:57] RECOVERY - cp21 Stunnel HTTP for reports121 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 10996 bytes in 0.068 second response time [15:42:04] PROBLEM - cp20 Stunnel HTTP for mw122 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:42:10] PROBLEM - pt.graalmilitary.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:42:32] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 17.78, 14.29, 11.36 [15:43:20] PROBLEM - wiki.tulpa.info - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:43:29] PROBLEM - ipv6bolivia.tk - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:43:54] PROBLEM - wikipanel.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:44:34] PROBLEM - sdiy.info - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:44:43] RECOVERY - correypedia.org - LetsEncrypt on sslhost is OK: OK - Certificate 'correypedia.org' will expire on Thu 01 Sep 2022 00:41:01 GMT +0000. [15:45:14] PROBLEM - cp21 SSH on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:45:53] RECOVERY - cp20 HTTPS on cp20 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 3405 bytes in 1.027 second response time [15:46:03] PROBLEM - nenawiki.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:46:13] PROBLEM - wiki.ricochetuniverse.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:46:14] PROBLEM - dariawiki.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:46:25] PROBLEM - gp.ct777.cf - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:46:30] PROBLEM - wildbowiki.net - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:46:42] RECOVERY - wiki.umbranet.mandelbrotgames.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.umbranet.mandelbrotgames.com' will expire on Sun 02 Oct 2022 11:07:49 GMT +0000. [15:47:01] RECOVERY - eng.archiopedia.org - LetsEncrypt on sslhost is OK: OK - Certificate 'eng.archiopedia.org' will expire on Sun 02 Oct 2022 05:35:50 GMT +0000. [15:47:27] RECOVERY - cp20 Stunnel HTTP for mw122 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 3.040 second response time [15:47:28] PROBLEM - cp20 Stunnel HTTP for mw121 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:47:42] PROBLEM - wiki.wisrail.de - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:48:27] RECOVERY - largedu.eu.org - LetsEncrypt on sslhost is OK: OK - Certificate 'largedu.eu.org' will expire on Sun 30 Oct 2022 14:46:40 GMT +0000. [15:48:48] RECOVERY - wiki.zymonic.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.zymonic.com' will expire on Wed 24 Aug 2022 02:07:19 GMT +0000. [15:48:57] RECOVERY - vmcodex.net - LetsEncrypt on sslhost is OK: OK - Certificate 'vmcodex.net' will expire on Wed 24 Aug 2022 03:45:41 GMT +0000. [15:49:05] RECOVERY - piwik.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [15:49:10] RECOVERY - encyclopediarobotica.org - LetsEncrypt on sslhost is OK: OK - Certificate 'encyclopediarobotica.org' will expire on Tue 06 Sep 2022 20:51:36 GMT +0000. [15:49:10] RECOVERY - wiki.slimelab.net - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.slimelab.net' will expire on Sat 01 Oct 2022 16:16:26 GMT +0000. [15:49:26] PROBLEM - cp20 conntrack_table_size on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [15:49:32] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::4c25/cpweb [15:49:56] RECOVERY - cp20 Stunnel HTTP for mw121 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 1.029 second response time [15:50:04] RECOVERY - wc.miraheze.org on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [15:50:29] PROBLEM - cp20 Stunnel HTTP for mw142 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [15:51:00] RECOVERY - pubwiki.lab.co.pl - LetsEncrypt on sslhost is OK: OK - Certificate 'pubwiki.lab.co.pl' will expire on Tue 23 Aug 2022 08:56:40 GMT +0000. [15:51:01] PROBLEM - cp20 Stunnel HTTP for mw131 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:51:02] RECOVERY - cp20 SSH on cp20 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [15:51:14] RECOVERY - wiki.insideearth.info - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.insideearth.info' will expire on Tue 23 Aug 2022 08:05:34 GMT +0000. [15:51:20] RECOVERY - cp21 SSH on cp21 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [15:51:23] RECOVERY - cp20 conntrack_table_size on cp20 is OK: OK: nf_conntrack is 1 % full [15:52:16] RECOVERY - guia.esporo.net - LetsEncrypt on sslhost is OK: OK - Certificate 'guia.esporo.net' will expire on Tue 23 Aug 2022 02:23:57 GMT +0000. [15:52:28] RECOVERY - cp20 Stunnel HTTP for mw142 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 1.039 second response time [15:52:37] RECOVERY - houkai2.cyou - LetsEncrypt on sslhost is OK: OK - Certificate 'houkai2.cyou' will expire on Thu 27 Oct 2022 05:22:41 GMT +0000. [15:52:42] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.65, 1.86, 1.45 [15:53:07] RECOVERY - cp20 Stunnel HTTP for mw131 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 7.193 second response time [15:54:02] PROBLEM - cp21 Stunnel HTTP for test131 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [15:54:03] PROBLEM - cp20 HTTPS on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:54:10] PROBLEM - cp21 Stunnel HTTP for mw121 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [15:54:28] [02puppet] 07Universal-Omega opened pull request 03#2760: Varnish: set initial to 4 in healthcheck to mark healthy initially - 13https://github.com/miraheze/puppet/pull/2760 [15:54:28] [url] Page not found · GitHub · GitHub | github.com [15:54:41] RECOVERY - squareenix.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [15:55:07] [02puppet] 07Universal-Omega commented on pull request 03#2710: Varnish: Update health checks - 13https://github.com/miraheze/puppet/pull/2710#issuecomment-1205443959 [15:55:08] [url] Varnish: Update health checks by Universal-Omega · Pull Request #2710 · miraheze/puppet · GitHub | github.com [15:55:08] [02puppet] 07Universal-Omega closed pull request 03#2710: Varnish: Update health checks - 13https://github.com/miraheze/puppet/pull/2710 [15:55:09] [url] Page not found · GitHub · GitHub | github.com [15:55:33] [02puppet] 07Universal-Omega commented on pull request 03#2703: varnish: force thumb_handler through a specific set of servers - 13https://github.com/miraheze/puppet/pull/2703#issuecomment-1205444463 [15:55:34] [url] varnish: force thumb_handler through a specific set of servers by paladox · Pull Request #2703 · miraheze/puppet · GitHub | github.com [15:55:54] [02puppet] 07paladox closed pull request 03#2703: varnish: force thumb_handler through a specific set of servers - 13https://github.com/miraheze/puppet/pull/2703 [15:55:54] [url] Page not found · GitHub · GitHub | github.com [15:55:56] [02miraheze/puppet] 07paladox deleted branch 03paladox-patch-6 [15:55:57] [02puppet] 07paladox deleted branch 03paladox-patch-6 - 13https://github.com/miraheze/puppet [15:55:58] [url] Page not found · GitHub · GitHub | github.com [15:56:00] RECOVERY - cp20 HTTPS on cp20 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 3405 bytes in 3.040 second response time [15:56:09] RECOVERY - cp21 Stunnel HTTP for mw121 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 1.045 second response time [15:56:16] RECOVERY - cp21 Stunnel HTTP for test131 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15954 bytes in 1.026 second response time [15:57:11] PROBLEM - cp21 Stunnel HTTP for mw122 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:57:19] RECOVERY - wikileague.cf - LetsEncrypt on sslhost is OK: OK - Certificate 'wikileague.cf' will expire on Mon 22 Aug 2022 22:21:46 GMT +0000. [15:58:01] [02puppet] 07Universal-Omega commented on pull request 03#2706: mariadb: tweak config - 13https://github.com/miraheze/puppet/pull/2706#issuecomment-1205447349 [15:58:01] [url] mariadb: tweak config by paladox · Pull Request #2706 · miraheze/puppet · GitHub | github.com [15:59:42] RECOVERY - cp21 Stunnel HTTP for mw122 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 1.529 second response time [15:59:43] RECOVERY - www.rothwell-leeds.co.uk - LetsEncrypt on sslhost is OK: OK - Certificate 'www.rothwell-leeds.co.uk' will expire on Sat 17 Sep 2022 18:56:39 GMT +0000. [16:00:13] [02puppet] 07Universal-Omega opened pull request 03#2761: puppet111 -> puppet141 - 13https://github.com/miraheze/puppet/pull/2761 [16:00:13] [url] Page not found · GitHub · GitHub | github.com [16:00:18] PROBLEM - ecole.science - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:00:25] RECOVERY - nottingham.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'nottingham.wiki' will expire on Mon 26 Sep 2022 06:16:48 GMT +0000. [16:00:30] PROBLEM - cp20 SSH on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:00:54] [02puppet] 07Universal-Omega synchronize pull request 03#2761: puppet111 -> puppet141 - 13https://github.com/miraheze/puppet/pull/2761 [16:00:55] ... [16:01:21] RECOVERY - wikimoma.art - LetsEncrypt on sslhost is OK: OK - Certificate 'wikimoma.art' will expire on Sat 17 Sep 2022 19:04:53 GMT +0000. [16:01:43] RECOVERY - tr.wikiretet.ga - LetsEncrypt on sslhost is OK: OK - Certificate 'tr.wikiretet.ga' will expire on Mon 12 Sep 2022 14:49:12 GMT +0000. [16:02:09] [02puppet] 07Universal-Omega synchronize pull request 03#2761: puppet111 -> puppet141 - 13https://github.com/miraheze/puppet/pull/2761 [16:02:10] [url] Page not found · GitHub · GitHub | github.com [16:02:27] PROBLEM - cp21 Stunnel HTTP for mail121 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [16:02:29] PROBLEM - cp21 HTTPS on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:02:32] RECOVERY - cp20 SSH on cp20 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [16:02:32] [02puppet] 07Universal-Omega synchronize pull request 03#2761: puppet111 -> puppet141 - 13https://github.com/miraheze/puppet/pull/2761 [16:02:33] ... [16:03:07] [02puppet] 07Universal-Omega synchronize pull request 03#2761: puppet111 -> puppet141 - 13https://github.com/miraheze/puppet/pull/2761 [16:03:07] [url] Page not found · GitHub · GitHub | github.com [16:03:50] RECOVERY - wiki.consid.vn - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.consid.vn' will expire on Mon 22 Aug 2022 23:09:56 GMT +0000. [16:04:22] RECOVERY - cp21 Stunnel HTTP for mail121 on cp21 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 427 bytes in 0.013 second response time [16:04:25] RECOVERY - cp21 HTTPS on cp21 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 3407 bytes in 1.029 second response time [16:04:32] [02puppet] 07Universal-Omega edited pull request 03#2761: puppet111 -> puppet141 - 13https://github.com/miraheze/puppet/pull/2761 [16:04:32] ... [16:04:50] PROBLEM - wiki.potabi.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:05:52] PROBLEM - cp21 SSH on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:05:57] PROBLEM - cp21 HTTP 4xx/5xx ERROR Rate on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [16:06:09] RECOVERY - www.sidem.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'www.sidem.wiki' will expire on Tue 23 Aug 2022 12:59:12 GMT +0000. [16:06:20] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.73, 1.95, 1.89 [16:06:20] PROBLEM - wiki.wilderyogi.eu - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:06:32] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 7.10, 10.03, 11.76 [16:06:47] RECOVERY - m33ks.ml - LetsEncrypt on sslhost is OK: OK - Certificate 'm33ks.ml' will expire on Thu 29 Sep 2022 04:18:17 GMT +0000. [16:07:00] RECOVERY - txt-dex.com - LetsEncrypt on sslhost is OK: OK - Certificate 'txt-dex.com' will expire on Sat 29 Oct 2022 14:13:35 GMT +0000. [16:07:01] PROBLEM - www.project-patterns.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'project-patterns.com' expires in 15 day(s) (Fri 19 Aug 2022 17:20:05 GMT +0000). [16:07:15] RECOVERY - allthetropes.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [16:07:46] PROBLEM - bebaskanpengetahuan.id - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:07:49] RECOVERY - cp21 SSH on cp21 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [16:08:00] PROBLEM - cp21 Stunnel HTTP for mwtask141 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:08:03] RECOVERY - cp21 HTTP 4xx/5xx ERROR Rate on cp21 is OK: OK - NGINX Error Rate is 7% [16:08:08] RECOVERY - gs.sidem.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'gs.sidem.wiki' will expire on Tue 23 Aug 2022 13:09:38 GMT +0000. [16:08:14] RECOVERY - dc-multiverse.dcwikis.com - LetsEncrypt on sslhost is OK: OK - Certificate 'dc-multiverse.dcwikis.com' will expire on Wed 24 Aug 2022 05:08:53 GMT +0000. [16:08:25] PROBLEM - cp21 Stunnel HTTP for mw131 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [16:08:30] PROBLEM - cp20 HTTPS on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:09:01] PROBLEM - microworldwiki.ga - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:09:30] RECOVERY - wiki.meower.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.meower.org' will expire on Thu 27 Oct 2022 03:39:58 GMT +0000. [16:10:13] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.58, 1.39, 1.65 [16:10:23] RECOVERY - cp21 Stunnel HTTP for mw131 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 3.042 second response time [16:10:32] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 14.11, 11.57, 11.94 [16:10:43] PROBLEM - hoseki.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:11:32] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [16:11:32] RECOVERY - pt.graalmilitary.com - LetsEncrypt on sslhost is OK: OK - Certificate 'pt.graalmilitary.com' will expire on Sun 02 Oct 2022 10:22:40 GMT +0000. [16:11:36] PROBLEM - www.programming.red - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:11:37] RECOVERY - proficientprofit.click - LetsEncrypt on sslhost is OK: OK - Certificate 'www.proficientprofit.click' will expire on Sat 08 Oct 2022 06:14:24 GMT +0000. [16:11:48] PROBLEM - wiki.hylormc.tk - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:12:18] PROBLEM - en.pornwiki.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:12:35] PROBLEM - wiki.conworlds.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:12:35] RECOVERY - cp20 HTTPS on cp20 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 3405 bytes in 7.314 second response time [16:12:54] PROBLEM - betaheze.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:13:00] PROBLEM - wiki.simorgh.me - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:13:02] PROBLEM - www.proficientprofit.click - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:13:09] PROBLEM - cp21 Stunnel HTTP for mail121 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [16:13:25] RECOVERY - cp21 Stunnel HTTP for mwtask141 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15950 bytes in 3.047 second response time [16:13:36] PROBLEM - wiki.fossbots.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:13:40] PROBLEM - wiki.make717.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:13:54] PROBLEM - hoodwiki.xyz - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:14:11] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [16:14:18] PROBLEM - wiki.joust.ro - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:14:32] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.64, 11.10, 11.80 [16:14:33] PROBLEM - wiki.digitalefitheid.nl - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:14:36] PROBLEM - wiki.helsinginpoytaroolipelaajat.fi - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:15:02] RECOVERY - wiki.ricochetuniverse.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.ricochetuniverse.com' will expire on Tue 23 Aug 2022 00:04:36 GMT +0000. [16:15:12] RECOVERY - cp21 Stunnel HTTP for mail121 on cp21 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 427 bytes in 7.157 second response time [16:15:40] RECOVERY - wildbowiki.net - LetsEncrypt on sslhost is OK: OK - Certificate 'wildbowiki.net' will expire on Tue 06 Sep 2022 20:59:02 GMT +0000. [16:15:57] PROBLEM - mariopedia.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:16:00] PROBLEM - cp21 SSH on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:16:05] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 0.85, 1.01, 0.90 [16:16:32] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 17.75, 13.58, 12.62 [16:16:44] PROBLEM - cp20 Stunnel HTTP for mw122 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [16:17:25] RECOVERY - wiki.wisrail.de - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.wisrail.de' will expire on Tue 06 Sep 2022 21:01:07 GMT +0000. [16:17:49] PROBLEM - cp20 Stunnel HTTP for matomo131 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:17:55] RECOVERY - cp21 SSH on cp21 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [16:18:40] RECOVERY - cp20 Stunnel HTTP for mw122 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.026 second response time [16:18:58] PROBLEM - wiki.umbranet.mandelbrotgames.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:19:19] PROBLEM - cp21 Stunnel HTTP for phab121 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:19:36] PROBLEM - finalfantasy.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:19:45] PROBLEM - cp21 Stunnel HTTP for reports121 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [16:20:02] PROBLEM - wiki.hsins.eu - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:20:33] PROBLEM - wiki.slimelab.net - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:20:35] PROBLEM - sharqedia.ml - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:21:50] RECOVERY - cp21 Stunnel HTTP for reports121 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 10996 bytes in 1.094 second response time [16:21:52] RECOVERY - cp20 Stunnel HTTP for matomo131 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 99061 bytes in 3.190 second response time [16:22:05] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.18, 1.74, 1.61 [16:22:22] PROBLEM - wiki.rebirthofthenight.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:22:32] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 6.95, 9.72, 11.41 [16:23:19] PROBLEM - dcmultiverse.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:23:21] PROBLEM - cp20 SSH on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:23:32] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::1b80/cpweb [16:23:37] PROBLEM - cp20 Stunnel HTTP for mon141 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [16:23:48] PROBLEM - houkai2.cyou - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:24:32] RECOVERY - lgbtqia.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'www.lgbtqia.wiki' will expire on Fri 07 Oct 2022 11:35:52 GMT +0000. [16:24:59] PROBLEM - cp21 Stunnel HTTP for mon141 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [16:25:26] RECOVERY - cp20 SSH on cp20 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [16:25:37] RECOVERY - cp20 Stunnel HTTP for mon141 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 39170 bytes in 0.033 second response time [16:25:48] PROBLEM - cp20 HTTPS on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:25:59] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.34, 1.66, 1.63 [16:26:42] PROBLEM - www.electrowiki.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:26:45] PROBLEM - sarovia.graalmilitary.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:27:02] PROBLEM - wiki.thesimswiki.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:27:03] PROBLEM - dc.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:27:15] RECOVERY - cp21 Stunnel HTTP for mon141 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 39185 bytes in 2.105 second response time [16:27:16] PROBLEM - cp20 Stunnel HTTP for mw132 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:27:20] PROBLEM - cp21 Stunnel HTTP for mw122 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [16:27:28] PROBLEM - cp20 Stunnel HTTP for mail121 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [16:27:49] RECOVERY - cp20 HTTPS on cp20 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 3405 bytes in 7.328 second response time [16:27:59] PROBLEM - files.pornwiki.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:28:40] RECOVERY - cp21 Stunnel HTTP for phab121 on cp21 is OK: HTTP OK: Status line output matched "500" - 2855 bytes in 0.098 second response time [16:29:04] PROBLEM - wc.miraheze.org on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:29:23] RECOVERY - cp21 Stunnel HTTP for mw122 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 2.032 second response time [16:29:28] RECOVERY - cp20 Stunnel HTTP for mail121 on cp20 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 427 bytes in 0.011 second response time [16:29:41] RECOVERY - ecole.science - LetsEncrypt on sslhost is OK: OK - Certificate 'ecole.science' will expire on Mon 22 Aug 2022 21:07:09 GMT +0000. [16:29:45] PROBLEM - cp20 Stunnel HTTP for mw122 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:29:46] PROBLEM - miraheze.ga - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:30:32] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 15.78, 12.06, 11.55 [16:30:58] PROBLEM - perpustaxaan.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:31:32] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [16:32:14] RECOVERY - cp20 Stunnel HTTP for mw122 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 3.058 second response time [16:32:17] PROBLEM - otogebase.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:32:56] PROBLEM - wiki.timewisely.net - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:33:05] PROBLEM - christipedia.nl - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:51:42] RECOVERY - cp31 Varnish Backends on cp31 is OK: All 14 backends are healthy [16:52:13] RECOVERY - wiki.rebirthofthenight.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.rebirthofthenight.com' will expire on Wed 24 Aug 2022 02:49:21 GMT +0000. [16:52:30] RECOVERY - dcmultiverse.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [16:52:31] RECOVERY - cp21 SSH on cp21 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [16:52:44] RECOVERY - houkai2.cyou - LetsEncrypt on sslhost is OK: OK - Certificate 'houkai2.cyou' will expire on Thu 27 Oct 2022 05:22:41 GMT +0000. [16:55:23] RECOVERY - www.electrowiki.org - LetsEncrypt on sslhost is OK: OK - Certificate 'electrowiki.org' will expire on Sat 17 Sep 2022 19:15:15 GMT +0000. [16:55:27] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 14.40, 10.21, 10.72 [16:55:29] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.07, 8.83, 10.40 [16:55:32] RECOVERY - cp20 Stunnel HTTP for puppet111 on cp20 is OK: HTTP OK: Status line output matched "403" - 289 bytes in 1.017 second response time [16:57:21] PROBLEM - gluster122 Current Load on gluster122 is CRITICAL: CRITICAL - load average: 5.95, 4.64, 3.64 [16:57:49] RECOVERY - files.pornwiki.org - LetsEncrypt on sslhost is OK: OK - Certificate 'files.pornwiki.org' will expire on Sat 17 Sep 2022 19:10:31 GMT +0000. [16:57:53] PROBLEM - cp20 SSH on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:57:54] PROBLEM - cp21 SSH on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:58:12] PROBLEM - cp20 HTTPS on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:58:36] RECOVERY - miraheze.ga - LetsEncrypt on sslhost is OK: OK - Certificate 'miraheze.ga' will expire on Wed 24 Aug 2022 04:25:02 GMT +0000. [16:58:53] RECOVERY - cp21 Stunnel HTTP for puppet111 on cp21 is OK: HTTP OK: Status line output matched "403" - 289 bytes in 7.180 second response time [16:59:37] RECOVERY - perpustaxaan.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'perpustaxaan.wiki' will expire on Tue 11 Oct 2022 04:34:44 GMT +0000. [16:59:50] RECOVERY - cp21 SSH on cp21 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [16:59:50] RECOVERY - cp20 SSH on cp20 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [16:59:57] [02puppet] 07Universal-Omega opened pull request 03#2762: ssl-renew: use puppet141 - 13https://github.com/miraheze/puppet/pull/2762 [16:59:57] [url] Page not found · GitHub · GitHub | github.com [17:00:13] RECOVERY - cp20 HTTPS on cp20 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 3406 bytes in 1.023 second response time [17:00:30] PROBLEM - cp21 Disk Space on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [17:00:31] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/1cc50dbf5a31...d94e0366b995 [17:00:31] [url] Comparing 1cc50dbf5a31...d94e0366b995 · miraheze/puppet · GitHub | github.com [17:00:32] [02miraheze/puppet] 07Universal-Omega 03d94e036 - ssl-renew: use puppet141 (#2762) [17:00:34] [02puppet] 07paladox closed pull request 03#2762: ssl-renew: use puppet141 - 13https://github.com/miraheze/puppet/pull/2762 [17:00:34] [url] Page not found · GitHub · GitHub | github.com [17:01:07] PROBLEM - cp21 Stunnel HTTP for reports121 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [17:01:13] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.60, 10.20, 10.75 [17:01:16] PROBLEM - journeytheword.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:01:33] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [17:01:55] RECOVERY - wiki.timewisely.net - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.timewisely.net' will expire on Mon 22 Aug 2022 22:01:18 GMT +0000. [17:02:01] PROBLEM - cp21 Stunnel HTTP for mon141 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [17:02:01] PROBLEM - cp20 Stunnel HTTP for mw122 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:02:12] PROBLEM - cp21 Stunnel HTTP for mwtask141 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [17:02:22] PROBLEM - stablestate.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:02:38] PROBLEM - arrieretoile.fr - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:02:42] RECOVERY - christipedia.nl - LetsEncrypt on sslhost is OK: OK - Certificate 'www.christipedia.nl' will expire on Sat 17 Sep 2022 18:34:21 GMT +0000. [17:03:07] PROBLEM - wiki.scpsharp.ga - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:03:07] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 5.06, 8.30, 9.98 [17:03:19] PROBLEM - wiki.nowchess.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:04:29] [02dns] 07Universal-Omega opened pull request 03#325: Remove puppet111 from dns - 13https://github.com/miraheze/dns/pull/325 [17:04:29] [url] Page not found · GitHub · GitHub | github.com [17:04:57] PROBLEM - cp21 Stunnel HTTP for puppet111 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:04:58] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.25, 1.75, 1.96 [17:05:07] RECOVERY - wiki.ssangyongsports.eu.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.ssangyongsports.eu.org' will expire on Wed 31 Aug 2022 22:12:11 GMT +0000. [17:05:09] RECOVERY - wiki.wilderyogi.eu - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.wilderyogi.eu' will expire on Mon 26 Sep 2022 06:35:10 GMT +0000. [17:05:14] PROBLEM - gluster122 Current Load on gluster122 is WARNING: WARNING - load average: 2.52, 3.77, 3.68 [17:05:56] PROBLEM - heavyironmodding.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:05:57] RECOVERY - bebaskanpengetahuan.id - LetsEncrypt on sslhost is OK: OK - Certificate 'bebaskanpengetahuan.id' will expire on Wed 24 Aug 2022 04:11:00 GMT +0000. [17:06:17] RECOVERY - cp21 Stunnel HTTP for mon141 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 39185 bytes in 1.063 second response time [17:06:27] RECOVERY - cp21 Stunnel HTTP for mwtask141 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15950 bytes in 1.043 second response time [17:07:41] PROBLEM - wikimas.kr - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:07:41] PROBLEM - ambient.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:07:50] PROBLEM - cp21 HTTPS on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:08:19] PROBLEM - cp20 Stunnel HTTP for matomo131 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:08:26] PROBLEM - cp20 SSH on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:08:59] PROBLEM - cp30 Stunnel HTTP for mw122 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:09:03] RECOVERY - cp21 Stunnel HTTP for reports121 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 10996 bytes in 0.083 second response time [17:09:09] RECOVERY - www.programming.red - LetsEncrypt on sslhost is OK: OK - Certificate 'programming.red' will expire on Tue 23 Aug 2022 09:31:28 GMT +0000. [17:09:31] PROBLEM - mw122 MediaWiki Rendering on mw122 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:09:32] PROBLEM - pornwiki.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:09:59] PROBLEM - wiki.worldsofweary.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:10:16] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::4c25/cpweb [17:10:21] PROBLEM - cp21 Stunnel HTTP for mw122 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [17:10:22] RECOVERY - cp20 SSH on cp20 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [17:10:35] PROBLEM - wiki.qadrishattari.xyz - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:10:37] RECOVERY - cp20 Stunnel HTTP for matomo131 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 99061 bytes in 7.215 second response time [17:10:46] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.96, 1.28, 1.69 [17:11:00] RECOVERY - cp30 Stunnel HTTP for mw122 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.439 second response time [17:11:20] RECOVERY - cp21 Disk Space on cp21 is OK: DISK OK - free space: / 8999 MB (23% inode=96%); [17:11:28] RECOVERY - mw122 MediaWiki Rendering on mw122 is OK: HTTP OK: HTTP/1.1 200 OK - 29512 bytes in 0.372 second response time [17:12:01] RECOVERY - cp21 HTTPS on cp21 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 3407 bytes in 7.256 second response time [17:12:02] RECOVERY - wiki.fossbots.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.fossbots.org' will expire on Sun 16 Oct 2022 13:11:42 GMT +0000. [17:12:11] PROBLEM - puritwiki.p-e.kr - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:12:13] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [17:12:16] RECOVERY - wiki.make717.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.make717.org' will expire on Mon 22 Aug 2022 23:35:07 GMT +0000. [17:12:20] RECOVERY - cp21 Stunnel HTTP for mw122 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.022 second response time [17:12:57] RECOVERY - cp20 Stunnel HTTP for mw122 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 1.037 second response time [17:13:07] RECOVERY - gluster122 Current Load on gluster122 is OK: OK - load average: 2.75, 2.93, 3.32 [17:13:22] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [17:13:34] PROBLEM - wc.miraheze.org on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:13:36] !log reboot cp21 - seems like things are stuck [17:13:36] PROBLEM - animatedfeet.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:13:37] RECOVERY - hoodwiki.xyz - LetsEncrypt on sslhost is OK: OK - Certificate 'hoodwiki.xyz' will expire on Wed 19 Oct 2022 06:37:38 GMT +0000. [17:13:56] PROBLEM - cp20 HTTPS on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:13:58] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:14:02] PROBLEM - cp21 Stunnel HTTP for mw132 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [17:14:40] PROBLEM - cp21 Stunnel HTTP for reports121 on cp21 is CRITICAL: connect to address localhost and port 8205: Connection refusedHTTP CRITICAL - Unable to open TCP socket [17:14:48] PROBLEM - cp21 Stunnel HTTP for test131 on cp21 is CRITICAL: connect to address localhost and port 8180: Connection refusedHTTP CRITICAL - Unable to open TCP socket [17:14:49] PROBLEM - wiki.openhatch.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:14:49] PROBLEM - cp20 Stunnel HTTP for mon141 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:15:04] PROBLEM - cp20 Stunnel HTTP for mw141 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [17:15:14] PROBLEM - cp21 Stunnel HTTP for mw121 on cp21 is CRITICAL: connect to address localhost and port 8104: Connection refusedHTTP CRITICAL - Unable to open TCP socket [17:15:15] PROBLEM - cp20 Stunnel HTTP for test131 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:15:18] PROBLEM - cp21 Stunnel HTTP for mail121 on cp21 is CRITICAL: connect to address localhost and port 8200: Connection refusedHTTP CRITICAL - Unable to open TCP socket [17:15:20] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 0.60, 0.32, 0.12 [17:15:32] RECOVERY - wc.miraheze.org on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [17:16:02] RECOVERY - cp20 HTTPS on cp20 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 3406 bytes in 7.233 second response time [17:16:05] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::1b80/cpweb [17:16:06] PROBLEM - cp21 HTTPS on cp21 is CRITICAL: HTTP CRITICAL: HTTP/1.1 503 Backend fetch failed - 6116 bytes in 0.019 second response time [17:16:14] RECOVERY - cp21 Stunnel HTTP for puppet111 on cp21 is OK: HTTP OK: Status line output matched "403" - 289 bytes in 1.011 second response time [17:16:29] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 16.54, 14.06, 10.86 [17:16:51] RECOVERY - cp21 Stunnel HTTP for test131 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15940 bytes in 7.288 second response time [17:16:58] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 5.18, 8.92, 11.82 [17:17:07] RECOVERY - cp21 Stunnel HTTP for reports121 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 10996 bytes in 0.047 second response time [17:17:14] RECOVERY - cp21 Stunnel HTTP for mail121 on cp21 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 427 bytes in 0.016 second response time [17:17:18] RECOVERY - cp20 Stunnel HTTP for test131 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15954 bytes in 3.057 second response time [17:17:33] RECOVERY - cp20 Stunnel HTTP for mw141 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.016 second response time [17:17:43] PROBLEM - cp21 HTTP 4xx/5xx ERROR Rate on cp21 is CRITICAL: CRITICAL - NGINX Error Rate is 87% [17:20:47] RECOVERY - sharqedia.ml - LetsEncrypt on sslhost is OK: OK - Certificate 'sharqedia.ml' will expire on Mon 03 Oct 2022 13:40:45 GMT +0000. [17:20:50] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 6.51, 9.26, 9.59 [17:20:54] RECOVERY - cp20 Stunnel HTTP for mon141 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 39170 bytes in 5.090 second response time [17:21:10] RECOVERY - cp21 Stunnel HTTP for mw132 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 0.017 second response time [17:22:21] RECOVERY - cp21 HTTP 4xx/5xx ERROR Rate on cp21 is OK: OK - NGINX Error Rate is 10% [17:22:38] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.16, 2.04, 1.79 [17:22:55] RECOVERY - cp21 HTTPS on cp21 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 3386 bytes in 7.342 second response time [17:23:01] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [17:23:06] PROBLEM - mediawiki.ecfin.eu - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:23:16] PROBLEM - sims.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:23:20] RECOVERY - cp21 Stunnel HTTP for mw121 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 4.085 second response time [17:23:29] PROBLEM - cp20 HTTPS on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:23:35] PROBLEM - grc.repository.archiopedia.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:23:57] PROBLEM - cp20 Stunnel HTTP for mw121 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:23:59] PROBLEM - houkai2.cyou - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:24:38] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.54, 1.73, 1.70 [17:24:46] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.84, 9.17, 10.58 [17:24:50] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 15.32, 12.93, 10.99 [17:24:51] PROBLEM - cp21 Stunnel HTTP for matomo131 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [17:25:02] PROBLEM - cp20 Stunnel HTTP for mw132 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [17:25:13] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CRITICAL - load average: 2.08, 1.34, 0.62 [17:25:30] RECOVERY - cp20 HTTPS on cp20 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 3406 bytes in 7.147 second response time [17:26:01] RECOVERY - sarovia.graalmilitary.com - LetsEncrypt on sslhost is OK: OK - Certificate 'sarovia.graalmilitary.com' will expire on Tue 25 Oct 2022 07:05:18 GMT +0000. [17:26:38] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.60, 1.32, 1.55 [17:27:01] PROBLEM - pmwiki.cubestudios.xyz - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:27:02] RECOVERY - cp21 Stunnel HTTP for matomo131 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 99061 bytes in 1.180 second response time [17:27:12] PROBLEM - wiki.puucraft.net - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:27:20] PROBLEM - cp20 SSH on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:27:23] PROBLEM - bluearchive.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:27:24] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 1.45, 1.50, 0.79 [17:27:27] RECOVERY - cp20 Stunnel HTTP for mw132 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 0.029 second response time [17:27:52] PROBLEM - cp21 Stunnel HTTP for mwtask141 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:28:10] PROBLEM - www.polandballwiki.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:28:42] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.03, 10.27, 10.81 [17:28:55] RECOVERY - cp20 Stunnel HTTP for mw121 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 1.030 second response time [17:29:21] RECOVERY - cp20 SSH on cp20 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [17:29:33] PROBLEM - data.nonbinary.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:29:51] PROBLEM - tep.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:29:54] PROBLEM - patternarchive.online - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:30:01] RECOVERY - cp21 Stunnel HTTP for mwtask141 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15950 bytes in 7.293 second response time [17:30:04] PROBLEM - cp21 Stunnel HTTP for mw122 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [17:30:50] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.50, 10.67, 10.61 [17:30:52] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::4c25/cpweb [17:31:04] RECOVERY - stablestate.org - LetsEncrypt on sslhost is OK: OK - Certificate 'stablestate.org' will expire on Tue 23 Aug 2022 08:41:48 GMT +0000. [17:31:35] PROBLEM - wiki.vinesh.eu.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:31:41] PROBLEM - uncyclopediakr.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:31:49] backimend error! [17:31:51] PROBLEM - test3.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:32:01] [02mw-config] 07AgentIsai opened pull request 03#4843: Add ContactPage configuration for Meta - 13https://github.com/miraheze/mw-config/pull/4843 [17:32:01] [url] Page not found · GitHub · GitHub | github.com [17:32:04] RECOVERY - wiki.nowchess.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.nowchess.org' will expire on Wed 24 Aug 2022 02:12:36 GMT +0000. [17:32:34] RECOVERY - nonciclopedia.org - LetsEncrypt on sslhost is OK: OK - Certificate 'nonciclopedia.org' will expire on Wed 24 Aug 2022 04:38:47 GMT +0000. [17:32:39] PROBLEM - swests.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:32:43] PROBLEM - civclassic.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:33:02] RECOVERY - wiki.scpsharp.ga - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.scpsharp.ga' will expire on Wed 31 Aug 2022 20:42:39 GMT +0000. [17:33:30] miraheze/mw-config - AgentIsai the build passed. [17:34:07] PROBLEM - cp21 Stunnel HTTP for phab121 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [17:34:19] PROBLEM - cp20 PowerDNS Recursor on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [17:34:25] PROBLEM - cp20 Stunnel HTTP for mw122 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [17:34:33] RECOVERY - heavyironmodding.org - LetsEncrypt on sslhost is OK: OK - Certificate 'heavyironmodding.org' will expire on Fri 30 Sep 2022 17:38:06 GMT +0000. [17:34:43] @Agent will merge the PR :) please also check DMS when around [17:34:47] PROBLEM - cp21 Stunnel HTTP for puppet141 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:34:50] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.21, 9.27, 10.10 [17:35:03] PROBLEM - cp21 Stunnel HTTP for mw132 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [17:35:27] [discord] Reception123: Thanks, am checking [17:35:44] CosmicAlpha: if around mind quickly having a look too? [17:35:47] just in case I missed something [17:36:17] PROBLEM - cp21 SSH on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:36:17] RECOVERY - cp20 PowerDNS Recursor on cp20 is OK: DNS OK: 0.062 seconds response time. miraheze.org returns 149.56.140.43,149.56.141.75,2607:5300:201:3100::5ebc,2607:5300:201:3100::929a [17:36:20] RECOVERY - cp20 Stunnel HTTP for mw122 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.019 second response time [17:36:22] RECOVERY - cp21 Stunnel HTTP for mw122 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 1.172 second response time [17:36:28] PROBLEM - cp20 Stunnel HTTP for puppet141 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:36:37] RECOVERY - cp21 Stunnel HTTP for phab121 on cp21 is OK: HTTP OK: Status line output matched "500" - 2855 bytes in 0.101 second response time [17:36:42] RECOVERY - cp21 Stunnel HTTP for puppet141 on cp21 is OK: HTTP OK: Status line output matched "403" - 289 bytes in 0.011 second response time [17:36:48] RECOVERY - wikimas.kr - LetsEncrypt on sslhost is OK: OK - Certificate 'wikimas.kr' will expire on Tue 23 Aug 2022 13:01:24 GMT +0000. [17:36:50] RECOVERY - ambient.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'ambient.wiki' will expire on Mon 10 Oct 2022 05:15:24 GMT +0000. [17:36:59] RECOVERY - cp21 Stunnel HTTP for mw132 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.019 second response time [17:37:26] PROBLEM - cp21 Stunnel HTTP for test131 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [17:38:05] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.86, 3.20, 3.94 [17:38:16] RECOVERY - cp21 SSH on cp21 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [17:38:35] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.44, 9.18, 10.09 [17:38:36] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.05, 1.95, 1.73 [17:39:04] RECOVERY - wiki.worldsofweary.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.worldsofweary.com' will expire on Sat 17 Sep 2022 21:51:04 GMT +0000. [17:39:59] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.39, 3.38, 3.90 [17:40:00] PROBLEM - cp20 HTTPS on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:40:06] RECOVERY - wiki.qadrishattari.xyz - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.qadrishattari.xyz' will expire on Sat 01 Oct 2022 16:09:21 GMT +0000. [17:40:50] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 22.84, 15.23, 11.97 [17:41:09] RECOVERY - cp20 Stunnel HTTP for puppet141 on cp20 is OK: HTTP OK: Status line output matched "403" - 289 bytes in 0.010 second response time [17:42:11] PROBLEM - betaheze.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'betaheze.org' expires in 15 day(s) (Fri 19 Aug 2022 17:58:05 GMT +0000). [17:42:24] RECOVERY - cp21 Stunnel HTTP for test131 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15954 bytes in 1.036 second response time [17:42:24] RECOVERY - animatedfeet.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [17:42:30] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 17.33, 15.07, 12.35 [17:43:47] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.57, 3.59, 3.89 [17:43:48] PROBLEM - cp21 HTTPS on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:43:56] PROBLEM - cp20 SSH on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:44:06] RECOVERY - cp20 HTTPS on cp20 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 3406 bytes in 7.138 second response time [17:44:36] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.54, 1.93, 1.82 [17:44:58] PROBLEM - cp20 Stunnel HTTP for phab121 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [17:45:25] PROBLEM - cp20 Stunnel HTTP for mw141 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:45:37] PROBLEM - cp20 Stunnel HTTP for test131 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [17:45:47] RECOVERY - cp21 HTTPS on cp21 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 3401 bytes in 1.030 second response time [17:45:56] PROBLEM - correypedia.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:47:10] RECOVERY - cp20 Stunnel HTTP for phab121 on cp20 is OK: HTTP OK: Status line output matched "500" - 2855 bytes in 5.137 second response time [17:47:21] RECOVERY - cp20 Stunnel HTTP for mw141 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 2.045 second response time [17:47:36] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 8.02, 4.89, 4.28 [17:47:41] RECOVERY - cp20 Stunnel HTTP for test131 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15954 bytes in 1.030 second response time [17:47:46] PROBLEM - cp20 Stunnel HTTP for mw122 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:48:11] RECOVERY - cp20 SSH on cp20 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [17:49:43] RECOVERY - cp20 Stunnel HTTP for mw122 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 1.028 second response time [17:49:49] PROBLEM - cp21 Stunnel HTTP for phab121 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [17:50:22] PROBLEM - cp20 Stunnel HTTP for mwtask141 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [17:50:24] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.02, 10.85, 11.63 [17:50:35] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.77, 2.11, 1.91 [17:50:50] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.48, 10.55, 11.54 [17:51:04] PROBLEM - cp21 Stunnel HTTP for matomo131 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [17:51:26] PROBLEM - cp20 HTTPS on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:52:02] RECOVERY - cp21 Stunnel HTTP for phab121 on cp21 is OK: HTTP OK: Status line output matched "500" - 2855 bytes in 7.162 second response time [17:52:17] [02mw-config] 07Universal-Omega reviewed pull request 03#4843 commit - 13https://github.com/miraheze/mw-config/pull/4843#discussion_r938081241 [17:52:18] [url] Add ContactPage configuration for Meta by AgentIsai · Pull Request #4843 · miraheze/mw-config · GitHub | github.com [17:52:19] [02mw-config] 07Universal-Omega reviewed pull request 03#4843 commit - 13https://github.com/miraheze/mw-config/pull/4843#discussion_r938080980 [17:52:19] [url] Add ContactPage configuration for Meta by AgentIsai · Pull Request #4843 · miraheze/mw-config · GitHub | github.com [17:52:20] RECOVERY - cp20 Stunnel HTTP for mwtask141 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15956 bytes in 0.025 second response time [17:52:33] PROBLEM - cp21 Stunnel HTTP for mw141 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:52:41] PROBLEM - wikifencing.ru - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:52:50] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 21.01, 14.02, 12.65 [17:53:01] RECOVERY - mediawiki.ecfin.eu - LetsEncrypt on sslhost is OK: OK - Certificate 'mediawiki.ecfin.eu' will expire on Mon 22 Aug 2022 23:01:19 GMT +0000. [17:53:19] PROBLEM - wiki.veloren.net - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:53:20] PROBLEM - nintendo.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:53:24] [02mw-config] 07AgentIsai reviewed pull request 03#4843 commit - 13https://github.com/miraheze/mw-config/pull/4843#discussion_r938092997 [17:53:25] [url] Add ContactPage configuration for Meta by AgentIsai · Pull Request #4843 · miraheze/mw-config · GitHub | github.com [17:53:36] RECOVERY - houkai2.cyou - LetsEncrypt on sslhost is OK: OK - Certificate 'houkai2.cyou' will expire on Thu 27 Oct 2022 05:22:41 GMT +0000. [17:53:40] [02mw-config] 07AgentIsai reviewed pull request 03#4843 commit - 13https://github.com/miraheze/mw-config/pull/4843#discussion_r938093426 [17:53:40] [url] Add ContactPage configuration for Meta by AgentIsai · Pull Request #4843 · miraheze/mw-config · GitHub | github.com [17:53:51] PROBLEM - www.puzzles.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:53:59] PROBLEM - staratlaswiki.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:54:31] PROBLEM - wiki.umbranet.mandelbrotgames.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:54:34] RECOVERY - cp21 Stunnel HTTP for mw141 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 1.025 second response time [17:54:48] PROBLEM - en.omniversalis.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:55:23] [02mw-config] 07AgentIsai commented on pull request 03#4843: Add ContactPage configuration for Meta - 13https://github.com/miraheze/mw-config/pull/4843#issuecomment-1205586745 [17:55:24] [url] Add ContactPage configuration for Meta by AgentIsai · Pull Request #4843 · miraheze/mw-config · GitHub | github.com [17:55:27] RECOVERY - cp20 HTTPS on cp20 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 3406 bytes in 3.058 second response time [17:55:42] PROBLEM - www.electrowiki.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:55:44] [02mw-config] 07Universal-Omega commented on pull request 03#4843: Add ContactPage configuration for Meta - 13https://github.com/miraheze/mw-config/pull/4843#issuecomment-1205587096 [17:55:45] ... [17:55:57] PROBLEM - wiki.yumeka.icu - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:56:02] RECOVERY - cp21 Stunnel HTTP for matomo131 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 99061 bytes in 0.152 second response time [17:56:06] RECOVERY - dc.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [17:56:15] RECOVERY - bluearchive.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'bluearchive.wiki' will expire on Mon 22 Aug 2022 15:22:46 GMT +0000. [17:56:17] RECOVERY - wiki.puucraft.net - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.puucraft.net' will expire on Wed 26 Oct 2022 16:57:15 GMT +0000. [17:56:28] PROBLEM - mazakwiki.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:56:29] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [17:56:30] PROBLEM - infectowiki.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:56:34] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.49, 2.00, 1.95 [17:56:43] PROBLEM - staff.polandballwiki.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:57:20] PROBLEM - www.mwcosmos.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:57:24] PROBLEM - cp21 NTP time on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [17:57:29] PROBLEM - publictestwiki.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:57:36] RECOVERY - www.polandballwiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'www.polandballwiki.com' will expire on Thu 29 Sep 2022 08:52:53 GMT +0000. [17:57:36] PROBLEM - wiki.cdntennis.ca - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:57:44] [02mw-config] 07AgentIsai commented on pull request 03#4843: Add ContactPage configuration for Meta - 13https://github.com/miraheze/mw-config/pull/4843#issuecomment-1205590326 [17:57:44] ... [17:57:46] PROBLEM - wiki.thehall.xyz - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:58:09] [02mw-config] 07Universal-Omega commented on pull request 03#4843: Add ContactPage configuration for Meta - 13https://github.com/miraheze/mw-config/pull/4843#issuecomment-1205590762 [17:58:10] ... [17:58:18] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 15.89, 10.68, 10.85 [17:58:30] PROBLEM - files.pornwiki.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:58:34] [02mw-config] 07Universal-Omega commented on pull request 03#4843: Add ContactPage configuration for Meta - 13https://github.com/miraheze/mw-config/pull/4843#issuecomment-1205591179 [17:59:02] RECOVERY - journeytheword.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'www.journeytheword.wiki' will expire on Wed 31 Aug 2022 18:13:33 GMT +0000. [17:59:07] RECOVERY - patternarchive.online - LetsEncrypt on sslhost is OK: OK - Certificate 'patternarchive.online' will expire on Sat 17 Sep 2022 18:49:33 GMT +0000. [17:59:07] PROBLEM - wiki.cjgh.xyz - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:59:11] RECOVERY - data.nonbinary.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'data.nonbinary.wiki' will expire on Mon 22 Aug 2022 23:00:39 GMT +0000. [17:59:34] RECOVERY - cp21 NTP time on cp21 is OK: NTP OK: Offset -0.0003405213356 secs [17:59:55] PROBLEM - ballmedia.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:59:59] PROBLEM - cp21 Puppet on cp21 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [18:00:04] PROBLEM - cp20 Stunnel HTTP for mw122 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [18:00:16] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.95, 11.64, 11.22 [18:00:21] RECOVERY - test3.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [18:00:21] PROBLEM - evil.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:00:32] [02mw-config] 07Universal-Omega commented on pull request 03#4843: Add ContactPage configuration for Meta - 13https://github.com/miraheze/mw-config/pull/4843#issuecomment-1205593241 [18:00:33] [url] Add ContactPage configuration for Meta by AgentIsai · Pull Request #4843 · miraheze/mw-config · GitHub | github.com [18:00:40] PROBLEM - cp20 SSH on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:00:47] PROBLEM - m.miraheze.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:00:48] RECOVERY - otogebase.com - LetsEncrypt on sslhost is OK: OK - Certificate 'otogebase.com' will expire on Mon 12 Sep 2022 09:53:37 GMT +0000. [18:00:50] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 7.00, 10.52, 11.93 [18:00:53] PROBLEM - miraheze.ml - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:01:02] RECOVERY - wiki.vinesh.eu.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.vinesh.eu.org' will expire on Sat 17 Sep 2022 22:28:24 GMT +0000. [18:01:35] PROBLEM - smashloop.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:01:36] PROBLEM - commonswiki.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:01:47] PROBLEM - webkinzguide.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:02:01] RECOVERY - cp20 Stunnel HTTP for mw122 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 1.044 second response time [18:02:23] PROBLEM - wiki.eversd.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:02:28] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::4c25/cpweb [18:02:32] [02mw-config] 07AgentIsai commented on pull request 03#4843: Add ContactPage configuration for Meta - 13https://github.com/miraheze/mw-config/pull/4843#issuecomment-1205595403 [18:02:33] [url] Add ContactPage configuration for Meta by AgentIsai · Pull Request #4843 · miraheze/mw-config · GitHub | github.com [18:02:40] RECOVERY - cp20 SSH on cp20 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [18:02:44] RECOVERY - m.miraheze.org - LetsEncrypt on sslhost is OK: OK - Certificate 'm.miraheze.org' will expire on Tue 06 Sep 2022 21:18:17 GMT +0000. [18:03:54] PROBLEM - wiki.digitaldesignhq.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:04:01] [02mw-config] 07Universal-Omega commented on pull request 03#4843: Add ContactPage configuration for Meta - 13https://github.com/miraheze/mw-config/pull/4843#issuecomment-1205596910 [18:04:13] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 17.99, 12.04, 11.26 [18:04:23] PROBLEM - cp21 Stunnel HTTP for phab121 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [18:04:35] PROBLEM - wiki.potabi.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:05:32] PROBLEM - wiki.zergmafia.top - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:06:27] PROBLEM - cp20 Stunnel HTTP for mw122 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:06:33] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.43, 1.55, 1.70 [18:06:36] PROBLEM - cp21 HTTPS on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:06:45] RECOVERY - cp21 Stunnel HTTP for phab121 on cp21 is OK: HTTP OK: Status line output matched "500" - 2855 bytes in 7.201 second response time [18:07:02] PROBLEM - rare.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:07:31] RECOVERY - pornwiki.org - LetsEncrypt on sslhost is OK: OK - Certificate 'pornwiki.org' will expire on Sat 17 Sep 2022 18:32:03 GMT +0000. [18:07:57] PROBLEM - cp20 NTP time on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [18:08:35] RECOVERY - cp21 HTTPS on cp21 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 3402 bytes in 1.022 second response time [18:08:50] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 5.32, 7.46, 9.95 [18:08:53] RECOVERY - cp20 Stunnel HTTP for mw122 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 0.024 second response time [18:10:22] [02miraheze/ssl] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/f393374e3f66...4d5768186a26 [18:10:23] [url] Comparing f393374e3f66...4d5768186a26 · miraheze/ssl · GitHub | github.com [18:10:24] [02miraheze/ssl] 07Universal-Omega 034d57681 - Add yokaiwatchwiki redirect per T9623 [18:10:28] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [18:10:33] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.58, 1.69, 1.74 [18:10:36] RECOVERY - puritwiki.p-e.kr - LetsEncrypt on sslhost is OK: OK - Certificate 'puritwiki.p-e.kr' will expire on Thu 29 Sep 2022 02:01:07 GMT +0000. [18:10:45] PROBLEM - pt.graalmilitary.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:11:02] PROBLEM - www.mh142.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:11:10] PROBLEM - cp21 Stunnel HTTP for reports121 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [18:12:04] PROBLEM - en.pornwiki.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:12:05] PROBLEM - wiki.harlonserver.net - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:12:13] PROBLEM - betaheze.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:12:14] PROBLEM - cp20 SSH on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:12:25] PROBLEM - sdiy.info - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:12:32] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.98, 1.45, 1.64 [18:12:35] PROBLEM - www.sdiy.info - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:12:36] PROBLEM - www.proficientprofit.click - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:12:47] PROBLEM - wiki.parappa.dev - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:12:52] PROBLEM - source.erag.eu.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:12:54] RECOVERY - cp20 NTP time on cp20 is OK: NTP OK: Offset -0.000616312027 secs [18:13:07] RECOVERY - cp21 Stunnel HTTP for reports121 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 10996 bytes in 1.056 second response time [18:13:19] PROBLEM - cp21 Disk Space on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [18:13:39] RECOVERY - wiki.openhatch.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.openhatch.org' will expire on Tue 23 Aug 2022 09:22:30 GMT +0000. [18:13:45] PROBLEM - aresrocket.ml - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:14:13] RECOVERY - cp20 SSH on cp20 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [18:14:28] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::4c25/cpweb [18:14:33] RECOVERY - correypedia.org - LetsEncrypt on sslhost is OK: OK - Certificate 'correypedia.org' will expire on Thu 01 Sep 2022 00:41:01 GMT +0000. [18:14:50] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.67, 9.81, 10.02 [18:14:54] PROBLEM - cp21 Stunnel HTTP for mw122 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [18:14:57] PROBLEM - cp20 HTTPS on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:15:11] PROBLEM - wiki.villagecollaborative.net - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:15:16] RECOVERY - cp21 Disk Space on cp21 is OK: DISK OK - free space: / 8742 MB (22% inode=96%); [18:16:45] PROBLEM - wiki.elgeis.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:16:50] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.26, 9.85, 10.01 [18:16:55] PROBLEM - m.miraheze.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:16:57] PROBLEM - cp20 PowerDNS Recursor on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [18:17:17] [02mw-config] 07AgentIsai synchronize pull request 03#4843: Add ContactPage configuration for Meta - 13https://github.com/miraheze/mw-config/pull/4843 [18:17:18] [url] Page not found · GitHub · GitHub | github.com [18:17:23] PROBLEM - cp21 Stunnel HTTP for mw141 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [18:17:53] PROBLEM - cp20 Stunnel HTTP for mw122 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [18:18:22] miraheze/mw-config - AgentIsai the build passed. [18:18:28] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [18:18:50] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 6.58, 8.85, 9.64 [18:18:52] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 1.88, 1.72, 1.28 [18:18:58] RECOVERY - cp20 HTTPS on cp20 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 3406 bytes in 3.040 second response time [18:19:07] RECOVERY - cp20 PowerDNS Recursor on cp20 is OK: DNS OK: 0.171 seconds response time. miraheze.org returns 198.244.148.90,2001:41d0:801:2000::1b80,2001:41d0:801:2000::4c25,51.195.220.68 [18:19:39] PROBLEM - cp21 Stunnel HTTP for mwtask141 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [18:19:56] RECOVERY - cp21 Stunnel HTTP for mw141 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 3.052 second response time [18:20:02] RECOVERY - cp20 Stunnel HTTP for mw122 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 8.134 second response time [18:20:21] PROBLEM - guia.esporo.net - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:20:46] PROBLEM - cp21 Stunnel HTTP for mw121 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [18:20:46] PROBLEM - test131 Current Load on test131 is CRITICAL: CRITICAL - load average: 2.26, 1.89, 1.39 [18:20:53] RECOVERY - m.miraheze.org - LetsEncrypt on sslhost is OK: OK - Certificate 'm.miraheze.org' will expire on Tue 06 Sep 2022 21:18:17 GMT +0000. [18:21:37] RECOVERY - cp21 Stunnel HTTP for mwtask141 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15942 bytes in 0.019 second response time [18:21:56] RECOVERY - wikifencing.ru - LetsEncrypt on sslhost is OK: OK - Certificate 'wikifencing.ru' will expire on Tue 06 Sep 2022 20:55:14 GMT +0000. [18:24:33] RECOVERY - wiki.yumeka.icu - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.yumeka.icu' will expire on Sat 17 Sep 2022 18:24:18 GMT +0000. [18:24:38] RECOVERY - grc.repository.archiopedia.org - LetsEncrypt on sslhost is OK: OK - Certificate 'grc.repository.archiopedia.org' will expire on Sat 17 Sep 2022 19:06:52 GMT +0000. [18:24:39] RECOVERY - cp21 Stunnel HTTP for mw121 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 5.052 second response time [18:24:43] PROBLEM - vault.agentisai.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:24:44] RECOVERY - www.electrowiki.org - LetsEncrypt on sslhost is OK: OK - Certificate 'electrowiki.org' will expire on Sat 17 Sep 2022 19:15:15 GMT +0000. [18:24:51] RECOVERY - staratlaswiki.org - LetsEncrypt on sslhost is OK: OK - Certificate 'staratlaswiki.org' will expire on Mon 19 Sep 2022 03:34:09 GMT +0000. [18:24:56] RECOVERY - wiki.thesimswiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'www.thesimswiki.com' will expire on Wed 24 Aug 2022 01:38:48 GMT +0000. [18:25:02] RECOVERY - infectowiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'infectowiki.com' will expire on Tue 23 Aug 2022 08:27:35 GMT +0000. [18:25:03] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 1.60, 1.77, 1.47 [18:25:07] RECOVERY - nintendo.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [18:25:17] RECOVERY - wiki.umbranet.mandelbrotgames.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.umbranet.mandelbrotgames.com' will expire on Sun 02 Oct 2022 11:07:49 GMT +0000. [18:26:19] RECOVERY - mazakwiki.org - LetsEncrypt on sslhost is OK: OK - Certificate 'mazakwiki.org' will expire on Wed 26 Oct 2022 18:25:25 GMT +0000. [18:26:24] PROBLEM - wiki.shaazzz.ir - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:26:36] RECOVERY - wiki.cdntennis.ca - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.cdntennis.ca' will expire on Tue 23 Aug 2022 02:44:14 GMT +0000. [18:26:42] PROBLEM - equestripedia.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:26:47] RECOVERY - pmwiki.cubestudios.xyz - LetsEncrypt on sslhost is OK: OK - Certificate 'pmwiki.cubestudios.xyz' will expire on Mon 03 Oct 2022 20:32:38 GMT +0000. [18:27:05] RECOVERY - cp21 Stunnel HTTP for mw122 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 2.071 second response time [18:27:09] RECOVERY - files.pornwiki.org - LetsEncrypt on sslhost is OK: OK - Certificate 'files.pornwiki.org' will expire on Sat 17 Sep 2022 19:10:31 GMT +0000. [18:27:12] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 2 datacenters are down: 2001:41d0:801:2000::4c25/cpweb, 2001:41d0:801:2000::1b80/cpweb [18:27:14] RECOVERY - wiki.thehall.xyz - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.thehall.xyz' will expire on Tue 23 Aug 2022 08:50:07 GMT +0000. [18:27:29] PROBLEM - cp20 ferm_active on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [18:27:34] RECOVERY - tep.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'tep.wiki' will expire on Tue 23 Aug 2022 08:40:10 GMT +0000. [18:27:49] PROBLEM - dc.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:28:51] PROBLEM - cp21 Stunnel HTTP for test131 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [18:28:55] RECOVERY - uncyclopediakr.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [18:29:01] RECOVERY - wiki.cjgh.xyz - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.cjgh.xyz' will expire on Mon 03 Oct 2022 20:57:39 GMT +0000. [18:29:21] PROBLEM - cp21 HTTPS on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:29:40] RECOVERY - ballmedia.org - LetsEncrypt on sslhost is OK: OK - Certificate 'ballmedia.org' will expire on Mon 10 Oct 2022 05:56:45 GMT +0000. [18:29:42] RECOVERY - evil.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'evil.wiki' will expire on Sun 23 Oct 2022 21:23:17 GMT +0000. [18:29:55] RECOVERY - miraheze.ml - LetsEncrypt on sslhost is OK: OK - Certificate 'miraheze.ml' will expire on Tue 23 Aug 2022 02:37:13 GMT +0000. [18:29:56] RECOVERY - cp20 ferm_active on cp20 is OK: OK ferm input default policy is set [18:30:19] RECOVERY - cp21 Puppet on cp21 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [18:30:21] RECOVERY - civclassic.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [18:30:38] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.66, 1.93, 1.70 [18:30:54] RECOVERY - cp21 Stunnel HTTP for test131 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15954 bytes in 7.278 second response time [18:30:58] RECOVERY - arrieretoile.fr - LetsEncrypt on sslhost is OK: OK - Certificate 'arrieretoile.fr' will expire on Thu 13 Oct 2022 04:37:30 GMT +0000. [18:31:03] PROBLEM - iol.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:31:11] RECOVERY - wiki.eversd.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.eversd.com' will expire on Thu 29 Sep 2022 08:32:27 GMT +0000. [18:31:11] RECOVERY - commonswiki.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [18:31:18] RECOVERY - cp21 HTTPS on cp21 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 3402 bytes in 0.018 second response time [18:31:45] RECOVERY - swests.org - LetsEncrypt on sslhost is OK: OK - Certificate 'swests.org' will expire on Thu 20 Oct 2022 03:33:41 GMT +0000. [18:32:32] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.04, 2.14, 1.81 [18:32:47] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.01, 9.30, 8.74 [18:32:55] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.25, 10.33, 11.93 [18:33:25] PROBLEM - cp21 Stunnel HTTP for mw142 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [18:33:39] PROBLEM - www.project-patterns.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:33:53] RECOVERY - wiki.potabi.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.potabi.com' will expire on Mon 10 Oct 2022 06:24:27 GMT +0000. [18:34:09] RECOVERY - wiki.zergmafia.top - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.zergmafia.top' will expire on Tue 06 Sep 2022 20:57:49 GMT +0000. [18:34:26] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.65, 1.96, 1.78 [18:34:42] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 6.97, 8.40, 8.48 [18:34:58] PROBLEM - cp21 Stunnel HTTP for mail121 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [18:35:00] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 1.20, 1.58, 1.57 [18:35:12] PROBLEM - christipedia.nl - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:35:30] PROBLEM - cp20 Stunnel HTTP for mw131 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:35:31] RECOVERY - cp21 Stunnel HTTP for mw142 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.017 second response time [18:35:35] RECOVERY - rare.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [18:36:54] RECOVERY - cp21 Stunnel HTTP for mail121 on cp21 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 427 bytes in 0.105 second response time [18:38:12] PROBLEM - cp21 Stunnel HTTP for phab121 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [18:39:41] RECOVERY - www.mh142.com - LetsEncrypt on sslhost is OK: OK - Certificate 'mh142.com' will expire on Tue 23 Aug 2022 00:06:10 GMT +0000. [18:39:44] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 1.43, 2.33, 1.76 [18:39:56] RECOVERY - pt.graalmilitary.com - LetsEncrypt on sslhost is OK: OK - Certificate 'pt.graalmilitary.com' will expire on Sun 02 Oct 2022 10:22:40 GMT +0000. [18:40:10] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.09, 1.55, 1.66 [18:40:24] RECOVERY - cp20 Stunnel HTTP for mw131 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.015 second response time [18:40:34] PROBLEM - cp21 SSH on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:40:42] RECOVERY - wiki.harlonserver.net - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.harlonserver.net' will expire on Wed 24 Aug 2022 16:27:40 GMT +0000. [18:40:48] RECOVERY - en.pornwiki.org - LetsEncrypt on sslhost is OK: OK - Certificate 'en.pornwiki.org' will expire on Sat 17 Sep 2022 22:00:09 GMT +0000. [18:40:58] RECOVERY - sdiy.info - LetsEncrypt on sslhost is OK: OK - Certificate 'sdiy.info' will expire on Sat 17 Sep 2022 21:29:52 GMT +0000. [18:41:41] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 0.67, 1.79, 1.63 [18:42:07] PROBLEM - betaheze.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'betaheze.org' expires in 14 day(s) (Fri 19 Aug 2022 17:58:05 GMT +0000). [18:42:30] RECOVERY - cp21 SSH on cp21 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [18:42:34] RECOVERY - aresrocket.ml - LetsEncrypt on sslhost is OK: OK - Certificate 'aresrocket.ml' will expire on Fri 14 Oct 2022 05:26:01 GMT +0000. [18:42:55] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 5.01, 7.15, 9.69 [18:43:27] PROBLEM - wiki.digitalefitheid.nl - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:43:37] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.39, 1.59, 1.57 [18:43:51] PROBLEM - wiki.globasa.net - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:44:04] PROBLEM - wiki.fbpml.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:44:05] PROBLEM - wiki.mostly.vet - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:44:44] PROBLEM - gp.ct777.cf - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:44:59] PROBLEM - wiki.openhatch.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:45:32] PROBLEM - cp20 Stunnel HTTP for mw132 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [18:45:35] PROBLEM - hoodwiki.xyz - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:45:50] RECOVERY - wiki.elgeis.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.elgeis.com' will expire on Fri 02 Sep 2022 12:34:13 GMT +0000. [18:45:55] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.90, 1.98, 1.80 [18:46:19] PROBLEM - wiki.anglish.info - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:46:28] PROBLEM - m.miraheze.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:46:31] PROBLEM - wc.miraheze.org on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:46:59] PROBLEM - wiki.counterculturelabs.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:47:23] PROBLEM - wiki.beergeeks.co.il - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:47:55] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.57, 2.05, 1.84 [18:48:10] PROBLEM - cp21 Stunnel HTTP for puppet141 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:48:20] PROBLEM - cp20 Stunnel HTTP for phab121 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [18:48:45] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [18:49:10] RECOVERY - cp21 Stunnel HTTP for phab121 on cp21 is OK: HTTP OK: Status line output matched "500" - 2855 bytes in 0.083 second response time [18:49:55] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.53, 1.80, 1.77 [18:50:14] PROBLEM - cp20 Stunnel HTTP for matomo131 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:50:24] RECOVERY - cp20 Stunnel HTTP for mw132 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.015 second response time [18:50:26] RECOVERY - cp21 Stunnel HTTP for puppet141 on cp21 is OK: HTTP OK: Status line output matched "403" - 289 bytes in 1.015 second response time [18:50:33] PROBLEM - cp21 Stunnel HTTP for mw131 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [18:50:50] RECOVERY - cp20 Stunnel HTTP for phab121 on cp20 is OK: HTTP OK: Status line output matched "500" - 2855 bytes in 3.099 second response time [18:51:06] PROBLEM - cp21 Stunnel HTTP for mwtask141 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:51:13] RECOVERY - wiki.veloren.net - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.veloren.net' will expire on Sat 15 Oct 2022 15:52:05 GMT +0000. [18:51:55] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.01, 1.54, 1.68 [18:52:13] PROBLEM - zenith.nsmbu.net - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:52:19] PROBLEM - roblox-wiki.tk - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:52:37] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 1.61, 3.10, 3.99 [18:52:38] PROBLEM - cp21 NTP time on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [18:52:43] RECOVERY - cp21 Stunnel HTTP for mw131 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.018 second response time [18:53:40] RECOVERY - en.omniversalis.org - LetsEncrypt on sslhost is OK: OK - Certificate 'en.omniversalis.org' will expire on Wed 26 Oct 2022 20:54:04 GMT +0000. [18:54:18] PROBLEM - cp20 Stunnel HTTP for mwtask141 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [18:54:42] PROBLEM - cp21 Stunnel HTTP for mw132 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [18:54:49] RECOVERY - wc.miraheze.org on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [18:54:52] RECOVERY - cp21 NTP time on cp21 is OK: NTP OK: Offset 0.000657081604 secs [18:55:55] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.93, 1.82, 1.78 [18:55:59] PROBLEM - staratlaswiki.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:56:22] RECOVERY - cp20 Stunnel HTTP for mwtask141 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15950 bytes in 0.023 second response time [18:56:31] PROBLEM - pwsc.polandballwiki.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:56:32] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.26, 4.19, 4.20 [18:56:47] RECOVERY - dc.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [18:56:54] PROBLEM - yokaiwatch.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:57:10] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+1/-0/±0] 13https://github.com/miraheze/ImportDump/compare/f7373b7d3026...b60c2b498620 [18:57:10] [url] Comparing f7373b7d3026...b60c2b498620 · miraheze/ImportDump · GitHub | github.com [18:57:11] [02miraheze/ImportDump] 07Universal-Omega 03b60c2b4 - Create ImportDumpRequestManagerTest.php [18:57:13] [02ImportDump] 07Universal-Omega synchronize pull request 03#24: Convert DB select queries to use SelectQueryBuilder - 13https://github.com/miraheze/ImportDump/pull/24 [18:57:13] [url] Page not found · GitHub · GitHub | github.com [18:57:16] PROBLEM - cp20 Stunnel HTTP for mon141 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:57:32] PROBLEM - cp20 conntrack_table_size on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [18:57:51] PROBLEM - cp21 Stunnel HTTP for mon141 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:57:52] PROBLEM - nonbinary.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:58:10] RECOVERY - cp20 Stunnel HTTP for matomo131 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 99061 bytes in 1.178 second response time [18:58:15] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/b60c2b498620...ace57613adbf [18:58:16] [url] Comparing b60c2b498620...ace57613adbf · miraheze/ImportDump · GitHub | github.com [18:58:17] [02miraheze/ImportDump] 07Universal-Omega 03ace5761 - Update extension.json [18:58:18] [02ImportDump] 07Universal-Omega synchronize pull request 03#24: Convert DB select queries to use SelectQueryBuilder - 13https://github.com/miraheze/ImportDump/pull/24 [18:58:18] [url] Page not found · GitHub · GitHub | github.com [18:58:24] RECOVERY - cp21 Stunnel HTTP for mwtask141 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15956 bytes in 1.033 second response time [18:58:29] PROBLEM - persist.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:59:02] PROBLEM - nl.xliving.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:59:05] PROBLEM - files.pornwiki.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:59:07] PROBLEM - www.polandballwiki.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:59:16] PROBLEM - hastursnotebook.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:59:25] PROBLEM - en.gyaanipedia.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:59:28] PROBLEM - www.winenjoy.net - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:59:31] RECOVERY - cp20 conntrack_table_size on cp20 is OK: OK: nf_conntrack is 4 % full [18:59:42] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 25.23, 15.07, 10.89 [18:59:42] RECOVERY - cp20 Stunnel HTTP for mon141 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 39170 bytes in 0.039 second response time [18:59:49] RECOVERY - cp21 Stunnel HTTP for mon141 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 39185 bytes in 1.050 second response time [18:59:55] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.59, 1.81, 1.75 [19:00:08] RECOVERY - smashloop.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'smashloop.wiki' will expire on Wed 31 Aug 2022 22:13:31 GMT +0000. [19:00:18] RECOVERY - webkinzguide.com - LetsEncrypt on sslhost is OK: OK - Certificate 'webkinzguide.com' will expire on Mon 29 Aug 2022 18:06:45 GMT +0000. [19:00:20] PROBLEM - dkwiki.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:00:25] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::1b80/cpweb [19:00:42] PROBLEM - tech.teojingyao.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:00:48] PROBLEM - patternarchive.online - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:01:07] PROBLEM - wc.miraheze.org on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:01:24] miraheze/ImportDump - Universal-Omega the build has errored. [19:01:37] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.28, 11.68, 10.16 [19:01:39] RECOVERY - cp21 Stunnel HTTP for mw132 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 2.073 second response time [19:02:00] [02ImportDump] 07Universal-Omega synchronize pull request 03#24: Convert DB select queries to use SelectQueryBuilder - 13https://github.com/miraheze/ImportDump/pull/24 [19:02:00] [url] Page not found · GitHub · GitHub | github.com [19:02:00] PROBLEM - cp21 Puppet on cp21 is CRITICAL: CRITICAL: Puppet has 2 failures. Last run 3 minutes ago with 2 failures. Failed resources (up to 3 shown): File[/etc/apt/trusted.gpg.d/puppetlabs.gpg],File[/usr/local/bin/puppet-enabled] [19:02:01] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/ace57613adbf...1e36cbd03ca9 [19:02:02] [url] Comparing ace57613adbf...1e36cbd03ca9 · miraheze/ImportDump · GitHub | github.com [19:02:03] [02miraheze/ImportDump] 07Universal-Omega 031e36cbd - Syntax [19:02:12] [02ImportDump] 07Universal-Omega edited pull request 03#24: Convert DB select queries to use SelectQueryBuilder and add tests - 13https://github.com/miraheze/ImportDump/pull/24 [19:02:12] [url] Page not found · GitHub · GitHub | github.com [19:02:21] PROBLEM - cp21 Stunnel HTTP for mw142 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [19:02:25] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.52, 3.56, 3.98 [19:02:37] PROBLEM - www.project-patterns.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'project-patterns.com' expires in 14 day(s) (Fri 19 Aug 2022 17:20:05 GMT +0000). [19:03:00] PROBLEM - threedomwiki.pcast.site - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:03:30] PROBLEM - allthetropes.orain.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:03:32] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.04, 10.17, 9.77 [19:04:06] [02miraheze/ImportDump] 07github-actions[bot] pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/1e36cbd03ca9...90cf3e063654 [19:04:06] PROBLEM - cp20 Stunnel HTTP for mw131 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:04:06] PROBLEM - en.clockupwiki.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:04:06] [url] Comparing 1e36cbd03ca9...90cf3e063654 · miraheze/ImportDump · GitHub | github.com [19:04:07] [02miraheze/ImportDump] 07github-actions 0390cf3e0 - CI: lint code to MediaWiki standards [19:04:09] [02ImportDump] 07github-actions[bot] synchronize pull request 03#24: Convert DB select queries to use SelectQueryBuilder and add tests - 13https://github.com/miraheze/ImportDump/pull/24 [19:04:09] [url] Page not found · GitHub · GitHub | github.com [19:04:18] PROBLEM - nottingham.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:04:20] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [19:04:22] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 3.61, 3.91, 4.07 [19:04:33] PROBLEM - cp20 Stunnel HTTP for mw132 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [19:04:57] RECOVERY - cp21 Stunnel HTTP for mw142 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 5.041 second response time [19:05:40] PROBLEM - wiki.dereric.gq - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:06:17] PROBLEM - mcdev.grantlmul.xyz - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:06:19] miraheze/ImportDump - Universal-Omega the build has errored. [19:06:20] RECOVERY - cp20 Stunnel HTTP for mw131 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 3.088 second response time [19:06:41] PROBLEM - cp21 HTTP 4xx/5xx ERROR Rate on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [19:07:31] PROBLEM - cp20 Stunnel HTTP for matomo131 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:07:35] PROBLEM - cp20 Stunnel HTTP for mw121 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [19:07:43] PROBLEM - metroid.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:07:55] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.60, 1.90, 1.85 [19:08:02] PROBLEM - cp20 HTTPS on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:08:36] RECOVERY - cp21 HTTP 4xx/5xx ERROR Rate on cp21 is OK: OK - NGINX Error Rate is 6% [19:08:56] PROBLEM - beaconspace.unrestrictedlorefare.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:09:32] RECOVERY - cp20 Stunnel HTTP for mw121 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 3.060 second response time [19:09:34] RECOVERY - wc.miraheze.org on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [19:09:39] RECOVERY - cp20 Stunnel HTTP for mw132 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.019 second response time [19:09:42] PROBLEM - cp20 Stunnel HTTP for mon141 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [19:09:54] PROBLEM - civwiki.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:10:50] RECOVERY - wiki.parappa.dev - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.parappa.dev' will expire on Sun 18 Sep 2022 13:44:45 GMT +0000. [19:11:13] RECOVERY - m.miraheze.org - LetsEncrypt on sslhost is OK: OK - Certificate 'm.miraheze.org' will expire on Tue 06 Sep 2022 21:18:17 GMT +0000. [19:11:14] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.35, 11.07, 10.03 [19:11:25] PROBLEM - cp21 Stunnel HTTP for mw122 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [19:11:38] RECOVERY - cp20 Stunnel HTTP for matomo131 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 99069 bytes in 1.573 second response time [19:11:40] RECOVERY - cp20 Stunnel HTTP for mon141 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 39185 bytes in 3.063 second response time [19:11:46] PROBLEM - wiki.harlonserver.net - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:12:06] RECOVERY - cp20 HTTPS on cp20 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 3406 bytes in 1.031 second response time [19:12:57] RECOVERY - wiki.digitalefitheid.nl - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.digitalefitheid.nl' will expire on Wed 21 Sep 2022 08:49:04 GMT +0000. [19:13:09] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 14.41, 12.27, 10.58 [19:13:18] PROBLEM - biblestrength.net - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:13:19] RECOVERY - wiki.globasa.net - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.globasa.net' will expire on Mon 10 Oct 2022 05:36:34 GMT +0000. [19:13:23] RECOVERY - wiki.mostly.vet - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.mostly.vet' will expire on Fri 02 Sep 2022 12:38:42 GMT +0000. [19:13:27] RECOVERY - cp21 Stunnel HTTP for mw122 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.023 second response time [19:13:41] RECOVERY - gp.ct777.cf - LetsEncrypt on sslhost is OK: OK - Certificate 'gp.ct777.cf' will expire on Sat 01 Oct 2022 16:25:42 GMT +0000. [19:14:01] PROBLEM - wiki.ameristraliagov.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:14:10] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 1.58, 3.23, 3.81 [19:14:23] RECOVERY - hoodwiki.xyz - LetsEncrypt on sslhost is OK: OK - Certificate 'hoodwiki.xyz' will expire on Wed 19 Oct 2022 06:37:38 GMT +0000. [19:14:25] RECOVERY - wiki.villagecollaborative.net - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.villagecollaborative.net' will expire on Wed 24 Aug 2022 02:59:35 GMT +0000. [19:15:04] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 5.84, 10.04, 9.98 [19:15:48] RECOVERY - wiki.anglish.info - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.anglish.info' will expire on Wed 24 Aug 2022 03:18:35 GMT +0000. [19:15:55] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.33, 1.49, 1.66 [19:16:10] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::4c25/cpweb [19:16:17] [02ImportDump] 07Universal-Omega synchronize pull request 03#24: Convert DB select queries to use SelectQueryBuilder and add tests - 13https://github.com/miraheze/ImportDump/pull/24 [19:16:17] [url] Page not found · GitHub · GitHub | github.com [19:16:18] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/90cf3e063654...6baa91c984be [19:16:19] [url] Comparing 90cf3e063654...6baa91c984be · miraheze/ImportDump · GitHub | github.com [19:16:20] [02miraheze/ImportDump] 07Universal-Omega 036baa91c - Update ImportDumpRequestManagerTest.php [19:16:28] RECOVERY - wiki.beergeeks.co.il - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.beergeeks.co.il' will expire on Mon 22 Aug 2022 21:21:00 GMT +0000. [19:16:32] PROBLEM - cp21 SSH on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:16:42] RECOVERY - wiki.counterculturelabs.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.counterculturelabs.org' will expire on Wed 31 Aug 2022 18:20:36 GMT +0000. [19:16:57] PROBLEM - opendatascot.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:17:13] PROBLEM - cp21 Stunnel HTTP for mail121 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [19:18:09] RECOVERY - guia.esporo.net - LetsEncrypt on sslhost is OK: OK - Certificate 'guia.esporo.net' will expire on Tue 23 Aug 2022 02:23:57 GMT +0000. [19:18:28] RECOVERY - cp21 SSH on cp21 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [19:19:42] RECOVERY - cp21 Stunnel HTTP for mail121 on cp21 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 427 bytes in 2.051 second response time [19:19:55] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.35, 1.76, 1.72 [19:20:18] miraheze/ImportDump - Universal-Omega the build has errored. [19:20:39] RECOVERY - sims.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [19:21:18] PROBLEM - cp20 Stunnel HTTP for mon141 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:21:33] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.14, 1.87, 1.39 [19:21:56] RECOVERY - zenith.nsmbu.net - LetsEncrypt on sslhost is OK: OK - Certificate 'zenith.nsmbu.net' will expire on Mon 10 Oct 2022 05:53:48 GMT +0000. [19:21:57] RECOVERY - roblox-wiki.tk - LetsEncrypt on sslhost is OK: OK - Certificate 'roblox-wiki.tk' will expire on Thu 27 Oct 2022 15:10:45 GMT +0000. [19:22:55] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 23.06, 15.33, 11.71 [19:23:25] RECOVERY - vault.agentisai.com - LetsEncrypt on sslhost is OK: OK - Certificate 'vault.agentisai.com' will expire on Thu 29 Sep 2022 08:34:24 GMT +0000. [19:23:29] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.16, 1.65, 1.37 [19:23:49] PROBLEM - cp20 Stunnel HTTP for matomo131 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [19:23:55] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.36, 1.80, 1.76 [19:23:57] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 8.83, 5.32, 4.32 [19:24:41] RECOVERY - staratlaswiki.org - LetsEncrypt on sslhost is OK: OK - Certificate 'staratlaswiki.org' will expire on Mon 19 Sep 2022 03:34:09 GMT +0000. [19:25:03] RECOVERY - www.puzzles.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'www.puzzles.wiki' will expire on Thu 20 Oct 2022 16:22:25 GMT +0000. [19:25:13] RECOVERY - pwsc.polandballwiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'pwsc.polandballwiki.com' will expire on Sun 02 Oct 2022 10:41:20 GMT +0000. [19:25:28] RECOVERY - wiki.shaazzz.ir - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.shaazzz.ir' will expire on Tue 23 Aug 2022 09:06:44 GMT +0000. [19:25:41] RECOVERY - equestripedia.org - LetsEncrypt on sslhost is OK: OK - Certificate 'equestripedia.org' will expire on Mon 10 Oct 2022 04:58:16 GMT +0000. [19:25:46] RECOVERY - staff.polandballwiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'staff.polandballwiki.com' will expire on Sun 02 Oct 2022 10:43:17 GMT +0000. [19:25:49] PROBLEM - cp20 Stunnel HTTP for mw122 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [19:25:51] RECOVERY - cp20 Stunnel HTTP for matomo131 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 99061 bytes in 0.482 second response time [19:25:51] PROBLEM - cp21 SSH on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:25:52] RECOVERY - publictestwiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'publictestwiki.com' will expire on Tue 23 Aug 2022 00:48:11 GMT +0000. [19:25:55] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.10, 1.87, 1.78 [19:25:56] RECOVERY - cp20 Stunnel HTTP for mon141 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 39185 bytes in 5.103 second response time [19:26:17] PROBLEM - cp20 Puppet on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [19:26:25] RECOVERY - yokaiwatch.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [19:26:57] RECOVERY - nonbinary.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'nonbinary.wiki' will expire on Tue 23 Aug 2022 02:51:23 GMT +0000. [19:27:46] RECOVERY - persist.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'persist.wiki' will expire on Mon 10 Oct 2022 04:01:57 GMT +0000. [19:27:47] RECOVERY - cp21 SSH on cp21 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [19:27:49] RECOVERY - cp20 Stunnel HTTP for mw122 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.025 second response time [19:27:53] PROBLEM - cp20 SSH on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:27:59] RECOVERY - cp21 Puppet on cp21 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [19:28:05] RECOVERY - hastursnotebook.org - LetsEncrypt on sslhost is OK: OK - Certificate 'hastursnotebook.org' will expire on Fri 21 Oct 2022 06:35:33 GMT +0000. [19:28:08] RECOVERY - www.winenjoy.net - LetsEncrypt on sslhost is OK: OK - Certificate 'www.winenjoy.net' will expire on Sun 02 Oct 2022 10:20:46 GMT +0000. [19:28:29] RECOVERY - cp20 Puppet on cp20 is OK: OK: Puppet is currently enabled, last run 3 minutes ago with 0 failures [19:28:34] RECOVERY - files.pornwiki.org - LetsEncrypt on sslhost is OK: OK - Certificate 'files.pornwiki.org' will expire on Sat 17 Sep 2022 19:10:31 GMT +0000. [19:28:44] RECOVERY - www.polandballwiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'www.polandballwiki.com' will expire on Thu 29 Sep 2022 08:52:53 GMT +0000. [19:28:53] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.84, 10.03, 8.45 [19:28:53] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.84, 10.03, 8.45 [19:29:08] RECOVERY - en.gyaanipedia.com - LetsEncrypt on sslhost is OK: OK - Certificate 'en.gyaanipedia.com' will expire on Thu 08 Sep 2022 07:04:52 GMT +0000. [19:29:35] RECOVERY - dkwiki.org - LetsEncrypt on sslhost is OK: OK - Certificate 'dkwiki.org' will expire on Sat 22 Oct 2022 05:58:53 GMT +0000. [19:29:50] RECOVERY - cp20 SSH on cp20 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [19:29:54] RECOVERY - patternarchive.online - LetsEncrypt on sslhost is OK: OK - Certificate 'patternarchive.online' will expire on Sat 17 Sep 2022 18:49:33 GMT +0000. [19:29:55] RECOVERY - iol.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'iol.wiki' will expire on Thu 27 Oct 2022 14:58:25 GMT +0000. [19:30:04] RECOVERY - tech.teojingyao.com - LetsEncrypt on sslhost is OK: OK - Certificate 'tech.teojingyao.com' will expire on Sat 08 Oct 2022 04:57:57 GMT +0000. [19:30:48] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.10, 11.33, 9.14 [19:30:55] [02ImportDump] 07Universal-Omega synchronize pull request 03#24: Convert DB select queries to use SelectQueryBuilder and add tests - 13https://github.com/miraheze/ImportDump/pull/24 [19:30:56] [url] Page not found · GitHub · GitHub | github.com [19:30:57] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/6baa91c984be...118717bd77dd [19:30:57] [url] Comparing 6baa91c984be...118717bd77dd · miraheze/ImportDump · GitHub | github.com [19:30:58] [02miraheze/ImportDump] 07Universal-Omega 03118717b - Update ImportDumpRequestManagerTest.php [19:31:51] PROBLEM - cp20 Stunnel HTTP for mw131 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [19:32:06] RECOVERY - wiki.digitaldesignhq.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.digitaldesignhq.com' will expire on Thu 01 Sep 2022 00:42:40 GMT +0000. [19:32:07] PROBLEM - cp21 SSH on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:32:33] RECOVERY - threedomwiki.pcast.site - LetsEncrypt on sslhost is OK: OK - Certificate 'threedomwiki.pcast.site' will expire on Mon 22 Aug 2022 22:02:33 GMT +0000. [19:32:44] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.44, 10.07, 8.93 [19:33:20] RECOVERY - allthetropes.orain.org - LetsEncrypt on sslhost is OK: OK - Certificate 'orain.org' will expire on Wed 26 Oct 2022 18:24:04 GMT +0000. [19:33:20] RECOVERY - en.clockupwiki.org - LetsEncrypt on sslhost is OK: OK - Certificate 'en.clockupwiki.org' will expire on Sat 10 Sep 2022 21:43:05 GMT +0000. [19:34:10] RECOVERY - christipedia.nl - LetsEncrypt on sslhost is OK: OK - Certificate 'www.christipedia.nl' will expire on Sat 17 Sep 2022 18:34:21 GMT +0000. [19:34:10] RECOVERY - cp21 SSH on cp21 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [19:34:20] RECOVERY - cp20 Stunnel HTTP for mw131 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 1.038 second response time [19:34:29] RECOVERY - wiki.dereric.gq - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.dereric.gq' will expire on Sat 22 Oct 2022 22:30:02 GMT +0000. [19:34:44] PROBLEM - cp20 conntrack_table_size on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [19:35:40] PROBLEM - cp21 Stunnel HTTP for mw142 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:36:02] miraheze/ImportDump - Universal-Omega the build has errored. [19:36:07] RECOVERY - mcdev.grantlmul.xyz - LetsEncrypt on sslhost is OK: OK - Certificate 'mcdev.grantlmul.xyz' will expire on Fri 14 Oct 2022 16:18:23 GMT +0000. [19:36:57] RECOVERY - cp20 conntrack_table_size on cp20 is OK: OK: nf_conntrack is 3 % full [19:37:25] PROBLEM - cp20 Stunnel HTTP for mw141 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [19:37:39] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.04, 3.52, 3.93 [19:38:06] PROBLEM - m.miraheze.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:38:30] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.71, 12.67, 10.30 [19:38:32] RECOVERY - civwiki.org - LetsEncrypt on sslhost is OK: OK - Certificate 'civwiki.org' will expire on Sat 17 Sep 2022 21:39:52 GMT +0000. [19:38:55] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 6.39, 9.82, 11.65 [19:39:13] RECOVERY - www.proficientprofit.click - LetsEncrypt on sslhost is OK: OK - Certificate 'www.proficientprofit.click' will expire on Sat 08 Oct 2022 06:14:24 GMT +0000. [19:39:14] PROBLEM - cp20 SSH on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:39:19] PROBLEM - wiki.worlduniversityandschool.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:39:22] RECOVERY - cp20 Stunnel HTTP for mw141 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 1.028 second response time [19:39:29] PROBLEM - microworldwiki.ga - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:40:08] PROBLEM - cp21 Stunnel HTTP for mw131 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [19:40:10] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [19:40:48] RECOVERY - cp21 Stunnel HTTP for mw142 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 2.044 second response time [19:40:55] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 20.44, 13.97, 12.96 [19:41:07] RECOVERY - www.sdiy.info - LetsEncrypt on sslhost is OK: OK - Certificate 'sdiy.info' will expire on Sat 17 Sep 2022 21:29:52 GMT +0000. [19:41:09] RECOVERY - cp20 SSH on cp20 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [19:41:33] PROBLEM - wiki.tulpa.info - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:41:35] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/118717bd77dd...6b378dcef0d9 [19:41:35] [url] Comparing 118717bd77dd...6b378dcef0d9 · miraheze/ImportDump · GitHub | github.com [19:41:36] [02miraheze/ImportDump] 07Universal-Omega 036b378dc - Update ImportDumpRequestManagerTest.php [19:41:38] [02ImportDump] 07Universal-Omega synchronize pull request 03#24: Convert DB select queries to use SelectQueryBuilder and add tests - 13https://github.com/miraheze/ImportDump/pull/24 [19:41:38] [url] Page not found · GitHub · GitHub | github.com [19:41:55] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.90, 1.89, 1.98 [19:42:34] RECOVERY - cp21 Stunnel HTTP for mw131 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 0.017 second response time [19:42:53] RECOVERY - biblestrength.net - LetsEncrypt on sslhost is OK: OK - Certificate 'biblestrength.net' will expire on Wed 07 Sep 2022 18:16:09 GMT +0000. [19:43:09] PROBLEM - wiki.site97.fr - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:43:29] RECOVERY - wiki.fbpml.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.fbpml.org' will expire on Sat 01 Oct 2022 15:33:56 GMT +0000. [19:44:08] PROBLEM - wiki.ciptamedia.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:44:08] RECOVERY - m.miraheze.org - LetsEncrypt on sslhost is OK: OK - Certificate 'm.miraheze.org' will expire on Tue 06 Sep 2022 21:18:17 GMT +0000. [19:44:35] PROBLEM - www.permanentfuturelab.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:45:07] RECOVERY - wiki.openhatch.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.openhatch.org' will expire on Tue 23 Aug 2022 09:22:30 GMT +0000. [19:45:29] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 1.54, 2.61, 3.36 [19:48:06] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 6.21, 10.07, 10.45 [19:48:26] PROBLEM - m.miraheze.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:49:36] [02ImportDump] 07Universal-Omega synchronize pull request 03#24: Convert DB select queries to use SelectQueryBuilder and add tests - 13https://github.com/miraheze/ImportDump/pull/24 [19:49:36] [url] Page not found · GitHub · GitHub | github.com [19:49:37] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/6b378dcef0d9...c7543e226d43 [19:49:38] [url] Comparing 6b378dcef0d9...c7543e226d43 · miraheze/ImportDump · GitHub | github.com [19:49:39] [02miraheze/ImportDump] 07Universal-Omega 03c7543e2 - Update ImportDumpRequestManagerTest.php [19:49:52] PROBLEM - de.gyaanipedia.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:50:01] PROBLEM - wiki.misslessfighters.club - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:50:01] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 5.57, 8.48, 9.82 [19:50:30] PROBLEM - inourownwords.online - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:51:17] PROBLEM - reviews.thejoshmeister.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:51:30] PROBLEM - cp21 Stunnel HTTP for puppet141 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:51:36] [02miraheze/ImportDump] 07github-actions[bot] pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/c7543e226d43...b1e81009c191 [19:51:37] [url] Comparing c7543e226d43...b1e81009c191 · miraheze/ImportDump · GitHub | github.com [19:51:38] [02miraheze/ImportDump] 07github-actions 03b1e8100 - CI: lint code to MediaWiki standards [19:51:39] [02ImportDump] 07github-actions[bot] synchronize pull request 03#24: Convert DB select queries to use SelectQueryBuilder and add tests - 13https://github.com/miraheze/ImportDump/pull/24 [19:51:40] [url] Page not found · GitHub · GitHub | github.com [19:51:40] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [19:51:55] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.04, 1.60, 1.73 [19:52:24] PROBLEM - wiki.whentheycry.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:52:53] PROBLEM - cp21 Stunnel HTTP for mw142 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [19:52:58] PROBLEM - pubwiki.lab.co.pl - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:53:01] PROBLEM - cp20 HTTPS on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:53:10] PROBLEM - cp20 Stunnel HTTP for mw132 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [19:53:38] miraheze/ImportDump - Universal-Omega the build has errored. [19:54:10] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::1b80/cpweb [19:54:10] PROBLEM - roblox-wiki.tk - LetsEncrypt on sslhost is CRITICAL: connect to address roblox-wiki.tk and port 443: Network is unreachableHTTP CRITICAL - Unable to open TCP socket [19:54:35] RECOVERY - m.miraheze.org - LetsEncrypt on sslhost is OK: OK - Certificate 'm.miraheze.org' will expire on Tue 06 Sep 2022 21:18:17 GMT +0000. [19:55:06] RECOVERY - cp20 Stunnel HTTP for mw132 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 1.029 second response time [19:55:17] PROBLEM - portalsofphereon.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:55:55] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.59, 1.80, 1.81 [19:56:10] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [19:56:14] PROBLEM - zh.internetpedia.tk - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:56:30] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 0.50, 0.77, 0.65 [19:56:36] PROBLEM - nintendo.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:56:43] PROBLEM - wiki.apico.buzz - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:56:44] RECOVERY - cp21 Stunnel HTTP for puppet141 on cp21 is OK: HTTP OK: Status line output matched "403" - 289 bytes in 1.025 second response time [19:56:53] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 16.62, 11.54, 10.47 [19:56:55] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.36, 10.59, 11.94 [19:57:05] RECOVERY - cp20 HTTPS on cp20 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 3407 bytes in 1.029 second response time [19:57:28] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 7.05, 4.77, 3.94 [19:58:05] PROBLEM - www.zenbuddhism.info - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:58:09] PROBLEM - erawikisource.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:58:23] RECOVERY - cp21 Stunnel HTTP for mw142 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.016 second response time [19:58:25] PROBLEM - roll-of-arms.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:58:26] RECOVERY - nl.xliving.org - LetsEncrypt on sslhost is OK: OK - Certificate 'nl.xliving.org' will expire on Tue 06 Sep 2022 20:54:18 GMT +0000. [19:58:30] PROBLEM - nonbinary.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:59:06] PROBLEM - mcwiki.kirbygang.tk - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:59:09] PROBLEM - www.istpcomputing.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:59:17] PROBLEM - hastursnotebook.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:59:21] PROBLEM - cp21 Puppet on cp21 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [19:59:39] PROBLEM - tr.wikiretet.ga - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:00:21] PROBLEM - wiki.thehall.xyz - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:00:25] PROBLEM - wikien.wildterra2.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:00:34] PROBLEM - wiki.autocountsoft.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:00:42] PROBLEM - www.project-patterns.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:00:43] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 5.40, 10.06, 10.27 [20:00:44] PROBLEM - wiki.recaptime.tk - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:01:20] PROBLEM - spcodex.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:01:23] PROBLEM - miraheze.ml - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:01:26] PROBLEM - mw131 Current Load on mw131 is WARNING: WARNING - load average: 11.82, 9.22, 6.73 [20:01:28] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.46, 3.87, 3.77 [20:01:38] PROBLEM - cp21 SSH on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:01:55] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.60, 1.27, 1.59 [20:02:39] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 4.40, 8.14, 9.54 [20:03:26] PROBLEM - mw131 Current Load on mw131 is CRITICAL: CRITICAL - load average: 15.67, 11.36, 7.81 [20:03:33] RECOVERY - cp21 SSH on cp21 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [20:03:34] [02ImportDump] 07Universal-Omega synchronize pull request 03#24: Convert DB select queries to use SelectQueryBuilder and add tests - 13https://github.com/miraheze/ImportDump/pull/24 [20:03:34] [url] Page not found · GitHub · GitHub | github.com [20:03:35] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/b1e81009c191...a44f699faa85 [20:03:36] [url] Comparing b1e81009c191...a44f699faa85 · miraheze/ImportDump · GitHub | github.com [20:03:37] [02miraheze/ImportDump] 07Universal-Omega 03a44f699 - Update ImportDumpRequestManagerTest.php [20:04:34] PROBLEM - cyberlaw.ccdcoe.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:04:55] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.13, 7.88, 10.12 [20:05:41] PROBLEM - www.famedata.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:06:10] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::4c25/cpweb [20:06:29] PROBLEM - www.sidem.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:07:15] PROBLEM - cp21 Stunnel HTTP for phab121 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [20:07:28] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.82, 3.00, 3.40 [20:07:30] PROBLEM - cp21 Stunnel HTTP for mw122 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [20:07:42] miraheze/ImportDump - Universal-Omega the build has errored. [20:08:25] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 20.85, 13.40, 11.02 [20:08:37] PROBLEM - cp21 HTTP 4xx/5xx ERROR Rate on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [20:09:26] RECOVERY - mw131 Current Load on mw131 is OK: OK - load average: 5.52, 9.93, 8.69 [20:09:50] !log reboot cp20 - seems stuck [20:09:59] PROBLEM - wiki.otir.nl - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:10:01] RECOVERY - cp21 Stunnel HTTP for mw122 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 5.074 second response time [20:10:03] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:10:13] PROBLEM - cp20 Stunnel HTTP for mw131 on cp20 is CRITICAL: connect to address localhost and port 8106: Connection refusedHTTP CRITICAL - Unable to open TCP socket [20:10:35] RECOVERY - source.erag.eu.org - LetsEncrypt on sslhost is OK: OK - Certificate 'source.erag.eu.org' will expire on Sun 09 Oct 2022 13:40:55 GMT +0000. [20:10:45] PROBLEM - cp20 Stunnel HTTP for mw142 on cp20 is CRITICAL: connect to address localhost and port 8109: Connection refusedHTTP CRITICAL - Unable to open TCP socket [20:10:54] PROBLEM - cp20 Stunnel HTTP for mw141 on cp20 is CRITICAL: connect to address localhost and port 8108: Connection refusedHTTP CRITICAL - Unable to open TCP socket [20:10:55] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 16.92, 11.71, 10.77 [20:11:36] PROBLEM - m.miraheze.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:12:05] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/a44f699faa85...4b496ed8d721 [20:12:06] [url] Comparing a44f699faa85...4b496ed8d721 · miraheze/ImportDump · GitHub | github.com [20:12:07] [02miraheze/ImportDump] 07Universal-Omega 034b496ed - Update ImportDumpRequestManagerTest.php [20:12:08] [02ImportDump] 07Universal-Omega synchronize pull request 03#24: Convert DB select queries to use SelectQueryBuilder and add tests - 13https://github.com/miraheze/ImportDump/pull/24 [20:12:09] [url] Page not found · GitHub · GitHub | github.com [20:12:09] RECOVERY - cp20 Stunnel HTTP for mw131 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.019 second response time [20:12:14] RECOVERY - cp21 Stunnel HTTP for phab121 on cp21 is OK: HTTP OK: Status line output matched "500" - 2855 bytes in 0.061 second response time [20:12:15] RECOVERY - m.miraheze.org - LetsEncrypt on sslhost is OK: OK - Certificate 'm.miraheze.org' will expire on Tue 06 Sep 2022 21:18:17 GMT +0000. [20:12:16] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 7.22, 11.79, 11.02 [20:12:25] RECOVERY - cp20 Stunnel HTTP for mw141 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 1.026 second response time [20:12:29] RECOVERY - wiki.otir.nl - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.otir.nl' will expire on Fri 26 Aug 2022 04:20:05 GMT +0000. [20:12:32] RECOVERY - cp20 Stunnel HTTP for mw142 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 5.080 second response time [20:12:33] RECOVERY - cp21 HTTP 4xx/5xx ERROR Rate on cp21 is OK: OK - NGINX Error Rate is 6% [20:12:36] RECOVERY - www.sidem.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'www.sidem.wiki' will expire on Tue 23 Aug 2022 12:59:12 GMT +0000. [20:12:45] PROBLEM - cp21 Stunnel HTTP for matomo131 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [20:12:55] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.52, 10.11, 10.31 [20:13:09] RECOVERY - wiki.ameristraliagov.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.ameristraliagov.com' will expire on Thu 20 Oct 2022 03:45:43 GMT +0000. [20:13:13] PROBLEM - cp20 HTTPS on cp20 is CRITICAL: HTTP CRITICAL: HTTP/1.1 503 Backend fetch failed - 6116 bytes in 1.027 second response time [20:13:27] RECOVERY - www.permanentfuturelab.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'permanentfuturelab.wiki' will expire on Tue 23 Aug 2022 00:31:22 GMT +0000. [20:13:42] RECOVERY - wiki.ciptamedia.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.ciptamedia.org' will expire on Tue 23 Aug 2022 08:44:56 GMT +0000. [20:14:01] PROBLEM - cp20 HTTP 4xx/5xx ERROR Rate on cp20 is CRITICAL: CRITICAL - NGINX Error Rate is 94% [20:14:35] PROBLEM - cp20 Stunnel HTTP for mwtask141 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [20:14:44] RECOVERY - cp21 Stunnel HTTP for matomo131 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 99061 bytes in 3.323 second response time [20:14:55] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.39, 10.35, 10.31 [20:15:24] RECOVERY - opendatascot.org - LetsEncrypt on sslhost is OK: OK - Certificate 'opendatascot.org' will expire on Thu 01 Sep 2022 00:46:11 GMT +0000. [20:15:58] RECOVERY - cp20 HTTP 4xx/5xx ERROR Rate on cp20 is OK: OK - NGINX Error Rate is 8% [20:16:06] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 6.23, 9.10, 10.09 [20:16:19] miraheze/ImportDump - Universal-Omega the build has errored. [20:16:42] RECOVERY - cp20 Stunnel HTTP for mwtask141 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15950 bytes in 7.249 second response time [20:16:55] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 6.84, 9.06, 9.85 [20:17:09] RECOVERY - cp20 HTTPS on cp20 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 3386 bytes in 4.081 second response time [20:17:28] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.28, 3.44, 3.40 [20:18:28] PROBLEM - marinebiodiversitymatrix.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:19:10] RECOVERY - de.gyaanipedia.com - LetsEncrypt on sslhost is OK: OK - Certificate 'de.gyaanipedia.com' will expire on Thu 08 Sep 2022 06:16:04 GMT +0000. [20:19:16] RECOVERY - cp20 Varnish Backends on cp20 is OK: All 14 backends are healthy [20:19:28] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.36, 3.09, 3.28 [20:19:29] PROBLEM - cp21 Stunnel HTTP for puppet141 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [20:19:36] PROBLEM - cp21 HTTPS on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:19:41] RECOVERY - inourownwords.online - LetsEncrypt on sslhost is OK: OK - Certificate 'inourownwords.online' will expire on Fri 02 Sep 2022 12:36:55 GMT +0000. [20:19:59] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.10, 1.68, 1.24 [20:20:00] RECOVERY - wiki.misslessfighters.club - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.misslessfighters.club' will expire on Tue 23 Aug 2022 13:06:24 GMT +0000. [20:20:25] PROBLEM - cp21 Stunnel HTTP for mw131 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [20:21:33] RECOVERY - cp21 HTTPS on cp21 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 3403 bytes in 0.021 second response time [20:21:35] RECOVERY - cp21 Stunnel HTTP for puppet141 on cp21 is OK: HTTP OK: Status line output matched "403" - 289 bytes in 0.015 second response time [20:21:38] RECOVERY - wiki.whentheycry.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.whentheycry.org' will expire on Wed 24 Aug 2022 02:57:37 GMT +0000. [20:21:56] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.04, 1.43, 1.20 [20:22:20] RECOVERY - cp21 Stunnel HTTP for mw131 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.019 second response time [20:23:28] PROBLEM - cp21 Stunnel HTTP for mw122 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [20:23:53] PROBLEM - www.cgradegames.net - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'www.cgradegames.net' expires in 15 day(s) (Sat 20 Aug 2022 20:03:51 GMT +0000). [20:23:55] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.55, 2.07, 1.62 [20:24:19] RECOVERY - portalsofphereon.com - LetsEncrypt on sslhost is OK: OK - Certificate 'www.portalsofphereon.com' will expire on Sat 17 Sep 2022 20:30:32 GMT +0000. [20:24:24] PROBLEM - cp20 Varnish Backends on cp20 is CRITICAL: 1 backends are down. mw122 [20:24:32] PROBLEM - cp21 Stunnel HTTP for mw121 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [20:25:31] RECOVERY - wiki.apico.buzz - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.apico.buzz' will expire on Thu 01 Sep 2022 00:43:13 GMT +0000. [20:25:35] RECOVERY - zh.internetpedia.tk - LetsEncrypt on sslhost is OK: OK - Certificate 'zh.internetpedia.tk' will expire on Mon 22 Aug 2022 22:07:13 GMT +0000. [20:25:47] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 15.59, 11.99, 10.74 [20:26:17] RECOVERY - nintendo.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [20:26:28] RECOVERY - cp21 Stunnel HTTP for mw121 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 1.028 second response time [20:26:36] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/4d5768186a26...6a78de18ad71 [20:26:36] [url] Comparing 4d5768186a26...6a78de18ad71 · miraheze/ssl · GitHub | github.com [20:26:37] [02miraheze/ssl] 07MirahezeSSLBot 036a78de1 - Bot: Update SSL cert for www.cgradegames.net [20:27:14] RECOVERY - roll-of-arms.com - LetsEncrypt on sslhost is OK: OK - Certificate 'roll-of-arms.com' will expire on Thu 27 Oct 2022 15:02:13 GMT +0000. [20:27:22] RECOVERY - www.zenbuddhism.info - LetsEncrypt on sslhost is OK: OK - Certificate 'www.zenbuddhism.info' will expire on Sat 17 Sep 2022 20:26:18 GMT +0000. [20:27:38] RECOVERY - nonbinary.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'nonbinary.wiki' will expire on Tue 23 Aug 2022 02:51:23 GMT +0000. [20:27:57] [02ImportDump] 07Universal-Omega synchronize pull request 03#24: Convert DB select queries to use SelectQueryBuilder and add tests - 13https://github.com/miraheze/ImportDump/pull/24 [20:27:58] [url] Page not found · GitHub · GitHub | github.com [20:27:59] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/4b496ed8d721...b32bb1844747 [20:27:59] RECOVERY - erawikisource.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [20:27:59] [url] Comparing 4b496ed8d721...b32bb1844747 · miraheze/ImportDump · GitHub | github.com [20:28:00] [02miraheze/ImportDump] 07Universal-Omega 03b32bb18 - Update ImportDumpRequestManagerTest.php [20:28:08] RECOVERY - hastursnotebook.org - LetsEncrypt on sslhost is OK: OK - Certificate 'hastursnotebook.org' will expire on Fri 21 Oct 2022 06:35:33 GMT +0000. [20:28:27] RECOVERY - tr.wikiretet.ga - LetsEncrypt on sslhost is OK: OK - Certificate 'tr.wikiretet.ga' will expire on Mon 12 Sep 2022 14:49:12 GMT +0000. [20:28:27] PROBLEM - scpvncommunitywiki.xyz - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:28:34] RECOVERY - cp21 Stunnel HTTP for mw122 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.031 second response time [20:29:05] PROBLEM - m.miraheze.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:29:28] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 3.48, 4.41, 3.81 [20:29:33] PROBLEM - cp21 Stunnel HTTP for mw131 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:29:37] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.35, 11.39, 10.85 [20:29:42] RECOVERY - wikien.wildterra2.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wikien.wildterra2.com' will expire on Wed 24 Aug 2022 01:30:15 GMT +0000. [20:29:46] PROBLEM - www.project-patterns.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'project-patterns.com' expires in 14 day(s) (Fri 19 Aug 2022 17:20:05 GMT +0000). [20:29:55] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 0.92, 1.72, 1.65 [20:30:12] RECOVERY - wiki.thehall.xyz - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.thehall.xyz' will expire on Tue 23 Aug 2022 08:50:07 GMT +0000. [20:30:17] RECOVERY - wiki.recaptime.tk - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.recaptime.tk' will expire on Wed 26 Oct 2022 23:10:27 GMT +0000. [20:30:23] [02miraheze/dns] 07paladox pushed 031 commit to 03paladox-patch-3 [+0/-0/±1] 13https://github.com/miraheze/dns/commit/1303daea4684 [20:30:24] [02miraheze/dns] 07paladox 031303dae - Add db131 and db141 [20:30:26] [02dns] 07paladox created branch 03paladox-patch-3 - 13https://github.com/miraheze/dns [20:30:26] [url] Page not found · GitHub · GitHub | github.com [20:30:27] [02dns] 07paladox opened pull request 03#326: Add db131 and db141 - 13https://github.com/miraheze/dns/pull/326 [20:30:28] [url] Page not found · GitHub · GitHub | github.com [20:31:07] RECOVERY - spcodex.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'spcodex.wiki' will expire on Wed 24 Aug 2022 04:17:42 GMT +0000. [20:31:11] RECOVERY - miraheze.ml - LetsEncrypt on sslhost is OK: OK - Certificate 'miraheze.ml' will expire on Tue 23 Aug 2022 02:37:13 GMT +0000. [20:31:32] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 17.28, 13.16, 11.51 [20:31:33] PROBLEM - wiki.cjgh.xyz - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:31:41] [02dns] 07paladox closed pull request 03#326: Add db131 and db141 - 13https://github.com/miraheze/dns/pull/326 [20:31:42] [url] Page not found · GitHub · GitHub | github.com [20:31:43] [02miraheze/dns] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/dns/compare/2e73aefb8d37...824af2c25c58 [20:31:43] [url] Comparing 2e73aefb8d37...824af2c25c58 · miraheze/dns · GitHub | github.com [20:31:44] RECOVERY - cp21 Stunnel HTTP for mw131 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 1.033 second response time [20:31:44] [02miraheze/dns] 07paladox 03824af2c - Add db131 and db141 (#326) [20:31:46] [02miraheze/dns] 07paladox deleted branch 03paladox-patch-3 [20:31:47] [02dns] 07paladox deleted branch 03paladox-patch-3 - 13https://github.com/miraheze/dns [20:31:48] ... [20:31:55] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.58, 1.69, 1.64 [20:32:03] miraheze/ImportDump - Universal-Omega the build has errored. [20:32:16] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [20:32:42] PROBLEM - cp30 Stunnel HTTP for mw122 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:33:11] RECOVERY - m.miraheze.org - LetsEncrypt on sslhost is OK: OK - Certificate 'm.miraheze.org' will expire on Tue 06 Sep 2022 21:18:17 GMT +0000. [20:33:17] PROBLEM - cp20 Stunnel HTTP for mw141 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:33:37] RECOVERY - cyberlaw.ccdcoe.org - LetsEncrypt on sslhost is OK: OK - Certificate 'cyberlaw.ccdcoe.org' will expire on Tue 23 Aug 2022 03:06:24 GMT +0000. [20:33:46] PROBLEM - cp21 Stunnel HTTP for mw122 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:33:51] PROBLEM - creativecommons.id - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:34:09] PROBLEM - cp31 Stunnel HTTP for mw122 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:34:11] RECOVERY - nottingham.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'nottingham.wiki' will expire on Mon 26 Sep 2022 06:16:48 GMT +0000. [20:34:53] PROBLEM - mw122 MediaWiki Rendering on mw122 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:34:59] PROBLEM - cp20 Stunnel HTTP for mw122 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:35:34] PROBLEM - cp20 Stunnel HTTP for mw121 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:36:30] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 17.09, 15.57, 11.93 [20:37:03] RECOVERY - metroid.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [20:37:38] RECOVERY - cp20 Stunnel HTTP for mw121 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 7.131 second response time [20:37:51] RECOVERY - wiki.harlonserver.net - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.harlonserver.net' will expire on Wed 24 Aug 2022 16:27:40 GMT +0000. [20:37:54] PROBLEM - wiki.ct777.cf - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:38:48] PROBLEM - wiki.worldsofweary.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:39:07] RECOVERY - microworldwiki.ga - LetsEncrypt on sslhost is OK: OK - Certificate 'microworldwiki.ga' will expire on Mon 26 Sep 2022 05:41:37 GMT +0000. [20:39:51] PROBLEM - wc.miraheze.org on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:41:18] RECOVERY - wiki.site97.fr - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.site97.fr' will expire on Tue 18 Oct 2022 15:25:34 GMT +0000. [20:42:24] RECOVERY - cp31 Stunnel HTTP for mw122 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 1.073 second response time [20:42:40] PROBLEM - cp30 Stunnel HTTP for mw121 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:42:41] PROBLEM - mw121 MediaWiki Rendering on mw121 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:43:21] RECOVERY - cp30 Stunnel HTTP for mw122 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 8.477 second response time [20:43:30] RECOVERY - cp21 Stunnel HTTP for mw122 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 4.478 second response time [20:43:34] RECOVERY - cp20 Stunnel HTTP for mw122 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 4.226 second response time [20:43:34] [02ImportDump] 07Universal-Omega synchronize pull request 03#24: Convert DB select queries to use SelectQueryBuilder and add tests - 13https://github.com/miraheze/ImportDump/pull/24 [20:43:35] [url] Page not found · GitHub · GitHub | github.com [20:43:36] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/b32bb1844747...e0827c376d9b [20:43:36] [url] Comparing b32bb1844747...e0827c376d9b · miraheze/ImportDump · GitHub | github.com [20:43:37] [02miraheze/ImportDump] 07Universal-Omega 03e0827c3 - Update ImportDumpRequestManagerTest.php [20:43:38] PROBLEM - cp31 Stunnel HTTP for mw121 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:43:48] PROBLEM - miraheze.cf - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'miraheze.cf' expires in 15 day(s) (Sat 20 Aug 2022 20:31:27 GMT +0000). [20:43:58] RECOVERY - wc.miraheze.org on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [20:44:55] PROBLEM - cp20 Stunnel HTTP for mw121 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:45:06] RECOVERY - mw122 MediaWiki Rendering on mw122 is OK: HTTP OK: HTTP/1.1 200 OK - 29512 bytes in 0.431 second response time [20:45:17] RECOVERY - cp20 Stunnel HTTP for mw141 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 1.043 second response time [20:45:26] PROBLEM - cp21 Stunnel HTTP for mw121 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [20:45:37] PROBLEM - wiki.mcpirevival.tk - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:45:55] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.15, 1.64, 1.56 [20:47:07] RECOVERY - marinebiodiversitymatrix.org - LetsEncrypt on sslhost is OK: OK - Certificate 'marinebiodiversitymatrix.org' will expire on Wed 24 Aug 2022 01:59:18 GMT +0000. [20:47:39] miraheze/ImportDump - Universal-Omega the build has errored. [20:48:04] [02ImportDump] 07Universal-Omega synchronize pull request 03#24: Convert DB select queries to use SelectQueryBuilder and add tests - 13https://github.com/miraheze/ImportDump/pull/24 [20:48:04] [url] Page not found · GitHub · GitHub | github.com [20:48:05] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/e0827c376d9b...1502546e25c1 [20:48:06] [url] Comparing e0827c376d9b...1502546e25c1 · miraheze/ImportDump · GitHub | github.com [20:48:07] [02miraheze/ImportDump] 07Universal-Omega 031502546 - Update ImportDumpRequestManagerTest.php [20:48:25] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/6a78de18ad71...06492f00d80a [20:48:25] [url] Comparing 6a78de18ad71...06492f00d80a · miraheze/ssl · GitHub | github.com [20:48:26] [02miraheze/ssl] 07MirahezeSSLBot 0306492f0 - Bot: Update SSL cert for miraheze.cf [20:48:52] RECOVERY - mw121 MediaWiki Rendering on mw121 is OK: HTTP OK: HTTP/1.1 200 OK - 29512 bytes in 0.455 second response time [20:48:54] RECOVERY - cp30 Stunnel HTTP for mw121 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.319 second response time [20:49:19] RECOVERY - reviews.thejoshmeister.com - LetsEncrypt on sslhost is OK: OK - Certificate 'reviews.thejoshmeister.com' will expire on Thu 29 Sep 2022 08:42:34 GMT +0000. [20:49:37] RECOVERY - cp21 Stunnel HTTP for mw121 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 2.038 second response time [20:49:43] RECOVERY - cp31 Stunnel HTTP for mw121 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 1.084 second response time [20:51:28] RECOVERY - pubwiki.lab.co.pl - LetsEncrypt on sslhost is OK: OK - Certificate 'pubwiki.lab.co.pl' will expire on Tue 23 Aug 2022 08:56:40 GMT +0000. [20:52:13] [02ImportDump] 07Universal-Omega synchronize pull request 03#24: Convert DB select queries to use SelectQueryBuilder and add tests - 13https://github.com/miraheze/ImportDump/pull/24 [20:52:14] [url] Page not found · GitHub · GitHub | github.com [20:52:15] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/1502546e25c1...6bc1d8c7cd2c [20:52:15] [url] Comparing 1502546e25c1...6bc1d8c7cd2c · miraheze/ImportDump · GitHub | github.com [20:52:16] [02miraheze/ImportDump] 07Universal-Omega 036bc1d8c - Update ImportDumpRequestManagerTest.php [20:52:20] RECOVERY - cp21 Varnish Backends on cp21 is OK: All 14 backends are healthy [20:52:46] RECOVERY - cp20 Stunnel HTTP for mw121 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 1.536 second response time [20:52:55] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::4c25/cpweb [20:53:01] PROBLEM - gluster122 Current Load on gluster122 is WARNING: WARNING - load average: 3.13, 3.61, 3.05 [20:53:02] miraheze/ImportDump - Universal-Omega the build has errored. [20:53:14] RECOVERY - roblox-wiki.tk - LetsEncrypt on sslhost is OK: OK - Certificate 'roblox-wiki.tk' will expire on Thu 27 Oct 2022 15:10:45 GMT +0000. [20:53:38] RECOVERY - www.mwcosmos.com - LetsEncrypt on sslhost is OK: OK - Certificate 'mwcosmos.com' will expire on Mon 22 Aug 2022 15:03:04 GMT +0000. [20:53:59] PROBLEM - www.cgradegames.net - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:54:28] PROBLEM - infectowiki.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:55:01] PROBLEM - gluster122 Current Load on gluster122 is CRITICAL: CRITICAL - load average: 4.22, 3.68, 3.13 [20:55:55] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.31, 1.72, 1.69 [20:56:36] miraheze/ImportDump - Universal-Omega the build has errored. [20:56:39] RECOVERY - www.istpcomputing.com - LetsEncrypt on sslhost is OK: OK - Certificate 'istpcomputing.com' will expire on Tue 11 Oct 2022 04:37:06 GMT +0000. [20:56:56] RECOVERY - cp21 Puppet on cp21 is OK: OK: Puppet is currently enabled, last run 10 seconds ago with 0 failures [20:57:01] RECOVERY - gluster122 Current Load on gluster122 is OK: OK - load average: 1.92, 3.10, 2.99 [20:57:55] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.44, 1.54, 1.62 [20:58:19] RECOVERY - mcwiki.kirbygang.tk - LetsEncrypt on sslhost is OK: OK - Certificate 'mcwiki.kirbygang.tk' will expire on Wed 05 Oct 2022 22:00:10 GMT +0000. [20:58:35] PROBLEM - webkinzguide.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:58:49] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/6bc1d8c7cd2c...739830317c35 [20:58:49] [url] Comparing 6bc1d8c7cd2c...739830317c35 · miraheze/ImportDump · GitHub | github.com [20:58:50] [02miraheze/ImportDump] 07Universal-Omega 037398303 - Update ImportDumpRequestManagerTest.php [20:58:52] [02ImportDump] 07Universal-Omega synchronize pull request 03#24: Convert DB select queries to use SelectQueryBuilder and add tests - 13https://github.com/miraheze/ImportDump/pull/24 [20:58:52] [url] Page not found · GitHub · GitHub | github.com [20:58:53] PROBLEM - www.project-patterns.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:00:10] RECOVERY - wiki.autocountsoft.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.autocountsoft.com' will expire on Sun 18 Sep 2022 20:39:54 GMT +0000. [21:01:01] PROBLEM - gluster122 Current Load on gluster122 is CRITICAL: CRITICAL - load average: 4.71, 4.14, 3.46 [21:01:25] [02miraheze/ImportDump] 07github-actions[bot] pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/739830317c35...31c19e7be7b9 [21:01:26] [url] Comparing 739830317c35...31c19e7be7b9 · miraheze/ImportDump · GitHub | github.com [21:01:26] [02miraheze/ImportDump] 07github-actions 0331c19e7 - CI: lint code to MediaWiki standards [21:01:28] [02ImportDump] 07github-actions[bot] synchronize pull request 03#24: Convert DB select queries to use SelectQueryBuilder and add tests - 13https://github.com/miraheze/ImportDump/pull/24 [21:01:28] [url] Page not found · GitHub · GitHub | github.com [21:01:33] RECOVERY - wiki.cjgh.xyz - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.cjgh.xyz' will expire on Mon 03 Oct 2022 20:57:39 GMT +0000. [21:01:35] PROBLEM - cp21 Stunnel HTTP for mw121 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [21:01:55] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 3.71, 2.54, 2.00 [21:02:03] PROBLEM - arrieretoile.fr - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:02:12] PROBLEM - cp21 Varnish Backends on cp21 is CRITICAL: 1 backends are down. mw122 [21:02:23] RECOVERY - creativecommons.id - LetsEncrypt on sslhost is OK: OK - Certificate 'creativecommons.id' will expire on Thu 27 Oct 2022 05:20:13 GMT +0000. [21:02:26] PROBLEM - cp31 Stunnel HTTP for mw121 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:02:26] PROBLEM - cp30 Stunnel HTTP for mw121 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:02:53] RECOVERY - www.famedata.org - LetsEncrypt on sslhost is OK: OK - Certificate 'famedata.org' will expire on Thu 29 Sep 2022 07:42:43 GMT +0000. [21:02:55] PROBLEM - wiki.dereric.gq - LetsEncrypt on sslhost is CRITICAL: connect to address wiki.dereric.gq and port 443: Network is unreachableHTTP CRITICAL - Unable to open TCP socket [21:03:49] RECOVERY - cp21 Stunnel HTTP for mw121 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 3.477 second response time [21:04:33] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.67, 1.66, 1.22 [21:05:17] RECOVERY - beaconspace.unrestrictedlorefare.com - LetsEncrypt on sslhost is OK: OK - Certificate 'beaconspace.unrestrictedlorefare.com' will expire on Tue 23 Aug 2022 00:32:44 GMT +0000. [21:08:01] RECOVERY - cp31 Stunnel HTTP for mw121 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.312 second response time [21:08:21] RECOVERY - wiki.worlduniversityandschool.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.worlduniversityandschool.org' will expire on Tue 23 Aug 2022 07:52:18 GMT +0000. [21:08:25] RECOVERY - wiki.worldsofweary.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.worldsofweary.com' will expire on Sat 17 Sep 2022 21:51:04 GMT +0000. [21:08:29] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.06, 1.74, 1.83 [21:09:29] PROBLEM - cp20 Stunnel HTTP for mw132 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [21:09:31] miraheze/ImportDump - Universal-Omega the build passed. [21:09:51] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/31c19e7be7b9...1832f2e5a34e [21:09:51] [url] Comparing 31c19e7be7b9...1832f2e5a34e · miraheze/ImportDump · GitHub | github.com [21:09:52] [02miraheze/ImportDump] 07Universal-Omega 031832f2e - Update ImportDumpRequestManagerTest.php [21:09:54] [02ImportDump] 07Universal-Omega synchronize pull request 03#24: Convert DB select queries to use SelectQueryBuilder and add tests - 13https://github.com/miraheze/ImportDump/pull/24 [21:09:54] [url] Page not found · GitHub · GitHub | github.com [21:10:05] RECOVERY - wiki.tulpa.info - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.tulpa.info' will expire on Mon 22 Aug 2022 22:32:33 GMT +0000. [21:10:19] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.33, 1.92, 1.52 [21:10:41] RECOVERY - cp30 Stunnel HTTP for mw121 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 0.610 second response time [21:11:08] PROBLEM - cp30 Stunnel HTTP for mw122 on cp30 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 328 bytes in 6.845 second response time [21:11:14] PROBLEM - cp31 Stunnel HTTP for mw122 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:11:26] RECOVERY - cp20 Stunnel HTTP for mw132 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.024 second response time [21:11:41] PROBLEM - cp21 Stunnel HTTP for reports121 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [21:12:17] PROBLEM - mw122 MediaWiki Rendering on mw122 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:12:36] PROBLEM - cp20 Stunnel HTTP for mw122 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:12:42] PROBLEM - cp21 Stunnel HTTP for mw122 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:13:18] RECOVERY - cp31 Stunnel HTTP for mw122 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 9.642 second response time [21:13:24] RECOVERY - miraheze.cf - LetsEncrypt on sslhost is OK: OK - Certificate 'miraheze.cf' will expire on Wed 02 Nov 2022 19:48:19 GMT +0000. [21:13:49] PROBLEM - vise.dayid.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:13:53] RECOVERY - cp21 Stunnel HTTP for reports121 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 10996 bytes in 2.083 second response time [21:14:10] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [21:14:14] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/1832f2e5a34e...914b47139cf7 [21:14:14] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.40, 1.83, 1.82 [21:14:14] miraheze/ImportDump - Universal-Omega the build has errored. [21:14:15] [url] Comparing 1832f2e5a34e...914b47139cf7 · miraheze/ImportDump · GitHub | github.com [21:14:15] [02miraheze/ImportDump] 07Universal-Omega 03914b471 - Update ImportDumpRequestManagerTest.php [21:14:16] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.49, 1.28, 1.36 [21:14:17] [02ImportDump] 07Universal-Omega synchronize pull request 03#24: Convert DB select queries to use SelectQueryBuilder and add tests - 13https://github.com/miraheze/ImportDump/pull/24 [21:14:17] [url] Page not found · GitHub · GitHub | github.com [21:14:22] RECOVERY - mw122 MediaWiki Rendering on mw122 is OK: HTTP OK: HTTP/1.1 200 OK - 29513 bytes in 6.400 second response time [21:15:04] RECOVERY - wiki.mcpirevival.tk - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.mcpirevival.tk' will expire on Wed 24 Aug 2022 03:07:55 GMT +0000. [21:16:09] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.35, 1.66, 1.76 [21:16:29] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-1 [+1/-0/±0] 13https://github.com/miraheze/puppet/commit/3004efe66c60 [21:16:31] [02miraheze/puppet] 07paladox 033004efe - Install db131 and db141 [21:16:32] [02puppet] 07paladox opened pull request 03#2763: Install db131 and db141 - 13https://github.com/miraheze/puppet/pull/2763 [21:16:32] [url] Page not found · GitHub · GitHub | github.com [21:16:33] [02puppet] 07paladox created branch 03paladox-patch-1 - 13https://github.com/miraheze/puppet [21:16:34] ... [21:16:47] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-1 [+1/-0/±0] 13https://github.com/miraheze/puppet/compare/3004efe66c60...05e6015cf84c [21:16:48] [url] Comparing 3004efe66c60...05e6015cf84c · miraheze/puppet · GitHub | github.com [21:16:48] [02miraheze/puppet] 07paladox 0305e6015 - Create db141.yaml [21:16:50] [02puppet] 07paladox synchronize pull request 03#2763: Install db131 and db141 - 13https://github.com/miraheze/puppet/pull/2763 [21:16:50] [url] Page not found · GitHub · GitHub | github.com [21:16:57] PROBLEM - animefeet.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:17:05] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/05e6015cf84c...e01f763cab5d [21:17:05] [url] Comparing 05e6015cf84c...e01f763cab5d · miraheze/puppet · GitHub | github.com [21:17:06] RECOVERY - cp21 Stunnel HTTP for mw122 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 7.126 second response time [21:17:06] [02miraheze/puppet] 07paladox 03e01f763 - Update site.pp [21:17:08] [02puppet] 07paladox synchronize pull request 03#2763: Install db131 and db141 - 13https://github.com/miraheze/puppet/pull/2763 [21:17:08] [url] Page not found · GitHub · GitHub | github.com [21:17:09] RECOVERY - cp30 Stunnel HTTP for mw122 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 7.118 second response time [21:17:38] PROBLEM - cp31 Stunnel HTTP for mw122 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:18:04] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.25, 1.53, 1.70 [21:18:43] PROBLEM - mw122 MediaWiki Rendering on mw122 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:20:03] RECOVERY - cp20 Varnish Backends on cp20 is OK: All 14 backends are healthy [21:20:16] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.24, 2.31, 1.76 [21:22:37] miraheze/ImportDump - Universal-Omega the build passed. [21:23:02] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.14, 1.84, 1.68 [21:23:37] RECOVERY - cp20 Stunnel HTTP for mw122 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 4.498 second response time [21:23:44] PROBLEM - wiki.dereric.gq - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.dereric.gq could not be found [21:23:56] RECOVERY - www.cgradegames.net - LetsEncrypt on sslhost is OK: OK - Certificate 'www.cgradegames.net' will expire on Wed 02 Nov 2022 19:26:30 GMT +0000. [21:24:04] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.34, 1.79, 1.77 [21:24:09] PROBLEM - db141 ferm_active on db141 is UNKNOWN: NRPE: Unable to read output [21:24:18] PROBLEM - db141 Puppet on db141 is UNKNOWN: NRPE: Unable to read output [21:24:34] PROBLEM - db141 conntrack_table_size on db141 is UNKNOWN: NRPE: Unable to read output [21:24:40] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03master [+1/-0/±3] 13https://github.com/miraheze/ImportDump/compare/61eeea3d9cba...174a00734a1d [21:24:41] [url] Comparing 61eeea3d9cba...174a00734a1d · miraheze/ImportDump · GitHub | github.com [21:24:42] [02miraheze/ImportDump] 07Universal-Omega 03174a007 - Convert DB select queries to use SelectQueryBuilder and add tests (#24) [21:24:43] [02ImportDump] 07Universal-Omega closed pull request 03#24: Convert DB select queries to use SelectQueryBuilder and add tests - 13https://github.com/miraheze/ImportDump/pull/24 [21:24:44] [url] Page not found · GitHub · GitHub | github.com [21:24:45] [02miraheze/ImportDump] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 [21:24:46] [02ImportDump] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 - 13https://github.com/miraheze/ImportDump [21:24:47] [url] Page not found · GitHub · GitHub | github.com [21:25:26] RECOVERY - cp21 Varnish Backends on cp21 is OK: All 14 backends are healthy [21:26:00] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.06, 1.55, 1.69 [21:26:30] RECOVERY - db141 conntrack_table_size on db141 is OK: OK: nf_conntrack is 0 % full [21:26:56] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.64, 1.37, 1.54 [21:27:02] RECOVERY - scpvncommunitywiki.xyz - LetsEncrypt on sslhost is OK: OK - Certificate 'scpvncommunitywiki.xyz' will expire on Tue 23 Aug 2022 02:34:15 GMT +0000. [21:27:15] RECOVERY - webkinzguide.com - LetsEncrypt on sslhost is OK: OK - Certificate 'webkinzguide.com' will expire on Mon 29 Aug 2022 18:06:45 GMT +0000. [21:27:26] PROBLEM - cp30 Stunnel HTTP for mw122 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:27:34] PROBLEM - baharna.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:27:41] PROBLEM - cp21 Stunnel HTTP for mw122 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:28:01] RECOVERY - db141 ferm_active on db141 is OK: OK ferm input default policy is set [21:28:06] PROBLEM - cp20 Stunnel HTTP for mw122 on cp20 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 328 bytes in 4.473 second response time [21:28:06] RECOVERY - db141 Puppet on db141 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [21:29:48] PROBLEM - mw121 MediaWiki Rendering on mw121 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:30:12] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+2/-0/±1] 13https://github.com/miraheze/puppet/compare/d94e0366b995...92d1da6e722a [21:30:12] [url] Comparing d94e0366b995...92d1da6e722a · miraheze/puppet · GitHub | github.com [21:30:13] [02miraheze/puppet] 07paladox 0392d1da6 - Install db131 and db141 (#2763) [21:30:15] [02puppet] 07paladox closed pull request 03#2763: Install db131 and db141 - 13https://github.com/miraheze/puppet/pull/2763 [21:30:15] [url] Page not found · GitHub · GitHub | github.com [21:30:16] [02miraheze/puppet] 07paladox deleted branch 03paladox-patch-1 [21:30:18] [02puppet] 07paladox deleted branch 03paladox-patch-1 - 13https://github.com/miraheze/puppet [21:30:18] ... [21:31:24] RECOVERY - arrieretoile.fr - LetsEncrypt on sslhost is OK: OK - Certificate 'arrieretoile.fr' will expire on Thu 13 Oct 2022 04:37:30 GMT +0000. [21:31:41] RECOVERY - cp30 Stunnel HTTP for mw122 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 5.831 second response time [21:31:47] RECOVERY - mw121 MediaWiki Rendering on mw121 is OK: HTTP OK: HTTP/1.1 200 OK - 29512 bytes in 0.287 second response time [21:31:59] RECOVERY - cp21 Stunnel HTTP for mw122 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 1.452 second response time [21:32:04] RECOVERY - cp31 Stunnel HTTP for mw122 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 1.201 second response time [21:32:09] RECOVERY - mw122 MediaWiki Rendering on mw122 is OK: HTTP OK: HTTP/1.1 200 OK - 29513 bytes in 5.647 second response time [21:32:17] RECOVERY - cp20 Stunnel HTTP for mw122 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 1.170 second response time [21:33:08] miraheze/ImportDump - Universal-Omega the build passed. [21:33:32] PROBLEM - cp21 Varnish Backends on cp21 is CRITICAL: 1 backends are down. mw122 [21:35:33] !log migrate vm db112 to cloud10 [21:36:32] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:36:55] PROBLEM - cloud11 Puppet on cloud11 is WARNING: WARNING: Puppet is currently disabled, message: paladox, last run 17 minutes ago with 0 failures [21:37:16] PROBLEM - cloud10 Puppet on cloud10 is WARNING: WARNING: Puppet is currently disabled, message: paladox, last run 28 minutes ago with 0 failures [21:37:56] RECOVERY - cp21 Varnish Backends on cp21 is OK: All 14 backends are healthy [21:38:03] RECOVERY - wiki.ct777.cf - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.ct777.cf' will expire on Sun 02 Oct 2022 10:59:59 GMT +0000. [21:38:41] PROBLEM - betaheze.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:40:54] PROBLEM - cp20 Stunnel HTTP for mw122 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:41:56] PROBLEM - cp21 Stunnel HTTP for mw141 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:42:49] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.30, 3.18, 3.99 [21:42:56] RECOVERY - cp20 Stunnel HTTP for mw122 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 2.887 second response time [21:43:38] RECOVERY - vise.dayid.org - LetsEncrypt on sslhost is OK: OK - Certificate 'vise.dayid.org' will expire on Wed 24 Aug 2022 04:30:45 GMT +0000. [21:44:01] RECOVERY - cp21 Stunnel HTTP for mw141 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 5.080 second response time [21:45:51] [02miraheze/mw-config] 07paladox pushed 031 commit to 03paladox-patch-2 [+0/-0/±1] 13https://github.com/miraheze/mw-config/commit/6c731ad6091b [21:45:53] [02miraheze/mw-config] 07paladox 036c731ad - Add db131/db141 [21:45:54] [02mw-config] 07paladox created branch 03paladox-patch-2 - 13https://github.com/miraheze/mw-config [21:45:55] [url] Page not found · GitHub · GitHub | github.com [21:45:55] RECOVERY - animefeet.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [21:45:56] [02mw-config] 07paladox opened pull request 03#4844: Add db131/db141 - 13https://github.com/miraheze/mw-config/pull/4844 [21:45:56] ... [21:47:10] miraheze/mw-config - paladox the build passed. [21:47:15] [02mw-config] 07Universal-Omega reviewed pull request 03#4844 commit - 13https://github.com/miraheze/mw-config/pull/4844#discussion_r938272607 [21:47:16] [url] Add db131/db141 by paladox · Pull Request #4844 · miraheze/mw-config · GitHub | github.com [21:48:12] [02miraheze/mw-config] 07paladox pushed 031 commit to 03paladox-patch-2 [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/6c731ad6091b...19fd6a10d9ec [21:48:13] [url] Comparing 6c731ad6091b...19fd6a10d9ec · miraheze/mw-config · GitHub | github.com [21:48:14] [02miraheze/mw-config] 07paladox 0319fd6a1 - Update Database.php [21:48:15] [02mw-config] 07paladox synchronize pull request 03#4844: Add db131/db141 - 13https://github.com/miraheze/mw-config/pull/4844 [21:48:16] [url] Page not found · GitHub · GitHub | github.com [21:48:21] [02mw-config] 07paladox reviewed pull request 03#4844 commit - 13https://github.com/miraheze/mw-config/pull/4844#discussion_r938273225 [21:48:21] [url] Add db131/db141 by paladox · Pull Request #4844 · miraheze/mw-config · GitHub | github.com [21:48:49] PROBLEM - cp30 Stunnel HTTP for mw122 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:48:54] PROBLEM - mw122 MediaWiki Rendering on mw122 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:48:56] PROBLEM - cp31 Stunnel HTTP for mw122 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:49:19] miraheze/mw-config - paladox the build passed. [21:49:25] PROBLEM - cp20 Stunnel HTTP for mw122 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:50:11] PROBLEM - phab121 Current Load on phab121 is CRITICAL: CRITICAL - load average: 2.13, 1.76, 1.41 [21:50:58] RECOVERY - cp30 Stunnel HTTP for mw122 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 9.424 second response time [21:51:01] RECOVERY - cp31 Stunnel HTTP for mw122 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 7.889 second response time [21:51:28] RECOVERY - cp20 Stunnel HTTP for mw122 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 2.845 second response time [21:51:49] [02miraheze/mw-config] 07paladox pushed 031 commit to 03paladox-patch-2 [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/19fd6a10d9ec...7717e86ec427 [21:51:49] [url] Comparing 19fd6a10d9ec...7717e86ec427 · miraheze/mw-config · GitHub | github.com [21:51:50] [02miraheze/mw-config] 07paladox 037717e86 - Update LocalSettings.php [21:51:52] [02mw-config] 07paladox synchronize pull request 03#4844: Add db131/db141 - 13https://github.com/miraheze/mw-config/pull/4844 [21:51:52] [url] Page not found · GitHub · GitHub | github.com [21:52:09] RECOVERY - phab121 Current Load on phab121 is OK: OK - load average: 1.54, 1.64, 1.40 [21:52:59] miraheze/mw-config - paladox the build passed. [21:55:25] RECOVERY - infectowiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'infectowiki.com' will expire on Tue 23 Aug 2022 08:27:35 GMT +0000. [21:55:43] PROBLEM - db131 MariaDB on db131 is CRITICAL: Can't connect to MySQL server on 'db131.miraheze.org' (115) [21:56:04] PROBLEM - db141 MariaDB on db141 is CRITICAL: Can't connect to MySQL server on 'db141.miraheze.org' (115) [21:56:51] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 3.18, 2.88, 3.36 [21:57:06] PROBLEM - www.project-patterns.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'project-patterns.com' expires in 14 day(s) (Fri 19 Aug 2022 17:20:05 GMT +0000). [21:57:14] PROBLEM - cp30 Stunnel HTTP for mw122 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:57:22] [02mw-config] 07paladox synchronize pull request 03#4844: Add db131/db141 - 13https://github.com/miraheze/mw-config/pull/4844 [21:57:23] [url] Page not found · GitHub · GitHub | github.com [21:57:24] [02miraheze/mw-config] 07paladox pushed 031 commit to 03paladox-patch-2 [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/7717e86ec427...f08ae47106ff [21:57:24] [url] Comparing 7717e86ec427...f08ae47106ff · miraheze/mw-config · GitHub | github.com [21:57:25] [02miraheze/mw-config] 07paladox 03f08ae47 - Update LocalSettings.php [21:57:58] PROBLEM - cp20 Stunnel HTTP for mw122 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:58:01] PROBLEM - cp31 Stunnel HTTP for mw122 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:58:29] miraheze/mw-config - paladox the build passed. [21:58:30] PROBLEM - cp21 Stunnel HTTP for mw122 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:58:41] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::1b80/cpweb [22:00:42] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.68, 3.54, 3.55 [22:01:22] RECOVERY - cp30 Stunnel HTTP for mw122 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 1.399 second response time [22:01:47] RECOVERY - mw122 MediaWiki Rendering on mw122 is OK: HTTP OK: HTTP/1.1 200 OK - 29520 bytes in 0.388 second response time [22:02:13] RECOVERY - cp31 Stunnel HTTP for mw122 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 3.857 second response time [22:02:29] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [22:02:37] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.15, 2.99, 3.35 [22:02:42] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.84, 1.68, 1.43 [22:04:11] RECOVERY - cp20 Stunnel HTTP for mw122 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 9.140 second response time [22:04:42] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.17, 1.45, 1.37 [22:06:28] [02miraheze/CreateWiki] 07Universal-Omega pushed 031 commit to 03master [+0/-1/±0] 13https://github.com/miraheze/CreateWiki/compare/fd29ec311c8f...0d60accfc334 [22:06:28] [url] Comparing fd29ec311c8f...0d60accfc334 · miraheze/CreateWiki · GitHub | github.com [22:06:29] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.42, 3.21, 3.37 [22:06:29] [02miraheze/CreateWiki] 07Universal-Omega 030d60acc - Delete DBListGenerator.php [22:06:53] RECOVERY - cp21 Stunnel HTTP for mw122 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 6.322 second response time [22:08:21] PROBLEM - betaheze.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'betaheze.org' expires in 14 day(s) (Fri 19 Aug 2022 17:58:05 GMT +0000). [22:08:24] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 3.11, 3.11, 3.31 [22:14:36] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.13, 10.96, 11.94 [22:15:08] miraheze/CreateWiki - Universal-Omega the build passed. [22:22:55] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.42, 3.26, 3.26 [22:24:50] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 3.10, 3.03, 3.16 [22:26:17] RECOVERY - baharna.org - LetsEncrypt on sslhost is OK: OK - Certificate 'www.baharna.org' will expire on Sat 17 Sep 2022 21:09:35 GMT +0000. [22:26:37] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.35, 10.88, 11.35 [22:28:29] PROBLEM - cp21 Stunnel HTTP for mw122 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [22:28:31] PROBLEM - cp31 Stunnel HTTP for mw122 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [22:28:36] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.10, 11.22, 11.43 [22:28:42] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.79, 3.75, 3.39 [22:28:59] PROBLEM - mw122 MediaWiki Rendering on mw122 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [22:29:00] PROBLEM - cp30 Stunnel HTTP for mw122 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [22:29:20] PROBLEM - cp20 Stunnel HTTP for mw122 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [22:29:25] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.83, 1.60, 1.35 [22:30:36] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 15.56, 12.91, 12.02 [22:31:20] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.40, 1.96, 1.51 [22:31:40] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 1.07, 2.07, 1.25 [22:33:14] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.11, 1.61, 1.43 [22:33:38] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 0.62, 1.52, 1.14 [22:36:35] RECOVERY - cp21 Stunnel HTTP for mw122 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 0.019 second response time [22:36:58] RECOVERY - cp31 Stunnel HTTP for mw122 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.451 second response time [22:37:24] RECOVERY - cp30 Stunnel HTTP for mw122 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.328 second response time [22:37:27] RECOVERY - mw122 MediaWiki Rendering on mw122 is OK: HTTP OK: HTTP/1.1 200 OK - 29520 bytes in 0.363 second response time [22:37:30] RECOVERY - cp20 Stunnel HTTP for mw122 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.023 second response time [22:38:18] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 1.50, 3.63, 3.74 [22:41:49] PROBLEM - cp30 Stunnel HTTP for mw122 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [22:41:54] PROBLEM - mw122 MediaWiki Rendering on mw122 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [22:41:54] PROBLEM - cp20 Stunnel HTTP for mw122 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [22:42:54] PROBLEM - cp21 Stunnel HTTP for mw122 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [22:43:47] RECOVERY - cp30 Stunnel HTTP for mw122 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.318 second response time [22:43:47] RECOVERY - cp20 Stunnel HTTP for mw122 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.017 second response time [22:43:56] RECOVERY - mw122 MediaWiki Rendering on mw122 is OK: HTTP OK: HTTP/1.1 200 OK - 29513 bytes in 3.343 second response time [22:44:05] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 6.91, 6.95, 6.59 [22:44:51] RECOVERY - cp21 Stunnel HTTP for mw122 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 3.200 second response time [22:45:59] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.37, 2.83, 3.35 [22:46:48] RECOVERY - db141 MariaDB on db141 is OK: Uptime: 6 Threads: 2 Questions: 23 Slow queries: 7 Opens: 19 Open tables: 13 Queries per second avg: 3.833 [22:47:59] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 8.06, 7.73, 6.99 [22:48:12] RECOVERY - db131 MariaDB on db131 is OK: Uptime: 16 Threads: 2 Questions: 25 Slow queries: 7 Opens: 19 Open tables: 13 Queries per second avg: 1.562 [22:48:48] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.99, 1.50, 1.17 [22:49:56] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 6.51, 7.41, 6.97 [22:50:48] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.49, 1.51, 1.22 [22:53:51] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 4.56, 6.18, 6.59 [22:56:34] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 6.27, 3.59, 3.26 [22:57:43] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.21, 7.08, 6.88 [22:58:55] PROBLEM - mw122 MediaWiki Rendering on mw122 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [22:59:40] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 5.84, 6.57, 6.71 [23:00:37] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.31, 11.13, 11.99 [23:01:04] RECOVERY - mw122 MediaWiki Rendering on mw122 is OK: HTTP OK: HTTP/1.1 200 OK - 29513 bytes in 9.898 second response time [23:03:32] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 9.81, 7.79, 7.13 [23:05:06] PROBLEM - cp30 Stunnel HTTP for mw122 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [23:05:22] PROBLEM - cp21 Stunnel HTTP for mw122 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [23:05:31] PROBLEM - mw122 MediaWiki Rendering on mw122 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [23:06:05] PROBLEM - cp20 Stunnel HTTP for mw122 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [23:07:11] RECOVERY - cp30 Stunnel HTTP for mw122 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 5.777 second response time [23:07:23] RECOVERY - cp21 Stunnel HTTP for mw122 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 6.389 second response time [23:07:26] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.03, 7.34, 7.09 [23:08:05] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.10, 3.87, 3.72 [23:08:37] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 18.42, 13.82, 12.70 [23:09:23] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 8.02, 7.66, 7.24 [23:10:21] PROBLEM - mw121 MediaWiki Rendering on mw121 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [23:10:54] PROBLEM - cp31 Stunnel HTTP for mw121 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [23:11:10] PROBLEM - cp31 Stunnel HTTP for mw122 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [23:11:20] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.78, 7.75, 7.33 [23:11:26] PROBLEM - cp30 Stunnel HTTP for mw122 on cp30 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 328 bytes in 0.243 second response time [23:11:32] PROBLEM - cp30 Stunnel HTTP for mw121 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [23:11:41] PROBLEM - cp21 Stunnel HTTP for mw122 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [23:11:51] PROBLEM - cp21 Stunnel HTTP for mw121 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [23:11:56] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.92, 3.52, 3.55 [23:12:13] PROBLEM - cp20 Stunnel HTTP for mw121 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [23:13:14] RECOVERY - cp31 Stunnel HTTP for mw122 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 4.717 second response time [23:13:18] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 8.58, 7.86, 7.41 [23:13:43] RECOVERY - cp21 Stunnel HTTP for mw122 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 7.250 second response time [23:13:51] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.16, 2.85, 3.29 [23:13:53] RECOVERY - mw122 MediaWiki Rendering on mw122 is OK: HTTP OK: HTTP/1.1 200 OK - 29512 bytes in 5.870 second response time [23:14:12] RECOVERY - cp20 Stunnel HTTP for mw122 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 2.189 second response time [23:14:14] PROBLEM - cp20 Varnish Backends on cp20 is CRITICAL: 1 backends are down. mw122 [23:14:16] RECOVERY - cp20 Stunnel HTTP for mw121 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 5.868 second response time [23:14:32] RECOVERY - mw121 MediaWiki Rendering on mw121 is OK: HTTP OK: HTTP/1.1 200 OK - 29512 bytes in 6.591 second response time [23:15:15] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 4.88, 6.80, 7.08 [23:15:37] RECOVERY - cp30 Stunnel HTTP for mw122 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 5.358 second response time [23:15:42] RECOVERY - cp30 Stunnel HTTP for mw121 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.385 second response time [23:15:50] RECOVERY - cp21 Stunnel HTTP for mw121 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.018 second response time [23:17:10] RECOVERY - cp31 Stunnel HTTP for mw121 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 2.032 second response time [23:17:12] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 8.64, 7.70, 7.38 [23:18:14] RECOVERY - cp20 Varnish Backends on cp20 is OK: All 14 backends are healthy [23:19:09] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.13, 7.42, 7.32 [23:19:38] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 11.61, 6.06, 4.31 [23:21:06] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 8.91, 7.63, 7.38 [23:22:42] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.97, 1.95, 1.62 [23:24:36] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 7.96, 9.81, 11.60 [23:24:42] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.73, 1.86, 1.63 [23:26:42] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.45, 1.68, 1.60 [23:28:55] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 6.03, 7.75, 7.65 [23:30:42] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.33, 1.75, 1.67 [23:30:52] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 9.65, 8.45, 7.91 [23:31:49] PROBLEM - gluster122 Current Load on gluster122 is WARNING: WARNING - load average: 2.23, 2.88, 3.85 [23:32:29] PROBLEM - roblox-wiki.tk - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query roblox-wiki.tk. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [23:32:42] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.87, 1.38, 1.54 [23:37:49] RECOVERY - gluster122 Current Load on gluster122 is OK: OK - load average: 0.87, 2.02, 3.18 [23:38:41] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 6.86, 7.97, 7.94 [23:40:36] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 15.91, 12.10, 11.26 [23:42:36] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.72, 11.37, 11.12 [23:43:40] PROBLEM - cp30 Stunnel HTTP for mw122 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [23:44:33] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 1.82, 4.42, 6.41 [23:45:04] PROBLEM - db112 NTP time on db112 is CRITICAL: NTP CRITICAL: Offset 5.686540753 secs [23:45:39] RECOVERY - cp30 Stunnel HTTP for mw122 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.728 second response time [23:46:43] RECOVERY - cloud11 Puppet on cloud11 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [23:47:34] RECOVERY - cloud10 Puppet on cloud10 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [23:54:36] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.39, 9.02, 10.00 [23:59:16] [02mw-config] 07paladox closed pull request 03#4844: Add db131/db141 - 13https://github.com/miraheze/mw-config/pull/4844 [23:59:17] [url] Page not found · GitHub · GitHub | github.com [23:59:18] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±2] 13https://github.com/miraheze/mw-config/compare/151b8363301b...bdedc9eef8a6 [23:59:18] [url] Comparing 151b8363301b...bdedc9eef8a6 · miraheze/mw-config · GitHub | github.com [23:59:19] [02miraheze/mw-config] 07paladox 03bdedc9e - Add db131/db141 (#4844) [23:59:21] [02mw-config] 07paladox deleted branch 03paladox-patch-2 - 13https://github.com/miraheze/mw-config [23:59:21] [url] Page not found · GitHub · GitHub | github.com [23:59:22] [02miraheze/mw-config] 07paladox deleted branch 03paladox-patch-2 [23:59:27] PROBLEM - mw122 MediaWiki Rendering on mw122 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [23:59:31] PROBLEM - cp31 Stunnel HTTP for mw122 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds