[00:01:38] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.89, 1.94, 1.88 [00:02:52] PROBLEM - matomo101 Current Load on matomo101 is WARNING: WARNING - load average: 3.20, 3.67, 3.13 [00:03:30] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.15, 2.03, 1.69 [00:03:39] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 13.45, 10.76, 10.92 [00:03:53] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 11.31, 10.04, 9.41 [00:04:52] RECOVERY - matomo101 Current Load on matomo101 is OK: OK - load average: 2.02, 3.20, 3.03 [00:05:38] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.74, 10.57, 10.83 [00:05:53] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 21.83, 14.44, 10.41 [00:07:38] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 14.63, 12.09, 11.35 [00:07:45] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.93, 9.20, 9.22 [00:09:26] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 0.84, 1.82, 1.77 [00:09:50] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.93, 11.58, 10.11 [00:11:25] !log set php childs on mw1* to 42 as a experiment - monitoring to make sure there is no impact as well [00:11:25] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.17, 1.91, 1.80 [00:11:37] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.19, 11.17, 11.19 [00:11:43] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:11:48] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 13.87, 12.24, 10.51 [00:12:01] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 14.58, 10.57, 9.71 [00:13:24] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.87, 1.46, 1.65 [00:14:01] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.16, 9.11, 9.28 [00:15:35] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.13, 11.13, 11.14 [00:15:45] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 10.22, 11.99, 10.85 [00:17:35] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 8.70, 10.17, 10.78 [00:17:38] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.24, 1.88, 1.82 [00:21:40] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 7.01, 9.08, 9.95 [00:23:33] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 7.34, 9.16, 10.20 [00:27:32] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.10, 10.00, 10.33 [00:29:31] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 8.00, 9.37, 10.07 [00:33:29] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.75, 11.09, 10.72 [00:35:08] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-8 [+0/-0/±1] 13https://github.com/miraheze/puppet/commit/214494ad0f3a [00:35:09] [02miraheze/puppet] 07paladox 03214494a - prometheus: fix fail_if_body_not_matches_regexp for blackbox [00:35:11] [02puppet] 07paladox created branch 03paladox-patch-8 - 13https://github.com/miraheze/puppet [00:35:11] [url] Page not found · GitHub · GitHub | github.com [00:35:12] [02puppet] 07paladox opened pull request 03#2704: prometheus: fix fail_if_body_not_matches_regexp for blackbox - 13https://github.com/miraheze/puppet/pull/2704 [00:35:13] [url] Page not found · GitHub · GitHub | github.com [00:35:31] [02miraheze/puppet] 07paladox deleted branch 03paladox-patch-8 [00:35:32] [02puppet] 07paladox closed pull request 03#2704: prometheus: fix fail_if_body_not_matches_regexp for blackbox - 13https://github.com/miraheze/puppet/pull/2704 [00:35:32] [url] Page not found · GitHub · GitHub | github.com [00:35:34] [02puppet] 07paladox deleted branch 03paladox-patch-8 - 13https://github.com/miraheze/puppet [00:35:34] [url] Page not found · GitHub · GitHub | github.com [00:35:35] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/9a4073d831b5...d1c81fb6db44 [00:35:36] [url] Comparing 9a4073d831b5...d1c81fb6db44 · miraheze/puppet · GitHub | github.com [00:35:37] [02miraheze/puppet] 07paladox 03d1c81fb - prometheus: fix fail_if_body_not_matches_regexp for blackbox (#2704) [00:37:07] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.01, 1.54, 1.48 [00:37:38] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.65, 1.89, 1.99 [00:39:05] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.76, 1.64, 1.53 [00:39:26] PROBLEM - prometheus101 Current Load on prometheus101 is CRITICAL: CRITICAL - load average: 6.30, 3.15, 1.60 [00:39:28] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 6.51, 8.76, 9.82 [00:40:10] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.31, 3.20, 3.98 [00:40:21] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 11.01, 10.17, 9.70 [00:41:04] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.81, 1.29, 1.41 [00:44:06] !log mon111: upgrade grafana to 9 [00:44:10] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.52, 4.08, 4.16 [00:44:14] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:45:38] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.26, 1.94, 1.94 [00:46:16] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 12.80, 10.86, 10.12 [00:47:24] PROBLEM - prometheus101 Current Load on prometheus101 is WARNING: WARNING - load average: 0.69, 1.86, 1.61 [00:48:14] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 8.89, 10.04, 9.91 [00:49:24] RECOVERY - prometheus101 Current Load on prometheus101 is OK: OK - load average: 0.38, 1.34, 1.44 [00:50:10] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.25, 3.51, 3.91 [00:50:57] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.73, 1.48, 1.44 [00:52:10] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.10, 3.72, 3.94 [00:52:56] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.54, 1.46, 1.43 [00:54:10] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.26, 3.46, 3.81 [00:56:53] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.91, 1.72, 1.54 [00:58:04] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 12.44, 10.82, 10.20 [00:58:10] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.94, 4.14, 3.96 [00:58:21] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 11.21, 9.83, 9.46 [00:58:52] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.04, 1.49, 1.48 [01:00:02] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 10.59, 10.89, 10.31 [01:00:20] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.56, 10.32, 9.65 [01:02:20] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.85, 10.49, 9.82 [01:03:59] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 8.68, 9.64, 9.93 [01:04:10] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.02, 3.38, 3.74 [01:06:19] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 7.59, 9.03, 9.38 [01:06:38] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 14.66, 12.97, 9.81 [01:08:38] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.30, 10.87, 9.43 [01:11:50] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 15.63, 11.81, 10.48 [01:11:53] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.59, 3.51, 3.97 [01:12:01] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.76, 10.07, 9.06 [01:12:10] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.15, 3.61, 3.68 [01:12:38] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.80, 9.70, 9.30 [01:13:06] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/d1c81fb6db44...1d446f22ca62 [01:13:06] [url] Comparing d1c81fb6db44...1d446f22ca62 · miraheze/puppet · GitHub | github.com [01:13:07] [02miraheze/puppet] 07paladox 031d446f2 - mediawiki: Update tideways_xhprof.so [01:13:48] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.79, 11.05, 10.38 [01:14:01] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.39, 9.35, 8.92 [01:14:10] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.95, 3.65, 3.68 [01:15:47] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 8.44, 10.08, 10.10 [01:15:53] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.01, 3.63, 3.90 [01:18:15] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 11.72, 10.03, 9.55 [01:19:53] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.66, 3.37, 3.74 [01:20:29] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.50, 3.63, 3.95 [01:22:10] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.22, 2.90, 3.35 [01:26:29] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 6.23, 4.03, 3.90 [01:27:38] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.22, 1.64, 1.97 [01:27:53] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.57, 4.13, 3.86 [01:29:03] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.62, 3.34, 3.44 [01:30:11] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 14.41, 11.41, 10.33 [01:32:11] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 11.92, 11.39, 10.45 [01:32:29] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.16, 3.75, 3.83 [01:32:52] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.77, 10.39, 11.95 [01:32:59] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.86, 3.25, 3.39 [01:33:53] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.54, 3.66, 3.81 [01:34:10] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 7.68, 10.10, 10.10 [01:34:52] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 25.65, 15.05, 13.38 [01:35:38] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.09, 1.48, 1.72 [01:36:52] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.61, 3.94, 3.64 [01:37:38] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.29, 1.35, 1.63 [01:37:53] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.25, 4.32, 4.03 [01:38:29] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.40, 4.51, 4.13 [01:40:40] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-8 [+0/-0/±1] 13https://github.com/miraheze/puppet/commit/930949088a5d [01:40:42] [02miraheze/puppet] 07paladox 039309490 - prometheus: Use Miraheze rather then Main_Page [01:40:43] [02puppet] 07paladox created branch 03paladox-patch-8 - 13https://github.com/miraheze/puppet [01:40:44] [url] Page not found · GitHub · GitHub | github.com [01:40:45] [02puppet] 07paladox opened pull request 03#2705: prometheus: Use Miraheze rather then Main_Page - 13https://github.com/miraheze/puppet/pull/2705 [01:40:45] ... [01:40:48] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.38, 3.85, 3.68 [01:40:59] [02puppet] 07paladox closed pull request 03#2705: prometheus: Use Miraheze rather then Main_Page - 13https://github.com/miraheze/puppet/pull/2705 [01:41:00] ... [01:41:01] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/1d446f22ca62...685b97eae878 [01:41:02] [url] Comparing 1d446f22ca62...685b97eae878 · miraheze/puppet · GitHub | github.com [01:41:02] [02miraheze/puppet] 07paladox 03685b97e - prometheus: Use Miraheze rather then Main_Page (#2705) [01:41:04] [02miraheze/puppet] 07paladox deleted branch 03paladox-patch-8 [01:41:05] [02puppet] 07paladox deleted branch 03paladox-patch-8 - 13https://github.com/miraheze/puppet [01:41:06] [url] Page not found · GitHub · GitHub | github.com [01:41:53] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.68, 3.73, 3.86 [01:43:53] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.54, 4.00, 3.93 [01:44:52] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 7.79, 10.12, 11.71 [01:45:53] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.50, 3.76, 3.85 [01:47:38] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.51, 1.91, 1.71 [01:49:48] RECOVERY - lab.wikimimo.com - reverse DNS on sslhost is OK: SSL OK - lab.wikimimo.com reverse DNS resolves to cp21.miraheze.org - CNAME OK [01:50:52] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 13.28, 11.17, 11.55 [01:51:23] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.73, 1.70, 1.38 [01:51:53] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.44, 3.89, 3.80 [01:52:35] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 7.20, 4.22, 3.75 [01:55:21] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.18, 1.62, 1.44 [01:55:38] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.29, 1.92, 1.91 [01:56:09] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 10.44, 10.06, 9.00 [01:56:30] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.89, 3.69, 3.65 [01:57:03] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.10, 10.75, 9.90 [01:57:53] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.82, 3.90, 3.88 [01:58:01] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.69, 10.29, 8.56 [01:58:09] PROBLEM - db121 Current Load on db121 is CRITICAL: CRITICAL - load average: 8.01, 5.35, 3.16 [01:58:28] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.66, 3.80, 3.68 [01:59:02] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.63, 12.49, 10.71 [02:00:01] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.00, 9.10, 8.35 [02:00:26] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.50, 3.25, 3.49 [02:01:38] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.13, 1.42, 1.69 [02:01:53] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.95, 3.85, 3.80 [02:02:09] PROBLEM - db121 Current Load on db121 is WARNING: WARNING - load average: 7.50, 6.62, 4.21 [02:03:01] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.73, 11.37, 10.69 [02:03:16] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.04, 1.82, 1.55 [02:04:02] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 12.68, 11.19, 9.95 [02:04:09] RECOVERY - db121 Current Load on db121 is OK: OK - load average: 6.67, 6.70, 4.54 [02:04:22] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.57, 3.67, 3.61 [02:05:01] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 7.28, 9.78, 10.18 [02:05:15] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.87, 1.49, 1.47 [02:05:53] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.07, 3.73, 3.78 [02:06:01] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 6.36, 9.44, 9.47 [02:06:20] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.93, 3.38, 3.51 [02:06:29] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.99, 3.61, 3.94 [02:10:15] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.46, 3.15, 3.39 [02:10:31] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.56, 1.96, 1.79 [02:12:58] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 12.06, 11.92, 10.56 [02:14:10] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.49, 3.78, 3.59 [02:14:29] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.24, 3.41, 3.65 [02:14:52] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.07, 10.07, 11.66 [02:14:58] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.37, 10.90, 10.35 [02:15:53] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 6.13, 4.32, 3.86 [02:16:10] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.13, 3.55, 3.53 [02:16:29] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.99, 3.52, 3.66 [02:16:58] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 12.37, 11.31, 10.56 [02:18:29] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.06, 3.68, 3.69 [02:18:58] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.32, 10.25, 10.24 [02:19:53] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.42, 3.86, 3.78 [02:20:01] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.32, 1.75, 1.37 [02:21:53] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 3.47, 4.02, 3.86 [02:21:57] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.76, 1.70, 1.40 [02:22:29] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.85, 3.58, 3.68 [02:22:58] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 13.20, 11.70, 10.86 [02:23:52] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.51, 1.64, 1.41 [02:23:53] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.07, 3.71, 3.77 [02:24:02] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.76, 1.80, 1.56 [02:24:10] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.71, 3.19, 3.40 [02:24:58] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.28, 11.01, 10.72 [02:26:01] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.14, 1.54, 1.49 [02:26:52] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 14.08, 11.57, 11.45 [02:27:53] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.67, 3.94, 3.82 [02:28:10] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.41, 3.69, 3.52 [02:28:58] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 12.39, 10.71, 10.60 [02:30:10] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.54, 3.65, 3.53 [02:31:56] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.66, 1.86, 1.64 [02:32:52] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.09, 11.24, 11.47 [02:32:54] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 14.51, 12.62, 10.11 [02:32:58] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 8.25, 10.16, 10.48 [02:33:53] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.82, 3.50, 3.70 [02:33:55] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.19, 1.66, 1.59 [02:34:29] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.07, 3.37, 3.46 [02:34:52] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 14.47, 12.28, 11.81 [02:34:53] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 11.12, 11.71, 10.06 [02:34:58] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 8.77, 9.55, 10.20 [02:35:53] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.14, 3.96, 3.86 [02:36:10] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.45, 3.74, 3.56 [02:36:54] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 13.94, 11.87, 10.28 [02:38:10] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.66, 3.75, 3.59 [02:38:53] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.55, 11.30, 10.28 [02:39:53] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.34, 3.63, 3.80 [02:40:29] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.90, 3.96, 3.75 [02:41:20] !log revert for now [02:41:26] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:42:10] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.12, 3.07, 3.37 [02:42:50] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.93, 10.69, 9.20 [02:42:54] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 15.31, 11.82, 10.60 [02:44:45] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.65, 10.27, 9.23 [02:44:54] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 7.65, 10.48, 10.29 [02:46:29] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.18, 3.62, 3.64 [02:46:39] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 9.98, 9.99, 9.24 [02:46:52] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.47, 11.37, 11.81 [02:46:54] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 8.82, 9.93, 10.10 [02:47:53] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.51, 3.78, 3.69 [02:49:53] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.78, 3.35, 3.54 [02:50:10] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.88, 3.95, 3.64 [02:52:10] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.38, 3.67, 3.57 [02:52:52] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.52, 11.78, 11.87 [02:55:53] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.39, 3.92, 3.71 [02:56:10] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.87, 4.09, 3.74 [02:57:53] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.31, 3.88, 3.73 [02:58:10] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.42, 3.81, 3.67 [02:58:29] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.58, 3.82, 3.83 [02:58:52] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.03, 11.55, 11.91 [03:00:52] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 14.62, 12.40, 12.15 [03:02:10] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.29, 3.58, 3.57 [03:02:52] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.16, 11.72, 11.97 [03:02:54] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.83, 10.82, 10.28 [03:03:53] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.85, 3.97, 3.75 [03:04:10] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.14, 3.38, 3.50 [03:04:52] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 21.17, 14.83, 13.03 [03:04:53] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 7.95, 9.99, 10.06 [03:05:53] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.20, 3.63, 3.66 [03:06:10] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.76, 3.54, 3.52 [03:06:29] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.89, 3.82, 3.72 [03:08:10] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.70, 3.49, 3.50 [03:08:29] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.43, 3.55, 3.63 [03:09:38] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.46, 1.57, 1.93 [03:09:53] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.54, 3.75, 3.69 [03:10:52] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.42, 10.98, 11.87 [03:11:29] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 11.00, 8.80, 8.13 [03:11:53] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.02, 3.42, 3.58 [03:12:10] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 3.17, 3.27, 3.40 [03:13:28] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 5.87, 7.65, 7.79 [03:13:53] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.10, 3.50, 3.57 [03:14:29] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.31, 3.58, 3.57 [03:15:53] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.61, 3.30, 3.50 [03:16:10] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.79, 3.48, 3.44 [03:16:29] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.38, 3.43, 3.51 [03:17:38] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.55, 1.75, 1.81 [03:17:53] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.86, 3.98, 3.72 [03:18:10] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.33, 3.76, 3.54 [03:18:29] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.25, 4.25, 3.81 [03:20:10] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.33, 3.60, 3.51 [03:23:53] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.18, 3.69, 3.76 [03:25:38] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.23, 1.76, 1.87 [03:25:53] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 3.75, 4.02, 3.89 [03:27:53] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.08, 3.71, 3.79 [03:28:10] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.79, 3.21, 3.36 [03:28:29] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.98, 3.83, 3.95 [03:30:52] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 9.04, 9.33, 10.04 [03:31:53] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.10, 3.89, 3.84 [03:33:53] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.46, 3.62, 3.74 [03:36:16] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.84, 1.71, 1.43 [03:37:01] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.69, 3.66, 3.50 [03:37:38] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.20, 1.44, 1.66 [03:38:15] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.97, 1.43, 1.36 [03:40:29] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 3.21, 3.06, 3.39 [03:40:57] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.22, 3.18, 3.35 [03:44:50] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.39, 3.60, 3.50 [03:47:53] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.22, 3.83, 3.61 [03:48:46] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.71, 4.02, 3.67 [03:49:24] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.60, 3.84, 3.54 [03:49:38] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.41, 1.80, 1.63 [03:50:44] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.42, 3.82, 3.64 [03:52:58] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 10.57, 9.30, 8.32 [03:55:53] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.31, 3.73, 3.74 [03:56:37] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.78, 3.96, 3.73 [03:56:58] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 8.44, 9.25, 8.56 [03:57:53] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.60, 4.13, 3.90 [03:58:35] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.11, 3.59, 3.62 [03:59:17] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.19, 3.44, 3.63 [04:01:53] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.32, 3.95, 3.90 [04:02:31] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 1.55, 2.73, 3.28 [04:03:14] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.89, 2.68, 3.28 [04:09:08] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.80, 3.61, 3.46 [04:09:53] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 6.64, 4.20, 3.81 [04:13:05] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.23, 3.57, 3.48 [04:13:53] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.34, 3.76, 3.72 [04:14:15] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.28, 3.72, 3.51 [04:15:53] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 6.05, 4.17, 3.85 [04:17:53] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.65, 3.67, 3.69 [04:18:43] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.74, 1.90, 1.45 [04:19:00] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.23, 3.62, 3.51 [04:20:43] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 3.11, 2.29, 1.64 [04:21:53] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.23, 3.70, 3.69 [04:22:43] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.66, 1.94, 1.59 [04:22:57] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.72, 3.52, 3.53 [04:23:53] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.34, 3.46, 3.60 [04:24:43] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.94, 1.56, 1.49 [04:25:53] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.44, 3.91, 3.76 [04:26:55] PROBLEM - gluster111 APT on gluster111 is WARNING: APT WARNING: 0 packages available for upgrade (0 critical updates). warnings detected, errors detected. [04:28:10] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.47, 3.09, 3.33 [04:28:53] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.26, 3.97, 3.68 [04:28:56] PROBLEM - gluster111 APT on gluster111 is CRITICAL: APT CRITICAL: 37 packages available for upgrade (15 critical updates). [04:29:53] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.82, 3.62, 3.70 [04:30:51] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.15, 3.63, 3.59 [04:34:48] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 3.04, 3.12, 3.38 [04:35:53] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 1.61, 2.82, 3.39 [04:38:44] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.47, 3.70, 3.52 [04:40:42] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.80, 3.95, 3.65 [04:43:38] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.48, 1.63, 1.97 [04:44:39] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.40, 3.95, 3.70 [04:46:38] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.68, 3.82, 3.67 [04:47:38] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.44, 1.93, 2.00 [04:50:35] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.28, 3.67, 3.61 [04:52:33] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.35, 3.28, 3.49 [04:54:32] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.00, 2.93, 3.34 [04:57:37] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.66, 3.26, 3.18 [04:57:38] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.20, 1.65, 1.91 [04:59:35] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.28, 2.88, 3.05 [05:03:23] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.76, 3.81, 3.53 [05:03:38] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.56, 1.41, 1.70 [05:05:21] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.72, 3.31, 3.38 [05:05:38] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.10, 10.00, 8.73 [05:07:36] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 9.21, 9.45, 8.68 [05:19:08] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.94, 3.98, 3.53 [05:19:11] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.07, 3.31, 3.03 [05:19:14] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.49, 2.01, 1.77 [05:21:07] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.93, 3.24, 3.31 [05:21:08] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.60, 3.53, 3.15 [05:23:06] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.53, 3.16, 3.06 [05:25:01] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.10, 1.76, 1.79 [05:28:53] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.21, 1.46, 1.65 [05:33:45] PROBLEM - cp21 Varnish Backends on cp21 is CRITICAL: 1 backends are down. mw111 [05:35:42] RECOVERY - cp21 Varnish Backends on cp21 is OK: All 14 backends are healthy [05:38:34] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.43, 1.91, 1.75 [05:45:43] PROBLEM - cp21 Varnish Backends on cp21 is CRITICAL: 1 backends are down. mw111 [05:53:46] RECOVERY - cp21 Varnish Backends on cp21 is OK: All 14 backends are healthy [05:54:00] PROBLEM - wiki.wikimedia.cat - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [05:54:09] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::4c25/cpweb [05:58:22] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.53, 3.45, 3.02 [05:58:22] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.45, 3.63, 3.10 [05:58:54] PROBLEM - cp20 Varnish Backends on cp20 is CRITICAL: 1 backends are down. mw111 [06:00:20] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.58, 3.13, 2.97 [06:00:21] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.14, 2.90, 2.87 [06:00:52] RECOVERY - cp20 Varnish Backends on cp20 is OK: All 14 backends are healthy [06:02:09] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [06:02:57] PROBLEM - www.zetapedia.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:03:00] PROBLEM - es.gyaanipedia.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:04:53] PROBLEM - cp20 Varnish Backends on cp20 is CRITICAL: 2 backends are down. mw102 mw121 [06:07:48] PROBLEM - pt.polandballwiki.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:10:09] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::1b80/cpweb [06:12:52] RECOVERY - cp20 Varnish Backends on cp20 is OK: All 14 backends are healthy [06:13:22] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.83, 4.10, 3.26 [06:14:13] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.50, 3.62, 3.13 [06:14:36] PROBLEM - cp21 Varnish Backends on cp21 is CRITICAL: 3 backends are down. mw101 mw111 mw112 [06:14:39] PROBLEM - wiki.autocountsoft.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:15:21] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.14, 3.82, 3.27 [06:16:09] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [06:16:53] PROBLEM - cp20 Varnish Backends on cp20 is CRITICAL: 1 backends are down. mw101 [06:17:19] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.64, 3.18, 3.11 [06:18:11] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.66, 3.18, 3.07 [06:18:25] PROBLEM - wiki.nowchess.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:18:50] RECOVERY - cp20 Varnish Backends on cp20 is OK: All 14 backends are healthy [06:19:50] PROBLEM - wiki.site97.fr - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:20:45] PROBLEM - cp21 Stunnel HTTP for matomo101 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [06:22:58] RECOVERY - cp21 Stunnel HTTP for matomo101 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 99061 bytes in 0.291 second response time [06:23:06] RECOVERY - wiki.wikimedia.cat - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.wikimedia.cat' will expire on Mon 10 Oct 2022 04:52:56 GMT +0000. [06:23:14] PROBLEM - cp20 Varnish Backends on cp20 is CRITICAL: 3 backends are down. mw102 mw112 mw122 [06:23:31] PROBLEM - wiki.digitalcandela.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:24:15] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.62, 10.57, 8.97 [06:24:29] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.14, 1.87, 1.44 [06:26:06] PROBLEM - replication-ops.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:26:13] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.81, 9.65, 8.84 [06:26:25] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.97, 1.48, 1.34 [06:27:07] PROBLEM - wiki.parappa.dev - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:27:28] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 11.52, 9.77, 8.58 [06:27:46] PROBLEM - wiki.infomedia.co.uk - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:29:28] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 8.91, 9.32, 8.55 [06:31:56] RECOVERY - www.zetapedia.com - LetsEncrypt on sslhost is OK: OK - Certificate 'www.zetapedia.com' will expire on Wed 17 Aug 2022 21:08:43 GMT +0000. [06:32:05] RECOVERY - es.gyaanipedia.com - LetsEncrypt on sslhost is OK: OK - Certificate 'es.gyaanipedia.com' will expire on Thu 08 Sep 2022 07:18:15 GMT +0000. [06:33:44] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 12.72, 9.78, 8.05 [06:35:30] PROBLEM - arrieretoile.fr - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:35:44] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 6.14, 8.37, 7.75 [06:37:08] RECOVERY - pt.polandballwiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'pt.polandballwiki.com' will expire on Thu 29 Sep 2022 08:59:53 GMT +0000. [06:38:09] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 2 datacenters are down: 2001:41d0:801:2000::4c25/cpweb, 2001:41d0:801:2000::1b80/cpweb [06:41:24] PROBLEM - wiki.zergmafia.top - reverse DNS on sslhost is WARNING: Timeout: The DNS operation timed out after 5.406961441040039 seconds [06:41:36] PROBLEM - wiki.thedev.gq - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:42:26] PROBLEM - www.istpcomputing.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:43:22] RECOVERY - wiki.autocountsoft.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.autocountsoft.com' will expire on Sun 18 Sep 2022 20:39:54 GMT +0000. [06:45:57] PROBLEM - www.winenjoy.net - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:47:22] PROBLEM - cp21 Stunnel HTTP for mw101 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [06:48:06] PROBLEM - central.ballmedia.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:48:21] PROBLEM - www.journeytheword.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:48:21] RECOVERY - wiki.nowchess.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.nowchess.org' will expire on Wed 24 Aug 2022 02:12:36 GMT +0000. [06:49:16] RECOVERY - wiki.site97.fr - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.site97.fr' will expire on Tue 18 Oct 2022 15:25:34 GMT +0000. [06:49:27] RECOVERY - cp21 Stunnel HTTP for mw101 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 1.023 second response time [06:51:20] PROBLEM - cp21 ferm_active on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [06:53:48] RECOVERY - cp21 ferm_active on cp21 is OK: OK ferm input default policy is set [06:54:00] PROBLEM - cnt.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:54:30] PROBLEM - cp21 Stunnel HTTP for reports121 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:55:43] PROBLEM - vedopedia.witches-empire.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:55:46] RECOVERY - replication-ops.com - LetsEncrypt on sslhost is OK: OK - Certificate 'replication-ops.com' will expire on Tue 18 Oct 2022 15:32:39 GMT +0000. [06:56:18] RECOVERY - wiki.parappa.dev - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.parappa.dev' will expire on Sun 18 Sep 2022 13:44:45 GMT +0000. [06:56:25] RECOVERY - cp21 Stunnel HTTP for reports121 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 10996 bytes in 0.052 second response time [06:56:46] RECOVERY - cp21 Varnish Backends on cp21 is OK: All 14 backends are healthy [06:57:10] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.94, 3.82, 2.99 [06:57:37] RECOVERY - wiki.infomedia.co.uk - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.infomedia.co.uk' will expire on Fri 21 Oct 2022 15:33:32 GMT +0000. [06:57:53] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.99, 3.86, 3.09 [06:58:14] PROBLEM - cp20 Puppet on cp20 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): File[/etc/apt/trusted.gpg.d/puppetlabs.gpg] [06:59:08] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.13, 3.36, 2.94 [06:59:48] PROBLEM - en.gyaanipedia.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:59:53] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.17, 3.72, 3.11 [07:00:40] PROBLEM - cp21 Varnish Backends on cp21 is CRITICAL: 3 backends are down. mw111 mw112 mw121 [07:01:15] PROBLEM - recaptime.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:01:41] PROBLEM - wiki.funkey-project.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:01:53] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.69, 3.40, 3.07 [07:02:09] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [07:03:23] PROBLEM - www.zetapedia.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:05:56] PROBLEM - allthetropes.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:06:33] PROBLEM - cp21 ferm_active on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [07:08:49] PROBLEM - www.electrowiki.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:08:49] PROBLEM - cp20 Stunnel HTTP for mw111 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [07:08:56] PROBLEM - pt.polandballwiki.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:09:05] PROBLEM - bluearchive.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:10:05] RECOVERY - wiki.zergmafia.top - reverse DNS on sslhost is OK: SSL OK - wiki.zergmafia.top reverse DNS resolves to cp21.miraheze.org - CNAME OK [07:10:21] RECOVERY - wiki.thedev.gq - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.thedev.gq' will expire on Fri 02 Sep 2022 12:36:20 GMT +0000. [07:10:26] PROBLEM - sdiy.info - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:10:55] RECOVERY - cp20 Stunnel HTTP for mw111 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 1.027 second response time [07:11:54] RECOVERY - www.istpcomputing.com - LetsEncrypt on sslhost is OK: OK - Certificate 'istpcomputing.com' will expire on Tue 11 Oct 2022 04:37:06 GMT +0000. [07:13:14] PROBLEM - test3.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:14:28] RECOVERY - cp21 ferm_active on cp21 is OK: OK ferm input default policy is set [07:14:30] RECOVERY - www.winenjoy.net - LetsEncrypt on sslhost is OK: OK - Certificate 'www.winenjoy.net' will expire on Sun 02 Oct 2022 10:20:46 GMT +0000. [07:14:40] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 11.26, 9.36, 7.78 [07:16:27] PROBLEM - mwcosmos.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:16:38] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 9.10, 9.56, 8.07 [07:17:15] RECOVERY - central.ballmedia.org - LetsEncrypt on sslhost is OK: OK - Certificate 'central.ballmedia.org' will expire on Mon 10 Oct 2022 06:35:15 GMT +0000. [07:17:46] RECOVERY - www.journeytheword.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'www.journeytheword.wiki' will expire on Wed 31 Aug 2022 18:13:33 GMT +0000. [07:18:14] PROBLEM - wc.miraheze.org on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:20:04] PROBLEM - wiki.worlduniversityandschool.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:20:09] RECOVERY - wc.miraheze.org on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [07:21:04] PROBLEM - allthetropes.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:21:06] RECOVERY - wiki.digitalcandela.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.digitalcandela.com' will expire on Mon 17 Oct 2022 03:48:33 GMT +0000. [07:21:12] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.62, 9.60, 7.77 [07:21:26] PROBLEM - wiki.meeusen.net - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:22:26] PROBLEM - mcdev.grantlmul.xyz - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:22:35] PROBLEM - cp21 Stunnel HTTP for matomo101 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [07:23:12] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.52, 9.79, 8.06 [07:25:09] RECOVERY - cp21 Stunnel HTTP for matomo101 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 99038 bytes in 4.930 second response time [07:25:11] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 9.19, 9.48, 8.15 [07:25:31] PROBLEM - commons.ballmedia.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:25:40] RECOVERY - vedopedia.witches-empire.com - LetsEncrypt on sslhost is OK: OK - Certificate 'vedopedia.witches-empire.com' will expire on Wed 24 Aug 2022 04:55:08 GMT +0000. [07:27:39] RECOVERY - cp20 Puppet on cp20 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [07:27:40] PROBLEM - solaswiki.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:27:49] PROBLEM - commons.gyaanipedia.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:28:39] RECOVERY - en.gyaanipedia.com - LetsEncrypt on sslhost is OK: OK - Certificate 'en.gyaanipedia.com' will expire on Thu 08 Sep 2022 07:04:52 GMT +0000. [07:28:50] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.99, 3.56, 2.90 [07:29:35] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 2 datacenters are down: 2001:41d0:801:2000::4c25/cpweb, 2001:41d0:801:2000::1b80/cpweb [07:29:37] PROBLEM - betaheze.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:30:02] RECOVERY - recaptime.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [07:30:04] PROBLEM - zh.internetpedia.tk - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:30:07] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.65, 9.09, 7.72 [07:30:49] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 1.97, 3.02, 2.78 [07:30:53] PROBLEM - cp20 Stunnel HTTP for mw122 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:30:56] RECOVERY - wiki.funkey-project.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.funkey-project.com' will expire on Tue 23 Aug 2022 08:26:19 GMT +0000. [07:32:05] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 6.50, 8.23, 7.58 [07:32:21] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 12.24, 10.84, 9.16 [07:32:25] RECOVERY - www.zetapedia.com - LetsEncrypt on sslhost is OK: OK - Certificate 'www.zetapedia.com' will expire on Wed 17 Aug 2022 21:08:43 GMT +0000. [07:32:51] RECOVERY - cp20 Stunnel HTTP for mw122 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.023 second response time [07:33:02] RECOVERY - arrieretoile.fr - LetsEncrypt on sslhost is OK: OK - Certificate 'arrieretoile.fr' will expire on Thu 13 Oct 2022 04:37:30 GMT +0000. [07:34:19] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 6.77, 9.30, 8.82 [07:35:00] RECOVERY - allthetropes.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [07:35:39] PROBLEM - smashloop.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:36:38] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.49, 8.64, 6.36 [07:36:43] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.36, 1.63, 1.17 [07:37:33] PROBLEM - cp21 ferm_active on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [07:37:41] RECOVERY - www.electrowiki.org - LetsEncrypt on sslhost is OK: OK - Certificate 'electrowiki.org' will expire on Sat 17 Sep 2022 19:15:15 GMT +0000. [07:38:16] RECOVERY - pt.polandballwiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'pt.polandballwiki.com' will expire on Thu 29 Sep 2022 08:59:53 GMT +0000. [07:38:38] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 6.27, 7.74, 6.32 [07:38:43] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.08, 1.34, 1.12 [07:38:54] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [07:39:55] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 13.81, 10.21, 8.42 [07:39:56] RECOVERY - sdiy.info - LetsEncrypt on sslhost is OK: OK - Certificate 'sdiy.info' will expire on Sat 17 Sep 2022 21:29:52 GMT +0000. [07:40:56] PROBLEM - cp21 HTTPS on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:41:36] PROBLEM - wiki.thedev.gq - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:41:53] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 9.25, 9.73, 8.47 [07:42:16] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.44, 3.46, 2.80 [07:42:57] RECOVERY - cp21 ferm_active on cp21 is OK: OK ferm input default policy is set [07:42:59] RECOVERY - test3.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [07:43:47] PROBLEM - cp21 Stunnel HTTP for mw102 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:43:57] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 0.16, 0.28, 0.49 [07:44:14] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.77, 3.07, 2.73 [07:44:48] PROBLEM - experimyco.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:45:05] RECOVERY - cp21 HTTPS on cp21 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 3407 bytes in 7.320 second response time [07:45:29] RECOVERY - mwcosmos.com - LetsEncrypt on sslhost is OK: OK - Certificate 'mwcosmos.com' will expire on Mon 22 Aug 2022 15:03:04 GMT +0000. [07:46:13] RECOVERY - cp21 Stunnel HTTP for mw102 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.021 second response time [07:46:27] PROBLEM - docse.tk - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:49:08] PROBLEM - cp21 Stunnel HTTP for mw101 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:49:54] PROBLEM - erawikisource.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:49:57] RECOVERY - wiki.worlduniversityandschool.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.worlduniversityandschool.org' will expire on Tue 23 Aug 2022 07:52:18 GMT +0000. [07:49:59] PROBLEM - deepdark.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:50:22] PROBLEM - wiki.counterculturelabs.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:50:35] PROBLEM - grayravens.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:50:52] RECOVERY - wiki.meeusen.net - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.meeusen.net' will expire on Sat 17 Sep 2022 21:26:27 GMT +0000. [07:51:22] PROBLEM - speleo.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:51:27] RECOVERY - mcdev.grantlmul.xyz - LetsEncrypt on sslhost is OK: OK - Certificate 'mcdev.grantlmul.xyz' will expire on Fri 14 Oct 2022 16:18:23 GMT +0000. [07:52:45] PROBLEM - zenith.nsmbu.net - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:53:03] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 11.26, 9.71, 7.84 [07:54:32] RECOVERY - cp21 Stunnel HTTP for mw101 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.020 second response time [07:54:38] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.59, 10.48, 8.26 [07:55:01] PROBLEM - ambient.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:55:02] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 4.88, 7.74, 7.33 [07:55:19] PROBLEM - cp21 Stunnel HTTP for matomo101 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [07:55:24] RECOVERY - commons.ballmedia.org - LetsEncrypt on sslhost is OK: OK - Certificate 'commons.ballmedia.org' will expire on Mon 10 Oct 2022 06:16:04 GMT +0000. [07:55:25] PROBLEM - cp20 Stunnel HTTP for mwtask111 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:56:38] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.20, 10.89, 8.70 [07:56:39] RECOVERY - commons.gyaanipedia.com - LetsEncrypt on sslhost is OK: OK - Certificate 'commons.gyaanipedia.com' will expire on Thu 08 Sep 2022 06:46:28 GMT +0000. [07:57:02] PROBLEM - buildabearwiki.info - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:57:22] RECOVERY - cp20 Stunnel HTTP for mwtask111 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15950 bytes in 0.021 second response time [07:57:22] RECOVERY - solaswiki.org - LetsEncrypt on sslhost is OK: OK - Certificate 'solaswiki.org' will expire on Sat 03 Sep 2022 15:10:56 GMT +0000. [07:57:50] PROBLEM - crocwiki.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:58:05] PROBLEM - m.miraheze.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:59:33] PROBLEM - cp20 Puppet on cp20 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): File[/etc/apt/trusted.gpg.d/puppetlabs.gpg] [07:59:39] PROBLEM - wiki.ct777.cf - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:59:40] PROBLEM - electowiki.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:59:41] PROBLEM - scum-wiki.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:59:41] PROBLEM - scum-wiki.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:59:48] PROBLEM - squareenix.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:59:59] RECOVERY - m.miraheze.org - LetsEncrypt on sslhost is OK: OK - Certificate 'm.miraheze.org' will expire on Tue 06 Sep 2022 21:18:17 GMT +0000. [08:00:38] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.88, 10.02, 8.86 [08:00:44] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [08:00:52] PROBLEM - thepolicyhub.org.uk - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:01:14] PROBLEM - cp20 Stunnel HTTP for mon111 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:01:14] PROBLEM - wikipanel.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:03:28] PROBLEM - sarovia.graalmilitary.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:03:32] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.85, 3.24, 2.83 [08:03:42] RECOVERY - cp21 Stunnel HTTP for matomo101 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 99061 bytes in 0.481 second response time [08:05:30] PROBLEM - arrieretoile.fr - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:05:38] PROBLEM - cp21 Stunnel HTTP for mw102 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [08:06:08] PROBLEM - slymods.info - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:06:29] PROBLEM - wiki.worldsofweary.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:06:40] PROBLEM - mystiverse.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:07:11] RECOVERY - bluearchive.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'bluearchive.wiki' will expire on Mon 22 Aug 2022 15:22:46 GMT +0000. [08:07:30] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.97, 3.06, 2.84 [08:08:20] PROBLEM - rww2.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:09:09] PROBLEM - cp21 Disk Space on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [08:09:55] PROBLEM - en.omniversalis.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:10:04] PROBLEM - pt.polandballwiki.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:10:14] RECOVERY - wiki.thedev.gq - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.thedev.gq' will expire on Fri 02 Sep 2022 12:36:20 GMT +0000. [08:10:35] RECOVERY - cp20 Stunnel HTTP for mon111 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 39169 bytes in 3.082 second response time [08:11:04] RECOVERY - cp21 Disk Space on cp21 is OK: DISK OK - free space: / 11292 MB (29% inode=96%); [08:11:22] PROBLEM - itora.bunnies1230.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:11:45] PROBLEM - cp21 Stunnel HTTP for mw121 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:12:26] PROBLEM - cp21 Stunnel HTTP for mwtask111 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [08:12:43] PROBLEM - ngsswiki.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:13:19] PROBLEM - largedu.eu.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:13:42] RECOVERY - experimyco.com - LetsEncrypt on sslhost is OK: OK - Certificate 'experimyco.com' will expire on Thu 15 Sep 2022 05:36:04 GMT +0000. [08:13:42] RECOVERY - cp21 Stunnel HTTP for mw121 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 1.067 second response time [08:15:07] PROBLEM - sammaditthi.cyou - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:15:12] PROBLEM - cloudwiki.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:15:28] RECOVERY - docse.tk - LetsEncrypt on sslhost is OK: OK - Certificate 'docse.tk' will expire on Tue 20 Sep 2022 11:55:51 GMT +0000. [08:15:38] PROBLEM - www.iceria.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:15:53] PROBLEM - cp20 Stunnel HTTP for mon111 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:15:57] PROBLEM - drowiki.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:17:21] RECOVERY - cp21 Stunnel HTTP for mwtask111 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15950 bytes in 0.022 second response time [08:17:37] PROBLEM - data.nonbinary.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:17:42] PROBLEM - cp21 Stunnel HTTP for mw122 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [08:18:09] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::4c25/cpweb [08:18:38] PROBLEM - cp21 Stunnel HTTP for matomo101 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [08:19:13] RECOVERY - grayravens.com - LetsEncrypt on sslhost is OK: OK - Certificate 'grayravens.com' will expire on Sun 18 Sep 2022 13:03:26 GMT +0000. [08:19:20] RECOVERY - erawikisource.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [08:19:33] RECOVERY - deepdark.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'deepdark.wiki' will expire on Mon 03 Oct 2022 20:17:33 GMT +0000. [08:19:55] PROBLEM - cp20 Stunnel HTTP for reports121 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [08:19:56] RECOVERY - speleo.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'speleo.wiki' will expire on Mon 22 Aug 2022 22:45:26 GMT +0000. [08:20:20] RECOVERY - wiki.counterculturelabs.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.counterculturelabs.org' will expire on Wed 31 Aug 2022 18:20:36 GMT +0000. [08:20:54] PROBLEM - cp21 conntrack_table_size on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [08:20:55] RECOVERY - cp20 Stunnel HTTP for mon111 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 39185 bytes in 3.069 second response time [08:21:38] RECOVERY - cnt.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [08:22:02] RECOVERY - zenith.nsmbu.net - LetsEncrypt on sslhost is OK: OK - Certificate 'zenith.nsmbu.net' will expire on Mon 10 Oct 2022 05:53:48 GMT +0000. [08:22:09] RECOVERY - cp20 Stunnel HTTP for reports121 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 10996 bytes in 0.056 second response time [08:22:30] RECOVERY - cp21 Stunnel HTTP for mw102 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.021 second response time [08:22:34] RECOVERY - cp20 Varnish Backends on cp20 is OK: All 14 backends are healthy [08:22:38] RECOVERY - cp21 Stunnel HTTP for mw122 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 1.050 second response time [08:22:49] PROBLEM - intp.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:23:12] PROBLEM - cp20 Stunnel HTTP for test101 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:23:33] PROBLEM - cp20 Stunnel HTTP for mw111 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:24:21] RECOVERY - ambient.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'ambient.wiki' will expire on Mon 10 Oct 2022 05:15:24 GMT +0000. [08:26:04] RECOVERY - cp20 Stunnel HTTP for mw111 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 1.023 second response time [08:26:40] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.59, 3.32, 2.87 [08:26:43] RECOVERY - buildabearwiki.info - LetsEncrypt on sslhost is OK: OK - Certificate 'buildabearwiki.info' will expire on Fri 16 Sep 2022 17:59:19 GMT +0000. [08:27:19] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.56, 2.89, 2.63 [08:27:20] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.85, 3.69, 3.13 [08:27:25] PROBLEM - cp20 Varnish Backends on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [08:28:24] RECOVERY - zh.internetpedia.tk - LetsEncrypt on sslhost is OK: OK - Certificate 'zh.internetpedia.tk' will expire on Mon 22 Aug 2022 22:07:13 GMT +0000. [08:28:26] RECOVERY - electowiki.org - LetsEncrypt on sslhost is OK: OK - Certificate 'electowiki.org' will expire on Tue 23 Aug 2022 00:50:24 GMT +0000. [08:28:26] RECOVERY - scum-wiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'scum-wiki.com' will expire on Sat 22 Oct 2022 05:35:09 GMT +0000. [08:28:38] RECOVERY - squareenix.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [08:28:39] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.99, 2.76, 2.72 [08:28:53] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.83, 10.41, 8.75 [08:29:04] PROBLEM - cp20 Stunnel HTTP for reports121 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [08:29:15] PROBLEM - ecole.science - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:29:17] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.16, 2.57, 2.54 [08:29:19] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.73, 3.23, 3.02 [08:29:32] PROBLEM - cp20 ferm_active on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [08:30:02] PROBLEM - cp21 Stunnel HTTP for test101 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [08:30:06] RECOVERY - wikipanel.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wikipanel.org' will expire on Sun 02 Oct 2022 04:51:38 GMT +0000. [08:30:27] PROBLEM - cp21 SSH on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:30:37] PROBLEM - cp21 Stunnel HTTP for mw102 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [08:30:42] PROBLEM - cp21 Stunnel HTTP for mail121 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:30:55] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [08:30:58] Wikis returning 503 [08:31:05] RECOVERY - cp20 Stunnel HTTP for reports121 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 10996 bytes in 0.039 second response time [08:31:10] RECOVERY - cp20 Stunnel HTTP for test101 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15954 bytes in 3.065 second response time [08:31:17] PROBLEM - cp21 NTP time on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [08:31:22] PROBLEM - cp20 Stunnel HTTP for mw111 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:31:29] RECOVERY - cp20 ferm_active on cp20 is OK: OK ferm input default policy is set [08:31:30] RECOVERY - cp21 conntrack_table_size on cp21 is OK: OK: nf_conntrack is 1 % full [08:31:48] RECOVERY - cp21 Stunnel HTTP for matomo101 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 99061 bytes in 0.305 second response time [08:32:06] RECOVERY - cp21 Stunnel HTTP for test101 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15954 bytes in 0.044 second response time [08:32:31] RECOVERY - cp21 Stunnel HTTP for mw102 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.025 second response time [08:32:33] RECOVERY - cp21 SSH on cp21 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [08:32:54] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.78, 11.29, 9.46 [08:33:00] PROBLEM - cp21 Stunnel HTTP for reports121 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [08:33:02] RECOVERY - sarovia.graalmilitary.com - LetsEncrypt on sslhost is OK: OK - Certificate 'sarovia.graalmilitary.com' will expire on Fri 12 Aug 2022 07:48:29 GMT +0000. [08:33:04] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 0.11, 0.36, 0.62 [08:33:15] RECOVERY - smashloop.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'smashloop.wiki' will expire on Wed 31 Aug 2022 22:13:31 GMT +0000. [08:33:22] PROBLEM - cp21 PowerDNS Recursor on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [08:33:46] RECOVERY - cp21 NTP time on cp21 is OK: NTP OK: Offset -0.0001895725727 secs [08:34:03] RECOVERY - arrieretoile.fr - LetsEncrypt on sslhost is OK: OK - Certificate 'arrieretoile.fr' will expire on Thu 13 Oct 2022 04:37:30 GMT +0000. [08:34:54] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 6.92, 10.09, 9.28 [08:35:03] RECOVERY - cp21 Stunnel HTTP for reports121 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 10996 bytes in 7.317 second response time [08:35:53] RECOVERY - cp21 PowerDNS Recursor on cp21 is OK: DNS OK: 0.081 seconds response time. miraheze.org returns 149.56.140.43,149.56.141.75,2607:5300:201:3100::5ebc,2607:5300:201:3100::929a [08:36:23] RECOVERY - mystiverse.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'mystiverse.wiki' will expire on Sat 01 Oct 2022 04:26:41 GMT +0000. [08:36:28] RECOVERY - wiki.worldsofweary.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.worldsofweary.com' will expire on Sat 17 Sep 2022 21:51:04 GMT +0000. [08:36:36] RECOVERY - cp20 Stunnel HTTP for mw111 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 0.588 second response time [08:37:25] PROBLEM - cp20 Stunnel HTTP for reports121 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:37:29] RECOVERY - rww2.org - LetsEncrypt on sslhost is OK: OK - Certificate 'rww2.org' will expire on Sat 17 Sep 2022 22:30:25 GMT +0000. [08:38:18] PROBLEM - cp21 conntrack_table_size on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [08:38:25] RECOVERY - en.omniversalis.org - LetsEncrypt on sslhost is OK: OK - Certificate 'en.omniversalis.org' will expire on Sat 13 Aug 2022 21:32:36 GMT +0000. [08:38:27] PROBLEM - cp21 Stunnel HTTP for mw101 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [08:39:17] RECOVERY - cp20 Varnish Backends on cp20 is OK: All 14 backends are healthy [08:39:24] RECOVERY - pt.polandballwiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'pt.polandballwiki.com' will expire on Thu 29 Sep 2022 08:59:53 GMT +0000. [08:39:55] RECOVERY - cp20 Stunnel HTTP for reports121 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 10996 bytes in 0.086 second response time [08:40:01] PROBLEM - avas.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:40:13] PROBLEM - www.polandballwiki.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:40:20] PROBLEM - cp20 HTTP 4xx/5xx ERROR Rate on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [08:40:36] RECOVERY - cp21 Stunnel HTTP for mail121 on cp21 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 427 bytes in 0.011 second response time [08:40:46] PROBLEM - en.wikiyri.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:42:31] RECOVERY - cp20 HTTP 4xx/5xx ERROR Rate on cp20 is OK: OK - NGINX Error Rate is 4% [08:43:00] RECOVERY - largedu.eu.org - LetsEncrypt on sslhost is OK: OK - Certificate 'largedu.eu.org' will expire on Wed 17 Aug 2022 15:37:36 GMT +0000. [08:43:09] PROBLEM - www.mcpk.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:43:27] PROBLEM - cp20 Varnish Backends on cp20 is CRITICAL: 2 backends are down. mw102 mw121 [08:43:39] PROBLEM - unmade.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:44:24] RECOVERY - www.iceria.org - LetsEncrypt on sslhost is OK: OK - Certificate 'www.iceria.org' will expire on Sat 17 Sep 2022 21:13:26 GMT +0000. [08:44:31] RECOVERY - drowiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'drowiki.com' will expire on Tue 04 Oct 2022 18:56:56 GMT +0000. [08:44:41] PROBLEM - cp21 Stunnel HTTP for matomo101 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [08:44:47] RECOVERY - sammaditthi.cyou - LetsEncrypt on sslhost is OK: OK - Certificate 'sammaditthi.cyou' will expire on Sat 08 Oct 2022 06:03:19 GMT +0000. [08:44:48] PROBLEM - fortis.miraheze.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:46:00] RECOVERY - cp21 conntrack_table_size on cp21 is OK: OK: nf_conntrack is 3 % full [08:46:20] RECOVERY - data.nonbinary.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'data.nonbinary.wiki' will expire on Mon 22 Aug 2022 23:00:39 GMT +0000. [08:46:57] RECOVERY - cp21 Stunnel HTTP for matomo101 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 99061 bytes in 3.606 second response time [08:47:36] PROBLEM - wiki.helsinginpoytaroolipelaajat.fi - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:48:09] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [08:48:40] RECOVERY - cp21 Stunnel HTTP for mw101 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 3.014 second response time [08:48:46] RECOVERY - allthetropes.org - LetsEncrypt on sslhost is OK: OK - Certificate 'allthetropes.org' will expire on Tue 23 Aug 2022 01:54:39 GMT +0000. [08:48:53] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 14.73, 10.41, 8.81 [08:50:02] PROBLEM - wiki.make717.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:50:27] PROBLEM - cp21 Stunnel HTTP for mwtask111 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [08:50:53] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.28, 10.23, 8.97 [08:51:07] PROBLEM - cp20 Stunnel HTTP for mw111 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:51:38] PROBLEM - wiki.qadrishattari.xyz - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:52:05] PROBLEM - m.miraheze.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:52:38] PROBLEM - wiki.dereric.gq - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:52:43] PROBLEM - pastport.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:52:54] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 6.32, 8.55, 8.49 [08:52:58] PROBLEM - cp21 Stunnel HTTP for matomo101 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [08:53:31] PROBLEM - wiki.digitalcandela.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:53:36] RECOVERY - cp20 Stunnel HTTP for mw111 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.020 second response time [08:53:47] PROBLEM - cp21 Stunnel HTTP for mw112 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:53:58] RECOVERY - m.miraheze.org - LetsEncrypt on sslhost is OK: OK - Certificate 'm.miraheze.org' will expire on Tue 06 Sep 2022 21:18:17 GMT +0000. [08:54:33] RECOVERY - cp21 Stunnel HTTP for mwtask111 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15950 bytes in 1.029 second response time [08:54:42] PROBLEM - wiki.kachow.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:54:54] RECOVERY - cp20 Puppet on cp20 is OK: OK: Puppet is currently enabled, last run 19 seconds ago with 0 failures [08:54:59] RECOVERY - cp21 Stunnel HTTP for matomo101 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 99061 bytes in 1.303 second response time [08:55:28] PROBLEM - famedata.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:55:44] PROBLEM - scpvncommunitywiki.xyz - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:55:48] RECOVERY - cp21 Stunnel HTTP for mw112 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 0.200 second response time [08:56:29] PROBLEM - cp21 Stunnel HTTP for reports121 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:57:23] PROBLEM - commons.ballmedia.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:58:02] PROBLEM - wiki.teessidehackspace.org.uk - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:58:25] RECOVERY - cp21 Stunnel HTTP for reports121 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 10996 bytes in 1.081 second response time [08:58:41] PROBLEM - cp21 Stunnel HTTP for mw101 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [08:58:53] RECOVERY - betaheze.org - LetsEncrypt on sslhost is OK: OK - Certificate 'betaheze.org' will expire on Fri 19 Aug 2022 17:58:05 GMT +0000. [08:59:18] PROBLEM - wiki.bikinibottomdiscord.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:59:24] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [08:59:43] PROBLEM - wiki.macc.nyc - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:59:55] PROBLEM - squareenix.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:00:39] PROBLEM - grc.repository.archiopedia.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:00:42] RECOVERY - thepolicyhub.org.uk - LetsEncrypt on sslhost is OK: OK - Certificate 'thepolicyhub.org.uk' will expire on Tue 23 Aug 2022 02:56:36 GMT +0000. [09:00:53] RECOVERY - cp21 Stunnel HTTP for mw101 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 1.052 second response time [09:01:04] PROBLEM - infectowiki.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:01:13] PROBLEM - wiki.slimeapedia.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:01:49] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 0.56, 0.81, 0.74 [09:03:14] PROBLEM - cp21 Stunnel HTTP for mail121 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [09:03:24] PROBLEM - wiki.funkey-project.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:04:24] PROBLEM - cp20 SSH on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:04:45] RECOVERY - slymods.info - LetsEncrypt on sslhost is OK: OK - Certificate 'slymods.info' will expire on Fri 21 Oct 2022 06:31:32 GMT +0000. [09:05:34] RECOVERY - cp21 Stunnel HTTP for mail121 on cp21 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 427 bytes in 5.061 second response time [09:06:09] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::4c25/cpweb [09:07:31] PROBLEM - stablestate.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:08:09] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [09:08:23] RECOVERY - cp20 SSH on cp20 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [09:08:33] PROBLEM - mystiverse.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:08:57] PROBLEM - privacywiki.xyz - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:09:01] PROBLEM - icclopedia.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:09:06] PROBLEM - rww2.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:09:48] RECOVERY - avas.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'avas.wiki' will expire on Mon 10 Oct 2022 04:52:24 GMT +0000. [09:09:53] RECOVERY - en.wikiyri.org - LetsEncrypt on sslhost is OK: OK - Certificate 'en.wikiyri.org' will expire on Wed 28 Sep 2022 05:13:53 GMT +0000. [09:10:00] RECOVERY - www.polandballwiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'www.polandballwiki.com' will expire on Thu 29 Sep 2022 08:52:53 GMT +0000. [09:10:31] PROBLEM - wiki.rtapp.tk - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:11:04] PROBLEM - cp20 Stunnel HTTP for mw102 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:11:42] PROBLEM - notes.mridulpm.in - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:11:51] PROBLEM - animatedfeet.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:11:54] RECOVERY - www.mcpk.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'www.mcpk.wiki' will expire on Sat 17 Sep 2022 18:44:27 GMT +0000. [09:11:58] PROBLEM - wc.miraheze.org on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:12:05] PROBLEM - cloud12 Puppet on cloud12 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[ulogd2] [09:12:09] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 2 datacenters are down: 2001:41d0:801:2000::4c25/cpweb, 2001:41d0:801:2000::1b80/cpweb [09:12:52] RECOVERY - unmade.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [09:13:02] PROBLEM - cp20 Stunnel HTTP for matomo101 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:13:38] RECOVERY - cp20 Stunnel HTTP for mw102 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 3.052 second response time [09:13:42] RECOVERY - fortis.miraheze.org - LetsEncrypt on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [09:13:51] RECOVERY - cloudwiki.org - LetsEncrypt on sslhost is OK: OK - Certificate 'cloudwiki.org' will expire on Sun 23 Oct 2022 16:49:57 GMT +0000. [09:13:52] RECOVERY - wc.miraheze.org on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [09:14:52] PROBLEM - cp21 HTTPS on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:15:29] RECOVERY - cp20 Stunnel HTTP for matomo101 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 99061 bytes in 1.246 second response time [09:15:57] PROBLEM - hoodwiki.xyz - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:16:14] RECOVERY - wiki.helsinginpoytaroolipelaajat.fi - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.helsinginpoytaroolipelaajat.fi' will expire on Mon 29 Aug 2022 12:44:24 GMT +0000. [09:18:58] RECOVERY - cp21 HTTPS on cp21 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 3403 bytes in 1.024 second response time [09:20:05] PROBLEM - m.miraheze.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:20:53] RECOVERY - wiki.qadrishattari.xyz - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.qadrishattari.xyz' will expire on Sat 01 Oct 2022 16:09:21 GMT +0000. [09:20:56] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.20, 1.61, 1.10 [09:20:59] PROBLEM - cp20 Stunnel HTTP for phab121 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:21:03] RECOVERY - cp20 Varnish Backends on cp20 is OK: All 14 backends are healthy [09:21:47] RECOVERY - intp.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [09:21:47] RECOVERY - pastport.org - LetsEncrypt on sslhost is OK: OK - Certificate 'pastport.org' will expire on Wed 31 Aug 2022 20:55:03 GMT +0000. [09:21:51] RECOVERY - wiki.dereric.gq - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.dereric.gq' will expire on Sat 22 Oct 2022 22:30:02 GMT +0000. [09:21:58] RECOVERY - m.miraheze.org - LetsEncrypt on sslhost is OK: OK - Certificate 'm.miraheze.org' will expire on Tue 06 Sep 2022 21:18:17 GMT +0000. [09:22:07] RECOVERY - wiki.digitalcandela.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.digitalcandela.com' will expire on Mon 17 Oct 2022 03:48:33 GMT +0000. [09:22:09] PROBLEM - patternarchive.online - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:23:06] RECOVERY - cp20 Stunnel HTTP for phab121 on cp20 is OK: HTTP OK: Status line output matched "500" - 2855 bytes in 1.066 second response time [09:24:04] RECOVERY - wiki.kachow.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.kachow.org' will expire on Wed 12 Oct 2022 04:17:08 GMT +0000. [09:24:07] PROBLEM - cp21 Stunnel HTTP for mw101 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [09:24:53] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.72, 1.66, 1.23 [09:24:56] PROBLEM - cp20 Varnish Backends on cp20 is CRITICAL: 1 backends are down. mw122 [09:25:26] RECOVERY - famedata.org - LetsEncrypt on sslhost is OK: OK - Certificate 'famedata.org' will expire on Thu 29 Sep 2022 07:42:43 GMT +0000. [09:26:18] RECOVERY - cp21 Stunnel HTTP for mw101 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 7.250 second response time [09:26:52] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.10, 1.36, 1.16 [09:27:12] RECOVERY - commons.ballmedia.org - LetsEncrypt on sslhost is OK: OK - Certificate 'commons.ballmedia.org' will expire on Mon 10 Oct 2022 06:16:04 GMT +0000. [09:28:27] RECOVERY - wiki.macc.nyc - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.macc.nyc' will expire on Wed 31 Aug 2022 20:26:03 GMT +0000. [09:28:48] RECOVERY - squareenix.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [09:29:27] PROBLEM - cp20 Stunnel HTTP for mw121 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [09:30:01] PROBLEM - cp20 Stunnel HTTP for puppet111 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [09:30:29] RECOVERY - grc.repository.archiopedia.org - LetsEncrypt on sslhost is OK: OK - Certificate 'grc.repository.archiopedia.org' will expire on Sat 17 Sep 2022 19:06:52 GMT +0000. [09:31:15] PROBLEM - recaptime.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:31:24] RECOVERY - cp20 Stunnel HTTP for mw121 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 1.037 second response time [09:31:44] PROBLEM - cp20 Stunnel HTTP for mw111 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [09:32:03] RECOVERY - cp20 Stunnel HTTP for puppet111 on cp20 is OK: HTTP OK: Status line output matched "403" - 289 bytes in 2.033 second response time [09:32:36] PROBLEM - cp21 ferm_active on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [09:33:58] RECOVERY - cp20 Stunnel HTTP for mw111 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.017 second response time [09:34:38] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.06, 9.59, 7.15 [09:35:38] PROBLEM - cp21 Stunnel HTTP for phab121 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:36:01] PROBLEM - cp21 Stunnel HTTP for mw121 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [09:36:38] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 5.46, 7.92, 6.83 [09:37:15] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [09:37:53] RECOVERY - cp21 Stunnel HTTP for phab121 on cp21 is OK: HTTP OK: Status line output matched "500" - 2855 bytes in 1.089 second response time [09:37:58] RECOVERY - privacywiki.xyz - LetsEncrypt on sslhost is OK: OK - Certificate 'privacywiki.xyz' will expire on Mon 26 Sep 2022 13:36:29 GMT +0000. [09:38:05] RECOVERY - icclopedia.org - LetsEncrypt on sslhost is OK: OK - Certificate 'icclopedia.org' will expire on Wed 24 Aug 2022 03:23:05 GMT +0000. [09:38:14] RECOVERY - rww2.org - LetsEncrypt on sslhost is OK: OK - Certificate 'rww2.org' will expire on Sat 17 Sep 2022 22:30:25 GMT +0000. [09:38:25] PROBLEM - www.puzzles.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:38:28] RECOVERY - cp21 Stunnel HTTP for mw121 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.018 second response time [09:38:51] PROBLEM - wiki.nevillepedia.eu - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:39:32] RECOVERY - wiki.rtapp.tk - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.rtapp.tk' will expire on Sun 14 Aug 2022 00:07:41 GMT +0000. [09:40:01] PROBLEM - archive.stellurgists.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:40:04] RECOVERY - cloud12 Puppet on cloud12 is OK: OK: Puppet is currently enabled, last run 54 seconds ago with 0 failures [09:40:07] PROBLEM - www.electrowiki.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:40:15] PROBLEM - wikimas.kr - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:40:19] PROBLEM - pwsc.polandballwiki.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:40:31] RECOVERY - notes.mridulpm.in - LetsEncrypt on sslhost is OK: OK - Certificate 'notes.mridulpm.in' will expire on Tue 20 Sep 2022 12:00:20 GMT +0000. [09:40:34] PROBLEM - lcn.zfc.id.lv - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:40:55] RECOVERY - cp21 ferm_active on cp21 is OK: OK ferm input default policy is set [09:41:03] RECOVERY - itora.bunnies1230.com - LetsEncrypt on sslhost is OK: OK - Certificate 'itora.bunnies1230.com' will expire on Tue 20 Sep 2022 01:50:31 GMT +0000. [09:41:12] PROBLEM - cp20 Stunnel HTTP for mon111 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [09:41:44] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 11.65, 9.36, 7.23 [09:41:50] PROBLEM - cp21 NTP time on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [09:42:10] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 0.93, 0.82, 0.72 [09:42:16] PROBLEM - sims.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:42:18] RECOVERY - ngsswiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'ngsswiki.com' will expire on Sun 02 Oct 2022 05:32:39 GMT +0000. [09:43:02] PROBLEM - cp20 SSH on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:43:03] PROBLEM - wiki.ssangyongsports.eu.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:43:10] PROBLEM - www.mcpk.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:43:16] RECOVERY - cp20 Stunnel HTTP for mon111 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 39185 bytes in 5.077 second response time [09:43:44] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 5.54, 8.21, 7.10 [09:44:09] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [09:44:48] PROBLEM - commonswiki.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:44:57] RECOVERY - cp20 SSH on cp20 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [09:45:42] PROBLEM - test3.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:46:27] PROBLEM - rarewiki.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:46:53] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [09:47:01] RECOVERY - cp21 NTP time on cp21 is OK: NTP OK: Offset -0.001452505589 secs [09:47:19] PROBLEM - en.famepedia.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:47:47] PROBLEM - cp20 Stunnel HTTP for mon111 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:48:50] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.03, 0.92, 0.74 [09:49:13] PROBLEM - cp20 Stunnel HTTP for puppet111 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:49:26] RECOVERY - wiki.make717.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.make717.org' will expire on Mon 22 Aug 2022 23:35:07 GMT +0000. [09:49:46] RECOVERY - cp20 Stunnel HTTP for mon111 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 39185 bytes in 0.060 second response time [09:50:12] PROBLEM - m.miraheze.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:50:27] PROBLEM - cp21 Stunnel HTTP for mw102 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:50:31] PROBLEM - en.pornwiki.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:51:33] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.86, 3.35, 2.99 [09:51:41] PROBLEM - wc.miraheze.org on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:51:43] RECOVERY - patternarchive.online - LetsEncrypt on sslhost is OK: OK - Certificate 'patternarchive.online' will expire on Sat 17 Sep 2022 18:49:33 GMT +0000. [09:51:43] PROBLEM - cp21 ferm_active on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [09:52:06] PROBLEM - wiki.thunis.eu - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:52:14] PROBLEM - wiki.timewisely.net - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:52:37] PROBLEM - pwiki.drydraytonvillagehall.org.uk - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:53:31] PROBLEM - wiki.danvs.net - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:53:32] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 3.04, 3.16, 2.96 [09:53:35] RECOVERY - wc.miraheze.org on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [09:53:35] PROBLEM - cp20 Stunnel HTTP for mw102 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:53:59] PROBLEM - thelonsdalebattalion.co.uk - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:54:10] RECOVERY - m.miraheze.org - LetsEncrypt on sslhost is OK: OK - Certificate 'm.miraheze.org' will expire on Tue 06 Sep 2022 21:18:17 GMT +0000. [09:54:12] PROBLEM - cp21 Stunnel HTTP for mwtask111 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [09:54:55] PROBLEM - wiki.yahyabd.xyz - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:56:09] RECOVERY - cp21 Stunnel HTTP for mwtask111 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15950 bytes in 1.037 second response time [09:56:27] PROBLEM - cp21 Stunnel HTTP for test101 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [09:56:28] RECOVERY - ecole.science - LetsEncrypt on sslhost is OK: OK - Certificate 'ecole.science' will expire on Mon 22 Aug 2022 21:07:09 GMT +0000. [09:56:35] PROBLEM - archive.a2b2.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:56:36] RECOVERY - cp21 ferm_active on cp21 is OK: OK ferm input default policy is set [09:57:07] PROBLEM - wiki.parappa.dev - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:57:13] RECOVERY - wiki.ct777.cf - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.ct777.cf' will expire on Sun 02 Oct 2022 10:59:59 GMT +0000. [09:57:15] RECOVERY - cp20 Stunnel HTTP for puppet111 on cp20 is OK: HTTP OK: Status line output matched "403" - 289 bytes in 0.019 second response time [09:57:38] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.47, 9.35, 7.78 [09:57:50] RECOVERY - cp21 Stunnel HTTP for mw102 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.023 second response time [09:58:23] RECOVERY - cp21 Stunnel HTTP for test101 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15954 bytes in 0.035 second response time [09:58:28] PROBLEM - wiki.recaptime.eu.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:58:40] RECOVERY - wiki.bikinibottomdiscord.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.bikinibottomdiscord.org' will expire on Mon 22 Aug 2022 21:26:08 GMT +0000. [09:58:58] PROBLEM - cp21 SSH on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:59:37] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.77, 9.94, 8.19 [09:59:38] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.31, 1.60, 1.99 [10:00:02] RECOVERY - recaptime.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [10:00:04] PROBLEM - wikipedia.yogfront.ooo - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:00:21] PROBLEM - wiki-asterix.cf - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:00:30] PROBLEM - portalsofphereon.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:00:34] PROBLEM - wiki.newnormal.fans - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:00:41] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::4c25/cpweb [10:00:45] RECOVERY - cp20 Stunnel HTTP for mw102 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 2.693 second response time [10:00:46] PROBLEM - www.marinebiodiversitymatrix.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:01:13] PROBLEM - civclassic.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:01:44] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 11.77, 8.46, 6.79 [10:02:01] RECOVERY - wiki.funkey-project.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.funkey-project.com' will expire on Tue 23 Aug 2022 08:26:19 GMT +0000. [10:03:05] RECOVERY - cp21 SSH on cp21 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [10:03:33] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 6.91, 9.47, 8.48 [10:03:44] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 8.07, 8.63, 7.09 [10:04:13] PROBLEM - finalfantasy.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:04:39] PROBLEM - cp21 Stunnel HTTP for mw112 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [10:05:25] PROBLEM - cp21 Stunnel HTTP for mw101 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:06:21] PROBLEM - cp20 Stunnel HTTP for mw101 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:06:34] RECOVERY - cp21 Stunnel HTTP for mw112 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.023 second response time [10:07:19] PROBLEM - robloxapi.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:07:24] RECOVERY - cp21 Stunnel HTTP for mw101 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 3.063 second response time [10:07:44] RECOVERY - wiki.nevillepedia.eu - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.nevillepedia.eu' will expire on Wed 24 Aug 2022 04:41:20 GMT +0000. [10:08:13] RECOVERY - www.puzzles.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'www.puzzles.wiki' will expire on Thu 20 Oct 2022 16:22:25 GMT +0000. [10:08:32] RECOVERY - cp20 Stunnel HTTP for mw101 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 1.036 second response time [10:08:59] RECOVERY - www.electrowiki.org - LetsEncrypt on sslhost is OK: OK - Certificate 'electrowiki.org' will expire on Sat 17 Sep 2022 19:15:15 GMT +0000. [10:09:16] RECOVERY - wikimas.kr - LetsEncrypt on sslhost is OK: OK - Certificate 'wikimas.kr' will expire on Tue 23 Aug 2022 13:01:24 GMT +0000. [10:09:30] RECOVERY - lcn.zfc.id.lv - LetsEncrypt on sslhost is OK: OK - Certificate 'lcn.zfc.id.lv' will expire on Wed 31 Aug 2022 21:26:51 GMT +0000. [10:09:41] RECOVERY - archive.stellurgists.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'archive.stellurgists.wiki' will expire on Tue 23 Aug 2022 00:33:03 GMT +0000. [10:09:50] RECOVERY - pwsc.polandballwiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'pwsc.polandballwiki.com' will expire on Sun 02 Oct 2022 10:41:20 GMT +0000. [10:10:09] PROBLEM - test2.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:10:54] PROBLEM - cp20 Stunnel HTTP for test101 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:11:01] RECOVERY - sims.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [10:11:15] RECOVERY - animatedfeet.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [10:11:38] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.24, 1.35, 1.64 [10:11:43] RECOVERY - wiki.ssangyongsports.eu.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.ssangyongsports.eu.org' will expire on Wed 31 Aug 2022 22:12:11 GMT +0000. [10:11:54] RECOVERY - www.mcpk.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'www.mcpk.wiki' will expire on Sat 17 Sep 2022 18:44:27 GMT +0000. [10:12:09] PROBLEM - cp20 Disk Space on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [10:13:33] RECOVERY - hoodwiki.xyz - LetsEncrypt on sslhost is OK: OK - Certificate 'hoodwiki.xyz' will expire on Wed 19 Oct 2022 06:37:38 GMT +0000. [10:13:42] RECOVERY - commonswiki.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [10:14:05] PROBLEM - cp20 PowerDNS Recursor on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [10:14:14] PROBLEM - wiki.lu9.io - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:14:35] PROBLEM - cp20 Stunnel HTTP for mw112 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [10:14:41] RECOVERY - cp20 Disk Space on cp20 is OK: DISK OK - free space: / 11061 MB (28% inode=96%); [10:14:41] PROBLEM - cp21 Stunnel HTTP for mw101 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [10:15:17] RECOVERY - cp20 Stunnel HTTP for test101 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15954 bytes in 1.054 second response time [10:15:22] PROBLEM - cp21 Stunnel HTTP for mail121 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [10:15:27] RECOVERY - test3.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [10:15:28] RECOVERY - rarewiki.org - LetsEncrypt on sslhost is OK: OK - Certificate 'rarewiki.org' will expire on Wed 28 Sep 2022 05:06:19 GMT +0000. [10:15:57] PROBLEM - www.winenjoy.net - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:16:50] RECOVERY - cp20 Stunnel HTTP for mw112 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.020 second response time [10:17:04] RECOVERY - en.famepedia.org - LetsEncrypt on sslhost is OK: OK - Certificate 'en.famepedia.org' will expire on Mon 10 Oct 2022 05:45:28 GMT +0000. [10:17:10] RECOVERY - cp21 Stunnel HTTP for mw101 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 1.042 second response time [10:18:07] PROBLEM - cp21 HTTP 4xx/5xx ERROR Rate on cp21 is WARNING: WARNING - NGINX Error Rate is 45% [10:18:11] PROBLEM - cp21 Stunnel HTTP for mw102 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:18:38] PROBLEM - cp21 PowerDNS Recursor on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [10:18:54] PROBLEM - cp21 conntrack_table_size on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [10:19:17] RECOVERY - cp20 PowerDNS Recursor on cp20 is OK: DNS OK: 0.164 seconds response time. miraheze.org returns 198.244.148.90,2001:41d0:801:2000::1b80,2001:41d0:801:2000::4c25,51.195.220.68 [10:19:38] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.56, 1.76, 1.66 [10:19:46] RECOVERY - cp21 Stunnel HTTP for mail121 on cp21 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 427 bytes in 0.032 second response time [10:20:07] RECOVERY - cp21 HTTP 4xx/5xx ERROR Rate on cp21 is OK: OK - NGINX Error Rate is 7% [10:20:21] PROBLEM - cp21 Disk Space on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [10:20:37] RECOVERY - cp21 PowerDNS Recursor on cp21 is OK: DNS OK: 0.088 seconds response time. miraheze.org returns 198.244.148.90,2001:41d0:801:2000::4c25,51.195.220.68 [10:20:47] RECOVERY - wiki.thunis.eu - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.thunis.eu' will expire on Tue 23 Aug 2022 01:47:24 GMT +0000. [10:21:19] PROBLEM - cp20 Stunnel HTTP for mw121 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [10:21:20] RECOVERY - cp21 conntrack_table_size on cp21 is OK: OK: nf_conntrack is 4 % full [10:21:21] PROBLEM - wiki.meeusen.net - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:21:27] RECOVERY - wiki.timewisely.net - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.timewisely.net' will expire on Mon 22 Aug 2022 22:01:18 GMT +0000. [10:21:47] PROBLEM - wiki.ciptamedia.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:21:49] PROBLEM - www.lgbtqia.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:22:08] PROBLEM - pa.gyaanipedia.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:22:14] RECOVERY - wiki.danvs.net - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.danvs.net' will expire on Tue 23 Aug 2022 02:16:10 GMT +0000. [10:22:20] RECOVERY - cp21 Disk Space on cp21 is OK: DISK OK - free space: / 10907 MB (28% inode=96%); [10:23:10] PROBLEM - cp21 Stunnel HTTP for matomo101 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [10:23:17] PROBLEM - cp21 Stunnel HTTP for mw101 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [10:23:26] RECOVERY - wiki.yahyabd.xyz - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.yahyabd.xyz' will expire on Sun 14 Aug 2022 20:06:30 GMT +0000. [10:23:35] PROBLEM - wiki.scvo.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:23:38] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.77, 2.00, 1.81 [10:23:48] PROBLEM - cp20 conntrack_table_size on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [10:23:48] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 11.99, 9.38, 7.80 [10:23:51] RECOVERY - cp20 Stunnel HTTP for mw121 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 0.023 second response time [10:24:00] PROBLEM - cnt.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:25:28] PROBLEM - www.portalsofphereon.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:25:33] RECOVERY - cp21 Stunnel HTTP for mw101 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 3.253 second response time [10:25:35] RECOVERY - wiki.teessidehackspace.org.uk - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.teessidehackspace.org.uk' will expire on Wed 21 Sep 2022 09:01:23 GMT +0000. [10:25:43] RECOVERY - cp20 conntrack_table_size on cp20 is OK: OK: nf_conntrack is 6 % full [10:25:48] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.08, 10.17, 8.28 [10:25:56] PROBLEM - www.sdiy.info - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:26:05] PROBLEM - dc-multiverse.dcwikis.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:26:09] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [10:26:15] RECOVERY - wiki.parappa.dev - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.parappa.dev' will expire on Sun 18 Sep 2022 13:44:45 GMT +0000. [10:26:54] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [10:27:45] RECOVERY - crocwiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'crocwiki.com' will expire on Thu 15 Sep 2022 05:33:41 GMT +0000. [10:27:47] PROBLEM - wiki.ravynos.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:27:47] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 5.12, 8.07, 7.73 [10:28:20] RECOVERY - cp21 Stunnel HTTP for matomo101 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 99061 bytes in 0.407 second response time [10:28:34] RECOVERY - cp21 Stunnel HTTP for mw102 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 4.312 second response time [10:28:47] RECOVERY - wiki.slimeapedia.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.slimeapedia.org' will expire on Mon 10 Oct 2022 05:19:54 GMT +0000. [10:29:04] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 0.56, 0.71, 0.76 [10:29:30] PROBLEM - guia.esporo.net - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:29:39] PROBLEM - microworldwiki.ga - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:29:39] PROBLEM - wiki.ct777.cf - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:29:40] PROBLEM - electowiki.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:29:42] RECOVERY - wiki.newnormal.fans - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.newnormal.fans' will expire on Fri 14 Oct 2022 16:20:05 GMT +0000. [10:29:45] RECOVERY - wiki-asterix.cf - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki-asterix.cf' will expire on Sat 17 Sep 2022 20:36:30 GMT +0000. [10:29:57] RECOVERY - civclassic.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [10:30:16] RECOVERY - portalsofphereon.com - LetsEncrypt on sslhost is OK: OK - Certificate 'www.portalsofphereon.com' will expire on Sat 17 Sep 2022 20:30:32 GMT +0000. [10:30:17] PROBLEM - cp21 ferm_active on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [10:30:17] PROBLEM - cp20 Stunnel HTTP for mon111 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:30:22] RECOVERY - www.marinebiodiversitymatrix.org - LetsEncrypt on sslhost is OK: OK - Certificate 'marinebiodiversitymatrix.org' will expire on Wed 24 Aug 2022 01:59:18 GMT +0000. [10:31:17] PROBLEM - recaptime.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:31:58] PROBLEM - wiki.vinesh.eu.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:32:00] PROBLEM - thenintendowiki.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:32:05] PROBLEM - m.miraheze.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:32:09] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::4c25/cpweb [10:33:01] RECOVERY - finalfantasy.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [10:33:17] PROBLEM - cp21 HTTP 4xx/5xx ERROR Rate on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [10:33:38] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.25, 1.58, 1.69 [10:34:09] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [10:34:38] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.42, 8.76, 6.34 [10:35:12] RECOVERY - stablestate.org - LetsEncrypt on sslhost is OK: OK - Certificate 'stablestate.org' will expire on Tue 23 Aug 2022 08:41:48 GMT +0000. [10:35:15] RECOVERY - cp20 Stunnel HTTP for mon111 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 39170 bytes in 0.042 second response time [10:35:16] RECOVERY - cp21 HTTP 4xx/5xx ERROR Rate on cp21 is OK: OK - NGINX Error Rate is 16% [10:35:40] RECOVERY - cp21 ferm_active on cp21 is OK: OK ferm input default policy is set [10:35:48] PROBLEM - cp21 conntrack_table_size on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [10:36:10] PROBLEM - cp20 Stunnel HTTP for mw112 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [10:36:38] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.41, 8.70, 6.64 [10:36:46] PROBLEM - cp21 Stunnel HTTP for mon111 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [10:37:09] PROBLEM - celeste.ink - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:37:46] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [10:38:03] RECOVERY - mystiverse.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'mystiverse.wiki' will expire on Sat 01 Oct 2022 04:26:41 GMT +0000. [10:38:12] RECOVERY - m.miraheze.org - LetsEncrypt on sslhost is OK: OK - Certificate 'm.miraheze.org' will expire on Tue 06 Sep 2022 21:18:17 GMT +0000. [10:38:27] RECOVERY - cp20 Stunnel HTTP for mw112 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 2.039 second response time [10:38:42] RECOVERY - cp21 Stunnel HTTP for mon111 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 39185 bytes in 0.048 second response time [10:38:49] PROBLEM - az.wikiretet.ga - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:38:54] RECOVERY - test2.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [10:39:19] PROBLEM - pt.polandballwiki.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:39:27] PROBLEM - inourownwords.online - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:39:34] PROBLEM - source.erag.eu.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:39:55] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 0.54, 0.91, 0.86 [10:40:03] PROBLEM - wiki.ameristraliagov.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:40:10] PROBLEM - cp20 Stunnel HTTP for puppet111 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:40:15] PROBLEM - cp21 Stunnel HTTP for mw111 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [10:40:55] PROBLEM - cp21 Stunnel HTTP for reports121 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [10:41:42] PROBLEM - burnout.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:41:46] PROBLEM - proficientprofit.click - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:42:11] RECOVERY - cp20 Stunnel HTTP for puppet111 on cp20 is OK: HTTP OK: Status line output matched "403" - 289 bytes in 0.011 second response time [10:42:15] PROBLEM - cp20 SSH on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:42:28] PROBLEM - cp21 Stunnel HTTP for mw122 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [10:42:56] PROBLEM - cp21 Stunnel HTTP for phab121 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [10:42:57] RECOVERY - cp21 Stunnel HTTP for reports121 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 10996 bytes in 5.067 second response time [10:43:53] PROBLEM - cp21 SSH on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:44:08] RECOVERY - wiki.lu9.io - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.lu9.io' will expire on Tue 06 Sep 2022 20:59:54 GMT +0000. [10:44:12] PROBLEM - roll-of-arms.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:44:13] PROBLEM - wiki-tintin.cf - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:44:13] RECOVERY - cp20 SSH on cp20 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [10:44:24] PROBLEM - persist.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:44:33] RECOVERY - cp21 Stunnel HTTP for mw122 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 8.769 second response time [10:44:33] RECOVERY - www.winenjoy.net - LetsEncrypt on sslhost is OK: OK - Certificate 'www.winenjoy.net' will expire on Sun 02 Oct 2022 10:20:46 GMT +0000. [10:44:55] RECOVERY - cp21 Stunnel HTTP for phab121 on cp21 is OK: HTTP OK: Status line output matched "500" - 2855 bytes in 1.098 second response time [10:45:01] PROBLEM - fortis.miraheze.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:45:23] PROBLEM - cp31 Stunnel HTTP for mw122 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:45:32] PROBLEM - cp20 Stunnel HTTP for mw122 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:45:36] PROBLEM - cp20 Stunnel HTTP for matomo101 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [10:46:07] PROBLEM - cp21 Stunnel HTTP for matomo101 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [10:46:50] PROBLEM - with.cpt-ra.bid - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:46:54] PROBLEM - rarewiki.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:47:08] PROBLEM - cp21 Stunnel HTTP for mwtask111 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [10:47:23] RECOVERY - cp31 Stunnel HTTP for mw122 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.319 second response time [10:47:31] RECOVERY - cp20 Stunnel HTTP for matomo101 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 99061 bytes in 0.192 second response time [10:48:03] RECOVERY - cp21 SSH on cp21 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [10:48:48] PROBLEM - www.journeytheword.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:49:10] PROBLEM - cp21 Stunnel HTTP for mw101 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:49:18] RECOVERY - cp21 conntrack_table_size on cp21 is OK: OK: nf_conntrack is 5 % full [10:49:38] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.93, 2.16, 1.77 [10:50:12] PROBLEM - evil.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:50:13] RECOVERY - cp21 Stunnel HTTP for mw111 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 1.034 second response time [10:50:34] RECOVERY - cp20 Stunnel HTTP for mw122 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 1.044 second response time [10:50:39] RECOVERY - www.lgbtqia.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'www.lgbtqia.wiki' will expire on Fri 07 Oct 2022 11:35:52 GMT +0000. [10:50:41] PROBLEM - cp21 Stunnel HTTP for puppet111 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [10:50:47] RECOVERY - wiki.meeusen.net - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.meeusen.net' will expire on Sat 17 Sep 2022 21:26:27 GMT +0000. [10:51:00] PROBLEM - www.dariawiki.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:51:11] RECOVERY - pwiki.drydraytonvillagehall.org.uk - LetsEncrypt on sslhost is OK: OK - Certificate 'pwiki.drydraytonvillagehall.org.uk' will expire on Wed 12 Oct 2022 13:33:40 GMT +0000. [10:51:13] RECOVERY - cp21 Stunnel HTTP for mw101 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 5.825 second response time [10:51:24] RECOVERY - cp21 Stunnel HTTP for mwtask111 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15956 bytes in 1.062 second response time [10:51:48] PROBLEM - heavyironmodding.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:52:15] RECOVERY - wiki.scvo.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.scvo.org' will expire on Tue 23 Aug 2022 09:01:11 GMT +0000. [10:52:27] PROBLEM - cp20 SSH on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:52:34] PROBLEM - cp20 Stunnel HTTP for mon111 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [10:52:37] PROBLEM - wiki.consid.vn - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:52:42] RECOVERY - cp21 Stunnel HTTP for puppet111 on cp21 is OK: HTTP OK: Status line output matched "403" - 289 bytes in 0.010 second response time [10:53:01] PROBLEM - wiki.mineland.eu - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:53:09] RECOVERY - cnt.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [10:53:19] PROBLEM - deepdark.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:53:21] PROBLEM - files.pornwiki.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:53:41] RECOVERY - cp21 Stunnel HTTP for matomo101 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 99061 bytes in 0.256 second response time [10:53:51] PROBLEM - dariawiki.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:54:16] PROBLEM - wiki.valkyrienskies.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:54:22] PROBLEM - wiki.sketch.town - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:54:37] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 2 datacenters are down: 2001:41d0:801:2000::4c25/cpweb, 2001:41d0:801:2000::1b80/cpweb [10:55:55] RECOVERY - www.sdiy.info - LetsEncrypt on sslhost is OK: OK - Certificate 'sdiy.info' will expire on Sat 17 Sep 2022 21:29:52 GMT +0000. [10:55:56] RECOVERY - dc-multiverse.dcwikis.com - LetsEncrypt on sslhost is OK: OK - Certificate 'dc-multiverse.dcwikis.com' will expire on Wed 24 Aug 2022 05:08:53 GMT +0000. [10:56:29] PROBLEM - dragonquestwiki.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:56:40] PROBLEM - polandballwiki.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:56:44] RECOVERY - wiki.recaptime.eu.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.recaptime.eu.org' will expire on Mon 03 Oct 2022 22:23:06 GMT +0000. [10:56:47] RECOVERY - cp20 Stunnel HTTP for mon111 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 39185 bytes in 1.068 second response time [10:57:02] PROBLEM - cp21 HTTPS on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:57:14] PROBLEM - cp21 Stunnel HTTP for mw101 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:57:17] PROBLEM - wiki.graalmilitary.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:57:39] RECOVERY - wiki.ravynos.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.ravynos.com' will expire on Thu 01 Sep 2022 00:45:42 GMT +0000. [10:57:41] PROBLEM - wc.miraheze.org on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:58:01] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.52, 9.31, 6.54 [10:58:13] RECOVERY - guia.esporo.net - LetsEncrypt on sslhost is OK: OK - Certificate 'guia.esporo.net' will expire on Tue 23 Aug 2022 02:23:57 GMT +0000. [10:58:14] PROBLEM - cp20 Stunnel HTTP for mw112 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [10:58:22] RECOVERY - wiki.ct777.cf - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.ct777.cf' will expire on Sun 02 Oct 2022 10:59:59 GMT +0000. [10:58:22] RECOVERY - microworldwiki.ga - LetsEncrypt on sslhost is OK: OK - Certificate 'microworldwiki.ga' will expire on Mon 26 Sep 2022 05:41:37 GMT +0000. [10:58:24] RECOVERY - wikipedia.yogfront.ooo - LetsEncrypt on sslhost is OK: OK - Certificate 'wikipedia.yogfront.ooo' will expire on Mon 22 Aug 2022 21:48:31 GMT +0000. [10:58:32] RECOVERY - cp20 SSH on cp20 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [10:58:45] RECOVERY - infectowiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'infectowiki.com' will expire on Tue 23 Aug 2022 08:27:35 GMT +0000. [10:58:59] PROBLEM - cp21 Stunnel HTTP for mw102 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [10:59:13] RECOVERY - cp21 Stunnel HTTP for mw101 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 1.843 second response time [10:59:23] PROBLEM - cp20 Stunnel HTTP for matomo101 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [10:59:35] RECOVERY - wc.miraheze.org on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [11:00:01] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.29, 8.92, 6.75 [11:00:04] RECOVERY - recaptime.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [11:00:05] PROBLEM - cp20 Stunnel HTTP for mw121 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:00:22] RECOVERY - cp20 Stunnel HTTP for mw112 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 1.042 second response time [11:00:38] RECOVERY - thenintendowiki.org - LetsEncrypt on sslhost is OK: OK - Certificate 'thenintendowiki.org' will expire on Sat 22 Oct 2022 05:06:23 GMT +0000. [11:00:55] RECOVERY - cp21 Stunnel HTTP for mw102 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 1.024 second response time [11:01:21] RECOVERY - cp20 Stunnel HTTP for matomo101 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 99061 bytes in 0.215 second response time [11:01:36] RECOVERY - wiki.vinesh.eu.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.vinesh.eu.org' will expire on Sat 17 Sep 2022 22:28:24 GMT +0000. [11:02:33] RECOVERY - cp20 Stunnel HTTP for mw121 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 1.040 second response time [11:02:36] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.32, 8.75, 7.07 [11:03:14] RECOVERY - cp21 HTTPS on cp21 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 3405 bytes in 3.056 second response time [11:04:18] PROBLEM - cp20 ferm_active on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [11:04:36] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 11.95, 9.89, 7.69 [11:05:16] PROBLEM - cp20 Stunnel HTTP for mw101 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [11:06:14] RECOVERY - cp20 ferm_active on cp20 is OK: OK ferm input default policy is set [11:06:35] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 9.80, 9.63, 7.86 [11:07:05] PROBLEM - dkpedia.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:07:11] PROBLEM - cp21 Stunnel HTTP for mw102 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:07:41] RECOVERY - az.wikiretet.ga - LetsEncrypt on sslhost is OK: OK - Certificate 'az.wikiretet.ga' will expire on Tue 11 Oct 2022 04:40:37 GMT +0000. [11:08:39] RECOVERY - pt.polandballwiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'pt.polandballwiki.com' will expire on Thu 29 Sep 2022 08:59:53 GMT +0000. [11:08:53] PROBLEM - cp20 Stunnel HTTP for mw102 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:09:06] RECOVERY - source.erag.eu.org - LetsEncrypt on sslhost is OK: OK - Certificate 'source.erag.eu.org' will expire on Sun 09 Oct 2022 13:40:55 GMT +0000. [11:09:25] RECOVERY - inourownwords.online - LetsEncrypt on sslhost is OK: OK - Certificate 'inourownwords.online' will expire on Fri 02 Sep 2022 12:36:55 GMT +0000. [11:09:53] RECOVERY - wiki.ameristraliagov.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.ameristraliagov.com' will expire on Thu 20 Oct 2022 03:45:43 GMT +0000. [11:10:09] PROBLEM - test2.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:10:12] PROBLEM - mystiverse.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:10:32] RECOVERY - burnout.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'burnout.wiki' will expire on Fri 19 Aug 2022 05:01:19 GMT +0000. [11:10:37] RECOVERY - proficientprofit.click - LetsEncrypt on sslhost is OK: OK - Certificate 'www.proficientprofit.click' will expire on Sat 08 Oct 2022 06:14:24 GMT +0000. [11:10:52] RECOVERY - cp20 Stunnel HTTP for mw102 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 0.024 second response time [11:11:05] RECOVERY - cp21 Varnish Backends on cp21 is OK: All 14 backends are healthy [11:11:25] RECOVERY - cp20 Stunnel HTTP for mw101 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 1.709 second response time [11:11:38] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.86, 9.10, 7.59 [11:12:27] PROBLEM - cp21 Stunnel HTTP for mw101 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [11:13:34] RECOVERY - wiki-tintin.cf - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki-tintin.cf' will expire on Mon 10 Oct 2022 03:55:03 GMT +0000. [11:13:51] RECOVERY - roll-of-arms.com - LetsEncrypt on sslhost is OK: OK - Certificate 'roll-of-arms.com' will expire on Sun 14 Aug 2022 15:58:21 GMT +0000. [11:13:56] RECOVERY - fortis.miraheze.org - LetsEncrypt on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [11:15:20] PROBLEM - cp21 ferm_active on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [11:15:35] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 4.92, 7.94, 7.55 [11:15:38] PROBLEM - wiki.dunmoore.net - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:16:00] PROBLEM - cp21 Varnish Backends on cp21 is CRITICAL: 2 backends are down. mw102 mw111 [11:16:14] PROBLEM - cp21 conntrack_table_size on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [11:16:20] PROBLEM - wiki.lu9.io - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:16:22] PROBLEM - www.wikiretet.ga - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:16:22] RECOVERY - with.cpt-ra.bid - LetsEncrypt on sslhost is OK: OK - Certificate 'with.cpt-ra.bid' will expire on Thu 01 Sep 2022 00:46:39 GMT +0000. [11:16:35] PROBLEM - cp20 Stunnel HTTP for mw111 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:16:48] PROBLEM - wiki.digitalefitheid.nl - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:16:55] PROBLEM - www.arru.xyz - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:17:32] RECOVERY - cp21 ferm_active on cp21 is OK: OK ferm input default policy is set [11:17:35] RECOVERY - cp21 Stunnel HTTP for mw101 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 1.049 second response time [11:18:03] RECOVERY - en.pornwiki.org - LetsEncrypt on sslhost is OK: OK - Certificate 'en.pornwiki.org' will expire on Sat 17 Sep 2022 22:00:09 GMT +0000. [11:18:09] RECOVERY - cp21 conntrack_table_size on cp21 is OK: OK: nf_conntrack is 5 % full [11:18:18] PROBLEM - cp21 Stunnel HTTP for test101 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:18:22] PROBLEM - wiki.scpsharp.ga - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:19:04] RECOVERY - cp20 Stunnel HTTP for mw111 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 0.020 second response time [11:19:30] PROBLEM - squareenixwiki.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:19:34] PROBLEM - dcmultiverse.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:19:40] RECOVERY - evil.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'evil.wiki' will expire on Sun 23 Oct 2022 21:23:17 GMT +0000. [11:19:52] PROBLEM - fc.songcontests.eu - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:19:58] PROBLEM - cp21 Stunnel HTTP for phab121 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [11:19:59] RECOVERY - www.dariawiki.org - LetsEncrypt on sslhost is OK: OK - Certificate 'dariawiki.org' will expire on Mon 22 Aug 2022 22:44:29 GMT +0000. [11:20:31] RECOVERY - cp21 Stunnel HTTP for test101 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15954 bytes in 0.070 second response time [11:21:22] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.85, 9.58, 7.58 [11:21:23] RECOVERY - heavyironmodding.org - LetsEncrypt on sslhost is OK: OK - Certificate 'heavyironmodding.org' will expire on Fri 30 Sep 2022 17:38:06 GMT +0000. [11:21:48] PROBLEM - cp20 conntrack_table_size on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [11:22:09] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [11:22:10] RECOVERY - files.pornwiki.org - LetsEncrypt on sslhost is OK: OK - Certificate 'files.pornwiki.org' will expire on Sat 17 Sep 2022 19:10:31 GMT +0000. [11:22:13] RECOVERY - cp21 Stunnel HTTP for phab121 on cp21 is OK: HTTP OK: Status line output matched "500" - 2855 bytes in 1.089 second response time [11:22:51] RECOVERY - dariawiki.org - LetsEncrypt on sslhost is OK: OK - Certificate 'dariawiki.org' will expire on Mon 22 Aug 2022 22:44:29 GMT +0000. [11:23:18] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.15, 8.54, 7.43 [11:23:22] PROBLEM - cp20 SSH on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:23:31] PROBLEM - vrcdev.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:23:37] RECOVERY - wiki.valkyrienskies.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.valkyrienskies.org' will expire on Wed 24 Aug 2022 05:14:40 GMT +0000. [11:23:45] RECOVERY - cp20 conntrack_table_size on cp20 is OK: OK: nf_conntrack is 5 % full [11:25:00] RECOVERY - dragonquestwiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'dragonquestwiki.com' will expire on Thu 15 Sep 2022 05:19:23 GMT +0000. [11:25:01] RECOVERY - www.portalsofphereon.com - LetsEncrypt on sslhost is OK: OK - Certificate 'www.portalsofphereon.com' will expire on Sat 17 Sep 2022 20:30:32 GMT +0000. [11:25:11] PROBLEM - ndg.nenawiki.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:25:23] PROBLEM - cp20 Stunnel HTTP for mw102 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:25:55] RECOVERY - scpvncommunitywiki.xyz - LetsEncrypt on sslhost is OK: OK - Certificate 'scpvncommunitywiki.xyz' will expire on Tue 23 Aug 2022 02:34:15 GMT +0000. [11:26:21] PROBLEM - bebaskanpengetahuan.id - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:26:35] PROBLEM - www.ambientguitar.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:26:45] PROBLEM - wikipariksha.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:27:06] RECOVERY - wiki.graalmilitary.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.graalmilitary.com' will expire on Tue 23 Aug 2022 03:02:35 GMT +0000. [11:27:53] RECOVERY - cp21 Stunnel HTTP for mw102 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 8.203 second response time [11:28:26] PROBLEM - cp21 Stunnel HTTP for reports121 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [11:28:58] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 11.79, 8.66, 6.54 [11:29:37] PROBLEM - rct.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:29:48] PROBLEM - squareenix.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:29:55] PROBLEM - cp21 SSH on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:30:20] RECOVERY - cp21 Stunnel HTTP for reports121 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 10996 bytes in 0.069 second response time [11:30:23] PROBLEM - biblestrength.net - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:30:37] [Grafana] FIRING: Some MediaWiki Appservers are running out of PHP-FPM workers. https://grafana.miraheze.org/d/GtxbP1Xnk [11:30:58] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 7.17, 8.56, 6.81 [11:31:13] PROBLEM - wiki.slimeapedia.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:31:40] PROBLEM - istpcomputing.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:31:53] RECOVERY - cp21 SSH on cp21 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [11:32:03] PROBLEM - wiki.whentheycry.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:32:04] PROBLEM - franchise.franchising.org.ua - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:33:15] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.37, 8.04, 6.80 [11:34:53] RECOVERY - robloxapi.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'robloxapi.wiki' will expire on Mon 12 Sep 2022 18:36:58 GMT +0000. [11:35:27] RECOVERY - cp20 Stunnel HTTP for mw102 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 3.055 second response time [11:35:43] RECOVERY - dkpedia.com - LetsEncrypt on sslhost is OK: OK - Certificate 'dkpedia.com' will expire on Tue 04 Oct 2022 18:55:51 GMT +0000. [11:35:45] RECOVERY - cp20 SSH on cp20 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [11:36:01] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.48, 9.61, 8.01 [11:36:08] PROBLEM - slymods.info - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:37:11] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 5.27, 8.11, 7.24 [11:37:40] PROBLEM - mw121 MediaWiki Rendering on mw121 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:38:42] PROBLEM - miraheze.ml - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:38:55] RECOVERY - test2.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [11:39:38] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.49, 1.64, 1.97 [11:39:43] RECOVERY - mw121 MediaWiki Rendering on mw121 is OK: HTTP OK: HTTP/1.1 200 OK - 28479 bytes in 5.287 second response time [11:40:01] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 9.73, 10.03, 8.59 [11:40:59] PROBLEM - cp21 Stunnel HTTP for mw122 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [11:41:42] PROBLEM - iceria.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:41:44] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::4c25/cpweb [11:41:46] PROBLEM - inourownwords.online - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:42:24] PROBLEM - cp21 Disk Space on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [11:42:30] PROBLEM - www.polandballwiki.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:42:47] PROBLEM - cp21 Stunnel HTTP for mwtask111 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [11:43:41] PROBLEM - wc.miraheze.org on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:44:12] PROBLEM - abeyancewiki.bumblebee-studios.se - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:44:19] RECOVERY - cp21 Disk Space on cp21 is OK: DISK OK - free space: / 10643 MB (27% inode=96%); [11:44:22] RECOVERY - persist.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'persist.wiki' will expire on Mon 10 Oct 2022 04:01:57 GMT +0000. [11:44:43] RECOVERY - cp21 Stunnel HTTP for mwtask111 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15950 bytes in 1.037 second response time [11:44:49] PROBLEM - experimyco.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:45:07] RECOVERY - rarewiki.org - LetsEncrypt on sslhost is OK: OK - Certificate 'rarewiki.org' will expire on Wed 28 Sep 2022 05:06:19 GMT +0000. [11:45:12] PROBLEM - cloudwiki.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:45:35] RECOVERY - wc.miraheze.org on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [11:46:00] RECOVERY - www.arru.xyz - LetsEncrypt on sslhost is OK: OK - Certificate 'www.arru.xyz' will expire on Sat 17 Sep 2022 21:47:49 GMT +0000. [11:46:15] RECOVERY - wiki.digitalefitheid.nl - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.digitalefitheid.nl' will expire on Wed 21 Sep 2022 08:49:04 GMT +0000. [11:46:27] RECOVERY - www.wikiretet.ga - LetsEncrypt on sslhost is OK: OK - Certificate 'www.wikiretet.ga' will expire on Tue 11 Oct 2022 04:42:43 GMT +0000. [11:47:19] PROBLEM - n64brew.dev - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:47:38] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.40, 1.76, 1.87 [11:47:50] RECOVERY - wiki.scpsharp.ga - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.scpsharp.ga' will expire on Wed 31 Aug 2022 20:42:39 GMT +0000. [11:47:50] RECOVERY - cp21 Stunnel HTTP for mw122 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.019 second response time [11:48:36] RECOVERY - squareenixwiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'squareenixwiki.com' will expire on Sat 01 Oct 2022 04:20:30 GMT +0000. [11:49:06] PROBLEM - www.proficientprofit.click - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:49:11] RECOVERY - dcmultiverse.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [11:49:34] RECOVERY - fc.songcontests.eu - LetsEncrypt on sslhost is OK: OK - Certificate 'fc.songcontests.eu' will expire on Mon 22 Aug 2022 22:44:59 GMT +0000. [11:49:59] PROBLEM - repository.archiopedia.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:50:02] PROBLEM - en.famepedia.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:50:10] PROBLEM - tensegritywiki.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:50:32] RECOVERY - wiki.mineland.eu - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.mineland.eu' will expire on Tue 23 Aug 2022 01:29:10 GMT +0000. [11:51:18] PROBLEM - cp21 PowerDNS Recursor on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [11:51:22] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 11.53, 9.02, 7.73 [11:51:36] PROBLEM - erawikisource.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:51:48] RECOVERY - pa.gyaanipedia.com - LetsEncrypt on sslhost is OK: OK - Certificate 'pa.gyaanipedia.com' will expire on Thu 08 Sep 2022 06:52:35 GMT +0000. [11:52:29] RECOVERY - wiki.consid.vn - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.consid.vn' will expire on Mon 22 Aug 2022 23:09:56 GMT +0000. [11:52:37] RECOVERY - deepdark.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'deepdark.wiki' will expire on Mon 03 Oct 2022 20:17:33 GMT +0000. [11:52:49] RECOVERY - vrcdev.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'vrcdev.wiki' will expire on Tue 20 Sep 2022 12:25:22 GMT +0000. [11:52:56] RECOVERY - thelonsdalebattalion.co.uk - LetsEncrypt on sslhost is OK: OK - Certificate 'thelonsdalebattalion.co.uk' will expire on Wed 24 Aug 2022 03:06:17 GMT +0000. [11:53:12] RECOVERY - wiki.sketch.town - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.sketch.town' will expire on Thu 13 Oct 2022 04:34:16 GMT +0000. [11:53:21] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 5.83, 7.82, 7.45 [11:53:33] RECOVERY - cp21 PowerDNS Recursor on cp21 is OK: DNS OK: 0.106 seconds response time. miraheze.org returns 149.56.140.43,149.56.141.75,2607:5300:201:3100::5ebc,2607:5300:201:3100::929a [11:54:20] RECOVERY - polandballwiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'www.polandballwiki.com' will expire on Thu 29 Sep 2022 08:52:53 GMT +0000. [11:54:54] PROBLEM - mh142.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:55:24] RECOVERY - www.ambientguitar.org - LetsEncrypt on sslhost is OK: OK - Certificate 'ambientguitar.org' will expire on Mon 22 Aug 2022 22:13:35 GMT +0000. [11:55:35] RECOVERY - wikipariksha.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wikipariksha.com' will expire on Wed 24 Aug 2022 05:18:49 GMT +0000. [11:55:37] [Grafana] RESOLVED: PHP-FPM Worker Usage High https://grafana.miraheze.org/d/GtxbP1Xnk [11:56:11] RECOVERY - bebaskanpengetahuan.id - LetsEncrypt on sslhost is OK: OK - Certificate 'bebaskanpengetahuan.id' will expire on Wed 24 Aug 2022 04:11:00 GMT +0000. [11:57:16] RECOVERY - electowiki.org - LetsEncrypt on sslhost is OK: OK - Certificate 'electowiki.org' will expire on Tue 23 Aug 2022 00:50:24 GMT +0000. [11:57:38] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.36, 1.77, 1.95 [11:58:15] RECOVERY - rct.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'rct.wiki' will expire on Mon 22 Aug 2022 21:33:31 GMT +0000. [11:58:38] RECOVERY - squareenix.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [12:02:50] PROBLEM - cp21 Stunnel HTTP for mw101 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:03:38] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.13, 1.28, 1.66 [12:04:09] PROBLEM - cp21 Stunnel HTTP for mwtask111 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:04:52] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.95, 9.88, 7.97 [12:05:03] RECOVERY - cp21 Stunnel HTTP for mw101 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 1.066 second response time [12:06:06] RECOVERY - cp21 Stunnel HTTP for mwtask111 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15956 bytes in 0.045 second response time [12:06:52] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 6.33, 8.59, 7.74 [12:07:17] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.03, 3.41, 3.00 [12:08:27] RECOVERY - miraheze.ml - LetsEncrypt on sslhost is OK: OK - Certificate 'miraheze.ml' will expire on Tue 23 Aug 2022 02:37:13 GMT +0000. [12:08:53] PROBLEM - cp20 Stunnel HTTP for mw121 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:09:15] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 8.78, 5.08, 3.63 [12:09:49] RECOVERY - mystiverse.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'mystiverse.wiki' will expire on Sat 01 Oct 2022 04:26:41 GMT +0000. [12:09:51] PROBLEM - cp20 HTTPS on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:10:09] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.89, 4.66, 3.53 [12:10:24] PROBLEM - m33ks.ml - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:10:31] RECOVERY - iceria.org - LetsEncrypt on sslhost is OK: OK - Certificate 'www.iceria.org' will expire on Sat 17 Sep 2022 21:13:26 GMT +0000. [12:10:55] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 3.64, 4.72, 3.74 [12:11:07] RECOVERY - cp20 Stunnel HTTP for mw121 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 3.675 second response time [12:11:44] RECOVERY - inourownwords.online - LetsEncrypt on sslhost is OK: OK - Certificate 'inourownwords.online' will expire on Fri 02 Sep 2022 12:36:55 GMT +0000. [12:12:08] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.44, 3.77, 3.34 [12:12:54] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [12:12:54] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 1.97, 3.74, 3.50 [12:13:09] PROBLEM - www.mcpk.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:13:14] PROBLEM - www.connorjwat.net - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:13:26] PROBLEM - cp21 Stunnel HTTP for reports121 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [12:13:30] PROBLEM - ngsswiki.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:13:39] PROBLEM - unmade.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:13:43] RECOVERY - experimyco.com - LetsEncrypt on sslhost is OK: OK - Certificate 'experimyco.com' will expire on Thu 15 Sep 2022 05:36:04 GMT +0000. [12:13:50] RECOVERY - cp20 HTTPS on cp20 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 3406 bytes in 1.032 second response time [12:13:52] RECOVERY - abeyancewiki.bumblebee-studios.se - LetsEncrypt on sslhost is OK: OK - Certificate 'abeyancewiki.bumblebee-studios.se' will expire on Wed 24 Aug 2022 16:26:15 GMT +0000. [12:14:27] RECOVERY - cloudwiki.org - LetsEncrypt on sslhost is OK: OK - Certificate 'cloudwiki.org' will expire on Sun 23 Oct 2022 16:49:57 GMT +0000. [12:14:39] PROBLEM - wiki.autocountsoft.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:14:39] PROBLEM - www.iceria.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:15:03] PROBLEM - wiki.grottocenter.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:15:08] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.99, 3.79, 3.53 [12:15:24] RECOVERY - cp21 Stunnel HTTP for reports121 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 10996 bytes in 1.082 second response time [12:16:05] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.28, 3.82, 3.44 [12:16:10] RECOVERY - wiki.lu9.io - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.lu9.io' will expire on Tue 06 Sep 2022 20:59:54 GMT +0000. [12:16:28] PROBLEM - cp20 Stunnel HTTP for mw111 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:16:45] RECOVERY - n64brew.dev - LetsEncrypt on sslhost is OK: OK - Certificate 'n64brew.dev' will expire on Tue 23 Aug 2022 09:10:11 GMT +0000. [12:17:06] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.47, 4.22, 3.73 [12:17:07] PROBLEM - cp21 Stunnel HTTP for mail121 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [12:17:24] RECOVERY - www.journeytheword.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'www.journeytheword.wiki' will expire on Wed 31 Aug 2022 18:13:33 GMT +0000. [12:17:56] PROBLEM - wiki.iurevar.world - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:18:03] PROBLEM - wiki.digitalefitheid.nl - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:18:03] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.55, 3.55, 3.37 [12:18:26] PROBLEM - cp20 Stunnel HTTP for mon111 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:18:27] RECOVERY - cp20 Stunnel HTTP for mw111 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.020 second response time [12:18:45] PROBLEM - cp21 ferm_active on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [12:18:57] RECOVERY - www.proficientprofit.click - LetsEncrypt on sslhost is OK: OK - Certificate 'www.proficientprofit.click' will expire on Sat 08 Oct 2022 06:14:24 GMT +0000. [12:19:17] RECOVERY - tensegritywiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'tensegritywiki.com' will expire on Tue 23 Aug 2022 08:10:17 GMT +0000. [12:19:18] RECOVERY - cp21 Stunnel HTTP for mail121 on cp21 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 427 bytes in 0.014 second response time [12:19:33] RECOVERY - repository.archiopedia.org - LetsEncrypt on sslhost is OK: OK - Certificate 'repository.archiopedia.org' will expire on Mon 10 Oct 2022 06:46:02 GMT +0000. [12:19:48] RECOVERY - en.famepedia.org - LetsEncrypt on sslhost is OK: OK - Certificate 'en.famepedia.org' will expire on Mon 10 Oct 2022 05:45:28 GMT +0000. [12:20:02] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.02, 3.66, 3.43 [12:20:05] PROBLEM - m.miraheze.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:20:13] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.84, 1.85, 1.75 [12:20:50] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.21, 3.87, 3.59 [12:21:02] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.57, 3.72, 3.66 [12:21:09] RECOVERY - erawikisource.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [12:21:58] RECOVERY - m.miraheze.org - LetsEncrypt on sslhost is OK: OK - Certificate 'm.miraheze.org' will expire on Tue 06 Sep 2022 21:18:17 GMT +0000. [12:22:00] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.45, 3.24, 3.31 [12:22:16] PROBLEM - nonbinary.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:22:49] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.25, 3.57, 3.52 [12:23:05] PROBLEM - www.trollpasta.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:23:38] PROBLEM - legacygt.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:23:55] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 12.38, 10.05, 7.73 [12:24:09] RECOVERY - cp21 ferm_active on cp21 is OK: OK ferm input default policy is set [12:24:25] PROBLEM - cp21 Stunnel HTTP for mw121 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:24:31] PROBLEM - cp20 Stunnel HTTP for mw111 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [12:24:40] PROBLEM - cp21 Stunnel HTTP for mw102 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [12:24:48] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 1.77, 2.93, 3.29 [12:24:57] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.51, 2.91, 3.32 [12:25:04] PROBLEM - cp20 Stunnel HTTP for mw102 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:25:51] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 9.34, 10.06, 8.03 [12:26:00] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.06, 1.46, 1.63 [12:26:32] PROBLEM - cp31 Stunnel HTTP for mw102 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:26:35] PROBLEM - revi.wiki - PositiveSSLDV on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:26:40] PROBLEM - polandballwiki.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:26:48] PROBLEM - correypedia.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:26:48] PROBLEM - cp30 Stunnel HTTP for mw102 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:27:11] RECOVERY - cp20 Stunnel HTTP for mw102 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 8.474 second response time [12:28:02] PROBLEM - wiki.climatechange.ai - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:28:02] PROBLEM - www.thesimswiki.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:28:28] PROBLEM - bebaskanpengetahuan.id - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:28:31] RECOVERY - cp31 Stunnel HTTP for mw102 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.323 second response time [12:28:45] RECOVERY - cp30 Stunnel HTTP for mw102 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.441 second response time [12:28:45] RECOVERY - cp20 Stunnel HTTP for mw111 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 0.100 second response time [12:28:54] RECOVERY - wiki.slimeapedia.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.slimeapedia.org' will expire on Mon 10 Oct 2022 05:19:54 GMT +0000. [12:29:17] RECOVERY - cp21 Stunnel HTTP for mw121 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 0.025 second response time [12:29:38] RECOVERY - wiki.whentheycry.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.whentheycry.org' will expire on Wed 24 Aug 2022 02:57:37 GMT +0000. [12:29:40] PROBLEM - electowiki.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:29:45] PROBLEM - wiki.newnormal.fans - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:29:55] PROBLEM - lab.wikimimo.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:29:55] RECOVERY - cp20 Stunnel HTTP for mon111 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 39185 bytes in 1.052 second response time [12:30:21] RECOVERY - istpcomputing.com - LetsEncrypt on sslhost is OK: OK - Certificate 'istpcomputing.com' will expire on Tue 11 Oct 2022 04:37:06 GMT +0000. [12:30:26] PROBLEM - cp20 Puppet on cp20 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): File[/etc/apt/trusted.gpg.d/puppetlabs.gpg] [12:30:50] PROBLEM - solaswiki.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:30:52] RECOVERY - franchise.franchising.org.ua - LetsEncrypt on sslhost is OK: OK - Certificate 'franchise.franchising.org.ua' will expire on Tue 23 Aug 2022 02:08:17 GMT +0000. [12:30:53] PROBLEM - famedata.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:30:59] RECOVERY - cp21 Stunnel HTTP for mw102 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 1.037 second response time [12:31:03] PROBLEM - infectowiki.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:31:13] PROBLEM - thenintendowiki.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:31:14] PROBLEM - enc.for.uz - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:31:56] PROBLEM - wiki.villagecollaborative.net - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:32:07] PROBLEM - www.pornwiki.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:34:15] PROBLEM - wc.miraheze.org on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:34:45] RECOVERY - slymods.info - LetsEncrypt on sslhost is OK: OK - Certificate 'slymods.info' will expire on Fri 21 Oct 2022 06:31:32 GMT +0000. [12:34:51] PROBLEM - cp20 Stunnel HTTP for mw111 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [12:35:29] PROBLEM - www.mwcosmos.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:35:30] PROBLEM - arrieretoile.fr - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:35:41] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.37, 1.86, 1.70 [12:35:59] PROBLEM - lg.gyaanipedia.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:36:21] RECOVERY - celeste.ink - LetsEncrypt on sslhost is OK: OK - Certificate 'celeste.ink' will expire on Sat 24 Sep 2022 13:42:28 GMT +0000. [12:37:20] RECOVERY - cp20 Stunnel HTTP for mw111 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.018 second response time [12:37:43] PROBLEM - cp20 Stunnel HTTP for mw101 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [12:38:01] PROBLEM - jp.popira.info - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:38:12] RECOVERY - wc.miraheze.org on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [12:38:28] PROBLEM - agentisai.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:38:57] PROBLEM - privacywiki.xyz - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:39:51] PROBLEM - cp21 Stunnel HTTP for test101 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [12:39:53] RECOVERY - cp20 Stunnel HTTP for mw101 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 0.018 second response time [12:39:57] PROBLEM - www.obeymewiki.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:40:59] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::4c25/cpweb [12:41:32] PROBLEM - cp21 Stunnel HTTP for mw101 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [12:41:36] PROBLEM - www.mh142.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:41:45] PROBLEM - wiki.rtapp.tk - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:41:49] RECOVERY - cp21 Stunnel HTTP for test101 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15954 bytes in 0.035 second response time [12:41:54] RECOVERY - www.mcpk.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'www.mcpk.wiki' will expire on Sat 17 Sep 2022 18:44:27 GMT +0000. [12:41:57] PROBLEM - cp20 Stunnel HTTP for reports121 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [12:42:00] RECOVERY - www.connorjwat.net - LetsEncrypt on sslhost is OK: OK - Certificate 'www.connorjwat.net' will expire on Mon 22 Aug 2022 22:20:46 GMT +0000. [12:42:24] PROBLEM - cp20 PowerDNS Recursor on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [12:42:55] RECOVERY - unmade.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [12:43:03] PROBLEM - pubwiki.lab.co.pl - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:43:49] PROBLEM - cp21 Stunnel HTTP for puppet111 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [12:43:59] RECOVERY - cp20 Stunnel HTTP for reports121 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 10996 bytes in 1.079 second response time [12:44:12] RECOVERY - wiki.grottocenter.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.grottocenter.org' will expire on Mon 22 Aug 2022 22:30:31 GMT +0000. [12:44:22] PROBLEM - www.permanentfuturelab.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:44:35] PROBLEM - beta.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:44:37] RECOVERY - cp20 PowerDNS Recursor on cp20 is OK: DNS OK: 0.061 seconds response time. miraheze.org returns 149.56.140.43,149.56.141.75,2607:5300:201:3100::5ebc,2607:5300:201:3100::929a [12:45:07] PROBLEM - cp21 Stunnel HTTP for phab121 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [12:45:15] PROBLEM - fortis.miraheze.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:45:47] RECOVERY - cp21 Stunnel HTTP for puppet111 on cp21 is OK: HTTP OK: Status line output matched "403" - 289 bytes in 0.012 second response time [12:46:19] PROBLEM - largedu.eu.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:46:35] PROBLEM - persist.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:46:40] PROBLEM - itora.bunnies1230.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:46:56] RECOVERY - cp21 Stunnel HTTP for mw101 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.022 second response time [12:47:27] RECOVERY - wiki.digitalefitheid.nl - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.digitalefitheid.nl' will expire on Wed 21 Sep 2022 08:49:04 GMT +0000. [12:47:48] RECOVERY - wiki.iurevar.world - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.iurevar.world' will expire on Wed 21 Sep 2022 08:53:59 GMT +0000. [12:48:11] PROBLEM - cp21 SSH on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:48:20] RECOVERY - wiki.ciptamedia.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.ciptamedia.org' will expire on Tue 23 Aug 2022 08:44:56 GMT +0000. [12:50:17] RECOVERY - cp21 SSH on cp21 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [12:51:04] RECOVERY - nonbinary.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'nonbinary.wiki' will expire on Tue 23 Aug 2022 02:51:23 GMT +0000. [12:51:26] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.56, 1.85, 1.32 [12:51:31] PROBLEM - cp20 PowerDNS Recursor on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [12:52:08] PROBLEM - cp20 HTTPS on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:52:21] RECOVERY - cp21 Stunnel HTTP for phab121 on cp21 is OK: HTTP OK: Status line output matched "500" - 2855 bytes in 5.078 second response time [12:52:48] RECOVERY - ndg.nenawiki.org - LetsEncrypt on sslhost is OK: OK - Certificate 'nenawiki.org' will expire on Tue 23 Aug 2022 01:35:44 GMT +0000. [12:53:22] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.83, 1.50, 1.25 [12:54:01] RECOVERY - cp20 PowerDNS Recursor on cp20 is OK: DNS OK: 0.288 seconds response time. miraheze.org returns 198.244.148.90,2001:41d0:801:2000::1b80,2001:41d0:801:2000::4c25,51.195.220.68 [12:54:06] RECOVERY - archive.a2b2.org - LetsEncrypt on sslhost is OK: OK - Certificate 'archive.a2b2.org' will expire on Tue 23 Aug 2022 01:40:20 GMT +0000. [12:54:17] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.07, 1.86, 1.36 [12:54:22] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.65, 3.40, 2.90 [12:55:25] RECOVERY - polandballwiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'www.polandballwiki.com' will expire on Thu 29 Sep 2022 08:52:53 GMT +0000. [12:55:42] RECOVERY - correypedia.org - LetsEncrypt on sslhost is OK: OK - Certificate 'correypedia.org' will expire on Thu 01 Sep 2022 00:41:01 GMT +0000. [12:56:09] RECOVERY - cp20 Puppet on cp20 is OK: OK: Puppet is currently enabled, last run 55 seconds ago with 0 failures [12:56:12] RECOVERY - cp20 HTTPS on cp20 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 3406 bytes in 0.017 second response time [12:56:16] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.74, 1.84, 1.41 [12:56:23] PROBLEM - cp20 Stunnel HTTP for puppet111 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [12:56:36] RECOVERY - www.thesimswiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'www.thesimswiki.com' will expire on Wed 24 Aug 2022 01:38:48 GMT +0000. [12:56:36] RECOVERY - wiki.climatechange.ai - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.climatechange.ai' will expire on Wed 24 Aug 2022 04:03:58 GMT +0000. [12:57:28] PROBLEM - cp21 Stunnel HTTP for mw102 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:58:05] PROBLEM - cp21 Puppet on cp21 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [12:58:15] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.52, 1.69, 1.41 [12:58:18] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.69, 3.68, 3.19 [12:58:18] RECOVERY - bebaskanpengetahuan.id - LetsEncrypt on sslhost is OK: OK - Certificate 'bebaskanpengetahuan.id' will expire on Wed 24 Aug 2022 04:11:00 GMT +0000. [12:58:26] RECOVERY - electowiki.org - LetsEncrypt on sslhost is OK: OK - Certificate 'electowiki.org' will expire on Tue 23 Aug 2022 00:50:24 GMT +0000. [12:58:29] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.57, 3.49, 3.18 [12:58:52] RECOVERY - wiki.newnormal.fans - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.newnormal.fans' will expire on Fri 14 Oct 2022 16:20:05 GMT +0000. [12:58:56] PROBLEM - cp21 Stunnel HTTP for puppet111 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [12:59:39] PROBLEM - wiki.ct777.cf - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:59:42] RECOVERY - infectowiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'infectowiki.com' will expire on Tue 23 Aug 2022 08:27:35 GMT +0000. [12:59:55] RECOVERY - cp21 Stunnel HTTP for mw102 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 1.037 second response time [12:59:58] RECOVERY - thenintendowiki.org - LetsEncrypt on sslhost is OK: OK - Certificate 'thenintendowiki.org' will expire on Sat 22 Oct 2022 05:06:23 GMT +0000. [13:00:06] RECOVERY - enc.for.uz - LetsEncrypt on sslhost is OK: OK - Certificate 'enc.for.uz' will expire on Tue 23 Aug 2022 01:42:45 GMT +0000. [13:00:07] PROBLEM - cp20 Stunnel HTTP for mw111 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [13:00:16] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.56, 3.37, 3.14 [13:00:36] PROBLEM - wiki.jeremyboyd.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:00:44] PROBLEM - cp21 Stunnel HTTP for mw122 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:00:47] RECOVERY - cp20 Stunnel HTTP for puppet111 on cp20 is OK: HTTP OK: Status line output matched "403" - 289 bytes in 1.036 second response time [13:00:51] RECOVERY - famedata.org - LetsEncrypt on sslhost is OK: OK - Certificate 'famedata.org' will expire on Thu 29 Sep 2022 07:42:43 GMT +0000. [13:01:15] PROBLEM - www.opendatascot.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:01:21] RECOVERY - wiki.villagecollaborative.net - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.villagecollaborative.net' will expire on Wed 24 Aug 2022 02:59:35 GMT +0000. [13:01:30] PROBLEM - arru.xyz - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:02:02] PROBLEM - istpcomputing.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:02:23] RECOVERY - cp20 Stunnel HTTP for mw111 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 2.037 second response time [13:02:27] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.15, 3.63, 3.29 [13:02:33] PROBLEM - nonciclopedia.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:02:46] RECOVERY - cp21 Stunnel HTTP for mw122 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.028 second response time [13:03:00] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.95, 9.83, 8.14 [13:03:55] RECOVERY - cp21 Stunnel HTTP for puppet111 on cp21 is OK: HTTP OK: Status line output matched "403" - 289 bytes in 0.011 second response time [13:04:06] RECOVERY - arrieretoile.fr - LetsEncrypt on sslhost is OK: OK - Certificate 'arrieretoile.fr' will expire on Thu 13 Oct 2022 04:37:30 GMT +0000. [13:04:06] RECOVERY - www.mwcosmos.com - LetsEncrypt on sslhost is OK: OK - Certificate 'mwcosmos.com' will expire on Mon 22 Aug 2022 15:03:04 GMT +0000. [13:04:11] PROBLEM - tr.wikiretet.ga - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:04:26] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.58, 3.81, 3.41 [13:04:43] PROBLEM - smashbros.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:05:00] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 10.10, 9.99, 8.41 [13:06:18] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [13:06:25] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.83, 4.19, 3.60 [13:06:47] PROBLEM - cp21 PowerDNS Recursor on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [13:07:04] PROBLEM - cp20 SSH on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:07:20] PROBLEM - opendatascot.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:07:54] PROBLEM - cp20 Stunnel HTTP for matomo101 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [13:08:00] RECOVERY - privacywiki.xyz - LetsEncrypt on sslhost is OK: OK - Certificate 'privacywiki.xyz' will expire on Mon 26 Sep 2022 13:36:29 GMT +0000. [13:08:00] PROBLEM - dkpedia.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:08:24] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.36, 3.85, 3.54 [13:08:27] RECOVERY - m33ks.ml - LetsEncrypt on sslhost is OK: OK - Certificate 'm33ks.ml' will expire on Thu 29 Sep 2022 04:18:17 GMT +0000. [13:08:30] RECOVERY - www.obeymewiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'www.obeymewiki.com' will expire on Thu 01 Sep 2022 00:44:40 GMT +0000. [13:08:34] PROBLEM - cp20 Stunnel HTTP for mw111 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [13:08:58] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.36, 10.42, 8.96 [13:09:28] PROBLEM - wiki.seamly.net - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:09:46] PROBLEM - pt.polandballwiki.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:10:09] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 2 datacenters are down: 2001:41d0:801:2000::4c25/cpweb, 2001:41d0:801:2000::1b80/cpweb [13:10:14] RECOVERY - www.mh142.com - LetsEncrypt on sslhost is OK: OK - Certificate 'mh142.com' will expire on Tue 23 Aug 2022 00:06:10 GMT +0000. [13:10:23] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 3.62, 4.16, 3.72 [13:10:45] RECOVERY - wiki.rtapp.tk - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.rtapp.tk' will expire on Sun 14 Aug 2022 00:07:41 GMT +0000. [13:10:48] RECOVERY - cp20 Stunnel HTTP for mw111 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.018 second response time [13:10:57] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 8.18, 9.74, 8.89 [13:11:01] PROBLEM - cp21 Stunnel HTTP for mw101 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [13:11:05] RECOVERY - cp20 SSH on cp20 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [13:11:44] RECOVERY - pubwiki.lab.co.pl - LetsEncrypt on sslhost is OK: OK - Certificate 'pubwiki.lab.co.pl' will expire on Tue 23 Aug 2022 08:56:40 GMT +0000. [13:12:00] RECOVERY - cp21 PowerDNS Recursor on cp21 is OK: DNS OK: 0.240 seconds response time. miraheze.org returns 149.56.140.43,149.56.141.75,2001:41d0:801:2000::1b80,2001:41d0:801:2000::4c25 [13:12:07] RECOVERY - www.polandballwiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'www.polandballwiki.com' will expire on Thu 29 Sep 2022 08:52:53 GMT +0000. [13:12:15] RECOVERY - wiki.autocountsoft.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.autocountsoft.com' will expire on Sun 18 Sep 2022 20:39:54 GMT +0000. [13:12:17] PROBLEM - zh.gyaanipedia.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:12:19] RECOVERY - www.iceria.org - LetsEncrypt on sslhost is OK: OK - Certificate 'www.iceria.org' will expire on Sat 17 Sep 2022 21:13:26 GMT +0000. [13:12:22] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.45, 3.68, 3.60 [13:12:28] RECOVERY - cp20 Stunnel HTTP for matomo101 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 99061 bytes in 3.303 second response time [13:12:43] PROBLEM - wiki.worldbuilding.network - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:12:57] PROBLEM - wiki.ameristraliagov.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:13:09] RECOVERY - ngsswiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'ngsswiki.com' will expire on Sun 02 Oct 2022 05:32:39 GMT +0000. [13:13:17] RECOVERY - beta.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [13:13:52] PROBLEM - cp20 Stunnel HTTP for puppet111 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:14:01] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.77, 10.28, 8.36 [13:14:09] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [13:14:09] RECOVERY - fortis.miraheze.org - LetsEncrypt on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [13:14:17] PROBLEM - atnarsia.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:14:23] PROBLEM - cp21 Stunnel HTTP for mw112 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:14:34] PROBLEM - unmade.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:14:43] PROBLEM - it.famepedia.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:15:31] PROBLEM - cp21 Stunnel HTTP for test101 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [13:15:34] PROBLEM - wiki.minebox.fr - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:15:50] PROBLEM - www.istpcomputing.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:15:58] RECOVERY - largedu.eu.org - LetsEncrypt on sslhost is OK: OK - Certificate 'largedu.eu.org' will expire on Wed 17 Aug 2022 15:37:36 GMT +0000. [13:16:01] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 4.33, 8.00, 7.76 [13:16:20] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.09, 3.00, 3.34 [13:16:24] RECOVERY - cp21 Stunnel HTTP for mw112 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 1.035 second response time [13:16:26] RECOVERY - itora.bunnies1230.com - LetsEncrypt on sslhost is OK: OK - Certificate 'itora.bunnies1230.com' will expire on Tue 20 Sep 2022 01:50:31 GMT +0000. [13:16:30] RECOVERY - persist.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'persist.wiki' will expire on Mon 10 Oct 2022 04:01:57 GMT +0000. [13:16:55] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 11.83, 10.94, 9.57 [13:17:01] PROBLEM - www.fossilfighterswiki.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:17:19] PROBLEM - cp30 Stunnel HTTP for mw101 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:17:27] PROBLEM - cp31 Stunnel HTTP for mw101 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:18:01] PROBLEM - cp20 Stunnel HTTP for mw121 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:18:06] RECOVERY - cp20 Stunnel HTTP for puppet111 on cp20 is OK: HTTP OK: Status line output matched "403" - 289 bytes in 1.024 second response time [13:18:27] RECOVERY - cp21 Stunnel HTTP for mw101 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 9.615 second response time [13:19:11] PROBLEM - you.r-fit.cc - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:19:12] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.99, 3.63, 3.23 [13:19:16] RECOVERY - cp30 Stunnel HTTP for mw101 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 0.323 second response time [13:19:24] RECOVERY - cp31 Stunnel HTTP for mw101 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 0.313 second response time [13:19:47] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.84, 3.80, 3.37 [13:20:18] PROBLEM - wc.miraheze.org on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:20:30] PROBLEM - cp20 Stunnel HTTP for matomo101 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:20:31] PROBLEM - wiki.otir.nl - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:20:43] PROBLEM - wiki.ciptamedia.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:20:54] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 5.79, 9.05, 9.19 [13:21:11] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.55, 3.36, 3.20 [13:21:18] PROBLEM - cp20 Stunnel HTTP for phab121 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:21:45] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.99, 3.45, 3.29 [13:21:47] PROBLEM - cp20 Stunnel HTTP for mon111 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [13:21:48] PROBLEM - cp20 PowerDNS Recursor on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [13:21:56] RECOVERY - www.trollpasta.com - LetsEncrypt on sslhost is OK: OK - Certificate 'trollpasta.com' will expire on Mon 10 Oct 2022 06:29:05 GMT +0000. [13:22:12] RECOVERY - wc.miraheze.org on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [13:22:17] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.61, 3.79, 3.56 [13:22:26] RECOVERY - cp20 Stunnel HTTP for matomo101 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 99061 bytes in 1.327 second response time [13:22:31] RECOVERY - mh142.com - LetsEncrypt on sslhost is OK: OK - Certificate 'mh142.com' will expire on Tue 23 Aug 2022 00:06:10 GMT +0000. [13:22:32] PROBLEM - polandball.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:22:50] PROBLEM - cloud11 Puppet on cloud11 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[ulogd2] [13:23:18] RECOVERY - cp20 Stunnel HTTP for phab121 on cp20 is OK: HTTP OK: Status line output matched "500" - 2855 bytes in 1.105 second response time [13:23:43] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 3.00, 3.28, 3.25 [13:23:44] PROBLEM - cp21 Disk Space on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [13:23:46] RECOVERY - cp20 Stunnel HTTP for mon111 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 39177 bytes in 0.053 second response time [13:24:00] PROBLEM - cnt.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:24:38] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 10.31, 9.25, 7.61 [13:25:00] RECOVERY - cp21 Stunnel HTTP for test101 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15954 bytes in 0.073 second response time [13:25:11] PROBLEM - ndg.nenawiki.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:25:17] PROBLEM - cyberlaw.ccdcoe.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:25:29] RECOVERY - cp20 Stunnel HTTP for mw121 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 1.053 second response time [13:25:39] RECOVERY - cp21 Disk Space on cp21 is OK: DISK OK - free space: / 10301 MB (26% inode=96%); [13:25:52] PROBLEM - cp20 Stunnel HTTP for mw102 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [13:25:58] PROBLEM - miraheze.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:26:15] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.46, 3.74, 3.60 [13:26:19] RECOVERY - cp21 Puppet on cp21 is OK: OK: Puppet is currently enabled, last run 8 seconds ago with 0 failures [13:26:28] PROBLEM - thelonsdalebattalion.co.uk - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:26:29] PROBLEM - dragonquestwiki.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:26:34] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 4.29, 7.50, 7.17 [13:26:35] PROBLEM - rothwell-leeds.co.uk - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:26:39] PROBLEM - cp21 Stunnel HTTP for matomo101 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [13:26:57] PROBLEM - cp21 Current Load on cp21 is WARNING: WARNING - load average: 1.86, 1.63, 1.12 [13:26:59] RECOVERY - cp20 PowerDNS Recursor on cp20 is OK: DNS OK: 0.307 seconds response time. miraheze.org returns 198.244.148.90,2001:41d0:801:2000::1b80,2001:41d0:801:2000::4c25,51.195.220.68 [13:27:28] PROBLEM - cp20 Puppet on cp20 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [13:27:31] PROBLEM - cp21 Stunnel HTTP for phab121 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [13:27:55] RECOVERY - lab.wikimimo.com - LetsEncrypt on sslhost is OK: OK - Certificate 'lab.wikimimo.com' will expire on Sun 09 Oct 2022 03:42:01 GMT +0000. [13:27:58] RECOVERY - cp20 Stunnel HTTP for mw102 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 6.824 second response time [13:28:10] PROBLEM - tot.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:28:22] RECOVERY - wiki.ct777.cf - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.ct777.cf' will expire on Sun 02 Oct 2022 10:59:59 GMT +0000. [13:28:45] PROBLEM - dragonquest2.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:28:51] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 0.77, 1.32, 1.07 [13:28:57] PROBLEM - wiki.warframestat.us - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:29:11] PROBLEM - scpvncommunitywiki.xyz - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:29:13] PROBLEM - cp20 Stunnel HTTP for mon111 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [13:29:25] PROBLEM - tech.teojingyao.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:29:27] PROBLEM - cp21 Stunnel HTTP for reports121 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [13:29:34] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.46, 3.70, 3.42 [13:29:37] PROBLEM - rct.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:29:38] RECOVERY - biblestrength.net - LetsEncrypt on sslhost is OK: OK - Certificate 'biblestrength.net' will expire on Wed 07 Sep 2022 18:16:09 GMT +0000. [13:29:41] PROBLEM - phgalaxy.eu.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:29:46] PROBLEM - wiki.triplescripts.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:30:01] RECOVERY - cp21 Stunnel HTTP for phab121 on cp21 is OK: HTTP OK: Status line output matched "500" - 2855 bytes in 0.069 second response time [13:30:03] RECOVERY - www.opendatascot.org - LetsEncrypt on sslhost is OK: OK - Certificate 'opendatascot.org' will expire on Thu 01 Sep 2022 00:46:11 GMT +0000. [13:30:09] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::4c25/cpweb [13:30:23] RECOVERY - solaswiki.org - LetsEncrypt on sslhost is OK: OK - Certificate 'solaswiki.org' will expire on Sat 03 Sep 2022 15:10:56 GMT +0000. [13:30:33] [Grafana] FIRING: Some MediaWiki Appservers are running out of PHP-FPM workers. https://grafana.miraheze.org/d/GtxbP1Xnk [13:31:13] PROBLEM - wiki.slimeapedia.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:31:21] RECOVERY - arru.xyz - LetsEncrypt on sslhost is OK: OK - Certificate 'www.arru.xyz' will expire on Sat 17 Sep 2022 21:47:49 GMT +0000. [13:31:29] RECOVERY - cp21 Stunnel HTTP for reports121 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 10996 bytes in 7.186 second response time [13:31:32] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.96, 10.23, 8.13 [13:31:37] RECOVERY - www.pornwiki.org - LetsEncrypt on sslhost is OK: OK - Certificate 'www.pornwiki.org' will expire on Sat 17 Sep 2022 20:10:50 GMT +0000. [13:31:38] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.40, 1.66, 1.99 [13:31:55] RECOVERY - nonciclopedia.org - LetsEncrypt on sslhost is OK: OK - Certificate 'nonciclopedia.org' will expire on Wed 24 Aug 2022 04:38:47 GMT +0000. [13:33:15] PROBLEM - vedopedia.witches-empire.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:33:28] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 9.75, 9.95, 8.29 [13:33:29] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.00, 3.51, 3.42 [13:34:11] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.19, 3.72, 3.59 [13:34:13] PROBLEM - finalfantasy.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:34:20] RECOVERY - lg.gyaanipedia.com - LetsEncrypt on sslhost is OK: OK - Certificate 'lg.gyaanipedia.com' will expire on Thu 08 Sep 2022 06:37:50 GMT +0000. [13:34:22] RECOVERY - smashbros.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [13:36:10] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.03, 3.37, 3.47 [13:36:21] RECOVERY - cp20 Stunnel HTTP for mon111 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 39185 bytes in 0.043 second response time [13:36:38] RECOVERY - dkpedia.com - LetsEncrypt on sslhost is OK: OK - Certificate 'dkpedia.com' will expire on Tue 04 Oct 2022 18:55:51 GMT +0000. [13:36:54] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.69, 3.73, 3.46 [13:37:00] RECOVERY - opendatascot.org - LetsEncrypt on sslhost is OK: OK - Certificate 'opendatascot.org' will expire on Thu 01 Sep 2022 00:46:11 GMT +0000. [13:37:25] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.07, 3.22, 3.37 [13:38:06] RECOVERY - jp.popira.info - LetsEncrypt on sslhost is OK: OK - Certificate 'jp.popira.info' will expire on Mon 10 Oct 2022 06:13:03 GMT +0000. [13:38:09] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.64, 3.02, 3.32 [13:38:24] RECOVERY - agentisai.com - LetsEncrypt on sslhost is OK: OK - Certificate 'www.agentisai.com' will expire on Wed 28 Sep 2022 11:24:06 GMT +0000. [13:38:53] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.15, 3.72, 3.47 [13:39:06] RECOVERY - pt.polandballwiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'pt.polandballwiki.com' will expire on Thu 29 Sep 2022 08:59:53 GMT +0000. [13:39:11] RECOVERY - wiki.seamly.net - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.seamly.net' will expire on Tue 23 Aug 2022 07:40:05 GMT +0000. [13:39:15] PROBLEM - cp20 Stunnel HTTP for mw102 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:39:33] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 11.98, 9.27, 7.56 [13:39:57] PROBLEM - www.obeymewiki.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:40:09] PROBLEM - sims.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:40:24] PROBLEM - en.wikiyri.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:40:32] RECOVERY - cp21 Stunnel HTTP for matomo101 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 99061 bytes in 0.299 second response time [13:40:33] [Grafana] RESOLVED: PHP-FPM Worker Usage High https://grafana.miraheze.org/d/GtxbP1Xnk [13:40:51] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.11, 3.57, 3.45 [13:41:01] PROBLEM - cp21 Stunnel HTTP for mw102 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:41:10] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [13:41:31] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 12.74, 10.71, 8.30 [13:41:42] PROBLEM - iceria.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:42:02] RECOVERY - wiki.worldbuilding.network - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.worldbuilding.network' will expire on Mon 10 Oct 2022 05:23:51 GMT +0000. [13:42:24] PROBLEM - pwsc.polandballwiki.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:42:48] RECOVERY - wiki.ameristraliagov.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.ameristraliagov.com' will expire on Thu 20 Oct 2022 03:45:43 GMT +0000. [13:42:50] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.75, 3.22, 3.33 [13:42:55] RECOVERY - cp21 Stunnel HTTP for mw102 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 0.387 second response time [13:43:09] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 0.45, 0.93, 1.18 [13:43:16] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.53, 3.98, 3.59 [13:43:29] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 8.64, 9.94, 8.32 [13:43:38] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.19, 1.41, 1.67 [13:43:43] RECOVERY - atnarsia.com - LetsEncrypt on sslhost is OK: OK - Certificate 'atnarsia.com' will expire on Sun 25 Sep 2022 20:45:25 GMT +0000. [13:43:47] RECOVERY - unmade.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [13:44:04] RECOVERY - www.permanentfuturelab.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'permanentfuturelab.wiki' will expire on Tue 23 Aug 2022 00:31:22 GMT +0000. [13:44:14] RECOVERY - cp20 Stunnel HTTP for mw102 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 1.022 second response time [13:44:33] RECOVERY - it.famepedia.org - LetsEncrypt on sslhost is OK: OK - Certificate 'it.famepedia.org' will expire on Sat 08 Oct 2022 06:08:33 GMT +0000. [13:45:04] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.32, 3.74, 3.55 [13:45:07] RECOVERY - wiki.minebox.fr - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.minebox.fr' will expire on Fri 16 Sep 2022 18:05:33 GMT +0000. [13:45:15] RECOVERY - wiki.dunmoore.net - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.dunmoore.net' will expire on Sun 02 Oct 2022 10:05:42 GMT +0000. [13:45:17] RECOVERY - www.istpcomputing.com - LetsEncrypt on sslhost is OK: OK - Certificate 'istpcomputing.com' will expire on Tue 11 Oct 2022 04:37:06 GMT +0000. [13:46:36] RECOVERY - www.fossilfighterswiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'www.fossilfighterswiki.com' will expire on Sat 24 Sep 2022 13:17:51 GMT +0000. [13:46:45] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 3.95, 4.14, 3.72 [13:47:03] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.92, 3.63, 3.55 [13:48:44] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.49, 3.67, 3.61 [13:48:58] RECOVERY - you.r-fit.cc - LetsEncrypt on sslhost is OK: OK - Certificate 'you.r-fit.cc' will expire on Sat 01 Oct 2022 16:22:56 GMT +0000. [13:49:03] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 6.30, 4.64, 3.92 [13:49:04] RECOVERY - wiki.otir.nl - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.otir.nl' will expire on Fri 26 Aug 2022 04:20:05 GMT +0000. [13:49:33] RECOVERY - wiki.ciptamedia.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.ciptamedia.org' will expire on Tue 23 Aug 2022 08:44:56 GMT +0000. [13:49:38] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.61, 1.99, 1.81 [13:50:17] PROBLEM - cp20 Stunnel HTTP for mw111 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:50:35] PROBLEM - cp20 SSH on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:50:50] RECOVERY - cloud11 Puppet on cloud11 is OK: OK: Puppet is currently enabled, last run 29 seconds ago with 0 failures [13:51:07] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 1.87, 3.46, 3.64 [13:51:11] RECOVERY - legacygt.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'legacygt.wiki' will expire on Fri 07 Oct 2022 11:41:33 GMT +0000. [13:51:44] RECOVERY - polandball.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [13:52:06] PROBLEM - wiki.mineland.eu - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:52:27] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [13:52:30] RECOVERY - cp20 SSH on cp20 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [13:52:33] PROBLEM - cp21 Stunnel HTTP for mw122 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:52:47] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.86, 1.67, 1.25 [13:53:01] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.43, 3.84, 3.80 [13:53:38] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.72, 1.94, 1.84 [13:53:46] PROBLEM - cp21 Stunnel HTTP for mw101 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [13:53:59] RECOVERY - ndg.nenawiki.org - LetsEncrypt on sslhost is OK: OK - Certificate 'nenawiki.org' will expire on Tue 23 Aug 2022 01:35:44 GMT +0000. [13:54:09] RECOVERY - cyberlaw.ccdcoe.org - LetsEncrypt on sslhost is OK: OK - Certificate 'cyberlaw.ccdcoe.org' will expire on Tue 23 Aug 2022 03:06:24 GMT +0000. [13:54:12] RECOVERY - revi.wiki - PositiveSSLDV on sslhost is OK: OK - Certificate 'revi.wiki' will expire on Thu 29 Dec 2022 23:59:59 GMT +0000. [13:54:37] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 0.29, 0.43, 0.72 [13:54:41] PROBLEM - cp20 Stunnel HTTP for mw112 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:54:45] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.63, 8.57, 7.61 [13:54:47] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.48, 1.51, 1.24 [13:55:00] RECOVERY - dragonquestwiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'dragonquestwiki.com' will expire on Thu 15 Sep 2022 05:19:23 GMT +0000. [13:55:15] RECOVERY - cp20 Stunnel HTTP for mw111 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 2.039 second response time [13:55:20] RECOVERY - rothwell-leeds.co.uk - LetsEncrypt on sslhost is OK: OK - Certificate 'www.rothwell-leeds.co.uk' will expire on Sat 17 Sep 2022 18:56:39 GMT +0000. [13:55:27] RECOVERY - miraheze.com - LetsEncrypt on sslhost is OK: OK - Certificate 'miraheze.com' will expire on Wed 12 Oct 2022 13:21:03 GMT +0000. [13:55:44] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 11.09, 9.47, 7.46 [13:55:48] PROBLEM - wiki.worlduniversityandschool.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:55:57] RECOVERY - cp21 Stunnel HTTP for mw101 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.021 second response time [13:56:26] PROBLEM - history.estill.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:56:41] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.46, 8.25, 7.62 [13:57:01] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.14, 3.60, 3.61 [13:57:23] RECOVERY - cp21 Stunnel HTTP for mw122 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 1.030 second response time [13:57:41] PROBLEM - commons.ballmedia.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:58:09] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [13:58:18] RECOVERY - rct.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'rct.wiki' will expire on Mon 22 Aug 2022 21:33:31 GMT +0000. [13:58:29] RECOVERY - wiki.warframestat.us - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.warframestat.us' will expire on Wed 24 Aug 2022 01:37:17 GMT +0000. [13:58:36] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.85, 2.70, 3.22 [13:58:40] RECOVERY - wiki.triplescripts.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.triplescripts.org' will expire on Wed 24 Aug 2022 04:49:04 GMT +0000. [13:58:52] PROBLEM - cp21 Stunnel HTTP for mw102 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [13:58:59] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.57, 3.21, 3.47 [13:59:06] RECOVERY - scpvncommunitywiki.xyz - LetsEncrypt on sslhost is OK: OK - Certificate 'scpvncommunitywiki.xyz' will expire on Tue 23 Aug 2022 02:34:15 GMT +0000. [13:59:06] RECOVERY - cp20 Puppet on cp20 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [13:59:38] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.29, 1.54, 1.70 [13:59:39] RECOVERY - cp20 Stunnel HTTP for mw112 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 2.042 second response time [13:59:39] PROBLEM - wiki.ct777.cf - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:59:50] PROBLEM - cp21 SSH on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:00:22] RECOVERY - wiki.jeremyboyd.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.jeremyboyd.org' will expire on Fri 12 Aug 2022 07:04:44 GMT +0000. [14:00:23] PROBLEM - cp21 Stunnel HTTP for reports121 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [14:00:43] RECOVERY - istpcomputing.com - LetsEncrypt on sslhost is OK: OK - Certificate 'istpcomputing.com' will expire on Tue 11 Oct 2022 04:37:06 GMT +0000. [14:00:57] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.35, 3.58, 3.64 [14:01:03] PROBLEM - infectowiki.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:01:38] PROBLEM - cp20 Stunnel HTTP for reports121 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:01:43] PROBLEM - biblestrength.net - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:01:44] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 5.79, 8.81, 8.03 [14:02:09] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::1b80/cpweb [14:02:15] PROBLEM - cp21 Stunnel HTTP for phab121 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:02:20] RECOVERY - cp21 Stunnel HTTP for reports121 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 10996 bytes in 3.096 second response time [14:02:54] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.97, 3.85, 3.63 [14:02:56] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.81, 3.58, 3.63 [14:03:19] RECOVERY - vedopedia.witches-empire.com - LetsEncrypt on sslhost is OK: OK - Certificate 'vedopedia.witches-empire.com' will expire on Wed 24 Aug 2022 04:55:08 GMT +0000. [14:03:39] RECOVERY - tr.wikiretet.ga - LetsEncrypt on sslhost is OK: OK - Certificate 'tr.wikiretet.ga' will expire on Mon 12 Sep 2022 14:49:12 GMT +0000. [14:03:42] RECOVERY - cp21 Stunnel HTTP for mw102 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 1.058 second response time [14:03:46] PROBLEM - wiki.auraxis.co - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:04:09] RECOVERY - cp20 Stunnel HTTP for reports121 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 10996 bytes in 1.104 second response time [14:04:17] RECOVERY - cp21 Stunnel HTTP for phab121 on cp21 is OK: HTTP OK: Status line output matched "500" - 2855 bytes in 3.127 second response time [14:04:30] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.86, 3.22, 3.23 [14:04:41] PROBLEM - www.bluepageswiki.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:04:52] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.54, 3.59, 3.56 [14:04:55] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.10, 3.73, 3.68 [14:06:01] PROBLEM - cp21 conntrack_table_size on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [14:06:05] RECOVERY - cp21 SSH on cp21 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [14:06:09] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [14:06:13] PROBLEM - eng.archiopedia.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:06:50] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.38, 3.11, 3.38 [14:07:54] PROBLEM - cp21 Stunnel HTTP for mw101 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [14:08:03] [Grafana] FIRING: Some MediaWiki Appservers are running out of PHP-FPM workers. https://grafana.miraheze.org/d/GtxbP1Xnk [14:08:23] PROBLEM - stablestate.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:08:29] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 6.36, 3.96, 3.49 [14:08:31] RECOVERY - www.obeymewiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'www.obeymewiki.com' will expire on Thu 01 Sep 2022 00:44:40 GMT +0000. [14:09:00] PROBLEM - cp20 Stunnel HTTP for mw121 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [14:09:24] RECOVERY - en.wikiyri.org - LetsEncrypt on sslhost is OK: OK - Certificate 'en.wikiyri.org' will expire on Wed 28 Sep 2022 05:13:53 GMT +0000. [14:09:30] PROBLEM - cp21 Stunnel HTTP for matomo101 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [14:09:47] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 11.52, 9.75, 7.51 [14:10:06] RECOVERY - cp21 Stunnel HTTP for mw101 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 1.049 second response time [14:10:29] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.84, 3.54, 3.40 [14:10:37] PROBLEM - wiki.harlonserver.net - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:10:54] PROBLEM - pt.polandballwiki.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:10:55] RECOVERY - cp20 Stunnel HTTP for mw121 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.019 second response time [14:11:20] RECOVERY - cp21 conntrack_table_size on cp21 is OK: OK: nf_conntrack is 6 % full [14:11:24] PROBLEM - cp20 SSH on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:11:34] RECOVERY - cp21 Stunnel HTTP for matomo101 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 99061 bytes in 0.283 second response time [14:11:46] PROBLEM - proficientprofit.click - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:11:46] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 8.74, 9.56, 7.73 [14:11:58] RECOVERY - pwsc.polandballwiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'pwsc.polandballwiki.com' will expire on Sun 02 Oct 2022 10:41:20 GMT +0000. [14:12:06] RECOVERY - zh.gyaanipedia.com - LetsEncrypt on sslhost is OK: OK - Certificate 'zh.gyaanipedia.com' will expire on Thu 08 Sep 2022 06:29:43 GMT +0000. [14:12:19] PROBLEM - cp20 Stunnel HTTP for mon111 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [14:12:29] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.12, 3.64, 3.44 [14:12:51] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.52, 3.98, 3.82 [14:13:03] PROBLEM - wiki.ssangyongsports.eu.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:13:41] PROBLEM - wc.miraheze.org on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:13:57] PROBLEM - cp20 PowerDNS Recursor on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [14:14:18] RECOVERY - cp20 Stunnel HTTP for mon111 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 39185 bytes in 0.053 second response time [14:14:29] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.43, 3.56, 3.44 [14:14:39] PROBLEM - wiki.ssij.se - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:15:03] PROBLEM - inourownwords.online - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:15:10] PROBLEM - cp21 PowerDNS Recursor on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [14:15:20] PROBLEM - cp20 Stunnel HTTP for matomo101 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [14:15:26] PROBLEM - swests.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:15:35] RECOVERY - wc.miraheze.org on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [14:16:02] PROBLEM - cp20 HTTP 4xx/5xx ERROR Rate on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [14:16:02] RECOVERY - cp20 PowerDNS Recursor on cp20 is OK: DNS OK: 0.184 seconds response time. miraheze.org returns 198.244.148.90,2001:41d0:801:2000::1b80,2001:41d0:801:2000::4c25,51.195.220.68 [14:16:53] PROBLEM - it.famepedia.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:17:00] PROBLEM - www.turtletown.ca - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:17:09] RECOVERY - cp21 PowerDNS Recursor on cp21 is OK: DNS OK: 0.293 seconds response time. miraheze.org returns 198.244.148.90,2001:41d0:801:2000::1b80,2001:41d0:801:2000::4c25,51.195.220.68 [14:17:15] RECOVERY - cp20 Stunnel HTTP for matomo101 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 99061 bytes in 0.333 second response time [14:17:37] RECOVERY - cp20 SSH on cp20 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [14:17:41] PROBLEM - largedu.eu.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:18:17] RECOVERY - cp20 HTTP 4xx/5xx ERROR Rate on cp20 is OK: OK - NGINX Error Rate is 3% [14:18:41] PROBLEM - www.journeytheword.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:18:48] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.17, 3.71, 3.71 [14:19:38] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 3.17, 2.15, 1.71 [14:19:52] PROBLEM - wikicryptos.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:20:29] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.93, 4.20, 3.71 [14:20:31] PROBLEM - en.pornwiki.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:20:48] PROBLEM - cp20 Stunnel HTTP for mw111 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [14:21:04] PROBLEM - allthetropes.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:21:13] PROBLEM - wikiru.wildterra2.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:21:14] PROBLEM - podpedia.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:22:17] PROBLEM - cp21 Stunnel HTTP for mon111 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:22:18] PROBLEM - files.pornwiki.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:22:26] PROBLEM - johanloopmans.nl - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:22:34] PROBLEM - erawikisource.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:23:08] RECOVERY - cp20 Stunnel HTTP for mw111 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 7.336 second response time [14:23:26] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.61, 4.04, 3.64 [14:23:40] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [14:23:41] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::4c25/cpweb [14:24:54] PROBLEM - mh142.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:24:55] PROBLEM - cp20 Stunnel HTTP for mw102 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [14:25:02] RECOVERY - history.estill.org - LetsEncrypt on sslhost is OK: OK - Certificate 'history.estill.org' will expire on Wed 24 Aug 2022 03:29:39 GMT +0000. [14:25:24] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.20, 3.84, 3.62 [14:25:33] PROBLEM - www.ballmedia.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:25:43] RECOVERY - tot.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'tot.wiki' will expire on Tue 23 Aug 2022 12:51:08 GMT +0000. [14:25:48] RECOVERY - wiki.worlduniversityandschool.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.worlduniversityandschool.org' will expire on Tue 23 Aug 2022 07:52:18 GMT +0000. [14:26:42] PROBLEM - www.baharna.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:27:21] PROBLEM - miraheze.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:27:21] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.09, 4.08, 3.74 [14:27:27] RECOVERY - phgalaxy.eu.org - LetsEncrypt on sslhost is OK: OK - Certificate 'phgalaxy.eu.org' will expire on Sun 02 Oct 2022 05:33:18 GMT +0000. [14:27:27] RECOVERY - commons.ballmedia.org - LetsEncrypt on sslhost is OK: OK - Certificate 'commons.ballmedia.org' will expire on Mon 10 Oct 2022 06:16:04 GMT +0000. [14:28:25] RECOVERY - wiki.ct777.cf - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.ct777.cf' will expire on Sun 02 Oct 2022 10:59:59 GMT +0000. [14:28:29] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.21, 3.81, 3.91 [14:28:30] RECOVERY - dragonquest2.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [14:28:41] RECOVERY - tech.teojingyao.com - LetsEncrypt on sslhost is OK: OK - Certificate 'tech.teojingyao.com' will expire on Sat 08 Oct 2022 04:57:57 GMT +0000. [14:28:44] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 0.96, 1.18, 1.07 [14:28:52] RECOVERY - wiki.slimeapedia.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.slimeapedia.org' will expire on Mon 10 Oct 2022 05:19:54 GMT +0000. [14:28:55] PROBLEM - cp21 Stunnel HTTP for mw101 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [14:29:19] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.61, 3.34, 3.50 [14:29:30] PROBLEM - cp20 Stunnel HTTP for mw101 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [14:29:48] RECOVERY - infectowiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'infectowiki.com' will expire on Tue 23 Aug 2022 08:27:35 GMT +0000. [14:31:23] RECOVERY - cp20 Stunnel HTTP for mw102 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 4.576 second response time [14:31:23] RECOVERY - biblestrength.net - LetsEncrypt on sslhost is OK: OK - Certificate 'biblestrength.net' will expire on Wed 07 Sep 2022 18:16:09 GMT +0000. [14:31:24] RECOVERY - sbs.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'sbs.wiki' will expire on Thu 01 Sep 2022 00:42:07 GMT +0000. [14:31:26] PROBLEM - cp20 Stunnel HTTP for test101 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [14:31:28] RECOVERY - fortis.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'fortis.wiki' will expire on Mon 22 Aug 2022 15:42:16 GMT +0000. [14:31:38] RECOVERY - cp20 Stunnel HTTP for mw101 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.023 second response time [14:31:59] RECOVERY - finalfantasy.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [14:32:06] PROBLEM - aresrocket.ml - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:32:15] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.39, 1.83, 1.34 [14:32:29] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.17, 3.92, 3.92 [14:33:15] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.18, 3.93, 3.67 [14:33:24] RECOVERY - cp20 Stunnel HTTP for test101 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15954 bytes in 0.037 second response time [14:34:11] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.78, 1.79, 1.38 [14:34:20] RECOVERY - cp21 Stunnel HTTP for mw101 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 1.146 second response time [14:34:20] RECOVERY - cp21 Stunnel HTTP for mon111 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 39185 bytes in 1.079 second response time [14:34:34] RECOVERY - www.bluepageswiki.org - LetsEncrypt on sslhost is OK: OK - Certificate 'www.bluepageswiki.org' will expire on Sat 17 Sep 2022 22:39:35 GMT +0000. [14:35:13] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.93, 3.57, 3.57 [14:36:06] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.35, 1.70, 1.40 [14:36:11] RECOVERY - eng.archiopedia.org - LetsEncrypt on sslhost is OK: OK - Certificate 'eng.archiopedia.org' will expire on Sun 02 Oct 2022 05:35:50 GMT +0000. [14:37:10] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.05, 3.88, 3.69 [14:37:23] PROBLEM - cp21 ferm_active on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [14:37:30] RECOVERY - stablestate.org - LetsEncrypt on sslhost is OK: OK - Certificate 'stablestate.org' will expire on Tue 23 Aug 2022 08:41:48 GMT +0000. [14:37:50] RECOVERY - sims.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [14:39:24] PROBLEM - antiguabarbudacalypso.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:39:29] RECOVERY - iceria.org - LetsEncrypt on sslhost is OK: OK - Certificate 'www.iceria.org' will expire on Sat 17 Sep 2022 21:13:26 GMT +0000. [14:39:57] PROBLEM - www.obeymewiki.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:40:09] PROBLEM - test2.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:40:17] RECOVERY - pt.polandballwiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'pt.polandballwiki.com' will expire on Thu 29 Sep 2022 08:59:53 GMT +0000. [14:40:31] RECOVERY - wiki.harlonserver.net - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.harlonserver.net' will expire on Wed 24 Aug 2022 16:27:40 GMT +0000. [14:41:29] PROBLEM - wiki.zergmafia.top - reverse DNS on sslhost is WARNING: Timeout: The DNS operation timed out after 5.40622091293335 seconds [14:41:40] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.35, 1.75, 1.43 [14:41:46] RECOVERY - wiki.ssangyongsports.eu.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.ssangyongsports.eu.org' will expire on Wed 31 Aug 2022 22:12:11 GMT +0000. [14:42:59] PROBLEM - cp21 Stunnel HTTP for reports121 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [14:43:09] PROBLEM - www.mcpk.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:43:28] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [14:43:39] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.79, 1.47, 1.38 [14:44:39] PROBLEM - hellointernet.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:44:55] RECOVERY - cp21 Stunnel HTTP for reports121 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 10996 bytes in 0.034 second response time [14:45:36] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.35, 9.72, 7.76 [14:45:43] RECOVERY - cp21 ferm_active on cp21 is OK: OK ferm input default policy is set [14:45:44] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.25, 1.85, 1.61 [14:46:00] PROBLEM - cp21 Stunnel HTTP for mw101 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [14:46:35] RECOVERY - www.turtletown.ca - LetsEncrypt on sslhost is OK: OK - Certificate 'www.turtletown.ca' will expire on Tue 20 Sep 2022 20:30:39 GMT +0000. [14:46:35] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.65, 3.56, 3.96 [14:46:56] PROBLEM - cp20 Stunnel HTTP for mw112 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [14:46:59] PROBLEM - docse.tk - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:47:00] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.60, 3.82, 3.81 [14:47:20] RECOVERY - largedu.eu.org - LetsEncrypt on sslhost is OK: OK - Certificate 'largedu.eu.org' will expire on Wed 17 Aug 2022 15:37:36 GMT +0000. [14:47:36] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 8.98, 9.41, 7.88 [14:47:39] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.16, 1.51, 1.50 [14:48:07] RECOVERY - www.journeytheword.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'www.journeytheword.wiki' will expire on Wed 31 Aug 2022 18:13:33 GMT +0000. [14:48:08] PROBLEM - wikifencing.ru - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:48:30] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 0.74, 0.50, 0.47 [14:48:34] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.34, 4.09, 4.11 [14:48:52] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.34, 9.23, 8.15 [14:48:57] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.11, 4.34, 4.01 [14:49:22] PROBLEM - test3.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:50:28] RECOVERY - wikiru.wildterra2.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wikiru.wildterra2.com' will expire on Wed 24 Aug 2022 02:47:08 GMT +0000. [14:50:31] RECOVERY - podpedia.org - LetsEncrypt on sslhost is OK: OK - Certificate 'podpedia.org' will expire on Wed 31 Aug 2022 21:23:58 GMT +0000. [14:50:33] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.15, 3.65, 3.95 [14:50:52] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.14, 8.19, 7.89 [14:51:19] PROBLEM - cp20 Stunnel HTTP for matomo101 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:51:20] PROBLEM - cp20 Stunnel HTTP for mw101 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:51:31] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.86, 2.19, 1.77 [14:51:50] PROBLEM - cp20 Stunnel HTTP for mw111 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [14:51:57] RECOVERY - cp20 Stunnel HTTP for mw112 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 1.288 second response time [14:52:00] RECOVERY - erawikisource.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [14:52:38] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.91, 9.18, 7.31 [14:53:16] PROBLEM - cp20 Stunnel HTTP for mwtask111 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:54:20] RECOVERY - cp20 Stunnel HTTP for mw111 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 0.028 second response time [14:54:38] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.97, 8.88, 7.43 [14:54:51] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.11, 3.29, 3.67 [14:55:20] RECOVERY - cp20 Stunnel HTTP for mwtask111 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15956 bytes in 0.019 second response time [14:55:22] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.31, 1.83, 1.72 [14:55:26] RECOVERY - cp20 Stunnel HTTP for matomo101 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 99061 bytes in 0.239 second response time [14:55:43] RECOVERY - thelonsdalebattalion.co.uk - LetsEncrypt on sslhost is OK: OK - Certificate 'thelonsdalebattalion.co.uk' will expire on Wed 24 Aug 2022 03:06:17 GMT +0000. [14:55:44] PROBLEM - cp21 Stunnel HTTP for mw102 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:55:47] PROBLEM - cp20 PowerDNS Recursor on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [14:55:55] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [14:56:26] RECOVERY - cp20 Stunnel HTTP for mw101 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 1.334 second response time [14:56:29] PROBLEM - history.sdtef.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:56:39] RECOVERY - www.baharna.org - LetsEncrypt on sslhost is OK: OK - Certificate 'www.baharna.org' will expire on Sat 17 Sep 2022 21:09:35 GMT +0000. [14:56:47] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [14:56:57] RECOVERY - miraheze.com - LetsEncrypt on sslhost is OK: OK - Certificate 'miraheze.com' will expire on Wed 12 Oct 2022 13:21:03 GMT +0000. [14:56:59] PROBLEM - miraheze.tk - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:57:00] PROBLEM - wiki.wisrail.de - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:57:00] RECOVERY - cp21 Stunnel HTTP for mw101 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 1.044 second response time [14:57:11] PROBLEM - replication-ops.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:57:17] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.67, 1.43, 1.59 [14:58:01] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 1.09, 0.92, 0.77 [14:58:02] RECOVERY - cp21 Stunnel HTTP for mw102 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 8.626 second response time [14:58:03] [Grafana] RESOLVED: PHP-FPM Worker Usage High https://grafana.miraheze.org/d/GtxbP1Xnk [14:58:17] RECOVERY - cp20 PowerDNS Recursor on cp20 is OK: DNS OK: 0.182 seconds response time. miraheze.org returns 198.244.148.90,2001:41d0:801:2000::1b80,2001:41d0:801:2000::4c25,51.195.220.68 [14:58:23] PROBLEM - wiki.fbpml.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:58:29] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.34, 4.22, 4.03 [14:58:32] PROBLEM - www.christipedia.nl - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:58:58] PROBLEM - www.portalsofphereon.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:59:30] PROBLEM - guia.esporo.net - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:59:43] PROBLEM - wiki.macc.nyc - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:59:48] PROBLEM - squareenix.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:00:59] PROBLEM - mon111 Puppet on mon111 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Package[python] [15:01:55] RECOVERY - aresrocket.ml - LetsEncrypt on sslhost is OK: OK - Certificate 'aresrocket.ml' will expire on Fri 14 Oct 2022 05:26:01 GMT +0000. [15:02:03] PROBLEM - wiki.exputra.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:02:28] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.21, 3.98, 3.99 [15:02:42] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 3.82, 4.05, 3.84 [15:03:22] PROBLEM - sbs.wiki - LetsEncrypt on sslhost is CRITICAL: connect to address sbs.wiki and port 443: Network is unreachableHTTP CRITICAL - Unable to open TCP socket [15:03:24] PROBLEM - fortis.wiki - LetsEncrypt on sslhost is CRITICAL: connect to address fortis.wiki and port 443: Network is unreachableHTTP CRITICAL - Unable to open TCP socket [15:03:29] PROBLEM - datacrondatabase.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:03:30] RECOVERY - wiki.auraxis.co - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.auraxis.co' will expire on Fri 21 Oct 2022 06:34:16 GMT +0000. [15:04:13] PROBLEM - cp21 Stunnel HTTP for matomo101 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [15:04:40] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.32, 3.89, 3.81 [15:04:52] PROBLEM - cp21 Stunnel HTTP for mw101 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:05:30] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 11.35, 9.91, 8.76 [15:05:39] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.60, 9.22, 8.17 [15:05:54] PROBLEM - www.ethene.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:06:09] PROBLEM - wiki.insideearth.info - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:06:26] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.83, 4.33, 4.12 [15:06:38] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 3.75, 4.03, 3.89 [15:07:07] PROBLEM - cp21 Stunnel HTTP for mw112 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:07:19] PROBLEM - wiki.beergeeks.co.il - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:07:20] PROBLEM - cp20 Stunnel HTTP for mw121 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [15:07:29] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 7.96, 9.13, 8.62 [15:07:37] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 8.64, 8.82, 8.14 [15:08:30] RECOVERY - www.obeymewiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'www.obeymewiki.com' will expire on Thu 01 Sep 2022 00:44:40 GMT +0000. [15:08:35] PROBLEM - cp21 Stunnel HTTP for mwtask111 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [15:08:58] RECOVERY - cp21 Stunnel HTTP for matomo101 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 99061 bytes in 2.300 second response time [15:09:01] PROBLEM - en.wikiretet.ga - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:09:03] RECOVERY - cp21 Stunnel HTTP for mw112 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 1.501 second response time [15:09:34] RECOVERY - cp20 Stunnel HTTP for mw121 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 0.040 second response time [15:10:08] RECOVERY - wiki.zergmafia.top - reverse DNS on sslhost is OK: SSL OK - wiki.zergmafia.top reverse DNS resolves to cp20.miraheze.org - CNAME OK [15:10:37] RECOVERY - cp21 Stunnel HTTP for mwtask111 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15950 bytes in 0.024 second response time [15:10:51] PROBLEM - cp20 Stunnel HTTP for mon111 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:11:31] PROBLEM - wikien.wildterra2.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:11:31] PROBLEM - wiki.meower.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:11:42] PROBLEM - burnout.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:11:54] RECOVERY - www.mcpk.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'www.mcpk.wiki' will expire on Sat 17 Sep 2022 18:44:27 GMT +0000. [15:11:55] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [15:12:31] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.25, 3.48, 3.77 [15:12:48] PROBLEM - cp21 Stunnel HTTP for mail121 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [15:12:53] RECOVERY - cp20 Stunnel HTTP for mon111 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 39184 bytes in 0.044 second response time [15:12:55] PROBLEM - cp20 SSH on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:13:13] RECOVERY - cp21 Stunnel HTTP for mw101 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 2.029 second response time [15:13:18] PROBLEM - www.puzzles.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:13:36] RECOVERY - swests.org - LetsEncrypt on sslhost is OK: OK - Certificate 'swests.org' will expire on Thu 20 Oct 2022 03:33:41 GMT +0000. [15:13:38] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.41, 1.73, 1.95 [15:13:43] PROBLEM - mediawiki.ecfin.eu - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:13:45] PROBLEM - wiki-tintin.cf - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:13:54] PROBLEM - cp21 Current Load on cp21 is WARNING: WARNING - load average: 0.79, 1.89, 1.67 [15:14:21] RECOVERY - wiki.ssij.se - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.ssij.se' will expire on Mon 22 Aug 2022 22:25:45 GMT +0000. [15:14:22] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.65, 3.70, 3.97 [15:14:29] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.03, 3.94, 3.92 [15:14:52] PROBLEM - commonswiki.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:15:00] RECOVERY - cp21 Stunnel HTTP for mail121 on cp21 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 427 bytes in 1.040 second response time [15:15:10] RECOVERY - inourownwords.online - LetsEncrypt on sslhost is OK: OK - Certificate 'inourownwords.online' will expire on Fri 02 Sep 2022 12:36:55 GMT +0000. [15:15:13] PROBLEM - cloudwiki.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:15:41] PROBLEM - pwsc.polandballwiki.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:15:55] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 0.57, 1.50, 1.55 [15:15:57] PROBLEM - drowiki.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:16:04] PROBLEM - wc.miraheze.org on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:16:08] RECOVERY - docse.tk - LetsEncrypt on sslhost is OK: OK - Certificate 'docse.tk' will expire on Tue 20 Sep 2022 11:55:51 GMT +0000. [15:16:21] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.48, 4.01, 4.05 [15:16:27] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.25, 3.77, 3.86 [15:16:45] RECOVERY - it.famepedia.org - LetsEncrypt on sslhost is OK: OK - Certificate 'it.famepedia.org' will expire on Sat 08 Oct 2022 06:08:33 GMT +0000. [15:16:54] RECOVERY - cp20 SSH on cp20 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [15:17:38] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.45, 1.96, 1.97 [15:17:45] RECOVERY - wikifencing.ru - LetsEncrypt on sslhost is OK: OK - Certificate 'wikifencing.ru' will expire on Tue 06 Sep 2022 20:55:14 GMT +0000. [15:17:58] RECOVERY - wc.miraheze.org on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [15:18:03] RECOVERY - en.pornwiki.org - LetsEncrypt on sslhost is OK: OK - Certificate 'en.pornwiki.org' will expire on Sat 17 Sep 2022 22:00:09 GMT +0000. [15:18:09] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 2 datacenters are down: 2001:41d0:801:2000::4c25/cpweb, 2001:41d0:801:2000::1b80/cpweb [15:19:04] PROBLEM - cp20 Stunnel HTTP for puppet111 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [15:19:07] RECOVERY - test3.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [15:19:39] RECOVERY - wikicryptos.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wikicryptos.org' will expire on Wed 24 Aug 2022 05:45:16 GMT +0000. [15:19:41] RECOVERY - wiki.mineland.eu - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.mineland.eu' will expire on Tue 23 Aug 2022 01:29:10 GMT +0000. [15:19:50] PROBLEM - cp21 Stunnel HTTP for mw111 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [15:19:52] PROBLEM - miraheze.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:20:03] RECOVERY - files.pornwiki.org - LetsEncrypt on sslhost is OK: OK - Certificate 'files.pornwiki.org' will expire on Sat 17 Sep 2022 19:10:31 GMT +0000. [15:20:37] RECOVERY - johanloopmans.nl - LetsEncrypt on sslhost is OK: OK - Certificate 'www.johanloopmans.nl' will expire on Sat 17 Sep 2022 20:00:57 GMT +0000. [15:20:41] PROBLEM - discordian.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:21:03] RECOVERY - cp20 Stunnel HTTP for puppet111 on cp20 is OK: HTTP OK: Status line output matched "403" - 289 bytes in 0.020 second response time [15:21:19] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.11, 10.36, 9.02 [15:21:36] RECOVERY - cnt.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [15:22:29] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.14, 3.62, 3.95 [15:23:14] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.89, 2.03, 1.50 [15:23:17] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 8.43, 9.85, 9.01 [15:23:48] PROBLEM - reviwiki.info - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:24:04] PROBLEM - otcg.ml - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:24:18] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 6.35, 4.14, 3.89 [15:24:29] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 7.53, 5.10, 4.45 [15:24:43] RECOVERY - cp21 Stunnel HTTP for mw111 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.019 second response time [15:25:23] RECOVERY - www.ballmedia.org - LetsEncrypt on sslhost is OK: OK - Certificate 'ballmedia.org' will expire on Mon 10 Oct 2022 05:56:45 GMT +0000. [15:25:58] PROBLEM - mw101 MediaWiki Rendering on mw101 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:26:00] PROBLEM - cp30 Stunnel HTTP for mw101 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:26:19] PROBLEM - cp21 HTTP 4xx/5xx ERROR Rate on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [15:26:43] RECOVERY - wiki.wisrail.de - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.wisrail.de' will expire on Tue 06 Sep 2022 21:01:07 GMT +0000. [15:26:53] RECOVERY - miraheze.tk - LetsEncrypt on sslhost is OK: OK - Certificate 'miraheze.tk' will expire on Tue 23 Aug 2022 07:48:08 GMT +0000. [15:26:58] PROBLEM - cp21 Stunnel HTTP for mw121 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:27:09] PROBLEM - cp21 Stunnel HTTP for mw101 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:27:21] RECOVERY - wiki.fbpml.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.fbpml.org' will expire on Sat 01 Oct 2022 15:33:56 GMT +0000. [15:27:31] PROBLEM - cp30 Stunnel HTTP for mw121 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:27:38] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.52, 1.80, 1.98 [15:28:06] RECOVERY - guia.esporo.net - LetsEncrypt on sslhost is OK: OK - Certificate 'guia.esporo.net' will expire on Tue 23 Aug 2022 02:23:57 GMT +0000. [15:28:16] PROBLEM - cp21 SSH on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:28:18] PROBLEM - cp31 Stunnel HTTP for mw101 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:28:20] PROBLEM - cp21 Disk Space on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [15:28:21] RECOVERY - cp21 HTTP 4xx/5xx ERROR Rate on cp21 is OK: OK - NGINX Error Rate is 7% [15:28:31] RECOVERY - www.christipedia.nl - LetsEncrypt on sslhost is OK: OK - Certificate 'www.christipedia.nl' will expire on Sat 17 Sep 2022 18:34:21 GMT +0000. [15:28:38] RECOVERY - squareenix.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [15:28:40] RECOVERY - www.portalsofphereon.com - LetsEncrypt on sslhost is OK: OK - Certificate 'www.portalsofphereon.com' will expire on Sat 17 Sep 2022 20:30:32 GMT +0000. [15:29:00] RECOVERY - mon111 Puppet on mon111 is OK: OK: Puppet is currently enabled, last run 24 seconds ago with 0 failures [15:29:13] RECOVERY - cp21 Stunnel HTTP for mw101 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 1.262 second response time [15:29:27] RECOVERY - cp30 Stunnel HTTP for mw121 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 2.121 second response time [15:29:31] RECOVERY - cp21 Stunnel HTTP for mw121 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 6.157 second response time [15:29:53] PROBLEM - cp20 Stunnel HTTP for mw101 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [15:30:02] RECOVERY - mw101 MediaWiki Rendering on mw101 is OK: HTTP OK: HTTP/1.1 200 OK - 28479 bytes in 3.192 second response time [15:30:04] RECOVERY - cp30 Stunnel HTTP for mw101 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 0.333 second response time [15:30:15] RECOVERY - cp21 SSH on cp21 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [15:30:15] RECOVERY - cp31 Stunnel HTTP for mw101 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 0.314 second response time [15:30:16] RECOVERY - cp21 Disk Space on cp21 is OK: DISK OK - free space: / 9921 MB (25% inode=96%); [15:30:45] RECOVERY - wiki.exputra.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.exputra.com' will expire on Fri 16 Sep 2022 18:09:57 GMT +0000. [15:31:20] PROBLEM - cp31 Stunnel HTTP for mw102 on cp31 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 328 bytes in 0.249 second response time [15:31:48] PROBLEM - mw102 MediaWiki Rendering on mw102 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:32:04] RECOVERY - cp20 Stunnel HTTP for mw101 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 1.044 second response time [15:32:17] PROBLEM - cp20 Stunnel HTTP for mw102 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:33:19] RECOVERY - cp31 Stunnel HTTP for mw102 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.335 second response time [15:33:47] RECOVERY - mw102 MediaWiki Rendering on mw102 is OK: HTTP OK: HTTP/1.1 200 OK - 28479 bytes in 0.347 second response time [15:35:03] RECOVERY - www.ethene.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'ethene.wiki' will expire on Sat 24 Sep 2022 13:58:45 GMT +0000. [15:35:04] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.85, 9.97, 8.89 [15:35:38] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.66, 1.42, 1.70 [15:36:18] RECOVERY - wiki.beergeeks.co.il - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.beergeeks.co.il' will expire on Mon 22 Aug 2022 21:21:00 GMT +0000. [15:37:02] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 6.63, 8.92, 8.66 [15:37:05] PROBLEM - thestories.kr - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:37:16] RECOVERY - cp20 Stunnel HTTP for mw102 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 0.023 second response time [15:37:50] RECOVERY - test2.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [15:38:05] RECOVERY - en.wikiretet.ga - LetsEncrypt on sslhost is OK: OK - Certificate 'en.wikiretet.ga' will expire on Sun 02 Oct 2022 05:37:01 GMT +0000. [15:38:48] PROBLEM - az.wikiretet.ga - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:39:02] PROBLEM - smashbroswiki.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:39:14] PROBLEM - cp21 Stunnel HTTP for matomo101 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:39:25] RECOVERY - proficientprofit.click - LetsEncrypt on sslhost is OK: OK - Certificate 'www.proficientprofit.click' will expire on Sat 08 Oct 2022 06:14:24 GMT +0000. [15:39:30] PROBLEM - cp21 Stunnel HTTP for mw122 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [15:40:25] PROBLEM - cp21 Stunnel HTTP for mw102 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [15:40:29] RECOVERY - burnout.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'burnout.wiki' will expire on Fri 19 Aug 2022 05:01:19 GMT +0000. [15:41:14] RECOVERY - cp21 Stunnel HTTP for matomo101 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 99061 bytes in 1.344 second response time [15:41:38] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.88, 1.74, 1.75 [15:42:19] RECOVERY - hellointernet.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [15:42:20] RECOVERY - cp21 Stunnel HTTP for mw102 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 1.023 second response time [15:42:34] PROBLEM - cp20 Stunnel HTTP for mw102 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:43:02] RECOVERY - mediawiki.ecfin.eu - LetsEncrypt on sslhost is OK: OK - Certificate 'mediawiki.ecfin.eu' will expire on Mon 22 Aug 2022 23:01:19 GMT +0000. [15:43:07] RECOVERY - wiki-tintin.cf - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki-tintin.cf' will expire on Mon 10 Oct 2022 03:55:03 GMT +0000. [15:43:09] PROBLEM - www.mcpk.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:43:46] RECOVERY - commonswiki.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [15:44:31] RECOVERY - drowiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'drowiki.com' will expire on Tue 04 Oct 2022 18:56:56 GMT +0000. [15:44:33] RECOVERY - cp20 Stunnel HTTP for mw102 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.025 second response time [15:45:13] PROBLEM - cp21 Stunnel HTTP for mon111 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [15:45:14] RECOVERY - pwsc.polandballwiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'pwsc.polandballwiki.com' will expire on Sun 02 Oct 2022 10:41:20 GMT +0000. [15:45:38] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.19, 1.49, 1.64 [15:45:46] PROBLEM - wiki.minebox.fr - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:46:27] PROBLEM - rarewiki.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:46:27] PROBLEM - abeyancewiki.bumblebee-studios.se - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:47:11] RECOVERY - cp21 Stunnel HTTP for mon111 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 39169 bytes in 1.091 second response time [15:47:22] RECOVERY - cp21 Stunnel HTTP for mw122 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 7.590 second response time [15:47:23] PROBLEM - www.fossilfighterswiki.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:47:36] PROBLEM - wiki.helsinginpoytaroolipelaajat.fi - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:48:09] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [15:48:21] PROBLEM - cp21 Stunnel HTTP for mw102 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [15:48:22] PROBLEM - wikileague.cf - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:48:49] RECOVERY - allthetropes.org - LetsEncrypt on sslhost is OK: OK - Certificate 'allthetropes.org' will expire on Tue 23 Aug 2022 01:54:39 GMT +0000. [15:48:55] PROBLEM - cp20 PowerDNS Recursor on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [15:48:59] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 0.88, 1.43, 1.83 [15:49:00] PROBLEM - cp20 Stunnel HTTP for mw102 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:49:38] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.15, 1.78, 1.72 [15:49:59] PROBLEM - cp21 conntrack_table_size on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [15:50:12] PROBLEM - mw102 MediaWiki Rendering on mw102 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:50:19] PROBLEM - cp20 Stunnel HTTP for mw101 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:50:33] PROBLEM - cp31 Stunnel HTTP for mw101 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:50:39] RECOVERY - discordian.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'discordian.wiki' will expire on Fri 16 Sep 2022 18:03:24 GMT +0000. [15:50:48] PROBLEM - cp30 Stunnel HTTP for mw102 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:51:00] RECOVERY - cp20 PowerDNS Recursor on cp20 is OK: DNS OK: 0.432 seconds response time. miraheze.org returns 198.244.148.90,2001:41d0:801:2000::1b80,2001:41d0:801:2000::4c25,51.195.220.68 [15:51:01] RECOVERY - cp20 Stunnel HTTP for mw102 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 1.749 second response time [15:51:54] RECOVERY - cp21 conntrack_table_size on cp21 is OK: OK: nf_conntrack is 5 % full [15:52:02] PROBLEM - cp21 Stunnel HTTP for mw101 on cp21 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 328 bytes in 0.066 second response time [15:52:05] PROBLEM - mw101 MediaWiki Rendering on mw101 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:52:11] PROBLEM - wikicompliance.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:52:12] PROBLEM - cp30 Stunnel HTTP for mw101 on cp30 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 328 bytes in 6.013 second response time [15:52:18] PROBLEM - cp21 Stunnel HTTP for matomo101 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [15:52:18] RECOVERY - mw102 MediaWiki Rendering on mw102 is OK: HTTP OK: HTTP/1.1 200 OK - 28479 bytes in 7.285 second response time [15:52:30] RECOVERY - mh142.com - LetsEncrypt on sslhost is OK: OK - Certificate 'mh142.com' will expire on Tue 23 Aug 2022 00:06:10 GMT +0000. [15:52:31] PROBLEM - marinebiodiversitymatrix.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:52:48] RECOVERY - cp30 Stunnel HTTP for mw102 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 3.885 second response time [15:53:38] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.51, 1.90, 1.81 [15:53:51] RECOVERY - otcg.ml - LetsEncrypt on sslhost is OK: OK - Certificate 'otcg.ml' will expire on Sat 17 Sep 2022 22:12:58 GMT +0000. [15:54:07] RECOVERY - mw101 MediaWiki Rendering on mw101 is OK: HTTP OK: HTTP/1.1 200 OK - 28479 bytes in 6.780 second response time [15:54:09] RECOVERY - cp30 Stunnel HTTP for mw101 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.317 second response time [15:54:29] RECOVERY - cp21 Stunnel HTTP for matomo101 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 99061 bytes in 7.281 second response time [15:54:34] RECOVERY - cp20 Stunnel HTTP for mw101 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.018 second response time [15:54:37] RECOVERY - cp31 Stunnel HTTP for mw101 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.318 second response time [15:54:45] PROBLEM - mabi.myomi.net - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:54:56] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.85, 1.19, 1.60 [15:55:03] PROBLEM - wiki.sketch.town - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:56:06] PROBLEM - hi.famepedia.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:56:24] PROBLEM - cp20 Stunnel HTTP for mw111 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [15:56:33] PROBLEM - cp31 Varnish Backends on cp31 is CRITICAL: 1 backends are down. mw101 [15:56:36] RECOVERY - replication-ops.com - LetsEncrypt on sslhost is OK: OK - Certificate 'replication-ops.com' will expire on Tue 18 Oct 2022 15:32:39 GMT +0000. [15:57:20] PROBLEM - programming.red - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:57:28] PROBLEM - wc.miraheze.org on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:57:31] PROBLEM - cp30 Stunnel HTTP for mw122 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:57:35] PROBLEM - mw122 MediaWiki Rendering on mw122 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:57:38] PROBLEM - cp31 Stunnel HTTP for mw122 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:57:38] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.45, 1.55, 1.68 [15:57:38] RECOVERY - cp21 Stunnel HTTP for mw102 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 3.044 second response time [15:58:01] PROBLEM - wiki.umbranet.mandelbrotgames.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:58:02] PROBLEM - wiki.potabi.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:58:33] RECOVERY - cp31 Varnish Backends on cp31 is OK: All 14 backends are healthy [15:59:28] RECOVERY - cp30 Stunnel HTTP for mw122 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.318 second response time [15:59:33] RECOVERY - mw122 MediaWiki Rendering on mw122 is OK: HTTP OK: HTTP/1.1 200 OK - 28479 bytes in 0.305 second response time [15:59:33] RECOVERY - cp21 Stunnel HTTP for mw101 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 1.030 second response time [15:59:38] RECOVERY - cp31 Stunnel HTTP for mw122 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 0.307 second response time [15:59:41] PROBLEM - scum-wiki.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:00:09] PROBLEM - lab.wikimimo.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:00:16] PROBLEM - croc.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:00:45] RECOVERY - cp20 Stunnel HTTP for mw111 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.018 second response time [16:00:48] PROBLEM - www.portalsofphereon.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:01:14] PROBLEM - wikipanel.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:01:19] PROBLEM - cp20 SSH on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:01:23] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [16:01:31] PROBLEM - cp21 ferm_active on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [16:02:06] PROBLEM - www.hoolehistoryheritagesociety.org.uk - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:03:32] RECOVERY - wc.miraheze.org on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [16:03:35] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 0.25, 0.30, 0.37 [16:03:40] PROBLEM - cp20 Stunnel HTTP for mw121 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:03:42] RECOVERY - cp21 ferm_active on cp21 is OK: OK ferm input default policy is set [16:03:53] PROBLEM - cp21 SSH on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:04:11] PROBLEM - puritwiki.p-e.kr - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:04:14] PROBLEM - wiki.jeremyboyd.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:04:21] PROBLEM - cp20 PowerDNS Recursor on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [16:05:28] PROBLEM - cp21 Stunnel HTTP for mw111 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:05:38] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.71, 2.06, 1.82 [16:05:45] RECOVERY - thestories.kr - LetsEncrypt on sslhost is OK: OK - Certificate 'thestories.kr' will expire on Thu 01 Sep 2022 00:44:22 GMT +0000. [16:05:59] PROBLEM - aman.awiki.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:06:14] PROBLEM - smashbros.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:06:21] PROBLEM - tep.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:06:34] RECOVERY - cp20 PowerDNS Recursor on cp20 is OK: DNS OK: 0.286 seconds response time. miraheze.org returns 198.244.148.90,2001:41d0:801:2000::1b80,2001:41d0:801:2000::4c25,51.195.220.68 [16:07:06] PROBLEM - www.zenbuddhism.info - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:07:16] PROBLEM - cp30 Stunnel HTTP for mw111 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:07:26] RECOVERY - cp20 SSH on cp20 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [16:07:40] PROBLEM - cp20 Stunnel HTTP for mw111 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [16:07:40] RECOVERY - az.wikiretet.ga - LetsEncrypt on sslhost is OK: OK - Certificate 'az.wikiretet.ga' will expire on Tue 11 Oct 2022 04:40:37 GMT +0000. [16:07:57] PROBLEM - mw111 MediaWiki Rendering on mw111 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:08:09] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::4c25/cpweb [16:08:30] RECOVERY - cp20 Stunnel HTTP for mw121 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.018 second response time [16:09:10] RECOVERY - wikien.wildterra2.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wikien.wildterra2.com' will expire on Wed 24 Aug 2022 01:30:15 GMT +0000. [16:09:11] RECOVERY - cp30 Stunnel HTTP for mw111 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.317 second response time [16:09:19] PROBLEM - wikimas.kr - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:09:39] PROBLEM - cp20 Stunnel HTTP for mw102 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:09:46] RECOVERY - cp20 Stunnel HTTP for mw111 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 1.027 second response time [16:09:54] RECOVERY - mw111 MediaWiki Rendering on mw111 is OK: HTTP OK: HTTP/1.1 200 OK - 28479 bytes in 0.459 second response time [16:09:58] PROBLEM - cp20 Stunnel HTTP for mw112 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [16:10:08] RECOVERY - cp21 SSH on cp21 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [16:10:11] RECOVERY - cp21 Stunnel HTTP for mw111 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 1.057 second response time [16:10:28] PROBLEM - cp21 Stunnel HTTP for mw102 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:12:01] RECOVERY - www.mcpk.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'www.mcpk.wiki' will expire on Sat 17 Sep 2022 18:44:27 GMT +0000. [16:13:09] PROBLEM - cp20 Disk Space on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [16:13:51] RECOVERY - cloudwiki.org - LetsEncrypt on sslhost is OK: OK - Certificate 'cloudwiki.org' will expire on Sun 23 Oct 2022 16:49:57 GMT +0000. [16:14:02] PROBLEM - cp21 Stunnel HTTP for mw101 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [16:14:39] RECOVERY - cp20 Stunnel HTTP for mw102 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 1.030 second response time [16:14:47] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.43, 1.71, 1.43 [16:15:03] PROBLEM - commonswiki.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:15:07] RECOVERY - cp20 Disk Space on cp20 is OK: DISK OK - free space: / 9881 MB (25% inode=96%); [16:15:19] RECOVERY - wiki.minebox.fr - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.minebox.fr' will expire on Fri 16 Sep 2022 18:05:33 GMT +0000. [16:15:28] RECOVERY - rarewiki.org - LetsEncrypt on sslhost is OK: OK - Certificate 'rarewiki.org' will expire on Wed 28 Sep 2022 05:06:19 GMT +0000. [16:16:06] RECOVERY - cp21 Stunnel HTTP for mw101 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 0.025 second response time [16:16:06] RECOVERY - abeyancewiki.bumblebee-studios.se - LetsEncrypt on sslhost is OK: OK - Certificate 'abeyancewiki.bumblebee-studios.se' will expire on Wed 24 Aug 2022 16:26:15 GMT +0000. [16:16:57] RECOVERY - www.fossilfighterswiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'www.fossilfighterswiki.com' will expire on Sat 24 Sep 2022 13:17:51 GMT +0000. [16:17:50] RECOVERY - wikileague.cf - LetsEncrypt on sslhost is OK: OK - Certificate 'wikileague.cf' will expire on Mon 22 Aug 2022 22:21:46 GMT +0000. [16:18:15] PROBLEM - cp21 Stunnel HTTP for mw112 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:18:25] PROBLEM - cp20 Stunnel HTTP for mw121 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [16:18:35] PROBLEM - cp31 Stunnel HTTP for mw112 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:18:43] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.43, 1.87, 1.51 [16:18:56] PROBLEM - mw112 MediaWiki Rendering on mw112 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:20:12] RECOVERY - cp21 Stunnel HTTP for mw112 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.021 second response time [16:20:33] RECOVERY - cp31 Stunnel HTTP for mw112 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.322 second response time [16:20:53] RECOVERY - mw112 MediaWiki Rendering on mw112 is OK: HTTP OK: HTTP/1.1 200 OK - 28479 bytes in 0.327 second response time [16:22:36] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [16:22:46] RECOVERY - reviwiki.info - LetsEncrypt on sslhost is OK: OK - Certificate 'reviwiki.info' will expire on Sat 17 Sep 2022 19:46:36 GMT +0000. [16:22:52] RECOVERY - cp21 Stunnel HTTP for mw102 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 1.026 second response time [16:22:52] RECOVERY - cp20 Stunnel HTTP for mw112 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 1.024 second response time [16:23:54] PROBLEM - wiki.meeusen.net - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:23:55] RECOVERY - cp20 Stunnel HTTP for mw121 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 4.020 second response time [16:24:02] RECOVERY - history.sdtef.org - LetsEncrypt on sslhost is OK: OK - Certificate 'history.sdtef.org' will expire on Tue 23 Aug 2022 02:29:10 GMT +0000. [16:24:23] RECOVERY - wiki.sketch.town - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.sketch.town' will expire on Thu 13 Oct 2022 04:34:16 GMT +0000. [16:24:37] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 0.69, 0.39, 0.33 [16:24:43] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.40, 1.81, 1.62 [16:24:54] PROBLEM - worldsanskrit.net - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:25:51] RECOVERY - hi.famepedia.org - LetsEncrypt on sslhost is OK: OK - Certificate 'hi.famepedia.org' will expire on Tue 18 Oct 2022 14:04:28 GMT +0000. [16:26:43] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.43, 1.66, 1.59 [16:26:45] RECOVERY - wiki.umbranet.mandelbrotgames.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.umbranet.mandelbrotgames.com' will expire on Sun 02 Oct 2022 11:07:49 GMT +0000. [16:26:47] RECOVERY - programming.red - LetsEncrypt on sslhost is OK: OK - Certificate 'programming.red' will expire on Tue 23 Aug 2022 09:31:28 GMT +0000. [16:27:15] RECOVERY - wiki.macc.nyc - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.macc.nyc' will expire on Wed 31 Aug 2022 20:26:03 GMT +0000. [16:28:33] PROBLEM - wiki.newnormal.fans - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:29:13] PROBLEM - cp20 ferm_active on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [16:29:39] PROBLEM - microworldwiki.ga - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:29:39] PROBLEM - wiki.ct777.cf - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:29:40] PROBLEM - electowiki.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:30:02] PROBLEM - cp20 Stunnel HTTP for mw121 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [16:30:08] RECOVERY - wikipanel.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wikipanel.org' will expire on Sun 02 Oct 2022 04:51:38 GMT +0000. [16:30:15] PROBLEM - cp21 Puppet on cp21 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): File[/etc/apt/trusted.gpg.d/puppetlabs.gpg] [16:30:29] RECOVERY - www.portalsofphereon.com - LetsEncrypt on sslhost is OK: OK - Certificate 'www.portalsofphereon.com' will expire on Sat 17 Sep 2022 20:30:32 GMT +0000. [16:31:15] PROBLEM - recaptime.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:31:17] RECOVERY - cp20 ferm_active on cp20 is OK: OK ferm input default policy is set [16:31:46] RECOVERY - www.hoolehistoryheritagesociety.org.uk - LetsEncrypt on sslhost is OK: OK - Certificate 'www.hoolehistoryheritagesociety.org.uk' will expire on Sat 01 Oct 2022 16:03:14 GMT +0000. [16:32:22] PROBLEM - animefeet.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:33:19] PROBLEM - arru.xyz - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:33:51] PROBLEM - cp20 Stunnel HTTP for mwtask111 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [16:33:56] RECOVERY - puritwiki.p-e.kr - LetsEncrypt on sslhost is OK: OK - Certificate 'puritwiki.p-e.kr' will expire on Thu 29 Sep 2022 02:01:07 GMT +0000. [16:34:02] RECOVERY - cp20 Stunnel HTTP for mw121 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.017 second response time [16:34:04] PROBLEM - wiki.mastodon.kr - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:34:43] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 1.54, 3.04, 2.31 [16:35:52] RECOVERY - tep.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'tep.wiki' will expire on Tue 23 Aug 2022 08:40:10 GMT +0000. [16:36:04] RECOVERY - cp20 Stunnel HTTP for mwtask111 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15950 bytes in 0.024 second response time [16:36:23] RECOVERY - www.zenbuddhism.info - LetsEncrypt on sslhost is OK: OK - Certificate 'www.zenbuddhism.info' will expire on Sat 17 Sep 2022 20:26:18 GMT +0000. [16:36:31] PROBLEM - sarovia.graalmilitary.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:36:53] PROBLEM - cp21 PowerDNS Recursor on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [16:36:55] RECOVERY - cp21 Varnish Backends on cp21 is OK: All 14 backends are healthy [16:37:01] PROBLEM - wiki.vinesh.eu.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:37:05] PROBLEM - dkpedia.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:37:58] PROBLEM - cp20 HTTP 4xx/5xx ERROR Rate on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [16:37:58] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [16:38:09] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [16:38:21] RECOVERY - wikimas.kr - LetsEncrypt on sslhost is OK: OK - Certificate 'wikimas.kr' will expire on Tue 23 Aug 2022 13:01:24 GMT +0000. [16:38:30] PROBLEM - cp20 Stunnel HTTP for mw111 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:38:38] PROBLEM - celeste.ink - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:38:43] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 0.61, 1.67, 1.90 [16:38:47] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 0.93, 1.72, 1.91 [16:39:03] RECOVERY - wiki.meower.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.meower.org' will expire on Sun 14 Aug 2022 04:08:30 GMT +0000. [16:39:07] RECOVERY - cp21 PowerDNS Recursor on cp21 is OK: DNS OK: 0.230 seconds response time. miraheze.org returns 198.244.148.90,2001:41d0:801:2000::1b80,2001:41d0:801:2000::4c25,51.195.220.68 [16:39:23] PROBLEM - cp20 PowerDNS Recursor on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [16:39:34] [Grafana] FIRING: Some MediaWiki Appservers are running out of PHP-FPM workers. https://grafana.miraheze.org/d/GtxbP1Xnk [16:39:37] PROBLEM - cp21 Stunnel HTTP for mw122 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [16:39:55] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 0.80, 0.68, 0.54 [16:39:57] RECOVERY - cp20 HTTP 4xx/5xx ERROR Rate on cp20 is OK: OK - NGINX Error Rate is 3% [16:40:24] PROBLEM - m33ks.ml - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:40:29] RECOVERY - cp20 Stunnel HTTP for mw111 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.062 second response time [16:40:51] PROBLEM - cp21 Varnish Backends on cp21 is CRITICAL: 4 backends are down. mw102 mw111 mw112 mw121 [16:41:03] PROBLEM - mystiverse.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:41:07] PROBLEM - cp21 Stunnel HTTP for mw112 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:41:46] RECOVERY - cp21 Stunnel HTTP for mw122 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 7.192 second response time [16:42:01] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.35, 10.00, 8.30 [16:42:09] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::4c25/cpweb [16:42:28] PROBLEM - cp21 Stunnel HTTP for mw102 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:42:43] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.51, 1.03, 1.58 [16:42:45] PROBLEM - iceria.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:43:03] RECOVERY - cp21 Stunnel HTTP for mw112 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 1.330 second response time [16:43:08] RECOVERY - www.puzzles.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'www.puzzles.wiki' will expire on Thu 20 Oct 2022 16:22:25 GMT +0000. [16:43:58] RECOVERY - commonswiki.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [16:44:01] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.77, 9.25, 8.25 [16:44:25] RECOVERY - cp21 Stunnel HTTP for mw102 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 2.049 second response time [16:44:26] PROBLEM - cp20 NTP time on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [16:44:27] RECOVERY - cp20 PowerDNS Recursor on cp20 is OK: DNS OK: 0.445 seconds response time. miraheze.org returns 198.244.148.90,2001:41d0:801:2000::1b80,2001:41d0:801:2000::4c25,51.195.220.68 [16:44:47] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 4.50, 2.86, 2.23 [16:44:48] PROBLEM - fortis.miraheze.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:44:51] PROBLEM - electrowiki.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:45:15] RECOVERY - wiki.helsinginpoytaroolipelaajat.fi - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.helsinginpoytaroolipelaajat.fi' will expire on Mon 29 Aug 2022 12:44:24 GMT +0000. [16:45:44] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.50, 9.90, 8.65 [16:45:56] PROBLEM - cp21 HTTP 4xx/5xx ERROR Rate on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [16:46:05] PROBLEM - m.miraheze.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:46:10] PROBLEM - zh.gyaanipedia.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:46:10] PROBLEM - atnarsia.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:46:22] RECOVERY - cp20 NTP time on cp20 is OK: NTP OK: Offset -0.001279741526 secs [16:47:14] PROBLEM - cp20 Stunnel HTTP for mon111 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:47:16] PROBLEM - cp30 Stunnel HTTP for mw112 on cp30 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 328 bytes in 0.239 second response time [16:47:18] PROBLEM - cp30 Stunnel HTTP for mw111 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:47:29] PROBLEM - inourownwords.online - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:47:52] PROBLEM - cp31 Stunnel HTTP for mw112 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:47:53] PROBLEM - docse.tk - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:47:55] PROBLEM - cp21 HTTP 4xx/5xx ERROR Rate on cp21 is WARNING: WARNING - NGINX Error Rate is 54% [16:48:01] RECOVERY - m.miraheze.org - LetsEncrypt on sslhost is OK: OK - Certificate 'm.miraheze.org' will expire on Tue 06 Sep 2022 21:18:17 GMT +0000. [16:48:09] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [16:48:13] PROBLEM - wiki.apico.buzz - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:48:47] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.16, 1.90, 1.97 [16:49:11] RECOVERY - cp30 Stunnel HTTP for mw112 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 0.333 second response time [16:49:14] RECOVERY - cp20 Stunnel HTTP for mon111 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 39184 bytes in 1.065 second response time [16:49:14] RECOVERY - cp30 Stunnel HTTP for mw111 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 1.225 second response time [16:49:25] PROBLEM - www.journeytheword.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:49:40] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.33, 9.64, 8.91 [16:49:49] PROBLEM - wikifencing.ru - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:49:51] RECOVERY - cp31 Stunnel HTTP for mw112 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 1.552 second response time [16:49:57] PROBLEM - sammaditthi.cyou - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:49:57] RECOVERY - cp21 HTTP 4xx/5xx ERROR Rate on cp21 is OK: OK - NGINX Error Rate is 5% [16:50:35] PROBLEM - wiki.veloren.net - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:50:43] PROBLEM - wiki.ciptamedia.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:50:43] PROBLEM - wiki.hylormc.tk - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:51:12] PROBLEM - cp21 Stunnel HTTP for mw102 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [16:51:24] PROBLEM - wiki.sanctuary-rts.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:51:48] RECOVERY - marinebiodiversitymatrix.org - LetsEncrypt on sslhost is OK: OK - Certificate 'marinebiodiversitymatrix.org' will expire on Wed 24 Aug 2022 01:59:18 GMT +0000. [16:52:07] RECOVERY - wikicompliance.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wikicompliance.com' will expire on Fri 07 Oct 2022 11:39:30 GMT +0000. [16:52:16] PROBLEM - nintendo.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:53:02] PROBLEM - dc.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:53:19] RECOVERY - wiki.meeusen.net - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.meeusen.net' will expire on Sat 17 Sep 2022 21:26:27 GMT +0000. [16:53:25] RECOVERY - worldsanskrit.net - LetsEncrypt on sslhost is OK: OK - Certificate 'worldsanskrit.net' will expire on Sat 24 Sep 2022 13:22:32 GMT +0000. [16:53:38] PROBLEM - legacygt.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:53:41] PROBLEM - wc.miraheze.org on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:54:19] PROBLEM - m.miraheze.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:55:23] PROBLEM - wiki.counterculturelabs.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:55:35] RECOVERY - wc.miraheze.org on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [16:55:42] PROBLEM - cp21 Stunnel HTTP for reports121 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [16:56:01] RECOVERY - cp21 Stunnel HTTP for mw102 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 0.358 second response time [16:56:12] RECOVERY - m.miraheze.org - LetsEncrypt on sslhost is OK: OK - Certificate 'm.miraheze.org' will expire on Tue 06 Sep 2022 21:18:17 GMT +0000. [16:56:40] PROBLEM - wiki.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:56:47] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.59, 1.07, 1.58 [16:56:48] PROBLEM - cp21 Stunnel HTTP for mw112 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [16:56:54] PROBLEM - mw101 MediaWiki Rendering on mw101 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 1595 bytes in 0.018 second response time [16:57:07] PROBLEM - wiki.parappa.dev - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:57:17] PROBLEM - cp31 Stunnel HTTP for mw101 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:57:23] RECOVERY - scum-wiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'scum-wiki.com' will expire on Sat 22 Oct 2022 05:35:09 GMT +0000. [16:57:25] PROBLEM - cp21 Stunnel HTTP for mw101 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [16:57:41] RECOVERY - wiki.newnormal.fans - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.newnormal.fans' will expire on Fri 14 Oct 2022 16:20:05 GMT +0000. [16:57:59] RECOVERY - cp21 Stunnel HTTP for reports121 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 10996 bytes in 1.070 second response time [16:58:09] RECOVERY - lab.wikimimo.com - LetsEncrypt on sslhost is OK: OK - Certificate 'lab.wikimimo.com' will expire on Sun 09 Oct 2022 03:42:01 GMT +0000. [16:58:19] PROBLEM - cp20 Stunnel HTTP for mw101 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [16:58:22] RECOVERY - wiki.ct777.cf - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.ct777.cf' will expire on Sun 02 Oct 2022 10:59:59 GMT +0000. [16:58:23] RECOVERY - microworldwiki.ga - LetsEncrypt on sslhost is OK: OK - Certificate 'microworldwiki.ga' will expire on Mon 26 Sep 2022 05:41:37 GMT +0000. [16:58:25] PROBLEM - cp20 Stunnel HTTP for mw111 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [16:58:26] RECOVERY - electowiki.org - LetsEncrypt on sslhost is OK: OK - Certificate 'electowiki.org' will expire on Tue 23 Aug 2022 00:50:24 GMT +0000. [16:58:37] PROBLEM - programming.red - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:58:45] RECOVERY - cp21 Stunnel HTTP for mw112 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 3.042 second response time [16:58:50] RECOVERY - mw101 MediaWiki Rendering on mw101 is OK: HTTP OK: HTTP/1.1 200 OK - 28479 bytes in 0.318 second response time [16:58:59] PROBLEM - cp21 Stunnel HTTP for mw122 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:59:15] RECOVERY - cp31 Stunnel HTTP for mw101 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.352 second response time [16:59:23] RECOVERY - cp21 Stunnel HTTP for mw101 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 1.044 second response time [16:59:26] RECOVERY - cp21 Puppet on cp21 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [16:59:36] PROBLEM - www.publictestwiki.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:59:43] PROBLEM - cp20 Puppet on cp20 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [16:59:46] PROBLEM - wiki.misslessfighters.club - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:59:46] PROBLEM - wiki.triplescripts.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:00:02] RECOVERY - recaptime.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [17:00:04] PROBLEM - wikipedia.yogfront.ooo - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:00:13] PROBLEM - landofliberos.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:00:14] RECOVERY - cp20 Stunnel HTTP for mw101 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.021 second response time [17:00:31] RECOVERY - cp20 Stunnel HTTP for mw111 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 1.033 second response time [17:00:38] PROBLEM - ambientguitar.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:01:03] PROBLEM - infectowiki.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:01:38] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.35, 1.56, 1.95 [17:01:41] PROBLEM - dc-multiverse.dcwikis.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:01:47] RECOVERY - animefeet.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [17:02:09] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 2 datacenters are down: 2001:41d0:801:2000::4c25/cpweb, 2001:41d0:801:2000::1b80/cpweb [17:02:30] PROBLEM - meta.gyaanipedia.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:02:38] PROBLEM - www.portalsofphereon.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:03:08] PROBLEM - cp21 Stunnel HTTP for mon111 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:03:21] RECOVERY - datacrondatabase.com - LetsEncrypt on sslhost is OK: OK - Certificate 'datacrondatabase.com' will expire on Mon 22 Aug 2022 15:10:26 GMT +0000. [17:03:35] PROBLEM - cp20 Stunnel HTTP for mw122 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:03:37] PROBLEM - cp21 Stunnel HTTP for mw111 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [17:03:37] PROBLEM - istpcomputing.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:03:43] PROBLEM - fr.gyaanipedia.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:03:52] RECOVERY - wiki.mastodon.kr - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.mastodon.kr' will expire on Mon 05 Sep 2022 00:02:52 GMT +0000. [17:03:56] RECOVERY - cp21 Stunnel HTTP for mw122 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 5.084 second response time [17:04:00] RECOVERY - wiki.jeremyboyd.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.jeremyboyd.org' will expire on Fri 12 Aug 2022 07:04:44 GMT +0000. [17:04:08] PROBLEM - cp21 ferm_active on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [17:04:22] PROBLEM - www.zetapedia.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:04:25] PROBLEM - cp21 Stunnel HTTP for phab121 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [17:04:41] PROBLEM - cp21 SSH on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:04:48] PROBLEM - cp21 Stunnel HTTP for mw121 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [17:05:34] RECOVERY - cp21 Stunnel HTTP for mw111 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.030 second response time [17:05:36] RECOVERY - cp20 Stunnel HTTP for mw122 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.022 second response time [17:05:39] PROBLEM - biblestrength.net - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:05:42] RECOVERY - smashbros.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [17:05:46] RECOVERY - dkpedia.com - LetsEncrypt on sslhost is OK: OK - Certificate 'dkpedia.com' will expire on Tue 04 Oct 2022 18:55:51 GMT +0000. [17:06:04] RECOVERY - sarovia.graalmilitary.com - LetsEncrypt on sslhost is OK: OK - Certificate 'sarovia.graalmilitary.com' will expire on Fri 12 Aug 2022 07:48:29 GMT +0000. [17:06:23] RECOVERY - wiki.insideearth.info - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.insideearth.info' will expire on Tue 23 Aug 2022 08:05:34 GMT +0000. [17:06:28] RECOVERY - smashbroswiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'smashbroswiki.com' will expire on Sat 22 Oct 2022 05:43:00 GMT +0000. [17:06:35] PROBLEM - cp20 Stunnel HTTP for mon111 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:06:39] RECOVERY - wiki.vinesh.eu.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.vinesh.eu.org' will expire on Sat 17 Sep 2022 22:28:24 GMT +0000. [17:06:41] PROBLEM - cp21 Stunnel HTTP for mw102 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:06:43] RECOVERY - cp21 SSH on cp21 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [17:06:47] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.77, 1.75, 1.61 [17:06:55] RECOVERY - cp21 Stunnel HTTP for phab121 on cp21 is OK: HTTP OK: Status line output matched "500" - 2855 bytes in 0.142 second response time [17:07:15] RECOVERY - cp21 Stunnel HTTP for mw121 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 0.036 second response time [17:07:24] PROBLEM - cp20 Stunnel HTTP for mw102 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:08:00] RECOVERY - cp21 Stunnel HTTP for mon111 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 39184 bytes in 0.055 second response time [17:08:18] RECOVERY - celeste.ink - LetsEncrypt on sslhost is OK: OK - Certificate 'celeste.ink' will expire on Sat 24 Sep 2022 13:42:28 GMT +0000. [17:08:24] RECOVERY - antiguabarbudacalypso.com - LetsEncrypt on sslhost is OK: OK - Certificate 'antiguabarbudacalypso.com' will expire on Tue 23 Aug 2022 01:05:30 GMT +0000. [17:08:47] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.24, 1.57, 1.56 [17:09:06] RECOVERY - cp20 Stunnel HTTP for mon111 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 39184 bytes in 0.050 second response time [17:09:28] RECOVERY - cp20 Stunnel HTTP for mw102 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 4.418 second response time [17:09:38] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.38, 1.38, 1.69 [17:09:57] PROBLEM - wiki.pablojprieto.com.es - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:10:39] RECOVERY - cp21 Stunnel HTTP for mw102 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.019 second response time [17:10:54] RECOVERY - mystiverse.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'mystiverse.wiki' will expire on Sat 01 Oct 2022 04:26:41 GMT +0000. [17:11:04] PROBLEM - cp20 Stunnel HTTP for mw111 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:11:33] RECOVERY - iceria.org - LetsEncrypt on sslhost is OK: OK - Certificate 'www.iceria.org' will expire on Sat 17 Sep 2022 21:13:26 GMT +0000. [17:11:36] PROBLEM - wiki.thedev.gq - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:12:12] RECOVERY - cp21 ferm_active on cp21 is OK: OK ferm input default policy is set [17:12:18] PROBLEM - cp21 Stunnel HTTP for puppet111 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [17:12:47] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.25, 2.15, 1.83 [17:13:03] PROBLEM - pubwiki.lab.co.pl - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:13:15] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.28, 9.09, 7.91 [17:13:42] RECOVERY - fortis.miraheze.org - LetsEncrypt on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [17:14:07] PROBLEM - cp21 Stunnel HTTP for matomo101 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:14:16] RECOVERY - cp21 Stunnel HTTP for puppet111 on cp21 is OK: HTTP OK: Status line output matched "403" - 289 bytes in 0.012 second response time [17:14:36] !log mw1* set php-fpm childs to 42 [17:14:56] PROBLEM - cp21 Stunnel HTTP for mw101 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [17:15:03] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:15:32] PROBLEM - cp21 Stunnel HTTP for mw121 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:16:00] RECOVERY - zh.gyaanipedia.com - LetsEncrypt on sslhost is OK: OK - Certificate 'zh.gyaanipedia.com' will expire on Thu 08 Sep 2022 06:29:43 GMT +0000. [17:16:55] RECOVERY - docse.tk - LetsEncrypt on sslhost is OK: OK - Certificate 'docse.tk' will expire on Tue 20 Sep 2022 11:55:51 GMT +0000. [17:17:09] PROBLEM - cp21 Stunnel HTTP for mw111 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:17:11] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 14.43, 11.41, 9.08 [17:17:26] RECOVERY - inourownwords.online - LetsEncrypt on sslhost is OK: OK - Certificate 'inourownwords.online' will expire on Fri 02 Sep 2022 12:36:55 GMT +0000. [17:17:30] RECOVERY - wiki.apico.buzz - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.apico.buzz' will expire on Thu 01 Sep 2022 00:43:13 GMT +0000. [17:17:36] PROBLEM - cp30 Stunnel HTTP for mw111 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:18:51] RECOVERY - www.journeytheword.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'www.journeytheword.wiki' will expire on Wed 31 Aug 2022 18:13:33 GMT +0000. [17:19:08] PROBLEM - cp21 Stunnel HTTP for mail121 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [17:19:12] RECOVERY - wiki.veloren.net - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.veloren.net' will expire on Sat 15 Oct 2022 15:52:05 GMT +0000. [17:19:19] RECOVERY - wikifencing.ru - LetsEncrypt on sslhost is OK: OK - Certificate 'wikifencing.ru' will expire on Tue 06 Sep 2022 20:55:14 GMT +0000. [17:19:21] PROBLEM - iol.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:19:32] RECOVERY - wiki.hylormc.tk - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.hylormc.tk' will expire on Sun 04 Sep 2022 22:31:11 GMT +0000. [17:19:32] RECOVERY - wiki.ciptamedia.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.ciptamedia.org' will expire on Tue 23 Aug 2022 08:44:56 GMT +0000. [17:19:36] RECOVERY - cp30 Stunnel HTTP for mw111 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 5.833 second response time [17:19:38] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.59, 1.90, 1.73 [17:19:54] PROBLEM - cp20 Stunnel HTTP for mon111 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:20:18] PROBLEM - cp21 Stunnel HTTP for mw102 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:20:47] PROBLEM - cp20 Stunnel HTTP for mw101 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:21:01] RECOVERY - wiki.sanctuary-rts.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.sanctuary-rts.com' will expire on Sat 17 Sep 2022 18:17:01 GMT +0000. [17:21:04] RECOVERY - nintendo.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [17:21:14] PROBLEM - www.trollpasta.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:21:20] RECOVERY - cp21 Stunnel HTTP for mw111 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 5.089 second response time [17:21:37] RECOVERY - cp21 Stunnel HTTP for mail121 on cp21 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 427 bytes in 1.019 second response time [17:21:44] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.27, 13.16, 9.93 [17:21:50] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 26.77, 13.47, 9.00 [17:21:53] RECOVERY - cp20 Stunnel HTTP for mon111 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 39184 bytes in 0.050 second response time [17:22:18] RECOVERY - legacygt.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'legacygt.wiki' will expire on Fri 07 Oct 2022 11:41:33 GMT +0000. [17:22:28] RECOVERY - cp21 Stunnel HTTP for mw102 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 0.023 second response time [17:22:30] RECOVERY - cp21 Stunnel HTTP for mw121 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 0.036 second response time [17:22:38] RECOVERY - cp21 Stunnel HTTP for matomo101 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 99061 bytes in 8.090 second response time [17:22:38] RECOVERY - dc.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [17:22:43] RECOVERY - cp20 Stunnel HTTP for mw101 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.021 second response time [17:22:45] RECOVERY - cp21 Stunnel HTTP for mw101 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 3.043 second response time [17:23:15] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 11.98, 13.32, 10.68 [17:23:44] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 6.05, 10.55, 9.36 [17:23:57] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [17:24:01] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.75, 10.21, 8.44 [17:24:34] [Grafana] RESOLVED: PHP-FPM Worker Usage High https://grafana.miraheze.org/d/GtxbP1Xnk [17:25:10] PROBLEM - discordian.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:25:20] RECOVERY - wiki.counterculturelabs.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.counterculturelabs.org' will expire on Wed 31 Aug 2022 18:20:36 GMT +0000. [17:25:35] RECOVERY - wiki.potabi.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.potabi.com' will expire on Mon 10 Oct 2022 06:24:27 GMT +0000. [17:25:44] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 6.55, 9.16, 8.98 [17:25:55] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 0.51, 0.43, 0.39 [17:26:01] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 9.47, 9.83, 8.51 [17:26:15] RECOVERY - wiki.parappa.dev - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.parappa.dev' will expire on Sun 18 Sep 2022 13:44:45 GMT +0000. [17:26:24] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-8 [+0/-0/±1] 13https://github.com/miraheze/puppet/commit/677c955d7253 [17:26:26] [02miraheze/puppet] 07paladox 03677c955 - mariadb: tweak config [17:26:26] RECOVERY - wiki.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [17:26:27] [02puppet] 07paladox created branch 03paladox-patch-8 - 13https://github.com/miraheze/puppet [17:26:27] [url] Page not found · GitHub · GitHub | github.com [17:26:29] [02puppet] 07paladox opened pull request 03#2706: mariadb: tweak config - 13https://github.com/miraheze/puppet/pull/2706 [17:26:29] [url] Page not found · GitHub · GitHub | github.com [17:26:49] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-8 [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/677c955d7253...cfc0347cd600 [17:26:50] [url] Comparing 677c955d7253...cfc0347cd600 · miraheze/puppet · GitHub | github.com [17:26:51] [02miraheze/puppet] 07paladox 03cfc0347 - Update db111.yaml [17:26:52] [02puppet] 07paladox synchronize pull request 03#2706: mariadb: tweak config - 13https://github.com/miraheze/puppet/pull/2706 [17:26:53] [url] Page not found · GitHub · GitHub | github.com [17:27:00] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-8 [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/cfc0347cd600...3dbb7b7ab085 [17:27:01] [url] Comparing cfc0347cd600...3dbb7b7ab085 · miraheze/puppet · GitHub | github.com [17:27:02] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 5.31, 10.01, 11.05 [17:27:02] [02miraheze/puppet] 07paladox 033dbb7b7 - Update db121.yaml [17:27:03] [02puppet] 07paladox synchronize pull request 03#2706: mariadb: tweak config - 13https://github.com/miraheze/puppet/pull/2706 [17:27:04] [url] Page not found · GitHub · GitHub | github.com [17:27:10] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 32.33, 19.13, 11.63 [17:27:17] PROBLEM - cp20 Stunnel HTTP for mon111 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:27:17] PROBLEM - gluster111 APT on gluster111 is WARNING: APT WARNING: 0 packages available for upgrade (0 critical updates). warnings detected, errors detected. [17:27:38] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.47, 1.82, 1.82 [17:28:30] PROBLEM - cp21 Stunnel HTTP for mail121 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [17:28:45] PROBLEM - wiki.worlduniversityandschool.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:28:47] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 0.70, 1.55, 1.87 [17:28:55] RECOVERY - www.publictestwiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'publictestwiki.com' will expire on Tue 23 Aug 2022 00:48:11 GMT +0000. [17:29:00] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 20.90, 13.37, 12.08 [17:29:10] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 10.74, 11.68, 10.87 [17:29:19] PROBLEM - gluster111 APT on gluster111 is CRITICAL: APT CRITICAL: 37 packages available for upgrade (15 critical updates). [17:29:43] PROBLEM - wiki.macc.nyc - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:29:45] PROBLEM - dragonquest2.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:29:48] PROBLEM - squareenix.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:30:29] RECOVERY - cp21 Stunnel HTTP for mail121 on cp21 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 427 bytes in 0.012 second response time [17:31:04] RECOVERY - meta.gyaanipedia.com - LetsEncrypt on sslhost is OK: OK - Certificate 'meta.gyaanipedia.com' will expire on Thu 08 Sep 2022 07:12:19 GMT +0000. [17:31:29] RECOVERY - dc-multiverse.dcwikis.com - LetsEncrypt on sslhost is OK: OK - Certificate 'dc-multiverse.dcwikis.com' will expire on Wed 24 Aug 2022 05:08:53 GMT +0000. [17:31:31] PROBLEM - replication-ops.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:31:37] PROBLEM - cp21 Stunnel HTTP for mw101 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [17:31:38] PROBLEM - solaswiki.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:31:57] RECOVERY - cp20 Stunnel HTTP for mw111 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.021 second response time [17:32:06] PROBLEM - www.pornwiki.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:32:26] RECOVERY - www.portalsofphereon.com - LetsEncrypt on sslhost is OK: OK - Certificate 'www.portalsofphereon.com' will expire on Sat 17 Sep 2022 20:30:32 GMT +0000. [17:32:47] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.26, 1.21, 1.64 [17:32:52] RECOVERY - fr.gyaanipedia.com - LetsEncrypt on sslhost is OK: OK - Certificate 'fr.gyaanipedia.com' will expire on Thu 08 Sep 2022 07:15:36 GMT +0000. [17:32:57] RECOVERY - arru.xyz - LetsEncrypt on sslhost is OK: OK - Certificate 'www.arru.xyz' will expire on Sat 17 Sep 2022 21:47:49 GMT +0000. [17:33:07] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 13.67, 11.53, 10.92 [17:33:38] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.35, 1.52, 1.69 [17:33:39] RECOVERY - aman.awiki.org - LetsEncrypt on sslhost is OK: OK - Certificate 'aman.awiki.org' will expire on Mon 22 Aug 2022 23:45:19 GMT +0000. [17:33:49] RECOVERY - cp21 Stunnel HTTP for mw101 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 1.046 second response time [17:34:01] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 27.95, 15.32, 10.75 [17:34:09] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [17:34:37] PROBLEM - mr.gyaanipedia.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:35:15] RECOVERY - cp20 Stunnel HTTP for mon111 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 39176 bytes in 1.070 second response time [17:35:40] PROBLEM - datacrondatabase.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:35:44] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 29.01, 16.87, 11.69 [17:35:51] PROBLEM - cp20 SSH on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:36:21] PROBLEM - cp21 Stunnel HTTP for mw111 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [17:36:46] PROBLEM - cp21 Stunnel HTTP for mw102 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [17:36:47] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.16, 1.93, 1.86 [17:36:52] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 4.69, 10.00, 11.61 [17:37:04] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 6.09, 9.94, 10.56 [17:37:11] PROBLEM - wiki.pixlies.net - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:37:43] PROBLEM - cp21 ferm_active on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [17:37:49] RECOVERY - cp20 SSH on cp20 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [17:38:17] RECOVERY - cp21 Stunnel HTTP for mw111 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.022 second response time [17:38:31] RECOVERY - wiki.pablojprieto.com.es - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.pablojprieto.com.es' will expire on Tue 23 Aug 2022 09:39:26 GMT +0000. [17:38:35] PROBLEM - permanentfuturelab.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:38:40] RECOVERY - cp21 Stunnel HTTP for mw102 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.021 second response time [17:38:47] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 0.91, 1.52, 1.72 [17:38:49] PROBLEM - smashbroswiki.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:38:53] PROBLEM - cp21 HTTP 4xx/5xx ERROR Rate on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [17:39:02] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 6.07, 8.67, 10.02 [17:39:32] PROBLEM - cp21 Stunnel HTTP for matomo101 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [17:39:38] PROBLEM - nottingham.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:39:54] RECOVERY - cp21 ferm_active on cp21 is OK: OK ferm input default policy is set [17:39:56] PROBLEM - www.electrowiki.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:40:01] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.10, 11.94, 10.80 [17:40:14] RECOVERY - wiki.thedev.gq - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.thedev.gq' will expire on Fri 02 Sep 2022 12:36:20 GMT +0000. [17:40:34] PROBLEM - wiki.joust.ro - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:40:47] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.12, 1.34, 1.63 [17:40:48] PROBLEM - miraheze.gq - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:40:51] RECOVERY - cp21 HTTP 4xx/5xx ERROR Rate on cp21 is OK: OK - NGINX Error Rate is 11% [17:40:52] PROBLEM - sdiy.info - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:41:41] PROBLEM - wc.miraheze.org on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:41:46] PROBLEM - proficientprofit.click - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:41:46] PROBLEM - id.altilunium.xyz - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:42:01] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 25.49, 17.43, 12.96 [17:42:01] RECOVERY - cp21 Stunnel HTTP for matomo101 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 99061 bytes in 0.227 second response time [17:42:01] PROBLEM - guia.cineastas.pt - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:42:03] PROBLEM - source.erag.eu.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:42:52] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 25.38, 13.06, 11.82 [17:43:15] PROBLEM - cp21 Stunnel HTTP for mw101 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:43:40] PROBLEM - wiki.worldbuilding.network - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:43:41] PROBLEM - jp.popira.info - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:44:04] PROBLEM - cp20 Stunnel HTTP for mw112 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [17:44:32] PROBLEM - cp21 Stunnel HTTP for mw112 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [17:45:00] PROBLEM - fortis.miraheze.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:45:11] RECOVERY - atnarsia.com - LetsEncrypt on sslhost is OK: OK - Certificate 'atnarsia.com' will expire on Sun 25 Sep 2022 20:45:25 GMT +0000. [17:45:13] PROBLEM - wiki.mxlinuxusers.de - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:45:15] RECOVERY - cp21 Stunnel HTTP for mw101 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 1.047 second response time [17:45:39] RECOVERY - wc.miraheze.org on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [17:45:44] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 6.76, 11.69, 11.95 [17:46:07] RECOVERY - cp20 Stunnel HTTP for mw112 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 1.033 second response time [17:46:26] RECOVERY - cp21 Stunnel HTTP for mw112 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.020 second response time [17:46:37] PROBLEM - cp20 Stunnel HTTP for mw111 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [17:46:39] PROBLEM - cp21 Stunnel HTTP for mail121 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [17:46:47] PROBLEM - ngsswiki.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:46:52] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.22, 10.61, 11.19 [17:46:58] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 34.49, 19.36, 13.39 [17:47:24] PROBLEM - pokemonwiki.info - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:48:01] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 5.52, 10.01, 11.17 [17:48:29] PROBLEM - it.famepedia.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:48:37] PROBLEM - bn.gyaanipedia.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:48:38] RECOVERY - cp21 Stunnel HTTP for mail121 on cp21 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 427 bytes in 0.018 second response time [17:48:52] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 13.79, 11.03, 11.22 [17:49:07] RECOVERY - cp20 Stunnel HTTP for mw111 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.022 second response time [17:49:38] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 3.47, 2.48, 1.93 [17:49:42] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 4.68, 7.74, 11.99 [17:49:44] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 31.50, 16.99, 13.58 [17:49:47] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::4c25/cpweb [17:50:43] PROBLEM - cp21 Stunnel HTTP for mw102 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [17:51:02] PROBLEM - cp21 Stunnel HTTP for mw122 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:51:10] PROBLEM - wiki.timewisely.net - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:51:41] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 27.63, 14.49, 13.87 [17:51:57] PROBLEM - wc.miraheze.org on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:52:01] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 5.94, 8.26, 10.19 [17:52:07] PROBLEM - cp21 Stunnel HTTP for mw121 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [17:52:20] PROBLEM - nintendo.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:52:25] PROBLEM - wiki.leapit.no - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:52:37] PROBLEM - pwiki.drydraytonvillagehall.org.uk - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:52:37] PROBLEM - itora.bunnies1230.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:52:38] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 4.15, 7.89, 11.58 [17:52:41] RECOVERY - mabi.myomi.net - LetsEncrypt on sslhost is OK: OK - Certificate 'mabi.myomi.net' will expire on Tue 23 Aug 2022 13:11:15 GMT +0000. [17:53:01] RECOVERY - cp21 Stunnel HTTP for mw122 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 3.069 second response time [17:53:02] PROBLEM - wiki.thunis.eu - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:53:51] RECOVERY - wc.miraheze.org on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [17:54:04] RECOVERY - cp21 Stunnel HTTP for mw121 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.023 second response time [17:54:55] PROBLEM - wiki.yahyabd.xyz - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:54:58] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 4.02, 9.14, 11.27 [17:55:07] RECOVERY - discordian.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'discordian.wiki' will expire on Fri 16 Sep 2022 18:03:24 GMT +0000. [17:55:13] PROBLEM - cp30 Stunnel HTTP for mw111 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:55:32] PROBLEM - cp20 Stunnel HTTP for mw111 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:56:30] PROBLEM - cp20 Stunnel HTTP for mail121 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [17:56:35] PROBLEM - cp21 Stunnel HTTP for mw112 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:56:38] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 5.22, 6.42, 10.13 [17:56:54] PROBLEM - cp20 Stunnel HTTP for test101 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [17:57:08] RECOVERY - cp30 Stunnel HTTP for mw111 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.312 second response time [17:57:30] RECOVERY - wiki.triplescripts.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.triplescripts.org' will expire on Wed 24 Aug 2022 04:49:04 GMT +0000. [17:57:42] RECOVERY - cp21 Stunnel HTTP for mw102 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 2.816 second response time [17:57:57] RECOVERY - croc.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [17:58:24] RECOVERY - wikipedia.yogfront.ooo - LetsEncrypt on sslhost is OK: OK - Certificate 'wikipedia.yogfront.ooo' will expire on Mon 22 Aug 2022 21:48:31 GMT +0000. [17:58:37] RECOVERY - wiki.worlduniversityandschool.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.worlduniversityandschool.org' will expire on Tue 23 Aug 2022 07:52:18 GMT +0000. [17:58:38] RECOVERY - infectowiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'infectowiki.com' will expire on Tue 23 Aug 2022 08:27:35 GMT +0000. [17:58:38] RECOVERY - squareenix.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [17:58:46] RECOVERY - cp20 Puppet on cp20 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [17:58:47] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.99, 1.74, 1.55 [17:58:58] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 18.80, 11.67, 11.57 [17:59:00] RECOVERY - cp20 Stunnel HTTP for mail121 on cp20 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 427 bytes in 0.010 second response time [17:59:00] RECOVERY - cp21 Stunnel HTTP for mw112 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.022 second response time [17:59:35] RECOVERY - dragonquest2.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [17:59:39] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 5.90, 8.42, 11.35 [17:59:42] RECOVERY - landofliberos.com - LetsEncrypt on sslhost is OK: OK - Certificate 'landofliberos.com' will expire on Tue 30 Aug 2022 16:38:50 GMT +0000. [17:59:44] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 10.24, 10.62, 11.71 [17:59:45] RECOVERY - ambientguitar.org - LetsEncrypt on sslhost is OK: OK - Certificate 'ambientguitar.org' will expire on Mon 22 Aug 2022 22:13:35 GMT +0000. [18:00:47] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 3.46, 2.28, 1.76 [18:01:15] PROBLEM - cp21 Stunnel HTTP for mw101 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [18:01:19] RECOVERY - solaswiki.org - LetsEncrypt on sslhost is OK: OK - Certificate 'solaswiki.org' will expire on Sat 03 Sep 2022 15:10:56 GMT +0000. [18:01:28] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.17, 1.59, 1.26 [18:01:46] RECOVERY - www.pornwiki.org - LetsEncrypt on sslhost is OK: OK - Certificate 'www.pornwiki.org' will expire on Sat 17 Sep 2022 20:10:50 GMT +0000. [18:01:58] RECOVERY - cp20 Stunnel HTTP for test101 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15954 bytes in 0.032 second response time [18:02:18] RECOVERY - istpcomputing.com - LetsEncrypt on sslhost is OK: OK - Certificate 'istpcomputing.com' will expire on Tue 11 Oct 2022 04:37:06 GMT +0000. [18:02:33] RECOVERY - www.zetapedia.com - LetsEncrypt on sslhost is OK: OK - Certificate 'www.zetapedia.com' will expire on Wed 17 Aug 2022 21:08:43 GMT +0000. [18:02:38] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 22.39, 12.56, 11.30 [18:02:39] RECOVERY - cp21 Varnish Backends on cp21 is OK: All 14 backends are healthy [18:03:23] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.82, 1.71, 1.34 [18:03:40] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.03, 9.84, 11.17 [18:03:43] RECOVERY - cp20 Stunnel HTTP for mw111 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 1.039 second response time [18:04:38] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.01, 11.78, 11.20 [18:05:08] RECOVERY - biblestrength.net - LetsEncrypt on sslhost is OK: OK - Certificate 'biblestrength.net' will expire on Wed 07 Sep 2022 18:16:09 GMT +0000. [18:05:14] PROBLEM - cp21 SSH on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:05:18] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.08, 1.73, 1.39 [18:05:41] RECOVERY - cp21 Stunnel HTTP for mw101 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 5.281 second response time [18:05:55] RECOVERY - wiki.pixlies.net - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.pixlies.net' will expire on Tue 06 Sep 2022 20:56:25 GMT +0000. [18:06:58] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 8.48, 10.50, 11.58 [18:07:14] RECOVERY - cp21 SSH on cp21 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [18:07:14] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.41, 1.68, 1.42 [18:07:17] PROBLEM - cp21 Varnish Backends on cp21 is CRITICAL: 3 backends are down. mw101 mw111 mw122 [18:07:21] RECOVERY - permanentfuturelab.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'permanentfuturelab.wiki' will expire on Tue 23 Aug 2022 00:31:22 GMT +0000. [18:07:56] RECOVERY - m33ks.ml - LetsEncrypt on sslhost is OK: OK - Certificate 'm33ks.ml' will expire on Thu 29 Sep 2022 04:18:17 GMT +0000. [18:08:15] PROBLEM - cp21 Stunnel HTTP for reports121 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [18:08:29] PROBLEM - cp20 Stunnel HTTP for mwtask111 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [18:08:38] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.29, 9.05, 10.20 [18:08:49] RECOVERY - www.electrowiki.org - LetsEncrypt on sslhost is OK: OK - Certificate 'electrowiki.org' will expire on Sat 17 Sep 2022 19:15:15 GMT +0000. [18:08:54] PROBLEM - cp21 conntrack_table_size on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [18:09:09] RECOVERY - nottingham.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'nottingham.wiki' will expire on Mon 26 Sep 2022 06:16:48 GMT +0000. [18:09:30] RECOVERY - wiki.joust.ro - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.joust.ro' will expire on Tue 23 Aug 2022 07:32:52 GMT +0000. [18:09:30] PROBLEM - cp21 Stunnel HTTP for mw102 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [18:09:40] PROBLEM - cp20 Stunnel HTTP for matomo101 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [18:10:09] PROBLEM - test2.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:10:09] PROBLEM - sims.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:10:10] RECOVERY - cp21 Stunnel HTTP for reports121 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 10996 bytes in 0.080 second response time [18:10:11] RECOVERY - miraheze.gq - LetsEncrypt on sslhost is OK: OK - Certificate 'miraheze.gq' will expire on Wed 31 Aug 2022 20:33:05 GMT +0000. [18:10:15] RECOVERY - sdiy.info - LetsEncrypt on sslhost is OK: OK - Certificate 'sdiy.info' will expire on Sat 17 Sep 2022 21:29:52 GMT +0000. [18:10:24] PROBLEM - index.pdcommunity.ir - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:10:30] RECOVERY - cp20 Stunnel HTTP for mwtask111 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15956 bytes in 1.043 second response time [18:10:37] RECOVERY - proficientprofit.click - LetsEncrypt on sslhost is OK: OK - Certificate 'www.proficientprofit.click' will expire on Sat 08 Oct 2022 06:14:24 GMT +0000. [18:10:38] RECOVERY - id.altilunium.xyz - LetsEncrypt on sslhost is OK: OK - Certificate 'id.altilunium.xyz' will expire on Fri 23 Sep 2022 00:33:37 GMT +0000. [18:10:40] RECOVERY - pubwiki.lab.co.pl - LetsEncrypt on sslhost is OK: OK - Certificate 'pubwiki.lab.co.pl' will expire on Tue 23 Aug 2022 08:56:40 GMT +0000. [18:10:50] PROBLEM - cp20 Stunnel HTTP for mw112 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [18:10:58] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 17.65, 13.72, 12.53 [18:11:05] PROBLEM - cp21 Stunnel HTTP for mw111 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:11:15] PROBLEM - cp20 Stunnel HTTP for mw111 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:11:19] RECOVERY - cp21 conntrack_table_size on cp21 is OK: OK: nf_conntrack is 2 % full [18:11:24] RECOVERY - cp21 Stunnel HTTP for mw102 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.033 second response time [18:11:32] RECOVERY - guia.cineastas.pt - LetsEncrypt on sslhost is OK: OK - Certificate 'guia.cineastas.pt' will expire on Tue 23 Aug 2022 01:13:17 GMT +0000. [18:11:35] RECOVERY - source.erag.eu.org - LetsEncrypt on sslhost is OK: OK - Certificate 'source.erag.eu.org' will expire on Sun 09 Oct 2022 13:40:55 GMT +0000. [18:11:36] PROBLEM - wiki.thedev.gq - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:11:36] RECOVERY - cp20 Stunnel HTTP for matomo101 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 99061 bytes in 1.298 second response time [18:12:01] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 30.36, 20.77, 14.09 [18:12:26] RECOVERY - electrowiki.org - LetsEncrypt on sslhost is OK: OK - Certificate 'electrowiki.org' will expire on Sat 17 Sep 2022 19:15:15 GMT +0000. [18:12:51] PROBLEM - cp21 Stunnel HTTP for mw101 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [18:12:58] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 6.10, 10.78, 11.61 [18:13:02] RECOVERY - cp21 Stunnel HTTP for mw111 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.026 second response time [18:13:44] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 5.88, 8.34, 9.92 [18:13:54] RECOVERY - fortis.miraheze.org - LetsEncrypt on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [18:13:56] PROBLEM - mystiverse.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:14:17] PROBLEM - cp20 HTTPS on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:14:19] PROBLEM - eng.archiopedia.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:14:33] RECOVERY - wiki.mxlinuxusers.de - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.mxlinuxusers.de' will expire on Wed 24 Aug 2022 03:14:31 GMT +0000. [18:14:39] PROBLEM - wiki.autocountsoft.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:14:39] PROBLEM - hellointernet.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:14:47] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.47, 1.88, 1.92 [18:14:53] PROBLEM - cp21 SSH on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:14:57] PROBLEM - cp21 Stunnel HTTP for matomo101 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [18:15:52] PROBLEM - www.scum-wiki.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:16:12] RECOVERY - cp20 HTTPS on cp20 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 3406 bytes in 0.019 second response time [18:16:13] RECOVERY - cp20 Stunnel HTTP for mw111 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 1.556 second response time [18:16:41] PROBLEM - cp21 HTTPS on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:16:45] PROBLEM - mwcosmos.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:16:56] PROBLEM - cp21 Stunnel HTTP for mw112 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [18:16:58] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 5.34, 7.40, 9.98 [18:16:59] RECOVERY - cp21 SSH on cp21 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [18:17:03] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [18:17:08] PROBLEM - wiki.mostly.vet - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:17:09] RECOVERY - cp20 Stunnel HTTP for mw112 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 1.054 second response time [18:17:23] RECOVERY - iol.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'iol.wiki' will expire on Sun 14 Aug 2022 15:50:21 GMT +0000. [18:17:30] PROBLEM - docse.tk - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:17:31] RECOVERY - cp21 Stunnel HTTP for matomo101 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 99061 bytes in 2.326 second response time [18:18:11] PROBLEM - zh.gyaanipedia.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:18:12] PROBLEM - wiki.minebox.fr - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:18:15] RECOVERY - cp21 Stunnel HTTP for mw101 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.023 second response time [18:18:15] PROBLEM - abeyancewiki.bumblebee-studios.se - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:18:39] RECOVERY - cp21 HTTPS on cp21 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 3407 bytes in 1.036 second response time [18:18:53] RECOVERY - cp21 Stunnel HTTP for mw112 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 3.065 second response time [18:18:57] PROBLEM - cp20 Stunnel HTTP for mail121 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:19:01] PROBLEM - avas.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:19:17] RECOVERY - sammaditthi.cyou - LetsEncrypt on sslhost is OK: OK - Certificate 'sammaditthi.cyou' will expire on Sat 08 Oct 2022 06:03:19 GMT +0000. [18:19:36] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 5.86, 8.11, 11.36 [18:19:51] PROBLEM - cp21 Stunnel HTTP for mw122 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [18:19:53] PROBLEM - largedu.eu.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:19:58] RECOVERY - www.trollpasta.com - LetsEncrypt on sslhost is OK: OK - Certificate 'trollpasta.com' will expire on Mon 10 Oct 2022 06:29:05 GMT +0000. [18:20:37] PROBLEM - ffwiki.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:20:48] PROBLEM - dcmultiverse.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:20:57] RECOVERY - cp20 Stunnel HTTP for mail121 on cp20 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 427 bytes in 1.018 second response time [18:21:03] PROBLEM - ipv6bolivia.tk - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:21:42] RECOVERY - wiki.thunis.eu - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.thunis.eu' will expire on Tue 23 Aug 2022 01:47:24 GMT +0000. [18:21:43] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.08, 1.76, 1.53 [18:21:46] RECOVERY - cp21 Stunnel HTTP for mw122 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 0.033 second response time [18:22:00] PROBLEM - mrlove.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:22:20] PROBLEM - nonbinary.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:22:30] RECOVERY - itora.bunnies1230.com - LetsEncrypt on sslhost is OK: OK - Certificate 'itora.bunnies1230.com' will expire on Tue 20 Sep 2022 01:50:31 GMT +0000. [18:22:38] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 16.29, 12.67, 10.66 [18:22:44] PROBLEM - www.proficientprofit.click - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:22:55] PROBLEM - marinebiodiversitymatrix.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:23:04] PROBLEM - erawikisource.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:23:35] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.13, 8.08, 10.44 [18:23:39] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.30, 1.55, 1.48 [18:23:52] PROBLEM - savagepedia.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:24:22] PROBLEM - cp20 Stunnel HTTP for matomo101 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [18:24:24] PROBLEM - dc.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:24:38] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.62, 11.53, 10.50 [18:24:39] PROBLEM - cp20 Stunnel HTTP for reports121 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [18:24:39] PROBLEM - wiki.s23.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:24:47] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.84, 2.79, 2.27 [18:25:16] PROBLEM - cp21 PowerDNS Recursor on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [18:25:34] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 6.74, 7.57, 9.98 [18:25:45] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 2 datacenters are down: 2001:41d0:801:2000::4c25/cpweb, 2001:41d0:801:2000::1b80/cpweb [18:26:38] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 25.50, 15.80, 12.11 [18:26:48] RECOVERY - cp20 Stunnel HTTP for matomo101 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 99061 bytes in 0.299 second response time [18:27:22] RECOVERY - wiki.macc.nyc - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.macc.nyc' will expire on Wed 31 Aug 2022 20:26:03 GMT +0000. [18:27:25] RECOVERY - wiki.misslessfighters.club - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.misslessfighters.club' will expire on Tue 23 Aug 2022 13:06:24 GMT +0000. [18:27:42] PROBLEM - cp21 conntrack_table_size on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [18:29:36] RECOVERY - cp21 conntrack_table_size on cp21 is OK: OK: nf_conntrack is 4 % full [18:29:38] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [18:29:41] PROBLEM - wiki.mcpirevival.tk - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:29:42] PROBLEM - cp20 HTTPS on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:29:43] PROBLEM - wikiyri.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:29:45] PROBLEM - wiki.recaptime.eu.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:29:47] PROBLEM - wiki.wisrail.de - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:29:48] PROBLEM - en.gyaanipedia.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:29:49] RECOVERY - cp20 Stunnel HTTP for reports121 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 10996 bytes in 1.069 second response time [18:30:27] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 21.88, 20.46, 14.29 [18:30:38] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 4.38, 10.48, 10.90 [18:30:47] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.33, 1.81, 1.97 [18:31:04] PROBLEM - cp20 Stunnel HTTP for mw101 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [18:31:04] RECOVERY - replication-ops.com - LetsEncrypt on sslhost is OK: OK - Certificate 'replication-ops.com' will expire on Tue 18 Oct 2022 15:32:39 GMT +0000. [18:31:07] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [18:31:23] PROBLEM - miraheze.ga - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:31:24] RECOVERY - cp20 Varnish Backends on cp20 is OK: All 14 backends are healthy [18:31:32] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 33.60, 20.85, 14.49 [18:31:43] RECOVERY - cp20 HTTPS on cp20 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 3406 bytes in 7.174 second response time [18:31:45] PROBLEM - landofliberos.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:31:51] PROBLEM - cp20 SSH on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:32:09] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-9 [+0/-0/±1] 13https://github.com/miraheze/puppet/commit/dd1f261e406d [18:32:11] [02miraheze/puppet] 07paladox 03dd1f261 - matomo101: increase php fpm childs to 7 x core (so 7x2 atm = 14) [18:32:12] [02puppet] 07paladox created branch 03paladox-patch-9 - 13https://github.com/miraheze/puppet [18:32:13] [url] Page not found · GitHub · GitHub | github.com [18:32:14] [02puppet] 07paladox opened pull request 03#2707: matomo101: increase php fpm childs to 7 x core (so 7x2 atm = 14) - 13https://github.com/miraheze/puppet/pull/2707 [18:32:14] ... [18:33:08] PROBLEM - cp21 Current Load on cp21 is WARNING: WARNING - load average: 1.95, 1.03, 0.78 [18:33:12] RECOVERY - cp20 Stunnel HTTP for mw101 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 6.301 second response time [18:33:16] RECOVERY - cp21 PowerDNS Recursor on cp21 is OK: DNS OK: 0.188 seconds response time. miraheze.org returns 198.244.148.90,2001:41d0:801:2000::1b80,2001:41d0:801:2000::4c25,51.195.220.68 [18:33:59] PROBLEM - www.zetapedia.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:34:01] PROBLEM - betaheze.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:34:38] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 5.55, 7.88, 9.74 [18:34:39] PROBLEM - cp20 PowerDNS Recursor on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [18:34:51] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [18:34:58] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 22.05, 14.86, 10.31 [18:35:09] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 0.99, 0.99, 0.80 [18:35:30] PROBLEM - cp20 Varnish Backends on cp20 is CRITICAL: 1 backends are down. mw101 [18:35:51] RECOVERY - cp20 SSH on cp20 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [18:36:01] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 5.13, 7.94, 11.89 [18:36:08] [02puppet] 07paladox closed pull request 03#2707: matomo101: increase php fpm childs to 7 x core (so 7x2 atm = 14) - 13https://github.com/miraheze/puppet/pull/2707 [18:36:09] [url] Page not found · GitHub · GitHub | github.com [18:36:10] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/685b97eae878...fd8cd817c788 [18:36:10] [url] Comparing 685b97eae878...fd8cd817c788 · miraheze/puppet · GitHub | github.com [18:36:11] [02miraheze/puppet] 07paladox 03fd8cd81 - matomo101: increase php fpm childs to 7 x core (so 7x2 atm = 14) (#2707) [18:36:13] [02miraheze/puppet] 07paladox deleted branch 03paladox-patch-9 [18:36:14] [02puppet] 07paladox deleted branch 03paladox-patch-9 - 13https://github.com/miraheze/puppet [18:36:14] [url] Page not found · GitHub · GitHub | github.com [18:36:15] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 6.49, 10.96, 11.93 [18:36:21] PROBLEM - bebaskanpengetahuan.id - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:36:40] RECOVERY - smashbroswiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'smashbroswiki.com' will expire on Sat 22 Oct 2022 05:43:00 GMT +0000. [18:36:47] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.03, 1.25, 1.65 [18:36:48] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 0.34, 0.57, 0.54 [18:36:53] RECOVERY - cp20 PowerDNS Recursor on cp20 is OK: DNS OK: 0.199 seconds response time. miraheze.org returns 198.244.148.90,2001:41d0:801:2000::1b80,2001:41d0:801:2000::4c25,51.195.220.68 [18:37:12] PROBLEM - biblestrength.net - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:37:17] PROBLEM - cp20 Stunnel HTTP for mon111 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:37:21] PROBLEM - wiki.yumeka.icu - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:38:01] PROBLEM - datawiki.online - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:38:11] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 19.54, 13.23, 12.56 [18:38:13] PROBLEM - cp20 Stunnel HTTP for mw111 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [18:38:54] RECOVERY - test2.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [18:38:57] PROBLEM - privacywiki.xyz - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:39:08] PROBLEM - mcwiki.kirbygang.tk - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:39:25] RECOVERY - index.pdcommunity.ir - LetsEncrypt on sslhost is OK: OK - Certificate 'index.pdcommunity.ir' will expire on Tue 23 Aug 2022 00:16:11 GMT +0000. [18:39:27] RECOVERY - cp20 Stunnel HTTP for mon111 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 39169 bytes in 7.333 second response time [18:39:44] PROBLEM - www.project-patterns.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:39:53] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.03, 3.00, 3.91 [18:40:10] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 1.74, 2.82, 3.76 [18:40:15] RECOVERY - wiki.thedev.gq - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.thedev.gq' will expire on Fri 02 Sep 2022 12:36:20 GMT +0000. [18:40:29] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 1.91, 2.79, 3.77 [18:40:39] PROBLEM - cp20 Stunnel HTTP for reports121 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [18:40:44] RECOVERY - cp20 Stunnel HTTP for mw111 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 2.108 second response time [18:40:58] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 4.68, 10.10, 10.07 [18:41:12] PROBLEM - wc.miraheze.org on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:41:32] PROBLEM - cp21 Stunnel HTTP for puppet111 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [18:41:32] PROBLEM - otogebase.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:41:57] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [18:42:03] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 5.01, 9.28, 11.19 [18:42:04] PROBLEM - sdiy.info - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:42:06] PROBLEM - celeste.ink - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:42:28] RECOVERY - wiki.worldbuilding.network - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.worldbuilding.network' will expire on Mon 10 Oct 2022 05:23:51 GMT +0000. [18:42:36] PROBLEM - cp20 Stunnel HTTP for matomo101 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [18:43:03] PROBLEM - wiki.ssangyongsports.eu.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:43:06] RECOVERY - wc.miraheze.org on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [18:43:10] PROBLEM - cp21 Stunnel HTTP for matomo101 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [18:43:10] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::4c25/cpweb [18:43:24] RECOVERY - hellointernet.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [18:43:31] PROBLEM - cp20 Stunnel HTTP for phab121 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:43:39] RECOVERY - mystiverse.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'mystiverse.wiki' will expire on Sat 01 Oct 2022 04:26:41 GMT +0000. [18:43:46] RECOVERY - jp.popira.info - LetsEncrypt on sslhost is OK: OK - Certificate 'jp.popira.info' will expire on Mon 10 Oct 2022 06:13:03 GMT +0000. [18:43:55] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 0.64, 0.73, 0.76 [18:44:01] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 6.74, 7.39, 9.91 [18:44:29] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.76, 3.60, 3.84 [18:44:57] PROBLEM - storytime.jdstroy.cf - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:45:03] PROBLEM - cp20 HTTPS on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:45:11] PROBLEM - fortis.miraheze.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:45:12] PROBLEM - cloudwiki.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:45:23] PROBLEM - wiki.grottocenter.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:45:25] RECOVERY - cp21 Stunnel HTTP for matomo101 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 99061 bytes in 3.224 second response time [18:45:39] RECOVERY - cp20 Stunnel HTTP for reports121 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 10996 bytes in 1.056 second response time [18:45:41] RECOVERY - cp21 Stunnel HTTP for puppet111 on cp21 is OK: HTTP OK: Status line output matched "403" - 289 bytes in 1.019 second response time [18:45:46] RECOVERY - mwcosmos.com - LetsEncrypt on sslhost is OK: OK - Certificate 'mwcosmos.com' will expire on Mon 22 Aug 2022 15:03:04 GMT +0000. [18:45:55] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 23.07, 13.93, 12.40 [18:45:57] PROBLEM - hoodwiki.xyz - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:45:57] PROBLEM - drowiki.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:46:02] RECOVERY - cp20 Stunnel HTTP for phab121 on cp20 is OK: HTTP OK: Status line output matched "500" - 2855 bytes in 1.097 second response time [18:46:25] RECOVERY - ngsswiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'ngsswiki.com' will expire on Sun 02 Oct 2022 05:32:39 GMT +0000. [18:46:34] RECOVERY - docse.tk - LetsEncrypt on sslhost is OK: OK - Certificate 'docse.tk' will expire on Tue 20 Sep 2022 11:55:51 GMT +0000. [18:46:44] RECOVERY - pokemonwiki.info - LetsEncrypt on sslhost is OK: OK - Certificate 'pokemonwiki.info' will expire on Wed 19 Oct 2022 06:57:42 GMT +0000. [18:46:47] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.76, 1.53, 1.58 [18:46:57] RECOVERY - cp20 HTTPS on cp20 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 3406 bytes in 1.026 second response time [18:47:04] PROBLEM - pwsc.polandballwiki.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:47:05] RECOVERY - wiki.mostly.vet - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.mostly.vet' will expire on Fri 02 Sep 2022 12:38:42 GMT +0000. [18:47:33] RECOVERY - cp20 Stunnel HTTP for matomo101 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 99061 bytes in 1.347 second response time [18:47:45] RECOVERY - wiki.minebox.fr - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.minebox.fr' will expire on Fri 16 Sep 2022 18:05:33 GMT +0000. [18:47:53] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.64, 3.84, 3.87 [18:47:54] RECOVERY - abeyancewiki.bumblebee-studios.se - LetsEncrypt on sslhost is OK: OK - Certificate 'abeyancewiki.bumblebee-studios.se' will expire on Wed 24 Aug 2022 16:26:15 GMT +0000. [18:48:01] RECOVERY - zh.gyaanipedia.com - LetsEncrypt on sslhost is OK: OK - Certificate 'zh.gyaanipedia.com' will expire on Thu 08 Sep 2022 06:29:43 GMT +0000. [18:48:21] RECOVERY - it.famepedia.org - LetsEncrypt on sslhost is OK: OK - Certificate 'it.famepedia.org' will expire on Sat 08 Oct 2022 06:08:33 GMT +0000. [18:48:24] RECOVERY - bn.gyaanipedia.com - LetsEncrypt on sslhost is OK: OK - Certificate 'bn.gyaanipedia.com' will expire on Thu 08 Sep 2022 06:11:48 GMT +0000. [18:48:50] RECOVERY - avas.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'avas.wiki' will expire on Mon 10 Oct 2022 04:52:24 GMT +0000. [18:49:17] RECOVERY - ffwiki.org - LetsEncrypt on sslhost is OK: OK - Certificate 'ffwiki.org' will expire on Thu 29 Sep 2022 19:07:40 GMT +0000. [18:49:46] RECOVERY - wiki.timewisely.net - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.timewisely.net' will expire on Mon 22 Aug 2022 22:01:18 GMT +0000. [18:49:47] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 7.96, 10.78, 11.50 [18:50:01] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.91, 10.56, 10.44 [18:50:10] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 6.19, 4.47, 3.98 [18:50:22] RECOVERY - dcmultiverse.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [18:50:32] RECOVERY - wiki.leapit.no - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.leapit.no' will expire on Wed 17 Aug 2022 08:40:55 GMT +0000. [18:50:40] PROBLEM - roll-of-arms.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:50:51] RECOVERY - ipv6bolivia.tk - LetsEncrypt on sslhost is OK: OK - Certificate 'ipv6bolivia.tk' will expire on Tue 23 Aug 2022 13:09:22 GMT +0000. [18:50:55] PROBLEM - cp20 Stunnel HTTP for test101 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [18:51:11] RECOVERY - nonbinary.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'nonbinary.wiki' will expire on Tue 23 Aug 2022 02:51:23 GMT +0000. [18:51:11] RECOVERY - pwiki.drydraytonvillagehall.org.uk - LetsEncrypt on sslhost is OK: OK - Certificate 'pwiki.drydraytonvillagehall.org.uk' will expire on Wed 12 Oct 2022 13:33:40 GMT +0000. [18:51:34] RECOVERY - mrlove.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'mrlove.wiki' will expire on Mon 22 Aug 2022 23:58:24 GMT +0000. [18:51:42] PROBLEM - cp21 SSH on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:51:46] PROBLEM - cp20 Stunnel HTTP for reports121 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [18:52:27] RECOVERY - www.proficientprofit.click - LetsEncrypt on sslhost is OK: OK - Certificate 'www.proficientprofit.click' will expire on Sat 08 Oct 2022 06:14:24 GMT +0000. [18:52:29] RECOVERY - marinebiodiversitymatrix.org - LetsEncrypt on sslhost is OK: OK - Certificate 'marinebiodiversitymatrix.org' will expire on Wed 24 Aug 2022 01:59:18 GMT +0000. [18:52:30] RECOVERY - erawikisource.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [18:52:31] PROBLEM - www.programming.red - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:52:31] RECOVERY - wiki.yahyabd.xyz - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.yahyabd.xyz' will expire on Sun 14 Aug 2022 20:06:30 GMT +0000. [18:52:47] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.73, 2.07, 1.78 [18:53:25] RECOVERY - cp20 Stunnel HTTP for test101 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15954 bytes in 0.035 second response time [18:53:25] PROBLEM - cp20 Stunnel HTTP for mw102 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:53:51] PROBLEM - dariawiki.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:54:00] RECOVERY - dc.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [18:54:16] RECOVERY - cp20 Stunnel HTTP for reports121 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 10996 bytes in 0.088 second response time [18:54:22] RECOVERY - wiki.s23.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.s23.org' will expire on Wed 24 Aug 2022 03:08:19 GMT +0000. [18:54:53] PROBLEM - persist.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:55:44] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.09, 7.93, 9.94 [18:55:48] PROBLEM - cp21 Stunnel HTTP for mw102 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:56:02] PROBLEM - wiki.conworlds.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:56:46] RECOVERY - programming.red - LetsEncrypt on sslhost is OK: OK - Certificate 'programming.red' will expire on Tue 23 Aug 2022 09:31:28 GMT +0000. [18:57:29] PROBLEM - cp21 Stunnel HTTP for mw112 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [18:57:57] RECOVERY - cp21 SSH on cp21 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [18:58:30] RECOVERY - wiki.mcpirevival.tk - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.mcpirevival.tk' will expire on Wed 24 Aug 2022 03:07:55 GMT +0000. [18:58:49] RECOVERY - wiki.recaptime.eu.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.recaptime.eu.org' will expire on Mon 03 Oct 2022 22:23:06 GMT +0000. [18:58:59] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 13.02, 12.19, 10.50 [18:59:15] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.70, 1.86, 1.48 [18:59:24] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 4.15, 6.66, 11.15 [18:59:30] RECOVERY - wiki.wisrail.de - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.wisrail.de' will expire on Tue 06 Sep 2022 21:01:07 GMT +0000. [19:00:01] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 6.88, 10.54, 10.89 [19:00:13] PROBLEM - cp20 Stunnel HTTP for mw112 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [19:00:17] RECOVERY - miraheze.ga - LetsEncrypt on sslhost is OK: OK - Certificate 'miraheze.ga' will expire on Wed 24 Aug 2022 04:25:02 GMT +0000. [19:00:21] PROBLEM - cp21 Stunnel HTTP for mw122 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [19:00:58] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 6.61, 10.11, 9.94 [19:01:04] PROBLEM - thenintendowiki.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:01:10] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.27, 1.67, 1.45 [19:01:15] PROBLEM - www.opendatascot.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:01:25] RECOVERY - landofliberos.com - LetsEncrypt on sslhost is OK: OK - Certificate 'landofliberos.com' will expire on Tue 30 Aug 2022 16:38:50 GMT +0000. [19:01:28] PROBLEM - cp20 Stunnel HTTP for mwtask111 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [19:02:01] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 5.05, 8.70, 10.17 [19:02:14] RECOVERY - cp20 Stunnel HTTP for mw112 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.021 second response time [19:02:16] RECOVERY - cp21 Stunnel HTTP for mw112 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 0.034 second response time [19:02:33] PROBLEM - cp21 Stunnel HTTP for mw111 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [19:02:57] PROBLEM - mw111 MediaWiki Rendering on mw111 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:02:59] RECOVERY - www.zetapedia.com - LetsEncrypt on sslhost is OK: OK - Certificate 'www.zetapedia.com' will expire on Wed 17 Aug 2022 21:08:43 GMT +0000. [19:03:04] PROBLEM - cp20 Stunnel HTTP for mw111 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:03:23] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 5.79, 5.95, 9.84 [19:03:26] RECOVERY - mr.gyaanipedia.com - LetsEncrypt on sslhost is OK: OK - Certificate 'mr.gyaanipedia.com' will expire on Thu 08 Sep 2022 06:58:00 GMT +0000. [19:03:26] RECOVERY - cp20 Stunnel HTTP for mwtask111 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15950 bytes in 0.024 second response time [19:03:38] RECOVERY - betaheze.org - LetsEncrypt on sslhost is OK: OK - Certificate 'betaheze.org' will expire on Fri 19 Aug 2022 17:58:05 GMT +0000. [19:04:10] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.37, 3.51, 4.00 [19:04:47] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.55, 1.98, 1.99 [19:05:12] RECOVERY - cp21 Stunnel HTTP for mw122 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 1.031 second response time [19:06:10] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.65, 4.20, 4.20 [19:06:45] RECOVERY - wiki.yumeka.icu - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.yumeka.icu' will expire on Sat 17 Sep 2022 18:24:18 GMT +0000. [19:06:52] RECOVERY - biblestrength.net - LetsEncrypt on sslhost is OK: OK - Certificate 'biblestrength.net' will expire on Wed 07 Sep 2022 18:16:09 GMT +0000. [19:06:58] RECOVERY - mw111 MediaWiki Rendering on mw111 is OK: HTTP OK: HTTP/1.1 200 OK - 28479 bytes in 0.386 second response time [19:07:05] PROBLEM - dkpedia.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:07:21] RECOVERY - datawiki.online - LetsEncrypt on sslhost is OK: OK - Certificate 'datawiki.online' will expire on Sun 16 Oct 2022 03:33:20 GMT +0000. [19:07:28] RECOVERY - cp21 Stunnel HTTP for mw111 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.022 second response time [19:07:49] RECOVERY - sims.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [19:08:06] RECOVERY - privacywiki.xyz - LetsEncrypt on sslhost is OK: OK - Certificate 'privacywiki.xyz' will expire on Mon 26 Sep 2022 13:36:29 GMT +0000. [19:08:14] PROBLEM - cp21 conntrack_table_size on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [19:08:44] RECOVERY - cp20 Stunnel HTTP for mw102 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 1.023 second response time [19:08:46] PROBLEM - cp21 Stunnel HTTP for test101 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [19:09:06] PROBLEM - bluearchive.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:09:06] RECOVERY - mcwiki.kirbygang.tk - LetsEncrypt on sslhost is OK: OK - Certificate 'mcwiki.kirbygang.tk' will expire on Wed 05 Oct 2022 22:00:10 GMT +0000. [19:09:20] PROBLEM - cp21 Stunnel HTTP for matomo101 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [19:09:21] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 26.36, 16.93, 13.12 [19:09:57] PROBLEM - wiki.pablojprieto.com.es - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:10:09] RECOVERY - cp21 conntrack_table_size on cp21 is OK: OK: nf_conntrack is 3 % full [19:10:27] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [19:10:37] PROBLEM - cp21 Stunnel HTTP for mw101 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [19:10:47] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.17, 1.77, 1.87 [19:11:01] RECOVERY - cp21 Stunnel HTTP for test101 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15954 bytes in 2.104 second response time [19:11:19] RECOVERY - otogebase.com - LetsEncrypt on sslhost is OK: OK - Certificate 'otogebase.com' will expire on Mon 12 Sep 2022 09:53:37 GMT +0000. [19:11:27] RECOVERY - sdiy.info - LetsEncrypt on sslhost is OK: OK - Certificate 'sdiy.info' will expire on Sat 17 Sep 2022 21:29:52 GMT +0000. [19:11:47] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.42, 1.72, 1.59 [19:11:47] RECOVERY - celeste.ink - LetsEncrypt on sslhost is OK: OK - Certificate 'celeste.ink' will expire on Sat 24 Sep 2022 13:42:28 GMT +0000. [19:11:50] RECOVERY - wiki.ssangyongsports.eu.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.ssangyongsports.eu.org' will expire on Wed 31 Aug 2022 22:12:11 GMT +0000. [19:11:53] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.54, 3.21, 3.90 [19:11:57] PROBLEM - wiki.joust.ro - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:12:07] PROBLEM - wildbowiki.net - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:12:15] RECOVERY - wiki.autocountsoft.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.autocountsoft.com' will expire on Sun 18 Sep 2022 20:39:54 GMT +0000. [19:12:37] RECOVERY - cp21 Stunnel HTTP for mw102 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.018 second response time [19:12:47] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.15, 1.46, 1.74 [19:13:05] RECOVERY - cp21 Stunnel HTTP for mw101 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.020 second response time [19:13:09] PROBLEM - www.mcpk.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:13:24] PROBLEM - wiki.zergmafia.top - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:13:42] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.09, 1.76, 1.61 [19:13:44] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.42, 11.82, 10.00 [19:13:48] PROBLEM - cp20 conntrack_table_size on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [19:14:05] RECOVERY - fortis.miraheze.org - LetsEncrypt on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [19:14:10] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.68, 3.35, 3.85 [19:14:13] PROBLEM - gluster101 APT on gluster101 is WARNING: APT WARNING: 0 packages available for upgrade (0 critical updates). warnings detected, errors detected. [19:14:17] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 2 datacenters are down: 2001:41d0:801:2000::4c25/cpweb, 2001:41d0:801:2000::1b80/cpweb [19:14:22] RECOVERY - storytime.jdstroy.cf - LetsEncrypt on sslhost is OK: OK - Certificate 'storytime.jdstroy.cf' will expire on Thu 13 Oct 2022 04:22:47 GMT +0000. [19:14:25] RECOVERY - eng.archiopedia.org - LetsEncrypt on sslhost is OK: OK - Certificate 'eng.archiopedia.org' will expire on Sun 02 Oct 2022 05:35:50 GMT +0000. [19:14:27] RECOVERY - cloudwiki.org - LetsEncrypt on sslhost is OK: OK - Certificate 'cloudwiki.org' will expire on Sun 23 Oct 2022 16:49:57 GMT +0000. [19:14:31] RECOVERY - drowiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'drowiki.com' will expire on Tue 04 Oct 2022 18:56:56 GMT +0000. [19:14:33] RECOVERY - wiki.grottocenter.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.grottocenter.org' will expire on Mon 22 Aug 2022 22:30:31 GMT +0000. [19:14:35] RECOVERY - cp20 Stunnel HTTP for mw111 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 2.944 second response time [19:14:37] OK FIX WIKI(y) [19:14:47] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.16, 1.73, 1.80 [19:14:48] PROBLEM - experimyco.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:14:49] RECOVERY - cp21 Stunnel HTTP for matomo101 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 99061 bytes in 3.376 second response time [19:14:55] RECOVERY - www.scum-wiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'scum-wiki.com' will expire on Sat 22 Oct 2022 05:35:09 GMT +0000. [19:15:19] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 4.07, 10.14, 11.64 [19:15:38] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.58, 1.71, 1.61 [19:15:44] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 6.26, 9.92, 9.52 [19:15:51] PROBLEM - cp20 SSH on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:15:53] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.19, 3.54, 3.86 [19:16:08] PROBLEM - jp.popira.info - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:16:13] RECOVERY - cp20 conntrack_table_size on cp20 is OK: OK: nf_conntrack is 3 % full [19:16:15] PROBLEM - gluster101 APT on gluster101 is CRITICAL: APT CRITICAL: 37 packages available for upgrade (15 critical updates). [19:16:36] RECOVERY - pwsc.polandballwiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'pwsc.polandballwiki.com' will expire on Sun 02 Oct 2022 10:41:20 GMT +0000. [19:16:38] PROBLEM - agentisai.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:16:39] PROBLEM - cp20 Stunnel HTTP for mw122 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [19:16:44] PROBLEM - spcodex.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:16:47] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.77, 1.38, 1.67 [19:16:57] PROBLEM - cp21 conntrack_table_size on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [19:17:13] PROBLEM - www.winenjoy.net - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:17:33] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.32, 1.63, 1.60 [19:17:38] PROBLEM - cp21 Stunnel HTTP for phab121 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:17:46] RECOVERY - cp20 SSH on cp20 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [19:19:18] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 16.68, 11.92, 11.88 [19:19:48] RECOVERY - nintendo.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [19:20:10] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.38, 4.25, 4.07 [19:20:51] PROBLEM - inourownwords.online - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:21:34] PROBLEM - kunwok.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:22:10] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.64, 3.57, 3.84 [19:22:38] PROBLEM - wiki.recaptime.tk - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:22:38] PROBLEM - cp20 Stunnel HTTP for mw102 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [19:22:48] RECOVERY - dariawiki.org - LetsEncrypt on sslhost is OK: OK - Certificate 'dariawiki.org' will expire on Mon 22 Aug 2022 22:44:29 GMT +0000. [19:23:16] PROBLEM - pa.gyaanipedia.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:24:09] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [19:24:10] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.46, 3.86, 3.91 [19:24:13] PROBLEM - wiki.meeusen.net - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:24:24] PROBLEM - erawikisource.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:24:38] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 24.83, 15.00, 11.35 [19:24:39] RECOVERY - cp21 conntrack_table_size on cp21 is OK: OK: nf_conntrack is 4 % full [19:24:52] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 4.84, 7.47, 11.40 [19:24:55] PROBLEM - wiki.minecraftathome.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:25:11] RECOVERY - cp20 Stunnel HTTP for mw102 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 2.078 second response time [19:25:12] PROBLEM - cp20 Puppet on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [19:25:16] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 4.56, 10.62, 11.81 [19:25:35] RECOVERY - cp21 Stunnel HTTP for phab121 on cp21 is OK: HTTP OK: Status line output matched "500" - 2855 bytes in 0.079 second response time [19:25:35] PROBLEM - cp20 Stunnel HTTP for mw111 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [19:25:47] RECOVERY - wiki.conworlds.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.conworlds.org' will expire on Tue 23 Aug 2022 08:34:15 GMT +0000. [19:25:53] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.57, 3.85, 3.97 [19:25:58] PROBLEM - wc.miraheze.org on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:26:10] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.73, 3.66, 3.82 [19:26:38] PROBLEM - cp21 Stunnel HTTP for matomo101 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:26:40] RECOVERY - cp20 Stunnel HTTP for mw122 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 1.376 second response time [19:26:43] PROBLEM - www.johanloopmans.nl - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:26:45] PROBLEM - commons.gyaanipedia.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:27:15] PROBLEM - cp20 Stunnel HTTP for mw121 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:27:21] PROBLEM - cp21 HTTPS on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:27:21] RECOVERY - wikiyri.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wikiyri.org' will expire on Thu 22 Sep 2022 04:19:34 GMT +0000. [19:27:46] PROBLEM - www.ballmedia.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:27:48] RECOVERY - cp20 Stunnel HTTP for mw111 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.020 second response time [19:27:53] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.06, 3.93, 3.98 [19:28:10] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.10, 3.87, 3.88 [19:28:29] PROBLEM - hololive.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:28:52] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.22, 7.59, 10.37 [19:29:06] RECOVERY - cp21 Stunnel HTTP for matomo101 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 99061 bytes in 0.281 second response time [19:29:15] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 4.81, 6.93, 10.00 [19:29:20] RECOVERY - cp21 HTTPS on cp21 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 3407 bytes in 3.054 second response time [19:29:41] PROBLEM - phgalaxy.eu.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:29:46] PROBLEM - cp21 Stunnel HTTP for mw112 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [19:29:48] RECOVERY - thenintendowiki.org - LetsEncrypt on sslhost is OK: OK - Certificate 'thenintendowiki.org' will expire on Sat 22 Oct 2022 05:06:23 GMT +0000. [19:29:53] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.75, 3.45, 3.80 [19:29:55] RECOVERY - wc.miraheze.org on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [19:29:56] PROBLEM - cp20 PowerDNS Recursor on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [19:30:01] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 20.40, 12.21, 8.91 [19:30:03] RECOVERY - www.opendatascot.org - LetsEncrypt on sslhost is OK: OK - Certificate 'opendatascot.org' will expire on Thu 01 Sep 2022 00:46:11 GMT +0000. [19:30:06] RECOVERY - cp20 Puppet on cp20 is OK: OK: Puppet is currently enabled, last run 4 minutes ago with 0 failures [19:31:15] PROBLEM - enc.for.uz - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:31:23] RECOVERY - cp20 Stunnel HTTP for mw121 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 1.033 second response time [19:31:40] RECOVERY - cp21 Stunnel HTTP for mw112 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 1.020 second response time [19:31:40] PROBLEM - franchise.franchising.org.ua - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:31:51] PROBLEM - cp20 SSH on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:31:53] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.49, 3.79, 3.88 [19:31:54] RECOVERY - cp20 PowerDNS Recursor on cp20 is OK: DNS OK: 0.203 seconds response time. miraheze.org returns 198.244.148.90,2001:41d0:801:2000::1b80,2001:41d0:801:2000::4c25,51.195.220.68 [19:31:56] PROBLEM - wiki.worlduniversityandschool.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:32:01] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.35, 11.61, 9.13 [19:32:10] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.42, 3.71, 3.80 [19:33:22] PROBLEM - cp20 Stunnel HTTP for mw112 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [19:33:34] PROBLEM - cp21 Puppet on cp21 is CRITICAL: CRITICAL: Puppet has 2 failures. Last run 4 minutes ago with 2 failures. Failed resources (up to 3 shown): File[/etc/apt/trusted.gpg.d/puppetlabs.gpg],File[/usr/local/bin/puppet-enabled] [19:33:36] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 16.30, 9.73, 8.18 [19:34:01] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 6.96, 10.02, 8.85 [19:34:10] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.23, 3.92, 3.87 [19:34:18] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 4.39, 10.30, 11.81 [19:34:43] PROBLEM - puritwiki.p-e.kr - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:34:52] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.74, 11.10, 11.44 [19:35:13] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 13.62, 12.58, 11.50 [19:35:31] RECOVERY - datacrondatabase.com - LetsEncrypt on sslhost is OK: OK - Certificate 'datacrondatabase.com' will expire on Mon 22 Aug 2022 15:10:26 GMT +0000. [19:35:58] PROBLEM - wiki.infomedia.co.uk - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:37:12] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.74, 11.44, 11.19 [19:37:26] PROBLEM - cp21 ferm_active on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [19:37:31] PROBLEM - wiki.chouverse.cludisciples.cyou - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:37:31] PROBLEM - stablestate.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:37:40] PROBLEM - wiki.mastodon.kr - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:38:09] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 14.22, 10.93, 11.58 [19:38:11] RECOVERY - bluearchive.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'bluearchive.wiki' will expire on Mon 22 Aug 2022 15:22:46 GMT +0000. [19:38:33] RECOVERY - wiki.pablojprieto.com.es - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.pablojprieto.com.es' will expire on Tue 23 Aug 2022 09:39:26 GMT +0000. [19:38:48] PROBLEM - az.wikiretet.ga - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:38:49] PROBLEM - smashbroswiki.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:38:54] PROBLEM - cp21 HTTPS on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:39:01] PROBLEM - icclopedia.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:39:04] RECOVERY - www.project-patterns.com - LetsEncrypt on sslhost is OK: OK - Certificate 'project-patterns.com' will expire on Fri 19 Aug 2022 17:20:05 GMT +0000. [19:39:31] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.81, 11.75, 9.86 [19:39:44] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::4c25/cpweb [19:39:47] PROBLEM - wiki.insideearth.info - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:39:54] RECOVERY - cp21 ferm_active on cp21 is OK: OK ferm input default policy is set [19:39:57] PROBLEM - www.obeymewiki.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:40:03] RECOVERY - cp20 SSH on cp20 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [19:40:34] RECOVERY - cp20 Stunnel HTTP for mw112 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 0.017 second response time [19:40:53] RECOVERY - wiki.joust.ro - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.joust.ro' will expire on Tue 23 Aug 2022 07:32:52 GMT +0000. [19:40:58] RECOVERY - cp21 HTTPS on cp21 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 3407 bytes in 7.319 second response time [19:41:09] PROBLEM - cp20 Disk Space on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [19:41:21] RECOVERY - wildbowiki.net - LetsEncrypt on sslhost is OK: OK - Certificate 'wildbowiki.net' will expire on Tue 06 Sep 2022 20:59:02 GMT +0000. [19:41:29] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 22.87, 15.09, 11.25 [19:41:30] PROBLEM - popira.info - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:41:41] PROBLEM - en.wikiyri.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:41:54] RECOVERY - www.mcpk.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'www.mcpk.wiki' will expire on Sat 17 Sep 2022 18:44:27 GMT +0000. [19:42:13] PROBLEM - cp20 Stunnel HTTP for mw121 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:42:23] PROBLEM - cp20 Stunnel HTTP for mail121 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:42:32] PROBLEM - wiki.thedev.gq - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:42:52] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 6.18, 7.99, 9.80 [19:43:04] RECOVERY - wiki.zergmafia.top - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.zergmafia.top' will expire on Tue 06 Sep 2022 20:57:49 GMT +0000. [19:43:07] RECOVERY - cp20 Disk Space on cp20 is OK: DISK OK - free space: / 9329 MB (24% inode=96%); [19:43:25] PROBLEM - cp21 Stunnel HTTP for matomo101 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:43:32] PROBLEM - cp21 Stunnel HTTP for test101 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:43:33] RECOVERY - hoodwiki.xyz - LetsEncrypt on sslhost is OK: OK - Certificate 'hoodwiki.xyz' will expire on Wed 19 Oct 2022 06:37:38 GMT +0000. [19:43:39] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.04, 1.70, 1.51 [19:43:43] RECOVERY - experimyco.com - LetsEncrypt on sslhost is OK: OK - Certificate 'experimyco.com' will expire on Thu 15 Sep 2022 05:36:04 GMT +0000. [19:43:45] PROBLEM - wiki-tintin.cf - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:44:23] RECOVERY - cp20 Stunnel HTTP for mail121 on cp20 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 427 bytes in 1.022 second response time [19:44:25] PROBLEM - animatedfeet.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:45:41] PROBLEM - cp20 Stunnel HTTP for mw102 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [19:45:46] RECOVERY - www.winenjoy.net - LetsEncrypt on sslhost is OK: OK - Certificate 'www.winenjoy.net' will expire on Sun 02 Oct 2022 10:20:46 GMT +0000. [19:45:54] RECOVERY - cp21 Stunnel HTTP for matomo101 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 99061 bytes in 0.339 second response time [19:46:01] RECOVERY - cp21 Stunnel HTTP for test101 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15954 bytes in 1.063 second response time [19:46:01] RECOVERY - spcodex.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'spcodex.wiki' will expire on Wed 24 Aug 2022 04:17:42 GMT +0000. [19:46:40] PROBLEM - cp20 Stunnel HTTP for puppet111 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:46:43] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.01, 1.70, 1.43 [19:47:10] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 7.23, 9.08, 10.16 [19:47:10] RECOVERY - miraheze.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'miraheze.wiki' will expire on Wed 12 Oct 2022 13:11:41 GMT +0000. [19:47:40] RECOVERY - cp20 Stunnel HTTP for mw102 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 0.023 second response time [19:48:09] PROBLEM - wiki.cjgh.xyz - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:48:43] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 2.00, 1.79, 1.50 [19:48:45] RECOVERY - cp20 Stunnel HTTP for puppet111 on cp20 is OK: HTTP OK: Status line output matched "403" - 289 bytes in 3.032 second response time [19:49:10] RECOVERY - largedu.eu.org - LetsEncrypt on sslhost is OK: OK - Certificate 'largedu.eu.org' will expire on Wed 17 Aug 2022 15:37:36 GMT +0000. [19:49:13] RECOVERY - cp20 Stunnel HTTP for mw121 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 4.619 second response time [19:49:32] PROBLEM - ngsswiki.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:50:48] RECOVERY - inourownwords.online - LetsEncrypt on sslhost is OK: OK - Certificate 'inourownwords.online' will expire on Fri 02 Sep 2022 12:36:55 GMT +0000. [19:50:49] RECOVERY - www.programming.red - LetsEncrypt on sslhost is OK: OK - Certificate 'programming.red' will expire on Tue 23 Aug 2022 09:31:28 GMT +0000. [19:51:05] PROBLEM - cp21 Stunnel HTTP for mw102 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [19:51:11] RECOVERY - kunwok.org - LetsEncrypt on sslhost is OK: OK - Certificate 'kunwok.org' will expire on Wed 24 Aug 2022 04:11:39 GMT +0000. [19:51:21] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 5.34, 9.85, 11.18 [19:51:24] RECOVERY - savagepedia.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'savagepedia.wiki' will expire on Wed 24 Aug 2022 04:44:37 GMT +0000. [19:51:51] RECOVERY - wiki.recaptime.tk - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.recaptime.tk' will expire on Sun 14 Aug 2022 00:05:19 GMT +0000. [19:51:56] PROBLEM - dcmultiverse.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:52:01] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 28.76, 19.47, 12.72 [19:52:43] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.53, 2.09, 1.67 [19:53:01] RECOVERY - cp21 Stunnel HTTP for mw102 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 1.488 second response time [19:53:02] RECOVERY - pa.gyaanipedia.com - LetsEncrypt on sslhost is OK: OK - Certificate 'pa.gyaanipedia.com' will expire on Thu 08 Sep 2022 06:52:35 GMT +0000. [19:53:14] PROBLEM - fc.songcontests.eu - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:53:16] PROBLEM - cp20 Stunnel HTTP for mw122 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [19:53:40] RECOVERY - wiki.meeusen.net - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.meeusen.net' will expire on Sat 17 Sep 2022 21:26:27 GMT +0000. [19:53:44] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 6.37, 10.32, 11.85 [19:53:50] RECOVERY - erawikisource.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [19:54:43] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.68, 1.54, 1.52 [19:54:52] RECOVERY - persist.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'persist.wiki' will expire on Mon 10 Oct 2022 04:01:57 GMT +0000. [19:55:03] RECOVERY - cp20 Varnish Backends on cp20 is OK: All 14 backends are healthy [19:55:17] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 6.64, 8.05, 10.12 [19:55:19] PROBLEM - cp30 Stunnel HTTP for mw101 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:55:28] RECOVERY - cp20 Stunnel HTTP for mw122 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 0.656 second response time [19:55:34] RECOVERY - commons.gyaanipedia.com - LetsEncrypt on sslhost is OK: OK - Certificate 'commons.gyaanipedia.com' will expire on Thu 08 Sep 2022 06:46:28 GMT +0000. [19:56:21] RECOVERY - www.johanloopmans.nl - LetsEncrypt on sslhost is OK: OK - Certificate 'www.johanloopmans.nl' will expire on Sat 17 Sep 2022 20:00:57 GMT +0000. [19:56:44] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-9 [+0/-0/±1] 13https://github.com/miraheze/puppet/commit/2e9a48de3e5d [19:56:46] [02miraheze/puppet] 07paladox 032e9a48d - nginx::site: set http_ignore_body for monitoring::services [19:56:47] [02puppet] 07paladox created branch 03paladox-patch-9 - 13https://github.com/miraheze/puppet [19:56:48] [url] Page not found · GitHub · GitHub | github.com [19:56:49] [02puppet] 07paladox opened pull request 03#2708: nginx::site: set http_ignore_body for monitoring::services - 13https://github.com/miraheze/puppet/pull/2708 [19:56:49] ... [19:56:55] PROBLEM - cp21 Stunnel HTTP for mw101 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:57:00] [02puppet] 07paladox closed pull request 03#2708: nginx::site: set http_ignore_body for monitoring::services - 13https://github.com/miraheze/puppet/pull/2708 [19:57:01] ... [19:57:02] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/fd8cd817c788...8f629cbfd76b [19:57:02] [url] Comparing fd8cd817c788...8f629cbfd76b · miraheze/puppet · GitHub | github.com [19:57:03] [02miraheze/puppet] 07paladox 038f629cb - nginx::site: set http_ignore_body for monitoring::services (#2708) [19:57:05] [02miraheze/puppet] 07paladox deleted branch 03paladox-patch-9 [19:57:06] [02puppet] 07paladox deleted branch 03paladox-patch-9 - 13https://github.com/miraheze/puppet [19:57:06] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 20.89, 15.15, 11.85 [19:57:07] [url] Page not found · GitHub · GitHub | github.com [19:57:18] RECOVERY - cp30 Stunnel HTTP for mw101 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 2.152 second response time [19:57:30] RECOVERY - cp21 Puppet on cp21 is OK: OK: Puppet is currently enabled, last run 40 seconds ago with 0 failures [19:57:35] RECOVERY - hololive.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'hololive.wiki' will expire on Tue 23 Aug 2022 02:02:38 GMT +0000. [19:57:35] RECOVERY - www.ballmedia.org - LetsEncrypt on sslhost is OK: OK - Certificate 'ballmedia.org' will expire on Mon 10 Oct 2022 05:56:45 GMT +0000. [19:57:42] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 16.65, 11.52, 9.99 [19:57:44] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 14.96, 10.97, 11.61 [19:57:47] PROBLEM - cp20 Stunnel HTTP for mw101 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [19:58:01] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.72, 11.72, 11.38 [19:58:30] RECOVERY - phgalaxy.eu.org - LetsEncrypt on sslhost is OK: OK - Certificate 'phgalaxy.eu.org' will expire on Sun 02 Oct 2022 05:33:18 GMT +0000. [19:58:31] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [19:58:44] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.32, 1.82, 1.62 [19:58:59] PROBLEM - cp20 Varnish Backends on cp20 is CRITICAL: 2 backends are down. mw102 mw111 [19:59:14] RECOVERY - cp21 Stunnel HTTP for mw101 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 7.294 second response time [19:59:23] PROBLEM - wiki.recaptime.eu.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:59:40] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.49, 11.17, 10.07 [19:59:44] RECOVERY - cp20 Stunnel HTTP for mw101 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 2.047 second response time [20:00:09] RECOVERY - enc.for.uz - LetsEncrypt on sslhost is OK: OK - Certificate 'enc.for.uz' will expire on Tue 23 Aug 2022 01:42:45 GMT +0000. [20:00:40] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 0.52, 0.95, 0.96 [20:00:43] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.14, 1.46, 1.51 [20:01:11] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 24.64, 13.86, 11.56 [20:01:39] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 6.51, 9.45, 9.57 [20:01:44] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 6.34, 9.78, 11.12 [20:02:01] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 16.88, 14.50, 12.50 [20:02:20] PROBLEM - dragonquest2.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:02:32] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-9 [+0/-0/±1] 13https://github.com/miraheze/puppet/commit/94615cafed4b [20:02:34] [02miraheze/puppet] 07paladox 0394615ca - nginx::site: increase timeout for http check to 20s [20:02:35] [02puppet] 07paladox created branch 03paladox-patch-9 - 13https://github.com/miraheze/puppet [20:02:36] [url] Page not found · GitHub · GitHub | github.com [20:02:37] [02puppet] 07paladox opened pull request 03#2709: nginx::site: increase timeout for http check to 20s - 13https://github.com/miraheze/puppet/pull/2709 [20:02:37] [url] Page not found · GitHub · GitHub | github.com [20:02:48] PROBLEM - cp21 ferm_active on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [20:03:00] PROBLEM - wiki.eversd.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:03:05] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.35, 11.56, 11.35 [20:03:20] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-9 [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/94615cafed4b...ff482ec04045 [20:03:20] [url] Comparing 94615cafed4b...ff482ec04045 · miraheze/puppet · GitHub | github.com [20:03:21] [02miraheze/puppet] 07paladox 03ff482ec - Update site.pp [20:03:23] [02puppet] 07paladox synchronize pull request 03#2709: nginx::site: increase timeout for http check to 20s - 13https://github.com/miraheze/puppet/pull/2709 [20:03:23] [url] Page not found · GitHub · GitHub | github.com [20:03:46] PROBLEM - cp20 Stunnel HTTP for mw111 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [20:04:01] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 7.18, 11.53, 11.64 [20:04:26] RECOVERY - puritwiki.p-e.kr - LetsEncrypt on sslhost is OK: OK - Certificate 'puritwiki.p-e.kr' will expire on Thu 29 Sep 2022 02:01:07 GMT +0000. [20:04:33] PROBLEM - cp20 Stunnel HTTP for test101 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [20:04:38] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.62, 11.08, 9.06 [20:04:59] RECOVERY - cp21 ferm_active on cp21 is OK: OK ferm input default policy is set [20:05:04] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 13.33, 12.68, 11.82 [20:05:21] PROBLEM - wiki.graalmilitary.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:05:25] PROBLEM - cp21 Stunnel HTTP for test101 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [20:05:44] RECOVERY - cp20 Stunnel HTTP for mw111 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 0.031 second response time [20:06:01] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 15.39, 13.26, 12.26 [20:06:09] PROBLEM - cp20 conntrack_table_size on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [20:06:11] RECOVERY - bebaskanpengetahuan.id - LetsEncrypt on sslhost is OK: OK - Certificate 'bebaskanpengetahuan.id' will expire on Wed 24 Aug 2022 04:11:00 GMT +0000. [20:06:27] [02puppet] 07paladox closed pull request 03#2709: nginx::site: increase timeout for http check to 20s - 13https://github.com/miraheze/puppet/pull/2709 [20:06:28] [url] Page not found · GitHub · GitHub | github.com [20:06:30] [02miraheze/puppet] 07paladox deleted branch 03paladox-patch-9 [20:06:31] [02puppet] 07paladox deleted branch 03paladox-patch-9 - 13https://github.com/miraheze/puppet [20:06:31] ... [20:06:35] RECOVERY - cp20 Stunnel HTTP for test101 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15954 bytes in 2.034 second response time [20:06:38] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.26, 9.74, 8.82 [20:07:00] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [20:07:03] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.03, 11.57, 11.54 [20:07:35] PROBLEM - cp20 SSH on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:07:38] RECOVERY - cp21 Stunnel HTTP for test101 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15954 bytes in 0.053 second response time [20:07:41] RECOVERY - az.wikiretet.ga - LetsEncrypt on sslhost is OK: OK - Certificate 'az.wikiretet.ga' will expire on Tue 11 Oct 2022 04:40:37 GMT +0000. [20:07:44] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 6.70, 8.16, 9.96 [20:07:48] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [20:08:04] PROBLEM - cp31 Stunnel HTTP for mw121 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:08:06] RECOVERY - icclopedia.org - LetsEncrypt on sslhost is OK: OK - Certificate 'icclopedia.org' will expire on Wed 24 Aug 2022 03:23:05 GMT +0000. [20:08:06] RECOVERY - cp20 conntrack_table_size on cp20 is OK: OK: nf_conntrack is 3 % full [20:08:17] PROBLEM - cp21 Stunnel HTTP for mw121 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:08:32] PROBLEM - m.miraheze.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:08:35] PROBLEM - cp20 Stunnel HTTP for mw121 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:08:52] PROBLEM - antiguabarbudacalypso.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:09:44] RECOVERY - wiki.insideearth.info - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.insideearth.info' will expire on Tue 23 Aug 2022 08:05:34 GMT +0000. [20:09:45] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.12, 0.66, 0.44 [20:10:11] RECOVERY - cp31 Stunnel HTTP for mw121 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 6.814 second response time [20:10:21] RECOVERY - cp21 Stunnel HTTP for mw121 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 7.729 second response time [20:10:25] RECOVERY - m.miraheze.org - LetsEncrypt on sslhost is OK: OK - Certificate 'm.miraheze.org' will expire on Tue 06 Sep 2022 21:18:17 GMT +0000. [20:10:44] RECOVERY - en.wikiyri.org - LetsEncrypt on sslhost is OK: OK - Certificate 'en.wikiyri.org' will expire on Wed 28 Sep 2022 05:13:53 GMT +0000. [20:10:50] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::1b80/cpweb [20:10:53] PROBLEM - cp20 Stunnel HTTP for mon111 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [20:11:11] RECOVERY - wiki.thedev.gq - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.thedev.gq' will expire on Fri 02 Sep 2022 12:36:20 GMT +0000. [20:11:36] RECOVERY - cp20 SSH on cp20 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [20:12:25] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 20.85, 15.01, 11.54 [20:12:50] RECOVERY - cp20 Stunnel HTTP for mw121 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.023 second response time [20:13:01] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 7.34, 10.50, 11.79 [20:13:08] RECOVERY - wiki-tintin.cf - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki-tintin.cf' will expire on Mon 10 Oct 2022 03:55:03 GMT +0000. [20:13:11] PROBLEM - cp21 Stunnel HTTP for mw122 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:14:00] PROBLEM - wiki.worldbuilding.network - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:14:30] PROBLEM - cp20 HTTP 4xx/5xx ERROR Rate on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [20:14:41] PROBLEM - celeste.ink - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:14:48] PROBLEM - fortis.miraheze.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:14:59] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 15.46, 12.06, 12.17 [20:15:09] RECOVERY - cp21 Stunnel HTTP for mw122 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 1.101 second response time [20:15:51] RECOVERY - cp20 Stunnel HTTP for mon111 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 39184 bytes in 0.060 second response time [20:16:08] PROBLEM - staff.polandballwiki.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:16:13] RECOVERY - jp.popira.info - LetsEncrypt on sslhost is OK: OK - Certificate 'jp.popira.info' will expire on Mon 10 Oct 2022 06:13:03 GMT +0000. [20:16:27] PROBLEM - rarewiki.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:16:29] RECOVERY - cp20 HTTP 4xx/5xx ERROR Rate on cp20 is OK: OK - NGINX Error Rate is 6% [20:16:34] RECOVERY - agentisai.com - LetsEncrypt on sslhost is OK: OK - Certificate 'www.agentisai.com' will expire on Wed 28 Sep 2022 11:24:06 GMT +0000. [20:16:41] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [20:16:58] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 7.08, 10.33, 11.54 [20:17:01] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.95, 10.29, 10.53 [20:17:03] [Grafana] FIRING: Some MediaWiki Appservers are running out of PHP-FPM workers. https://grafana.miraheze.org/d/GtxbP1Xnk [20:17:20] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.83, 1.74, 1.98 [20:17:36] PROBLEM - wiki.helsinginpoytaroolipelaajat.fi - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:17:38] RECOVERY - wiki.cjgh.xyz - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.cjgh.xyz' will expire on Mon 03 Oct 2022 20:57:39 GMT +0000. [20:18:06] PROBLEM - wiki.digitalefitheid.nl - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:18:17] PROBLEM - cp21 Stunnel HTTP for mw112 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [20:18:38] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 18.41, 13.50, 11.24 [20:19:58] RECOVERY - roll-of-arms.com - LetsEncrypt on sslhost is OK: OK - Certificate 'roll-of-arms.com' will expire on Sun 14 Aug 2022 15:58:21 GMT +0000. [20:20:27] RECOVERY - cp21 Stunnel HTTP for mw112 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 0.024 second response time [20:20:58] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 4.83, 7.12, 9.94 [20:21:01] PROBLEM - wikifencing.ru - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:21:18] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.18, 1.85, 1.96 [20:22:30] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.87, 11.79, 11.13 [20:22:59] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 6.77, 10.10, 10.70 [20:23:17] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.24, 1.61, 1.86 [20:23:18] PROBLEM - ambient.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:24:01] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 4.58, 7.75, 11.44 [20:24:46] PROBLEM - cp21 Stunnel HTTP for test101 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [20:24:48] PROBLEM - marinebiodiversitymatrix.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:24:58] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 3.93, 7.96, 9.84 [20:25:31] PROBLEM - wiki.meeusen.net - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:25:44] PROBLEM - mabi.myomi.net - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:26:21] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 5.43, 8.43, 9.91 [20:26:43] RECOVERY - cp21 Stunnel HTTP for test101 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15954 bytes in 1.051 second response time [20:26:45] PROBLEM - wikipariksha.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:26:48] PROBLEM - correypedia.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:26:51] PROBLEM - cp20 Stunnel HTTP for matomo101 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [20:27:04] PROBLEM - gluster111 APT on gluster111 is WARNING: APT WARNING: 0 packages available for upgrade (0 critical updates). warnings detected, errors detected. [20:27:04] PROBLEM - wiki.ricochetuniverse.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:27:21] RECOVERY - en.gyaanipedia.com - LetsEncrypt on sslhost is OK: OK - Certificate 'en.gyaanipedia.com' will expire on Thu 08 Sep 2022 07:04:52 GMT +0000. [20:28:27] RECOVERY - wiki.recaptime.eu.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.recaptime.eu.org' will expire on Mon 03 Oct 2022 22:23:06 GMT +0000. [20:28:51] RECOVERY - cp20 Stunnel HTTP for matomo101 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 99061 bytes in 5.340 second response time [20:29:06] PROBLEM - gluster111 APT on gluster111 is CRITICAL: APT CRITICAL: 37 packages available for upgrade (15 critical updates). [20:29:13] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.06, 1.35, 1.67 [20:30:01] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.17, 6.80, 9.81 [20:30:22] RECOVERY - franchise.franchising.org.ua - LetsEncrypt on sslhost is OK: OK - Certificate 'franchise.franchising.org.ua' will expire on Tue 23 Aug 2022 02:08:17 GMT +0000. [20:31:03] PROBLEM - infectowiki.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:31:41] PROBLEM - cp20 Stunnel HTTP for mw101 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [20:31:50] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 13.08, 12.49, 11.15 [20:31:54] RECOVERY - wiki.worlduniversityandschool.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.worlduniversityandschool.org' will expire on Tue 23 Aug 2022 07:52:18 GMT +0000. [20:32:03] [Grafana] RESOLVED: PHP-FPM Worker Usage High https://grafana.miraheze.org/d/GtxbP1Xnk [20:32:04] RECOVERY - wiki.eversd.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.eversd.com' will expire on Thu 29 Sep 2022 08:32:27 GMT +0000. [20:32:13] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::4c25/cpweb [20:32:49] PROBLEM - landofliberos.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:32:56] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 18.77, 13.13, 11.10 [20:33:35] RECOVERY - cp20 Stunnel HTTP for mw101 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.051 second response time [20:34:13] PROBLEM - finalfantasy.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:34:24] PROBLEM - mr.gyaanipedia.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:34:39] RECOVERY - dkpedia.com - LetsEncrypt on sslhost is OK: OK - Certificate 'dkpedia.com' will expire on Tue 04 Oct 2022 18:55:51 GMT +0000. [20:35:09] RECOVERY - wiki.graalmilitary.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.graalmilitary.com' will expire on Tue 23 Aug 2022 03:02:35 GMT +0000. [20:35:42] [02puppet] 07Universal-Omega opened pull request 03#2710: Varnish: Update health checks - 13https://github.com/miraheze/puppet/pull/2710 [20:35:42] [url] Page not found · GitHub · GitHub | github.com [20:35:53] RECOVERY - stablestate.org - LetsEncrypt on sslhost is OK: OK - Certificate 'stablestate.org' will expire on Tue 23 Aug 2022 08:41:48 GMT +0000. [20:35:53] RECOVERY - wiki.chouverse.cludisciples.cyou - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.chouverse.cludisciples.cyou' will expire on Tue 23 Aug 2022 00:10:19 GMT +0000. [20:35:58] RECOVERY - wiki.infomedia.co.uk - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.infomedia.co.uk' will expire on Fri 21 Oct 2022 15:33:32 GMT +0000. [20:36:19] PROBLEM - www.mwcosmos.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:36:39] RECOVERY - smashbroswiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'smashbroswiki.com' will expire on Sat 22 Oct 2022 05:43:00 GMT +0000. [20:36:55] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 6.59, 10.72, 10.67 [20:37:25] RECOVERY - wiki.mastodon.kr - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.mastodon.kr' will expire on Mon 05 Sep 2022 00:02:52 GMT +0000. [20:38:09] PROBLEM - cp21 Current Load on cp21 is WARNING: WARNING - load average: 1.84, 1.81, 1.34 [20:40:03] [02puppet] 07JohnFLewis commented on pull request 03#2710: Varnish: Update health checks - 13https://github.com/miraheze/puppet/pull/2710#issuecomment-1195958186 [20:40:04] [url] Varnish: Update health checks by Universal-Omega · Pull Request #2710 · miraheze/puppet · GitHub | github.com [20:40:54] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 4.11, 7.91, 9.62 [20:41:03] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [20:41:24] PROBLEM - wiki.zergmafia.top - reverse DNS on sslhost is WARNING: Timeout: The DNS operation timed out after 5.408181667327881 seconds [20:41:33] RECOVERY - popira.info - LetsEncrypt on sslhost is OK: OK - Certificate 'popira.info' will expire on Sun 02 Oct 2022 11:12:21 GMT +0000. [20:41:51] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 12.12, 11.02, 9.62 [20:42:01] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 20.50, 14.53, 11.27 [20:43:13] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 0.21, 0.92, 1.09 [20:43:19] RECOVERY - wiki.worldbuilding.network - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.worldbuilding.network' will expire on Mon 10 Oct 2022 05:23:51 GMT +0000. [20:43:39] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 7.81, 10.55, 11.63 [20:43:42] RECOVERY - fortis.miraheze.org - LetsEncrypt on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [20:43:48] RECOVERY - animatedfeet.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [20:44:21] RECOVERY - celeste.ink - LetsEncrypt on sslhost is OK: OK - Certificate 'celeste.ink' will expire on Sat 24 Sep 2022 13:42:28 GMT +0000. [20:44:51] RECOVERY - staff.polandballwiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'staff.polandballwiki.com' will expire on Sun 02 Oct 2022 10:43:17 GMT +0000. [20:45:28] RECOVERY - rarewiki.org - LetsEncrypt on sslhost is OK: OK - Certificate 'rarewiki.org' will expire on Wed 28 Sep 2022 05:06:19 GMT +0000. [20:46:02] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.20, 2.00, 1.75 [20:46:14] RECOVERY - wiki.helsinginpoytaroolipelaajat.fi - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.helsinginpoytaroolipelaajat.fi' will expire on Mon 29 Aug 2022 12:44:24 GMT +0000. [20:47:30] RECOVERY - wiki.digitalefitheid.nl - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.digitalefitheid.nl' will expire on Wed 21 Sep 2022 08:49:04 GMT +0000. [20:47:44] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 11.21, 11.63, 10.53 [20:48:01] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.76, 11.96, 11.19 [20:48:52] PROBLEM - matomo101 Current Load on matomo101 is CRITICAL: CRITICAL - load average: 4.03, 3.08, 2.44 [20:48:54] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.18, 8.93, 9.04 [20:49:01] PROBLEM - cp20 Stunnel HTTP for mw111 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:49:11] RECOVERY - ngsswiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'ngsswiki.com' will expire on Sun 02 Oct 2022 05:32:39 GMT +0000. [20:49:28] PROBLEM - cp21 Stunnel HTTP for puppet111 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:49:44] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.86, 10.19, 10.13 [20:50:31] RECOVERY - wikifencing.ru - LetsEncrypt on sslhost is OK: OK - Certificate 'wikifencing.ru' will expire on Tue 06 Sep 2022 20:55:14 GMT +0000. [20:50:52] RECOVERY - matomo101 Current Load on matomo101 is OK: OK - load average: 3.24, 3.23, 2.58 [20:51:15] RECOVERY - cp20 Stunnel HTTP for mw111 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 0.019 second response time [20:51:21] RECOVERY - dcmultiverse.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [20:51:28] RECOVERY - cp21 Stunnel HTTP for puppet111 on cp21 is OK: HTTP OK: Status line output matched "403" - 289 bytes in 0.012 second response time [20:51:33] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 12.68, 11.29, 11.31 [20:52:01] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.75, 12.37, 11.50 [20:52:38] RECOVERY - ambient.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'ambient.wiki' will expire on Mon 10 Oct 2022 05:15:24 GMT +0000. [20:52:51] RECOVERY - fc.songcontests.eu - LetsEncrypt on sslhost is OK: OK - Certificate 'fc.songcontests.eu' will expire on Mon 22 Aug 2022 22:44:59 GMT +0000. [20:52:53] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.65, 11.52, 10.32 [20:52:58] PROBLEM - cp21 Stunnel HTTP for mw102 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:53:31] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 7.97, 10.23, 10.93 [20:53:58] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.26, 1.95, 1.89 [20:54:53] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 5.69, 9.46, 9.72 [20:54:56] RECOVERY - cp21 Stunnel HTTP for mw102 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 4.455 second response time [20:54:57] RECOVERY - wiki.meeusen.net - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.meeusen.net' will expire on Sat 17 Sep 2022 21:26:27 GMT +0000. [20:55:07] RECOVERY - mabi.myomi.net - LetsEncrypt on sslhost is OK: OK - Certificate 'mabi.myomi.net' will expire on Tue 23 Aug 2022 13:11:15 GMT +0000. [20:55:10] PROBLEM - erawikisource.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:55:29] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 18.58, 12.25, 11.51 [20:55:34] RECOVERY - wikipariksha.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wikipariksha.com' will expire on Wed 24 Aug 2022 05:18:49 GMT +0000. [20:56:38] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 14.72, 11.56, 9.07 [20:57:01] RECOVERY - wiki.ricochetuniverse.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.ricochetuniverse.com' will expire on Tue 23 Aug 2022 00:04:36 GMT +0000. [20:57:54] PROBLEM - cp21 Puppet on cp21 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [20:57:56] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.95, 1.39, 1.68 [21:01:34] RECOVERY - cp21 Varnish Backends on cp21 is OK: All 14 backends are healthy [21:02:03] RECOVERY - dragonquest2.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [21:02:09] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [21:02:38] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.51, 10.75, 9.80 [21:02:54] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 13.63, 13.44, 11.24 [21:03:02] RECOVERY - finalfantasy.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [21:03:24] PROBLEM - cp21 Stunnel HTTP for mw101 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:04:38] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 16.39, 12.68, 10.59 [21:04:54] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 7.32, 11.30, 10.73 [21:05:02] RECOVERY - www.mwcosmos.com - LetsEncrypt on sslhost is OK: OK - Certificate 'mwcosmos.com' will expire on Mon 22 Aug 2022 15:03:04 GMT +0000. [21:06:00] [02puppet] 07Universal-Omega commented on pull request 03#2710: Varnish: Update health checks - 13https://github.com/miraheze/puppet/pull/2710#issuecomment-1195981140 [21:06:00] [url] Varnish: Update health checks by Universal-Omega · Pull Request #2710 · miraheze/puppet · GitHub | github.com [21:07:33] RECOVERY - www.obeymewiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'www.obeymewiki.com' will expire on Thu 01 Sep 2022 00:44:40 GMT +0000. [21:07:44] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 13.22, 10.95, 9.58 [21:08:24] RECOVERY - antiguabarbudacalypso.com - LetsEncrypt on sslhost is OK: OK - Certificate 'antiguabarbudacalypso.com' will expire on Tue 23 Aug 2022 01:05:30 GMT +0000. [21:09:10] PROBLEM - privacywiki.xyz - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:09:44] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 10.56, 10.51, 9.57 [21:09:51] PROBLEM - cp20 SSH on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:10:01] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.18, 11.13, 12.00 [21:10:03] PROBLEM - grk.repository.archiopedia.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:10:05] RECOVERY - wiki.zergmafia.top - reverse DNS on sslhost is OK: SSL OK - wiki.zergmafia.top reverse DNS resolves to cp20.miraheze.org - CNAME OK [21:10:24] PROBLEM - wiki.joust.ro - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:10:40] RECOVERY - cp21 Stunnel HTTP for mw101 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.042 second response time [21:10:48] PROBLEM - cp21 Varnish Backends on cp21 is CRITICAL: 1 backends are down. mw102 [21:11:34] [02puppet] 07JohnFLewis commented on pull request 03#2710: Varnish: Update health checks - 13https://github.com/miraheze/puppet/pull/2710#issuecomment-1195985801 [21:11:34] [url] Varnish: Update health checks by Universal-Omega · Pull Request #2710 · miraheze/puppet · GitHub | github.com [21:11:44] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 6.84, 9.70, 9.42 [21:12:01] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 9.89, 11.36, 12.02 [21:12:53] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 13.34, 11.03, 10.56 [21:13:47] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.20, 1.81, 1.62 [21:13:50] RECOVERY - cp20 SSH on cp20 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [21:14:01] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.15, 10.45, 11.62 [21:14:54] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 11.53, 11.33, 10.74 [21:15:12] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 10.06, 10.71, 11.79 [21:15:46] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.06, 1.55, 1.55 [21:16:38] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.85, 11.18, 11.19 [21:16:40] RECOVERY - cp21 Varnish Backends on cp21 is OK: All 14 backends are healthy [21:16:54] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 13.02, 11.81, 10.98 [21:17:10] RECOVERY - cp20 Varnish Backends on cp20 is OK: All 14 backends are healthy [21:17:10] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 12.67, 11.06, 11.77 [21:18:54] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 7.15, 10.04, 10.44 [21:19:09] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 10.31, 10.62, 11.51 [21:19:44] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 10.48, 9.94, 9.29 [21:20:54] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.96, 10.88, 10.68 [21:21:41] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.21, 1.73, 1.65 [21:21:44] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 15.29, 11.94, 10.10 [21:22:38] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.28, 10.44, 10.69 [21:22:54] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 11.93, 11.64, 11.02 [21:23:05] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 14.51, 11.83, 11.72 [21:23:40] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.84, 1.45, 1.56 [21:24:06] RECOVERY - marinebiodiversitymatrix.org - LetsEncrypt on sslhost is OK: OK - Certificate 'marinebiodiversitymatrix.org' will expire on Wed 24 Aug 2022 01:59:18 GMT +0000. [21:24:36] RECOVERY - erawikisource.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [21:24:38] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.80, 10.60, 10.72 [21:24:38] RECOVERY - wiki.minecraftathome.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.minecraftathome.com' will expire on Wed 24 Aug 2022 02:32:00 GMT +0000. [21:24:46] RECOVERY - correypedia.org - LetsEncrypt on sslhost is OK: OK - Certificate 'correypedia.org' will expire on Thu 01 Sep 2022 00:41:01 GMT +0000. [21:26:40] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.35, 11.51, 11.04 [21:26:48] RECOVERY - cp21 Puppet on cp21 is OK: OK: Puppet is currently enabled, last run 4 seconds ago with 0 failures [21:26:54] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 15.18, 12.79, 11.58 [21:28:01] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.30, 11.94, 11.29 [21:28:38] RECOVERY - infectowiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'infectowiki.com' will expire on Tue 23 Aug 2022 08:27:35 GMT +0000. [21:28:38] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.58, 11.20, 11.00 [21:29:36] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.03, 1.94, 1.74 [21:29:54] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CRITICAL - load average: 2.95, 2.76, 1.53 [21:30:01] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.11, 11.91, 11.39 [21:31:53] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.20, 1.68, 1.67 [21:32:57] RECOVERY - landofliberos.com - LetsEncrypt on sslhost is OK: OK - Certificate 'landofliberos.com' will expire on Tue 30 Aug 2022 16:38:50 GMT +0000. [21:34:29] RECOVERY - landofliberos.com - LetsEncrypt on sslhost is OK: OK - Certificate 'landofliberos.com' will expire on Tue 30 Aug 2022 16:38:50 GMT +0000. [21:34:40] RECOVERY - mr.gyaanipedia.com - LetsEncrypt on sslhost is OK: OK - Certificate 'mr.gyaanipedia.com' will expire on Thu 08 Sep 2022 06:58:00 GMT +0000. [21:34:55] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.12, 11.47, 11.44 [21:35:58] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.61, 11.41, 11.96 [21:36:30] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.79, 10.69, 11.05 [21:36:46] PROBLEM - mon111 Current Load on mon111 is CRITICAL: CRITICAL - load average: 3.67, 16.66, 10.16 [21:38:11] RECOVERY - privacywiki.xyz - LetsEncrypt on sslhost is OK: OK - Certificate 'privacywiki.xyz' will expire on Mon 26 Sep 2022 13:36:29 GMT +0000. [21:38:29] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.06, 10.97, 11.06 [21:39:20] RECOVERY - wiki.joust.ro - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.joust.ro' will expire on Tue 23 Aug 2022 07:32:52 GMT +0000. [21:39:51] RECOVERY - grk.repository.archiopedia.org - LetsEncrypt on sslhost is OK: OK - Certificate 'grk.repository.archiopedia.org' will expire on Sat 17 Sep 2022 21:13:49 GMT +0000. [21:39:55] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 12.68, 11.98, 12.05 [21:40:42] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 12.40, 10.98, 11.10 [21:42:34] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.04, 11.72, 11.10 [21:42:38] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 7.63, 9.74, 10.64 [21:44:34] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 6.75, 8.64, 10.12 [21:46:29] PROBLEM - mon111 Current Load on mon111 is WARNING: WARNING - load average: 0.44, 2.91, 5.72 [21:48:32] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.79, 11.37, 11.18 [21:50:22] RECOVERY - mon111 Current Load on mon111 is OK: OK - load average: 0.92, 1.81, 4.63 [21:50:23] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 11.55, 10.19, 10.27 [21:52:19] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 9.19, 9.59, 10.03 [21:53:30] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.71, 1.56, 1.44 [21:55:30] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.03, 1.41, 1.41 [21:58:11] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.67, 11.63, 11.85 [22:08:02] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.71, 11.41, 11.39 [22:10:00] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.62, 11.84, 11.58 [22:11:58] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.54, 12.42, 11.85 [22:15:55] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.14, 11.95, 11.84 [22:20:22] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 14.30, 10.46, 9.29 [22:20:24] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 6.90, 8.85, 9.82 [22:22:17] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 8.61, 9.65, 9.14 [22:26:11] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.37, 10.40, 9.61 [22:30:02] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.85, 9.30, 9.35 [22:30:20] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.34, 1.60, 1.96 [22:30:24] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.86, 1.54, 1.32 [22:32:22] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.63, 1.20, 1.22 [22:33:38] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.60, 9.29, 10.06 [22:36:17] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.22, 1.77, 1.89 [22:37:23] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 10.41, 10.99, 11.96 [22:37:55] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.36, 10.93, 11.79 [22:38:17] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.68, 1.72, 1.86 [22:39:23] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 12.73, 11.64, 12.08 [22:43:55] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 13.89, 11.84, 11.82 [22:44:17] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.21, 1.40, 1.67 [22:45:55] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 8.05, 10.33, 11.27 [22:48:18] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 7.62, 9.29, 11.86 [22:50:17] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.04, 1.88, 1.79 [22:51:55] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.41, 10.71, 11.01 [22:52:17] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 15.91, 11.67, 12.11 [22:53:30] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.08, 1.64, 1.39 [22:53:55] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 11.29, 10.82, 11.00 [22:54:17] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.41, 1.83, 1.82 [22:54:25] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 12.28, 11.56, 10.07 [22:55:30] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.40, 1.58, 1.41 [22:56:21] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.22, 10.38, 9.82 [22:57:55] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 13.43, 11.54, 11.22 [22:58:17] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 12.00, 11.46, 11.94 [22:59:10] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.63, 10.55, 9.90 [23:00:12] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 6.58, 9.03, 9.44 [23:00:17] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.07, 1.81, 1.80 [23:01:10] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.98, 9.79, 9.69 [23:02:17] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 16.01, 12.77, 12.25 [23:05:55] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.63, 11.92, 11.78 [23:08:05] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.38, 10.85, 10.13 [23:09:55] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.71, 1.55, 1.37 [23:09:55] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.62, 12.28, 11.94 [23:11:10] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.21, 9.45, 8.79 [23:11:53] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.70, 1.23, 1.27 [23:12:03] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.77, 1.56, 1.42 [23:13:57] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.44, 1.45, 1.39 [23:15:09] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.30, 8.65, 8.64 [23:15:55] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.06, 11.55, 11.78 [23:15:58] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.54, 11.96, 11.18 [23:19:07] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.55, 10.32, 9.33 [23:19:40] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.52, 3.02, 2.13 [23:21:07] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 9.04, 9.66, 9.20 [23:21:32] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 11.09, 11.85, 10.41 [23:25:23] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 7.63, 9.77, 11.99 [23:25:30] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.30, 1.91, 1.91 [23:27:32] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 16.65, 12.79, 11.14 [23:29:23] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 12.14, 10.01, 11.51 [23:29:30] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.79, 1.40, 1.70 [23:29:32] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.83, 11.56, 10.92 [23:29:45] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.54, 9.18, 9.94 [23:31:23] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 11.77, 10.66, 11.57 [23:31:55] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 18.81, 12.88, 11.94 [23:35:02] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.72, 10.95, 10.00 [23:37:02] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.03, 10.82, 10.04 [23:37:23] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 17.09, 12.25, 11.81 [23:39:01] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.29, 10.36, 9.95 [23:39:23] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 11.72, 11.87, 11.73 [23:39:32] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 6.96, 9.32, 10.13 [23:39:35] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.20, 10.78, 10.27 [23:41:01] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 6.53, 9.11, 9.55 [23:41:23] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 13.15, 12.10, 11.80 [23:45:23] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 7.45, 10.55, 11.32 [23:45:55] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 7.92, 10.57, 11.65 [23:47:27] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.86, 9.43, 9.93 [23:51:32] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 11.48, 10.22, 9.73 [23:53:32] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 6.79, 9.20, 9.44 [23:55:23] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 13.90, 11.59, 11.36 [23:57:55] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.84, 11.74, 11.38 [23:59:23] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 11.37, 11.36, 11.31 [23:59:55] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.36, 10.93, 11.11