[00:00:47] !log [macfan@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=vendeewiki --no-updates --username-prefix=vikidiafrwiki /mnt/mediawiki-static/metawiki/ImportDump/vendeewiki-20220914115416.xml (END - exit=0) [00:00:48] !log [macfan@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=vendeewiki (START) [00:00:54] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:01:03] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:01:28] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 1.49, 1.64, 1.64 [00:02:27] !log [macfan@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=vendeewiki (END - exit=0) [00:02:28] !log [macfan@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/initSiteStats.php --wiki=vendeewiki --active --update (END - exit=0) [00:02:36] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:02:47] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:04:06] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 2.38, 5.12, 5.41 [00:06:06] RECOVERY - gluster102 Current Load on gluster102 is OK: OK - load average: 2.49, 4.26, 5.05 [00:08:00] RECOVERY - cp31 Disk Space on cp31 is OK: DISK OK - free space: / 10366 MB (26% inode=96%); [00:08:18] RECOVERY - db131 NTP time on db131 is OK: NTP OK: Offset 0.00214356184 secs [00:08:59] RECOVERY - cp30 Disk Space on cp30 is OK: DISK OK - free space: / 10184 MB (26% inode=96%); [00:13:32] PROBLEM - mw132 Current Load on mw132 is CRITICAL: CRITICAL - load average: 17.20, 15.76, 8.94 [00:13:44] PROBLEM - mw141 Current Load on mw141 is CRITICAL: CRITICAL - load average: 17.65, 16.28, 10.04 [00:15:32] PROBLEM - mw132 Current Load on mw132 is WARNING: WARNING - load average: 3.60, 11.11, 8.06 [00:15:41] PROBLEM - cp30 Varnish Backends on cp30 is CRITICAL: 1 backends are down. mw132 [00:17:32] RECOVERY - mw132 Current Load on mw132 is OK: OK - load average: 4.51, 8.67, 7.52 [00:17:40] RECOVERY - cp30 Varnish Backends on cp30 is OK: All 14 backends are healthy [00:17:44] PROBLEM - mw141 Current Load on mw141 is WARNING: WARNING - load average: 5.56, 10.83, 9.26 [00:19:44] RECOVERY - mw141 Current Load on mw141 is OK: OK - load average: 5.42, 9.16, 8.85 [00:20:54] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 5.85, 5.42, 4.99 [00:22:48] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 6.52, 6.18, 5.34 [00:26:36] RECOVERY - gluster102 Current Load on gluster102 is OK: OK - load average: 2.30, 4.74, 4.98 [01:03:18] [02miraheze/dns] 07Universal-Omega pushed 031 commit to 03revert-342-revert-341-paladox-patch-1 [+0/-0/±1] 13https://github.com/miraheze/dns/commit/0f10189c25d5 [01:03:19] [02miraheze/dns] 07Universal-Omega 030f10189 - Revert "Revert "Repool cp20/21 (#341)" (#342)" [01:03:21] [02dns] 07Universal-Omega created branch 03revert-342-revert-341-paladox-patch-1 - 13https://github.com/miraheze/dns [01:03:21] [url] Page not found · GitHub · GitHub | github.com [01:03:22] [02dns] 07Universal-Omega opened pull request 03#347: Revert "Revert "Repool cp20/21"" - 13https://github.com/miraheze/dns/pull/347 [01:03:23] ... [01:04:00] [02dns] 07Universal-Omega edited pull request 03#347: Repool cp20/21 - 13https://github.com/miraheze/dns/pull/347 [01:04:00] ... [01:04:07] [02dns] 07Universal-Omega edited pull request 03#347: Repool cp20/21 - 13https://github.com/miraheze/dns/pull/347 [01:04:08] ... [01:04:46] [02dns] 07Universal-Omega closed pull request 03#347: Repool cp20/21 - 13https://github.com/miraheze/dns/pull/347 [01:04:46] [url] Page not found · GitHub · GitHub | github.com [01:04:48] [02miraheze/dns] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/dns/compare/da4c0b445178...7908c79d0839 [01:04:48] [url] Comparing da4c0b445178...7908c79d0839 · miraheze/dns · GitHub | github.com [01:04:49] [02miraheze/dns] 07Universal-Omega 037908c79 - Repool cp20/21 (#347) [01:04:51] [02miraheze/dns] 07Universal-Omega deleted branch 03revert-342-revert-341-paladox-patch-1 [01:04:52] [02dns] 07Universal-Omega deleted branch 03revert-342-revert-341-paladox-patch-1 - 13https://github.com/miraheze/dns [01:04:52] [url] Page not found · GitHub · GitHub | github.com [01:11:03] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 1.97, 3.21, 3.96 [01:13:03] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 9.38, 5.37, 4.65 [01:15:06] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 8.42, 5.34, 4.16 [01:17:00] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 5.91, 5.28, 4.26 [01:18:54] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 6.41, 6.53, 4.90 [01:20:48] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 4.35, 5.84, 4.84 [01:22:42] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 10.38, 7.46, 5.53 [01:34:41] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 0.41, 1.08, 2.00 [01:35:08] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 1.11, 1.17, 2.01 [01:35:13] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.10, 1.17, 2.00 [01:35:48] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.22, 9.59, 8.35 [01:38:22] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 1.58, 1.75, 1.61 [01:39:46] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.61, 9.23, 8.55 [01:40:21] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 1.38, 1.62, 1.58 [01:40:28] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.06, 1.51, 1.89 [01:40:39] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.89, 1.49, 1.88 [01:40:48] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.23, 1.58, 1.91 [01:40:59] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.89, 1.52, 1.89 [01:42:37] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 3.24, 1.73, 1.90 [01:43:38] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.93, 1.64, 1.86 [01:43:45] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.87, 10.45, 8.93 [01:45:45] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.16, 9.16, 8.64 [01:46:06] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 2.95, 4.81, 5.75 [01:47:49] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.75, 1.90, 1.90 [01:48:06] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 14.27, 8.67, 7.06 [01:48:33] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.08, 1.51, 2.00 [01:48:43] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.86, 1.82, 1.87 [01:48:52] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.17, 1.89, 1.90 [01:50:54] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.74, 1.81, 2.03 [01:50:58] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.73, 1.96, 1.93 [01:52:52] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 3.39, 2.20, 2.01 [01:54:46] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.75, 1.87, 1.90 [01:56:06] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 2.50, 4.23, 5.64 [01:56:37] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.17, 1.80, 1.98 [01:56:41] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.32, 1.95, 1.92 [01:56:42] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 1.72, 1.91, 2.01 [01:57:09] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.42, 1.82, 1.98 [01:57:38] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.86, 1.91, 1.90 [02:02:06] RECOVERY - gluster102 Current Load on gluster102 is OK: OK - load average: 3.52, 3.89, 5.00 [02:03:44] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.98, 1.29, 1.69 [02:07:30] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.77, 1.84, 1.80 [02:09:30] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.31, 1.61, 1.72 [02:09:44] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.55, 1.88, 1.77 [02:11:44] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.41, 1.70, 1.72 [02:13:44] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.73, 1.34, 1.58 [02:15:31] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.92, 1.40, 1.62 [02:16:06] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 4.15, 5.78, 5.27 [02:16:22] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.33, 10.87, 9.72 [02:18:06] RECOVERY - gluster102 Current Load on gluster102 is OK: OK - load average: 1.11, 3.99, 4.67 [02:18:19] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 4.45, 8.29, 8.89 [02:19:01] PROBLEM - cp30 Varnish Backends on cp30 is CRITICAL: 2 backends are down. mw141 mw142 [02:19:29] PROBLEM - cp31 Varnish Backends on cp31 is CRITICAL: 7 backends are down. mw121 mw122 mw131 mw132 mw141 mw142 mediawiki [02:21:17] well crap... [02:22:01] RECOVERY - cp31 Varnish Backends on cp31 is OK: All 14 backends are healthy [02:22:23] RECOVERY - cp30 Varnish Backends on cp30 is OK: All 14 backends are healthy [02:27:44] PROBLEM - test131 Current Load on test131 is CRITICAL: CRITICAL - load average: 2.17, 1.63, 1.29 [02:27:52] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 1.98, 1.61, 1.29 [02:28:22] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 1.67, 1.57, 1.28 [02:31:44] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.05, 1.95, 1.67 [02:37:44] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.11, 1.67, 1.68 [02:39:03] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.94, 3.34, 3.96 [02:47:03] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.13, 3.59, 3.75 [02:51:03] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.89, 3.93, 3.87 [02:52:30] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 3.06, 1.86, 1.58 [02:53:44] PROBLEM - mw141 Current Load on mw141 is WARNING: WARNING - load average: 11.24, 11.97, 7.81 [02:55:44] RECOVERY - mw141 Current Load on mw141 is OK: OK - load average: 6.08, 9.89, 7.56 [02:56:22] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.31, 1.69, 1.58 [03:01:03] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.30, 3.59, 3.58 [03:05:03] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.97, 2.94, 3.33 [03:17:03] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.32, 4.44, 3.86 [03:17:30] PROBLEM - test131 Current Load on test131 is CRITICAL: CRITICAL - load average: 2.37, 1.87, 1.61 [03:19:28] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 1.85, 1.84, 1.63 [03:20:48] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 6.94, 6.68, 5.08 [03:23:28] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 1.39, 1.70, 1.63 [03:24:36] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 3.16, 5.45, 4.97 [03:26:30] RECOVERY - gluster102 Current Load on gluster102 is OK: OK - load average: 3.27, 4.96, 4.86 [03:28:22] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 4.13, 2.79, 1.90 [03:32:14] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 0.97, 1.79, 1.69 [03:33:40] PROBLEM - db131 NTP time on db131 is CRITICAL: NTP CRITICAL: Offset 0.7094629705 secs [03:34:10] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.89, 1.50, 1.59 [03:40:00] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.35, 2.32, 1.90 [03:41:56] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.33, 1.95, 1.81 [03:45:48] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.96, 1.40, 1.61 [03:47:03] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.31, 2.99, 3.89 [03:59:03] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.00, 2.19, 3.16 [04:04:26] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.61, 1.78, 1.57 [04:06:22] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.48, 1.84, 1.60 [04:08:18] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.49, 1.72, 1.59 [04:12:10] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 3.45, 2.17, 1.77 [04:14:06] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.32, 1.75, 1.66 [04:17:58] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.09, 1.46, 1.57 [04:23:30] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 1.92, 2.73, 1.94 [04:27:31] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.67, 1.61, 1.66 [04:29:03] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 6.58, 4.81, 3.25 [04:30:33] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 6.31, 4.96, 3.39 [04:34:21] RECOVERY - gluster102 Current Load on gluster102 is OK: OK - load average: 3.09, 4.90, 3.78 [04:35:03] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.58, 3.91, 3.41 [04:39:18] RECOVERY - db131 NTP time on db131 is OK: NTP OK: Offset -0.004042327404 secs [04:41:03] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.28, 3.15, 3.25 [04:43:31] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.83, 2.71, 1.95 [04:47:03] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 6.58, 5.07, 4.01 [04:47:31] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.29, 1.93, 1.81 [04:49:30] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.84, 1.57, 1.69 [04:53:03] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.67, 3.97, 3.88 [04:57:03] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 6.86, 4.05, 3.84 [04:59:03] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.60, 3.64, 3.71 [04:59:09] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 7.18, 5.01, 4.13 [04:59:56] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 1.97, 1.81, 1.57 [05:01:03] RECOVERY - gluster102 Current Load on gluster102 is OK: OK - load average: 3.50, 4.73, 4.16 [05:03:03] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 10.85, 6.03, 4.56 [05:04:51] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 6.88, 6.64, 5.07 [05:06:45] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 3.64, 5.37, 4.78 [05:07:48] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 1.35, 1.60, 1.59 [05:08:39] RECOVERY - gluster102 Current Load on gluster102 is OK: OK - load average: 1.70, 4.15, 4.40 [05:09:13] PROBLEM - wikipanel.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wikipanel.org' expires in 15 day(s) (Sun 02 Oct 2022 04:51:38 GMT +0000). [05:10:49] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.18, 1.72, 1.55 [05:12:44] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.86, 1.41, 1.45 [05:13:03] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 1.40, 2.86, 3.83 [05:13:07] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/105beec6389b...36ff81b4f186 [05:13:08] [url] Comparing 105beec6389b...36ff81b4f186 · miraheze/ssl · GitHub | github.com [05:13:09] [02miraheze/ssl] 07MirahezeSSLBot 0336ff81b - Bot: Update SSL cert for wikipanel.org [05:17:03] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.84, 3.11, 3.64 [05:19:03] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.29, 2.83, 3.48 [05:21:03] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.34, 2.47, 3.28 [05:38:08] RECOVERY - wikipanel.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wikipanel.org' will expire on Thu 15 Dec 2022 04:13:01 GMT +0000. [05:38:40] PROBLEM - wiki.controlistes.fr - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.controlistes.fr' expires in 15 day(s) (Sun 02 Oct 2022 05:16:52 GMT +0000). [05:38:41] PROBLEM - grk.archiopedia.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'grk.archiopedia.org' expires in 15 day(s) (Sun 02 Oct 2022 05:34:49 GMT +0000). [05:39:03] PROBLEM - reviews.thejoshmeister.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [05:41:10] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::1b80/cpweb [05:41:12] PROBLEM - ecole.science - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [05:41:31] PROBLEM - hoodwiki.xyz - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [05:41:39] PROBLEM - en.wikiretet.ga - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'en.wikiretet.ga' expires in 15 day(s) (Sun 02 Oct 2022 05:37:01 GMT +0000). [05:41:59] PROBLEM - phgalaxy.eu.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'phgalaxy.eu.org' expires in 15 day(s) (Sun 02 Oct 2022 05:33:18 GMT +0000). [05:42:16] PROBLEM - commons.polandballwiki.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [05:42:49] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/36ff81b4f186...ed9f419b592c [05:42:49] [url] Comparing 36ff81b4f186...ed9f419b592c · miraheze/ssl · GitHub | github.com [05:42:50] [02miraheze/ssl] 07MirahezeSSLBot 03ed9f419 - Bot: Update SSL cert for wiki.controlistes.fr [05:42:57] PROBLEM - yokaiwatch.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [05:44:55] PROBLEM - sdiy.info - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [05:45:28] PROBLEM - wiki.newnormal.fans - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [05:46:33] PROBLEM - lgbtqia.wiki - LetsEncrypt on sslhost is CRITICAL: connect to address lgbtqia.wiki and port 443: Network is unreachableHTTP CRITICAL - Unable to open TCP socket [05:46:46] PROBLEM - worldsanskrit.net - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [05:47:10] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [05:47:13] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/ed9f419b592c...8a3a0b3d95c8 [05:47:14] [url] Comparing ed9f419b592c...8a3a0b3d95c8 · miraheze/ssl · GitHub | github.com [05:47:15] [02miraheze/ssl] 07MirahezeSSLBot 038a3a0b3 - Bot: Update SSL cert for phgalaxy.eu.org [05:47:31] PROBLEM - wikien.wildterra2.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [05:47:37] PROBLEM - ngsswiki.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'ngsswiki.com' expires in 15 day(s) (Sun 02 Oct 2022 05:32:39 GMT +0000). [05:47:52] PROBLEM - data.famepedia.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [05:48:40] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/8a3a0b3d95c8...c1c8bbdb0fee [05:48:40] [url] Comparing 8a3a0b3d95c8...c1c8bbdb0fee · miraheze/ssl · GitHub | github.com [05:48:41] [02miraheze/ssl] 07MirahezeSSLBot 03c1c8bbd - Bot: Update SSL cert for en.wikiretet.ga [05:48:44] PROBLEM - arcanewaterswiki.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [05:49:43] PROBLEM - wiki.zymonic.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [05:50:30] PROBLEM - elsterclopedie.marithaime.nl - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [05:51:25] PROBLEM - zenith.nsmbu.net - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [05:53:09] PROBLEM - eng.archiopedia.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'eng.archiopedia.org' expires in 15 day(s) (Sun 02 Oct 2022 05:35:50 GMT +0000). [05:53:36] PROBLEM - wikimoma.art - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [05:54:03] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/c1c8bbdb0fee...6d3cec9516b8 [05:54:04] [url] Comparing c1c8bbdb0fee...6d3cec9516b8 · miraheze/ssl · GitHub | github.com [05:54:05] [02miraheze/ssl] 07MirahezeSSLBot 036d3cec9 - Bot: Update SSL cert for grk.archiopedia.org [05:54:11] PROBLEM - wiki.villagecollaborative.net - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [05:54:12] PROBLEM - www.opendatascot.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [05:54:31] PROBLEM - wc.miraheze.org on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [05:56:54] PROBLEM - thelonsdalebattalion.co.uk - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [05:57:28] PROBLEM - test131 Current Load on test131 is CRITICAL: CRITICAL - load average: 2.37, 1.74, 1.35 [05:57:43] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/6d3cec9516b8...047d41cb6ba0 [05:57:44] [url] Comparing 6d3cec9516b8...047d41cb6ba0 · miraheze/ssl · GitHub | github.com [05:57:45] [02miraheze/ssl] 07MirahezeSSLBot 03047d41c - Bot: Update SSL cert for ngsswiki.com [05:58:40] RECOVERY - wc.miraheze.org on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [05:59:10] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::4c25/cpweb [05:59:28] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 1.49, 1.62, 1.36 [05:59:42] PROBLEM - m.miraheze.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:00:26] PROBLEM - intp.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:01:09] PROBLEM - mariopedia.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:01:23] PROBLEM - cp21 Stunnel HTTP for mon141 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [06:01:36] PROBLEM - tot.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:01:39] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/047d41cb6ba0...a12dc8504700 [06:01:39] RECOVERY - m.miraheze.org - LetsEncrypt on sslhost is OK: OK - Certificate 'm.miraheze.org' will expire on Tue 22 Nov 2022 14:02:45 GMT +0000. [06:01:40] [url] Comparing 047d41cb6ba0...a12dc8504700 · miraheze/ssl · GitHub | github.com [06:01:41] [02miraheze/ssl] 07MirahezeSSLBot 03a12dc85 - Bot: Update SSL cert for eng.archiopedia.org [06:02:14] PROBLEM - wiki.harlonserver.net - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:02:15] PROBLEM - wiki.misslessfighters.club - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:02:59] PROBLEM - thepolicyhub.org.uk - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:03:24] RECOVERY - cp21 Stunnel HTTP for mon141 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 36275 bytes in 2.084 second response time [06:06:50] PROBLEM - wiki.meeusen.net - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:06:56] RECOVERY - wikien.wildterra2.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wikien.wildterra2.com' will expire on Sun 06 Nov 2022 01:05:05 GMT +0000. [06:07:53] PROBLEM - grk.archiopedia.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:08:14] PROBLEM - wiki.controlistes.fr - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:08:30] RECOVERY - reviews.thejoshmeister.com - LetsEncrypt on sslhost is OK: OK - Certificate 'reviews.thejoshmeister.com' will expire on Mon 12 Dec 2022 07:51:54 GMT +0000. [06:09:01] PROBLEM - www.sdiy.info - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:09:28] PROBLEM - test131 Current Load on test131 is CRITICAL: CRITICAL - load average: 2.33, 1.87, 1.53 [06:09:36] RECOVERY - mariopedia.org - LetsEncrypt on sslhost is OK: OK - Certificate 'mariopedia.org' will expire on Fri 07 Oct 2022 11:49:47 GMT +0000. [06:10:00] RECOVERY - wiki.harlonserver.net - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.harlonserver.net' will expire on Sun 06 Nov 2022 16:13:37 GMT +0000. [06:10:28] RECOVERY - ecole.science - LetsEncrypt on sslhost is OK: OK - Certificate 'ecole.science' will expire on Fri 04 Nov 2022 20:42:01 GMT +0000. [06:10:33] RECOVERY - en.wikiretet.ga - LetsEncrypt on sslhost is OK: OK - Certificate 'en.wikiretet.ga' will expire on Thu 15 Dec 2022 04:48:34 GMT +0000. [06:11:25] RECOVERY - commons.polandballwiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'commons.polandballwiki.com' will expire on Mon 10 Oct 2022 05:30:54 GMT +0000. [06:11:35] RECOVERY - phgalaxy.eu.org - LetsEncrypt on sslhost is OK: OK - Certificate 'phgalaxy.eu.org' will expire on Thu 15 Dec 2022 04:47:07 GMT +0000. [06:11:35] RECOVERY - yokaiwatch.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [06:12:57] PROBLEM - atnarsia.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:14:23] RECOVERY - wiki.newnormal.fans - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.newnormal.fans' will expire on Fri 14 Oct 2022 16:20:05 GMT +0000. [06:14:45] RECOVERY - sdiy.info - LetsEncrypt on sslhost is OK: OK - Certificate 'sdiy.info' will expire on Fri 02 Dec 2022 10:24:01 GMT +0000. [06:15:48] RECOVERY - lgbtqia.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'www.lgbtqia.wiki' will expire on Fri 07 Oct 2022 11:35:52 GMT +0000. [06:16:13] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 16.21, 9.30, 6.62 [06:16:44] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.46, 3.54, 2.93 [06:16:46] RECOVERY - data.famepedia.org - LetsEncrypt on sslhost is OK: OK - Certificate 'data.famepedia.org' will expire on Sun 11 Dec 2022 16:28:51 GMT +0000. [06:17:43] PROBLEM - ngsswiki.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:17:44] PROBLEM - wc.miraheze.org on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:18:18] RECOVERY - arcanewaterswiki.org - LetsEncrypt on sslhost is OK: OK - Certificate 'arcanewaterswiki.org' will expire on Sun 30 Oct 2022 20:54:06 GMT +0000. [06:18:41] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.11, 2.72, 2.70 [06:18:55] PROBLEM - smashbros.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:18:59] RECOVERY - wiki.zymonic.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.zymonic.com' will expire on Sun 06 Nov 2022 01:42:48 GMT +0000. [06:19:30] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.26, 1.83, 1.25 [06:19:39] RECOVERY - elsterclopedie.marithaime.nl - LetsEncrypt on sslhost is OK: OK - Certificate 'elsterclopedie.marithaime.nl' will expire on Sun 30 Oct 2022 20:08:40 GMT +0000. [06:20:07] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 5.30, 8.46, 6.99 [06:20:54] RECOVERY - zenith.nsmbu.net - LetsEncrypt on sslhost is OK: OK - Certificate 'zenith.nsmbu.net' will expire on Mon 10 Oct 2022 05:53:48 GMT +0000. [06:21:31] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.74, 1.87, 1.34 [06:21:53] RECOVERY - wc.miraheze.org on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [06:22:25] RECOVERY - wikimoma.art - LetsEncrypt on sslhost is OK: OK - Certificate 'wikimoma.art' will expire on Wed 30 Nov 2022 18:21:01 GMT +0000. [06:23:27] RECOVERY - wiki.villagecollaborative.net - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.villagecollaborative.net' will expire on Sun 06 Nov 2022 02:31:19 GMT +0000. [06:23:30] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.06, 1.60, 1.31 [06:23:44] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.09, 1.82, 1.34 [06:24:28] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.61, 3.46, 3.01 [06:25:44] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.66, 1.81, 1.40 [06:25:53] RECOVERY - thelonsdalebattalion.co.uk - LetsEncrypt on sslhost is OK: OK - Certificate 'thelonsdalebattalion.co.uk' will expire on Sun 06 Nov 2022 02:18:56 GMT +0000. [06:26:25] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.94, 3.32, 3.02 [06:27:44] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.74, 1.43, 1.31 [06:30:04] RECOVERY - intp.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [06:30:46] RECOVERY - tot.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'tot.wiki' will expire on Sat 05 Nov 2022 12:03:33 GMT +0000. [06:31:44] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 5.22, 4.11, 2.40 [06:31:47] RECOVERY - wiki.misslessfighters.club - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.misslessfighters.club' will expire on Sat 05 Nov 2022 12:35:39 GMT +0000. [06:32:03] RECOVERY - thepolicyhub.org.uk - LetsEncrypt on sslhost is OK: OK - Certificate 'thepolicyhub.org.uk' will expire on Sat 05 Nov 2022 02:12:45 GMT +0000. [06:33:59] PROBLEM - wiki.jeremyboyd.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:35:48] PROBLEM - storytime.jdstroy.cf - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:35:55] PROBLEM - spcodex.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:36:01] PROBLEM - wiki.globasa.net - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:36:12] PROBLEM - en.petrawiki.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:36:21] [02miraheze/dns] 07Universal-Omega pushed 031 commit to 03revert-347-revert-342-revert-341-paladox-patch-1 [+0/-0/±1] 13https://github.com/miraheze/dns/commit/128696832f07 [06:36:22] [02miraheze/dns] 07Universal-Omega 031286968 - Revert "Repool cp20/21 (#347)" [06:36:24] [02dns] 07Universal-Omega created branch 03revert-347-revert-342-revert-341-paladox-patch-1 - 13https://github.com/miraheze/dns [06:36:24] [url] Page not found · GitHub · GitHub | github.com [06:36:25] [02dns] 07Universal-Omega opened pull request 03#348: Revert "Repool cp20/21" - 13https://github.com/miraheze/dns/pull/348 [06:36:26] [url] Page not found · GitHub · GitHub | github.com [06:37:00] PROBLEM - www.electrowiki.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:37:12] PROBLEM - smafallfest.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:37:40] PROBLEM - fid.koyomi-ya.net - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:38:56] PROBLEM - patternarchive.online - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:39:22] PROBLEM - wiki.vinesh.eu.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:39:23] PROBLEM - wiki.triplescripts.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:39:32] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [06:39:44] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 0.63, 1.52, 1.78 [06:40:15] PROBLEM - ndg.nenawiki.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:40:38] PROBLEM - wikipariksha.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:41:44] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.45, 1.17, 1.62 [06:41:55] PROBLEM - en.wikiretet.ga - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:42:16] PROBLEM - wiki.bikinibottomdiscord.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:42:26] PROBLEM - wikipedia.yogfront.ooo - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:42:59] PROBLEM - commons.polandballwiki.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:43:13] PROBLEM - en.famepedia.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:44:40] PROBLEM - perpustaxaan.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:44:44] PROBLEM - electrowiki.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:44:48] PROBLEM - wiki.slimelab.net - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:45:23] PROBLEM - ao90.pinho.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:45:58] PROBLEM - iceria.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:45:59] PROBLEM - pwiki.arkcls.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:46:20] PROBLEM - mabi.myomi.net - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:46:35] PROBLEM - de.gyaanipedia.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:47:00] PROBLEM - sdiy.info - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:47:15] PROBLEM - wiki.fossbots.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:47:31] PROBLEM - az.wikiretet.ga - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:47:40] PROBLEM - swests.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:47:44] PROBLEM - files.petrawiki.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:48:47] RECOVERY - smashbros.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [06:49:29] PROBLEM - www.istpcomputing.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:50:05] PROBLEM - m.miraheze.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:51:15] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::4c25/cpweb [06:51:19] PROBLEM - eng.archiopedia.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:52:02] RECOVERY - m.miraheze.org - LetsEncrypt on sslhost is OK: OK - Certificate 'm.miraheze.org' will expire on Tue 22 Nov 2022 14:02:45 GMT +0000. [06:52:13] PROBLEM - wikifencing.ru - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:52:42] RECOVERY - www.opendatascot.org - LetsEncrypt on sslhost is OK: OK - Certificate 'opendatascot.org' will expire on Mon 14 Nov 2022 00:11:40 GMT +0000. [06:52:49] PROBLEM - zenith.nsmbu.net - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:53:37] PROBLEM - persist.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:53:49] PROBLEM - baharna.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:54:41] PROBLEM - www.mcpk.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:56:25] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.03, 1.87, 1.66 [06:57:40] PROBLEM - commons.gyaanipedia.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:58:14] PROBLEM - metroid.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:58:14] PROBLEM - crashspyro.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:58:21] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.47, 1.77, 1.65 [07:00:17] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.19, 1.59, 1.60 [07:01:07] PROBLEM - wiki.nevillepedia.eu - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:01:24] PROBLEM - inourownwords.online - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:02:36] PROBLEM - wiki.scpsharp.ga - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:02:37] PROBLEM - wiki.graalmilitary.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:04:00] PROBLEM - wiki.apico.buzz - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:04:38] RECOVERY - storytime.jdstroy.cf - LetsEncrypt on sslhost is OK: OK - Certificate 'storytime.jdstroy.cf' will expire on Thu 13 Oct 2022 04:22:47 GMT +0000. [07:05:31] RECOVERY - wiki.meeusen.net - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.meeusen.net' will expire on Fri 02 Dec 2022 11:18:06 GMT +0000. [07:05:32] RECOVERY - www.electrowiki.org - LetsEncrypt on sslhost is OK: OK - Certificate 'electrowiki.org' will expire on Wed 30 Nov 2022 18:47:02 GMT +0000. [07:06:10] RECOVERY - en.petrawiki.org - LetsEncrypt on sslhost is OK: OK - Certificate 'en.petrawiki.org' will expire on Fri 02 Dec 2022 14:48:33 GMT +0000. [07:06:35] RECOVERY - grk.archiopedia.org - LetsEncrypt on sslhost is OK: OK - Certificate 'grk.archiopedia.org' will expire on Thu 15 Dec 2022 04:53:56 GMT +0000. [07:06:57] RECOVERY - fid.koyomi-ya.net - LetsEncrypt on sslhost is OK: OK - Certificate 'fid.koyomi-ya.net' will expire on Fri 04 Nov 2022 15:58:35 GMT +0000. [07:07:18] RECOVERY - wiki.controlistes.fr - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.controlistes.fr' will expire on Thu 15 Dec 2022 04:42:43 GMT +0000. [07:07:28] RECOVERY - www.sdiy.info - LetsEncrypt on sslhost is OK: OK - Certificate 'sdiy.info' will expire on Fri 02 Dec 2022 10:24:01 GMT +0000. [07:07:59] RECOVERY - patternarchive.online - LetsEncrypt on sslhost is OK: OK - Certificate 'patternarchive.online' will expire on Wed 30 Nov 2022 18:14:49 GMT +0000. [07:08:30] RECOVERY - wiki.triplescripts.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.triplescripts.org' will expire on Sun 06 Nov 2022 04:20:23 GMT +0000. [07:08:47] RECOVERY - wiki.vinesh.eu.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.vinesh.eu.org' will expire on Fri 02 Dec 2022 08:52:56 GMT +0000. [07:08:51] PROBLEM - wildbowiki.net - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:09:04] RECOVERY - ndg.nenawiki.org - LetsEncrypt on sslhost is OK: OK - Certificate 'nenawiki.org' will expire on Sat 05 Nov 2022 00:44:07 GMT +0000. [07:09:27] PROBLEM - m.miraheze.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:09:52] RECOVERY - wikipariksha.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wikipariksha.com' will expire on Sun 06 Nov 2022 08:23:33 GMT +0000. [07:10:14] PROBLEM - rosettacode.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:10:18] RECOVERY - hoodwiki.xyz - LetsEncrypt on sslhost is OK: OK - Certificate 'hoodwiki.xyz' will expire on Wed 19 Oct 2022 06:37:38 GMT +0000. [07:10:34] RECOVERY - atnarsia.com - LetsEncrypt on sslhost is OK: OK - Certificate 'atnarsia.com' will expire on Thu 08 Dec 2022 20:09:51 GMT +0000. [07:10:48] RECOVERY - en.wikiretet.ga - LetsEncrypt on sslhost is OK: OK - Certificate 'en.wikiretet.ga' will expire on Thu 15 Dec 2022 04:48:34 GMT +0000. [07:11:24] RECOVERY - m.miraheze.org - LetsEncrypt on sslhost is OK: OK - Certificate 'm.miraheze.org' will expire on Tue 22 Nov 2022 14:02:45 GMT +0000. [07:11:55] RECOVERY - wikipedia.yogfront.ooo - LetsEncrypt on sslhost is OK: OK - Certificate 'wikipedia.yogfront.ooo' will expire on Fri 04 Nov 2022 21:18:18 GMT +0000. [07:12:02] RECOVERY - en.famepedia.org - LetsEncrypt on sslhost is OK: OK - Certificate 'en.famepedia.org' will expire on Mon 10 Oct 2022 05:45:28 GMT +0000. [07:12:09] RECOVERY - wiki.bikinibottomdiscord.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.bikinibottomdiscord.org' will expire on Fri 04 Nov 2022 20:46:48 GMT +0000. [07:12:11] RECOVERY - commons.polandballwiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'commons.polandballwiki.com' will expire on Mon 10 Oct 2022 05:30:54 GMT +0000. [07:13:40] RECOVERY - wiki.slimelab.net - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.slimelab.net' will expire on Wed 14 Dec 2022 15:53:00 GMT +0000. [07:14:15] RECOVERY - electrowiki.org - LetsEncrypt on sslhost is OK: OK - Certificate 'electrowiki.org' will expire on Wed 30 Nov 2022 18:47:02 GMT +0000. [07:14:29] RECOVERY - iceria.org - LetsEncrypt on sslhost is OK: OK - Certificate 'www.iceria.org' will expire on Fri 02 Dec 2022 13:28:19 GMT +0000. [07:14:30] RECOVERY - perpustaxaan.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'perpustaxaan.wiki' will expire on Tue 11 Oct 2022 04:34:44 GMT +0000. [07:14:36] RECOVERY - pwiki.arkcls.com - LetsEncrypt on sslhost is OK: OK - Certificate 'pwiki.arkcls.com' will expire on Sat 05 Nov 2022 07:46:31 GMT +0000. [07:14:52] RECOVERY - ao90.pinho.org - LetsEncrypt on sslhost is OK: OK - Certificate 'ao90.pinho.org' will expire on Sat 05 Nov 2022 00:40:26 GMT +0000. [07:15:19] RECOVERY - mabi.myomi.net - LetsEncrypt on sslhost is OK: OK - Certificate 'mabi.myomi.net' will expire on Sat 05 Nov 2022 12:53:43 GMT +0000. [07:15:29] RECOVERY - worldsanskrit.net - LetsEncrypt on sslhost is OK: OK - Certificate 'worldsanskrit.net' will expire on Wed 07 Dec 2022 12:44:39 GMT +0000. [07:16:03] RECOVERY - az.wikiretet.ga - LetsEncrypt on sslhost is OK: OK - Certificate 'az.wikiretet.ga' will expire on Tue 11 Oct 2022 04:40:37 GMT +0000. [07:16:04] RECOVERY - de.gyaanipedia.com - LetsEncrypt on sslhost is OK: OK - Certificate 'de.gyaanipedia.com' will expire on Mon 21 Nov 2022 05:46:41 GMT +0000. [07:16:47] RECOVERY - sdiy.info - LetsEncrypt on sslhost is OK: OK - Certificate 'sdiy.info' will expire on Fri 02 Dec 2022 10:24:01 GMT +0000. [07:16:47] PROBLEM - privacywiki.xyz - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:17:09] RECOVERY - files.petrawiki.org - LetsEncrypt on sslhost is OK: OK - Certificate 'files.petrawiki.org' will expire on Fri 02 Dec 2022 14:49:49 GMT +0000. [07:17:12] RECOVERY - swests.org - LetsEncrypt on sslhost is OK: OK - Certificate 'swests.org' will expire on Thu 20 Oct 2022 03:33:41 GMT +0000. [07:17:46] RECOVERY - ngsswiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'ngsswiki.com' will expire on Thu 15 Dec 2022 04:57:37 GMT +0000. [07:18:55] RECOVERY - www.istpcomputing.com - LetsEncrypt on sslhost is OK: OK - Certificate 'istpcomputing.com' will expire on Tue 11 Oct 2022 04:37:06 GMT +0000. [07:21:01] RECOVERY - wikifencing.ru - LetsEncrypt on sslhost is OK: OK - Certificate 'wikifencing.ru' will expire on Sat 19 Nov 2022 20:12:29 GMT +0000. [07:21:09] RECOVERY - eng.archiopedia.org - LetsEncrypt on sslhost is OK: OK - Certificate 'eng.archiopedia.org' will expire on Thu 15 Dec 2022 05:01:33 GMT +0000. [07:22:16] RECOVERY - persist.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'persist.wiki' will expire on Mon 10 Oct 2022 04:01:57 GMT +0000. [07:22:18] RECOVERY - zenith.nsmbu.net - LetsEncrypt on sslhost is OK: OK - Certificate 'zenith.nsmbu.net' will expire on Mon 10 Oct 2022 05:53:48 GMT +0000. [07:22:39] RECOVERY - baharna.org - LetsEncrypt on sslhost is OK: OK - Certificate 'www.baharna.org' will expire on Fri 02 Dec 2022 06:38:50 GMT +0000. [07:24:29] RECOVERY - www.mcpk.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'www.mcpk.wiki' will expire on Wed 30 Nov 2022 18:05:08 GMT +0000. [07:25:54] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.66, 3.72, 2.67 [07:26:56] PROBLEM - kiseki.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:26:59] RECOVERY - commons.gyaanipedia.com - LetsEncrypt on sslhost is OK: OK - Certificate 'commons.gyaanipedia.com' will expire on Mon 21 Nov 2022 06:24:36 GMT +0000. [07:27:51] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.11, 3.08, 2.55 [07:28:03] RECOVERY - crashspyro.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [07:28:39] PROBLEM - wiki.worldbuilding.network - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:28:43] PROBLEM - wiki.erag.eu.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:29:27] PROBLEM - m.miraheze.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:29:28] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 1.26, 1.57, 1.97 [07:29:49] RECOVERY - wiki.nevillepedia.eu - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.nevillepedia.eu' will expire on Sun 06 Nov 2022 04:20:38 GMT +0000. [07:30:17] PROBLEM - croc.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:31:09] PROBLEM - biblestrength.net - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:31:10] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [07:31:43] PROBLEM - wiki.mikrodev.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:31:44] PROBLEM - intp.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:32:17] RECOVERY - wiki.graalmilitary.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.graalmilitary.com' will expire on Sat 05 Nov 2022 05:43:24 GMT +0000. [07:32:26] RECOVERY - wiki.jeremyboyd.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.jeremyboyd.org' will expire on Tue 25 Oct 2022 07:00:25 GMT +0000. [07:32:27] PROBLEM - www.bluepageswiki.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:32:28] PROBLEM - www.arru.xyz - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:32:30] PROBLEM - www.dovearchives.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:32:33] RECOVERY - wiki.apico.buzz - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.apico.buzz' will expire on Sun 13 Nov 2022 23:50:45 GMT +0000. [07:32:34] RECOVERY - wiki.scpsharp.ga - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.scpsharp.ga' will expire on Sun 13 Nov 2022 20:09:37 GMT +0000. [07:32:39] PROBLEM - civclassic.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:32:52] PROBLEM - wiki.cryptoroyale.one - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:32:56] [02dns] 07paladox closed pull request 03#348: Revert "Repool cp20/21" - 13https://github.com/miraheze/dns/pull/348 [07:32:57] [url] Page not found · GitHub · GitHub | github.com [07:32:58] [02miraheze/dns] 07paladox deleted branch 03revert-347-revert-342-revert-341-paladox-patch-1 [07:32:59] [02dns] 07paladox deleted branch 03revert-347-revert-342-revert-341-paladox-patch-1 - 13https://github.com/miraheze/dns [07:33:00] [url] Page not found · GitHub · GitHub | github.com [07:33:01] [02miraheze/dns] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/dns/compare/7908c79d0839...cb8d572e7f57 [07:33:02] [url] Comparing 7908c79d0839...cb8d572e7f57 · miraheze/dns · GitHub | github.com [07:33:03] [02miraheze/dns] 07Universal-Omega 03cb8d572 - Revert "Repool cp20/21" (#348) [07:33:21] PROBLEM - wiki.misslessfighters.club - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:33:22] PROBLEM - pokemon2.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:33:31] RECOVERY - m.miraheze.org - LetsEncrypt on sslhost is OK: OK - Certificate 'm.miraheze.org' will expire on Tue 22 Nov 2022 14:02:45 GMT +0000. [07:33:42] PROBLEM - wiki.ultravanilla.world - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:34:29] PROBLEM - wiki.erisly.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:34:35] PROBLEM - wiki.aridia.space - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:35:28] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 1.06, 1.23, 1.68 [07:35:33] PROBLEM - wiki.warframestat.us - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:35:38] PROBLEM - mw141 MediaWiki Rendering on mw141 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:35:39] PROBLEM - hi.gyaanipedia.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:35:41] PROBLEM - roblox-wiki.tk - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - roblox-wiki.tk All nameservers failed to answer the query. [07:36:05] RECOVERY - smafallfest.org - LetsEncrypt on sslhost is OK: OK - Certificate 'smafallfest.org' will expire on Wed 26 Oct 2022 18:44:23 GMT +0000. [07:36:06] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 16.70, 10.67, 5.82 [07:36:07] PROBLEM - wiki.rebirthofthenight.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:36:10] RECOVERY - wiki.globasa.net - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.globasa.net' will expire on Mon 10 Oct 2022 05:36:34 GMT +0000. [07:36:48] PROBLEM - wiki.consid.vn - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:37:08] PROBLEM - nottingham.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:37:32] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 3.86, 5.48, 3.81 [07:37:34] RECOVERY - mw141 MediaWiki Rendering on mw141 is OK: HTTP OK: HTTP/1.1 200 OK - 29512 bytes in 0.233 second response time [07:37:40] PROBLEM - wiki.meeusen.net - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:37:51] RECOVERY - wildbowiki.net - LetsEncrypt on sslhost is OK: OK - Certificate 'wildbowiki.net' will expire on Sat 19 Nov 2022 20:19:51 GMT +0000. [07:38:51] PROBLEM - history.sdtef.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:39:27] PROBLEM - wiki.hylormc.tk - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:39:28] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 18.50, 14.45, 8.99 [07:39:32] PROBLEM - you.r-fit.cc - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:39:42] RECOVERY - rosettacode.org - LetsEncrypt on sslhost is OK: OK - Certificate 'rosettacode.org' will expire on Tue 22 Nov 2022 18:48:13 GMT +0000. [07:39:43] PROBLEM - www.permanentfuturelab.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:40:06] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 1.29, 5.39, 4.74 [07:40:27] PROBLEM - wiki.yermocapital.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:40:40] PROBLEM - cyberlaw.ccdcoe.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:41:18] PROBLEM - wiki.ricochetuniverse.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:41:26] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.54, 3.23, 3.25 [07:41:27] PROBLEM - www.zenbuddhism.info - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:41:48] PROBLEM - correypedia.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:42:06] RECOVERY - gluster102 Current Load on gluster102 is OK: OK - load average: 1.34, 4.01, 4.31 [07:42:15] PROBLEM - wiki.harlonserver.net - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:42:34] PROBLEM - grk.repository.archiopedia.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:42:57] PROBLEM - atnarsia.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:43:10] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::4c25/cpweb [07:43:14] PROBLEM - en.famepedia.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:43:48] PROBLEM - wiki.infomedia.co.uk - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:44:34] PROBLEM - www.baharna.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:45:25] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 4.56, 10.71, 9.61 [07:45:50] PROBLEM - test1.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:46:35] PROBLEM - runzeppelin.ru - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:46:44] RECOVERY - privacywiki.xyz - LetsEncrypt on sslhost is OK: OK - Certificate 'privacywiki.xyz' will expire on Fri 09 Dec 2022 12:54:53 GMT +0000. [07:47:24] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 3.66, 8.30, 8.85 [07:55:12] PROBLEM - cp20 APT on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [07:56:02] RECOVERY - metroid.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [07:56:49] RECOVERY - kiseki.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'kiseki.wiki' will expire on Sun 06 Nov 2022 05:35:14 GMT +0000. [07:58:00] RECOVERY - wiki.erag.eu.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.erag.eu.org' will expire on Tue 29 Nov 2022 22:51:50 GMT +0000. [07:58:32] RECOVERY - wiki.worldbuilding.network - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.worldbuilding.network' will expire on Mon 10 Oct 2022 05:23:51 GMT +0000. [07:58:33] PROBLEM - cp21 Stunnel HTTP for mon141 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [07:59:35] RECOVERY - inourownwords.online - LetsEncrypt on sslhost is OK: OK - Certificate 'inourownwords.online' will expire on Tue 15 Nov 2022 12:04:52 GMT +0000. [07:59:53] RECOVERY - biblestrength.net - LetsEncrypt on sslhost is OK: OK - Certificate 'biblestrength.net' will expire on Sun 20 Nov 2022 17:39:25 GMT +0000. [08:00:03] RECOVERY - croc.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [08:00:07] RECOVERY - cp20 APT on cp20 is OK: APT OK: 38 packages available for upgrade (0 critical updates). [08:00:57] RECOVERY - wiki.mikrodev.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.mikrodev.com' will expire on Sat 05 Nov 2022 09:04:57 GMT +0000. [08:01:01] RECOVERY - www.arru.xyz - LetsEncrypt on sslhost is OK: OK - Certificate 'www.arru.xyz' will expire on Fri 02 Dec 2022 04:06:06 GMT +0000. [08:01:02] RECOVERY - www.dovearchives.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'www.dovearchives.wiki' will expire on Fri 18 Nov 2022 13:45:57 GMT +0000. [08:01:21] RECOVERY - intp.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [08:01:22] RECOVERY - civclassic.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [08:02:23] RECOVERY - www.bluepageswiki.org - LetsEncrypt on sslhost is OK: OK - Certificate 'www.bluepageswiki.org' will expire on Fri 02 Dec 2022 09:10:23 GMT +0000. [08:02:28] RECOVERY - wiki.cryptoroyale.one - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.cryptoroyale.one' will expire on Wed 07 Dec 2022 13:49:01 GMT +0000. [08:02:49] RECOVERY - pokemon2.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [08:02:53] RECOVERY - wiki.misslessfighters.club - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.misslessfighters.club' will expire on Sat 05 Nov 2022 12:35:39 GMT +0000. [08:03:09] RECOVERY - wiki.aridia.space - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.aridia.space' will expire on Wed 07 Dec 2022 12:57:30 GMT +0000. [08:03:29] RECOVERY - spcodex.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'spcodex.wiki' will expire on Sun 06 Nov 2022 03:38:01 GMT +0000. [08:03:31] RECOVERY - wiki.erisly.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.erisly.com' will expire on Sun 13 Nov 2022 20:41:38 GMT +0000. [08:03:36] RECOVERY - wiki.ultravanilla.world - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.ultravanilla.world' will expire on Tue 22 Nov 2022 18:50:34 GMT +0000. [08:04:52] RECOVERY - roblox-wiki.tk - reverse DNS on sslhost is OK: SSL OK - roblox-wiki.tk reverse DNS resolves to cp30.miraheze.org - NS RECORDS OK [08:04:59] RECOVERY - wiki.warframestat.us - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.warframestat.us' will expire on Sun 06 Nov 2022 01:10:22 GMT +0000. [08:05:10] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [08:05:26] RECOVERY - wiki.rebirthofthenight.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.rebirthofthenight.com' will expire on Sun 06 Nov 2022 01:58:55 GMT +0000. [08:05:28] RECOVERY - hi.gyaanipedia.com - LetsEncrypt on sslhost is OK: OK - Certificate 'hi.gyaanipedia.com' will expire on Mon 21 Nov 2022 06:19:31 GMT +0000. [08:05:30] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.21, 1.82, 1.30 [08:05:44] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.85, 1.70, 1.32 [08:05:53] RECOVERY - nottingham.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'nottingham.wiki' will expire on Fri 09 Dec 2022 05:32:19 GMT +0000. [08:06:07] RECOVERY - cp21 Stunnel HTTP for mon141 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 36260 bytes in 3.069 second response time [08:06:21] RECOVERY - wiki.consid.vn - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.consid.vn' will expire on Fri 04 Nov 2022 22:27:36 GMT +0000. [08:06:55] RECOVERY - wiki.meeusen.net - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.meeusen.net' will expire on Fri 02 Dec 2022 11:18:06 GMT +0000. [08:07:44] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.08, 1.48, 1.28 [08:08:02] RECOVERY - wiki.hylormc.tk - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.hylormc.tk' will expire on Thu 17 Nov 2022 21:52:31 GMT +0000. [08:08:16] RECOVERY - history.sdtef.org - LetsEncrypt on sslhost is OK: OK - Certificate 'history.sdtef.org' will expire on Sat 05 Nov 2022 01:45:23 GMT +0000. [08:09:22] PROBLEM - you.r-fit.cc - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'you.r-fit.cc' expires in 15 day(s) (Sat 01 Oct 2022 16:22:56 GMT +0000). [08:09:30] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.52, 1.85, 1.43 [08:09:32] RECOVERY - www.permanentfuturelab.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'permanentfuturelab.wiki' will expire on Fri 04 Nov 2022 23:37:17 GMT +0000. [08:09:42] RECOVERY - wiki.yermocapital.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.yermocapital.com' will expire on Sat 19 Nov 2022 15:53:54 GMT +0000. [08:09:59] RECOVERY - www.zenbuddhism.info - LetsEncrypt on sslhost is OK: OK - Certificate 'www.zenbuddhism.info' will expire on Fri 02 Dec 2022 12:14:59 GMT +0000. [08:10:03] RECOVERY - cyberlaw.ccdcoe.org - LetsEncrypt on sslhost is OK: OK - Certificate 'cyberlaw.ccdcoe.org' will expire on Sat 05 Nov 2022 02:20:26 GMT +0000. [08:10:40] RECOVERY - correypedia.org - LetsEncrypt on sslhost is OK: OK - Certificate 'correypedia.org' will expire on Sun 13 Nov 2022 23:56:35 GMT +0000. [08:10:59] RECOVERY - wiki.ricochetuniverse.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.ricochetuniverse.com' will expire on Fri 04 Nov 2022 23:35:55 GMT +0000. [08:11:30] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 1.60, 2.01, 1.56 [08:11:31] RECOVERY - atnarsia.com - LetsEncrypt on sslhost is OK: OK - Certificate 'atnarsia.com' will expire on Thu 08 Dec 2022 20:09:51 GMT +0000. [08:11:43] RECOVERY - grk.repository.archiopedia.org - LetsEncrypt on sslhost is OK: OK - Certificate 'grk.repository.archiopedia.org' will expire on Fri 02 Dec 2022 09:19:06 GMT +0000. [08:12:03] RECOVERY - en.famepedia.org - LetsEncrypt on sslhost is OK: OK - Certificate 'en.famepedia.org' will expire on Mon 10 Oct 2022 05:45:28 GMT +0000. [08:12:11] RECOVERY - wiki.harlonserver.net - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.harlonserver.net' will expire on Sun 06 Nov 2022 16:13:37 GMT +0000. [08:13:41] RECOVERY - wiki.infomedia.co.uk - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.infomedia.co.uk' will expire on Fri 21 Oct 2022 15:33:32 GMT +0000. [08:13:44] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.44, 1.97, 1.54 [08:13:51] RECOVERY - www.baharna.org - LetsEncrypt on sslhost is OK: OK - Certificate 'www.baharna.org' will expire on Fri 02 Dec 2022 06:38:50 GMT +0000. [08:15:06] RECOVERY - test1.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [08:15:30] RECOVERY - runzeppelin.ru - LetsEncrypt on sslhost is OK: OK - Certificate 'runzeppelin.ru' will expire on Sun 06 Nov 2022 04:33:14 GMT +0000. [08:15:30] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.15, 1.68, 1.54 [08:15:44] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.86, 1.88, 1.56 [08:16:03] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/a12dc8504700...070c8567972e [08:16:04] [url] Comparing a12dc8504700...070c8567972e · miraheze/ssl · GitHub | github.com [08:16:05] [02miraheze/ssl] 07MirahezeSSLBot 03070c856 - Bot: Update SSL cert for you.r-fit.cc [08:16:54] RECOVERY - wiki.fossbots.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.fossbots.org' will expire on Sun 16 Oct 2022 13:11:42 GMT +0000. [08:17:10] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::4c25/cpweb [08:17:44] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.13, 1.88, 1.59 [08:19:44] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.58, 1.80, 1.60 [08:21:44] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.25, 1.97, 1.69 [08:23:44] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.95, 1.97, 1.72 [08:25:44] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 1.90, 2.07, 1.79 [08:27:44] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.16, 1.71, 1.70 [08:29:44] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.08, 1.55, 1.64 [08:29:56] PROBLEM - test131 Current Load on test131 is CRITICAL: CRITICAL - load average: 2.17, 1.90, 1.60 [08:31:54] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 1.82, 1.84, 1.61 [08:34:32] PROBLEM - cp21 Stunnel HTTP for mon141 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [08:35:50] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 1.46, 1.70, 1.61 [08:37:03] RECOVERY - cp21 Stunnel HTTP for mon141 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 36275 bytes in 0.042 second response time [08:37:30] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.11, 1.84, 1.58 [08:37:44] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.39, 1.72, 1.69 [08:39:22] RECOVERY - you.r-fit.cc - LetsEncrypt on sslhost is OK: OK - Certificate 'you.r-fit.cc' will expire on Thu 15 Dec 2022 07:15:58 GMT +0000. [08:39:30] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.20, 1.57, 1.51 [08:39:44] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 4.34, 2.42, 1.94 [08:43:30] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.52, 1.93, 1.71 [08:47:30] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.77, 1.89, 1.71 [08:47:44] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.29, 1.83, 1.86 [08:50:06] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 12.31, 5.41, 3.33 [08:51:22] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 10.86, 6.70, 4.16 [08:51:44] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.18, 1.89, 1.86 [08:53:30] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.39, 1.87, 1.78 [08:54:06] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 2.84, 5.87, 4.24 [08:55:30] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.54, 1.97, 1.82 [08:56:06] RECOVERY - gluster102 Current Load on gluster102 is OK: OK - load average: 1.43, 4.24, 3.84 [08:57:13] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 1.32, 3.25, 3.43 [08:59:09] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.34, 2.61, 3.17 [08:59:10] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [09:01:30] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.41, 1.95, 1.91 [09:07:30] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.05, 1.38, 1.67 [09:10:03] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::4c25/cpweb [09:11:30] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.61, 1.74, 1.80 [09:11:44] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 0.77, 1.39, 1.99 [09:13:30] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.79, 1.94, 1.86 [09:13:44] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 7.49, 3.04, 2.49 [09:23:30] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.38, 1.85, 1.85 [09:25:21] PROBLEM - cp21 Stunnel HTTP for mon141 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [09:27:20] RECOVERY - cp21 Stunnel HTTP for mon141 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 36275 bytes in 0.051 second response time [09:31:30] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.51, 1.46, 1.66 [09:31:35] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.73, 3.86, 3.15 [09:35:28] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.51, 3.63, 3.26 [09:35:30] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.76, 1.87, 1.77 [09:37:25] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 6.48, 5.02, 3.82 [09:37:30] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.94, 1.79, 1.75 [09:38:48] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 5.43, 5.71, 4.26 [09:41:30] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.98, 1.38, 1.60 [09:42:36] RECOVERY - gluster102 Current Load on gluster102 is OK: OK - load average: 1.51, 3.93, 3.92 [09:43:16] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.24, 3.68, 3.68 [09:45:13] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 3.65, 4.60, 4.07 [09:45:30] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.87, 1.68, 1.67 [09:47:30] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.13, 1.91, 1.75 [09:49:06] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.08, 3.64, 3.82 [09:51:14] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [09:53:03] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.31, 2.30, 3.21 [09:55:30] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.08, 1.84, 1.88 [09:57:30] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.84, 2.65, 2.20 [10:03:10] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::4c25/cpweb [10:09:45] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 27.18, 16.42, 9.75 [10:13:30] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.50, 1.50, 1.96 [10:13:45] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 6.16, 10.71, 8.93 [10:15:10] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [10:15:45] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.23, 9.35, 8.63 [10:16:05] PROBLEM - cp21 Stunnel HTTP for mon141 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [10:17:44] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.62, 1.52, 2.00 [10:18:09] RECOVERY - cp21 Stunnel HTTP for mon141 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 36267 bytes in 0.046 second response time [10:19:10] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::4c25/cpweb [10:21:44] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.06, 1.64, 1.93 [10:27:30] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.24, 1.43, 1.70 [10:28:17] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 1.67, 1.71, 1.59 [10:28:58] PROBLEM - cp21 Stunnel HTTP for mon141 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [10:30:15] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 1.39, 1.58, 1.56 [10:31:01] RECOVERY - cp21 Stunnel HTTP for mon141 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 36275 bytes in 0.045 second response time [10:32:34] PROBLEM - wiki.dunmoore.net - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.dunmoore.net' expires in 15 day(s) (Sun 02 Oct 2022 10:05:42 GMT +0000). [10:34:20] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/070c8567972e...72cfbc4b5b1f [10:34:21] [url] Comparing 070c8567972e...72cfbc4b5b1f · miraheze/ssl · GitHub | github.com [10:34:22] [02miraheze/ssl] 07MirahezeSSLBot 0372cfbc4 - Bot: Update SSL cert for wiki.dunmoore.net [10:37:41] PROBLEM - cp21 Stunnel HTTP for mon141 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [10:40:08] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.39, 2.35, 1.97 [10:41:01] PROBLEM - www.winenjoy.net - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'www.winenjoy.net' expires in 15 day(s) (Sun 02 Oct 2022 10:20:46 GMT +0000). [10:42:02] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 0.90, 1.78, 1.80 [10:43:13] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/72cfbc4b5b1f...38e94c5bbb5b [10:43:13] [url] Comparing 72cfbc4b5b1f...38e94c5bbb5b · miraheze/ssl · GitHub | github.com [10:43:14] [02miraheze/ssl] 07MirahezeSSLBot 0338e94c5 - Bot: Update SSL cert for www.winenjoy.net [10:43:57] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.28, 1.93, 1.85 [10:45:10] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [10:45:46] RECOVERY - cp21 Stunnel HTTP for mon141 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 36275 bytes in 7.323 second response time [10:45:51] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 0.92, 1.53, 1.71 [10:46:57] PROBLEM - pt.graalmilitary.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'pt.graalmilitary.com' expires in 15 day(s) (Sun 02 Oct 2022 10:22:40 GMT +0000). [10:47:45] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.24, 1.46, 1.66 [10:48:45] PROBLEM - pwsc.polandballwiki.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'pwsc.polandballwiki.com' expires in 15 day(s) (Sun 02 Oct 2022 10:41:20 GMT +0000). [10:50:07] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/38e94c5bbb5b...c032562ad325 [10:50:08] [url] Comparing 38e94c5bbb5b...c032562ad325 · miraheze/ssl · GitHub | github.com [10:50:09] [02miraheze/ssl] 07MirahezeSSLBot 03c032562 - Bot: Update SSL cert for pt.graalmilitary.com [10:51:10] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::4c25/cpweb [10:55:44] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/c032562ad325...b6c01ddca392 [10:55:45] [url] Comparing c032562ad325...b6c01ddca392 · miraheze/ssl · GitHub | github.com [10:55:45] [02miraheze/ssl] 07MirahezeSSLBot 03b6c01dd - Bot: Update SSL cert for pwsc.polandballwiki.com [11:00:42] PROBLEM - staff.polandballwiki.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'staff.polandballwiki.com' expires in 15 day(s) (Sun 02 Oct 2022 10:43:17 GMT +0000). [11:01:38] RECOVERY - wiki.dunmoore.net - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.dunmoore.net' will expire on Thu 15 Dec 2022 09:34:14 GMT +0000. [11:01:44] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.03, 1.49, 1.90 [11:06:08] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/b6c01ddca392...536df1e839d1 [11:06:08] [url] Comparing b6c01ddca392...536df1e839d1 · miraheze/ssl · GitHub | github.com [11:06:09] [02miraheze/ssl] 07MirahezeSSLBot 03536df1e - Bot: Update SSL cert for staff.polandballwiki.com [11:06:33] PROBLEM - wiki.simorgh.me - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.simorgh.me' expires in 15 day(s) (Sun 02 Oct 2022 10:55:38 GMT +0000). [11:09:44] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.94, 1.31, 1.66 [11:11:04] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/536df1e839d1...357cbe1c76c8 [11:11:04] [url] Comparing 536df1e839d1...357cbe1c76c8 · miraheze/ssl · GitHub | github.com [11:11:05] [02miraheze/ssl] 07MirahezeSSLBot 03357cbe1 - Bot: Update SSL cert for wiki.simorgh.me [11:13:44] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.58, 1.98, 1.84 [11:14:30] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.91, 1.56, 1.46 [11:15:44] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.61, 1.91, 1.84 [11:16:25] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.12, 1.74, 1.53 [11:17:50] PROBLEM - wiki.ct777.cf - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.ct777.cf' expires in 15 day(s) (Sun 02 Oct 2022 10:59:59 GMT +0000). [11:18:10] PROBLEM - wiki.umbranet.mandelbrotgames.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.umbranet.mandelbrotgames.com' expires in 15 day(s) (Sun 02 Oct 2022 11:07:49 GMT +0000). [11:18:35] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/357cbe1c76c8...2629dbdccd6a [11:18:35] [url] Comparing 357cbe1c76c8...2629dbdccd6a · miraheze/ssl · GitHub | github.com [11:18:36] [02miraheze/ssl] 07MirahezeSSLBot 032629dbd - Bot: Update SSL cert for wiki.ct777.cf [11:19:32] PROBLEM - cp21 Stunnel HTTP for mon141 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [11:20:14] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.77, 1.71, 1.56 [11:21:44] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 3.42, 2.45, 2.04 [11:21:58] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/2629dbdccd6a...92bc8c7937dc [11:21:58] [url] Comparing 2629dbdccd6a...92bc8c7937dc · miraheze/ssl · GitHub | github.com [11:21:59] [02miraheze/ssl] 07MirahezeSSLBot 0392bc8c7 - Bot: Update SSL cert for wiki.umbranet.mandelbrotgames.com [11:22:08] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 3.45, 2.26, 1.77 [11:23:03] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.73, 3.61, 3.06 [11:24:02] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.34, 1.89, 1.69 [11:25:03] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.40, 2.86, 2.85 [11:26:57] RECOVERY - cp21 Stunnel HTTP for mon141 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 36275 bytes in 0.043 second response time [11:27:51] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.26, 1.56, 1.60 [11:30:25] RECOVERY - staff.polandballwiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'staff.polandballwiki.com' will expire on Thu 15 Dec 2022 10:06:02 GMT +0000. [11:31:40] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.59, 2.24, 1.87 [11:35:06] RECOVERY - wiki.simorgh.me - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.simorgh.me' will expire on Thu 15 Dec 2022 10:10:58 GMT +0000. [11:37:10] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [11:37:54] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.47, 3.18, 2.91 [11:39:01] RECOVERY - www.winenjoy.net - LetsEncrypt on sslhost is OK: OK - Certificate 'www.winenjoy.net' will expire on Thu 15 Dec 2022 09:43:06 GMT +0000. [11:41:47] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.55, 3.87, 3.25 [11:43:44] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.93, 3.44, 3.17 [11:45:10] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::4c25/cpweb [11:45:41] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 7.63, 4.85, 3.70 [11:46:25] RECOVERY - pt.graalmilitary.com - LetsEncrypt on sslhost is OK: OK - Certificate 'pt.graalmilitary.com' will expire on Thu 15 Dec 2022 09:50:01 GMT +0000. [11:47:09] RECOVERY - wiki.ct777.cf - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.ct777.cf' will expire on Thu 15 Dec 2022 10:18:30 GMT +0000. [11:48:06] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 6.36, 5.52, 4.29 [11:48:33] RECOVERY - pwsc.polandballwiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'pwsc.polandballwiki.com' will expire on Thu 15 Dec 2022 09:55:38 GMT +0000. [11:50:06] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 5.15, 5.57, 4.47 [11:54:06] RECOVERY - gluster102 Current Load on gluster102 is OK: OK - load average: 4.35, 5.05, 4.55 [11:57:58] PROBLEM - test131 Current Load on test131 is CRITICAL: CRITICAL - load average: 2.45, 1.80, 1.51 [11:59:56] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 1.79, 1.81, 1.55 [12:03:52] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 1.38, 1.70, 1.57 [12:05:10] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 1.35, 2.98, 3.86 [12:06:20] PROBLEM - cp21 Stunnel HTTP for mon141 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [12:08:42] RECOVERY - cp21 Stunnel HTTP for mon141 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 36267 bytes in 7.259 second response time [12:09:03] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.10, 2.33, 3.38 [12:11:44] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.36, 1.68, 2.00 [12:15:22] PROBLEM - cp21 Stunnel HTTP for mon141 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:16:19] RECOVERY - wiki.umbranet.mandelbrotgames.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.umbranet.mandelbrotgames.com' will expire on Thu 15 Dec 2022 10:21:53 GMT +0000. [12:17:39] RECOVERY - cp21 Stunnel HTTP for mon141 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 36275 bytes in 2.082 second response time [12:17:44] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.01, 1.85, 1.96 [12:21:03] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.70, 3.43, 3.45 [12:23:03] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 3.17, 3.18, 3.34 [12:27:03] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.57, 3.65, 3.51 [12:27:30] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.45, 1.70, 2.00 [12:27:44] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.24, 1.80, 1.98 [12:29:10] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [12:31:22] PROBLEM - roblox-wiki.tk - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - roblox-wiki.tk All nameservers failed to answer the query. [12:31:31] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.09, 1.84, 1.98 [12:33:03] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.72, 4.08, 3.71 [12:33:31] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.40, 1.75, 1.94 [12:33:44] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.38, 1.85, 1.92 [12:35:10] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::4c25/cpweb [12:35:31] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 3.16, 2.51, 2.22 [12:35:44] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.13, 1.55, 1.80 [12:39:44] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 4.50, 2.23, 1.96 [12:41:56] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.93, 10.51, 9.36 [12:43:53] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.68, 9.93, 9.29 [12:45:03] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.93, 3.86, 3.93 [12:47:56] PROBLEM - cp20 APT on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [12:49:57] RECOVERY - cp20 APT on cp20 is OK: APT OK: 38 packages available for upgrade (0 critical updates). [12:54:21] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 10.35, 6.18, 4.61 [12:55:03] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 6.61, 4.93, 4.23 [13:00:33] RECOVERY - roblox-wiki.tk - reverse DNS on sslhost is OK: SSL OK - roblox-wiki.tk reverse DNS resolves to cp31.miraheze.org - NS RECORDS OK [13:02:06] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 4.12, 5.27, 4.97 [13:04:06] RECOVERY - gluster102 Current Load on gluster102 is OK: OK - load average: 2.32, 4.32, 4.66 [13:05:03] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 1.79, 2.96, 3.73 [13:11:03] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.93, 2.39, 3.21 [13:21:10] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [13:21:50] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.16, 3.45, 3.44 [13:27:41] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.18, 3.20, 3.38 [13:28:28] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 1.93, 1.66, 1.43 [13:29:10] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 3 datacenters are down: 2001:41d0:801:2000::4c25/cpweb, 149.56.141.75/cpweb, 2607:5300:201:3100::5ebc/cpweb [13:30:26] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 1.38, 1.57, 1.43 [13:31:32] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.01, 3.90, 3.64 [13:32:06] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 6.28, 6.20, 4.70 [13:38:43] PROBLEM - cp21 Stunnel HTTP for mon141 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:40:50] RECOVERY - cp21 Stunnel HTTP for mon141 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 36229 bytes in 5.099 second response time [13:46:06] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 3.30, 5.09, 5.45 [13:48:06] RECOVERY - gluster102 Current Load on gluster102 is OK: OK - load average: 1.70, 4.04, 5.03 [13:48:11] PROBLEM - cp20 APT on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [13:50:09] RECOVERY - cp20 APT on cp20 is OK: APT OK: 38 packages available for upgrade (0 critical updates). [13:57:03] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.69, 3.17, 3.97 [14:05:03] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.01, 3.17, 3.56 [14:09:11] PROBLEM - cp21 Stunnel HTTP for mon141 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [14:10:06] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 6.33, 7.31, 5.52 [14:11:18] RECOVERY - cp21 Stunnel HTTP for mon141 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 36267 bytes in 7.331 second response time [14:12:06] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 3.38, 5.96, 5.25 [14:13:10] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [14:16:06] RECOVERY - gluster102 Current Load on gluster102 is OK: OK - load average: 3.01, 4.84, 4.99 [14:21:10] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::4c25/cpweb [14:24:06] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 6.74, 6.27, 5.52 [14:24:08] PROBLEM - cp21 Stunnel HTTP for mon141 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [14:26:06] RECOVERY - gluster102 Current Load on gluster102 is OK: OK - load average: 2.53, 4.80, 5.07 [14:29:06] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.50, 10.52, 9.82 [14:31:03] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.10, 10.70, 9.94 [14:31:47] RECOVERY - cp21 Stunnel HTTP for mon141 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 36275 bytes in 0.044 second response time [14:33:00] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 9.05, 9.93, 9.75 [14:37:49] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.07, 10.47, 9.50 [14:39:48] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.72, 9.76, 9.35 [14:45:18] PROBLEM - cp21 Stunnel HTTP for mon141 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [14:47:49] RECOVERY - cp21 Stunnel HTTP for mon141 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 36275 bytes in 0.049 second response time [14:52:28] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.21, 10.24, 9.69 [14:54:25] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 6.34, 8.81, 9.24 [15:05:10] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [15:06:06] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 5.53, 5.35, 4.43 [15:08:06] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 9.74, 6.88, 5.07 [15:10:27] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.09, 10.99, 9.99 [15:12:06] RECOVERY - gluster102 Current Load on gluster102 is OK: OK - load average: 1.81, 4.72, 4.66 [15:12:26] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.25, 9.78, 9.68 [15:16:45] PROBLEM - cp21 Stunnel HTTP for mon141 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [15:18:03] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 2 datacenters are down: 2001:41d0:801:2000::4c25/cpweb, 2001:41d0:801:2000::1b80/cpweb [15:22:12] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 5.53, 6.33, 5.43 [15:23:06] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 1.32, 3.21, 3.97 [15:23:29] PROBLEM - mw142 Current Load on mw142 is CRITICAL: CRITICAL - load average: 23.88, 15.92, 9.80 [15:23:41] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 58.29, 29.27, 16.86 [15:23:52] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 26.92, 19.15, 12.88 [15:24:06] RECOVERY - gluster102 Current Load on gluster102 is OK: OK - load average: 2.67, 4.76, 4.95 [15:24:09] PROBLEM - mw132 Current Load on mw132 is CRITICAL: CRITICAL - load average: 20.94, 19.05, 10.92 [15:24:25] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.59, 3.02, 2.32 [15:24:35] PROBLEM - mw131 Current Load on mw131 is CRITICAL: CRITICAL - load average: 23.98, 22.76, 13.39 [15:24:40] RECOVERY - cp21 Stunnel HTTP for mon141 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 36275 bytes in 0.044 second response time [15:24:41] PROBLEM - cp31 Stunnel HTTP for mw122 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:24:49] PROBLEM - cp30 Stunnel HTTP for mw122 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:24:52] PROBLEM - mw122 MediaWiki Rendering on mw122 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:24:55] PROBLEM - mw141 Current Load on mw141 is CRITICAL: CRITICAL - load average: 35.95, 24.95, 14.12 [15:25:30] PROBLEM - m.miraheze.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:26:21] PROBLEM - test131 Current Load on test131 is CRITICAL: CRITICAL - load average: 2.12, 1.72, 1.49 [15:26:49] RECOVERY - cp30 Stunnel HTTP for mw122 on cp30 is OK: HTTP OK: HTTP/1.1 204 No Content - 352 bytes in 1.475 second response time [15:26:49] RECOVERY - mw122 MediaWiki Rendering on mw122 is OK: HTTP OK: HTTP/1.1 200 OK - 29520 bytes in 1.665 second response time [15:27:03] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 0.56, 2.11, 3.38 [15:27:04] PROBLEM - mw142 MediaWiki Rendering on mw142 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:27:27] RECOVERY - m.miraheze.org - LetsEncrypt on sslhost is OK: OK - Certificate 'm.miraheze.org' will expire on Tue 22 Nov 2022 14:02:45 GMT +0000. [15:27:32] PROBLEM - cp31 Stunnel HTTP for mw142 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:27:41] PROBLEM - cp30 Varnish Backends on cp30 is CRITICAL: 3 backends are down. mw122 mw141 mw142 [15:28:04] PROBLEM - intp.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:28:22] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 2.81, 3.32, 2.63 [15:28:34] PROBLEM - cp31 Varnish Backends on cp31 is CRITICAL: 3 backends are down. mw122 mw141 mw142 [15:28:45] RECOVERY - cp31 Stunnel HTTP for mw122 on cp31 is OK: HTTP OK: HTTP/1.1 204 No Content - 352 bytes in 0.244 second response time [15:28:58] RECOVERY - mw142 MediaWiki Rendering on mw142 is OK: HTTP OK: HTTP/1.1 200 OK - 29520 bytes in 0.441 second response time [15:29:31] RECOVERY - cp31 Stunnel HTTP for mw142 on cp31 is OK: HTTP OK: HTTP/1.1 204 No Content - 352 bytes in 0.243 second response time [15:30:17] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 1.90, 2.00, 1.68 [15:30:30] PROBLEM - cp21 Stunnel HTTP for mon141 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:31:03] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.20, 2.95, 3.43 [15:31:40] RECOVERY - cp30 Varnish Backends on cp30 is OK: All 14 backends are healthy [15:32:35] RECOVERY - cp31 Varnish Backends on cp31 is OK: All 14 backends are healthy [15:33:03] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.79, 2.31, 3.13 [15:36:11] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 1.30, 1.60, 1.60 [15:40:06] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 5.19, 4.59, 4.26 [15:41:03] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.72, 3.66, 3.46 [15:42:06] RECOVERY - gluster102 Current Load on gluster102 is OK: OK - load average: 2.86, 4.26, 4.20 [15:43:03] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.17, 2.79, 3.17 [15:43:15] PROBLEM - cp30 Stunnel HTTP for mw122 on cp30 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 201 bytes in 0.256 second response time [15:43:45] PROBLEM - cp31 Stunnel HTTP for mw131 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:43:46] PROBLEM - mw131 MediaWiki Rendering on mw131 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:43:58] PROBLEM - cp31 Stunnel HTTP for mw142 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:44:05] PROBLEM - cp30 Stunnel HTTP for mw132 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:44:05] PROBLEM - cp31 HTTP 4xx/5xx ERROR Rate on cp31 is CRITICAL: CRITICAL - NGINX Error Rate is 61% [15:44:09] PROBLEM - cp30 Stunnel HTTP for mw131 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:44:58] PROBLEM - erawikisource.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:45:03] PROBLEM - cp31 Stunnel HTTP for mw121 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:45:07] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.54, 3.18, 2.79 [15:45:24] PROBLEM - mw121 MediaWiki Rendering on mw121 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:45:32] PROBLEM - cp30 Stunnel HTTP for mw121 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:45:40] PROBLEM - cp30 Varnish Backends on cp30 is CRITICAL: 1 backends are down. mw122 [15:46:00] PROBLEM - cp31 HTTP 4xx/5xx ERROR Rate on cp31 is WARNING: WARNING - NGINX Error Rate is 48% [15:46:52] RECOVERY - cp21 Stunnel HTTP for mon141 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 36267 bytes in 0.054 second response time [15:47:04] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 3.27, 3.30, 2.89 [15:47:05] RECOVERY - cp31 Stunnel HTTP for mw121 on cp31 is OK: HTTP OK: HTTP/1.1 204 No Content - 352 bytes in 2.494 second response time [15:47:18] RECOVERY - mw121 MediaWiki Rendering on mw121 is OK: HTTP OK: HTTP/1.1 200 OK - 29520 bytes in 0.347 second response time [15:47:25] RECOVERY - cp30 Stunnel HTTP for mw122 on cp30 is OK: HTTP OK: HTTP/1.1 204 No Content - 352 bytes in 2.410 second response time [15:47:28] PROBLEM - wiki.eversd.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:47:32] RECOVERY - cp30 Stunnel HTTP for mw121 on cp30 is OK: HTTP OK: HTTP/1.1 204 No Content - 352 bytes in 0.248 second response time [15:47:45] RECOVERY - cp31 Stunnel HTTP for mw131 on cp31 is OK: HTTP OK: HTTP/1.1 204 No Content - 352 bytes in 0.263 second response time [15:47:47] RECOVERY - mw131 MediaWiki Rendering on mw131 is OK: HTTP OK: HTTP/1.1 200 OK - 29512 bytes in 0.486 second response time [15:47:54] RECOVERY - cp31 HTTP 4xx/5xx ERROR Rate on cp31 is OK: OK - NGINX Error Rate is 4% [15:48:02] RECOVERY - cp31 Stunnel HTTP for mw142 on cp31 is OK: HTTP OK: HTTP/1.1 204 No Content - 352 bytes in 0.259 second response time [15:48:07] RECOVERY - cp30 Stunnel HTTP for mw132 on cp30 is OK: HTTP OK: HTTP/1.1 204 No Content - 352 bytes in 0.258 second response time [15:48:15] RECOVERY - cp30 Stunnel HTTP for mw131 on cp30 is OK: HTTP OK: HTTP/1.1 204 No Content - 352 bytes in 0.253 second response time [15:48:34] PROBLEM - cp31 Varnish Backends on cp31 is CRITICAL: 3 backends are down. mw121 mw131 mw132 [15:50:37] RECOVERY - cp31 Varnish Backends on cp31 is OK: All 14 backends are healthy [15:51:40] RECOVERY - cp30 Varnish Backends on cp30 is OK: All 14 backends are healthy [15:52:42] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 5.57, 4.99, 4.31 [15:53:03] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.20, 4.00, 3.46 [15:54:36] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 18.62, 9.27, 5.91 [15:57:19] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [15:57:41] RECOVERY - intp.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [16:01:21] PROBLEM - mw142 Current Load on mw142 is WARNING: WARNING - load average: 6.49, 7.21, 11.52 [16:03:32] PROBLEM - mw132 Current Load on mw132 is WARNING: WARNING - load average: 4.13, 5.37, 11.12 [16:05:21] RECOVERY - mw142 Current Load on mw142 is OK: OK - load average: 4.63, 6.11, 10.11 [16:06:32] PROBLEM - mw141 Current Load on mw141 is WARNING: WARNING - load average: 5.28, 5.93, 11.95 [16:07:10] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::4c25/cpweb [16:07:32] RECOVERY - mw132 Current Load on mw132 is OK: OK - load average: 4.54, 4.81, 9.56 [16:10:31] PROBLEM - mw131 Current Load on mw131 is WARNING: WARNING - load average: 5.89, 6.06, 11.66 [16:11:50] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.43, 8.79, 11.72 [16:12:19] RECOVERY - mw141 Current Load on mw141 is OK: OK - load average: 6.35, 5.92, 10.03 [16:13:45] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 6.46, 8.50, 11.94 [16:14:28] RECOVERY - erawikisource.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [16:15:45] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.66, 9.83, 12.03 [16:16:31] RECOVERY - mw131 Current Load on mw131 is OK: OK - load average: 5.57, 5.91, 9.80 [16:16:46] RECOVERY - wiki.eversd.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.eversd.com' will expire on Mon 12 Dec 2022 08:00:17 GMT +0000. [16:17:46] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.73, 10.41, 11.36 [16:18:06] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 3.42, 5.41, 5.94 [16:19:45] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.16, 10.01, 11.10 [16:20:06] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 7.55, 5.71, 5.95 [16:21:45] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.42, 10.76, 11.81 [16:22:06] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 3.64, 4.86, 5.61 [16:22:20] PROBLEM - cp20 APT on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [16:24:19] RECOVERY - cp20 APT on cp20 is OK: APT OK: 38 packages available for upgrade (0 critical updates). [16:26:06] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 9.18, 5.93, 5.73 [16:27:41] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 10.08, 9.06, 10.16 [16:27:48] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.88, 3.19, 2.65 [16:28:06] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 5.49, 5.33, 5.53 [16:29:45] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.39, 2.82, 2.58 [16:29:49] PROBLEM - roblox-wiki.tk - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query roblox-wiki.tk. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [16:30:06] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 15.05, 9.07, 6.88 [16:31:45] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 6.27, 7.56, 9.73 [16:39:45] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 14.95, 11.11, 10.31 [16:41:05] PROBLEM - cp21 Stunnel HTTP for mon141 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [16:41:45] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.41, 10.89, 10.34 [16:45:45] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.80, 9.96, 10.10 [16:46:35] RECOVERY - cp21 Stunnel HTTP for mon141 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 36275 bytes in 0.044 second response time [16:48:06] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 1.34, 3.96, 5.90 [16:50:06] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 7.85, 6.38, 6.60 [16:51:10] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [16:57:45] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.34, 9.48, 9.49 [16:57:58] PROBLEM - test131 Current Load on test131 is CRITICAL: CRITICAL - load average: 2.24, 1.76, 1.47 [16:58:59] RECOVERY - roblox-wiki.tk - reverse DNS on sslhost is OK: SSL OK - roblox-wiki.tk reverse DNS resolves to cp30.miraheze.org - NS RECORDS OK [16:59:45] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.56, 8.97, 9.32 [16:59:56] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 1.36, 1.61, 1.44 [17:06:06] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 1.48, 3.66, 5.63 [17:06:18] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.44, 10.41, 9.32 [17:10:06] RECOVERY - gluster102 Current Load on gluster102 is OK: OK - load average: 1.58, 2.81, 4.84 [17:11:42] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 1.76, 1.69, 1.54 [17:14:14] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 15.69, 12.05, 10.33 [17:16:37] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.48, 10.82, 9.92 [17:17:24] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.09, 3.67, 2.98 [17:17:36] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 1.35, 1.60, 1.56 [17:18:06] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 11.20, 6.36, 5.42 [17:18:12] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.03, 11.53, 10.62 [17:18:34] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.44, 9.95, 9.71 [17:18:49] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::4c25/cpweb [17:19:21] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.59, 3.30, 2.92 [17:24:09] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 14.69, 11.72, 10.87 [17:26:07] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.36, 10.74, 10.62 [17:28:06] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.45, 11.38, 10.84 [17:30:05] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.66, 11.30, 10.90 [17:30:07] PROBLEM - roblox-wiki.tk - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - roblox-wiki.tk All nameservers failed to answer the query. [17:34:05] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.97, 10.73, 10.17 [17:37:59] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.69, 11.00, 10.34 [17:38:01] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.54, 9.29, 10.10 [17:41:58] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.76, 10.16, 10.35 [17:44:19] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [17:47:55] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.44, 9.07, 9.87 [17:49:45] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.05, 10.54, 10.97 [17:52:06] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 1.74, 3.47, 5.63 [17:56:06] RECOVERY - gluster102 Current Load on gluster102 is OK: OK - load average: 1.50, 2.79, 4.89 [17:59:04] PROBLEM - mwtask141 Disk Space on mwtask141 is WARNING: DISK WARNING - free space: / 7601 MB (10% inode=90%); [17:59:17] RECOVERY - roblox-wiki.tk - reverse DNS on sslhost is OK: SSL OK - roblox-wiki.tk reverse DNS resolves to cp30.miraheze.org - NS RECORDS OK [18:03:45] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 5.72, 8.57, 9.84 [18:04:06] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 6.58, 5.85, 5.35 [18:06:06] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 3.56, 5.09, 5.14 [18:08:07] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 13.27, 7.66, 6.04 [18:08:17] PROBLEM - test131 Current Load on test131 is CRITICAL: CRITICAL - load average: 2.22, 1.81, 1.43 [18:11:41] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.32, 11.35, 10.19 [18:11:45] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 14.38, 12.42, 10.91 [18:13:39] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.01, 11.35, 10.32 [18:13:45] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.71, 11.51, 10.77 [18:15:38] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.63, 10.56, 10.14 [18:16:45] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.85, 3.26, 2.68 [18:17:37] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.32, 12.01, 10.75 [18:18:42] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.28, 2.77, 2.56 [18:19:36] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.62, 10.47, 10.35 [18:21:45] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.94, 9.58, 10.17 [18:23:34] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.16, 11.13, 10.62 [18:24:06] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 2.18, 4.23, 5.81 [18:25:33] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.22, 10.77, 10.55 [18:29:45] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.62, 11.21, 10.65 [18:30:06] RECOVERY - gluster102 Current Load on gluster102 is OK: OK - load average: 3.95, 3.81, 5.08 [18:31:30] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.12, 9.37, 10.11 [18:33:45] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 6.48, 8.59, 9.71 [18:35:26] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.67, 10.73, 10.56 [18:43:45] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.85, 11.99, 10.77 [18:45:32] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 33.80, 16.96, 12.74 [18:46:31] PROBLEM - mw131 Current Load on mw131 is CRITICAL: CRITICAL - load average: 13.89, 10.58, 8.34 [18:48:22] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.72, 3.31, 2.34 [18:48:31] RECOVERY - mw131 Current Load on mw131 is OK: OK - load average: 8.41, 9.45, 8.19 [18:48:56] PROBLEM - jobchron121 Puppet on jobchron121 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_JobRunner] [18:49:45] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.40, 11.64, 11.08 [18:50:22] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 1.55, 2.61, 2.20 [18:53:39] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 7.38, 5.47, 4.67 [18:57:27] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 4.21, 5.49, 4.90 [18:57:45] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.99, 9.08, 10.12 [18:59:21] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 8.75, 6.58, 5.35 [19:05:41] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://github.com/miraheze/puppet/commit/46c4528146c2 [19:05:41] [url] Page not found · GitHub · GitHub | github.com [19:05:42] [02miraheze/puppet] 07paladox 0346c4528 - varnish: connect to stunnel using ipv6 [19:05:44] [02puppet] 07paladox created branch 03paladox-patch-1 - 13https://github.com/miraheze/puppet [19:05:44] [url] Page not found · GitHub · GitHub | github.com [19:05:45] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.03, 10.74, 10.44 [19:05:45] [02puppet] 07paladox opened pull request 03#2840: varnish: connect to stunnel using ipv6 - 13https://github.com/miraheze/puppet/pull/2840 [19:05:46] [url] Page not found · GitHub · GitHub | github.com [19:06:08] [02puppet] 07paladox synchronize pull request 03#2840: varnish: connect to stunnel using ipv6 - 13https://github.com/miraheze/puppet/pull/2840 [19:06:08] [url] Page not found · GitHub · GitHub | github.com [19:06:09] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/46c4528146c2...f7d1d9d542bc [19:06:10] [url] Comparing 46c4528146c2...f7d1d9d542bc · miraheze/puppet · GitHub | github.com [19:06:11] [02miraheze/puppet] 07paladox 03f7d1d9d - Update default.vcl [19:06:40] [02puppet] 07paladox edited pull request 03#2840: varnish: connect to stunnel using localhost - 13https://github.com/miraheze/puppet/pull/2840 [19:06:40] [url] Page not found · GitHub · GitHub | github.com [19:07:02] [02puppet] 07paladox edited pull request 03#2840: varnish: connect to stunnel using localhost - 13https://github.com/miraheze/puppet/pull/2840 [19:07:03] ... [19:07:42] [02puppet] 07paladox closed pull request 03#2840: varnish: connect to stunnel using localhost - 13https://github.com/miraheze/puppet/pull/2840 [19:07:42] ... [19:07:43] [02miraheze/puppet] 07paladox deleted branch 03paladox-patch-1 [19:07:45] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/1d291a6d6416...e36017ebbf61 [19:07:45] [url] Comparing 1d291a6d6416...e36017ebbf61 · miraheze/puppet · GitHub | github.com [19:07:46] [02miraheze/puppet] 07paladox 03e36017e - varnish: connect to stunnel using localhost (#2840) [19:07:48] [02puppet] 07paladox deleted branch 03paladox-patch-1 - 13https://github.com/miraheze/puppet [19:07:48] [url] Page not found · GitHub · GitHub | github.com [19:16:24] PROBLEM - cp30 Stunnel HTTP for mw122 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:16:46] PROBLEM - mw131 Current Load on mw131 is CRITICAL: CRITICAL - load average: 48.77, 30.76, 16.92 [19:16:55] RECOVERY - jobchron121 Puppet on jobchron121 is OK: OK: Puppet is currently enabled, last run 28 seconds ago with 0 failures [19:17:02] PROBLEM - mw141 Current Load on mw141 is CRITICAL: CRITICAL - load average: 49.40, 30.20, 16.50 [19:17:34] PROBLEM - mw122 MediaWiki Rendering on mw122 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:17:41] PROBLEM - cp31 Stunnel HTTP for mw122 on cp31 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 201 bytes in 8.001 second response time [19:17:46] PROBLEM - mw132 Current Load on mw132 is CRITICAL: CRITICAL - load average: 39.25, 22.10, 12.49 [19:18:10] PROBLEM - cp30 Stunnel HTTP for mw141 on cp30 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 201 bytes in 9.109 second response time [19:18:11] PROBLEM - cp30 Stunnel HTTP for mw142 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:18:21] PROBLEM - mw142 Current Load on mw142 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [19:18:22] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 4.04, 3.18, 2.51 [19:19:24] PROBLEM - cp31 Stunnel HTTP for mw121 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:19:30] RECOVERY - mw122 MediaWiki Rendering on mw122 is OK: HTTP OK: HTTP/1.1 200 OK - 29512 bytes in 0.288 second response time [19:19:38] RECOVERY - cp31 Stunnel HTTP for mw122 on cp31 is OK: HTTP OK: HTTP/1.1 204 No Content - 352 bytes in 0.249 second response time [19:20:06] RECOVERY - cp30 Stunnel HTTP for mw141 on cp30 is OK: HTTP OK: HTTP/1.1 204 No Content - 352 bytes in 0.267 second response time [19:20:07] RECOVERY - cp30 Stunnel HTTP for mw142 on cp30 is OK: HTTP OK: HTTP/1.1 204 No Content - 352 bytes in 0.253 second response time [19:20:08] PROBLEM - mw132 MediaWiki Rendering on mw132 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 1595 bytes in 0.007 second response time [19:20:15] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 1.76, 3.49, 5.52 [19:20:22] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 1.68, 2.78, 2.46 [19:20:27] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/e36017ebbf61...a7e9090a2ff8 [19:20:27] [url] Comparing e36017ebbf61...a7e9090a2ff8 · miraheze/puppet · GitHub | github.com [19:20:28] [02miraheze/puppet] 07paladox 03a7e9090 - varnish: force the use of ipv6 when connecting to stunnel [19:20:30] RECOVERY - cp30 Stunnel HTTP for mw122 on cp30 is OK: HTTP OK: HTTP/1.1 204 No Content - 352 bytes in 0.239 second response time [19:20:31] PROBLEM - cp30 Stunnel HTTP for mw132 on cp30 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 201 bytes in 0.249 second response time [19:20:32] PROBLEM - cp31 Stunnel HTTP for mw132 on cp31 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 201 bytes in 0.237 second response time [19:20:35] PROBLEM - cp31 Varnish Backends on cp31 is CRITICAL: 5 backends are down. mw121 mw122 mw132 mw141 mw142 [19:21:23] RECOVERY - cp31 Stunnel HTTP for mw121 on cp31 is OK: HTTP OK: HTTP/1.1 204 No Content - 352 bytes in 0.252 second response time [19:21:38] PROBLEM - mw132 Current Load on mw132 is WARNING: WARNING - load average: 1.31, 11.21, 10.24 [19:21:56] PROBLEM - cp31 Stunnel HTTP for mw131 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:22:35] RECOVERY - cp31 Varnish Backends on cp31 is OK: All 14 backends are healthy [19:23:33] RECOVERY - mw132 Current Load on mw132 is OK: OK - load average: 0.51, 7.75, 9.09 [19:23:41] PROBLEM - cp30 Varnish Backends on cp30 is CRITICAL: 1 backends are down. mw132 [19:23:51] RECOVERY - cp31 Stunnel HTTP for mw131 on cp31 is OK: HTTP OK: HTTP/1.1 204 No Content - 352 bytes in 0.253 second response time [19:26:36] PROBLEM - cp31 Varnish Backends on cp31 is CRITICAL: 1 backends are down. mw132 [19:28:06] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 6.55, 4.53, 5.15 [19:31:28] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 0.89, 1.30, 1.93 [19:31:36] PROBLEM - mw122 MediaWiki Rendering on mw122 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:33:32] RECOVERY - mw122 MediaWiki Rendering on mw122 is OK: HTTP OK: HTTP/1.1 200 OK - 29512 bytes in 0.493 second response time [19:36:31] PROBLEM - mw131 Current Load on mw131 is WARNING: WARNING - load average: 7.10, 8.62, 11.47 [19:37:15] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.34, 3.19, 2.59 [19:37:28] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 1.23, 1.13, 1.64 [19:37:53] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://github.com/miraheze/puppet/commit/ae25c4d4a60a [19:37:54] [02miraheze/puppet] 07paladox 03ae25c4d - mediawiki: reduce mediawiki::php::fpm::fpm_min_child to 20 [19:37:56] [02puppet] 07paladox created branch 03paladox-patch-1 - 13https://github.com/miraheze/puppet [19:37:56] [url] Page not found · GitHub · GitHub | github.com [19:37:57] [02puppet] 07paladox opened pull request 03#2841: mediawiki: reduce mediawiki::php::fpm::fpm_min_child to 20 - 13https://github.com/miraheze/puppet/pull/2841 [19:37:58] [url] Page not found · GitHub · GitHub | github.com [19:38:12] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/ae25c4d4a60a...475492582b76 [19:38:13] [url] Comparing ae25c4d4a60a...475492582b76 · miraheze/puppet · GitHub | github.com [19:38:14] [02miraheze/puppet] 07paladox 034754925 - Update mw122.yaml [19:38:15] [02puppet] 07paladox synchronize pull request 03#2841: mediawiki: reduce mediawiki::php::fpm::fpm_min_child to 20 - 13https://github.com/miraheze/puppet/pull/2841 [19:38:16] [url] Page not found · GitHub · GitHub | github.com [19:38:17] PROBLEM - mw141 Current Load on mw141 is WARNING: WARNING - load average: 7.02, 8.15, 11.84 [19:38:22] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/475492582b76...933a20e7edca [19:38:22] [url] Comparing 475492582b76...933a20e7edca · miraheze/puppet · GitHub | github.com [19:38:23] [02miraheze/puppet] 07paladox 03933a20e - Update mw131.yaml [19:38:25] [02puppet] 07paladox synchronize pull request 03#2841: mediawiki: reduce mediawiki::php::fpm::fpm_min_child to 20 - 13https://github.com/miraheze/puppet/pull/2841 [19:38:25] [url] Page not found · GitHub · GitHub | github.com [19:38:32] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/933a20e7edca...de553563d037 [19:38:33] [url] Comparing 933a20e7edca...de553563d037 · miraheze/puppet · GitHub | github.com [19:38:33] [02miraheze/puppet] 07paladox 03de55356 - Update mw132.yaml [19:38:35] [02puppet] 07paladox synchronize pull request 03#2841: mediawiki: reduce mediawiki::php::fpm::fpm_min_child to 20 - 13https://github.com/miraheze/puppet/pull/2841 [19:38:35] [url] Page not found · GitHub · GitHub | github.com [19:38:43] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/de553563d037...73da507261cb [19:38:44] [url] Comparing de553563d037...73da507261cb · miraheze/puppet · GitHub | github.com [19:38:45] [02miraheze/puppet] 07paladox 0373da507 - Update mw141.yaml [19:38:46] [02puppet] 07paladox synchronize pull request 03#2841: mediawiki: reduce mediawiki::php::fpm::fpm_min_child to 20 - 13https://github.com/miraheze/puppet/pull/2841 [19:38:46] [url] Page not found · GitHub · GitHub | github.com [19:38:53] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/73da507261cb...d2c888d0875d [19:38:54] [url] Comparing 73da507261cb...d2c888d0875d · miraheze/puppet · GitHub | github.com [19:38:55] [02miraheze/puppet] 07paladox 03d2c888d - Update mw142.yaml [19:38:56] [02puppet] 07paladox synchronize pull request 03#2841: mediawiki: reduce mediawiki::php::fpm::fpm_min_child to 20 - 13https://github.com/miraheze/puppet/pull/2841 [19:38:57] [url] Page not found · GitHub · GitHub | github.com [19:39:05] [02puppet] 07paladox closed pull request 03#2841: mediawiki: reduce mediawiki::php::fpm::fpm_min_child to 20 - 13https://github.com/miraheze/puppet/pull/2841 [19:39:06] [url] Page not found · GitHub · GitHub | github.com [19:39:07] [02miraheze/puppet] 07paladox deleted branch 03paladox-patch-1 [19:39:08] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±6] 13https://github.com/miraheze/puppet/compare/a7e9090a2ff8...b5e0e5cf9e25 [19:39:09] [url] Comparing a7e9090a2ff8...b5e0e5cf9e25 · miraheze/puppet · GitHub | github.com [19:39:10] [02miraheze/puppet] 07paladox 03b5e0e5c - mediawiki: reduce mediawiki::php::fpm::fpm_min_child to 20 (#2841) [19:39:11] [02puppet] 07paladox deleted branch 03paladox-patch-1 - 13https://github.com/miraheze/puppet [19:39:12] [url] Page not found · GitHub · GitHub | github.com [19:39:12] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 3.09, 3.17, 2.66 [19:39:44] PROBLEM - mw142 Current Load on mw142 is WARNING: WARNING - load average: 5.78, 7.23, 11.55 [19:44:31] RECOVERY - mw131 Current Load on mw131 is OK: OK - load average: 7.67, 8.31, 10.19 [19:45:16] PROBLEM - cp30 Stunnel HTTP for mw122 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:45:34] RECOVERY - mw142 Current Load on mw142 is OK: OK - load average: 4.95, 6.50, 9.94 [19:45:44] RECOVERY - cp30 Stunnel HTTP for mw132 on cp30 is OK: HTTP OK: HTTP/1.1 204 No Content - 352 bytes in 0.243 second response time [19:46:38] RECOVERY - cp31 Stunnel HTTP for mw132 on cp31 is OK: HTTP OK: HTTP/1.1 204 No Content - 352 bytes in 0.236 second response time [19:47:15] RECOVERY - cp30 Stunnel HTTP for mw122 on cp30 is OK: HTTP OK: HTTP/1.1 204 No Content - 352 bytes in 0.645 second response time [19:47:21] RECOVERY - mw132 MediaWiki Rendering on mw132 is OK: HTTP OK: HTTP/1.1 200 OK - 29512 bytes in 0.213 second response time [19:47:56] RECOVERY - mw141 Current Load on mw141 is OK: OK - load average: 6.56, 7.67, 10.10 [19:49:41] RECOVERY - cp30 Varnish Backends on cp30 is OK: All 14 backends are healthy [19:50:35] RECOVERY - cp31 Varnish Backends on cp31 is OK: All 14 backends are healthy [19:52:02] !log reboot cp20 [19:52:09] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:53:54] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 2.56, 4.54, 5.71 [19:54:33] RECOVERY - cp31 Varnish Backends on cp31 is OK: All 14 backends are healthy [19:56:18] PROBLEM - mon141 Current Load on mon141 is WARNING: WARNING - load average: 2.04, 3.47, 1.97 [19:58:15] RECOVERY - mon141 Current Load on mon141 is OK: OK - load average: 0.38, 2.36, 1.75 [19:59:41] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 10.03, 6.74, 6.11 [20:00:15] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.59, 9.11, 11.64 [20:00:50] PROBLEM - roblox-wiki.tk - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - roblox-wiki.tk All nameservers failed to answer the query. [20:04:32] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.75, 9.86, 11.77 [20:10:32] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.60, 10.49, 11.27 [20:12:32] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.53, 9.54, 10.85 [20:13:49] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.63, 8.74, 9.97 [20:16:32] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.11, 7.95, 9.87 [20:28:45] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 1.76, 1.78, 1.51 [20:29:22] RECOVERY - roblox-wiki.tk - reverse DNS on sslhost is OK: SSL OK - roblox-wiki.tk reverse DNS resolves to cp31.miraheze.org - NS RECORDS OK [20:30:44] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 1.41, 1.65, 1.50 [20:38:40] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 1.95, 1.64, 1.52 [20:42:38] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 1.70, 1.70, 1.57 [20:47:17] !log restarted mw131 [20:47:31] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:47:56] PROBLEM - mw131 Check Gluster Clients on mw131 is CRITICAL: PROCS CRITICAL: 0 processes with args '/usr/sbin/glusterfs' [20:48:50] PROBLEM - cp30 Varnish Backends on cp30 is CRITICAL: 1 backends are down. mw131 [20:50:19] PROBLEM - cp31 Varnish Backends on cp31 is CRITICAL: 1 backends are down. mw131 [20:50:51] RECOVERY - cp30 Varnish Backends on cp30 is OK: All 14 backends are healthy [20:51:46] RECOVERY - mw131 Check Gluster Clients on mw131 is OK: PROCS OK: 1 process with args '/usr/sbin/glusterfs' [20:52:19] RECOVERY - cp31 Varnish Backends on cp31 is OK: All 14 backends are healthy [20:53:34] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 2 datacenters are down: 198.244.148.90/cpweb, 2001:41d0:801:2000::1b80/cpweb [20:55:32] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [20:59:27] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 2 datacenters are down: 198.244.148.90/cpweb, 2001:41d0:801:2000::1b80/cpweb [20:59:52] PROBLEM - roblox-wiki.tk - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - roblox-wiki.tk All nameservers failed to answer the query. [21:00:12] PROBLEM - ns1 GDNSD Datacenters on ns1 is CRITICAL: CRITICAL - 2 datacenters are down: 198.244.148.90/cpweb, 2001:41d0:801:2000::1b80/cpweb [21:01:09] !log install ndisc6 on cp21 [21:01:51] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:02:08] RECOVERY - ns1 GDNSD Datacenters on ns1 is OK: OK - all datacenters are online [21:10:55] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.09, 9.72, 9.05 [21:12:07] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.93, 10.32, 9.47 [21:12:51] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 9.11, 9.46, 9.04 [21:13:16] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [21:17:12] !log fixed both cp20/21 netmask prefix to be 128 in ovh config [21:17:21] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:19:49] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.30, 9.72, 9.64 [21:20:36] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.30, 10.23, 9.54 [21:22:32] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.20, 9.27, 9.29 [21:24:52] PROBLEM - cp30 Stunnel HTTP for test131 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:24:53] PROBLEM - test131 MediaWiki Rendering on test131 is CRITICAL: connect to address 2a10:6740::6:406 and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [21:25:28] PROBLEM - test131 Check Gluster Clients on test131 is CRITICAL: PROCS CRITICAL: 0 processes with args '/usr/sbin/glusterfs' [21:26:51] RECOVERY - test131 MediaWiki Rendering on test131 is OK: HTTP OK: HTTP/1.1 200 OK - 34239 bytes in 1.855 second response time [21:26:51] RECOVERY - cp30 Stunnel HTTP for test131 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 14740 bytes in 0.315 second response time [21:27:08] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 4.16, 4.92, 5.79 [21:28:24] RECOVERY - roblox-wiki.tk - reverse DNS on sslhost is OK: SSL OK - roblox-wiki.tk reverse DNS resolves to cp30.miraheze.org - NS RECORDS OK [21:29:08] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 7.72, 5.83, 5.99 [21:31:21] PROBLEM - cp31 Stunnel HTTP for mw122 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:31:35] PROBLEM - mw122 MediaWiki Rendering on mw122 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:31:40] PROBLEM - mw121 MediaWiki Rendering on mw121 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:33:21] RECOVERY - cp31 Stunnel HTTP for mw122 on cp31 is OK: HTTP OK: HTTP/1.1 204 No Content - 352 bytes in 3.641 second response time [21:33:33] RECOVERY - mw122 MediaWiki Rendering on mw122 is OK: HTTP OK: HTTP/1.1 200 OK - 29512 bytes in 0.555 second response time [21:33:38] RECOVERY - mw121 MediaWiki Rendering on mw121 is OK: HTTP OK: HTTP/1.1 200 OK - 29512 bytes in 1.143 second response time [21:36:05] [02miraheze/dns] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://github.com/miraheze/dns/commit/5987d27e8303 [21:36:07] [02miraheze/dns] 07paladox 035987d27 - Depool ca and repool gb temporarily [21:36:08] [02dns] 07paladox created branch 03paladox-patch-1 - 13https://github.com/miraheze/dns [21:36:09] [url] Page not found · GitHub · GitHub | github.com [21:36:10] [02dns] 07paladox opened pull request 03#349: Depool ca and repool gb temporarily - 13https://github.com/miraheze/dns/pull/349 [21:36:10] ... [21:36:12] [02dns] 07paladox closed pull request 03#349: Depool ca and repool gb temporarily - 13https://github.com/miraheze/dns/pull/349 [21:36:12] ... [21:36:14] [02miraheze/dns] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/dns/compare/cb8d572e7f57...9ce6c5ab240d [21:36:14] [url] Comparing cb8d572e7f57...9ce6c5ab240d · miraheze/dns · GitHub | github.com [21:36:15] [02miraheze/dns] 07paladox 039ce6c5a - Depool ca and repool gb temporarily (#349) [21:36:17] [02dns] 07paladox deleted branch 03paladox-patch-1 - 13https://github.com/miraheze/dns [21:36:17] [url] Page not found · GitHub · GitHub | github.com [21:36:18] [02miraheze/dns] 07paladox deleted branch 03paladox-patch-1 [21:38:46] !log reboot cp30/31 [21:39:12] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.67, 0.15, 0.05 [21:39:30] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.64, 0.13, 0.04 [21:39:59] [02miraheze/dns] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/dns/compare/9ce6c5ab240d...0412134f45e5 [21:39:59] [url] Comparing 9ce6c5ab240d...0412134f45e5 · miraheze/dns · GitHub | github.com [21:40:00] [02miraheze/dns] 07paladox 030412134 - Revert "Depool ca and repool gb temporarily (#349)" [21:40:00] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.86, 3.49, 2.76 [21:40:10] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:40:13] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/b5e0e5cf9e25...867df0d26a8a [21:40:13] [url] Comparing b5e0e5cf9e25...867df0d26a8a · miraheze/puppet · GitHub | github.com [21:40:14] [02miraheze/puppet] 07paladox 03867df0d - Revert "varnish: force the use of ipv6 when connecting to stunnel" [21:41:50] PROBLEM - mw122 MediaWiki Rendering on mw122 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:42:07] PROBLEM - cp31 Stunnel HTTP for mw132 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:42:28] PROBLEM - cp30 Stunnel HTTP for mw122 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:43:12] PROBLEM - gluster122 Current Load on gluster122 is CRITICAL: CRITICAL - load average: 4.13, 2.67, 1.91 [21:43:26] PROBLEM - cp30 Stunnel HTTP for mw132 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:43:44] PROBLEM - mw132 MediaWiki Rendering on mw132 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:43:54] PROBLEM - mw121 MediaWiki Rendering on mw121 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:43:56] RECOVERY - mw122 MediaWiki Rendering on mw122 is OK: HTTP OK: HTTP/1.1 200 OK - 29512 bytes in 8.993 second response time [21:44:04] PROBLEM - mw131 MediaWiki Rendering on mw131 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:44:05] PROBLEM - cp30 Stunnel HTTP for mw121 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:44:06] PROBLEM - cp30 Stunnel HTTP for mw131 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:44:10] PROBLEM - cp31 Stunnel HTTP for mw131 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:44:28] RECOVERY - cp30 Stunnel HTTP for mw122 on cp30 is OK: HTTP OK: HTTP/1.1 204 No Content - 352 bytes in 0.247 second response time [21:44:31] PROBLEM - cp31 Stunnel HTTP for mw121 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:45:12] RECOVERY - gluster122 Current Load on gluster122 is OK: OK - load average: 3.18, 2.90, 2.10 [21:45:12] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.27, 1.40, 0.60 [21:45:22] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 3.18, 2.32, 1.03 [21:45:38] [02miraheze/puppet] 07Universal-Omega pushed 031 commit to 03varnish-network-tuning [+0/-0/±1] 13https://github.com/miraheze/puppet/commit/ef1186be0980 [21:45:39] [02miraheze/puppet] 07Universal-Omega 03ef1186b - varnish: add some more network tuning [21:45:41] [02puppet] 07Universal-Omega created branch 03varnish-network-tuning - 13https://github.com/miraheze/puppet [21:45:41] [url] Page not found · GitHub · GitHub | github.com [21:45:43] [02puppet] 07Universal-Omega opened pull request 03#2842: varnish: add some more network tuning - 13https://github.com/miraheze/puppet/pull/2842 [21:45:44] [url] Page not found · GitHub · GitHub | github.com [21:45:48] RECOVERY - mw132 MediaWiki Rendering on mw132 is OK: HTTP OK: HTTP/1.1 200 OK - 29512 bytes in 9.552 second response time [21:46:00] RECOVERY - mw131 MediaWiki Rendering on mw131 is OK: HTTP OK: HTTP/1.1 200 OK - 29512 bytes in 0.224 second response time [21:46:02] RECOVERY - cp30 Stunnel HTTP for mw131 on cp30 is OK: HTTP OK: HTTP/1.1 204 No Content - 352 bytes in 0.591 second response time [21:46:06] RECOVERY - cp31 Stunnel HTTP for mw131 on cp31 is OK: HTTP OK: HTTP/1.1 204 No Content - 352 bytes in 0.494 second response time [21:46:21] RECOVERY - cp31 Stunnel HTTP for mw132 on cp31 is OK: HTTP OK: HTTP/1.1 204 No Content - 352 bytes in 8.810 second response time [21:47:37] RECOVERY - cp30 Stunnel HTTP for mw132 on cp30 is OK: HTTP OK: HTTP/1.1 204 No Content - 352 bytes in 0.286 second response time [21:48:14] RECOVERY - cp30 Stunnel HTTP for mw121 on cp30 is OK: HTTP OK: HTTP/1.1 204 No Content - 352 bytes in 8.790 second response time [21:48:43] RECOVERY - cp31 Stunnel HTTP for mw121 on cp31 is OK: HTTP OK: HTTP/1.1 204 No Content - 352 bytes in 5.174 second response time [21:50:10] [02puppet] 07Universal-Omega closed pull request 03#2842: varnish: add some more network tuning - 13https://github.com/miraheze/puppet/pull/2842 [21:50:10] [url] Page not found · GitHub · GitHub | github.com [21:50:11] [02miraheze/puppet] 07Universal-Omega deleted branch 03varnish-network-tuning [21:50:13] [02miraheze/puppet] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/867df0d26a8a...1f9710592c61 [21:50:13] [url] Comparing 867df0d26a8a...1f9710592c61 · miraheze/puppet · GitHub | github.com [21:50:14] [02miraheze/puppet] 07Universal-Omega 031f97105 - varnish: add some more network tuning (#2842) [21:50:16] [02puppet] 07Universal-Omega deleted branch 03varnish-network-tuning - 13https://github.com/miraheze/puppet [21:50:16] [url] Page not found · GitHub · GitHub | github.com [21:52:44] PROBLEM - cp30 Stunnel HTTP for mw121 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:52:58] PROBLEM - cp30 Stunnel HTTP for mw122 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:53:09] PROBLEM - cp31 Stunnel HTTP for mw121 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:54:04] PROBLEM - cp31 Stunnel HTTP for mw122 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:54:19] PROBLEM - mw122 MediaWiki Rendering on mw122 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:54:53] RECOVERY - cp30 Stunnel HTTP for mw121 on cp30 is OK: HTTP OK: HTTP/1.1 204 No Content - 352 bytes in 9.866 second response time [21:56:22] RECOVERY - mw121 MediaWiki Rendering on mw121 is OK: HTTP OK: HTTP/1.1 200 OK - 29512 bytes in 5.640 second response time [21:57:17] RECOVERY - cp31 Stunnel HTTP for mw121 on cp31 is OK: HTTP OK: HTTP/1.1 204 No Content - 352 bytes in 1.271 second response time [21:58:12] RECOVERY - cp31 Stunnel HTTP for mw122 on cp31 is OK: HTTP OK: HTTP/1.1 204 No Content - 352 bytes in 6.631 second response time [21:58:26] RECOVERY - mw122 MediaWiki Rendering on mw122 is OK: HTTP OK: HTTP/1.1 200 OK - 29513 bytes in 3.400 second response time [21:59:25] RECOVERY - cp30 Stunnel HTTP for mw122 on cp30 is OK: HTTP OK: HTTP/1.1 204 No Content - 352 bytes in 6.968 second response time [22:02:36] PROBLEM - cp31 Stunnel HTTP for mw122 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [22:02:50] PROBLEM - mw122 MediaWiki Rendering on mw122 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [22:03:24] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.30, 3.59, 3.84 [22:04:42] RECOVERY - cp31 Stunnel HTTP for mw122 on cp31 is OK: HTTP OK: HTTP/1.1 204 No Content - 352 bytes in 9.643 second response time [22:04:57] RECOVERY - mw122 MediaWiki Rendering on mw122 is OK: HTTP OK: HTTP/1.1 200 OK - 29512 bytes in 9.683 second response time [22:05:12] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.28, 1.90, 1.77 [22:06:35] [Grafana] FIRING: Some MediaWiki Appservers are running out of PHP-FPM workers. https://grafana.miraheze.org/d/GtxbP1Xnk [22:07:12] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.32, 2.13, 1.87 [22:09:11] !log depool, reboot and repool mw121 [22:09:20] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:13:36] !log depool, reboot and repool mw122 [22:15:12] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:15:33] !log depool, reboot and repool mw131 [22:15:57] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:17:06] !log depool, reboot and repool mw132 [22:17:12] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.45, 1.91, 1.92 [22:17:15] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 1.85, 2.63, 3.29 [22:17:17] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:19:06] !log depool, reboot and repool mw141 [22:19:12] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 3.65, 2.75, 2.23 [22:19:35] PROBLEM - cp30 Stunnel HTTP for mw122 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [22:20:01] PROBLEM - mw121 MediaWiki Rendering on mw121 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [22:20:07] PROBLEM - cp31 Stunnel HTTP for mw122 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [22:20:13] PROBLEM - mw122 MediaWiki Rendering on mw122 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [22:20:17] !log depool, reboot and repool mw142 [22:20:28] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:20:42] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:21:15] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.62, 3.40, 3.46 [22:21:40] RECOVERY - cp30 Stunnel HTTP for mw122 on cp30 is OK: HTTP OK: HTTP/1.1 204 No Content - 352 bytes in 5.029 second response time [22:22:03] RECOVERY - cp31 Stunnel HTTP for mw122 on cp31 is OK: HTTP OK: HTTP/1.1 204 No Content - 352 bytes in 0.249 second response time [22:22:04] RECOVERY - mw121 MediaWiki Rendering on mw121 is OK: HTTP OK: HTTP/1.1 200 OK - 29512 bytes in 5.361 second response time [22:22:10] RECOVERY - mw122 MediaWiki Rendering on mw122 is OK: HTTP OK: HTTP/1.1 200 OK - 29512 bytes in 0.527 second response time [22:23:15] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.42, 4.29, 3.79 [22:23:49] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.25, 9.66, 5.40 [22:25:49] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 9.89, 9.69, 5.93 [22:29:55] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.71, 3.88, 3.82 [22:30:36] [Grafana] RESOLVED: PHP-FPM Worker Usage High https://grafana.miraheze.org/d/GtxbP1Xnk [22:32:00] PROBLEM - reports121 Puppet on reports121 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [22:32:12] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.39, 9.85, 7.44 [22:32:20] PROBLEM - puppet141 Current Load on puppet141 is CRITICAL: CRITICAL - load average: 4.20, 2.55, 1.10 [22:33:51] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 3.95, 4.07, 3.91 [22:34:20] RECOVERY - puppet141 Current Load on puppet141 is OK: OK - load average: 3.29, 2.74, 1.34 [22:35:27] !log rebooted mon141, puppet131, phab121, es131, es141, graylog121, prometheus131 and matomo131 [22:35:49] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.59, 3.93, 3.88 [22:36:05] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:37:47] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.30, 4.21, 3.99 [22:37:52] PROBLEM - graylog121 APT on graylog121 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [22:38:13] RECOVERY - graylog121 APT on graylog121 is OK: APT OK: 41 packages available for upgrade (0 critical updates). [22:39:36] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.94, 3.66, 1.70 [22:39:40] RECOVERY - test131 Check Gluster Clients on test131 is OK: PROCS OK: 1 process with args '/usr/sbin/glusterfs' [22:41:36] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 2.14, 3.16, 1.76 [22:41:43] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.94, 3.94, 3.94 [22:43:44] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.25, 1.78, 1.98 [22:44:50] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.12, 10.78, 8.99 [22:46:48] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.75, 10.10, 8.96 [22:49:21] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.62, 1.97, 1.98 [22:51:32] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.26, 2.59, 3.27 [22:53:18] [02miraheze/puppet] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/1f9710592c61...b22a7477ab61 [22:53:18] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.62, 1.91, 1.96 [22:53:19] [url] Comparing 1f9710592c61...b22a7477ab61 · miraheze/puppet · GitHub | github.com [22:53:20] [02miraheze/puppet] 07Universal-Omega 03b22a747 - blackbox: remove `X-Miraheze-Debug` [22:58:30] RECOVERY - reports121 Puppet on reports121 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [22:59:13] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.20, 1.39, 1.70 [23:00:07] [02miraheze/puppet] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/b22a7477ab61...b0510c1fd518 [23:00:07] [url] Comparing b22a7477ab61...b0510c1fd518 · miraheze/puppet · GitHub | github.com [23:00:08] [02miraheze/puppet] 07Universal-Omega 03b0510c1 - blackbox: remove Special:RecentChanges and Special:Version [23:01:40] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.57, 1.69, 1.99 [23:01:50] CosmicAlpha: there is a reason to them [23:02:11] RhinosF1: to what? [23:02:47] CosmicAlpha: version and RC [23:03:09] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.29, 1.83, 1.80 [23:03:26] It's supposed to test a page that's known to be on the slower end [23:04:07] RhinosF1: because hitting those does not really provide us with a ton of insight, but it does rack up otherwise unneeded expensive hits on the semi-expensive pages. I am mainly just seeing if it reduces other load, if it does not at all, it can be readded. [23:04:30] CosmicAlpha: ok [23:04:49] The X-Debug probably has a bigger impact [23:05:07] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.52, 1.71, 1.76 [23:05:35] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 1.95, 1.93, 2.01 [23:07:06] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.09, 1.52, 1.69 [23:07:07] RhinosF1: yeah, otherwise before that, every "separate" server it was hitting was really the same server, giving the same load, etc... (mw122), unless I read that wrong.... but it seemed to be what it was doing. [23:07:33] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.91, 1.82, 1.95 [23:07:58] Ye [23:09:31] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.14, 1.97, 2.00 [23:15:23] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.22, 1.81, 1.96 [23:21:16] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.44, 1.98, 1.97 [23:23:13] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.48, 1.88, 1.94 [23:25:11] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.60, 2.29, 2.09 [23:29:46] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.16, 1.73, 1.58 [23:31:04] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.25, 1.87, 1.98 [23:31:23] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 3.20, 4.62, 5.96 [23:31:45] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.94, 1.78, 1.62 [23:33:43] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.22, 2.02, 1.73 [23:35:04] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.54, 2.00, 2.00 [23:35:23] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 9.48, 6.77, 6.45 [23:35:42] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.83, 1.97, 1.75 [23:37:04] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.33, 1.87, 1.96 [23:39:39] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.11, 1.95, 1.78 [23:41:37] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.74, 1.97, 1.81 [23:45:04] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.54, 1.44, 1.70 [23:47:14] PROBLEM - es131 NTP time on es131 is CRITICAL: NTP CRITICAL: Offset 0.7101390958 secs [23:47:33] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.28, 1.95, 1.82 [23:49:04] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.67, 1.60, 1.72 [23:51:04] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 3.33, 2.13, 1.89 [23:52:02] !log sudo -u www-data php /srv/mediawiki/w/extensions/Echo/maintenance/removeOrphanedEvents.php --wiki=qualitipediawiki [23:52:09] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:55:04] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.14, 1.77, 1.82 [23:57:25] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.42, 1.88, 1.92