[00:01:06] PROBLEM - test131 Disk Space on test131 is WARNING: DISK WARNING - free space: / 1768 MB (9% inode=66%); [00:02:34] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.24, 1.88, 1.65 [00:02:49] PROBLEM - mw121 MediaWiki Rendering on mw121 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:02:53] PROBLEM - cp30 Stunnel HTTP for mw121 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:03:00] PROBLEM - cp23 Stunnel HTTP for mw121 on cp23 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:03:37] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.44, 1.84, 1.53 [00:04:44] RECOVERY - mw121 MediaWiki Rendering on mw121 is OK: HTTP OK: HTTP/1.1 200 OK - 30903 bytes in 0.811 second response time [00:04:53] RECOVERY - cp30 Stunnel HTTP for mw121 on cp30 is OK: HTTP OK: HTTP/1.1 204 No Content - 352 bytes in 0.239 second response time [00:04:54] RECOVERY - cp23 Stunnel HTTP for mw121 on cp23 is OK: HTTP OK: HTTP/1.1 204 No Content - 352 bytes in 0.023 second response time [00:05:37] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.64, 1.75, 1.54 [00:06:28] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.24, 1.79, 1.67 [00:07:37] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.05, 1.55, 1.50 [00:08:26] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.76, 1.49, 1.58 [00:09:46] !log [@mwtask141] starting deploy of {'config': True} to all [00:09:57] !log [@mwtask141] finished deploy of {'config': True} to all - SUCCESS in 10s [00:09:58] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:10:02] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:13:37] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.83, 2.33, 1.83 [00:17:37] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.29, 1.79, 1.72 [00:19:44] PROBLEM - cp23 APT on cp23 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [00:21:37] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.83, 1.42, 1.61 [00:22:03] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 4.66, 2.52, 1.85 [00:22:33] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 14.15, 5.77, 3.09 [00:23:09] PROBLEM - cp30 APT on cp30 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [00:25:08] RECOVERY - cp30 APT on cp30 is OK: APT OK: 38 packages available for upgrade (0 critical updates). [00:25:37] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.32, 1.84, 1.73 [00:27:55] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 0.90, 1.76, 1.78 [00:28:04] RECOVERY - cp23 APT on cp23 is OK: APT OK: 4 packages available for upgrade (0 critical updates). [00:29:37] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.95, 1.86, 1.75 [00:30:33] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 0.94, 3.97, 3.83 [00:31:50] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 9.35, 3.26, 2.24 [00:34:33] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 0.80, 2.25, 3.15 [00:37:37] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.86, 1.39, 1.61 [00:45:34] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.52, 1.55, 1.97 [00:45:40] PROBLEM - cp23 NTP time on cp23 is WARNING: NTP WARNING: Offset 0.1321451962 secs [00:47:34] PROBLEM - cp23 APT on cp23 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [00:47:41] RECOVERY - cp23 NTP time on cp23 is OK: NTP OK: Offset 0.09772562981 secs [00:49:32] RECOVERY - cp23 APT on cp23 is OK: APT OK: 4 packages available for upgrade (0 critical updates). [00:52:10] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.62, 1.72, 1.62 [00:55:34] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.06, 1.33, 1.66 [00:56:00] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.08, 1.47, 1.55 [00:59:49] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.98, 1.68, 1.61 [00:59:54] PROBLEM - cp23 APT on cp23 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [01:01:44] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.61, 1.60, 1.59 [01:01:52] RECOVERY - cp23 APT on cp23 is OK: APT OK: 4 packages available for upgrade (0 critical updates). [01:03:34] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.98, 2.73, 2.11 [01:07:34] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.15, 2.00, 1.96 [01:08:27] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 0.92, 1.84, 1.78 [01:10:21] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.22, 1.62, 1.70 [01:15:18] PROBLEM - cp22 APT on cp22 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [01:17:14] RECOVERY - cp22 APT on cp22 is OK: APT OK: 4 packages available for upgrade (0 critical updates). [01:17:34] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.67, 1.77, 1.77 [01:19:33] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.03, 1.47, 1.66 [01:24:42] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.60, 1.85, 1.67 [01:26:36] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.11, 1.58, 1.59 [01:27:59] PROBLEM - cp23 APT on cp23 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [01:29:57] RECOVERY - cp23 APT on cp23 is OK: APT OK: 4 packages available for upgrade (0 critical updates). [01:45:33] PROBLEM - cp22 Current Load on cp22 is CRITICAL: CRITICAL - load average: 7.20, 3.93, 1.94 [01:45:34] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.22, 1.88, 1.56 [01:47:32] RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 1.22, 2.72, 1.74 [01:47:34] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.24, 1.76, 1.56 [01:49:34] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 4.20, 2.97, 2.04 [01:52:10] PROBLEM - cp23 APT on cp23 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [01:56:33] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 4.34, 3.36, 1.94 [01:58:09] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 9.78, 3.47, 2.05 [02:00:30] RECOVERY - cp23 APT on cp23 is OK: APT OK: 4 packages available for upgrade (0 critical updates). [02:00:33] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 1.86, 3.48, 2.38 [02:02:33] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 0.85, 2.52, 2.16 [02:03:34] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.42, 1.78, 1.95 [02:03:53] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.49, 1.96, 1.79 [02:05:48] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.97, 1.63, 1.69 [02:11:34] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.37, 1.43, 1.70 [02:13:53] PROBLEM - test131 Current Load on test131 is CRITICAL: CRITICAL - load average: 3.79, 2.73, 1.80 [02:14:27] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.11, 1.85, 1.72 [02:15:40] PROBLEM - swiftobject115 Current Load on swiftobject115 is CRITICAL: CRITICAL - load average: 4.97, 2.68, 1.16 [02:16:22] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.62, 1.67, 1.67 [02:19:16] PROBLEM - swiftobject114 Current Load on swiftobject114 is WARNING: WARNING - load average: 3.51, 3.17, 1.66 [02:19:39] RECOVERY - swiftobject115 Current Load on swiftobject115 is OK: OK - load average: 2.06, 2.81, 1.60 [02:21:16] RECOVERY - swiftobject114 Current Load on swiftobject114 is OK: OK - load average: 0.62, 2.17, 1.47 [02:22:06] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 1.58, 2.26, 1.94 [02:23:53] PROBLEM - cp23 APT on cp23 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [02:25:55] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 0.92, 1.84, 1.86 [02:26:33] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 4.07, 2.86, 1.79 [02:27:53] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 1.27, 1.65, 1.94 [02:28:00] RECOVERY - cp23 APT on cp23 is OK: APT OK: 4 packages available for upgrade (0 critical updates). [02:28:33] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.42, 2.22, 1.68 [02:28:44] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+1/-1/±0] 13https://github.com/miraheze/mw-config/commit/36d3fde839f6 [02:28:45] [02miraheze/mw-config] 07Universal-Omega 0336d3fde - Include disabled extensions in cache [02:28:47] [02mw-config] 07Universal-Omega created branch 03Universal-Omega-patch-1 - 13https://github.com/miraheze/mw-config [02:28:47] [url] Page not found · GitHub · GitHub | github.com [02:28:48] [02mw-config] 07Universal-Omega opened pull request 03#4907: Include disabled extensions in cache - 13https://github.com/miraheze/mw-config/pull/4907 [02:28:49] [url] Page not found · GitHub · GitHub | github.com [02:29:44] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.05, 1.35, 1.65 [02:29:57] miraheze/mw-config - Universal-Omega the build passed. [02:31:53] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 0.90, 1.23, 1.70 [02:32:20] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/3c9b57803d86...8874768cbecc [02:32:21] [url] Comparing 3c9b57803d86...8874768cbecc · miraheze/mw-config · GitHub | github.com [02:32:22] [02miraheze/mw-config] 07Universal-Omega 038874768 - Update extension-list [02:32:53] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/8874768cbecc...00fb4fbbabab [02:32:54] [url] Comparing 8874768cbecc...00fb4fbbabab · miraheze/mw-config · GitHub | github.com [02:32:54] [02miraheze/mw-config] 07Universal-Omega 0300fb4fb - Revert [02:33:22] miraheze/mw-config - Universal-Omega the build has errored. [02:33:52] miraheze/mw-config - Universal-Omega the build passed. [02:42:18] PROBLEM - cp23 APT on cp23 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [02:44:16] RECOVERY - cp23 APT on cp23 is OK: APT OK: 4 packages available for upgrade (0 critical updates). [02:49:16] PROBLEM - swiftobject114 Current Load on swiftobject114 is CRITICAL: CRITICAL - load average: 4.57, 2.89, 1.49 [02:49:40] PROBLEM - swiftobject115 Current Load on swiftobject115 is CRITICAL: CRITICAL - load average: 6.28, 3.36, 1.65 [02:51:16] RECOVERY - swiftobject114 Current Load on swiftobject114 is OK: OK - load average: 2.34, 2.91, 1.69 [02:51:40] RECOVERY - swiftobject115 Current Load on swiftobject115 is OK: OK - load average: 1.83, 2.98, 1.74 [02:52:59] !log [paladox@test131] sudo -u www-data /usr/local/bin/foreachwikiindblist /srv/mediawiki/cache/databases.json /srv/mediawiki/w/extensions/MirahezeMagic/maintenance/test.php (START) [02:53:03] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:53:13] !log [paladox@test131] sudo -u www-data /usr/local/bin/foreachwikiindblist /srv/mediawiki/cache/databases.json /srv/mediawiki/w/extensions/MirahezeMagic/maintenance/test.php (END - exit=2) [02:53:17] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:53:33] !log [paladox@test131] sudo -u www-data /usr/local/bin/foreachwikiindblist /srv/mediawiki/cache/databases.json /srv/mediawiki/w/extensions/MirahezeMagic/maintenance/test.php (START) [02:53:37] !log [paladox@test131] sudo -u www-data /usr/local/bin/foreachwikiindblist /srv/mediawiki/cache/databases.json /srv/mediawiki/w/extensions/MirahezeMagic/maintenance/test.php (END - exit=2) [02:53:43] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:53:47] !log [paladox@test131] sudo -u www-data /usr/local/bin/foreachwikiindblist /srv/mediawiki/cache/databases.json /srv/mediawiki/w/extensions/MirahezeMagic/maintenance/test.php (START) [02:53:47] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:53:52] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:54:18] !log [paladox@test131] sudo -u www-data /usr/local/bin/foreachwikiindblist /srv/mediawiki/cache/databases.json /srv/mediawiki/w/extensions/MirahezeMagic/maintenance/test.php (END - exit=2) [02:54:22] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:55:44] !log [paladox@test131] sudo -u www-data /usr/local/bin/foreachwikiindblist /srv/mediawiki/cache/databases.json /srv/mediawiki/w/extensions/MirahezeMagic/maintenance/test.php (START) [02:55:50] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:55:51] !log [paladox@test131] sudo -u www-data /usr/local/bin/foreachwikiindblist /srv/mediawiki/cache/databases.json /srv/mediawiki/w/extensions/MirahezeMagic/maintenance/test.php (END - exit=2) [02:56:00] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:57:28] !log [paladox@test131] sudo -u www-data /usr/local/bin/foreachwikiindblist /srv/mediawiki/cache/databases.json /srv/mediawiki/w/extensions/MirahezeMagic/maintenance/test.php (START) [02:57:32] !log [paladox@test131] sudo -u www-data /usr/local/bin/foreachwikiindblist /srv/mediawiki/cache/databases.json /srv/mediawiki/w/extensions/MirahezeMagic/maintenance/test.php (END - exit=2) [02:57:32] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:57:38] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:57:47] PROBLEM - cp23 APT on cp23 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [02:59:32] !log [paladox@test131] sudo -u www-data /usr/local/bin/foreachwikiindblist /srv/mediawiki/cache/databases.json /srv/mediawiki/w/extensions/MirahezeMagic/maintenance/test.php (START) [02:59:36] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:00:33] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 9.91, 5.13, 2.81 [03:01:52] RECOVERY - cp23 APT on cp23 is OK: APT OK: 4 packages available for upgrade (0 critical updates). [03:01:53] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 1.93, 1.69, 1.44 [03:03:53] PROBLEM - test131 Current Load on test131 is CRITICAL: CRITICAL - load average: 2.79, 2.01, 1.58 [03:04:33] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 1.16, 3.54, 2.78 [03:06:33] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 0.92, 2.66, 2.55 [03:07:27] !log [paladox@test131] sudo -u www-data /usr/local/bin/foreachwikiindblist /srv/mediawiki/cache/databases.json /srv/mediawiki/w/extensions/MirahezeMagic/maintenance/test.php (END - exit=2) [03:07:31] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:07:39] !log [paladox@test131] sudo -u www-data /usr/local/bin/foreachwikiindblist /srv/mediawiki/cache/databases.json /srv/mediawiki/w/extensions/MirahezeMagic/maintenance/test.php (START) [03:07:44] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:27:56] PROBLEM - cp23 APT on cp23 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [03:29:54] RECOVERY - cp23 APT on cp23 is OK: APT OK: 4 packages available for upgrade (0 critical updates). [03:32:03] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.71, 1.84, 1.54 [03:34:00] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.88, 1.51, 1.45 [03:55:37] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.21, 1.57, 1.24 [03:57:37] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.56, 1.52, 1.26 [04:05:37] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 1.62, 2.29, 1.75 [04:09:37] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.49, 1.81, 1.67 [04:11:35] PROBLEM - wiki.projectdiablo2.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.projectdiablo2.com' expires in 15 day(s) (Tue 11 Oct 2022 03:46:46 GMT +0000). [04:11:37] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.25, 1.59, 1.60 [04:15:18] PROBLEM - cp22 APT on cp22 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [04:15:37] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.53, 1.75, 1.69 [04:17:14] RECOVERY - cp22 APT on cp22 is OK: APT OK: 4 packages available for upgrade (0 critical updates). [04:17:32] PROBLEM - cp22 Current Load on cp22 is CRITICAL: CRITICAL - load average: 6.02, 5.17, 2.51 [04:17:37] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.33, 1.53, 1.61 [04:18:42] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/39213490dd2f...3d46439c3988 [04:18:42] [url] Comparing 39213490dd2f...3d46439c3988 · miraheze/ssl · GitHub | github.com [04:18:43] [02miraheze/ssl] 07MirahezeSSLBot 033d46439 - Bot: Update SSL cert for wiki.projectdiablo2.com [04:19:32] PROBLEM - cp22 Current Load on cp22 is WARNING: WARNING - load average: 1.01, 3.54, 2.23 [04:21:32] RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 0.53, 2.52, 2.01 [04:21:34] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.54, 1.71, 1.34 [04:25:34] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.04, 1.84, 1.53 [04:27:33] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.67, 1.53, 1.46 [04:28:12] PROBLEM - cp23 APT on cp23 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [04:30:10] RECOVERY - cp23 APT on cp23 is OK: APT OK: 4 packages available for upgrade (0 critical updates). [04:38:52] PROBLEM - perpustaxaan.wiki - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'perpustaxaan.wiki' expires in 15 day(s) (Tue 11 Oct 2022 04:34:44 GMT +0000). [04:40:40] RECOVERY - wiki.projectdiablo2.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.projectdiablo2.com' will expire on Sat 24 Dec 2022 03:18:36 GMT +0000. [04:42:48] PROBLEM - az.wikiretet.ga - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'az.wikiretet.ga' expires in 15 day(s) (Tue 11 Oct 2022 04:40:37 GMT +0000). [04:45:18] PROBLEM - cp22 APT on cp22 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [04:45:45] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/3d46439c3988...2fac206a73ab [04:45:46] [url] Comparing 3d46439c3988...2fac206a73ab · miraheze/ssl · GitHub | github.com [04:45:47] [02miraheze/ssl] 07MirahezeSSLBot 032fac206 - Bot: Update SSL cert for perpustaxaan.wiki [04:47:15] RECOVERY - cp22 APT on cp22 is OK: APT OK: 4 packages available for upgrade (0 critical updates). [04:47:32] PROBLEM - cp22 Current Load on cp22 is WARNING: WARNING - load average: 3.50, 3.57, 2.15 [04:48:28] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/2fac206a73ab...2dfaeb0b4643 [04:48:29] [url] Comparing 2fac206a73ab...2dfaeb0b4643 · miraheze/ssl · GitHub | github.com [04:48:29] [02miraheze/ssl] 07MirahezeSSLBot 032dfaeb0 - Bot: Update SSL cert for az.wikiretet.ga [04:49:32] RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 2.75, 3.29, 2.22 [04:50:08] PROBLEM - www.wikiretet.ga - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'www.wikiretet.ga' expires in 15 day(s) (Tue 11 Oct 2022 04:42:43 GMT +0000). [04:50:55] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/2dfaeb0b4643...bf15adde9fe5 [04:50:56] [url] Comparing 2dfaeb0b4643...bf15adde9fe5 · miraheze/ssl · GitHub | github.com [04:50:57] [02miraheze/ssl] 07MirahezeSSLBot 03bf15add - Bot: Update SSL cert for www.wikiretet.ga [04:52:11] PROBLEM - istpcomputing.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'istpcomputing.com' expires in 15 day(s) (Tue 11 Oct 2022 04:37:06 GMT +0000). [04:57:51] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/bf15adde9fe5...f99abcbe60fd [04:57:52] [url] Comparing bf15adde9fe5...f99abcbe60fd · miraheze/ssl · GitHub | github.com [04:57:53] [02miraheze/ssl] 07MirahezeSSLBot 03f99abcb - Bot: Update SSL cert for istpcomputing.com [04:58:58] PROBLEM - www.istpcomputing.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'istpcomputing.com' expires in 15 day(s) (Tue 11 Oct 2022 04:37:06 GMT +0000). [05:08:13] RECOVERY - perpustaxaan.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'perpustaxaan.wiki' will expire on Sat 24 Dec 2022 03:45:40 GMT +0000. [05:13:33] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.74, 1.54, 1.32 [05:14:23] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.14, 1.59, 1.26 [05:15:18] PROBLEM - cp22 APT on cp22 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [05:15:34] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.30, 1.45, 1.31 [05:16:18] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.87, 1.24, 1.17 [05:17:35] PROBLEM - cp22 Current Load on cp22 is CRITICAL: CRITICAL - load average: 9.13, 5.07, 2.79 [05:19:20] RECOVERY - cp22 APT on cp22 is OK: APT OK: 4 packages available for upgrade (0 critical updates). [05:20:45] PROBLEM - cp23 APT on cp23 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [05:21:23] RECOVERY - istpcomputing.com - LetsEncrypt on sslhost is OK: OK - Certificate 'istpcomputing.com' will expire on Sat 24 Dec 2022 03:57:46 GMT +0000. [05:22:33] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 6.93, 3.98, 2.18 [05:23:32] RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 0.52, 3.17, 2.93 [05:23:33] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.64, 1.77, 1.49 [05:25:34] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.58, 1.28, 1.34 [05:26:59] RECOVERY - cp23 APT on cp23 is OK: APT OK: 4 packages available for upgrade (0 critical updates). [05:28:52] RECOVERY - www.istpcomputing.com - LetsEncrypt on sslhost is OK: OK - Certificate 'istpcomputing.com' will expire on Sat 24 Dec 2022 03:57:46 GMT +0000. [05:31:34] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.72, 1.90, 1.54 [05:33:33] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.96, 1.91, 1.58 [05:34:33] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 0.45, 3.20, 3.95 [05:35:33] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.91, 1.48, 1.46 [05:38:33] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 0.53, 1.72, 3.16 [05:42:48] RECOVERY - az.wikiretet.ga - LetsEncrypt on sslhost is OK: OK - Certificate 'az.wikiretet.ga' will expire on Sat 24 Dec 2022 03:48:22 GMT +0000. [05:47:30] RECOVERY - www.wikiretet.ga - LetsEncrypt on sslhost is OK: OK - Certificate 'www.wikiretet.ga' will expire on Sat 24 Dec 2022 03:50:50 GMT +0000. [05:58:25] PROBLEM - cp23 APT on cp23 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [06:00:35] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 10.25, 5.30, 3.13 [06:03:30] PROBLEM - cp23 PowerDNS Recursor on cp23 is CRITICAL: CRITICAL - Plugin timed out while executing system call [06:05:28] RECOVERY - cp23 PowerDNS Recursor on cp23 is OK: DNS OK: 0.483 seconds response time. miraheze.org returns 109.228.51.216,217.174.247.33,2a00:da00:1800:326::1,2a00:da00:1800:328::1 [06:07:33] !log [paladox@test131] sudo -u www-data /usr/local/bin/foreachwikiindblist /srv/mediawiki/cache/databases.json /srv/mediawiki/w/extensions/MirahezeMagic/maintenance/test.php (END - exit=0) [06:07:37] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:14:00] PROBLEM - cp23 PowerDNS Recursor on cp23 is CRITICAL: CRITICAL - Plugin timed out while executing system call [06:14:01] PROBLEM - cp23 SSH on cp23 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:16:03] RECOVERY - cp23 SSH on cp23 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [06:16:08] RECOVERY - cp23 PowerDNS Recursor on cp23 is OK: DNS OK: 9.560 seconds response time. miraheze.org returns 109.228.51.216,217.174.247.33,2a00:da00:1800:326::1,2a00:da00:1800:328::1 [06:19:43] RECOVERY - cp23 APT on cp23 is OK: APT OK: 4 packages available for upgrade (0 critical updates). [06:39:58] PROBLEM - cp23 APT on cp23 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [06:41:24] PROBLEM - cp20 APT on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [06:41:55] RECOVERY - cp23 APT on cp23 is OK: APT OK: 4 packages available for upgrade (0 critical updates). [06:42:31] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [06:43:21] RECOVERY - cp20 APT on cp20 is OK: APT OK: 38 packages available for upgrade (0 critical updates). [06:44:27] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 0.00, 0.00, 0.00 [06:44:47] PROBLEM - cp22 APT on cp22 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [06:47:32] PROBLEM - cp22 Current Load on cp22 is CRITICAL: CRITICAL - load average: 8.74, 6.61, 3.18 [06:48:50] RECOVERY - cp22 APT on cp22 is OK: APT OK: 4 packages available for upgrade (0 critical updates). [06:50:33] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 0.55, 1.53, 3.93 [06:51:32] PROBLEM - cp22 Current Load on cp22 is WARNING: WARNING - load average: 1.34, 3.46, 2.65 [06:53:32] RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 0.91, 2.61, 2.43 [06:54:33] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 5.32, 2.59, 3.73 [06:56:33] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 2.15, 2.37, 3.51 [06:58:33] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.54, 2.35, 3.39 [07:01:45] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 1.42, 2.61, 4.00 [07:03:45] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.29, 3.74, 4.24 [07:11:53] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 1.06, 1.57, 1.95 [07:17:53] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 0.95, 1.16, 1.63 [07:23:45] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 1.14, 2.46, 3.78 [07:27:46] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.14, 1.99, 3.31 [07:29:34] PROBLEM - cp23 APT on cp23 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [07:30:33] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 4.79, 3.11, 2.18 [07:31:32] RECOVERY - cp23 APT on cp23 is OK: APT OK: 4 packages available for upgrade (0 critical updates). [07:32:33] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.20, 2.29, 1.98 [07:38:20] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/deleteBatch.php --wiki=monstergirlencyclopediawiki --r=Requested at [[phab:T9754 [07:38:23] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:45:19] PROBLEM - cp22 APT on cp22 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [07:46:21] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.15, 4.41, 3.41 [07:47:15] RECOVERY - cp22 APT on cp22 is OK: APT OK: 4 packages available for upgrade (0 critical updates). [07:47:32] PROBLEM - cp22 Current Load on cp22 is CRITICAL: CRITICAL - load average: 2.75, 4.09, 2.34 [07:49:32] RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 0.62, 2.83, 2.09 [07:50:16] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.52, 3.78, 3.36 [07:51:44] PROBLEM - cp23 APT on cp23 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [07:53:50] RECOVERY - cp23 APT on cp23 is OK: APT OK: 4 packages available for upgrade (0 critical updates). [07:54:11] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.78, 5.00, 3.93 [07:54:33] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 4.11, 3.44, 2.26 [07:56:08] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.00, 3.99, 3.69 [07:56:33] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 2.39, 2.99, 2.23 [08:00:03] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 10.26, 6.23, 4.56 [08:06:48] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [08:07:52] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.49, 3.51, 4.00 [08:11:40] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 0.00, 0.00, 0.00 [08:13:45] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 7.95, 4.16, 4.00 [08:14:25] PROBLEM - cp23 APT on cp23 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [08:15:45] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.70, 3.57, 3.82 [08:16:22] RECOVERY - cp23 APT on cp23 is OK: APT OK: 4 packages available for upgrade (0 critical updates). [08:17:01] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 3.53, 3.04, 2.36 [08:17:45] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 9.88, 5.81, 4.59 [08:18:57] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 2.78, 2.85, 2.36 [08:25:46] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 1.39, 3.05, 3.79 [08:27:45] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.46, 3.52, 3.84 [08:31:45] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.31, 3.64, 3.85 [08:37:45] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.03, 4.06, 4.00 [08:39:45] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.47, 3.58, 3.84 [08:46:48] PROBLEM - cp23 APT on cp23 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [08:47:45] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.87, 2.85, 3.31 [08:48:45] RECOVERY - cp23 APT on cp23 is OK: APT OK: 4 packages available for upgrade (0 critical updates). [08:56:04] PROBLEM - cp20 APT on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [08:58:16] RECOVERY - cp20 APT on cp20 is OK: APT OK: 38 packages available for upgrade (0 critical updates). [08:58:20] PROBLEM - cp23 APT on cp23 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [08:59:11] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 15.99, 6.31, 3.25 [09:02:25] RECOVERY - cp23 APT on cp23 is OK: APT OK: 4 packages available for upgrade (0 critical updates). [09:05:01] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 1.23, 3.41, 3.01 [09:06:21] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 7.21, 4.71, 3.77 [09:06:58] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 0.47, 2.42, 2.70 [09:10:16] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.36, 3.95, 3.74 [09:14:11] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.77, 2.71, 3.27 [09:14:46] PROBLEM - cp23 APT on cp23 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [09:16:44] RECOVERY - cp23 APT on cp23 is OK: APT OK: 4 packages available for upgrade (0 critical updates). [09:23:10] PROBLEM - cp23 APT on cp23 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [09:25:08] RECOVERY - cp23 APT on cp23 is OK: APT OK: 4 packages available for upgrade (0 critical updates). [09:29:45] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 6.17, 4.34, 3.61 [09:31:45] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.32, 3.85, 3.51 [09:33:46] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.91, 3.12, 3.28 [09:34:05] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/deleteBatch.php --wiki=monstergirlencyclopediawiki --r=Requested at [[phab:T9754 [09:34:06] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/deleteBatch.php --wiki=monstergirlencyclopediawiki --r=Requested at [[phab:T9754 [09:34:09] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [09:34:14] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [09:39:45] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.81, 3.36, 3.29 [09:41:45] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.48, 3.06, 3.19 [09:52:32] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.88, 3.89, 3.57 [09:54:30] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.81, 3.12, 3.33 [09:58:21] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.55, 3.57, 3.47 [09:58:35] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 4.79, 3.84, 2.45 [10:00:19] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 0.95, 2.59, 3.12 [10:00:33] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.82, 3.00, 2.31 [10:14:11] PROBLEM - cp23 APT on cp23 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [10:14:16] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [10:16:19] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 0.02, 0.02, 0.00 [10:20:24] RECOVERY - cp23 APT on cp23 is OK: APT OK: 4 packages available for upgrade (0 critical updates). [10:24:52] PROBLEM - cp23 APT on cp23 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [10:26:58] RECOVERY - cp23 APT on cp23 is OK: APT OK: 4 packages available for upgrade (0 critical updates). [10:27:17] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 3.71, 3.38, 2.50 [10:29:14] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.25, 2.61, 2.33 [10:34:05] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/deleteBatch.php --wiki=monstergirlencyclopediawiki --r=Requested at [[phab:T9754 [10:34:08] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [10:34:37] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 7.47, 4.03, 2.91 [10:36:35] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.24, 3.17, 2.73 [10:45:19] PROBLEM - cp22 APT on cp22 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [10:47:22] RECOVERY - cp22 APT on cp22 is OK: APT OK: 4 packages available for upgrade (0 critical updates). [10:47:32] PROBLEM - cp22 Current Load on cp22 is CRITICAL: CRITICAL - load average: 11.82, 8.38, 4.02 [10:53:32] RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 0.72, 2.91, 2.90 [10:54:32] PROBLEM - cp23 APT on cp23 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [10:56:33] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 3.77, 3.36, 2.33 [10:58:33] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 3.16, 3.35, 2.46 [11:00:45] RECOVERY - cp23 APT on cp23 is OK: APT OK: 4 packages available for upgrade (0 critical updates). [11:07:46] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.04, 3.89, 3.05 [11:09:45] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.10, 3.21, 2.90 [11:17:04] PROBLEM - cp23 APT on cp23 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [11:19:01] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 3.91, 3.52, 2.59 [11:19:02] RECOVERY - cp23 APT on cp23 is OK: APT OK: 4 packages available for upgrade (0 critical updates). [11:20:57] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.18, 2.62, 2.37 [11:33:46] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 8.05, 4.54, 3.42 [11:34:28] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [11:35:46] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.54, 3.98, 3.35 [11:36:23] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 0.03, 0.01, 0.00 [11:41:45] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.17, 2.67, 2.99 [11:46:58] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [11:49:05] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 0.05, 0.02, 0.00 [11:53:40] PROBLEM - cp23 NTP time on cp23 is WARNING: NTP WARNING: Offset 0.1044543684 secs [11:59:42] PROBLEM - cp23 APT on cp23 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [11:59:43] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 5.40, 3.97, 2.71 [12:01:40] RECOVERY - cp23 APT on cp23 is OK: APT OK: 4 packages available for upgrade (0 critical updates). [12:01:40] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.73, 3.25, 2.61 [12:01:45] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.64, 3.60, 2.98 [12:03:38] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [12:03:46] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.69, 3.34, 2.96 [12:05:37] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 0.00, 0.00, 0.00 [12:09:40] RECOVERY - cp23 NTP time on cp23 is OK: NTP OK: Offset 0.08381891251 secs [12:14:00] PROBLEM - cp23 APT on cp23 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [12:15:15] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 8.76, 4.90, 3.20 [12:18:52] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [12:20:13] RECOVERY - cp23 APT on cp23 is OK: APT OK: 4 packages available for upgrade (0 critical updates). [12:20:48] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 0.00, 0.00, 0.00 [12:31:13] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.40, 3.52, 2.91 [12:32:49] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 1.62, 2.80, 3.79 [12:33:11] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.58, 3.49, 2.97 [12:35:08] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.36, 3.09, 2.89 [12:36:43] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.17, 1.97, 3.22 [12:46:06] PROBLEM - roblox-wiki.tk - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - roblox-wiki.tk All nameservers failed to answer the query. [12:57:34] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 6.77, 4.28, 3.31 [12:59:23] PROBLEM - cp23 APT on cp23 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [13:00:33] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 5.65, 4.09, 3.00 [13:03:28] RECOVERY - cp23 APT on cp23 is OK: APT OK: 4 packages available for upgrade (0 critical updates). [13:04:33] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.40, 2.95, 2.81 [13:05:58] PROBLEM - cp20 APT on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [13:07:55] RECOVERY - cp20 APT on cp20 is OK: APT OK: 38 packages available for upgrade (0 critical updates). [13:15:12] RECOVERY - roblox-wiki.tk - reverse DNS on sslhost is OK: SSL OK - roblox-wiki.tk reverse DNS resolves to cp23.miraheze.org - NS RECORDS OK [13:22:24] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.77, 1.41, 1.07 [13:24:21] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.26, 1.31, 1.08 [13:25:12] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/deleteBatch.php --wiki=monstergirlencyclopediawiki --r=Requested at [[phab:T9754 [13:25:16] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [13:45:18] PROBLEM - cp22 APT on cp22 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [13:46:57] PROBLEM - cp23 APT on cp23 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [13:47:32] PROBLEM - cp22 Current Load on cp22 is CRITICAL: CRITICAL - load average: 9.63, 5.41, 2.80 [13:48:38] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 6.53, 4.03, 2.59 [13:48:56] RECOVERY - cp23 APT on cp23 is OK: APT OK: 4 packages available for upgrade (0 critical updates). [13:49:21] RECOVERY - cp22 APT on cp22 is OK: APT OK: 4 packages available for upgrade (0 critical updates). [13:50:35] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.88, 3.08, 2.41 [13:52:20] PROBLEM - cp20 APT on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [13:53:32] PROBLEM - cp22 Current Load on cp22 is WARNING: WARNING - load average: 0.90, 3.83, 3.21 [13:54:18] RECOVERY - cp20 APT on cp20 is OK: APT OK: 38 packages available for upgrade (0 critical updates). [13:55:32] RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 1.70, 3.20, 3.06 [13:59:23] PROBLEM - cp23 APT on cp23 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [14:00:33] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 4.73, 4.46, 3.16 [14:01:20] RECOVERY - cp23 APT on cp23 is OK: APT OK: 4 packages available for upgrade (0 critical updates). [14:02:33] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.45, 3.38, 2.93 [14:07:18] PROBLEM - cp20 APT on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [14:09:15] RECOVERY - cp20 APT on cp20 is OK: APT OK: 38 packages available for upgrade (0 critical updates). [14:15:18] PROBLEM - cp22 APT on cp22 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [14:15:40] PROBLEM - cp23 APT on cp23 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [14:17:15] RECOVERY - cp22 APT on cp22 is OK: APT OK: 4 packages available for upgrade (0 critical updates). [14:17:32] PROBLEM - cp22 Current Load on cp22 is CRITICAL: CRITICAL - load average: 5.39, 4.68, 3.11 [14:18:33] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 11.39, 7.02, 4.05 [14:19:32] PROBLEM - cp22 Current Load on cp22 is WARNING: WARNING - load average: 1.56, 3.51, 2.87 [14:21:32] RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 1.57, 2.74, 2.66 [14:21:54] RECOVERY - cp23 APT on cp23 is OK: APT OK: 4 packages available for upgrade (0 critical updates). [14:26:33] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 2.44, 3.49, 3.57 [14:27:35] PROBLEM - wikileague.cf - LetsEncrypt on sslhost is CRITICAL: connect to address wikileague.cf and port 443: Network is unreachableHTTP CRITICAL - Unable to open TCP socket [14:30:33] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.26, 2.61, 3.22 [14:34:25] PROBLEM - wikileague.cf - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wikileague.cf could not be found [14:46:26] PROBLEM - cp23 APT on cp23 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [14:52:38] RECOVERY - cp23 APT on cp23 is OK: APT OK: 4 packages available for upgrade (0 critical updates). [14:57:06] PROBLEM - cp23 APT on cp23 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [14:58:33] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 3.93, 3.39, 2.63 [14:59:04] RECOVERY - cp23 APT on cp23 is OK: APT OK: 4 packages available for upgrade (0 critical updates). [14:59:05] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/deleteBatch.php --wiki=monstergirlencyclopediawiki --r=Requested at [[phab:T9754 [14:59:06] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/deleteBatch.php --wiki=monstergirlencyclopediawiki --r=Requested at [[phab:T9754 [14:59:10] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:59:14] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:00:33] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.09, 2.49, 2.39 [15:09:11] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [15:11:06] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 0.02, 0.02, 0.00 [15:14:19] PROBLEM - cp22 APT on cp22 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [15:16:16] RECOVERY - cp22 APT on cp22 is OK: APT OK: 4 packages available for upgrade (0 critical updates). [15:24:50] PROBLEM - cp23 APT on cp23 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [15:26:35] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 19.53, 9.06, 4.57 [15:26:53] PROBLEM - cp23 PowerDNS Recursor on cp23 is CRITICAL: CRITICAL - Plugin timed out while executing system call [15:27:57] PROBLEM - cp23 SSH on cp23 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:28:51] RECOVERY - cp23 PowerDNS Recursor on cp23 is OK: DNS OK: 0.156 seconds response time. miraheze.org returns 109.228.51.216,217.174.247.33,2a00:da00:1800:326::1,2a00:da00:1800:328::1 [15:28:58] RECOVERY - cp23 APT on cp23 is OK: APT OK: 4 packages available for upgrade (0 critical updates). [15:29:54] RECOVERY - cp23 SSH on cp23 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [15:30:17] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.79, 1.65, 1.30 [15:32:14] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.07, 1.40, 1.25 [15:33:28] PROBLEM - cp23 APT on cp23 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [15:40:54] PROBLEM - cp22 NTP time on cp22 is WARNING: NTP WARNING: Offset 0.119307667 secs [15:43:32] PROBLEM - cp22 Current Load on cp22 is CRITICAL: CRITICAL - load average: 6.30, 3.42, 2.00 [15:43:56] PROBLEM - cp23 Varnish Backends on cp23 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [15:43:57] PROBLEM - cp22 APT on cp22 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [15:44:59] PROBLEM - cp23 PowerDNS Recursor on cp23 is CRITICAL: CRITICAL - Plugin timed out while executing system call [15:45:52] PROBLEM - cp23 Puppet on cp23 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [15:46:25] PROBLEM - cp23 SSH on cp23 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:48:00] RECOVERY - cp22 APT on cp22 is OK: APT OK: 4 packages available for upgrade (0 critical updates). [15:49:06] PROBLEM - cp23 conntrack_table_size on cp23 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [15:51:19] PROBLEM - cp23 HTTP 4xx/5xx ERROR Rate on cp23 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [15:51:23] PROBLEM - ns1 GDNSD Datacenters on ns1 is CRITICAL: CRITICAL - 2 datacenters are down: 109.228.51.216/cpweb, 2a00:da00:1800:328::1/cpweb [15:51:32] PROBLEM - cp22 Current Load on cp22 is WARNING: WARNING - load average: 2.38, 3.65, 2.92 [15:52:20] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2a00:da00:1800:328::1/cpweb [15:53:32] RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 1.89, 3.07, 2.79 [15:53:50] PROBLEM - cp20 APT on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [15:54:40] PROBLEM - cp23 Varnish Backends on cp23 is WARNING: No backends detected. If this is an error, see readme.txt [15:54:42] RECOVERY - cp23 SSH on cp23 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [15:54:54] RECOVERY - cp22 NTP time on cp22 is OK: NTP OK: Offset 0.08756169677 secs [15:54:58] RECOVERY - cp23 APT on cp23 is OK: APT OK: 4 packages available for upgrade (0 critical updates). [15:55:15] !log reboot cp23 which picks up a network change to prevent it loosing its ipv6 address again [15:55:16] RECOVERY - ns1 GDNSD Datacenters on ns1 is OK: OK - all datacenters are online [15:55:19] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:55:50] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.47, 0.48, 0.17 [15:55:56] RECOVERY - cp23 PowerDNS Recursor on cp23 is OK: DNS OK: 0.110 seconds response time. miraheze.org returns 109.228.51.216,217.174.247.33,2a00:da00:1800:326::1,2a00:da00:1800:328::1 [15:56:15] RECOVERY - cp23 HTTP 4xx/5xx ERROR Rate on cp23 is OK: OK - NGINX Error Rate is 4% [15:56:20] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [15:56:34] RECOVERY - cp23 Varnish Backends on cp23 is OK: All 14 backends are healthy [15:56:50] RECOVERY - cp23 Puppet on cp23 is OK: OK: Puppet is currently enabled, last run 53 seconds ago with 0 failures [15:57:03] RECOVERY - cp23 conntrack_table_size on cp23 is OK: OK: nf_conntrack is 3 % full [15:57:20] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/deleteBatch.php --wiki=monstergirlencyclopediawiki --r=Requested at [[phab:T9754 [15:57:31] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:58:44] RECOVERY - cp20 APT on cp20 is OK: APT OK: 38 packages available for upgrade (0 critical updates). [16:02:53] PROBLEM - pwiki.arkcls.com - LetsEncrypt on sslhost is CRITICAL: connect to address pwiki.arkcls.com and port 443: Network is unreachableHTTP CRITICAL - Unable to open TCP socket [16:05:33] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.36, 4.01, 3.01 [16:07:28] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.57, 3.77, 3.03 [16:09:22] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.58, 3.21, 2.91 [16:32:08] RECOVERY - pwiki.arkcls.com - LetsEncrypt on sslhost is OK: OK - Certificate 'pwiki.arkcls.com' will expire on Sat 05 Nov 2022 07:46:31 GMT +0000. [16:37:58] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [16:41:51] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [16:43:00] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 0.00, 0.01, 0.00 [16:46:06] PROBLEM - roblox-wiki.tk - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - roblox-wiki.tk All nameservers failed to answer the query. [16:46:42] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 0.07, 0.02, 0.00 [16:52:23] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.96, 1.57, 1.35 [16:53:40] PROBLEM - cp23 NTP time on cp23 is WARNING: NTP WARNING: Offset 0.1003358364 secs [16:54:21] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.52, 1.61, 1.40 [17:03:40] RECOVERY - cp23 NTP time on cp23 is OK: NTP OK: Offset 0.0876429975 secs [17:05:30] PROBLEM - cp20 APT on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [17:07:57] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 3.09, 4.42, 2.86 [17:10:24] RECOVERY - cp20 APT on cp20 is OK: APT OK: 38 packages available for upgrade (0 critical updates). [17:15:13] RECOVERY - roblox-wiki.tk - reverse DNS on sslhost is OK: SSL OK - roblox-wiki.tk reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [17:19:41] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 0.87, 1.26, 1.88 [17:23:36] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.12, 1.73, 1.92 [17:24:27] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [17:25:34] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.93, 1.80, 1.92 [17:29:23] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 0.02, 0.04, 0.00 [17:37:34] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.65, 1.29, 1.60 [17:45:37] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.16, 2.31, 1.52 [17:47:34] PROBLEM - cp20 APT on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [17:52:12] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.62, 2.99, 2.59 [17:52:28] RECOVERY - cp20 APT on cp20 is OK: APT OK: 38 packages available for upgrade (0 critical updates). [17:54:47] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 1.99, 2.45, 2.44 [17:55:57] PROBLEM - cp32 ferm_active on cp32 is UNKNOWN: NRPE: Unable to read output [17:55:58] PROBLEM - cp32 conntrack_table_size on cp32 is UNKNOWN: NRPE: Unable to read output [17:56:04] PROBLEM - ping6 on cp33 is WARNING: PING WARNING - Packet loss = 0%, RTA = 106.29 ms [17:56:04] PROBLEM - cp33 ferm_active on cp33 is UNKNOWN: NRPE: Unable to read output [17:56:28] PROBLEM - cp32 Puppet on cp32 is UNKNOWN: NRPE: Unable to read output [17:56:44] PROBLEM - ping6 on cp32 is WARNING: PING WARNING - Packet loss = 0%, RTA = 105.53 ms [17:57:53] RECOVERY - cp32 ferm_active on cp32 is OK: OK ferm input default policy is set [17:57:54] RECOVERY - cp32 conntrack_table_size on cp32 is OK: OK: nf_conntrack is 0 % full [17:58:03] RECOVERY - cp33 ferm_active on cp33 is OK: OK ferm input default policy is set [17:58:24] RECOVERY - cp32 Puppet on cp32 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [17:59:12] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 0.76, 1.62, 1.76 [18:00:13] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [18:01:22] PROBLEM - cp22 NTP time on cp22 is WARNING: NTP WARNING: Offset 0.1006199419 secs [18:03:09] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.98, 1.29, 1.60 [18:05:12] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 0.01, 0.01, 0.00 [18:09:36] PROBLEM - test131 Current Load on test131 is CRITICAL: CRITICAL - load average: 2.09, 1.65, 1.28 [18:11:22] RECOVERY - cp22 NTP time on cp22 is OK: NTP OK: Offset 0.07756561041 secs [18:13:35] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 1.93, 1.88, 1.47 [18:15:35] PROBLEM - test131 Current Load on test131 is CRITICAL: CRITICAL - load average: 2.18, 1.98, 1.56 [18:19:34] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 1.95, 1.99, 1.67 [18:20:13] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [18:21:34] PROBLEM - test131 Current Load on test131 is CRITICAL: CRITICAL - load average: 2.13, 2.03, 1.73 [18:21:45] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.48, 2.00, 1.66 [18:22:07] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 0.00, 0.04, 0.05 [18:26:04] [02miraheze/puppet] 07JohnFLewis pushed 031 commit to 03master [+2/-2/±1] 13https://github.com/miraheze/puppet/compare/e276dff7ec57...c87e27302c51 [18:26:05] [url] Comparing e276dff7ec57...c87e27302c51 · miraheze/puppet · GitHub | github.com [18:26:06] [02miraheze/puppet] 07JohnFLewis 03c87e273 - varnish: deploy cp32/33 [18:27:36] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.56, 1.99, 1.80 [18:31:30] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.29, 1.60, 1.68 [18:34:44] PROBLEM - cp33 Puppet on cp33 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[varnish] [18:35:21] PROBLEM - cp32 Puppet on cp32 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[varnish] [18:36:44] RECOVERY - cp33 Puppet on cp33 is OK: OK: Puppet is currently enabled, last run 10 seconds ago with 0 failures [18:37:18] RECOVERY - cp32 Puppet on cp32 is OK: OK: Puppet is currently enabled, last run 48 seconds ago with 0 failures [18:37:43] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.94, 1.72, 1.53 [18:39:41] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.51, 1.60, 1.51 [18:56:46] PROBLEM - cp33 HTTP 4xx/5xx ERROR Rate on cp33 is CRITICAL: CRITICAL - NGINX Error Rate is 95% [18:56:53] PROBLEM - cp33 Stunnel HTTP for test131 on cp33 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:56:58] PROBLEM - cp32 HTTP 4xx/5xx ERROR Rate on cp32 is CRITICAL: CRITICAL - NGINX Error Rate is 99% [18:57:20] PROBLEM - cp33 Stunnel HTTP for reports121 on cp33 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:57:48] PROBLEM - cp32 Stunnel HTTP for test131 on cp32 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:59:16] RECOVERY - cp33 Stunnel HTTP for reports121 on cp33 is OK: HTTP OK: HTTP/1.1 200 OK - 10996 bytes in 0.375 second response time [18:59:48] RECOVERY - cp32 Stunnel HTTP for test131 on cp32 is OK: HTTP OK: HTTP/1.1 200 OK - 14740 bytes in 0.430 second response time [19:00:54] RECOVERY - cp33 Stunnel HTTP for test131 on cp33 is OK: HTTP OK: HTTP/1.1 200 OK - 14740 bytes in 0.419 second response time [19:01:28] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 5.04, 4.10, 2.52 [19:04:21] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [19:06:34] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 0.00, 0.02, 0.00 [19:13:02] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 3.14, 2.25, 1.83 [19:13:33] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 0.79, 1.33, 1.88 [19:14:31] PROBLEM - cp22 APT on cp22 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [19:14:48] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.21, 1.67, 1.96 [19:14:54] PROBLEM - cp22 Current Load on cp22 is CRITICAL: CRITICAL - load average: 7.88, 4.58, 2.42 [19:14:59] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.16, 1.84, 1.73 [19:16:57] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.97, 2.19, 1.86 [19:17:23] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 1.03, 1.16, 1.68 [19:18:37] RECOVERY - cp22 APT on cp22 is OK: APT OK: 4 packages available for upgrade (0 critical updates). [19:22:36] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.61, 1.18, 1.63 [19:22:54] PROBLEM - cp22 Current Load on cp22 is WARNING: WARNING - load average: 0.59, 3.99, 3.61 [19:23:54] [02miraheze/dns] 07JohnFLewis pushed 031 commit to 03master [+0/-0/±2] 13https://github.com/miraheze/dns/compare/eea44ac70e6e...9cd12f15480c [19:23:55] [url] Comparing eea44ac70e6e...9cd12f15480c · miraheze/dns · GitHub | github.com [19:23:56] [02miraheze/dns] 07JohnFLewis 039cd12f1 - deploy cp32/33 to production [19:24:54] RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 0.50, 2.81, 3.22 [19:25:58] RECOVERY - cp33 HTTP 4xx/5xx ERROR Rate on cp33 is OK: OK - NGINX Error Rate is 4% [19:26:02] RECOVERY - cp32 HTTP 4xx/5xx ERROR Rate on cp32 is OK: OK - NGINX Error Rate is 2% [19:28:44] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.43, 1.93, 1.98 [19:32:40] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.36, 1.08, 1.61 [19:33:58] PROBLEM - cp30 Stunnel HTTP for mw122 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:36:02] RECOVERY - cp30 Stunnel HTTP for mw122 on cp30 is OK: HTTP OK: HTTP/1.1 204 No Content - 352 bytes in 6.707 second response time [19:36:07] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.63, 3.56, 3.03 [19:40:01] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.82, 3.91, 3.26 [19:40:23] PROBLEM - cp23 NTP time on cp23 is WARNING: NTP WARNING: Offset 0.1086063683 secs [19:43:55] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.16, 3.96, 3.45 [19:44:43] PROBLEM - cp22 APT on cp22 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [19:46:08] PROBLEM - roblox-wiki.tk - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - roblox-wiki.tk All nameservers failed to answer the query. [19:46:41] RECOVERY - cp22 APT on cp22 is OK: APT OK: 4 packages available for upgrade (0 critical updates). [19:47:50] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.35, 3.33, 3.34 [19:47:53] [02miraheze/mw-config] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://github.com/miraheze/mw-config/commit/cbbf183548a5 [19:47:55] [02miraheze/mw-config] 07paladox 03cbbf183 - Add cp32/33 to wgCdnServers and remove cp30/31 [19:47:56] [02mw-config] 07paladox created branch 03paladox-patch-1 - 13https://github.com/miraheze/mw-config [19:47:57] [url] Page not found · GitHub · GitHub | github.com [19:47:58] [02mw-config] 07paladox opened pull request 03#4908: Add cp32/33 to wgCdnServers and remove cp30/31 - 13https://github.com/miraheze/mw-config/pull/4908 [19:47:58] [url] Page not found · GitHub · GitHub | github.com [19:48:06] [02miraheze/mw-config] 07paladox deleted branch 03paladox-patch-1 [19:48:07] [02mw-config] 07paladox closed pull request 03#4908: Add cp32/33 to wgCdnServers and remove cp30/31 - 13https://github.com/miraheze/mw-config/pull/4908 [19:48:08] [url] Page not found · GitHub · GitHub | github.com [19:48:09] [02mw-config] 07paladox deleted branch 03paladox-patch-1 - 13https://github.com/miraheze/mw-config [19:48:10] [url] Page not found · GitHub · GitHub | github.com [19:48:10] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/00fb4fbbabab...2001e1434963 [19:48:11] [url] Comparing 00fb4fbbabab...2001e1434963 · miraheze/mw-config · GitHub | github.com [19:48:12] [02miraheze/mw-config] 07paladox 032001e14 - Add cp32/33 to wgCdnServers and remove cp30/31 (#4908) [19:48:30] !log [paladox@mwtask141] starting deploy of {'pull': 'config', 'config': True} to all [19:49:00] miraheze/mw-config - paladox the build passed. [19:49:12] !log [paladox@mwtask141] DEPLOY ABORTED: Canary check failed for publictestwiki.com@mw122.miraheze.org [19:49:21] !log [paladox@mwtask141] starting deploy of {'pull': 'config', 'config': True, 'force': True} to all [19:49:28] miraheze/mw-config - paladox the build passed. [19:49:34] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:49:58] !log [paladox@mwtask141] finished deploy of {'pull': 'config', 'config': True, 'force': True} to all - SUCCESS in 36s [19:50:24] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:50:36] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:50:46] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:51:41] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.54, 3.73, 3.53 [19:51:48] paladox: why did deploy fail? [19:51:48] !log [paladox@test131] starting deploy of {'pull': 'config', 'config': True} to test131 [19:51:49] !log [paladox@test131] finished deploy of {'pull': 'config', 'config': True} to test131 - SUCCESS in 1s [19:51:57] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:51:57] !log [paladox@test131] starting deploy of {'config': True} to test131 [19:51:58] !log [paladox@test131] finished deploy of {'config': True} to test131 - SUCCESS in 0s [19:52:02] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:52:06] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:52:13] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:52:18] said mw122 was down, works now. [19:54:24] RECOVERY - cp23 NTP time on cp23 is OK: NTP OK: Offset 0.09417799115 secs [19:55:35] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 1.82, 3.01, 3.31 [19:58:32] PROBLEM - cp23 APT on cp23 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [19:59:27] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.01, 3.46, 3.44 [20:00:30] RECOVERY - cp23 APT on cp23 is OK: APT OK: 4 packages available for upgrade (0 critical updates). [20:00:43] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 4.94, 4.15, 2.23 [20:01:24] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.92, 3.24, 3.37 [20:02:42] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.14, 2.99, 2.04 [20:02:46] paladox: will have been workers then [20:02:47] Bleh [20:05:16] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.11, 3.41, 3.42 [20:15:16] RECOVERY - roblox-wiki.tk - reverse DNS on sslhost is OK: SSL OK - roblox-wiki.tk reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [20:19:15] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.25, 2.98, 3.30 [20:50:53] PROBLEM - cp22 NTP time on cp22 is WARNING: NTP WARNING: Offset 0.1012270153 secs [21:00:42] RECOVERY - cp22 NTP time on cp22 is OK: NTP OK: Offset 0.0908652842 secs [21:08:36] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 6.58, 4.04, 3.18 [21:10:58] PROBLEM - cp22 Stunnel HTTP for mw122 on cp22 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:12:00] PROBLEM - mw131 MediaWiki Rendering on mw131 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:12:36] PROBLEM - cp32 Stunnel HTTP for mw122 on cp32 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:12:55] RECOVERY - cp22 Stunnel HTTP for mw122 on cp22 is OK: HTTP OK: HTTP/1.1 204 No Content - 352 bytes in 0.079 second response time [21:14:31] RECOVERY - cp32 Stunnel HTTP for mw122 on cp32 is OK: HTTP OK: HTTP/1.1 204 No Content - 352 bytes in 0.309 second response time [21:14:35] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.10, 3.91, 3.46 [21:16:01] RECOVERY - mw131 MediaWiki Rendering on mw131 is OK: HTTP OK: HTTP/1.1 200 OK - 30903 bytes in 0.401 second response time [21:16:34] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.02, 3.93, 3.51 [21:20:33] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.74, 3.60, 3.50 [21:26:32] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.15, 3.84, 3.65 [21:30:31] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.84, 3.29, 3.47 [21:32:30] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.53, 2.95, 3.32 [22:14:21] [02miraheze/puppet] 07JohnFLewis pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/c87e27302c51...941a1fa60961 [22:14:22] [url] Comparing c87e27302c51...941a1fa60961 · miraheze/puppet · GitHub | github.com [22:14:23] [02miraheze/puppet] 07JohnFLewis 03941a1fa - stunnel: make empty TCP request to check connection, not HTTP response [22:26:26] PROBLEM - cp33 Stunnel for mail121 on cp33 is UNKNOWN: Usage:check_tcp -H host -p port [-w ] [-c ] [-s ][-e ] [-q ][-m ] [-d ][-t ] [-r ] [-M ] [-v] [-4|-6] [-j][-D [,]] [-S ] [-E] [22:26:30] PROBLEM - cp33 Stunnel for mw141 on cp33 is UNKNOWN: Usage:check_tcp -H host -p port [-w ] [-c ] [-s ][-e ] [-q ][-m ] [-d ][-t ] [-r ] [-M ] [-v] [-4|-6] [-j][-D [,]] [-S ] [-E] [22:26:35] PROBLEM - cp33 Stunnel for phab121 on cp33 is UNKNOWN: Usage:check_tcp -H host -p port [-w ] [-c ] [-s ][-e ] [-q ][-m ] [-d ][-t ] [-r ] [-M ] [-v] [-4|-6] [-j][-D [,]] [-S ] [-E] [22:26:35] PROBLEM - cp33 Stunnel for mw121 on cp33 is UNKNOWN: Usage:check_tcp -H host -p port [-w ] [-c ] [-s ][-e ] [-q ][-m ] [-d ][-t ] [-r ] [-M ] [-v] [-4|-6] [-j][-D [,]] [-S ] [-E] [22:26:39] PROBLEM - cp33 Stunnel for mw131 on cp33 is UNKNOWN: Usage:check_tcp -H host -p port [-w ] [-c ] [-s ][-e ] [-q ][-m ] [-d ][-t ] [-r ] [-M ] [-v] [-4|-6] [-j][-D [,]] [-S ] [-E] [22:26:43] PROBLEM - cp33 Stunnel for puppet141 on cp33 is UNKNOWN: Usage:check_tcp -H host -p port [-w ] [-c ] [-s ][-e ] [-q ][-m ] [-d ][-t ] [-r ] [-M ] [-v] [-4|-6] [-j][-D [,]] [-S ] [-E] [22:26:46] PROBLEM - cp33 Stunnel for mw132 on cp33 is UNKNOWN: Usage:check_tcp -H host -p port [-w ] [-c ] [-s ][-e ] [-q ][-m ] [-d ][-t ] [-r ] [-M ] [-v] [-4|-6] [-j][-D [,]] [-S ] [-E] [22:26:50] PROBLEM - cp33 Stunnel for mw142 on cp33 is UNKNOWN: Usage:check_tcp -H host -p port [-w ] [-c ] [-s ][-e ] [-q ][-m ] [-d ][-t ] [-r ] [-M ] [-v] [-4|-6] [-j][-D [,]] [-S ] [-E] [22:26:52] PROBLEM - cp33 Stunnel for mon141 on cp33 is UNKNOWN: Usage:check_tcp -H host -p port [-w ] [-c ] [-s ][-e ] [-q ][-m ] [-d ][-t ] [-r ] [-M ] [-v] [-4|-6] [-j][-D [,]] [-S ] [-E] [22:27:02] PROBLEM - cp33 Stunnel for mw122 on cp33 is UNKNOWN: Usage:check_tcp -H host -p port [-w ] [-c ] [-s ][-e ] [-q ][-m ] [-d ][-t ] [-r ] [-M ] [-v] [-4|-6] [-j][-D [,]] [-S ] [-E] [22:27:03] PROBLEM - cp33 Stunnel for reports121 on cp33 is UNKNOWN: Usage:check_tcp -H host -p port [-w ] [-c ] [-s ][-e ] [-q ][-m ] [-d ][-t ] [-r ] [-M ] [-v] [-4|-6] [-j][-D [,]] [-S ] [-E] [22:27:09] PROBLEM - cp33 Stunnel for mwtask141 on cp33 is UNKNOWN: Usage:check_tcp -H host -p port [-w ] [-c ] [-s ][-e ] [-q ][-m ] [-d ][-t ] [-r ] [-M ] [-v] [-4|-6] [-j][-D [,]] [-S ] [-E] [22:27:09] PROBLEM - cp33 Stunnel for matomo131 on cp33 is UNKNOWN: Usage:check_tcp -H host -p port [-w ] [-c ] [-s ][-e ] [-q ][-m ] [-d ][-t ] [-r ] [-M ] [-v] [-4|-6] [-j][-D [,]] [-S ] [-E] [22:27:14] PROBLEM - cp33 Stunnel for test131 on cp33 is UNKNOWN: Usage:check_tcp -H host -p port [-w ] [-c ] [-s ][-e ] [-q ][-m ] [-d ][-t ] [-r ] [-M ] [-v] [-4|-6] [-j][-D [,]] [-S ] [-E] [22:32:16] [02miraheze/puppet] 07JohnFLewis pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/941a1fa60961...8c46c8c7f3e7 [22:32:17] [url] Comparing 941a1fa60961...8c46c8c7f3e7 · miraheze/puppet · GitHub | github.com [22:32:18] [02miraheze/puppet] 07JohnFLewis 038c46c8c - nrpe: -H not -I for check_tcp [22:55:34] RECOVERY - cp33 Stunnel for mail121 on cp33 is OK: TCP OK - 0.001 second response time on localhost port 8200 [22:55:36] RECOVERY - cp33 Stunnel for mw141 on cp33 is OK: TCP OK - 0.000 second response time on localhost port 8108 [22:55:42] RECOVERY - cp33 Stunnel for mw121 on cp33 is OK: TCP OK - 0.000 second response time on localhost port 8104 [22:55:44] RECOVERY - cp33 Stunnel for phab121 on cp33 is OK: TCP OK - 0.000 second response time on localhost port 8202 [22:55:46] RECOVERY - cp33 Stunnel for mw131 on cp33 is OK: TCP OK - 0.001 second response time on localhost port 8106 [22:55:50] RECOVERY - cp33 Stunnel for puppet141 on cp33 is OK: TCP OK - 0.000 second response time on localhost port 8204 [22:55:53] RECOVERY - cp33 Stunnel for mw132 on cp33 is OK: TCP OK - 0.000 second response time on localhost port 8107 [22:55:57] RECOVERY - cp33 Stunnel for mw142 on cp33 is OK: TCP OK - 0.000 second response time on localhost port 8109 [22:56:01] RECOVERY - cp33 Stunnel for mon141 on cp33 is OK: TCP OK - 0.000 second response time on localhost port 8201 [22:56:10] RECOVERY - cp33 Stunnel for mw122 on cp33 is OK: TCP OK - 0.000 second response time on localhost port 8105 [22:56:11] RECOVERY - cp33 Stunnel for reports121 on cp33 is OK: TCP OK - 0.000 second response time on localhost port 8205 [22:56:15] RECOVERY - cp33 Stunnel for mwtask141 on cp33 is OK: TCP OK - 0.000 second response time on localhost port 8150 [22:56:18] RECOVERY - cp33 Stunnel for matomo131 on cp33 is OK: TCP OK - 0.000 second response time on localhost port 8203 [22:56:20] PROBLEM - cp32 Stunnel for test131 on cp32 is UNKNOWN: Usage:check_tcp -H host -p port [-w ] [-c ] [-s ][-e ] [-q ][-m ] [-d ][-t ] [-r ] [-M ] [-v] [-4|-6] [-j][-D [,]] [-S ] [-E] [22:56:20] RECOVERY - cp33 Stunnel for test131 on cp33 is OK: TCP OK - 0.000 second response time on localhost port 8180 [22:56:27] PROBLEM - cp32 Stunnel for mw122 on cp32 is UNKNOWN: Usage:check_tcp -H host -p port [-w ] [-c ] [-s ][-e ] [-q ][-m ] [-d ][-t ] [-r ] [-M ] [-v] [-4|-6] [-j][-D [,]] [-S ] [-E] [22:56:38] PROBLEM - cp32 Stunnel for matomo131 on cp32 is UNKNOWN: Usage:check_tcp -H host -p port [-w ] [-c ] [-s ][-e ] [-q ][-m ] [-d ][-t ] [-r ] [-M ] [-v] [-4|-6] [-j][-D [,]] [-S ] [-E] [22:56:46] PROBLEM - cp32 Stunnel for mail121 on cp32 is UNKNOWN: Usage:check_tcp -H host -p port [-w ] [-c ] [-s ][-e ] [-q ][-m ] [-d ][-t ] [-r ] [-M ] [-v] [-4|-6] [-j][-D [,]] [-S ] [-E] [22:56:50] PROBLEM - cp32 Stunnel for phab121 on cp32 is UNKNOWN: Usage:check_tcp -H host -p port [-w ] [-c ] [-s ][-e ] [-q ][-m ] [-d ][-t ] [-r ] [-M ] [-v] [-4|-6] [-j][-D [,]] [-S ] [-E] [22:56:51] PROBLEM - cp32 Stunnel for puppet141 on cp32 is UNKNOWN: Usage:check_tcp -H host -p port [-w ] [-c ] [-s ][-e ] [-q ][-m ] [-d ][-t ] [-r ] [-M ] [-v] [-4|-6] [-j][-D [,]] [-S ] [-E] [22:56:55] PROBLEM - cp32 Stunnel for mw121 on cp32 is UNKNOWN: Usage:check_tcp -H host -p port [-w ] [-c ] [-s ][-e ] [-q ][-m ] [-d ][-t ] [-r ] [-M ] [-v] [-4|-6] [-j][-D [,]] [-S ] [-E] [22:57:03] PROBLEM - cp32 Stunnel for mw131 on cp32 is UNKNOWN: Usage:check_tcp -H host -p port [-w ] [-c ] [-s ][-e ] [-q ][-m ] [-d ][-t ] [-r ] [-M ] [-v] [-4|-6] [-j][-D [,]] [-S ] [-E] [22:57:08] PROBLEM - cp32 Stunnel for mwtask141 on cp32 is UNKNOWN: Usage:check_tcp -H host -p port [-w ] [-c ] [-s ][-e ] [-q ][-m ] [-d ][-t ] [-r ] [-M ] [-v] [-4|-6] [-j][-D [,]] [-S ] [-E] [22:57:10] PROBLEM - cp32 Stunnel for mon141 on cp32 is UNKNOWN: Usage:check_tcp -H host -p port [-w ] [-c ] [-s ][-e ] [-q ][-m ] [-d ][-t ] [-r ] [-M ] [-v] [-4|-6] [-j][-D [,]] [-S ] [-E] [22:57:13] PROBLEM - cp32 Stunnel for mw132 on cp32 is UNKNOWN: Usage:check_tcp -H host -p port [-w ] [-c ] [-s ][-e ] [-q ][-m ] [-d ][-t ] [-r ] [-M ] [-v] [-4|-6] [-j][-D [,]] [-S ] [-E] [22:57:14] PROBLEM - cp32 Stunnel for reports121 on cp32 is UNKNOWN: Usage:check_tcp -H host -p port [-w ] [-c ] [-s ][-e ] [-q ][-m ] [-d ][-t ] [-r ] [-M ] [-v] [-4|-6] [-j][-D [,]] [-S ] [-E] [22:57:15] PROBLEM - cp32 Stunnel for mw142 on cp32 is UNKNOWN: Usage:check_tcp -H host -p port [-w ] [-c ] [-s ][-e ] [-q ][-m ] [-d ][-t ] [-r ] [-M ] [-v] [-4|-6] [-j][-D [,]] [-S ] [-E] [22:57:17] PROBLEM - cp32 Stunnel for mw141 on cp32 is UNKNOWN: Usage:check_tcp -H host -p port [-w ] [-c ] [-s ][-e ] [-q ][-m ] [-d ][-t ] [-r ] [-M ] [-v] [-4|-6] [-j][-D [,]] [-S ] [-E] [23:06:19] RECOVERY - cp32 Stunnel for mw122 on cp32 is OK: TCP OK - 0.000 second response time on localhost port 8105 [23:06:26] RECOVERY - cp32 Stunnel for mw121 on cp32 is OK: TCP OK - 0.000 second response time on localhost port 8104 [23:06:29] RECOVERY - cp32 Stunnel for matomo131 on cp32 is OK: TCP OK - 0.000 second response time on localhost port 8203 [23:06:29] RECOVERY - cp32 Stunnel for mail121 on cp32 is OK: TCP OK - 0.000 second response time on localhost port 8200 [23:06:31] RECOVERY - cp32 Stunnel for puppet141 on cp32 is OK: TCP OK - 0.000 second response time on localhost port 8204 [23:06:40] RECOVERY - cp32 Stunnel for phab121 on cp32 is OK: TCP OK - 0.000 second response time on localhost port 8202 [23:06:48] RECOVERY - cp32 Stunnel for mw132 on cp32 is OK: TCP OK - 0.000 second response time on localhost port 8107 [23:06:49] RECOVERY - cp32 Stunnel for mwtask141 on cp32 is OK: TCP OK - 0.000 second response time on localhost port 8150 [23:06:52] RECOVERY - cp32 Stunnel for mw141 on cp32 is OK: TCP OK - 0.000 second response time on localhost port 8108 [23:06:54] RECOVERY - cp32 Stunnel for mw131 on cp32 is OK: TCP OK - 0.000 second response time on localhost port 8106 [23:06:58] RECOVERY - cp32 Stunnel for mon141 on cp32 is OK: TCP OK - 0.000 second response time on localhost port 8201 [23:07:08] RECOVERY - cp32 Stunnel for reports121 on cp32 is OK: TCP OK - 0.000 second response time on localhost port 8205 [23:07:11] RECOVERY - cp32 Stunnel for mw142 on cp32 is OK: TCP OK - 0.000 second response time on localhost port 8109 [23:08:07] RECOVERY - cp32 Stunnel for test131 on cp32 is OK: TCP OK - 0.000 second response time on localhost port 8180 [23:13:45] PROBLEM - roblox-wiki.tk - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - roblox-wiki.tk All nameservers failed to answer the query. [23:14:32] PROBLEM - cp22 APT on cp22 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [23:15:37] PROBLEM - cp22 Current Load on cp22 is CRITICAL: CRITICAL - load average: 9.54, 4.26, 1.92 [23:16:33] RECOVERY - cp22 APT on cp22 is OK: APT OK: 4 packages available for upgrade (0 critical updates). [23:17:34] PROBLEM - cp22 Current Load on cp22 is WARNING: WARNING - load average: 2.57, 3.59, 1.97 [23:19:31] RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 0.73, 2.56, 1.78 [23:59:30] PROBLEM - cp23 APT on cp23 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds