[00:01:15] PROBLEM - cp23 APT on cp23 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [00:01:21] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 11.56, 5.98, 3.01 [00:01:33] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 9.63, 5.99, 4.17 [00:03:47] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.45, 4.05, 3.37 [00:06:14] RECOVERY - cp23 APT on cp23 is OK: APT OK: 34 packages available for upgrade (0 critical updates). [00:07:15] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 1.01, 3.82, 3.19 [00:07:17] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.56, 3.76, 3.75 [00:09:13] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 0.66, 2.74, 2.86 [00:09:47] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.31, 3.89, 3.58 [00:10:28] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 4.73, 6.89, 7.82 [00:11:07] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.59, 2.92, 3.39 [00:11:47] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 7.91, 4.82, 3.92 [00:12:28] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.64, 7.79, 8.02 [00:14:19] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.37, 10.47, 12.00 [00:14:40] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 7.70, 5.49, 3.09 [00:15:47] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.19, 3.90, 3.76 [00:16:19] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.75, 11.30, 12.10 [00:17:48] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 6.37, 7.33, 5.64 [00:18:40] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 0.76, 3.10, 2.68 [00:19:47] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 4.22, 6.20, 5.43 [00:20:19] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.24, 11.16, 11.89 [00:21:48] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.98, 3.88, 3.70 [00:22:36] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 7.66, 5.60, 4.22 [00:22:53] PROBLEM - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - uk.religiononfire.mar.in.ua All nameservers failed to answer the query. [00:26:00] PROBLEM - os141 Current Load on os141 is CRITICAL: CRITICAL - load average: 4.26, 3.29, 2.55 [00:28:11] PROBLEM - db142 Current Load on db142 is CRITICAL: CRITICAL - load average: 11.43, 7.67, 5.36 [00:28:21] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.85, 3.60, 3.79 [00:28:54] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 5.51, 3.44, 2.50 [00:29:20] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.21, 10.96, 11.87 [00:31:47] PROBLEM - cp23 APT on cp23 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [00:31:48] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.56, 3.67, 3.81 [00:32:10] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.84, 3.20, 3.52 [00:33:47] RECOVERY - cp23 APT on cp23 is OK: APT OK: 34 packages available for upgrade (0 critical updates). [00:33:48] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 12.17, 5.36, 4.32 [00:34:00] RECOVERY - os141 Current Load on os141 is OK: OK - load average: 2.18, 3.35, 3.00 [00:34:05] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.44, 2.48, 3.22 [00:34:19] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 17.57, 12.66, 11.69 [00:34:48] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.28, 3.18, 2.82 [00:35:20] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.40, 11.01, 11.55 [00:36:06] PROBLEM - db142 Current Load on db142 is WARNING: WARNING - load average: 5.42, 7.87, 6.76 [00:37:20] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.31, 10.67, 11.38 [00:38:05] PROBLEM - db142 Current Load on db142 is CRITICAL: CRITICAL - load average: 7.99, 8.03, 6.95 [00:38:19] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.05, 11.64, 11.54 [00:39:49] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.51, 3.67, 3.91 [00:40:04] PROBLEM - db142 Current Load on db142 is WARNING: WARNING - load average: 5.56, 7.29, 6.82 [00:40:04] PROBLEM - os141 Current Load on os141 is CRITICAL: CRITICAL - load average: 3.87, 4.05, 3.40 [00:40:19] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 16.04, 12.80, 11.94 [00:41:20] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.60, 12.01, 11.72 [00:41:49] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.02, 3.84, 3.94 [00:42:02] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 4.71, 6.29, 6.51 [00:42:03] PROBLEM - os141 Current Load on os141 is WARNING: WARNING - load average: 2.68, 3.45, 3.26 [00:43:49] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.87, 3.42, 3.77 [00:44:02] RECOVERY - os141 Current Load on os141 is OK: OK - load average: 3.14, 3.39, 3.26 [00:44:19] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.93, 11.66, 11.68 [00:45:22] PROBLEM - cp33 NTP time on cp33 is WARNING: NTP WARNING: Offset 0.1090959609 secs [00:46:19] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.89, 11.99, 11.78 [00:47:49] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.42, 2.56, 3.31 [00:50:19] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.95, 11.71, 11.76 [00:51:41] RECOVERY - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - uk.religiononfire.mar.in.ua reverse DNS resolves to cp22.miraheze.org - CNAME OK [00:52:19] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.18, 12.24, 11.96 [00:54:50] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.13, 3.51, 3.49 [00:55:20] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.00, 11.40, 11.87 [00:55:51] PROBLEM - db142 Current Load on db142 is CRITICAL: CRITICAL - load average: 8.07, 7.81, 7.05 [00:55:55] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.95, 3.56, 3.12 [00:56:19] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.71, 10.75, 11.46 [00:56:41] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 4.83, 6.95, 7.83 [00:56:50] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.94, 3.01, 3.31 [00:57:55] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.58, 2.83, 2.91 [01:00:22] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 12.25, 5.02, 2.70 [01:00:41] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 8.95, 8.02, 8.06 [01:00:59] PROBLEM - os141 Current Load on os141 is CRITICAL: CRITICAL - load average: 4.85, 3.97, 3.49 [01:02:47] PROBLEM - cp23 APT on cp23 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [01:03:22] RECOVERY - cp33 NTP time on cp33 is OK: NTP OK: Offset 0.09821212292 secs [01:04:19] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 15.03, 11.57, 11.31 [01:04:47] RECOVERY - cp23 APT on cp23 is OK: APT OK: 34 packages available for upgrade (0 critical updates). [01:06:16] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 1.95, 3.90, 3.06 [01:06:19] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.43, 11.38, 11.27 [01:06:41] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 6.95, 7.78, 8.00 [01:08:14] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 2.09, 3.21, 2.90 [01:08:52] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.88, 3.92, 3.50 [01:09:20] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.50, 11.53, 11.49 [01:10:41] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 9.81, 8.46, 8.20 [01:11:02] PROBLEM - os141 Current Load on os141 is WARNING: WARNING - load average: 2.69, 3.66, 3.75 [01:11:42] PROBLEM - db142 Current Load on db142 is WARNING: WARNING - load average: 4.82, 7.03, 8.00 [01:12:33] !log [macfan@mwtask141] sudo -u www-data php /srv/mediawiki/w/extensions/DataDump/maintenance/insertMissingDumps.php --wiki=obeymewiki (END - exit=0) [01:12:38] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:12:52] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.20, 3.04, 3.24 [01:14:19] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.59, 11.22, 11.13 [01:16:19] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.78, 10.70, 10.95 [01:17:20] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.58, 11.68, 11.83 [01:21:36] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 3.42, 5.26, 6.73 [01:22:19] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 14.33, 11.56, 11.17 [01:23:20] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.15, 11.48, 11.64 [01:24:40] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.96, 3.91, 2.22 [01:24:57] RECOVERY - os141 Current Load on os141 is OK: OK - load average: 0.85, 2.26, 3.05 [01:26:19] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.90, 11.25, 11.14 [01:26:40] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 0.96, 2.74, 1.99 [01:28:39] !log [macfan@mwtask141] sudo -u www-data php /srv/mediawiki/w/extensions/DataDump/maintenance/insertMissingDumps.php --wiki=obeymewiki (END - exit=0) [01:28:43] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:30:19] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.47, 11.43, 11.22 [01:31:20] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.39, 11.65, 11.78 [01:31:43] PROBLEM - cp23 APT on cp23 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [01:32:41] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 4.92, 6.56, 7.64 [01:33:20] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 15.98, 12.92, 12.20 [01:33:53] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 8.55, 7.82, 4.33 [01:36:41] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 10.95, 7.86, 7.83 [01:36:42] RECOVERY - cp23 APT on cp23 is OK: APT OK: 34 packages available for upgrade (0 critical updates). [01:36:55] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.89, 3.98, 3.09 [01:37:52] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 0.62, 3.92, 3.52 [01:38:50] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.48, 3.60, 3.04 [01:39:52] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 0.28, 2.71, 3.12 [01:40:45] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.66, 2.95, 2.87 [01:44:21] !log [macfan@mwtask141] sudo -u www-data php /srv/mediawiki/w/extensions/CreateWiki/maintenance/setContainersAccess.php --wiki=obeymewiki (END - exit=0) [01:44:29] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:44:36] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.84, 3.77, 3.27 [01:44:41] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 7.60, 7.72, 7.84 [01:46:31] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.20, 3.40, 3.20 [01:46:41] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 9.11, 8.47, 8.11 [01:59:52] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 5.23, 3.39, 2.53 [02:01:39] PROBLEM - cp23 APT on cp23 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [02:03:39] RECOVERY - cp23 APT on cp23 is OK: APT OK: 34 packages available for upgrade (0 critical updates). [02:03:58] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.67, 3.00, 2.60 [02:05:20] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.25, 10.84, 11.89 [02:05:52] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 0.81, 3.15, 2.94 [02:05:58] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.66, 3.38, 2.77 [02:07:20] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.01, 11.06, 11.83 [02:08:41] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 5.62, 6.99, 7.77 [02:09:20] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.14, 10.55, 11.54 [02:09:23] PROBLEM - db142 Current Load on db142 is CRITICAL: CRITICAL - load average: 10.36, 6.02, 3.32 [02:11:20] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 18.22, 13.18, 12.36 [02:11:23] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 4.06, 5.52, 3.50 [02:12:41] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 11.23, 8.27, 8.03 [02:16:19] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.28, 11.12, 11.90 [02:19:59] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.18, 3.31, 3.65 [02:21:59] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.30, 2.65, 3.37 [02:22:19] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.34, 11.43, 11.72 [02:26:19] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.69, 11.11, 11.52 [02:28:19] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.50, 11.83, 11.75 [02:30:19] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.86, 11.44, 11.62 [02:34:19] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 15.22, 12.35, 11.83 [02:44:41] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 5.24, 7.04, 7.78 [02:46:28] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 4.32, 6.76, 7.84 [02:48:19] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.66, 11.82, 11.97 [02:48:28] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.34, 7.82, 8.12 [02:49:07] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.56, 3.65, 2.97 [02:50:41] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 8.72, 7.49, 7.63 [02:52:41] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 7.89, 7.60, 7.65 [02:52:57] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.80, 3.42, 3.04 [02:54:41] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 8.30, 7.89, 7.75 [02:54:52] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.26, 3.01, 2.94 [02:57:20] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.03, 11.08, 11.94 [02:59:37] PROBLEM - wiki.zulaclub.net - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query wiki.zulaclub.net. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [03:01:35] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 7.42, 5.24, 3.87 [03:04:19] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 14.23, 10.81, 10.89 [03:05:20] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.08, 11.32, 11.67 [03:06:19] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.31, 11.26, 11.07 [03:07:19] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.86, 3.85, 3.83 [03:08:19] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.45, 12.11, 11.43 [03:10:19] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.92, 11.66, 11.33 [03:12:19] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.18, 11.78, 11.41 [03:13:04] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.02, 3.69, 3.66 [03:14:40] !log [macfan@mwtask141] sudo -u www-data php /srv/mediawiki/w/extensions/CreateWiki/maintenance/setContainersAccess.php --wiki=obeymewiki (END - exit=0) [03:14:46] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:14:59] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.05, 3.72, 3.69 [03:18:48] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.85, 2.64, 3.25 [03:19:00] [02ManageWiki] 07OAuthority synchronize pull request 03#410: fix log spam - 13https://github.com/miraheze/ManageWiki/pull/410 [03:19:23] [02ManageWiki] 07OAuthority reviewed pull request 03#410 commit - 13https://github.com/miraheze/ManageWiki/pull/410#discussion_r1225039192 [03:19:48] PROBLEM - swiftproxy111 HTTPS on swiftproxy111 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: HTTP/1.1 503 Service Unavailable [03:21:45] RECOVERY - swiftproxy111 HTTPS on swiftproxy111 is OK: HTTP OK: Status line output matched "HTTP/1.1 404" - 352 bytes in 0.025 second response time [03:28:19] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.05, 11.14, 11.87 [03:32:01] PROBLEM - cp23 APT on cp23 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [03:32:41] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 7.27, 7.63, 8.00 [03:34:01] RECOVERY - cp23 APT on cp23 is OK: APT OK: 34 packages available for upgrade (0 critical updates). [03:34:19] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 18.12, 13.93, 12.68 [03:36:28] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 4.49, 6.38, 7.92 [03:38:41] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 8.75, 7.72, 7.87 [03:40:28] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.27, 7.74, 8.14 [03:40:41] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 7.54, 7.61, 7.81 [03:42:41] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 8.58, 8.15, 7.99 [03:43:20] PROBLEM - swiftproxy131 HTTPS on swiftproxy131 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: HTTP/1.1 503 Service Unavailable [03:45:17] RECOVERY - swiftproxy131 HTTPS on swiftproxy131 is OK: HTTP OK: Status line output matched "HTTP/1.1 404" - 352 bytes in 0.028 second response time [03:45:23] PROBLEM - db142 Current Load on db142 is CRITICAL: CRITICAL - load average: 8.13, 5.00, 2.85 [03:47:23] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 3.73, 4.69, 3.02 [03:48:20] PROBLEM - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - uk.religiononfire.mar.in.ua All nameservers failed to answer the query. [03:50:28] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.27, 7.19, 7.86 [03:52:06] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.68, 3.87, 3.17 [03:52:28] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.99, 8.16, 8.12 [03:53:15] PROBLEM - swiftproxy111 HTTP on swiftproxy111 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host: HTTP/1.1 503 Service Unavailable [03:58:33] RECOVERY - wiki.zulaclub.net - reverse DNS on sslhost is OK: SSL OK - wiki.zulaclub.net reverse DNS resolves to cp22.miraheze.org - CNAME OK [03:58:46] PROBLEM - swiftproxy111 HTTPS on swiftproxy111 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: HTTP/1.1 503 Service Unavailable [04:00:06] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.24, 3.45, 3.42 [04:00:41] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 5.55, 7.21, 7.87 [04:00:43] RECOVERY - swiftproxy111 HTTPS on swiftproxy111 is OK: HTTP OK: Status line output matched "HTTP/1.1 404" - 352 bytes in 0.045 second response time [04:01:15] RECOVERY - swiftproxy111 HTTP on swiftproxy111 is OK: HTTP OK: Status line output matched "HTTP/1.1 404" - 352 bytes in 0.046 second response time [04:01:37] PROBLEM - cp23 NTP time on cp23 is WARNING: NTP WARNING: Offset 0.1558624804 secs [04:02:06] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.57, 3.26, 3.35 [04:02:28] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 5.24, 7.25, 7.96 [04:06:07] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.65, 4.03, 3.65 [04:08:07] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.57, 3.54, 3.52 [04:10:07] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.37, 3.07, 3.34 [04:10:29] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.67, 8.04, 7.98 [04:10:41] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 8.42, 7.91, 7.88 [04:12:28] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.11, 7.55, 7.80 [04:12:41] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 7.35, 7.63, 7.78 [04:13:37] RECOVERY - cp23 NTP time on cp23 is OK: NTP OK: Offset 0.09056285024 secs [04:13:55] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.66, 4.01, 2.90 [04:14:41] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 10.57, 8.22, 7.95 [04:17:08] PROBLEM - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query uk.religiononfire.mar.in.ua. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [04:18:28] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.28, 8.28, 8.00 [04:19:28] PROBLEM - swiftobject121 APT on swiftobject121 is WARNING: APT WARNING: 0 packages available for upgrade (0 critical updates). warnings detected, errors detected. [04:20:08] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.55, 3.01, 3.03 [04:20:57] PROBLEM - ns1 NTP time on ns1 is WARNING: NTP WARNING: Offset 0.1414959729 secs [04:21:30] PROBLEM - swiftobject121 APT on swiftobject121 is CRITICAL: APT CRITICAL: 52 packages available for upgrade (7 critical updates). [04:21:55] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.88, 3.77, 3.26 [04:22:08] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.39, 2.80, 2.95 [04:23:55] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.01, 3.20, 3.11 [04:26:19] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.18, 10.95, 11.91 [04:26:28] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 5.31, 7.40, 7.97 [04:29:52] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 6.55, 3.52, 1.93 [04:30:41] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 5.90, 7.31, 7.90 [04:31:56] PROBLEM - cp23 APT on cp23 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [04:32:19] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.39, 11.51, 11.79 [04:33:56] RECOVERY - cp23 APT on cp23 is OK: APT OK: 34 packages available for upgrade (0 critical updates). [04:35:37] PROBLEM - cp23 NTP time on cp23 is WARNING: NTP WARNING: Offset 0.1669612825 secs [04:35:52] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 0.92, 3.97, 2.95 [04:36:28] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 10.99, 8.54, 8.10 [04:36:41] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 8.98, 7.31, 7.60 [04:37:52] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 0.67, 2.86, 2.67 [04:38:41] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 7.61, 7.33, 7.57 [04:40:41] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 8.07, 7.57, 7.63 [04:42:19] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.57, 11.38, 11.92 [04:45:22] PROBLEM - cp33 NTP time on cp33 is WARNING: NTP WARNING: Offset 0.1087525189 secs [04:45:55] RECOVERY - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - uk.religiononfire.mar.in.ua reverse DNS resolves to cp23.miraheze.org - CNAME OK [04:46:57] RECOVERY - ns1 NTP time on ns1 is OK: NTP OK: Offset 0.08636721969 secs [04:47:37] RECOVERY - cp23 NTP time on cp23 is OK: NTP OK: Offset 0.05330401659 secs [04:48:19] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.10, 11.62, 11.77 [04:50:19] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.75, 11.61, 11.77 [05:00:52] PROBLEM - cp23 APT on cp23 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [05:00:57] PROBLEM - ns1 NTP time on ns1 is WARNING: NTP WARNING: Offset 0.1020847559 secs [05:01:20] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.77, 10.65, 11.65 [05:02:19] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.04, 10.64, 11.08 [05:02:57] RECOVERY - ns1 NTP time on ns1 is OK: NTP OK: Offset 0.09398564696 secs [05:05:50] RECOVERY - cp23 APT on cp23 is OK: APT OK: 34 packages available for upgrade (0 critical updates). [05:06:19] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.09, 10.40, 10.97 [05:07:22] RECOVERY - cp33 NTP time on cp33 is OK: NTP OK: Offset 0.09673327208 secs [05:09:30] [02mw-config] 07brandon-wm closed pull request 03#5144: Update wgCreateWikiCannedResponses - 13https://github.com/miraheze/mw-config/pull/5144 [05:11:20] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 14.82, 11.10, 11.16 [05:12:41] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 5.09, 6.88, 7.76 [05:13:20] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.93, 11.72, 11.41 [05:16:41] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 8.96, 7.82, 7.93 [05:18:19] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.86, 10.88, 10.73 [05:19:20] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.97, 11.66, 11.39 [05:20:19] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.44, 10.37, 10.58 [05:21:20] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.60, 11.58, 11.40 [05:25:20] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.66, 11.45, 11.32 [05:26:28] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.67, 7.53, 7.91 [05:28:19] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.52, 9.23, 10.02 [05:28:24] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 4.32, 2.37, 1.70 [05:29:20] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.06, 11.50, 11.42 [05:29:23] PROBLEM - db142 Current Load on db142 is WARNING: WARNING - load average: 6.83, 5.63, 2.96 [05:29:42] PROBLEM - os141 Current Load on os141 is CRITICAL: CRITICAL - load average: 4.24, 2.85, 1.39 [05:30:22] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 2.04, 2.20, 1.72 [05:30:41] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 6.92, 7.72, 8.00 [05:31:20] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.21, 11.87, 11.57 [05:31:23] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 1.52, 4.09, 2.72 [05:31:41] RECOVERY - os141 Current Load on os141 is OK: OK - load average: 0.71, 2.00, 1.26 [05:32:14] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.92, 3.36, 2.64 [05:32:41] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 9.11, 8.18, 8.13 [05:34:14] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.88, 3.84, 2.90 [05:34:19] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.16, 11.07, 10.52 [05:36:28] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.74, 7.41, 7.49 [05:40:14] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.10, 3.55, 3.21 [05:42:14] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.70, 2.93, 3.02 [05:44:19] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.77, 11.59, 11.32 [05:44:28] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 5.63, 7.38, 7.64 [05:46:41] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 7.71, 7.46, 7.96 [05:48:28] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.71, 7.75, 7.70 [05:50:41] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 10.09, 8.16, 8.07 [05:52:19] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.44, 11.44, 11.24 [05:52:28] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.77, 7.85, 7.80 [05:54:41] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 7.21, 7.72, 7.92 [05:56:19] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.92, 11.29, 11.27 [05:56:28] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.74, 7.75, 7.72 [05:58:06] PROBLEM - swiftproxy111 HTTP on swiftproxy111 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host: HTTP/1.1 503 Service Unavailable [05:58:28] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.75, 7.38, 7.59 [06:00:03] RECOVERY - swiftproxy111 HTTP on swiftproxy111 is OK: HTTP OK: Status line output matched "HTTP/1.1 404" - 352 bytes in 0.024 second response time [06:00:28] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.24, 7.54, 7.61 [06:00:41] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 8.03, 7.83, 7.91 [06:01:20] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 7.09, 10.13, 11.76 [06:02:19] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.44, 11.09, 11.16 [06:02:28] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.59, 7.45, 7.56 [06:03:12] PROBLEM - swiftproxy111 HTTPS on swiftproxy111 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: HTTP/1.1 503 Service Unavailable [06:04:28] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.29, 7.71, 7.64 [06:05:09] RECOVERY - swiftproxy111 HTTPS on swiftproxy111 is OK: HTTP OK: Status line output matched "HTTP/1.1 404" - 352 bytes in 0.031 second response time [06:06:28] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.46, 7.31, 7.51 [06:06:29] PROBLEM - en.religiononfire.mar.in.ua - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query mar.in.ua. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [06:06:41] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 7.65, 7.87, 7.93 [06:08:28] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.66, 7.73, 7.63 [06:08:41] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 8.50, 8.17, 8.04 [06:09:20] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.71, 12.20, 11.94 [06:10:28] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.78, 7.57, 7.58 [06:16:14] PROBLEM - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query mar.in.ua. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [06:16:28] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.28, 8.04, 7.79 [06:18:28] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.53, 7.90, 7.78 [06:18:41] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 6.78, 7.68, 7.92 [06:24:28] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.70, 8.06, 7.85 [06:24:41] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 8.07, 7.31, 7.60 [06:28:28] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.94, 7.72, 7.74 [06:28:41] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 7.46, 7.56, 7.65 [06:32:28] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.59, 7.62, 7.65 [06:34:28] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.97, 7.65, 7.65 [06:36:28] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.75, 8.42, 7.93 [06:36:41] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 8.01, 7.79, 7.67 [06:40:41] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 6.55, 7.93, 7.84 [06:45:02] RECOVERY - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - uk.religiononfire.mar.in.ua reverse DNS resolves to cp22.miraheze.org - CNAME OK [06:46:41] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 9.44, 8.55, 8.08 [06:48:33] PROBLEM - swiftproxy131 HTTP on swiftproxy131 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host: HTTP/1.1 503 Service Unavailable [06:49:42] PROBLEM - swiftobject121 APT on swiftobject121 is WARNING: APT WARNING: 0 packages available for upgrade (0 critical updates). warnings detected, errors detected. [06:50:30] RECOVERY - swiftproxy131 HTTP on swiftproxy131 is OK: HTTP OK: Status line output matched "HTTP/1.1 404" - 352 bytes in 0.035 second response time [06:51:44] PROBLEM - swiftobject121 APT on swiftobject121 is CRITICAL: APT CRITICAL: 52 packages available for upgrade (7 critical updates). [06:56:41] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 6.66, 7.58, 7.95 [07:00:19] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.46, 10.93, 11.95 [07:00:41] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 9.06, 8.08, 8.05 [07:03:18] PROBLEM - swiftproxy131 HTTPS on swiftproxy131 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: HTTP/1.1 503 Service Unavailable [07:03:23] PROBLEM - db142 Current Load on db142 is CRITICAL: CRITICAL - load average: 11.89, 5.92, 2.95 [07:05:16] RECOVERY - swiftproxy131 HTTPS on swiftproxy131 is OK: HTTP OK: Status line output matched "HTTP/1.1 404" - 352 bytes in 0.039 second response time [07:05:27] PROBLEM - os141 Current Load on os141 is CRITICAL: CRITICAL - load average: 5.35, 3.53, 1.78 [07:05:29] RECOVERY - en.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - en.religiononfire.mar.in.ua reverse DNS resolves to cp23.miraheze.org - CNAME OK [07:05:48] PROBLEM - mw142 Current Load on mw142 is CRITICAL: CRITICAL - load average: 12.11, 10.21, 7.47 [07:07:48] RECOVERY - mw142 Current Load on mw142 is OK: OK - load average: 8.18, 9.47, 7.54 [07:08:19] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.55, 11.80, 11.79 [07:09:23] PROBLEM - db142 Current Load on db142 is WARNING: WARNING - load average: 4.20, 6.86, 4.53 [07:09:25] PROBLEM - os141 Current Load on os141 is WARNING: WARNING - load average: 2.26, 3.52, 2.23 [07:10:19] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.82, 11.58, 11.73 [07:11:23] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 2.49, 5.75, 4.44 [07:11:24] RECOVERY - os141 Current Load on os141 is OK: OK - load average: 1.10, 2.88, 2.16 [07:15:48] PROBLEM - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - uk.religiononfire.mar.in.ua All nameservers failed to answer the query. [07:16:19] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 15.82, 12.51, 11.92 [07:16:28] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.03, 7.03, 7.82 [07:18:28] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.15, 7.35, 7.82 [07:24:28] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.44, 7.50, 7.82 [07:26:19] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.53, 11.07, 11.85 [07:30:19] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.69, 11.17, 11.68 [07:32:28] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.38, 8.14, 7.97 [07:36:41] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 7.23, 7.47, 7.97 [07:37:05] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 6.65, 6.96, 6.03 [07:39:05] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 5.96, 6.60, 6.01 [07:42:19] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.98, 10.98, 11.64 [07:42:41] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 8.66, 8.00, 8.03 [07:44:19] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 17.21, 13.17, 12.35 [07:44:35] PROBLEM - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query mar.in.ua. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [08:13:23] RECOVERY - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - uk.religiononfire.mar.in.ua reverse DNS resolves to cp22.miraheze.org - CNAME OK [08:14:41] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 6.57, 6.77, 7.99 [08:16:41] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 8.01, 7.43, 8.10 [08:28:41] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 6.62, 7.38, 7.95 [08:32:41] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 9.08, 8.10, 8.10 [08:41:23] PROBLEM - os141 Current Load on os141 is CRITICAL: CRITICAL - load average: 5.15, 3.92, 2.01 [08:41:23] PROBLEM - db142 Current Load on db142 is CRITICAL: CRITICAL - load average: 8.55, 5.39, 2.75 [08:43:23] RECOVERY - os141 Current Load on os141 is OK: OK - load average: 1.73, 3.24, 2.01 [08:43:23] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 3.47, 4.74, 2.85 [08:48:41] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 6.20, 7.44, 8.00 [08:49:25] PROBLEM - swiftproxy111 HTTPS on swiftproxy111 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: HTTP/1.1 503 Service Unavailable [08:51:23] RECOVERY - swiftproxy111 HTTPS on swiftproxy111 is OK: HTTP OK: Status line output matched "HTTP/1.1 404" - 352 bytes in 0.026 second response time [08:52:41] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 8.17, 7.73, 7.98 [08:54:41] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 7.15, 7.55, 7.89 [08:55:46] [02.github] 07redbluegreenhat commented on pull request 03#31: Add PHP 8.2 tests - 13https://github.com/miraheze/.github/pull/31#issuecomment-1585572604 [08:58:41] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 8.56, 7.70, 7.85 [09:24:41] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 4.80, 7.27, 7.99 [09:28:41] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 8.73, 7.66, 7.93 [09:36:00] PROBLEM - en.religiononfire.mar.in.ua - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - en.religiononfire.mar.in.ua All nameservers failed to answer the query. [09:42:41] PROBLEM - swiftproxy111 HTTP on swiftproxy111 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host: HTTP/1.1 503 Service Unavailable [09:44:37] RECOVERY - swiftproxy111 HTTP on swiftproxy111 is OK: HTTP OK: Status line output matched "HTTP/1.1 404" - 352 bytes in 0.018 second response time [09:57:20] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.32, 10.12, 11.90 [10:02:19] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.57, 10.13, 11.85 [10:04:19] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 14.22, 11.35, 12.06 [10:05:30] PROBLEM - en.religiononfire.mar.in.ua - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query mar.in.ua. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [10:09:20] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.43, 11.45, 11.44 [10:12:19] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.31, 11.19, 11.78 [10:17:20] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.19, 11.95, 11.98 [10:21:20] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.38, 11.60, 11.76 [10:23:20] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.40, 11.32, 11.68 [10:23:23] PROBLEM - db142 Current Load on db142 is CRITICAL: CRITICAL - load average: 11.07, 7.68, 4.33 [10:25:20] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.40, 11.68, 11.75 [10:25:23] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 2.87, 5.87, 4.08 [10:25:32] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 7.61, 7.00, 6.46 [10:27:20] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.31, 11.62, 11.73 [10:28:19] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.30, 11.41, 11.39 [10:29:31] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 6.53, 6.77, 6.48 [10:34:59] RECOVERY - en.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - en.religiononfire.mar.in.ua reverse DNS resolves to cp22.miraheze.org - CNAME OK [10:37:20] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 15.67, 12.98, 12.04 [10:42:17] PROBLEM - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - uk.religiononfire.mar.in.ua All nameservers failed to answer the query. [11:06:22] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 6.59, 6.82, 6.44 [11:08:22] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 5.98, 6.42, 6.33 [11:12:21] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 7.84, 7.05, 6.59 [11:14:20] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 6.38, 6.78, 6.55 [11:36:00] PROBLEM - en.religiononfire.mar.in.ua - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query en.religiononfire.mar.in.ua. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [11:39:52] PROBLEM - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query uk.religiononfire.mar.in.ua. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [11:59:01] PROBLEM - db142 Current Load on db142 is CRITICAL: CRITICAL - load average: 8.22, 6.03, 3.92 [12:01:00] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 2.59, 4.83, 3.74 [12:05:30] RECOVERY - en.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - en.religiononfire.mar.in.ua reverse DNS resolves to cp22.miraheze.org - CNAME OK [12:08:40] RECOVERY - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - uk.religiononfire.mar.in.ua reverse DNS resolves to cp23.miraheze.org - CNAME OK [12:33:54] PROBLEM - mwtask141 Disk Space on mwtask141 is WARNING: DISK WARNING - free space: / 7781 MB (10% inode=89%); [12:37:38] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.37, 3.63, 2.66 [12:39:38] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.77, 3.08, 2.59 [12:49:52] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 3.53, 3.31, 2.27 [12:51:52] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.92, 2.73, 2.18 [13:07:21] PROBLEM - mw122 MediaWiki Rendering on mw122 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:09:26] RECOVERY - mw122 MediaWiki Rendering on mw122 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 8.422 second response time [13:09:33] [Grafana] FIRING: Some MediaWiki Appservers are running out of PHP-FPM workers. https://grafana.miraheze.org/d/GtxbP1Xnk?orgId=1 [13:11:54] PROBLEM - mwtask141 Disk Space on mwtask141 is CRITICAL: DISK CRITICAL - free space: / 3782 MB (5% inode=89%); [13:21:09] PROBLEM - db142 Current Load on db142 is CRITICAL: CRITICAL - load average: 15.32, 8.62, 5.50 [13:25:07] PROBLEM - db142 Current Load on db142 is WARNING: WARNING - load average: 7.64, 7.35, 5.65 [13:27:05] PROBLEM - db142 Current Load on db142 is CRITICAL: CRITICAL - load average: 9.11, 7.58, 5.91 [13:27:54] PROBLEM - mwtask141 Disk Space on mwtask141 is WARNING: DISK WARNING - free space: / 7357 MB (10% inode=89%); [13:29:04] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 2.68, 5.88, 5.50 [13:31:52] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 2.44, 3.67, 2.84 [13:33:53] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 12.64, 8.07, 6.68 [13:34:33] [Grafana] RESOLVED: PHP-FPM Worker Usage High https://grafana.miraheze.org/d/GtxbP1Xnk?orgId=1 [13:35:52] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 2.01, 3.04, 2.81 [13:37:53] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 6.01, 7.16, 6.65 [13:40:56] PROBLEM - db142 Current Load on db142 is WARNING: WARNING - load average: 7.60, 5.50, 4.79 [13:41:52] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 5.65, 6.56, 6.52 [13:42:55] PROBLEM - db142 Current Load on db142 is CRITICAL: CRITICAL - load average: 8.48, 6.55, 5.26 [13:44:54] PROBLEM - db142 Current Load on db142 is WARNING: WARNING - load average: 6.84, 7.01, 5.61 [13:45:52] !log remove universalomega from board@ [13:45:58] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [13:46:53] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 1.48, 5.05, 5.07 [13:49:52] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 7.85, 4.15, 3.07 [13:49:57] PROBLEM - cp23 APT on cp23 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [13:51:37] !log change universalomega password for ldap account (deactivating it) [13:51:42] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [13:51:52] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 2.07, 3.23, 2.87 [13:52:16] RECOVERY - cp23 APT on cp23 is OK: APT OK: 34 packages available for upgrade (0 critical updates). [14:00:53] !log do T10930 [14:00:58] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:06:30] PROBLEM - en.religiononfire.mar.in.ua - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query en.religiononfire.mar.in.ua. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [14:08:17] PROBLEM - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query uk.religiononfire.mar.in.ua. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [14:15:55] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.91, 2.74, 1.85 [14:17:55] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.99, 2.83, 1.97 [14:18:35] [Grafana] FIRING: Some MediaWiki Appservers are running out of PHP-FPM workers. https://grafana.miraheze.org/d/GtxbP1Xnk?orgId=1 [14:19:55] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.23, 2.19, 1.84 [14:37:05] RECOVERY - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - uk.religiononfire.mar.in.ua reverse DNS resolves to cp22.miraheze.org - CNAME OK [14:43:35] [Grafana] RESOLVED: PHP-FPM Worker Usage High https://grafana.miraheze.org/d/GtxbP1Xnk?orgId=1 [14:49:30] PROBLEM - swiftobject121 APT on swiftobject121 is WARNING: APT WARNING: 0 packages available for upgrade (0 critical updates). warnings detected, errors detected. [14:51:33] PROBLEM - swiftobject121 APT on swiftobject121 is CRITICAL: APT CRITICAL: 52 packages available for upgrade (7 critical updates). [15:05:30] PROBLEM - en.religiononfire.mar.in.ua - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - en.religiononfire.mar.in.ua All nameservers failed to answer the query. [15:05:35] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 8.13, 6.66, 6.27 [15:07:35] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 5.48, 6.28, 6.19 [15:13:54] RECOVERY - mwtask141 Disk Space on mwtask141 is OK: DISK OK - free space: / 18691 MB (26% inode=90%); [15:17:56] PROBLEM - db142 Current Load on db142 is CRITICAL: CRITICAL - load average: 9.87, 6.69, 4.09 [15:19:39] PROBLEM - swiftobject121 APT on swiftobject121 is WARNING: APT WARNING: 0 packages available for upgrade (0 critical updates). warnings detected, errors detected. [15:19:54] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 6.03, 6.06, 4.15 [15:21:41] PROBLEM - swiftobject121 APT on swiftobject121 is CRITICAL: APT CRITICAL: 52 packages available for upgrade (7 critical updates). [15:23:51] PROBLEM - db142 Current Load on db142 is CRITICAL: CRITICAL - load average: 9.40, 7.41, 5.09 [15:25:50] PROBLEM - db142 Current Load on db142 is WARNING: WARNING - load average: 6.55, 7.03, 5.22 [15:29:47] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 5.12, 6.45, 5.46 [15:29:52] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 4.52, 3.22, 2.00 [15:31:52] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 2.20, 2.98, 2.07 [15:35:00] PROBLEM - en.religiononfire.mar.in.ua - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query en.religiononfire.mar.in.ua. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [15:39:22] PROBLEM - cp33 NTP time on cp33 is WARNING: NTP WARNING: Offset 0.1186635196 secs [15:39:30] [Grafana] FIRING: Some MediaWiki Appservers are running out of PHP-FPM workers. https://grafana.miraheze.org/d/GtxbP1Xnk?orgId=1 [15:49:22] RECOVERY - cp33 NTP time on cp33 is OK: NTP OK: Offset 0.08813691139 secs [16:03:55] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.54, 2.97, 2.35 [16:04:52] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.21, 3.68, 2.86 [16:05:55] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.57, 2.79, 2.36 [16:08:52] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 3.22, 3.40, 2.92 [16:19:30] [Grafana] RESOLVED: PHP-FPM Worker Usage High https://grafana.miraheze.org/d/GtxbP1Xnk?orgId=1 [16:28:03] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 7.01, 3.73, 2.47 [16:30:01] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 2.09, 2.96, 2.34 [16:34:00] RECOVERY - en.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - en.religiononfire.mar.in.ua reverse DNS resolves to cp23.miraheze.org - CNAME OK [16:51:06] PROBLEM - cp23 APT on cp23 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [16:51:23] PROBLEM - os141 Current Load on os141 is CRITICAL: CRITICAL - load average: 5.23, 3.39, 1.83 [16:51:52] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 6.26, 3.79, 2.51 [16:53:06] RECOVERY - cp23 APT on cp23 is OK: APT OK: 34 packages available for upgrade (0 critical updates). [16:53:23] PROBLEM - db142 Current Load on db142 is WARNING: WARNING - load average: 7.87, 5.24, 2.95 [16:53:52] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.66, 2.80, 2.30 [16:55:23] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 4.99, 5.34, 3.29 [16:55:55] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.23, 5.55, 4.03 [16:59:26] PROBLEM - os141 Current Load on os141 is WARNING: WARNING - load average: 2.33, 3.57, 2.76 [16:59:55] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.93, 3.46, 3.50 [17:01:25] RECOVERY - os141 Current Load on os141 is OK: OK - load average: 2.35, 3.27, 2.76 [17:01:55] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.88, 2.89, 3.28 [17:07:12] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 7.35, 7.08, 6.41 [17:07:23] PROBLEM - os141 Current Load on os141 is CRITICAL: CRITICAL - load average: 6.50, 5.01, 3.61 [17:07:23] PROBLEM - db142 Current Load on db142 is CRITICAL: CRITICAL - load average: 11.23, 7.42, 4.76 [17:09:13] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 5.31, 6.37, 6.23 [17:09:23] PROBLEM - db142 Current Load on db142 is WARNING: WARNING - load average: 7.88, 7.70, 5.20 [17:09:33] [Grafana] FIRING: Some MediaWiki Appservers are running out of PHP-FPM workers. https://grafana.miraheze.org/d/GtxbP1Xnk?orgId=1 [17:13:23] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 5.85, 6.75, 5.41 [17:17:23] PROBLEM - db142 Current Load on db142 is WARNING: WARNING - load average: 5.68, 7.39, 6.09 [17:19:23] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 3.44, 6.16, 5.81 [17:25:23] PROBLEM - db142 Current Load on db142 is WARNING: WARNING - load average: 6.88, 7.26, 6.43 [17:25:37] PROBLEM - os141 PowerDNS Recursor on os141 is CRITICAL: CRITICAL - Plugin timed out while executing system call [17:27:38] RECOVERY - os141 PowerDNS Recursor on os141 is OK: DNS OK: 5.058 seconds response time. miraheze.org returns 109.228.51.216,217.174.247.33,2a00:da00:1800:326::1,2a00:da00:1800:328::1 [17:29:23] PROBLEM - db142 Current Load on db142 is CRITICAL: CRITICAL - load average: 18.32, 10.37, 7.68 [17:31:57] PROBLEM - mw122 MediaWiki Rendering on mw122 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:32:01] PROBLEM - os141 PowerDNS Recursor on os141 is CRITICAL: CRITICAL - Plugin timed out while executing system call [17:32:13] PROBLEM - mw121 MediaWiki Rendering on mw121 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:32:34] PROBLEM - cp23 APT on cp23 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [17:33:48] PROBLEM - mw142 Current Load on mw142 is WARNING: WARNING - load average: 10.59, 9.14, 7.70 [17:34:01] RECOVERY - os141 PowerDNS Recursor on os141 is OK: DNS OK: 5.073 seconds response time. miraheze.org returns 109.228.51.216,217.174.247.33,2a00:da00:1800:326::1,2a00:da00:1800:328::1 [17:34:13] RECOVERY - mw121 MediaWiki Rendering on mw121 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 3.606 second response time [17:35:25] RECOVERY - cp23 APT on cp23 is OK: APT OK: 34 packages available for upgrade (0 critical updates). [17:35:48] RECOVERY - mw142 Current Load on mw142 is OK: OK - load average: 7.03, 8.28, 7.56 [17:36:06] RECOVERY - mw122 MediaWiki Rendering on mw122 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 6.369 second response time [17:36:12] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 5.18, 4.42, 3.00 [17:38:09] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.64, 3.32, 2.77 [17:38:26] PROBLEM - os141 PowerDNS Recursor on os141 is CRITICAL: CRITICAL - Plugin timed out while executing system call [17:40:23] RECOVERY - os141 PowerDNS Recursor on os141 is OK: DNS OK: 2.092 seconds response time. miraheze.org returns 109.228.51.216,217.174.247.33,2a00:da00:1800:326::1,2a00:da00:1800:328::1 [17:46:58] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 6.48, 4.27, 3.10 [17:48:58] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.91, 3.80, 3.05 [17:49:24] PROBLEM - swiftobject121 APT on swiftobject121 is WARNING: APT WARNING: 0 packages available for upgrade (0 critical updates). warnings detected, errors detected. [17:49:56] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 4.25, 3.21, 2.61 [17:50:59] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.07, 3.81, 3.14 [17:51:26] PROBLEM - swiftobject121 APT on swiftobject121 is CRITICAL: APT CRITICAL: 52 packages available for upgrade (7 critical updates). [17:51:54] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 2.68, 2.95, 2.58 [17:54:59] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.07, 3.34, 3.14 [17:55:23] PROBLEM - db142 Current Load on db142 is WARNING: WARNING - load average: 0.69, 3.90, 7.27 [17:57:23] PROBLEM - db142 Current Load on db142 is CRITICAL: CRITICAL - load average: 9.14, 6.86, 8.00 [17:57:41] PROBLEM - os141 Current Load on os141 is WARNING: WARNING - load average: 2.29, 2.43, 3.95 [17:59:23] PROBLEM - db142 Current Load on db142 is WARNING: WARNING - load average: 4.13, 5.45, 7.33 [18:01:38] RECOVERY - os141 Current Load on os141 is OK: OK - load average: 1.45, 1.83, 3.34 [18:07:23] PROBLEM - db142 Current Load on db142 is CRITICAL: CRITICAL - load average: 8.62, 6.21, 6.85 [18:08:28] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.74, 7.62, 7.97 [18:09:23] PROBLEM - db142 Current Load on db142 is WARNING: WARNING - load average: 4.67, 6.30, 6.86 [18:11:23] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 1.60, 4.81, 6.26 [18:12:28] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.90, 8.19, 8.11 [18:13:02] PROBLEM - mw121 MediaWiki Rendering on mw121 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:15:05] RECOVERY - mw121 MediaWiki Rendering on mw121 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 7.774 second response time [18:16:00] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.55, 3.30, 2.99 [18:17:48] PROBLEM - fid.koyomi-ya.net - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query koyomi-ya.net. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [18:18:00] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.75, 2.68, 2.80 [18:23:23] PROBLEM - db142 Current Load on db142 is WARNING: WARNING - load average: 7.40, 6.26, 5.63 [18:25:23] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 2.75, 5.32, 5.39 [18:30:28] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.57, 7.63, 8.00 [18:34:33] [Grafana] RESOLVED: PHP-FPM Worker Usage High https://grafana.miraheze.org/d/GtxbP1Xnk?orgId=1 [18:35:54] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 7.93, 6.78, 6.18 [18:39:23] PROBLEM - db142 Current Load on db142 is CRITICAL: CRITICAL - load average: 10.83, 8.56, 6.12 [18:39:55] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 6.03, 6.27, 6.10 [18:40:28] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.92, 7.81, 7.70 [18:41:03] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.24, 3.82, 3.12 [18:41:23] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 2.67, 6.40, 5.64 [18:42:00] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.58, 3.48, 2.96 [18:43:03] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.31, 3.29, 3.02 [18:43:55] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.45, 2.80, 2.77 [18:46:28] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 5.61, 7.58, 7.76 [18:49:32] PROBLEM - swiftobject121 APT on swiftobject121 is WARNING: APT WARNING: 0 packages available for upgrade (0 critical updates). warnings detected, errors detected. [18:50:28] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 10.95, 8.42, 7.99 [18:51:34] PROBLEM - swiftobject121 APT on swiftobject121 is CRITICAL: APT CRITICAL: 52 packages available for upgrade (7 critical updates). [19:00:28] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.84, 7.66, 7.95 [19:03:31] [Grafana] FIRING: Some MediaWiki Appservers are running out of PHP-FPM workers. https://grafana.miraheze.org/d/GtxbP1Xnk?orgId=1 [19:04:28] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.24, 7.66, 7.88 [19:06:28] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.52, 7.73, 7.89 [19:08:03] PROBLEM - mw122 MediaWiki Rendering on mw122 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:08:28] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 11.39, 8.95, 8.29 [19:10:09] RECOVERY - mw122 MediaWiki Rendering on mw122 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 9.335 second response time [19:17:29] RECOVERY - fid.koyomi-ya.net - reverse DNS on sslhost is OK: SSL OK - fid.koyomi-ya.net reverse DNS resolves to cp23.miraheze.org - CNAME OK [19:18:05] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.98, 3.76, 3.31 [19:19:26] PROBLEM - swiftobject121 APT on swiftobject121 is WARNING: APT WARNING: 0 packages available for upgrade (0 critical updates). warnings detected, errors detected. [19:20:05] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.71, 2.98, 3.08 [19:21:28] PROBLEM - swiftobject121 APT on swiftobject121 is CRITICAL: APT CRITICAL: 52 packages available for upgrade (7 critical updates). [19:26:06] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.99, 3.71, 3.36 [19:28:06] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.92, 3.37, 3.27 [19:32:07] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.83, 3.61, 3.43 [19:34:07] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 6.54, 4.21, 3.63 [19:36:07] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.73, 3.83, 3.55 [19:37:00] PROBLEM - en.religiononfire.mar.in.ua - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query en.religiononfire.mar.in.ua. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [19:41:23] PROBLEM - db142 Current Load on db142 is CRITICAL: CRITICAL - load average: 8.17, 5.89, 3.97 [19:42:07] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.80, 2.77, 3.20 [19:43:23] PROBLEM - db142 Current Load on db142 is WARNING: WARNING - load average: 7.16, 6.37, 4.38 [19:44:28] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.30, 7.41, 7.94 [19:46:28] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.67, 8.52, 8.32 [19:47:23] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 2.29, 5.17, 4.44 [19:49:40] PROBLEM - db112 Disk Space on db112 is WARNING: DISK WARNING - free space: / 14604 MB (10% inode=99%); [19:49:45] PROBLEM - cp23 APT on cp23 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [19:50:14] PROBLEM - mail121 Current Load on mail121 is CRITICAL: CRITICAL - load average: 2.76, 1.58, 0.95 [19:51:40] RECOVERY - db112 Disk Space on db112 is OK: DISK OK - free space: / 20619 MB (15% inode=99%); [19:52:25] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 4.47, 3.05, 2.04 [19:54:23] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.75, 2.62, 2.01 [19:55:23] RECOVERY - cp23 APT on cp23 is OK: APT OK: 34 packages available for upgrade (0 critical updates). [19:58:17] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 4.73, 3.95, 2.70 [19:59:22] PROBLEM - cp33 NTP time on cp33 is WARNING: NTP WARNING: Offset 0.1590107381 secs [20:00:15] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.84, 3.15, 2.55 [20:02:14] PROBLEM - mail121 Current Load on mail121 is WARNING: WARNING - load average: 0.38, 1.83, 1.73 [20:06:14] PROBLEM - mail121 Current Load on mail121 is CRITICAL: CRITICAL - load average: 2.34, 2.03, 1.83 [20:06:30] PROBLEM - en.religiononfire.mar.in.ua - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - en.religiononfire.mar.in.ua All nameservers failed to answer the query. [20:13:31] [Grafana] RESOLVED: PHP-FPM Worker Usage High https://grafana.miraheze.org/d/GtxbP1Xnk?orgId=1 [20:15:09] PROBLEM - cp22 Current Load on cp22 is CRITICAL: CRITICAL - load average: 7.95, 5.03, 2.60 [20:17:54] PROBLEM - cp22 APT on cp22 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [20:18:10] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.18, 3.91, 3.09 [20:19:51] RECOVERY - cp22 APT on cp22 is OK: APT OK: 34 packages available for upgrade (0 critical updates). [20:19:55] PROBLEM - swiftobject121 APT on swiftobject121 is WARNING: APT WARNING: 0 packages available for upgrade (0 critical updates). warnings detected, errors detected. [20:20:10] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.42, 3.83, 3.17 [20:21:09] RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 1.18, 3.24, 2.69 [20:21:22] RECOVERY - cp33 NTP time on cp33 is OK: NTP OK: Offset -0.02979132533 secs [20:21:57] PROBLEM - swiftobject121 APT on swiftobject121 is CRITICAL: APT CRITICAL: 52 packages available for upgrade (7 critical updates). [20:22:11] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.53, 4.20, 3.39 [20:23:43] PROBLEM - cp23 APT on cp23 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [20:24:11] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.95, 3.52, 3.22 [20:25:15] test [20:25:46] RECOVERY - cp23 APT on cp23 is OK: APT OK: 34 packages available for upgrade (0 critical updates). [20:26:11] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 3.23, 3.40, 3.21 [20:26:47] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 6.00, 5.41, 3.71 [20:30:37] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.89, 3.37, 3.24 [20:40:12] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 6.07, 4.68, 3.70 [20:42:12] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.64, 3.95, 3.56 [20:44:00] [Grafana] FIRING: Some MediaWiki Appservers are running out of PHP-FPM workers. https://grafana.miraheze.org/d/GtxbP1Xnk?orgId=1 [20:44:13] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.68, 3.17, 3.31 [20:48:14] PROBLEM - mail121 Current Load on mail121 is WARNING: WARNING - load average: 0.27, 0.66, 1.94 [20:51:55] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.07, 2.94, 2.57 [20:52:14] RECOVERY - mail121 Current Load on mail121 is OK: OK - load average: 0.16, 0.38, 1.53 [20:53:55] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.30, 2.66, 2.52 [21:04:14] PROBLEM - mail121 Current Load on mail121 is WARNING: WARNING - load average: 1.98, 1.27, 1.22 [21:05:29] PROBLEM - en.religiononfire.mar.in.ua - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query mar.in.ua. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [21:06:14] PROBLEM - mail121 Current Load on mail121 is CRITICAL: CRITICAL - load average: 2.13, 1.60, 1.35 [21:08:14] RECOVERY - mail121 Current Load on mail121 is OK: OK - load average: 1.34, 1.57, 1.37 [21:12:15] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.10, 3.72, 3.11 [21:14:00] [Grafana] RESOLVED: PHP-FPM Worker Usage High https://grafana.miraheze.org/d/GtxbP1Xnk?orgId=1 [21:16:15] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.63, 3.96, 3.43 [21:18:15] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.57, 3.40, 3.29 [21:24:14] PROBLEM - mail121 Current Load on mail121 is CRITICAL: CRITICAL - load average: 2.66, 2.33, 1.64 [21:28:47] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 4.83, 2.98, 1.98 [21:32:14] PROBLEM - mail121 Current Load on mail121 is WARNING: WARNING - load average: 0.34, 1.71, 1.78 [21:32:21] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 7.39, 6.33, 5.95 [21:32:43] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.60, 2.83, 2.19 [21:34:14] RECOVERY - mail121 Current Load on mail121 is OK: OK - load average: 0.70, 1.32, 1.62 [21:34:59] RECOVERY - en.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - en.religiononfire.mar.in.ua reverse DNS resolves to cp22.miraheze.org - CNAME OK [21:35:16] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.47, 3.40, 3.10 [21:36:21] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 6.26, 6.32, 6.04 [21:37:16] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 3.01, 3.22, 3.07 [21:38:17] PROBLEM - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - uk.religiononfire.mar.in.ua All nameservers failed to answer the query. [21:44:00] [Grafana] FIRING: Some MediaWiki Appservers are running out of PHP-FPM workers. https://grafana.miraheze.org/d/GtxbP1Xnk?orgId=1 [21:48:28] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.10, 6.99, 7.83 [21:50:28] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.83, 7.68, 7.98 [22:00:13] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 5.13, 3.18, 1.99 [22:01:47] PROBLEM - cp23 APT on cp23 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [22:03:47] RECOVERY - cp23 APT on cp23 is OK: APT OK: 34 packages available for upgrade (0 critical updates). [22:04:09] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.49, 2.97, 2.25 [22:08:37] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.20, 3.78, 3.04 [22:10:32] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.53, 2.96, 2.83 [22:14:28] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.46, 7.70, 7.97 [22:16:28] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 7.61, 7.87, 8.01 [22:36:17] PROBLEM - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query mar.in.ua. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [22:40:28] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.99, 7.20, 7.89 [22:44:28] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.69, 7.84, 8.00 [22:50:21] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 7.69, 4.04, 2.68 [22:52:21] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.92, 3.50, 2.65 [22:56:21] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.57, 3.69, 2.90 [22:56:28] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.63, 7.52, 7.96 [23:00:22] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.17, 3.91, 3.29 [23:01:23] PROBLEM - db142 Current Load on db142 is CRITICAL: CRITICAL - load average: 12.26, 7.85, 3.91 [23:02:22] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.62, 4.67, 3.68 [23:02:28] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.71, 7.81, 7.90 [23:03:23] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 4.91, 6.64, 3.95 [23:06:17] RECOVERY - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - uk.religiononfire.mar.in.ua reverse DNS resolves to cp23.miraheze.org - CNAME OK [23:06:28] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.12, 7.60, 7.84 [23:08:22] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.84, 3.39, 3.46 [23:09:00] [Grafana] RESOLVED: PHP-FPM Worker Usage High https://grafana.miraheze.org/d/GtxbP1Xnk?orgId=1 [23:10:28] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.76, 8.13, 7.96 [23:12:22] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.83, 4.59, 3.94 [23:12:29] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.67, 7.99, 7.94 [23:14:22] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.56, 3.77, 3.72 [23:20:23] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.38, 3.49, 3.53 [23:20:28] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 7.10, 8.22, 8.05 [23:22:23] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.22, 3.00, 3.34 [23:22:28] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.92, 7.97, 7.97 [23:26:28] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.63, 8.52, 8.19 [23:31:21] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.54, 3.61, 3.04 [23:32:28] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.43, 7.60, 7.90 [23:33:16] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 3.06, 3.38, 3.01 [23:34:24] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.52, 3.39, 3.09 [23:36:28] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.33, 7.66, 7.82 [23:38:24] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.95, 2.89, 2.98 [23:38:28] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.74, 7.20, 7.63 [23:44:28] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.69, 7.62, 7.64 [23:48:28] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 5.52, 7.29, 7.58 [23:48:35] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.02, 4.00, 3.25 [23:49:05] PROBLEM - swiftobject121 APT on swiftobject121 is WARNING: APT WARNING: 0 packages available for upgrade (0 critical updates). warnings detected, errors detected. [23:50:28] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.69, 7.65, 7.66 [23:50:30] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.86, 3.92, 3.30 [23:51:10] PROBLEM - swiftobject121 APT on swiftobject121 is CRITICAL: APT CRITICAL: 52 packages available for upgrade (7 critical updates). [23:52:25] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.99, 4.41, 3.53 [23:52:28] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.50, 7.23, 7.51 [23:53:26] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.26, 3.66, 3.08 [23:55:26] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.06, 3.03, 2.92 [23:56:15] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.85, 3.26, 3.27 [23:58:28] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.45, 7.56, 7.56