[00:01:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.73, 7.66, 7.48 [00:02:08] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 8.80, 7.38, 6.50 [00:03:37] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 8.56, 5.61, 4.17 [00:04:03] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 7.45, 7.40, 6.61 [00:05:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.48, 7.77, 7.63 [00:07:52] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 5.77, 6.54, 6.44 [00:13:19] PROBLEM - wiki.gab.pt.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.gab.pt.eu.org All nameservers failed to answer the query. [00:14:48] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.99, 5.02, 3.61 [00:15:25] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.72, 3.47, 3.95 [00:21:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.66, 7.68, 7.24 [00:23:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.73, 7.79, 7.34 [00:25:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.43, 8.27, 7.57 [00:25:25] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.96, 3.40, 3.51 [00:27:18] PROBLEM - db142 Current Load on db142 is CRITICAL: CRITICAL - load average: 11.00, 6.48, 3.98 [00:27:19] PROBLEM - os141 Current Load on os141 is CRITICAL: CRITICAL - load average: 4.09, 3.08, 2.22 [00:27:25] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.84, 2.65, 3.22 [00:27:36] RECOVERY - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - uk.religiononfire.mar.in.ua reverse DNS resolves to cp23.miraheze.org - CNAME OK [00:29:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 5.22, 7.10, 7.27 [00:31:18] PROBLEM - db142 Current Load on db142 is WARNING: WARNING - load average: 5.26, 7.42, 5.10 [00:31:18] RECOVERY - os141 Current Load on os141 is OK: OK - load average: 2.24, 3.22, 2.53 [00:35:18] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 4.84, 6.62, 5.33 [00:39:18] PROBLEM - db142 Current Load on db142 is WARNING: WARNING - load average: 6.66, 7.25, 5.91 [00:39:19] PROBLEM - os141 Current Load on os141 is WARNING: WARNING - load average: 3.70, 3.77, 3.05 [00:39:21] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.43, 6.14, 6.66 [00:41:18] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 4.14, 6.46, 5.80 [00:41:18] RECOVERY - os141 Current Load on os141 is OK: OK - load average: 2.25, 3.28, 2.97 [00:43:19] PROBLEM - wiki.gab.pt.eu.org - reverse DNS on sslhost is WARNING: SSL WARNING - rDNS OK but records conflict. {'NS': ['NS.ANKH.FR.eu.org.', 'NS1.eu.org.', 'NS1.ERIOMEM.NET.'], 'CNAME': 'bouncingwiki.miraheze.org.'} [00:45:40] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.25, 3.27, 3.93 [00:47:54] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.40, 3.45, 3.01 [00:49:18] PROBLEM - db142 Current Load on db142 is CRITICAL: CRITICAL - load average: 8.88, 7.18, 6.17 [00:49:49] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.53, 3.10, 2.94 [00:53:18] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 3.96, 6.47, 6.20 [00:53:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.49, 6.82, 6.60 [00:53:23] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.22, 3.44, 3.68 [00:55:20] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.71, 2.91, 3.44 [00:55:34] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.19, 3.48, 3.13 [00:57:21] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 4.16, 5.79, 6.26 [00:57:29] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.83, 2.92, 2.97 [00:59:20] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.77, 2.45, 3.13 [01:03:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.11, 6.80, 6.50 [01:05:21] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.61, 6.38, 6.38 [01:07:18] PROBLEM - db142 Current Load on db142 is CRITICAL: CRITICAL - load average: 11.72, 9.04, 7.08 [01:09:19] PROBLEM - os141 Current Load on os141 is WARNING: WARNING - load average: 4.00, 3.38, 3.04 [01:11:18] RECOVERY - os141 Current Load on os141 is OK: OK - load average: 2.83, 3.24, 3.04 [01:15:18] PROBLEM - db142 Current Load on db142 is WARNING: WARNING - load average: 2.94, 7.49, 7.51 [01:17:18] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 0.63, 5.10, 6.63 [01:18:45] [02mediawiki] 07OAuthority opened pull request 03#15525: remove WikiForum module - 13https://github.com/miraheze/mediawiki/pull/15525 [01:21:13] PROBLEM - phab121 Current Load on phab121 is WARNING: WARNING - load average: 1.80, 1.69, 1.30 [01:21:26] PROBLEM - cp23 APT on cp23 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [01:23:41] RECOVERY - cp23 APT on cp23 is OK: APT OK: 35 packages available for upgrade (0 critical updates). [01:25:05] PROBLEM - phab121 Current Load on phab121 is CRITICAL: CRITICAL - load average: 2.29, 2.06, 1.54 [01:27:01] PROBLEM - phab121 Current Load on phab121 is WARNING: WARNING - load average: 1.82, 1.93, 1.55 [01:28:58] PROBLEM - phab121 Current Load on phab121 is CRITICAL: CRITICAL - load average: 2.35, 2.07, 1.65 [01:32:50] PROBLEM - phab121 Current Load on phab121 is WARNING: WARNING - load average: 1.89, 1.99, 1.72 [01:38:38] PROBLEM - phab121 Current Load on phab121 is CRITICAL: CRITICAL - load average: 2.55, 2.08, 1.82 [01:42:38] PROBLEM - phab121 Current Load on phab121 is WARNING: WARNING - load average: 1.50, 1.85, 1.80 [01:47:52] PROBLEM - phab121 Disk Space on phab121 is WARNING: DISK WARNING - free space: / 3247 MB (7% inode=91%); [01:49:52] RECOVERY - phab121 Disk Space on phab121 is OK: DISK OK - free space: / 13287 MB (29% inode=91%); [01:50:06] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.31, 3.23, 2.57 [01:52:01] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 4.00, 3.32, 2.67 [01:53:55] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 3.04, 3.29, 2.74 [01:54:38] RECOVERY - phab121 Current Load on phab121 is OK: OK - load average: 1.36, 1.56, 1.70 [01:54:40] PROBLEM - cp23 APT on cp23 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [01:54:44] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 4.79, 3.07, 1.94 [01:56:40] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 2.40, 2.65, 1.91 [01:57:13] RECOVERY - cp23 APT on cp23 is OK: APT OK: 35 packages available for upgrade (0 critical updates). [01:57:23] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 11.06, 7.94, 6.86 [01:59:20] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 7.42, 5.52, 3.72 [01:59:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.22, 7.38, 6.79 [02:00:38] PROBLEM - phab121 Current Load on phab121 is WARNING: WARNING - load average: 1.88, 1.72, 1.72 [02:01:21] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.12, 6.47, 6.52 [02:02:38] RECOVERY - phab121 Current Load on phab121 is OK: OK - load average: 1.61, 1.67, 1.70 [02:08:17] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.35, 3.51, 3.04 [02:09:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.82, 6.50, 6.48 [02:10:12] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.30, 3.09, 2.93 [02:10:38] PROBLEM - phab121 Current Load on phab121 is CRITICAL: CRITICAL - load average: 2.10, 1.95, 1.80 [02:11:20] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.83, 3.90, 3.92 [02:11:21] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.93, 6.34, 6.43 [02:12:38] PROBLEM - phab121 Current Load on phab121 is WARNING: WARNING - load average: 1.63, 1.78, 1.75 [02:17:20] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.48, 3.32, 3.56 [02:21:20] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.80, 3.82, 3.70 [02:25:20] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.89, 2.93, 3.37 [02:27:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.36, 8.00, 6.91 [02:28:38] RECOVERY - phab121 Current Load on phab121 is OK: OK - load average: 1.30, 1.62, 1.70 [02:29:20] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.85, 3.21, 3.41 [02:29:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.19, 7.34, 6.81 [02:29:52] PROBLEM - phab121 Disk Space on phab121 is WARNING: DISK WARNING - free space: / 4911 MB (10% inode=91%); [02:31:21] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.76, 6.80, 6.67 [02:36:15] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.95, 4.12, 3.38 [02:37:20] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.74, 3.16, 3.36 [02:38:10] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.42, 3.47, 3.23 [02:39:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.77, 7.46, 6.81 [02:40:05] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.13, 2.95, 3.07 [02:41:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.41, 7.01, 6.72 [02:47:21] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 4.47, 6.21, 6.56 [02:49:40] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.17, 3.60, 3.19 [02:53:29] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.07, 3.66, 3.32 [02:55:25] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.25, 3.79, 3.40 [02:57:25] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.84, 3.71, 3.42 [02:59:25] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.50, 3.30, 3.30 [03:01:08] PROBLEM - cp23 APT on cp23 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [03:04:00] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.83, 3.67, 3.25 [03:05:56] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 6.53, 4.71, 3.68 [03:06:06] RECOVERY - cp23 APT on cp23 is OK: APT OK: 35 packages available for upgrade (0 critical updates). [03:07:52] RECOVERY - phab121 Disk Space on phab121 is OK: DISK OK - free space: / 4981 MB (11% inode=91%); [03:10:38] PROBLEM - phab121 Current Load on phab121 is CRITICAL: CRITICAL - load average: 2.58, 1.99, 1.49 [03:11:43] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.64, 3.42, 3.50 [03:11:48] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.23, 6.87, 6.63 [03:11:52] PROBLEM - phab121 Disk Space on phab121 is WARNING: DISK WARNING - free space: / 4911 MB (10% inode=91%); [03:12:38] PROBLEM - phab121 Current Load on phab121 is WARNING: WARNING - load average: 1.55, 1.75, 1.45 [03:13:39] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.26, 3.12, 3.39 [03:13:44] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.29, 6.38, 6.48 [03:14:38] RECOVERY - phab121 Current Load on phab121 is OK: OK - load average: 1.31, 1.56, 1.42 [03:17:32] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.32, 3.38, 3.52 [03:19:28] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.94, 2.97, 3.36 [03:23:22] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.66, 3.42, 3.53 [03:25:20] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.93, 3.02, 3.37 [03:37:52] RECOVERY - phab121 Disk Space on phab121 is OK: DISK OK - free space: / 24531 MB (54% inode=91%); [03:44:04] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.72, 10.63, 11.99 [03:47:20] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 7.37, 5.01, 3.82 [03:48:04] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 17.50, 12.81, 12.44 [03:49:25] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.89, 3.14, 2.45 [03:53:20] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.94, 3.89, 3.86 [03:53:25] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.62, 3.53, 2.79 [03:55:25] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.23, 2.95, 2.65 [03:58:04] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.42, 11.43, 11.90 [04:01:49] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 6.99, 6.76, 6.19 [04:03:20] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.73, 2.64, 3.26 [04:03:49] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 5.42, 6.24, 6.06 [04:04:04] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.62, 11.98, 11.90 [04:08:04] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.93, 11.58, 11.79 [04:17:24] PROBLEM - cp23 APT on cp23 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [04:19:24] RECOVERY - cp23 APT on cp23 is OK: APT OK: 35 packages available for upgrade (0 critical updates). [04:22:04] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.09, 11.93, 11.72 [04:24:04] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.07, 11.45, 11.59 [04:24:15] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.97, 11.09, 11.96 [04:28:15] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.34, 12.01, 12.11 [04:30:04] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.23, 11.83, 11.56 [04:40:38] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.67, 3.47, 2.81 [04:42:33] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.13, 2.69, 2.61 [04:46:15] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.30, 11.55, 12.00 [04:48:15] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.62, 12.11, 12.14 [04:50:13] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.89, 3.00, 2.66 [04:52:07] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.46, 2.70, 2.59 [04:52:36] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 10.34, 8.28, 6.87 [04:54:32] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.72, 7.65, 6.81 [04:56:29] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 4.32, 6.48, 6.48 [05:00:15] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.28, 11.07, 11.69 [05:02:04] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.53, 11.52, 11.97 [05:04:04] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 14.45, 12.70, 12.35 [05:04:18] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.92, 6.85, 6.63 [05:06:15] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 6.66, 6.72, 6.60 [05:06:15] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.39, 11.03, 11.41 [05:08:15] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.42, 10.59, 11.17 [05:12:15] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 14.79, 12.34, 11.70 [05:14:15] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.28, 11.70, 11.54 [05:20:15] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.42, 12.04, 11.67 [05:20:53] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.89, 7.61, 6.89 [05:22:04] PROBLEM - cp22 NTP time on cp22 is WARNING: NTP WARNING: Offset -0.1072532833 secs [05:22:15] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.72, 11.89, 11.66 [05:22:33] PROBLEM - cp23 NTP time on cp23 is WARNING: NTP WARNING: Offset 0.127387166 secs [05:22:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.18, 7.11, 6.80 [05:24:46] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 6.19, 6.70, 6.68 [05:26:04] RECOVERY - cp22 NTP time on cp22 is OK: NTP OK: Offset -0.08933877945 secs [05:29:39] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.93, 3.54, 2.77 [05:31:03] PROBLEM - test131 Current Load on test131 is CRITICAL: CRITICAL - load average: 20.78, 9.21, 4.41 [05:31:16] PROBLEM - test131 MediaWiki Rendering on test131 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [05:31:35] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.28, 3.02, 2.67 [05:32:04] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.67, 10.56, 11.62 [05:32:40] PROBLEM - test131 APT on test131 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [05:33:51] PROBLEM - test131 PowerDNS Recursor on test131 is CRITICAL: CRITICAL - Plugin timed out while executing system call [05:34:04] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.15, 11.29, 11.75 [05:34:33] RECOVERY - cp23 NTP time on cp23 is OK: NTP OK: Offset 0.08328333497 secs [05:35:49] PROBLEM - test131 SSH on test131 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [05:36:04] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.05, 10.60, 11.45 [05:36:15] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.84, 11.60, 11.38 [05:37:32] RECOVERY - test131 MediaWiki Rendering on test131 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 5.812 second response time [05:37:40] RECOVERY - test131 APT on test131 is OK: APT OK: 1 packages available for upgrade (0 critical updates). [05:37:46] RECOVERY - test131 SSH on test131 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [05:38:01] RECOVERY - test131 PowerDNS Recursor on test131 is OK: DNS OK: 0.294 seconds response time. miraheze.org returns 109.228.51.216,217.174.247.33,2a00:da00:1800:326::1,2a00:da00:1800:328::1 [05:41:26] PROBLEM - test131 Puppet on test131 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): File[/etc/ssl/localcerts/grayravens.com.crt] [05:42:04] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.18, 12.10, 11.86 [05:46:04] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.67, 11.94, 11.85 [05:46:11] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.19, 6.42, 6.19 [05:48:04] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.04, 11.84, 11.82 [05:48:33] PROBLEM - cp23 NTP time on cp23 is WARNING: NTP WARNING: Offset 0.119164139 secs [05:50:04] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.94, 11.74, 11.79 [05:50:05] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 6.47, 6.36, 6.20 [05:50:15] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.03, 11.61, 11.85 [05:52:50] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 1.21, 1.80, 3.83 [05:54:15] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.69, 12.33, 12.05 [05:54:33] RECOVERY - cp23 NTP time on cp23 is OK: NTP OK: Offset 0.0985828042 secs [05:56:15] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.00, 11.80, 11.89 [05:56:27] PROBLEM - cp33 NTP time on cp33 is WARNING: NTP WARNING: Offset 0.1496435404 secs [05:56:49] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 2.54, 1.85, 3.37 [05:58:15] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.60, 11.73, 11.83 [06:00:15] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.21, 11.56, 11.76 [06:01:36] PROBLEM - test131 Current Load on test131 is CRITICAL: CRITICAL - load average: 31.17, 14.55, 7.92 [06:01:37] PROBLEM - test131 MediaWiki Rendering on test131 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:02:15] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.84, 11.99, 11.90 [06:03:35] RECOVERY - test131 MediaWiki Rendering on test131 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.707 second response time [06:04:00] RECOVERY - test131 Puppet on test131 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [06:04:04] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 14.69, 12.03, 11.62 [06:04:15] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.19, 11.96, 11.93 [06:06:15] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.65, 12.69, 12.23 [06:08:04] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.40, 11.78, 11.68 [06:14:04] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.66, 12.42, 11.96 [06:18:04] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.08, 12.00, 11.96 [06:18:15] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.10, 11.19, 11.92 [06:18:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 10.12, 7.33, 6.50 [06:19:25] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 2.21, 2.53, 3.93 [06:22:15] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.02, 7.36, 6.72 [06:25:21] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 1.82, 2.22, 3.35 [06:26:08] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.85, 8.03, 7.11 [06:28:04] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.06, 7.57, 7.05 [06:28:26] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 6.97, 4.54, 2.44 [06:28:27] RECOVERY - cp33 NTP time on cp33 is OK: NTP OK: Offset 0.05759602785 secs [06:30:26] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 1.90, 3.41, 2.27 [06:31:58] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.08, 6.41, 6.70 [06:32:04] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.05, 8.14, 10.06 [06:32:26] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 0.89, 2.51, 2.08 [06:34:15] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.36, 8.29, 9.94 [06:36:04] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.33, 10.29, 10.56 [06:37:33] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.54, 3.08, 2.58 [06:38:33] PROBLEM - cp23 NTP time on cp23 is WARNING: NTP WARNING: Offset -0.1149566472 secs [06:39:28] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.55, 2.47, 2.41 [06:40:04] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.93, 9.43, 10.18 [06:42:33] RECOVERY - cp23 NTP time on cp23 is OK: NTP OK: Offset -0.09307676554 secs [06:51:29] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.08, 7.71, 6.88 [06:53:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.51, 7.18, 6.79 [06:56:15] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.03, 10.60, 10.02 [06:59:21] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 6.17, 6.80, 6.76 [07:00:15] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 9.57, 10.07, 9.97 [07:03:18] PROBLEM - db112 Disk Space on db112 is CRITICAL: DISK CRITICAL - free space: / 7963 MB (5% inode=99%); [07:09:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.27, 6.89, 6.57 [07:10:04] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.02, 10.44, 10.17 [07:11:03] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 4.35, 3.65, 2.41 [07:12:04] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 14.36, 11.78, 10.69 [07:12:15] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.58, 11.84, 10.71 [07:12:59] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.75, 3.00, 2.33 [07:14:15] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.32, 10.90, 10.50 [07:15:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.06, 7.19, 6.90 [07:16:15] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.78, 11.70, 10.84 [07:17:21] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 4.95, 6.33, 6.62 [07:18:04] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.38, 11.83, 11.20 [07:18:15] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.41, 10.70, 10.57 [07:20:15] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.75, 11.68, 10.95 [07:22:15] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.73, 11.01, 10.81 [07:23:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.33, 8.24, 7.34 [07:24:04] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.47, 11.52, 11.26 [07:25:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.97, 7.55, 7.19 [07:26:04] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.26, 10.78, 11.01 [07:28:15] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.34, 11.08, 10.82 [07:29:10] PROBLEM - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - uk.religiononfire.mar.in.ua All nameservers failed to answer the query. [07:30:04] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.25, 12.14, 11.57 [07:33:21] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 4.32, 5.65, 6.51 [07:36:15] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.45, 11.54, 11.34 [07:40:15] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 17.10, 12.96, 11.84 [07:43:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.41, 6.67, 6.53 [07:45:21] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 4.77, 5.95, 6.28 [07:48:15] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.11, 11.15, 11.65 [07:50:04] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.58, 10.63, 11.73 [07:51:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.11, 6.82, 6.53 [07:52:15] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.97, 11.43, 11.61 [07:54:04] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 15.20, 12.14, 12.01 [07:55:21] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 6.11, 6.76, 6.58 [07:57:43] RECOVERY - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - uk.religiononfire.mar.in.ua reverse DNS resolves to cp22.miraheze.org - CNAME OK [08:01:29] PROBLEM - cp23 APT on cp23 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [08:03:30] RECOVERY - cp23 APT on cp23 is OK: APT OK: 35 packages available for upgrade (0 critical updates). [08:16:10] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.20, 6.91, 6.53 [08:18:06] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.06, 6.34, 6.37 [08:22:02] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.63, 6.95, 6.59 [08:31:46] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.00, 7.87, 7.19 [08:35:39] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 5.62, 7.07, 7.05 [08:37:35] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.34, 7.53, 7.22 [08:39:32] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.12, 7.24, 7.14 [08:43:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 10.12, 7.85, 7.35 [08:45:22] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.72, 7.93, 7.45 [08:52:04] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.39, 10.10, 11.70 [08:53:21] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 4.09, 5.59, 6.56 [08:54:04] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 14.22, 11.39, 11.96 [08:56:59] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.69, 2.85, 1.96 [08:58:04] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.86, 10.59, 11.53 [08:58:15] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.67, 11.40, 11.97 [09:00:51] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.25, 3.24, 2.37 [09:02:04] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 14.33, 11.87, 11.77 [09:02:15] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.11, 11.51, 11.84 [09:04:15] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.34, 11.19, 11.70 [09:06:15] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.55, 12.79, 12.26 [09:08:56] PROBLEM - mwtask141 APT on mwtask141 is WARNING: APT WARNING: 0 packages available for upgrade (0 critical updates). warnings detected, errors detected. [09:10:56] PROBLEM - mwtask141 APT on mwtask141 is CRITICAL: APT CRITICAL: 67 packages available for upgrade (19 critical updates). [09:14:36] PROBLEM - cloud10 Puppet on cloud10 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[ulogd2] [09:16:13] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 7.57, 6.76, 6.17 [09:18:07] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 5.88, 6.37, 6.10 [09:21:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.65, 8.20, 7.16 [09:23:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 5.63, 7.24, 6.93 [09:25:21] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.49, 6.65, 6.75 [09:26:04] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.41, 10.43, 11.80 [09:32:15] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 7.79, 9.84, 11.78 [09:33:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.92, 6.85, 6.75 [09:37:21] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 6.78, 6.69, 6.70 [09:38:36] RECOVERY - cloud10 Puppet on cloud10 is OK: OK: Puppet is currently enabled, last run 2 seconds ago with 0 failures [09:44:15] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 14.10, 11.57, 11.46 [09:46:15] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.16, 11.53, 11.48 [09:48:15] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 14.12, 12.44, 11.81 [09:50:04] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 14.65, 12.45, 11.38 [09:51:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.90, 7.24, 6.66 [09:52:04] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.24, 11.63, 11.19 [09:53:21] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.99, 6.77, 6.56 [09:54:15] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.96, 11.94, 11.88 [09:58:33] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 4.23, 2.70, 1.90 [09:59:02] PROBLEM - en.religiononfire.mar.in.ua - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query mar.in.ua. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [10:00:04] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 14.28, 11.43, 11.11 [10:00:29] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 2.56, 2.62, 1.97 [10:02:04] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.65, 10.58, 10.83 [10:04:04] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 14.51, 12.09, 11.34 [10:05:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.49, 7.84, 6.80 [10:06:15] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 17.19, 12.47, 11.67 [10:07:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.33, 7.24, 6.71 [10:10:04] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.17, 11.71, 11.59 [10:11:21] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.53, 6.47, 6.55 [10:14:15] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.74, 11.57, 11.62 [10:19:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.56, 6.68, 6.52 [10:22:04] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 14.64, 11.26, 11.01 [10:24:04] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.34, 10.19, 10.66 [10:26:04] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.81, 11.33, 11.00 [10:26:15] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 14.21, 10.95, 10.96 [10:27:33] RECOVERY - en.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - en.religiononfire.mar.in.ua reverse DNS resolves to cp23.miraheze.org - CNAME OK [10:28:04] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.39, 11.34, 11.07 [10:30:15] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.71, 11.38, 11.29 [10:33:21] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.13, 6.25, 6.60 [10:34:04] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 14.65, 11.60, 11.07 [10:38:04] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.52, 11.39, 11.14 [10:45:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.74, 7.09, 6.81 [10:49:21] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 6.10, 6.56, 6.65 [10:50:15] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.99, 11.07, 10.92 [10:52:15] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.63, 10.97, 10.91 [10:55:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.41, 7.11, 6.84 [10:58:04] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.85, 9.43, 10.10 [11:01:21] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 6.40, 6.78, 6.79 [11:02:15] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 6.39, 8.99, 10.01 [11:12:15] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 14.28, 11.79, 10.36 [11:14:15] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.08, 10.36, 10.01 [11:16:15] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 6.85, 9.22, 9.64 [11:22:10] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.01, 6.68, 6.57 [11:23:09] [02miraheze/ImportDump] 07translatewiki pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/1abb19c39ee5...6f2a482c5860 [11:23:12] [02miraheze/ImportDump] 07translatewiki 036f2a482 - Localisation updates from https://translatewiki.net. [11:23:15] [02miraheze/landing] 07translatewiki pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/landing/compare/a41d661acc19...4ae736a1f643 [11:23:18] [02miraheze/landing] 07translatewiki 034ae736a - Localisation updates from https://translatewiki.net. [11:23:20] [02miraheze/ManageWiki] 07translatewiki pushed 031 commit to 03master [+0/-0/±4] 13https://github.com/miraheze/ManageWiki/compare/58efe058c46f...bacf944e6c0f [11:23:22] [02miraheze/ManageWiki] 07translatewiki 03bacf944 - Localisation updates from https://translatewiki.net. [11:23:23] [02miraheze/DataDump] 07translatewiki pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/DataDump/compare/f089656664e9...2135a9b73fa7 [11:23:24] [02miraheze/DataDump] 07translatewiki 032135a9b - Localisation updates from https://translatewiki.net. [11:23:27] [02miraheze/MirahezeMagic] 07translatewiki pushed 031 commit to 03master [+1/-0/±0] 13https://github.com/miraheze/MirahezeMagic/compare/98d525253637...b3116cc9f5ae [11:23:28] [02miraheze/MirahezeMagic] 07translatewiki 03b3116cc - Localisation updates from https://translatewiki.net. [11:24:07] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.68, 6.37, 6.48 [11:24:13] miraheze/landing - translatewiki the build passed. [11:31:02] miraheze/ManageWiki - translatewiki the build passed. [11:33:44] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.32, 11.06, 9.93 [11:35:43] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.39, 11.02, 10.08 [11:39:39] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.20, 11.38, 10.36 [11:40:15] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 14.64, 11.72, 10.32 [11:46:15] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.59, 11.45, 10.80 [11:46:34] miraheze/MirahezeMagic - translatewiki the build passed. [11:46:38] miraheze/ImportDump - translatewiki the build passed. [11:47:32] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 10.32, 7.83, 6.88 [11:48:04] PROBLEM - cp22 NTP time on cp22 is WARNING: NTP WARNING: Offset 0.1142795086 secs [11:48:15] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.69, 11.61, 10.91 [11:53:22] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 5.95, 7.72, 7.22 [11:57:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.84, 7.97, 7.38 [12:07:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.13, 7.33, 7.52 [12:08:58] PROBLEM - ns1 NTP time on ns1 is WARNING: NTP WARNING: Offset 0.2000378966 secs [12:10:57] RECOVERY - ns1 NTP time on ns1 is OK: NTP OK: Offset -0.01104259491 secs [12:15:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.81, 8.29, 7.69 [12:16:04] RECOVERY - cp22 NTP time on cp22 is OK: NTP OK: Offset 0.08074870706 secs [12:17:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.14, 7.67, 7.53 [12:19:18] PROBLEM - db142 Current Load on db142 is WARNING: WARNING - load average: 7.90, 6.27, 3.57 [12:19:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.43, 7.87, 7.61 [12:21:18] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 5.11, 5.65, 3.66 [12:23:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 5.89, 7.47, 7.57 [12:27:21] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 4.25, 3.73, 2.60 [12:29:17] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 0.99, 2.73, 2.36 [12:31:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 14.67, 8.70, 7.75 [12:41:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.02, 7.61, 7.82 [12:47:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.02, 7.13, 7.41 [12:48:01] PROBLEM - cp23 APT on cp23 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [12:49:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.93, 7.51, 7.52 [12:50:01] RECOVERY - cp23 APT on cp23 is OK: APT OK: 35 packages available for upgrade (0 critical updates). [12:51:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 10.49, 8.67, 7.94 [12:56:01] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 6.97, 6.79, 6.36 [12:57:56] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 6.36, 6.52, 6.30 [12:59:02] PROBLEM - en.religiononfire.mar.in.ua - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query mar.in.ua. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [13:01:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 5.02, 6.94, 7.64 [13:05:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 10.14, 7.85, 7.79 [13:13:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.05, 7.86, 7.90 [13:23:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.22, 7.56, 7.40 [13:25:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.95, 7.43, 7.36 [13:27:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.23, 8.08, 7.63 [13:29:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.91, 7.95, 7.64 [13:31:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 12.67, 9.18, 8.09 [13:37:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 4.51, 7.26, 7.71 [13:38:19] PROBLEM - db121 Backups SQL on db121 is WARNING: FILE_AGE WARNING: /var/log/sql-backup.log is 864227 seconds old and 1877 bytes [13:41:05] [02miraheze/RemovePII] 07paladox pushed 031 commit to 03paladox-patch-1 [+1/-0/±0] 13https://github.com/miraheze/RemovePII/commit/19d84f5243bf [13:41:08] [02miraheze/RemovePII] 07paladox 0319d84f5 - Fork fixStuckGlobalRename from CentralAuth [13:41:11] [02RemovePII] 07paladox created branch 03paladox-patch-1 - 13https://github.com/miraheze/RemovePII [13:41:14] [02RemovePII] 07paladox opened pull request 03#71: Fork fixStuckGlobalRename from CentralAuth - 13https://github.com/miraheze/RemovePII/pull/71 [13:41:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.08, 7.82, 7.83 [13:43:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.66, 7.93, 7.88 [13:44:53] miraheze/RemovePII - paladox the build has errored. [13:45:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.04, 8.03, 7.93 [13:49:49] PROBLEM - swiftobject121 APT on swiftobject121 is WARNING: APT WARNING: 0 packages available for upgrade (0 critical updates). warnings detected, errors detected. [13:51:52] PROBLEM - swiftobject121 APT on swiftobject121 is CRITICAL: APT CRITICAL: 52 packages available for upgrade (7 critical updates). [13:56:29] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 4.98, 3.63, 2.44 [13:58:26] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 2.68, 3.16, 2.40 [14:04:08] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 7.42, 6.90, 6.34 [14:07:20] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.16, 3.27, 2.37 [14:09:20] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.98, 3.51, 2.57 [14:09:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 5.58, 7.14, 7.87 [14:11:20] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.73, 3.12, 2.53 [14:13:49] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 5.08, 6.41, 6.47 [14:15:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.51, 6.63, 7.26 [14:19:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.28, 7.05, 7.29 [14:21:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.47, 7.71, 7.51 [14:29:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 5.37, 7.68, 7.78 [14:29:38] PROBLEM - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query mar.in.ua. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [14:39:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 19.24, 10.17, 8.37 [14:41:49] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 6.91, 6.67, 6.37 [14:43:49] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 5.59, 6.27, 6.26 [14:51:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 5.53, 7.62, 8.00 [14:55:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.07, 7.51, 7.78 [14:58:11] RECOVERY - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - uk.religiononfire.mar.in.ua reverse DNS resolves to cp23.miraheze.org - CNAME OK [15:01:18] PROBLEM - db142 Current Load on db142 is CRITICAL: CRITICAL - load average: 9.97, 5.57, 3.24 [15:01:49] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 6.91, 6.48, 6.30 [15:01:53] PROBLEM - mw142 Current Load on mw142 is WARNING: WARNING - load average: 10.87, 8.59, 6.99 [15:03:18] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 2.50, 4.34, 3.08 [15:03:49] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 6.51, 6.25, 6.23 [15:03:52] RECOVERY - mw142 Current Load on mw142 is OK: OK - load average: 6.92, 8.01, 6.98 [15:13:19] PROBLEM - wiki.gab.pt.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.gab.pt.eu.org All nameservers failed to answer the query. [15:27:02] RECOVERY - en.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - en.religiononfire.mar.in.ua reverse DNS resolves to cp22.miraheze.org - CNAME OK [15:29:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 5.90, 6.97, 7.84 [15:35:18] PROBLEM - db142 Current Load on db142 is CRITICAL: CRITICAL - load average: 8.64, 6.27, 3.61 [15:35:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.97, 8.10, 8.00 [15:37:02] [02dns] 07MacFan4000 opened pull request 03#416: add www.pastport.org - 13https://github.com/miraheze/dns/pull/416 [15:37:18] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 5.79, 6.42, 4.01 [15:37:18] PROBLEM - os141 Current Load on os141 is CRITICAL: CRITICAL - load average: 4.39, 3.52, 2.08 [15:39:19] RECOVERY - os141 Current Load on os141 is OK: OK - load average: 1.29, 2.60, 1.91 [15:43:19] PROBLEM - wiki.gab.pt.eu.org - reverse DNS on sslhost is WARNING: SSL WARNING - rDNS OK but records conflict. {'NS': ['NS.ANKH.FR.eu.org.', 'NS1.eu.org.', 'NS1.ERIOMEM.NET.'], 'CNAME': 'bouncingwiki.miraheze.org.'} [15:44:22] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+1/-0/±1] 13https://github.com/miraheze/ssl/compare/ec044caebb1a...ccaf4497378f [15:44:25] [02miraheze/ssl] 07MirahezeSSLBot 03ccaf449 - Bot: Add SSL cert for steem.wiki [15:45:49] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 6.92, 6.51, 6.28 [15:47:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 5.95, 7.35, 7.88 [15:47:49] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 5.76, 6.14, 6.16 [15:49:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 10.17, 8.06, 8.04 [15:49:44] PROBLEM - mw122 MediaWiki Rendering on mw122 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:51:55] PROBLEM - mw121 MediaWiki Rendering on mw121 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:00:30] [Grafana] FIRING: Some MediaWiki Appservers are running out of PHP-FPM workers. https://grafana.miraheze.org/d/GtxbP1Xnk?orgId=1 [18:20:30] [Grafana] RESOLVED: PHP-FPM Worker Usage High https://grafana.miraheze.org/d/GtxbP1Xnk?orgId=1 [18:50:00] [Grafana] FIRING: Some MediaWiki Appservers are running out of PHP-FPM workers. https://grafana.miraheze.org/d/GtxbP1Xnk?orgId=1 [18:55:00] [Grafana] RESOLVED: PHP-FPM Worker Usage High https://grafana.miraheze.org/d/GtxbP1Xnk?orgId=1 [19:21:59] [02miraheze/mw-config] 07MacFan4000 pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/01de7965125a...33f6d30ba7de [19:22:02] [02miraheze/mw-config] 07MacFan4000 0333f6d30 - remove Reception from staff wiki [19:22:42] !log [macfan@mwtask141] starting deploy of {'pull': 'config', 'config': True} to all [19:22:52] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:22:58] miraheze/mw-config - MacFan4000 the build passed. [19:22:59] !log [macfan@mwtask141] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 16s [19:23:00] [Grafana] FIRING: Some MediaWiki Appservers are running out of PHP-FPM workers. https://grafana.miraheze.org/d/GtxbP1Xnk?orgId=1 [19:23:14] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:27:23] !log [@test131] starting deploy of {'config': True} to all [19:27:24] !log [@test131] finished deploy of {'config': True} to all - SUCCESS in 1s [19:27:39] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:27:47] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:28:00] [Grafana] RESOLVED: PHP-FPM Worker Usage High https://grafana.miraheze.org/d/GtxbP1Xnk?orgId=1 [20:07:37] [02puppet] 07MacFan4000 opened pull request 03#3224: Remove reception123 shell and icinga access - 13https://github.com/miraheze/puppet/pull/3224 [20:08:24] [02puppet] 07MacFan4000 synchronize pull request 03#3224: Remove reception123 shell and icinga access - 13https://github.com/miraheze/puppet/pull/3224 [23:59:47] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±2] 13https://github.com/miraheze/puppet/compare/2d894207285d...560212c418fb [23:59:49] [02miraheze/puppet] 07MacFan4000 03560212c - Remove reception123 shell and icinga access (#3224) [23:59:52] [02puppet] 07paladox closed pull request 03#3224: Remove reception123 shell and icinga access - 13https://github.com/miraheze/puppet/pull/3224