[00:00:37] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 12.04, 5.26, 2.73 [00:02:27] PROBLEM - cp23 APT on cp23 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [00:04:24] RECOVERY - cp23 APT on cp23 is OK: APT OK: 2 packages available for upgrade (0 critical updates). [00:05:29] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 6.15, 4.74, 3.31 [00:06:36] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 2.18, 3.78, 3.05 [00:08:36] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 0.60, 2.64, 2.71 [00:09:22] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.87, 3.66, 3.17 [00:11:19] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.42, 2.90, 2.94 [00:13:41] PROBLEM - cp32 NTP time on cp32 is WARNING: NTP WARNING: Offset -0.1194778085 secs [00:15:41] RECOVERY - cp32 NTP time on cp32 is OK: NTP OK: Offset -0.09645047784 secs [00:25:08] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.80, 3.29, 2.60 [00:27:04] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 3.07, 3.16, 2.63 [00:32:02] PROBLEM - es141 Current Load on es141 is CRITICAL: CRITICAL - load average: 4.35, 3.26, 2.39 [00:32:19] PROBLEM - db142 Current Load on db142 is CRITICAL: CRITICAL - load average: 8.69, 6.44, 4.35 [00:34:02] PROBLEM - es141 Current Load on es141 is WARNING: WARNING - load average: 3.64, 3.33, 2.52 [00:35:41] PROBLEM - cp32 NTP time on cp32 is WARNING: NTP WARNING: Offset 0.1213596761 secs [00:36:04] PROBLEM - es141 Current Load on es141 is CRITICAL: CRITICAL - load average: 4.33, 3.63, 2.73 [00:36:12] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 5.75, 6.48, 4.86 [00:38:01] RECOVERY - es141 Current Load on es141 is OK: OK - load average: 2.74, 3.34, 2.73 [00:49:41] RECOVERY - cp32 NTP time on cp32 is OK: NTP OK: Offset 0.08410257101 secs [00:50:09] PROBLEM - db142 Current Load on db142 is CRITICAL: CRITICAL - load average: 10.07, 8.00, 6.12 [00:52:09] PROBLEM - db142 Current Load on db142 is WARNING: WARNING - load average: 6.04, 7.32, 6.11 [00:56:09] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 5.40, 6.73, 6.16 [01:00:02] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.91, 3.21, 2.66 [01:00:53] PROBLEM - housing.wiki - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query housing.wiki. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [01:01:58] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.48, 2.96, 2.64 [01:02:18] PROBLEM - cp23 NTP time on cp23 is WARNING: NTP WARNING: Offset 0.2596406341 secs [01:07:51] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.55, 3.43, 3.00 [01:09:51] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.62, 3.20, 2.97 [01:12:09] PROBLEM - db142 Current Load on db142 is CRITICAL: CRITICAL - load average: 9.10, 6.92, 5.43 [01:14:09] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 2.91, 5.66, 5.18 [01:21:51] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.51, 3.43, 3.18 [01:23:51] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.89, 3.00, 3.06 [01:26:11] PROBLEM - test131 Current Load on test131 is CRITICAL: CRITICAL - load average: 27.60, 10.44, 4.34 [01:28:09] PROBLEM - test131 SSH on test131 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:28:26] PROBLEM - test131 MediaWiki Rendering on test131 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:29:38] PROBLEM - test131 PowerDNS Recursor on test131 is CRITICAL: CRITICAL - Plugin timed out while executing system call [01:29:39] RECOVERY - housing.wiki - reverse DNS on sslhost is OK: SSL OK - housing.wiki reverse DNS resolves to cp33.miraheze.org - CNAME FLAT [01:30:18] RECOVERY - cp23 NTP time on cp23 is OK: NTP OK: Offset 0.05516564846 secs [01:31:05] PROBLEM - test131 Puppet on test131 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [01:31:25] PROBLEM - test131 conntrack_table_size on test131 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [01:35:32] PROBLEM - test131 ferm_active on test131 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [01:35:58] PROBLEM - test131 Redis Process on test131 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [01:36:01] PROBLEM - test131 JobChron Service on test131 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [01:38:03] PROBLEM - test131 JobRunner Service on test131 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [01:40:00] PROBLEM - test131 php-fpm on test131 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [01:40:11] PROBLEM - test131 nutcracker process on test131 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [01:41:20] PROBLEM - db112 Disk Space on db112 is CRITICAL: DISK CRITICAL - free space: / 7963 MB (5% inode=98%); [01:48:18] PROBLEM - test131 NTP time on test131 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [01:51:37] PROBLEM - test131 Disk Space on test131 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [01:51:43] PROBLEM - test131 HTTPS on test131 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:53:49] RECOVERY - test131 HTTPS on test131 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 549 bytes in 9.581 second response time [02:00:16] PROBLEM - test131 HTTPS on test131 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [02:01:18] RECOVERY - test131 SSH on test131 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [02:01:30] RECOVERY - test131 JobChron Service on test131 is OK: PROCS OK: 1 process with args 'redisJobChronService' [02:01:35] RECOVERY - test131 ferm_active on test131 is OK: OK ferm input default policy is set [02:01:38] RECOVERY - test131 Redis Process on test131 is OK: PROCS OK: 1 process with args 'redis-server' [02:01:44] RECOVERY - test131 JobRunner Service on test131 is OK: PROCS OK: 1 process with args 'redisJobRunnerService' [02:01:57] RECOVERY - test131 PowerDNS Recursor on test131 is OK: DNS OK: 0.206 seconds response time. miraheze.org returns 109.228.51.216,217.174.247.33,2a00:da00:1800:326::1,2a00:da00:1800:328::1 [02:02:06] PROBLEM - test131 Puppet on test131 is WARNING: WARNING: Puppet last ran 1 hour ago [02:02:09] RECOVERY - test131 MediaWiki Rendering on test131 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 3.403 second response time [02:02:13] RECOVERY - test131 HTTPS on test131 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 549 bytes in 0.033 second response time [02:02:17] RECOVERY - test131 Disk Space on test131 is OK: DISK OK - free space: / 12035 MB (42% inode=79%); [02:02:21] RECOVERY - test131 conntrack_table_size on test131 is OK: OK: nf_conntrack is 0 % full [02:02:49] RECOVERY - test131 NTP time on test131 is OK: NTP OK: Offset -0.0004454553127 secs [02:03:00] RECOVERY - test131 php-fpm on test131 is OK: PROCS OK: 9 processes with command name 'php-fpm7.4' [02:03:11] RECOVERY - test131 nutcracker process on test131 is OK: PROCS OK: 1 process with UID = 114 (nutcracker), command name 'nutcracker' [02:05:58] RECOVERY - test131 Puppet on test131 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [02:31:10] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 2.46, 4.29, 2.49 [02:33:09] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 0.85, 3.04, 2.24 [02:39:48] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 0.27, 0.30, 3.85 [02:43:48] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 0.23, 0.26, 3.02 [02:48:43] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.45, 3.68, 3.13 [02:50:39] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.72, 3.24, 3.02 [02:58:40] RECOVERY - dcmultiversewiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'dcmultiversewiki.com' will expire on Wed 10 May 2023 21:06:25 GMT +0000. [02:59:02] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 3.47, 2.36, 1.57 [03:00:45] RECOVERY - db112 Backups SQL on db112 is OK: FILE_AGE OK: /var/log/sql-backup.log is 43 seconds old and 364 bytes [03:01:01] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.76, 1.93, 1.49 [03:01:42] RECOVERY - db112 Backups SQL on db112 is OK: FILE_AGE OK: /var/log/sql-backup.log is 100 seconds old and 364 bytes [03:04:10] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.81, 3.50, 2.73 [03:06:06] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.65, 2.86, 2.58 [03:36:26] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.89, 4.21, 3.19 [03:38:22] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.15, 3.89, 3.20 [03:40:19] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.61, 3.08, 2.98 [03:57:20] PROBLEM - db112 Disk Space on db112 is WARNING: DISK WARNING - free space: / 8147 MB (6% inode=98%); [04:00:52] PROBLEM - housing.wiki - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query housing.wiki. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [04:06:18] PROBLEM - cp23 NTP time on cp23 is WARNING: NTP WARNING: Offset 0.1068634391 secs [04:08:18] RECOVERY - cp23 NTP time on cp23 is OK: NTP OK: Offset 0.0949716568 secs [04:27:20] PROBLEM - db112 Disk Space on db112 is CRITICAL: DISK CRITICAL - free space: / 7963 MB (5% inode=98%); [04:29:38] RECOVERY - housing.wiki - reverse DNS on sslhost is OK: SSL OK - housing.wiki reverse DNS resolves to cp33.miraheze.org - CNAME FLAT [04:30:39] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 13.05, 7.86, 3.75 [04:32:01] [02mw-config] 07thecutefinder opened pull request 03#5188: convict mediawiki of grand signature tyranny - 13https://github.com/miraheze/mw-config/pull/5188 [04:32:15] [02mw-config] 07thecutefinder commented on pull request 03#5187: T10707: Add $wgCleanSignatures to Meowpedia - 13https://github.com/miraheze/mw-config/pull/5187#issuecomment-1500788008 [04:32:27] PROBLEM - cp23 APT on cp23 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [04:33:04] miraheze/mw-config - thecutefinder the build passed. [04:34:25] RECOVERY - cp23 APT on cp23 is OK: APT OK: 2 packages available for upgrade (0 critical updates). [04:36:37] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 1.13, 3.61, 3.21 [04:36:48] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.52, 3.08, 2.84 [04:38:36] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 0.50, 2.54, 2.86 [04:38:44] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.37, 2.79, 2.76 [04:42:58] [02mw-config] 07thecutefinder synchronize pull request 03#5188: convict mediawiki of grand signature tyranny - 13https://github.com/miraheze/mw-config/pull/5188 [04:43:56] miraheze/mw-config - thecutefinder the build passed. [04:47:27] [02mw-config] 07thecutefinder commented on pull request 03#5188: convict mediawiki of grand signature tyranny - 13https://github.com/miraheze/mw-config/pull/5188#issuecomment-1500790365 [04:58:36] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 5.51, 3.05, 2.15 [05:00:59] PROBLEM - cp23 APT on cp23 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [05:02:36] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 3.50, 3.87, 2.74 [05:03:06] RECOVERY - cp23 APT on cp23 is OK: APT OK: 2 packages available for upgrade (0 critical updates). [05:06:36] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 0.75, 2.46, 2.46 [05:10:09] PROBLEM - db142 Current Load on db142 is CRITICAL: CRITICAL - load average: 8.96, 6.29, 3.57 [05:12:09] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 2.62, 4.94, 3.42 [05:51:48] PROBLEM - en.religiononfire.mar.in.ua - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query en.religiononfire.mar.in.ua. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [06:21:31] RECOVERY - en.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - en.religiononfire.mar.in.ua reverse DNS resolves to cp23.miraheze.org - CNAME OK [06:31:18] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 4.39, 6.71, 3.75 [06:35:17] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 0.76, 3.34, 3.03 [06:51:07] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 7.00, 6.02, 5.55 [06:53:07] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 5.55, 5.83, 5.53 [06:56:05] PROBLEM - dcmultiversewiki.com - LetsEncrypt on sslhost is CRITICAL: connect to address dcmultiversewiki.com and port 443: Network is unreachableHTTP CRITICAL - Unable to open TCP socket [07:03:20] PROBLEM - db112 Disk Space on db112 is WARNING: DISK WARNING - free space: / 8075 MB (6% inode=98%); [07:25:20] PROBLEM - db112 Disk Space on db112 is CRITICAL: DISK CRITICAL - free space: / 7957 MB (5% inode=98%); [07:59:54] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 3.60, 2.53, 1.67 [08:01:54] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 4.62, 3.23, 2.03 [08:03:53] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.64, 2.72, 2.00 [08:16:08] PROBLEM - db142 Current Load on db142 is CRITICAL: CRITICAL - load average: 8.53, 5.47, 2.84 [08:18:09] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 2.30, 4.31, 2.74 [08:23:09] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 7.32, 6.92, 5.85 [08:25:07] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 4.51, 6.11, 5.70 [08:50:18] PROBLEM - cp23 NTP time on cp23 is WARNING: NTP WARNING: Offset 0.1100741625 secs [08:53:09] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 8.99, 6.72, 5.78 [09:01:20] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 4.30, 7.35, 7.22 [09:02:36] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 2.12, 3.44, 2.33 [09:03:15] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 3.24, 6.02, 6.75 [09:04:36] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.02, 2.65, 2.17 [09:16:18] RECOVERY - cp23 NTP time on cp23 is OK: NTP OK: Offset 0.09752836823 secs [09:22:39] PROBLEM - en.religiononfire.mar.in.ua - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query en.religiononfire.mar.in.ua. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [09:23:07] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 9.31, 6.46, 5.71 [09:25:08] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 5.05, 5.93, 5.62 [09:30:36] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 4.98, 3.07, 2.04 [09:32:36] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.93, 2.63, 2.01 [09:46:09] PROBLEM - db142 Current Load on db142 is WARNING: WARNING - load average: 6.99, 4.91, 2.65 [09:48:09] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 1.46, 3.48, 2.39 [09:52:21] PROBLEM - en.religiononfire.mar.in.ua - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - en.religiononfire.mar.in.ua All nameservers failed to answer the query. [09:53:13] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 10.73, 7.55, 5.83 [09:55:34] PROBLEM - swiftobject121 APT on swiftobject121 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [09:57:44] RECOVERY - swiftobject121 APT on swiftobject121 is OK: APT OK: 16 packages available for upgrade (0 critical updates). [10:01:15] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 4.25, 7.98, 7.55 [10:05:07] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 4.24, 5.92, 6.78 [10:22:03] RECOVERY - en.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - en.religiononfire.mar.in.ua reverse DNS resolves to cp23.miraheze.org - CNAME OK [10:23:17] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 10.29, 7.34, 6.28 [10:26:26] PROBLEM - cp22 NTP time on cp22 is WARNING: NTP WARNING: Offset 0.1173259318 secs [10:26:35] PROBLEM - swiftobject121 APT on swiftobject121 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [10:27:20] PROBLEM - db112 Disk Space on db112 is WARNING: DISK WARNING - free space: / 8014 MB (6% inode=98%); [10:34:58] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.97, 9.58, 8.02 [10:36:58] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.08, 8.72, 7.91 [10:37:20] PROBLEM - db112 Disk Space on db112 is CRITICAL: DISK CRITICAL - free space: / 7963 MB (5% inode=98%); [10:37:50] RECOVERY - swiftobject121 APT on swiftobject121 is OK: APT OK: 16 packages available for upgrade (0 critical updates). [10:49:07] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 6.76, 5.89, 7.90 [10:51:16] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 9.92, 7.05, 8.05 [10:55:29] PROBLEM - swiftobject121 APT on swiftobject121 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [10:56:26] RECOVERY - cp22 NTP time on cp22 is OK: NTP OK: Offset 0.08196994662 secs [10:56:28] PROBLEM - swiftobject121 PowerDNS Recursor on swiftobject121 is CRITICAL: CRITICAL - Plugin timed out while executing system call [10:57:00] PROBLEM - swiftobject121 SSH on swiftobject121 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:57:49] PROBLEM - swiftobject121 Puppet on swiftobject121 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [10:59:52] PROBLEM - swiftobject121 NTP time on swiftobject121 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [11:02:14] RECOVERY - swiftobject121 NTP time on swiftobject121 is OK: NTP OK: Offset -0.005251735449 secs [11:03:02] PROBLEM - swiftobject121 Puppet on swiftobject121 is WARNING: WARNING: Puppet last ran 1 hour ago [11:03:15] RECOVERY - swiftobject121 SSH on swiftobject121 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [11:03:39] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.81, 4.84, 2.59 [11:04:13] RECOVERY - swiftobject121 PowerDNS Recursor on swiftobject121 is OK: DNS OK: 7.658 seconds response time. miraheze.org returns 109.228.51.216,217.174.247.33,2a00:da00:1800:326::1,2a00:da00:1800:328::1 [11:05:39] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.37, 3.46, 2.35 [11:07:39] PROBLEM - swiftobject121 SSH on swiftobject121 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:07:39] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 0.97, 2.64, 2.19 [11:07:59] PROBLEM - swiftobject121 Puppet on swiftobject121 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [11:09:38] RECOVERY - swiftobject121 SSH on swiftobject121 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [11:10:01] PROBLEM - swiftobject121 Puppet on swiftobject121 is WARNING: WARNING: Puppet last ran 1 hour ago [11:12:52] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.60, 10.03, 9.13 [11:13:04] RECOVERY - swiftobject121 APT on swiftobject121 is OK: APT OK: 16 packages available for upgrade (0 critical updates). [11:14:52] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.13, 8.84, 8.79 [11:18:09] PROBLEM - db142 Current Load on db142 is WARNING: WARNING - load average: 7.00, 4.32, 2.25 [11:18:18] PROBLEM - cp23 NTP time on cp23 is WARNING: NTP WARNING: Offset 0.1343723238 secs [11:20:09] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 1.72, 3.35, 2.16 [11:25:35] PROBLEM - swiftobject121 APT on swiftobject121 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [11:25:45] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.17, 10.83, 9.57 [11:27:43] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 6.86, 9.14, 9.09 [11:27:50] RECOVERY - swiftobject121 APT on swiftobject121 is OK: APT OK: 16 packages available for upgrade (0 critical updates). [11:34:18] RECOVERY - cp23 NTP time on cp23 is OK: NTP OK: Offset 0.08814832568 secs [11:56:42] PROBLEM - swiftobject121 APT on swiftobject121 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [11:57:04] PROBLEM - swiftobject121 Puppet on swiftobject121 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [11:57:57] PROBLEM - swiftobject121 SSH on swiftobject121 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:59:11] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 5.46, 2.96, 1.95 [11:59:33] PROBLEM - swiftobject121 PowerDNS Recursor on swiftobject121 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [12:01:10] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.54, 2.38, 1.87 [12:01:42] PROBLEM - swiftobject121 conntrack_table_size on swiftobject121 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [12:04:26] RECOVERY - swiftobject121 conntrack_table_size on swiftobject121 is OK: OK: nf_conntrack is 0 % full [12:04:27] RECOVERY - swiftobject121 PowerDNS Recursor on swiftobject121 is OK: DNS OK: 1.623 second response time. miraheze.org returns 109.228.51.216,217.174.247.33,2a00:da00:1800:326::1,2a00:da00:1800:328::1 [12:05:08] PROBLEM - swiftobject121 Puppet on swiftobject121 is WARNING: WARNING: Puppet last ran 2 hours ago [12:05:11] RECOVERY - swiftobject121 APT on swiftobject121 is OK: APT OK: 16 packages available for upgrade (0 critical updates). [12:06:18] RECOVERY - swiftobject121 SSH on swiftobject121 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [12:16:19] [02MirahezeMagic] 07Reception123 closed pull request 03#414: RebuildVersionCache: remove need for GitInfo core hack - 13https://github.com/miraheze/MirahezeMagic/pull/414 [12:16:22] [02miraheze/MirahezeMagic] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/MirahezeMagic/compare/09a3c8dcd091...77b546e318d5 [12:16:23] [02miraheze/MirahezeMagic] 07Universal-Omega 0377b546e - RebuildVersionCache: remove need for GitInfo core hack (#414) [12:20:28] RECOVERY - swiftobject121 Puppet on swiftobject121 is OK: OK: Puppet is currently enabled, last run 53 seconds ago with 0 failures [12:24:27] miraheze/MirahezeMagic - Reception123 the build passed. [12:30:54] PROBLEM - housing.wiki - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - housing.wiki All nameservers failed to answer the query. [12:34:09] PROBLEM - db142 Current Load on db142 is CRITICAL: CRITICAL - load average: 10.26, 5.90, 2.88 [12:36:09] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 5.24, 5.97, 3.31 [12:43:07] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 3.03, 2.88, 7.46 [12:46:17] RECOVERY - wiki.yuanpi.eu.org - reverse DNS on sslhost is OK: SSL OK - wiki.yuanpi.eu.org reverse DNS resolves to cp23.miraheze.org - CNAME OK [12:47:07] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 2.57, 2.73, 6.35 [12:50:15] [02puppet] 07paladox closed pull request 03#3110: Introduce opensearch puppet module - 13https://github.com/miraheze/puppet/pull/3110 [12:50:17] [02miraheze/puppet] 07paladox deleted branch 03opensearch [12:50:19] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+104/-0/±0] 13https://github.com/miraheze/puppet/compare/8b65073ebd76...d33ea083f28b [12:50:22] [02miraheze/puppet] 07paladox 03d33ea08 - Introduce opensearch puppet module (#3110) [12:50:24] [02puppet] 07paladox deleted branch 03opensearch - 13https://github.com/miraheze/puppet [12:56:19] PROBLEM - en.religiononfire.mar.in.ua - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - en.religiononfire.mar.in.ua All nameservers failed to answer the query. [12:59:45] PROBLEM - housing.wiki - reverse DNS on sslhost is WARNING: Timeout: The DNS operation timed out after 5.406564474105835 seconds [13:26:01] RECOVERY - en.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - en.religiononfire.mar.in.ua reverse DNS resolves to cp22.miraheze.org - CNAME OK [13:28:50] RECOVERY - housing.wiki - reverse DNS on sslhost is OK: SSL OK - housing.wiki reverse DNS resolves to cp32.miraheze.org - CNAME FLAT [14:02:38] PROBLEM - gs.sidem.wiki - reverse DNS on sslhost is WARNING: Timeout: The DNS operation timed out after 5.406033992767334 seconds [14:31:46] RECOVERY - gs.sidem.wiki - reverse DNS on sslhost is OK: SSL OK - gs.sidem.wiki reverse DNS resolves to cp22.miraheze.org - CNAME OK [14:31:50] PROBLEM - housing.wiki - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - housing.wiki All nameservers failed to answer the query. [14:34:06] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 16.58, 11.51, 9.48 [14:36:04] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.97, 11.94, 9.92 [14:40:12] PROBLEM - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - uk.religiononfire.mar.in.ua All nameservers failed to answer the query. [14:41:57] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 9.19, 9.89, 9.66 [14:43:18] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.44, 10.24, 9.58 [14:45:16] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 9.20, 10.07, 9.61 [14:47:17] RECOVERY - cloud11 IPMI Sensors on cloud11 is OK: IPMI Status: OK [14:51:07] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.32, 10.04, 9.68 [14:51:17] PROBLEM - cloud11 IPMI Sensors on cloud11 is CRITICAL: IPMI Status: Critical [Cntlr 2 Bay 7 = Critical] [14:53:04] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 6.91, 9.13, 9.41 [15:00:38] RECOVERY - housing.wiki - reverse DNS on sslhost is OK: SSL OK - housing.wiki reverse DNS resolves to cp33.miraheze.org - CNAME FLAT [15:09:24] RECOVERY - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - uk.religiononfire.mar.in.ua reverse DNS resolves to cp22.miraheze.org - CNAME OK [15:41:07] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.56, 10.79, 9.72 [15:43:05] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.09, 10.71, 9.83 [15:43:52] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.16, 10.26, 9.42 [15:45:49] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.98, 9.51, 9.25 [15:48:58] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 9.92, 10.11, 9.83 [15:52:52] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.81, 10.85, 10.18 [15:54:36] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 15.12, 11.67, 10.20 [15:56:34] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.20, 11.03, 10.13 [16:00:30] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.70, 10.15, 9.98 [16:00:52] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.57, 9.14, 9.68 [16:00:57] PROBLEM - housing.wiki - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - housing.wiki All nameservers failed to answer the query. [16:09:00] PROBLEM - db142 Current Load on db142 is WARNING: WARNING - load average: 7.21, 6.27, 4.10 [16:10:56] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 2.77, 4.93, 3.87 [16:12:52] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.24, 9.65, 9.53 [16:14:52] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.02, 8.97, 9.29 [16:29:50] PROBLEM - housing.wiki - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query housing.wiki. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [16:43:17] RECOVERY - cloud11 IPMI Sensors on cloud11 is OK: IPMI Status: OK [16:47:17] PROBLEM - cloud11 IPMI Sensors on cloud11 is CRITICAL: IPMI Status: Critical [Cntlr 2 Bay 7 = Critical] [16:53:44] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 11.47, 6.97, 3.90 [17:07:22] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.50, 9.73, 8.12 [17:07:39] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 0.82, 2.33, 3.68 [17:09:20] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 9.44, 9.47, 8.21 [17:09:39] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 0.93, 1.88, 3.35 [17:26:40] PROBLEM - cp23 NTP time on cp23 is WARNING: NTP WARNING: Offset 0.1147558689 secs [17:34:58] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.69, 9.97, 8.63 [17:36:58] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.87, 9.61, 8.66 [17:48:18] RECOVERY - cp23 NTP time on cp23 is OK: NTP OK: Offset 0.09168380499 secs [17:56:52] [02mw-config] 07brandon-wm commented on pull request 03#5188: convict mediawiki of grand signature tyranny - 13https://github.com/miraheze/mw-config/pull/5188#issuecomment-1500944633 [17:57:43] [02mw-config] 07brandon-wm commented on pull request 03#5187: T10707: Add $wgCleanSignatures to Meowpedia - 13https://github.com/miraheze/mw-config/pull/5187#issuecomment-1500944798 [18:01:29] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 7.95, 5.91, 3.13 [18:05:28] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.60, 3.38, 2.71 [18:11:22] PROBLEM - wiki.seamly.net - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query wiki.seamly.net. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [18:15:20] PROBLEM - db112 Disk Space on db112 is WARNING: DISK WARNING - free space: / 10918 MB (8% inode=98%); [18:28:46] RECOVERY - housing.wiki - reverse DNS on sslhost is OK: SSL OK - housing.wiki reverse DNS resolves to cp32.miraheze.org - CNAME FLAT [18:31:08] PROBLEM - cp23 APT on cp23 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [18:33:07] RECOVERY - cp23 APT on cp23 is OK: APT OK: 2 packages available for upgrade (0 critical updates). [18:40:06] RECOVERY - wiki.seamly.net - reverse DNS on sslhost is OK: SSL OK - wiki.seamly.net reverse DNS resolves to cp23.miraheze.org - CNAME OK [18:43:34] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 7.98, 10.28, 9.95 [18:45:32] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 6.34, 9.25, 9.63 [18:49:33] !log MariaDB [metawiki]> UPDATE interwiki SET iw_url = REPLACE(iw_url, 'http://', 'https://'); [18:49:37] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:58:30] PROBLEM - en.religiononfire.mar.in.ua - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - en.religiononfire.mar.in.ua All nameservers failed to answer the query. [19:28:12] RECOVERY - en.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - en.religiononfire.mar.in.ua reverse DNS resolves to cp23.miraheze.org - CNAME OK [19:34:58] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.44, 10.67, 9.08 [19:36:58] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 9.43, 10.19, 9.10 [19:40:12] PROBLEM - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - uk.religiononfire.mar.in.ua All nameservers failed to answer the query. [19:56:38] [02mw-config] 07thecutefinder edited pull request 03#5188: $wgCleanSignatures - 13https://github.com/miraheze/mw-config/pull/5188 [19:56:44] [02mw-config] 07thecutefinder edited pull request 03#5188: Add $wgCleanSignatures - 13https://github.com/miraheze/mw-config/pull/5188 [19:56:56] [02mw-config] 07thecutefinder edited pull request 03#5188: Add $wgCleanSignatures - 13https://github.com/miraheze/mw-config/pull/5188 [19:57:00] [02mw-config] 07thecutefinder commented on pull request 03#5188: Add $wgCleanSignatures - 13https://github.com/miraheze/mw-config/pull/5188#issuecomment-1500966542 [19:57:27] [02mw-config] 07thecutefinder edited pull request 03#5188: Add $wgCleanSignatures = false - 13https://github.com/miraheze/mw-config/pull/5188 [19:58:58] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 4.19, 2.75, 1.71 [20:01:36] PROBLEM - cp23 APT on cp23 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [20:02:30] [02mw-config] 07thelevking commented on pull request 03#5188: Add $wgCleanSignatures = false - 13https://github.com/miraheze/mw-config/pull/5188#issuecomment-1500967584 [20:03:30] [02mw-config] 07thecutefinder commented on pull request 03#5188: Add $wgCleanSignatures = false - 13https://github.com/miraheze/mw-config/pull/5188#issuecomment-1500967776 [20:03:35] RECOVERY - cp23 APT on cp23 is OK: APT OK: 2 packages available for upgrade (0 critical updates). [20:03:59] !log db121: MariaDB [allthetropeswiki]> truncate job; [20:04:03] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:04:08] [02mw-config] 07thecutefinder edited a comment on pull request 03#5188: Add $wgCleanSignatures = false - 13https://github.com/miraheze/mw-config/pull/5188#issuecomment-1500966542 [20:04:25] !log db131: MariaDB [metawiki]> truncate job; [20:04:29] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:04:56] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.43, 3.28, 2.44 [20:05:24] [02mw-config] 07redbluegreenhat commented on pull request 03#5188: Add $wgCleanSignatures = false - 13https://github.com/miraheze/mw-config/pull/5188#issuecomment-1500968143 [20:05:54] !log db121: MariaDB [allthetropeswiki]> truncate objectcache; [20:05:58] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:09:23] PROBLEM - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query mar.in.ua. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [20:09:43] [02mw-config] 07thecutefinder commented on pull request 03#5188: Add $wgCleanSignatures = false - 13https://github.com/miraheze/mw-config/pull/5188#issuecomment-1500968898 [20:10:01] [02mw-config] 07thecutefinder edited a comment on pull request 03#5188: Add $wgCleanSignatures = false - 13https://github.com/miraheze/mw-config/pull/5188#issuecomment-1500968898 [20:17:28] [02mw-config] 07redbluegreenhat commented on pull request 03#5188: Add $wgCleanSignatures = false - 13https://github.com/miraheze/mw-config/pull/5188#issuecomment-1500970150 [20:19:52] [02mw-config] 07brandon-wm commented on pull request 03#5188: Add $wgCleanSignatures = false - 13https://github.com/miraheze/mw-config/pull/5188#issuecomment-1500970563 [20:21:16] [02mw-config] 07redbluegreenhat reviewed pull request 03#5187 commit - 13https://github.com/miraheze/mw-config/pull/5187#discussion_r1161154051 [20:23:51] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.12, 4.13, 3.13 [20:25:51] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.95, 3.32, 2.95 [20:26:23] [02mw-config] 07brandon-wm reviewed pull request 03#5187 commit - 13https://github.com/miraheze/mw-config/pull/5187#discussion_r1161154513 [20:28:28] [02mw-config] 07AgentIsai reviewed pull request 03#5187 commit - 13https://github.com/miraheze/mw-config/pull/5187#discussion_r1161154682 [20:36:23] [02mw-config] 07brandon-wm reviewed pull request 03#5187 commit - 13https://github.com/miraheze/mw-config/pull/5187#discussion_r1161155372 [20:38:35] PROBLEM - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - uk.religiononfire.mar.in.ua All nameservers failed to answer the query. [21:07:51] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.31, 4.03, 2.89 [21:08:12] RECOVERY - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - uk.religiononfire.mar.in.ua reverse DNS resolves to cp23.miraheze.org - CNAME OK [21:09:51] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.02, 3.24, 2.73 [21:24:18] PROBLEM - cp23 NTP time on cp23 is WARNING: NTP WARNING: Offset 0.1167320907 secs [21:48:18] RECOVERY - cp23 NTP time on cp23 is OK: NTP OK: Offset 0.07838445902 secs [21:51:18] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.99, 3.43, 2.84 [21:53:15] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.55, 2.67, 2.63 [22:08:51] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.96, 3.44, 3.15 [22:10:47] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.66, 2.90, 2.99 [22:22:28] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.08, 3.25, 2.38 [22:24:25] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.66, 2.59, 2.24 [22:31:27] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 5.40, 4.00, 2.32 [22:32:27] PROBLEM - cp23 APT on cp23 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [22:33:26] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.73, 3.22, 2.25 [22:34:24] RECOVERY - cp23 APT on cp23 is OK: APT OK: 2 packages available for upgrade (0 critical updates). [22:36:31] PROBLEM - cp23 NTP time on cp23 is WARNING: NTP WARNING: Offset 0.1010989845 secs [22:36:43] [02mediawiki] 07Universal-Omega opened pull request 03#14459: Remove GitInfo hack - 13https://github.com/miraheze/mediawiki/pull/14459 [22:38:05] [02mediawiki] 07Universal-Omega opened pull request 03#14460: Remove GitInfo hack - 13https://github.com/miraheze/mediawiki/pull/14460 [22:40:19] RECOVERY - cp23 NTP time on cp23 is OK: NTP OK: Offset 0.09941247106 secs [22:50:58] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.88, 10.77, 9.03 [22:51:43] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 3.35, 5.26, 3.65 [22:52:14] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.82, 10.73, 9.16 [22:52:58] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.97, 10.03, 8.97 [22:54:12] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 14.77, 12.11, 9.85 [22:55:39] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.43, 3.71, 3.36 [22:56:09] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.98, 11.80, 10.00 [22:56:58] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.55, 10.91, 9.59 [22:57:39] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 0.64, 2.64, 3.01 [23:00:58] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.66, 9.87, 9.51 [23:04:58] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.82, 11.71, 10.40 [23:05:58] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.50, 9.81, 9.89 [23:08:58] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 6.83, 9.46, 9.81 [23:40:16] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.05, 9.56, 8.83 [23:42:14] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 9.92, 9.69, 8.97 [23:46:09] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.41, 2.60, 2.04 [23:48:09] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 2.48, 2.63, 2.13