[00:01:53] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 11.62, 9.14, 5.62 [00:02:48] PROBLEM - cp22 Current Load on cp22 is CRITICAL: CRITICAL - load average: 6.21, 6.65, 3.32 [00:02:52] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.68, 5.16, 3.80 [00:03:07] PROBLEM - cp22 NTP time on cp22 is WARNING: NTP WARNING: Offset 0.1155275404 secs [00:03:42] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 11.07, 13.57, 6.83 [00:06:48] PROBLEM - cp22 Current Load on cp22 is WARNING: WARNING - load average: 1.66, 3.91, 2.95 [00:08:48] RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 1.21, 2.94, 2.71 [00:11:59] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.83, 10.79, 9.53 [00:13:53] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.57, 10.00, 9.40 [00:15:42] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.47, 2.87, 3.89 [00:16:48] PROBLEM - cp22 Current Load on cp22 is CRITICAL: CRITICAL - load average: 6.24, 6.75, 4.45 [00:17:36] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 1.13, 2.49, 3.96 [00:19:39] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.21, 3.30, 3.80 [00:20:48] PROBLEM - cp22 Current Load on cp22 is WARNING: WARNING - load average: 0.57, 3.34, 3.58 [00:21:31] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.18, 10.72, 9.84 [00:21:35] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 0.71, 1.49, 3.21 [00:21:38] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.04, 2.76, 3.54 [00:22:48] RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 0.27, 2.33, 3.18 [00:25:20] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 9.07, 10.03, 9.77 [00:27:33] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.15, 2.48, 3.21 [00:28:27] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.45, 3.29, 3.94 [00:29:07] RECOVERY - cp22 NTP time on cp22 is OK: NTP OK: Offset 0.0969055295 secs [00:29:08] PROBLEM - db142 Current Load on db142 is WARNING: WARNING - load average: 7.16, 6.76, 5.41 [00:30:28] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.31, 3.76, 4.03 [00:31:02] PROBLEM - db142 Current Load on db142 is CRITICAL: CRITICAL - load average: 10.82, 8.07, 6.04 [00:32:41] PROBLEM - es141 Current Load on es141 is WARNING: WARNING - load average: 3.97, 3.37, 2.77 [00:33:00] PROBLEM - db142 Current Load on db142 is WARNING: WARNING - load average: 7.62, 7.90, 6.23 [00:34:38] RECOVERY - es141 Current Load on es141 is OK: OK - load average: 2.35, 3.03, 2.72 [00:35:00] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 4.50, 6.56, 5.94 [00:38:27] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.00, 3.15, 3.79 [00:40:27] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.11, 3.33, 3.76 [00:41:19] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.87, 11.20, 9.88 [00:42:27] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.86, 3.15, 3.64 [00:43:19] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.45, 10.44, 9.76 [00:43:48] PROBLEM - db142 Current Load on db142 is CRITICAL: CRITICAL - load average: 10.70, 8.13, 6.79 [00:45:19] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.92, 9.74, 9.60 [00:48:27] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.49, 2.58, 3.26 [00:50:26] PROBLEM - es141 Current Load on es141 is WARNING: WARNING - load average: 3.86, 3.44, 3.13 [00:52:23] RECOVERY - es141 Current Load on es141 is OK: OK - load average: 3.30, 3.34, 3.12 [00:57:07] PROBLEM - db142 Current Load on db142 is WARNING: WARNING - load average: 5.22, 7.09, 7.45 [01:03:00] PROBLEM - db142 Current Load on db142 is CRITICAL: CRITICAL - load average: 10.91, 7.77, 7.45 [01:04:10] PROBLEM - es141 Current Load on es141 is WARNING: WARNING - load average: 3.62, 3.49, 3.20 [01:05:01] PROBLEM - db142 Current Load on db142 is WARNING: WARNING - load average: 5.51, 6.90, 7.19 [01:06:08] RECOVERY - es141 Current Load on es141 is OK: OK - load average: 2.41, 3.06, 3.08 [01:09:00] PROBLEM - db142 Current Load on db142 is CRITICAL: CRITICAL - load average: 12.66, 9.04, 7.91 [01:10:07] PROBLEM - cp32 NTP time on cp32 is WARNING: NTP WARNING: Offset 0.1910184622 secs [01:18:07] RECOVERY - cp32 NTP time on cp32 is OK: NTP OK: Offset 0.04677209258 secs [01:18:53] PROBLEM - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query mar.in.ua. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [01:19:00] PROBLEM - db142 Current Load on db142 is WARNING: WARNING - load average: 0.87, 5.06, 7.18 [01:21:00] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 0.65, 3.61, 6.39 [01:21:09] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.66, 4.01, 3.18 [01:23:06] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.54, 3.13, 2.97 [01:30:55] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.92, 4.85, 3.70 [01:31:06] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 3.79, 2.66, 1.71 [01:31:28] PROBLEM - cp23 APT on cp23 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [01:33:05] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 2.95, 2.83, 1.89 [01:33:28] RECOVERY - cp23 APT on cp23 is OK: APT OK: 1 packages available for upgrade (0 critical updates). [01:45:24] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 3.95, 4.04, 3.25 [01:47:23] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.75, 3.60, 3.19 [01:49:21] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.96, 3.07, 3.04 [01:50:27] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.75, 3.11, 3.76 [01:53:17] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.89, 3.65, 3.28 [01:55:15] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 6.51, 4.34, 3.55 [01:56:27] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 6.75, 4.78, 4.19 [01:57:14] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.23, 3.78, 3.43 [02:01:11] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.22, 3.07, 3.24 [02:11:47] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.65, 10.65, 9.30 [02:12:54] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 4.69, 3.45, 2.58 [02:14:54] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 2.68, 3.20, 2.61 [02:16:53] RECOVERY - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - uk.religiononfire.mar.in.ua reverse DNS resolves to cp23.miraheze.org - CNAME OK [02:17:30] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.87, 10.92, 9.98 [02:21:19] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.24, 9.68, 9.71 [02:28:44] PROBLEM - cp23 NTP time on cp23 is WARNING: NTP WARNING: Offset 0.2035148144 secs [02:30:27] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.76, 3.05, 3.99 [02:38:27] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.40, 2.37, 3.25 [02:41:00] PROBLEM - db142 Current Load on db142 is CRITICAL: CRITICAL - load average: 8.11, 5.29, 2.84 [02:43:00] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 3.08, 4.39, 2.81 [02:52:44] RECOVERY - cp23 NTP time on cp23 is OK: NTP OK: Offset -0.02293804288 secs [03:00:16] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.16, 3.43, 3.16 [03:00:36] RECOVERY - db101 Backups SQL on db101 is OK: FILE_AGE OK: /var/log/sql-backup.log is 34 seconds old and 275 bytes [03:04:09] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.74, 3.52, 3.29 [03:04:23] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.48, 4.23, 3.27 [03:06:06] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.77, 2.96, 3.12 [03:06:23] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.89, 3.32, 3.05 [03:27:07] PROBLEM - cp22 NTP time on cp22 is WARNING: NTP WARNING: Offset 0.1140771508 secs [03:30:42] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 6.42, 5.40, 2.85 [03:32:26] PROBLEM - cp23 APT on cp23 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [03:36:27] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.40, 3.81, 3.36 [03:38:23] RECOVERY - cloud11 IPMI Sensors on cloud11 is OK: IPMI Status: OK [03:38:27] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.14, 3.54, 3.32 [03:40:22] RECOVERY - cp23 APT on cp23 is OK: APT OK: 1 packages available for upgrade (0 critical updates). [03:42:23] PROBLEM - cloud11 IPMI Sensors on cloud11 is CRITICAL: IPMI Status: Critical [Cntlr 2 Bay 7 = Critical] [03:42:27] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.94, 4.48, 3.71 [03:42:41] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 0.89, 3.26, 3.33 [03:52:27] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.97, 3.74, 3.80 [03:54:27] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.58, 4.06, 3.91 [03:56:27] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.28, 3.31, 3.64 [03:58:27] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.06, 2.59, 3.34 [04:01:07] RECOVERY - cp22 NTP time on cp22 is OK: NTP OK: Offset 0.08191895485 secs [04:24:23] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.62, 3.30, 2.91 [04:26:23] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.56, 3.02, 2.85 [04:39:47] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.13, 3.59, 3.28 [04:41:44] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.63, 2.83, 3.04 [04:50:23] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.31, 3.32, 2.68 [04:52:23] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 3.19, 3.05, 2.65 [04:58:43] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 6.48, 3.20, 1.74 [05:01:02] PROBLEM - cp23 APT on cp23 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [05:04:09] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 6.20, 4.52, 3.42 [05:06:20] RECOVERY - cp23 APT on cp23 is OK: APT OK: 1 packages available for upgrade (0 critical updates). [05:06:42] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 1.92, 3.93, 3.01 [05:08:03] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.64, 3.20, 3.15 [05:08:41] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 0.61, 2.76, 2.69 [05:30:31] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.04, 3.61, 3.16 [05:31:10] PROBLEM - cp23 APT on cp23 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [05:32:27] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.47, 3.23, 3.07 [05:33:10] RECOVERY - cp23 APT on cp23 is OK: APT OK: 1 packages available for upgrade (0 critical updates). [05:38:53] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 8.24, 7.01, 5.80 [05:40:52] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 4.40, 6.10, 5.63 [05:50:53] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.44, 6.38, 5.80 [05:52:52] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 4.68, 5.80, 5.66 [05:57:28] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=seccdxwiki --no-updates --username-prefix=mh:seccdxmodel /home/reception/ImportDump/seccdxwiki-20230325185833.xml (START) [05:57:33] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:04:57] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=seccdxwiki --no-updates --username-prefix=mh:seccdxmodel /home/reception/ImportDump/seccdxwiki-20230325185833.xml (END - exit=0) [06:04:58] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=seccdxwiki (START) [06:05:00] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:05:04] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:07:00] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=seccdxwiki (END - exit=0) [06:07:01] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/initSiteStats.php --wiki=seccdxwiki --active --update (END - exit=0) [06:07:04] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:07:08] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:12:23] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.08, 3.64, 2.55 [06:14:23] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.40, 2.74, 2.35 [06:14:58] [02mw-config] 07LuciferianThomas opened pull request 03#5168: Fix Kartographer configurations for hkrailwiki - 13https://github.com/miraheze/mw-config/pull/5168 [06:15:56] miraheze/mw-config - LuciferianThomas the build passed. [06:54:53] [02mw-config] 07Reception123 closed pull request 03#5168: Fix Kartographer configurations for hkrailwiki - 13https://github.com/miraheze/mw-config/pull/5168 [06:54:56] [02miraheze/mw-config] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/cb26f32735c7...73673af6ff82 [06:54:59] [02miraheze/mw-config] 07LuciferianThomas 0373673af - Fix Kartographer configurations for hkrailwiki (#5168) [06:54:59] !log [reception@mwtask141] starting deploy of {'pull': 'config', 'config': True} to all [06:55:04] !log [reception@mwtask141] DEPLOY ABORTED: Canary check failed for publictestwiki.com@localhost [06:55:05] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:55:09] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:55:54] miraheze/mw-config - Reception123 the build passed. [06:56:24] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 11.15, 5.51, 3.27 [06:57:32] !log [@test131] starting deploy of {'config': True} to all [06:57:33] !log [@test131] finished deploy of {'config': True} to all - SUCCESS in 0s [06:57:36] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:57:41] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:02:23] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.83, 3.39, 3.08 [07:10:27] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.54, 3.16, 2.24 [07:11:55] [02ManageWiki] 07Reception123 closed pull request 03#376: Add SQL patches for inserting default permissions and namespaces - 13https://github.com/miraheze/ManageWiki/pull/376 [07:11:56] [02miraheze/ManageWiki] 07Reception123 pushed 031 commit to 03master [+2/-0/±0] 13https://github.com/miraheze/ManageWiki/compare/adc5aa3fbd62...f34f3f22f3ff [07:11:58] [02miraheze/ManageWiki] 07Universal-Omega 03f34f3f2 - Add SQL patches for inserting default permissions and namespaces (#376) [07:12:06] !log [reception@mwtask141] starting deploy of {'pull': 'config', 'config': True, 'force': True} to all [07:12:10] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:12:13] !log [reception@mwtask141] finished deploy of {'pull': 'config', 'config': True, 'force': True} to all - SUCCESS in 7s [07:12:18] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:12:27] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.00, 2.61, 2.15 [07:15:32] miraheze/ManageWiki - Reception123 the build passed. [07:26:23] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.37, 3.69, 2.84 [07:28:23] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.77, 3.16, 2.74 [07:55:14] PROBLEM - wiki.leapit.no - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:00:41] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 6.07, 3.60, 2.09 [08:01:46] PROBLEM - cp23 APT on cp23 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [08:03:48] RECOVERY - cp23 APT on cp23 is OK: APT OK: 1 packages available for upgrade (0 critical updates). [08:06:41] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 0.63, 3.15, 2.67 [08:24:02] RECOVERY - wiki.leapit.no - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.leapit.no' will expire on Thu 11 May 2023 19:30:42 GMT +0000. [08:26:16] hey [08:26:25] wiki.leapit.no doesn't actually exist anymore [08:26:32] it returns a "wiki not found" page [08:28:47] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 3.52, 3.21, 2.30 [08:30:46] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 0.96, 2.38, 2.10 [09:42:44] PROBLEM - cp23 NTP time on cp23 is WARNING: NTP WARNING: Offset 0.1144902706 secs [10:04:44] RECOVERY - cp23 NTP time on cp23 is OK: NTP OK: Offset 0.0757752955 secs [10:20:29] PROBLEM - en.religiononfire.mar.in.ua - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - en.religiononfire.mar.in.ua All nameservers failed to answer the query. [10:29:14] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 4.59, 3.38, 2.17 [10:30:59] PROBLEM - cp23 APT on cp23 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [10:31:13] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 3.90, 3.59, 2.41 [10:32:59] RECOVERY - cp23 APT on cp23 is OK: APT OK: 1 packages available for upgrade (0 critical updates). [10:33:12] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 2.07, 3.10, 2.37 [10:49:08] RECOVERY - en.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - en.religiononfire.mar.in.ua reverse DNS resolves to cp23.miraheze.org - CNAME OK [12:18:52] PROBLEM - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query uk.religiononfire.mar.in.ua. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [12:46:08] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.29, 9.95, 8.84 [12:47:45] RECOVERY - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - uk.religiononfire.mar.in.ua reverse DNS resolves to cp22.miraheze.org - CNAME OK [12:48:02] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.50, 9.54, 8.83 [12:59:38] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 19.19, 7.10, 3.67 [13:00:28] [02miraheze/mediawiki] 07Reception123 pushed 031 commit to 03revert-13948-dependabot/submodules/REL1_39/extensions/Translate-7e4d25d [+0/-0/±1] 13https://github.com/miraheze/mediawiki/commit/2587b7667c25 [13:00:30] [02miraheze/mediawiki] 07Reception123 032587b76 - Revert "Bump extensions/Translate from `eea9f68` to `7e4d25d` (#13948)" [13:00:31] [02mediawiki] 07Reception123 created branch 03revert-13948-dependabot/submodules/REL1_39/extensions/Translate-7e4d25d - 13https://github.com/miraheze/mediawiki [13:00:33] [02mediawiki] 07Reception123 opened pull request 03#13957: Revert "Bump extensions/Translate from `eea9f68` to `7e4d25d`" - 13https://github.com/miraheze/mediawiki/pull/13957 [13:00:34] [02mediawiki] 07Reception123 closed pull request 03#13957: Revert "Bump extensions/Translate from `eea9f68` to `7e4d25d`" - 13https://github.com/miraheze/mediawiki/pull/13957 [13:00:35] [02miraheze/mediawiki] 07Reception123 deleted branch 03revert-13948-dependabot/submodules/REL1_39/extensions/Translate-7e4d25d [13:00:36] [02miraheze/mediawiki] 07Reception123 pushed 031 commit to 03REL1_39 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/59dfaf1c1537...94120049c42a [13:00:38] [02miraheze/mediawiki] 07Reception123 039412004 - Revert "Bump extensions/Translate from `eea9f68` to `7e4d25d` (#13948)" (#13957) [13:00:41] [02mediawiki] 07Reception123 deleted branch 03revert-13948-dependabot/submodules/REL1_39/extensions/Translate-7e4d25d - 13https://github.com/miraheze/mediawiki [13:01:02] !log [reception@mwtask141] starting deploy of {'world': True} to all [13:01:07] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [13:04:42] PROBLEM - wiki.wisrail.de - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query wisrail.de. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [13:05:35] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 0.83, 3.59, 3.34 [13:06:24] !log [reception@mwtask141] finished deploy of {'world': True} to all - SUCCESS in 321s [13:06:29] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [13:07:34] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 2.02, 2.98, 3.14 [13:11:19] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.30, 10.42, 8.77 [13:13:19] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.44, 9.08, 8.47 [13:17:37] [02mediawiki] 07redbluegreenhat commented on pull request 03#13957: Revert "Bump extensions/Translate from `eea9f68` to `7e4d25d`" - 13https://github.com/miraheze/mediawiki/pull/13957#issuecomment-1484094296 [13:29:26] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 4.23, 3.84, 2.84 [13:31:25] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.76, 3.04, 2.66 [13:33:57] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.61, 9.72, 9.04 [13:34:24] RECOVERY - wiki.wisrail.de - reverse DNS on sslhost is OK: SSL OK - wiki.wisrail.de reverse DNS resolves to cp22.miraheze.org - CNAME OK [13:35:28] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.73, 10.92, 9.14 [13:35:51] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 9.92, 9.85, 9.17 [13:37:28] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.00, 10.27, 9.12 [13:39:28] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 9.16, 9.91, 9.13 [13:59:48] PROBLEM - db142 Current Load on db142 is CRITICAL: CRITICAL - load average: 7.30, 8.11, 4.99 [14:05:30] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 1.49, 5.97, 5.36 [14:21:43] PROBLEM - wiki.albrusmusic.ru - reverse DNS on sslhost is WARNING: Timeout: The DNS operation timed out after 5.404332876205444 seconds [14:29:02] PROBLEM - db142 Current Load on db142 is CRITICAL: CRITICAL - load average: 8.83, 4.67, 3.77 [14:33:00] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 2.36, 4.97, 4.24 [14:41:19] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.10, 10.42, 8.98 [14:43:19] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.91, 10.00, 9.01 [14:44:46] PROBLEM - cp33 APT on cp33 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [14:46:49] RECOVERY - cp33 APT on cp33 is OK: APT OK: 1 packages available for upgrade (0 critical updates). [14:49:50] !log mail121: install p7zip [14:49:54] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:51:40] RECOVERY - wiki.albrusmusic.ru - reverse DNS on sslhost is OK: SSL OK - wiki.albrusmusic.ru reverse DNS resolves to cp22.miraheze.org - CNAME OK [14:51:46] !log mail121: install p7zip-full [14:51:50] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:14:22] [02puppet] 07Reception123 created branch 03Reception123-patch-2 - 13https://github.com/miraheze/puppet [15:14:23] [02miraheze/puppet] 07Reception123 pushed 031 commit to 03Reception123-patch-2 [+0/-0/±1] 13https://github.com/miraheze/puppet/commit/43eb6467de9b [15:14:24] [02miraheze/puppet] 07Reception123 0343eb646 - add alex (orangestar) to mw-admins [15:14:27] [02puppet] 07Reception123 opened pull request 03#3171: add alex (orangestar) to mw-admins - 13https://github.com/miraheze/puppet/pull/3171 [15:15:28] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.26, 9.89, 8.37 [15:17:28] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.47, 10.01, 8.59 [15:18:02] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.64, 11.18, 9.67 [15:18:52] PROBLEM - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - uk.religiononfire.mar.in.ua All nameservers failed to answer the query. [15:21:28] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.97, 9.71, 8.86 [15:21:51] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.80, 9.77, 9.47 [15:31:35] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 3.44, 4.54, 3.02 [15:33:34] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 2.50, 3.62, 2.85 [15:35:33] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.79, 2.96, 2.70 [15:46:35] PROBLEM - wiki.nj.cn.eu.org - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query wiki.nj.cn.eu.org. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [15:47:45] PROBLEM - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query uk.religiononfire.mar.in.ua. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [15:50:51] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.68, 2.85, 2.26 [15:52:48] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.31, 2.34, 2.15 [16:16:21] RECOVERY - wiki.nj.cn.eu.org - reverse DNS on sslhost is OK: SSL OK - wiki.nj.cn.eu.org reverse DNS resolves to cp23.miraheze.org - CNAME OK [16:23:03] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.57, 3.44, 2.39 [16:25:01] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.20, 3.03, 2.37 [16:29:10] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 3.27, 3.56, 2.42 [16:29:19] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.75, 9.92, 8.29 [16:31:09] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.32, 2.75, 2.26 [16:31:19] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.21, 9.10, 8.19 [16:43:19] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.59, 10.94, 9.51 [16:47:19] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.14, 11.11, 9.87 [16:49:19] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.88, 11.20, 10.06 [16:49:56] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.34, 11.17, 9.75 [16:51:19] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.16, 11.77, 10.42 [16:53:19] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.63, 11.57, 10.51 [16:53:52] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.56, 9.98, 9.67 [16:55:19] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.18, 11.83, 10.74 [16:55:44] PROBLEM - matomo131 Current Load on matomo131 is WARNING: WARNING - load average: 3.47, 3.10, 2.75 [16:57:43] RECOVERY - matomo131 Current Load on matomo131 is OK: OK - load average: 2.69, 2.97, 2.75 [16:57:44] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.60, 10.79, 10.08 [16:59:19] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.06, 11.75, 11.03 [16:59:42] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 6.72, 9.33, 9.63 [17:07:19] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.55, 11.22, 10.80 [17:07:30] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.24, 10.81, 10.03 [17:11:28] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.14, 11.73, 10.66 [17:15:28] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.11, 11.25, 10.65 [17:16:53] RECOVERY - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - uk.religiononfire.mar.in.ua reverse DNS resolves to cp22.miraheze.org - CNAME OK [17:17:28] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.52, 10.83, 10.54 [17:19:28] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.71, 11.65, 10.88 [17:23:19] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.36, 11.39, 11.58 [17:23:28] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.24, 10.39, 10.59 [17:27:19] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 14.69, 11.55, 11.48 [17:29:28] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.22, 10.90, 10.67 [17:31:19] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.81, 11.63, 11.58 [17:31:40] PROBLEM - mail121 Current Load on mail121 is CRITICAL: CRITICAL - load average: 2.35, 1.41, 0.67 [17:33:19] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.52, 12.41, 11.90 [17:35:19] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.95, 11.86, 11.76 [17:36:17] PROBLEM - matomo131 Current Load on matomo131 is WARNING: WARNING - load average: 3.48, 3.20, 2.85 [17:36:27] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.61, 3.51, 2.99 [17:37:28] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.57, 11.78, 11.37 [17:37:41] PROBLEM - mail121 Current Load on mail121 is WARNING: WARNING - load average: 1.22, 1.83, 1.16 [17:38:16] RECOVERY - matomo131 Current Load on matomo131 is OK: OK - load average: 2.87, 3.15, 2.88 [17:39:41] RECOVERY - mail121 Current Load on mail121 is OK: OK - load average: 0.33, 1.29, 1.04 [17:41:19] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 17.06, 13.73, 12.45 [17:41:28] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.08, 11.67, 11.41 [17:42:27] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.90, 2.90, 2.96 [17:43:28] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.46, 10.86, 11.12 [17:48:54] PROBLEM - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - uk.religiononfire.mar.in.ua All nameservers failed to answer the query. [17:49:28] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.65, 11.80, 11.31 [17:51:19] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.00, 11.64, 11.93 [17:51:20] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.84, 3.19, 3.04 [17:51:28] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.26, 10.89, 11.04 [17:55:13] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.08, 2.76, 2.92 [17:57:19] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.02, 11.34, 11.63 [17:59:19] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.42, 10.66, 11.34 [17:59:30] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 4.58, 4.04, 2.52 [18:01:29] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.56, 3.18, 2.39 [18:03:28] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.61, 12.07, 11.41 [18:04:59] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 6.07, 3.44, 2.91 [18:08:52] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.31, 3.23, 2.97 [18:09:28] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.20, 11.27, 11.41 [18:11:19] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 14.30, 11.25, 11.09 [18:13:28] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.03, 10.78, 11.15 [18:15:28] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.11, 11.16, 11.26 [18:17:19] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.83, 11.88, 11.56 [18:17:46] RECOVERY - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - uk.religiononfire.mar.in.ua reverse DNS resolves to cp22.miraheze.org - CNAME OK [18:25:28] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.64, 11.78, 11.31 [18:27:19] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 14.39, 12.45, 11.81 [18:29:28] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.97, 11.44, 11.31 [18:35:19] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.36, 11.26, 11.76 [18:35:28] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.59, 11.82, 11.42 [18:37:19] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.83, 12.70, 12.26 [18:39:28] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.26, 11.26, 11.31 [18:43:19] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 7.91, 10.89, 11.68 [18:47:28] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.84, 10.79, 10.88 [18:49:28] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.93, 11.45, 11.14 [18:55:28] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.90, 9.16, 10.15 [18:59:03] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 5.52, 3.06, 1.91 [19:03:02] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 2.84, 3.53, 2.40 [19:05:00] PROBLEM - db142 Current Load on db142 is WARNING: WARNING - load average: 7.13, 4.92, 2.94 [19:05:01] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.68, 2.83, 2.27 [19:05:15] PROBLEM - es141 Current Load on es141 is CRITICAL: CRITICAL - load average: 4.41, 2.97, 1.66 [19:05:19] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.94, 9.39, 10.18 [19:07:00] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 2.84, 4.36, 3.00 [19:07:15] RECOVERY - es141 Current Load on es141 is OK: OK - load average: 2.51, 2.76, 1.74 [19:07:33] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.16, 3.75, 2.89 [19:09:29] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.07, 3.43, 2.88 [19:11:19] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 15.39, 12.03, 10.94 [19:11:26] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.37, 2.70, 2.68 [19:13:19] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.11, 10.52, 10.53 [19:17:19] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 9.47, 9.80, 10.20 [19:21:19] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 16.82, 12.80, 11.26 [19:23:08] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.76, 4.02, 3.17 [19:26:06] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.67, 11.42, 10.09 [19:28:58] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.39, 3.63, 3.30 [19:30:49] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 2.92, 3.99, 2.89 [19:30:55] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.35, 4.15, 3.51 [19:32:48] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 0.94, 2.84, 2.59 [19:32:51] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.14, 3.75, 3.44 [19:33:56] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.89, 11.63, 10.91 [19:34:48] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.04, 3.25, 3.30 [19:35:54] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.59, 12.74, 11.41 [19:37:52] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.91, 11.42, 11.07 [19:39:49] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.34, 12.10, 11.36 [19:41:47] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.52, 11.25, 11.14 [19:47:40] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.06, 10.54, 10.73 [19:49:19] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.14, 11.22, 11.98 [19:51:35] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.34, 10.14, 10.56 [19:55:30] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 9.10, 9.43, 10.17 [19:57:19] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.27, 10.83, 11.31 [19:59:19] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.57, 10.10, 10.97 [20:07:19] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.98, 8.82, 10.01 [20:11:19] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.52, 10.54, 10.35 [20:13:19] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.43, 10.44, 10.35 [20:19:19] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.76, 9.49, 9.99 [20:21:44] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.41, 3.51, 3.13 [20:23:41] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.95, 3.71, 3.25 [20:25:38] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.22, 3.78, 3.32 [20:27:34] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.07, 3.60, 3.31 [20:29:31] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.58, 3.27, 3.22 [20:33:27] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.22, 3.83, 3.45 [20:34:54] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.71, 10.67, 9.55 [20:40:47] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.62, 9.86, 9.60 [20:41:13] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.89, 3.25, 3.44 [20:43:10] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 3.33, 3.04, 3.32 [20:50:10] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.76, 10.00, 9.80 [20:53:59] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.41, 9.45, 9.64 [21:06:33] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 6.94, 4.77, 3.48 [21:16:27] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.18, 3.92, 3.71 [21:24:27] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.24, 3.95, 3.69 [21:26:27] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.82, 3.43, 3.53 [21:28:27] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.67, 4.18, 3.77 [21:30:27] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.47, 3.51, 3.58 [21:32:27] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.67, 2.84, 3.32 [21:35:37] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.46, 9.50, 8.20 [21:37:34] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 9.44, 9.20, 8.23 [21:47:23] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.94, 4.18, 3.53 [21:49:20] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.12, 3.44, 3.34 [21:51:16] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.82, 2.95, 3.18 [21:55:23] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 10.02, 8.83, 4.90 [22:03:16] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.66, 3.62, 3.94 [22:05:56] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.64, 3.77, 3.28 [22:06:10] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.71, 10.35, 9.40 [22:07:13] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.27, 2.29, 3.32 [22:07:52] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.01, 3.78, 3.37 [22:08:04] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 9.24, 10.18, 9.47 [22:09:49] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.02, 3.19, 3.20 [22:19:37] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.96, 4.27, 3.63 [22:19:41] PROBLEM - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query uk.religiononfire.mar.in.ua. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [22:21:34] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.63, 3.76, 3.53 [22:22:47] PROBLEM - cloud11 Puppet on cloud11 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[ulogd2] [22:23:31] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.28, 3.15, 3.33 [22:24:58] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.45, 3.31, 2.97 [22:26:56] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.28, 2.95, 2.89 [22:31:23] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.84, 4.15, 3.68 [22:35:16] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.25, 3.37, 3.48 [22:37:13] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.01, 3.70, 3.57 [22:41:06] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.53, 3.78, 3.70 [22:46:56] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 7.91, 4.23, 3.76 [22:48:53]