[00:02:04] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 6.16, 3.70, 3.20 [00:09:07] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.05, 4.52, 3.45 [00:11:01] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.39, 3.68, 3.27 [00:12:55] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.27, 3.07, 3.08 [00:13:58] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.44, 3.22, 3.67 [00:15:57] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 6.15, 3.76, 3.77 [00:17:55] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.45, 3.17, 3.56 [00:19:54] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.39, 2.86, 3.39 [00:25:24] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 8.49, 7.08, 4.67 [00:25:35] [Grafana] !sre RESOLVED: High Job Queue Backlog https://grafana.miraheze.org/d/GtxbP1Xnk?orgId=1 [00:33:01] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.78, 3.23, 3.78 [00:36:50] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 8.24, 4.65, 4.15 [00:39:41] dasd [00:39:42] asd [00:39:43] asd [00:39:43] d [00:39:44] d [00:39:44] d [00:39:45] d [00:39:46] dd [00:39:47] d [00:39:48] https://en.wikipedia.org/wiki/File:Flaccid_and_erect_human_penis.jpg [00:39:49] [url] File:Flaccid and erect human penis.jpg - Wikipedia | en.wikipedia.org [00:39:49] Sugar [00:42:33] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.80, 3.44, 3.81 [00:46:22] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.47, 2.29, 3.25 [01:00:20] RECOVERY - removededm.ml - reverse DNS on sslhost is OK: SSL OK - removededm.ml reverse DNS resolves to cp23.miraheze.org - NS RECORDS OK [01:03:29] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.63, 3.20, 2.81 [01:05:29] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.21, 2.84, 2.73 [01:06:07] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.29, 3.87, 3.38 [01:08:07] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.97, 3.20, 3.20 [01:23:22] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.89, 3.78, 3.33 [01:27:20] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.14, 3.31, 3.27 [01:29:17] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.01, 5.10, 4.02 [01:29:45] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 4.77, 2.95, 1.65 [01:31:17] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 3.08, 4.12, 3.67 [01:32:14] PROBLEM - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - uk.religiononfire.mar.in.ua All nameservers failed to answer the query. [01:32:26] PROBLEM - cp23 APT on cp23 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [01:33:45] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 2.02, 3.44, 2.24 [01:34:23] RECOVERY - cp23 APT on cp23 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [01:35:00] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.16, 3.41, 3.56 [01:35:15] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.98, 3.99, 3.69 [01:35:45] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 0.73, 2.45, 2.02 [01:37:14] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.37, 4.10, 3.74 [01:41:12] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.75, 3.59, 3.64 [01:42:37] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.26, 2.82, 3.27 [01:43:11] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.25, 3.65, 3.64 [01:45:10] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.21, 3.10, 3.44 [01:45:15] [discord] @Moderators [01:46:48] [discord] Timed out the bot again until someone has a chance to ivnestigate [01:47:08] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.99, 2.80, 3.29 [01:48:04] [discord] That was an hour ago [01:49:24] [discord] Yep, just noted that, reverting. [01:51:28] [discord] Also a great indicator to the insane amount of lag I'm getting on mobile Discord notifications... [01:52:40] PROBLEM - cp23 NTP time on cp23 is WARNING: NTP WARNING: Offset 0.1300334334 secs [01:56:07] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 7.84, 4.21, 3.28 [01:57:29] [02mediawiki] 07dependabot[bot] opened pull request 03#13615: Bump skins/Flatbox from `bd68519` to `79745aa` - 13https://github.com/miraheze/mediawiki/pull/13615 [01:57:29] [url] Page not found · GitHub · GitHub | github.com [01:57:30] [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_39/skins/Flatbox-79745aa [+0/-0/±1] 13https://github.com/miraheze/mediawiki/commit/357e66d01f19 [01:57:31] [02miraheze/mediawiki] 07dependabot[bot] 03357e66d - Bump skins/Flatbox from `bd68519` to `79745aa` [01:57:34] [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_39/skins/Flatbox-79745aa - 13https://github.com/miraheze/mediawiki [01:57:34] [url] Page not found · GitHub · GitHub | github.com [01:57:36] [02mediawiki] 07dependabot[bot] opened pull request 03#13616: Bump extensions/StandardDialogs from `8fb04bc` to `58b734f` - 13https://github.com/miraheze/mediawiki/pull/13616 [01:57:36] [url] Page not found · GitHub · GitHub | github.com [01:57:39] [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_39/extensions/StandardDialogs-58b734f [+0/-0/±1] 13https://github.com/miraheze/mediawiki/commit/856171d228bd [01:57:42] [02miraheze/mediawiki] 07dependabot[bot] 03856171d - Bump extensions/StandardDialogs from `8fb04bc` to `58b734f` [01:57:43] [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_39/extensions/StandardDialogs-58b734f - 13https://github.com/miraheze/mediawiki [01:57:43] [url] Page not found · GitHub · GitHub | github.com [01:57:45] [02mediawiki] 07dependabot[bot] opened pull request 03#13617: Bump extensions/SemanticMediaWiki from `8e9a9bb` to `f4bb970` - 13https://github.com/miraheze/mediawiki/pull/13617 [01:57:46] [url] Page not found · GitHub · GitHub | github.com [01:57:48] [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_39/extensions/SemanticMediaWiki-f4bb970 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/commit/0d4fe5aa6684 [01:57:49] [02miraheze/mediawiki] 07dependabot[bot] 030d4fe5a - Bump extensions/SemanticMediaWiki from `8e9a9bb` to `f4bb970` [01:57:51] [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_39/extensions/SemanticMediaWiki-f4bb970 - 13https://github.com/miraheze/mediawiki [01:57:51] ... [01:57:53] [02mediawiki] 07github-actions[bot] labeled pull request 03#13615: Bump skins/Flatbox from `bd68519` to `79745aa` - 13https://github.com/miraheze/mediawiki/pull/13615 [01:57:53] ... [01:57:56] [02mediawiki] 07github-actions[bot] labeled pull request 03#13616: Bump extensions/StandardDialogs from `8fb04bc` to `58b734f` - 13https://github.com/miraheze/mediawiki/pull/13616 [01:57:57] ... [01:58:00] [02mediawiki] 07dependabot[bot] opened pull request 03#13618: Bump skins/CologneBlue from `595b448` to `56c49e5` - 13https://github.com/miraheze/mediawiki/pull/13618 [01:58:02] [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_39/skins/CologneBlue-56c49e5 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/commit/9fc73ffdd671 [01:58:05] [02miraheze/mediawiki] 07dependabot[bot] 039fc73ff - Bump skins/CologneBlue from `595b448` to `56c49e5` [01:58:06] [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_39/skins/CologneBlue-56c49e5 - 13https://github.com/miraheze/mediawiki [01:58:07] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.33, 3.81, 3.25 [01:58:08] [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_39/extensions/UniversalLanguageSelector-f2c4ca4 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/commit/5898b4aa346c [01:58:11] [02miraheze/mediawiki] 07dependabot[bot] 035898b4a - Bump extensions/UniversalLanguageSelector from `62c3873` to `f2c4ca4` [01:58:12] [02mediawiki] 07dependabot[bot] opened pull request 03#13619: Bump extensions/UniversalLanguageSelector from `62c3873` to `f2c4ca4` - 13https://github.com/miraheze/mediawiki/pull/13619 [01:58:14] [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_39/extensions/UniversalLanguageSelector-f2c4ca4 - 13https://github.com/miraheze/mediawiki [01:58:17] [02mediawiki] 07github-actions[bot] labeled pull request 03#13617: Bump extensions/SemanticMediaWiki from `8e9a9bb` to `f4bb970` - 13https://github.com/miraheze/mediawiki/pull/13617 [01:58:18] [02mediawiki] 07github-actions[bot] labeled pull request 03#13618: Bump skins/CologneBlue from `595b448` to `56c49e5` - 13https://github.com/miraheze/mediawiki/pull/13618 [01:58:24] [02mediawiki] 07dependabot[bot] opened pull request 03#13620: Bump skins/Femiwiki from `b5522e7` to `d09f2bf` - 13https://github.com/miraheze/mediawiki/pull/13620 [01:58:26] [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_39/skins/Femiwiki-d09f2bf [+0/-0/±1] 13https://github.com/miraheze/mediawiki/commit/a6972f616c26 [01:58:28] [02miraheze/mediawiki] 07dependabot[bot] 03a6972f6 - Bump skins/Femiwiki from `b5522e7` to `d09f2bf` [01:58:31] [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_39/skins/Femiwiki-d09f2bf - 13https://github.com/miraheze/mediawiki [01:58:34] [02mediawiki] 07github-actions[bot] labeled pull request 03#13619: Bump extensions/UniversalLanguageSelector from `62c3873` to `f2c4ca4` - 13https://github.com/miraheze/mediawiki/pull/13619 [01:58:36] [02mediawiki] 07github-actions[bot] labeled pull request 03#13619: Bump extensions/UniversalLanguageSelector from `62c3873` to `f2c4ca4` - 13https://github.com/miraheze/mediawiki/pull/13619 [01:58:39] [02mediawiki] 07github-actions[bot] labeled pull request 03#13619: Bump extensions/UniversalLanguageSelector from `62c3873` to `f2c4ca4` - 13https://github.com/miraheze/mediawiki/pull/13619 [01:58:41] [02mediawiki] 07dependabot[bot] opened pull request 03#13621: Bump extensions/Translate from `d22e1ce` to `1317dd1` - 13https://github.com/miraheze/mediawiki/pull/13621 [01:58:44] [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_39/extensions/Translate-1317dd1 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/commit/d1f20d59d52f [01:58:45] [02miraheze/mediawiki] 07dependabot[bot] 03d1f20d5 - Bump extensions/Translate from `d22e1ce` to `1317dd1` [01:58:46] [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_39/extensions/Translate-1317dd1 - 13https://github.com/miraheze/mediawiki [01:58:49] [02mediawiki] 07dependabot[bot] opened pull request 03#13622: Bump extensions/Moderation from `b0bcefc` to `d8ff8e8` - 13https://github.com/miraheze/mediawiki/pull/13622 [01:58:52] [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_39/extensions/Moderation-d8ff8e8 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/commit/50d589a41ba1 [01:58:53] [02miraheze/mediawiki] 07dependabot[bot] 0350d589a - Bump extensions/Moderation from `b0bcefc` to `d8ff8e8` [01:58:54] [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_39/extensions/Moderation-d8ff8e8 - 13https://github.com/miraheze/mediawiki [01:58:56] [02mediawiki] 07dependabot[bot] opened pull request 03#13623: Bump extensions/Cargo from `961e22e` to `f2df4cd` - 13https://github.com/miraheze/mediawiki/pull/13623 [01:58:57] [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_39/extensions/Cargo-f2df4cd [+0/-0/±1] 13https://github.com/miraheze/mediawiki/commit/264ad2cd4c1e [01:58:59] [02miraheze/mediawiki] 07dependabot[bot] 03264ad2c - Bump extensions/Cargo from `961e22e` to `f2df4cd` [01:59:01] [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_39/extensions/Cargo-f2df4cd - 13https://github.com/miraheze/mediawiki [01:59:04] [02mediawiki] 07github-actions[bot] labeled pull request 03#13620: Bump skins/Femiwiki from `b5522e7` to `d09f2bf` - 13https://github.com/miraheze/mediawiki/pull/13620 [01:59:07] [02mediawiki] 07github-actions[bot] labeled pull request 03#13620: Bump skins/Femiwiki from `b5522e7` to `d09f2bf` - 13https://github.com/miraheze/mediawiki/pull/13620 [01:59:10] [02mediawiki] 07github-actions[bot] labeled pull request 03#13622: Bump extensions/Moderation from `b0bcefc` to `d8ff8e8` - 13https://github.com/miraheze/mediawiki/pull/13622 [01:59:12] [02mediawiki] 07github-actions[bot] labeled pull request 03#13621: Bump extensions/Translate from `d22e1ce` to `1317dd1` - 13https://github.com/miraheze/mediawiki/pull/13621 [01:59:14] [02mediawiki] 07github-actions[bot] labeled pull request 03#13623: Bump extensions/Cargo from `961e22e` to `f2df4cd` - 13https://github.com/miraheze/mediawiki/pull/13623 [01:59:17] [02mediawiki] 07github-actions[bot] labeled pull request 03#13623: Bump extensions/Cargo from `961e22e` to `f2df4cd` - 13https://github.com/miraheze/mediawiki/pull/13623 [01:59:20] [02mediawiki] 07github-actions[bot] labeled pull request 03#13623: Bump extensions/Cargo from `961e22e` to `f2df4cd` - 13https://github.com/miraheze/mediawiki/pull/13623 [02:01:55] RECOVERY - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - uk.religiononfire.mar.in.ua reverse DNS resolves to cp23.miraheze.org - CNAME OK [02:02:07] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 3.26, 3.37, 3.18 [02:10:07] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 3.56, 4.07, 3.54 [02:12:40] RECOVERY - cp23 NTP time on cp23 is OK: NTP OK: Offset 0.09052312374 secs [02:14:07] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.00, 3.76, 3.56 [02:16:07] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.39, 3.22, 3.38 [02:24:07] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 10.81, 5.76, 4.16 [02:32:07] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.04, 3.82, 3.97 [02:34:07] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.52, 3.88, 3.95 [02:36:07] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.72, 3.04, 3.64 [02:37:38] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 3.81, 4.22, 3.45 [02:39:37] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.37, 3.56, 3.31 [02:40:07] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.85, 2.47, 3.26 [02:41:36] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.59, 2.89, 3.09 [02:49:18] PROBLEM - mem141 NTP time on mem141 is WARNING: NTP WARNING: Offset 0.1043380499 secs [02:56:33] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.10, 3.64, 3.32 [02:58:28] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.74, 3.72, 3.39 [02:59:38] RECOVERY - mem141 NTP time on mem141 is OK: NTP OK: Offset 0.09639009833 secs [03:00:22] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.75, 2.93, 3.13 [03:04:11] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 3.95, 4.23, 3.66 [03:08:07] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.46, 3.62, 3.52 [03:10:07] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.96, 3.15, 3.35 [03:24:07] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.39, 3.80, 3.39 [03:26:07] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.23, 3.29, 3.26 [03:32:53] PROBLEM - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query uk.religiononfire.mar.in.ua. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [03:36:08] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.13, 3.09, 2.72 [03:38:07] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.76, 2.69, 2.63 [03:54:22] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.23, 4.18, 3.47 [03:58:11] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.06, 3.74, 3.45 [04:00:07] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.87, 3.01, 3.21 [04:14:44] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.66, 3.96, 3.45 [04:16:39] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.06, 3.23, 3.24 [04:25:14] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.61, 3.75, 3.45 [04:27:08] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.68, 2.98, 3.20 [04:59:49] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 10.06, 6.11, 2.79 [05:01:54] PROBLEM - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - uk.religiononfire.mar.in.ua All nameservers failed to answer the query. [05:04:40] PROBLEM - cp23 NTP time on cp23 is WARNING: NTP WARNING: Offset 0.1553800106 secs [05:05:45] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 0.88, 3.74, 2.98 [05:07:45] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 0.55, 2.66, 2.67 [05:25:09] PROBLEM - removededm.ml - LetsEncrypt on sslhost is CRITICAL: connect to address removededm.ml and port 443: Network is unreachableHTTP CRITICAL - Unable to open TCP socket [05:31:34] RECOVERY - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - uk.religiononfire.mar.in.ua reverse DNS resolves to cp23.miraheze.org - CNAME OK [05:36:40] RECOVERY - cp23 NTP time on cp23 is OK: NTP OK: Offset 0.08666595817 secs [06:22:37] RECOVERY - removededm.ml - LetsEncrypt on sslhost is OK: OK - Certificate 'removededm.ml' will expire on Fri 12 May 2023 20:26:52 GMT +0000. [06:27:48] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 7.67, 3.14, 1.63 [06:29:45] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 3.98, 3.97, 2.18 [06:31:45] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.66, 2.97, 2.02 [06:41:10] PROBLEM - puppet141 Puppet on puppet141 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Package[postgresql-contrib-13] [07:09:04] RECOVERY - puppet141 Puppet on puppet141 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [07:22:07] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.19, 2.59, 1.97 [07:28:07] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.00, 3.12, 2.55 [07:47:17] PROBLEM - cp22 NTP time on cp22 is WARNING: NTP WARNING: Offset 0.1063645184 secs [08:13:29] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.42, 3.43, 2.66 [08:15:29] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.72, 2.98, 2.58 [08:16:47] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 18.61, 11.91, 8.50 [08:17:17] RECOVERY - cp22 NTP time on cp22 is OK: NTP OK: Offset 0.08072128892 secs [08:17:47] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 17.96, 13.10, 9.24 [08:18:33] PROBLEM - mw122 MediaWiki Rendering on mw122 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 5903 bytes in 0.011 second response time [08:20:32] RECOVERY - mw122 MediaWiki Rendering on mw122 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.297 second response time [08:21:12] PROBLEM - en.religiononfire.mar.in.ua - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query en.religiononfire.mar.in.ua. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [08:24:07] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.53, 2.40, 1.79 [08:26:07] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.42, 2.06, 1.75 [08:28:47] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.91, 11.09, 10.55 [08:29:48] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 6.90, 10.68, 10.57 [08:30:47] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.15, 9.72, 10.11 [08:31:48] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 6.13, 9.29, 10.08 [08:50:59] PROBLEM - en.religiononfire.mar.in.ua - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - en.religiononfire.mar.in.ua All nameservers failed to answer the query. [08:56:07] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 6.45, 4.12, 2.34 [08:58:07] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.20, 3.87, 2.48 [08:58:40] PROBLEM - cp23 NTP time on cp23 is WARNING: NTP WARNING: Offset 0.1003087163 secs [08:59:48] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 5.64, 4.47, 2.44 [09:01:45] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 1.79, 3.46, 2.30 [09:02:07] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.09, 2.94, 2.47 [09:02:40] RECOVERY - cp23 NTP time on cp23 is OK: NTP OK: Offset 0.09999480844 secs [09:03:45] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 0.94, 2.61, 2.13 [09:07:29] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.98, 3.71, 2.33 [09:09:29] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.80, 3.25, 2.32 [09:20:46] RECOVERY - en.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - en.religiononfire.mar.in.ua reverse DNS resolves to cp23.miraheze.org - CNAME OK [09:46:21] PROBLEM - cp33 APT on cp33 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [09:51:19] RECOVERY - cp33 APT on cp33 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [09:54:07] PROBLEM - cloud13 Puppet on cloud13 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[ulogd2] [09:56:07] PROBLEM - cp33 PowerDNS Recursor on cp33 is CRITICAL: CRITICAL - Plugin timed out while executing system call [09:56:45] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 16.81, 11.37, 5.52 [09:58:03] RECOVERY - cp33 PowerDNS Recursor on cp33 is OK: DNS OK: 0.656 seconds response time. miraheze.org returns 108.175.15.182,2607:f1c0:1800:26f::1,2607:f1c0:1800:8100::1,74.208.203.152 [09:58:12] PROBLEM - cp33 APT on cp33 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [09:58:17] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 3.93, 2.43, 1.68 [10:00:13] RECOVERY - cp33 APT on cp33 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [10:00:13] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.15, 1.87, 1.56 [10:04:23] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 0.74, 3.32, 3.87 [10:08:11] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 0.50, 1.82, 3.13 [10:20:06] RECOVERY - cloud13 Puppet on cloud13 is OK: OK: Puppet is currently enabled, last run 39 seconds ago with 0 failures [10:24:07] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 6.12, 4.85, 3.29 [10:24:37] PROBLEM - removededm.ml - LetsEncrypt on sslhost is CRITICAL: connect to address removededm.ml and port 443: Network is unreachableHTTP CRITICAL - Unable to open TCP socket [10:28:07] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.21, 3.40, 3.04 [10:34:16] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 15.59, 6.95, 3.52 [10:36:12] PROBLEM - cp32 APT on cp32 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [10:41:13] RECOVERY - cp32 APT on cp32 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [10:42:12] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.44, 3.39, 3.26 [10:44:40] PROBLEM - cp23 NTP time on cp23 is WARNING: NTP WARNING: Offset 0.102057904 secs [10:52:40] RECOVERY - cp23 NTP time on cp23 is OK: NTP OK: Offset 0.09981507063 secs [11:22:37] RECOVERY - removededm.ml - LetsEncrypt on sslhost is OK: OK - Certificate 'removededm.ml' will expire on Fri 12 May 2023 20:26:52 GMT +0000. [11:56:07] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.26, 5.19, 2.85 [11:57:14] PROBLEM - cp33 APT on cp33 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [11:59:13] RECOVERY - cp33 APT on cp33 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [12:00:07] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.75, 3.87, 2.91 [12:02:07] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 0.64, 2.78, 2.63 [12:06:40] PROBLEM - cp23 NTP time on cp23 is WARNING: NTP WARNING: Offset -0.1086066365 secs [12:08:02] PROBLEM - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - uk.religiononfire.mar.in.ua All nameservers failed to answer the query. [12:08:40] RECOVERY - cp23 NTP time on cp23 is OK: NTP OK: Offset -0.09537932277 secs [12:11:13] [02miraheze/CreateWiki] 07translatewiki pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/f4148e32e477...94fadba0397b [12:11:14] [url] Comparing f4148e32e477...94fadba0397b · miraheze/CreateWiki · GitHub | github.com [12:11:15] [02miraheze/CreateWiki] 07translatewiki 0394fadba - Localisation updates from https://translatewiki.net. [12:11:15] [url] Main page - translatewiki.net | translatewiki.net [12:11:17] [02miraheze/MirahezeMagic] 07translatewiki pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/MirahezeMagic/compare/e350dd03df16...6b205a7f1c07 [12:11:18] [url] Comparing e350dd03df16...6b205a7f1c07 · miraheze/MirahezeMagic · GitHub | github.com [12:11:20] [02miraheze/MirahezeMagic] 07translatewiki 036b205a7 - Localisation updates from https://translatewiki.net. [12:11:21] [url] Main page - translatewiki.net | translatewiki.net [12:20:48] miraheze/CreateWiki - translatewiki the build passed. [12:21:23] miraheze/MirahezeMagic - translatewiki the build passed. [12:26:07] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.60, 3.35, 2.40 [12:28:07] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.58, 2.93, 2.35 [12:37:29] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.71, 2.86, 1.78 [12:39:29] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.62, 3.24, 2.06 [12:40:41] PROBLEM - cp23 NTP time on cp23 is WARNING: NTP WARNING: Offset 0.1628035903 secs [12:41:29] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.88, 2.59, 1.96 [12:44:40] RECOVERY - cp23 NTP time on cp23 is OK: NTP OK: Offset 0.05210286379 secs [12:54:47] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 7.65, 4.77, 2.99 [13:00:00] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 3.79, 3.52, 2.18 [13:00:30] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.95, 3.82, 3.16 [13:01:56] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.16, 2.63, 2.01 [13:02:24] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.30, 2.92, 2.90 [13:10:29] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.73, 3.54, 2.57 [13:12:28] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.94, 2.93, 2.46 [13:13:47] PROBLEM - mw122 NTP time on mw122 is WARNING: NTP WARNING: Offset 0.1086861491 secs [13:29:45] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 4.49, 2.93, 1.96 [13:32:26] PROBLEM - cp23 APT on cp23 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [13:33:45] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 2.66, 3.76, 2.60 [13:34:23] RECOVERY - cp23 APT on cp23 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [13:35:45] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 0.96, 2.76, 2.37 [13:36:31] RECOVERY - mw122 NTP time on mw122 is OK: NTP OK: Offset 0.09378215671 secs [13:54:07] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 13.50, 5.89, 3.15 [14:02:07] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 0.85, 3.23, 3.14 [14:06:44] RECOVERY - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - uk.religiononfire.mar.in.ua reverse DNS resolves to cp22.miraheze.org - CNAME OK [14:13:13] PROBLEM - cp32 APT on cp32 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [14:15:14] RECOVERY - cp32 APT on cp32 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [14:46:11] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.56, 3.15, 2.68 [14:48:07] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.08, 2.71, 2.57 [14:50:40] PROBLEM - cp23 NTP time on cp23 is WARNING: NTP WARNING: Offset 0.1311811209 secs [15:02:16] RECOVERY - cloud11 IPMI Sensors on cloud11 is OK: IPMI Status: OK [15:04:46] PROBLEM - removededm.ml - reverse DNS on sslhost is WARNING: SSL WARNING - rDNS OK but records conflict. {'NS': ['galileo.aternos.org.', 'columbus.aternos.org.'], 'CNAME': None} [15:06:17] PROBLEM - cloud11 IPMI Sensors on cloud11 is CRITICAL: IPMI Status: Critical [Cntlr 2 Bay 7 = Critical] [15:09:18] PROBLEM - cp33 APT on cp33 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [15:11:19] RECOVERY - cp33 APT on cp33 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [15:16:40] RECOVERY - cp23 NTP time on cp23 is OK: NTP OK: Offset 0.09525924921 secs [15:20:47] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.44, 10.63, 9.25 [15:22:47] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.10, 9.75, 9.10 [15:26:07] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.85, 3.79, 2.74 [15:28:07] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.76, 3.30, 2.69 [15:28:40] PROBLEM - cp23 NTP time on cp23 is WARNING: NTP WARNING: Offset 0.1610103548 secs [15:34:20] RECOVERY - removededm.ml - reverse DNS on sslhost is OK: SSL OK - removededm.ml reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [15:35:07] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.54, 4.01, 3.02 [15:36:47] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.38, 10.57, 9.79 [15:40:40] RECOVERY - cp23 NTP time on cp23 is OK: NTP OK: Offset 0.09688791633 secs [15:40:47] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 9.04, 10.00, 9.74 [15:41:04] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.38, 3.75, 3.28 [15:43:03] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.02, 3.07, 3.07 [15:56:34] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.63, 6.75, 4.43 [16:02:17] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.52, 3.64, 3.81 [16:04:47] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.76, 9.72, 8.95 [16:06:07] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.43, 2.26, 3.19 [16:06:47] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 9.41, 9.39, 8.92 [16:11:44] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.88, 3.47, 3.12 [16:13:43] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.35, 2.70, 2.87 [16:14:40] PROBLEM - cp23 NTP time on cp23 is WARNING: NTP WARNING: Offset -0.1177596748 secs [16:24:45] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 3.58, 4.16, 3.40 [16:24:47] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.34, 9.97, 8.93 [16:26:40] RECOVERY - cp23 NTP time on cp23 is OK: NTP OK: Offset -0.07184141874 secs [16:26:47] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.98, 9.97, 9.04 [16:28:33] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.82, 3.64, 3.41 [16:29:45] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 3.90, 3.28, 2.21 [16:30:28] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.08, 2.83, 3.15 [16:30:40] PROBLEM - cp23 NTP time on cp23 is WARNING: NTP WARNING: Offset 0.174200356 secs [16:30:47] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.46, 9.00, 8.88 [16:31:45] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.43, 2.60, 2.09 [16:35:31] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.14, 2.90, 2.36 [16:39:29] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.54, 3.72, 2.92 [16:41:29] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.54, 3.33, 2.87 [16:41:43] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.37, 9.52, 9.15 [16:42:40] RECOVERY - cp23 NTP time on cp23 is OK: NTP OK: Offset 0.03608727455 secs [16:43:03] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.56, 10.14, 9.18 [16:43:42] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.77, 9.21, 9.08 [16:45:03] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 9.26, 9.51, 9.04 [16:49:38] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.92, 10.60, 9.65 [16:51:37] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.12, 9.62, 9.40 [16:55:35] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.77, 11.56, 10.28 [16:58:57] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 14.03, 12.44, 10.67 [17:01:32] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.65, 11.75, 10.89 [17:02:55] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.50, 11.64, 10.78 [17:03:31] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.35, 11.88, 11.03 [17:08:53] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.26, 11.89, 11.06 [17:12:07] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.55, 4.43, 3.17 [17:16:07] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.43, 3.70, 3.18 [17:18:07] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.39, 3.16, 3.03 [17:21:56] PROBLEM - ns1 NTP time on ns1 is WARNING: NTP WARNING: Offset 0.1093807518 secs [17:22:48] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.28, 10.93, 11.31 [17:23:21] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 6.73, 10.67, 11.76 [17:26:07] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 6.26, 6.61, 4.56 [17:27:19] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.40, 10.81, 11.48 [17:28:46] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.16, 11.07, 11.15 [17:29:18] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.64, 10.90, 11.42 [17:29:45] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 6.70, 3.92, 2.42 [17:30:46] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.39, 10.71, 11.00 [17:32:07] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.73, 3.50, 3.82 [17:33:16] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 16.17, 12.08, 11.66 [17:35:45] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 0.95, 2.90, 2.58 [17:36:02] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 6.21, 3.49, 2.59 [17:38:07] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.33, 3.55, 3.65 [17:38:43] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.46, 11.00, 10.91 [17:39:59] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.02, 3.94, 3.05 [17:40:07] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.36, 2.73, 3.33 [17:42:41] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.24, 11.59, 11.20 [17:43:11] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.73, 10.87, 11.48 [17:43:57] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.36, 3.74, 3.13 [17:45:56] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.30, 3.06, 2.95 [17:49:08] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.15, 10.96, 11.20 [17:49:56] RECOVERY - ns1 NTP time on ns1 is OK: NTP OK: Offset 0.07887795568 secs [17:51:07] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.31, 10.82, 11.14 [17:53:06] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.51, 11.98, 11.54 [17:54:07] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 10.27, 5.19, 3.79 [17:55:05] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.33, 11.92, 11.59 [17:57:04] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 15.05, 13.04, 12.02 [17:58:36] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 14.85, 11.89, 11.11 [18:00:35] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.21, 11.22, 10.94 [18:01:02] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.46, 11.29, 11.55 [18:04:07] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.43, 3.51, 3.58 [18:06:07] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.68, 2.92, 3.36 [18:07:43] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.81, 3.77, 2.94 [18:08:33] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.14, 9.35, 10.17 [18:08:35] PROBLEM - swiftac111 NTP time on swiftac111 is WARNING: NTP WARNING: Offset -0.1022910178 secs [18:09:42] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.88, 3.51, 2.96 [18:10:37] RECOVERY - swiftac111 NTP time on swiftac111 is OK: NTP OK: Offset -0.09873911738 secs [18:11:41] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.76, 2.92, 2.81 [18:12:30] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.79, 10.39, 10.39 [18:14:30] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.22, 9.48, 10.05 [18:14:55] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 6.87, 8.63, 10.04 [18:15:38] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 3.14, 4.14, 3.44 [18:17:37] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.21, 3.48, 3.28 [18:19:36] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.58, 2.84, 3.07 [18:25:26] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.23, 3.52, 3.32 [18:27:20] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.73, 3.83, 3.45 [18:30:26] PROBLEM - cp23 APT on cp23 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [18:31:45] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 3.41, 3.63, 2.23 [18:32:23] RECOVERY - cp23 APT on cp23 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [18:33:45] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.44, 2.80, 2.10 [18:34:57] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.65, 3.42, 3.75 [18:36:47] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.84, 10.05, 9.45 [18:38:24] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.46, 3.17, 2.85 [18:40:22] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.90, 2.70, 2.72 [18:40:41] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.24, 4.24, 3.97 [18:41:19] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 15.31, 11.25, 9.72 [18:42:35] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.65, 3.68, 3.80 [18:44:29] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 9.17, 5.08, 4.25 [18:45:18] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.25, 11.64, 10.29 [18:46:24] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.47, 3.97, 3.94 [18:52:07] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.05, 3.77, 3.79 [18:52:47] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 15.09, 11.81, 10.63 [18:54:07] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.57, 3.56, 3.71 [18:54:36] PROBLEM - removededm.ml - LetsEncrypt on sslhost is CRITICAL: connect to address removededm.ml and port 443: Network is unreachableHTTP CRITICAL - Unable to open TCP socket [18:54:47] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.15, 11.53, 10.68 [18:57:14] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.46, 12.07, 11.09 [18:58:07] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.69, 2.74, 3.35 [18:58:47] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 16.23, 13.34, 11.55 [19:00:47] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.10, 11.59, 11.12 [19:01:12] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.72, 11.75, 11.25 [19:02:47] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.93, 12.16, 11.39 [19:06:06] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 8.74, 3.98, 2.85 [19:08:07] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.30, 3.41, 3.23 [19:08:47] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.04, 11.30, 11.38 [19:10:47] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.43, 11.92, 11.58 [19:11:09] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 15.03, 11.97, 11.19 [19:12:47] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.07, 11.17, 11.35 [19:13:08] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.92, 11.76, 11.20 [19:16:07] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.03, 3.49, 3.63 [19:18:02] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.40, 3.83, 3.81 [19:18:07] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.68, 2.90, 3.39 [19:18:47] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.69, 11.53, 11.39 [19:20:48] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.69, 10.90, 11.19 [19:22:00] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.54, 2.72, 3.36 [19:23:15] RECOVERY - removededm.ml - LetsEncrypt on sslhost is OK: OK - Certificate 'removededm.ml' will expire on Fri 12 May 2023 20:26:52 GMT +0000. [19:25:08] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 6.83, 8.77, 9.98 [19:26:47] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.22, 8.87, 10.18 [19:28:07] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.26, 4.14, 3.62 [19:32:07] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.67, 3.27, 3.44 [19:33:37] Uh oh, that sounds bad [19:34:07] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.72, 3.04, 3.33 [19:34:47] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 16.68, 12.16, 10.94 [19:35:04] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.13, 10.70, 10.30 [19:36:28] It isn't bad, it is normal, just icinga-miraheze was ignored before. It is fixed now so it is ignored from relay again [19:36:47] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.07, 10.98, 10.64 [19:37:03] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.83, 9.57, 9.93 [19:40:47] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.85, 9.32, 10.04 [19:49:57] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.00, 10.70, 10.02 [19:51:57] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 9.51, 10.20, 9.92 [19:57:40] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.62, 10.10, 9.49 [19:59:39] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.47, 10.74, 9.79 [19:59:53] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.45, 11.10, 10.33 [20:01:40] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.97, 11.01, 10.02 [20:01:52] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.95, 10.52, 10.20 [20:03:39] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.89, 11.38, 10.26 [20:05:37] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.95, 3.65, 3.04 [20:05:38] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.12, 11.77, 10.57 [20:05:51] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.22, 9.75, 10.01 [20:07:36] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.04, 3.72, 3.12 [20:09:35] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.79, 3.48, 3.11 [20:09:36] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 15.66, 12.05, 10.83 [20:09:49] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.87, 10.38, 10.16 [20:11:33] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.60, 2.87, 2.93 [20:11:35] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.42, 11.21, 10.68 [20:11:48] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 19.27, 13.67, 11.39 [20:13:34] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.74, 12.29, 11.14 [20:17:32] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.99, 11.89, 11.25 [20:19:31] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.91, 12.32, 11.48 [20:21:30] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.59, 11.75, 11.38 [20:23:29] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.29, 11.71, 11.39 [20:23:29] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.35, 3.25, 2.79 [20:27:27] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.77, 11.38, 11.30 [20:27:29] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.40, 3.55, 3.04 [20:33:24] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 14.61, 12.19, 11.61 [20:33:29] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.24, 3.86, 3.32 [20:33:48] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.62, 10.54, 11.53 [20:35:29] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.74, 3.41, 3.22 [20:37:29] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.14, 3.51, 3.27 [20:38:37] I mean it is bad [20:38:46] It’s just normal that the servers are grumpy [20:38:58] It’s not that bad [20:39:29] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.38, 2.66, 2.98 [20:43:48] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 14.03, 11.82, 11.53 [20:45:48] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.80, 11.08, 11.31 [20:47:17] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.81, 11.81, 11.85 [20:47:48] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.15, 11.37, 11.38 [20:49:48] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.13, 11.03, 11.23 [20:51:15] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.02, 11.80, 11.83 [20:51:48] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.59, 11.29, 11.27 [20:53:48] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.82, 11.01, 11.16 [20:55:13] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.03, 11.10, 11.49 [20:55:20] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 7.81, 4.91, 3.35 [20:57:14] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.95, 3.67, 3.07 [20:57:48] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.02, 11.03, 11.10 [20:59:08] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.09, 3.28, 3.00 [21:01:47] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.10, 10.86, 11.06 [21:03:22] PROBLEM - cp32 APT on cp32 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [21:06:15] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 6.00, 4.49, 3.43 [21:11:24] RECOVERY - cp32 APT on cp32 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [21:11:48] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 16.98, 12.74, 11.46 [21:13:48] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.73, 11.92, 11.33 [21:14:10] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.64, 3.75, 3.58 [21:16:09] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.28, 3.19, 3.39 [21:17:02] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.25, 9.22, 10.15 [21:23:47] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 5.99, 8.63, 9.94 [21:51:45] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.64, 3.49, 3.01 [21:53:44] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.73, 2.80, 2.81 [21:54:51] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.09, 4.01, 3.29 [21:58:40] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.26, 3.91, 3.43 [22:02:29] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.79, 2.79, 3.07 [22:05:41] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 12.67, 5.39, 3.51 [22:11:37] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.27, 3.89, 3.50 [22:13:36] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.01, 2.94, 3.20 [22:19:33] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.38, 10.93, 9.74 [22:21:32] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.54, 10.77, 9.84 [22:23:32] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.17, 9.70, 9.57 [22:29:21] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.20, 10.81, 9.95 [22:37:17] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.03, 9.48, 9.80 [22:41:24] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.39, 10.40, 9.91 [22:42:34] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.98, 3.50, 2.91 [22:43:23] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.72, 9.57, 9.68 [22:44:28] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.17, 3.70, 3.03 [22:48:17] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.06, 3.13, 2.96 [22:54:07] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 10.51, 5.36, 3.78 [23:02:07] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.51, 3.76, 3.96 [23:08:07] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 3.00, 2.69, 3.37 [23:12:07] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 6.86, 4.46, 3.88 [23:16:07] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.60, 3.62, 3.75 [23:20:07] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.17, 2.54, 3.28 [23:24:07] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.85, 3.82, 3.63 [23:29:07] PROBLEM - miraheze.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Certificate 'miraheze.wiki' expires in 7 day(s) (Tue 14 Mar 2023 23:09:28 GMT +0000). [23:30:07] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.38, 3.70, 3.76 [23:31:52] PROBLEM - mw122 NTP time on mw122 is WARNING: NTP WARNING: Offset 0.1067415178 secs [23:34:07] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.70, 2.65, 3.28 [23:36:54] PROBLEM - test131 APT on test131 is WARNING: APT WARNING: 0 packages available for upgrade (0 critical updates). warnings detected, errors detected. [23:40:55] RECOVERY - test131 APT on test131 is OK: APT OK: 1 packages available for upgrade (0 critical updates). [23:48:24] RECOVERY - mw122 NTP time on mw122 is OK: NTP OK: Offset 0.08693304658 secs [23:54:56] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 9.65, 5.99, 3.98