[00:02:33] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 10.94, 10.04, 6.23 [00:13:46] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.10, 2.98, 3.83 [00:19:46] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.70, 2.48, 3.30 [00:23:03] PROBLEM - db142 Current Load on db142 is WARNING: WARNING - load average: 7.75, 5.01, 2.95 [00:23:46] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.47, 3.65, 3.58 [00:25:00] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 2.19, 3.96, 2.82 [00:30:01] RECOVERY - db112 Disk Space on db112 is OK: DISK OK - free space: / 16305 MB (12% inode=99%); [00:36:33] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.94, 3.39, 4.00 [00:38:33] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.58, 3.68, 4.02 [00:40:33] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.83, 3.66, 3.99 [00:48:33] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.76, 2.38, 3.28 [00:52:33] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.48, 3.70, 3.59 [00:54:37] PROBLEM - cp32 NTP time on cp32 is WARNING: NTP WARNING: Offset 0.1199359894 secs [00:56:33] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.60, 3.44, 3.57 [00:56:37] RECOVERY - cp32 NTP time on cp32 is OK: NTP OK: Offset 0.05894771218 secs [00:58:33] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.00, 4.10, 3.79 [01:01:42] PROBLEM - cp23 APT on cp23 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [01:02:33] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.85, 3.97, 3.81 [01:03:39] RECOVERY - cp23 APT on cp23 is OK: APT OK: 36 packages available for upgrade (0 critical updates). [01:04:33] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.81, 4.54, 4.02 [01:10:33] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.16, 3.89, 3.95 [01:12:33] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 7.81, 5.13, 4.39 [01:16:33] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.78, 3.22, 3.77 [01:22:06] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.83, 6.19, 5.78 [01:22:33] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.50, 2.43, 3.27 [01:24:04] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 6.17, 6.33, 5.89 [01:30:33] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.46, 3.62, 3.46 [01:44:33] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.46, 3.31, 3.91 [01:46:33] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.73, 4.33, 4.23 [01:50:26] PROBLEM - cp33 APT on cp33 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [01:50:33] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.23, 3.21, 3.79 [01:52:32] RECOVERY - cp33 APT on cp33 is OK: APT OK: 36 packages available for upgrade (0 critical updates). [01:56:33] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.66, 2.79, 3.39 [02:02:03] PROBLEM - db142 Current Load on db142 is CRITICAL: CRITICAL - load average: 9.01, 5.68, 3.11 [02:04:03] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 2.07, 4.15, 2.86 [02:05:46] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.79, 2.64, 3.82 [02:07:27] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.73, 3.43, 3.43 [02:07:46] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.42, 3.46, 3.96 [02:09:24] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.65, 3.19, 3.34 [02:11:25] PROBLEM - cloud12 Puppet on cloud12 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[ulogd2] [02:11:46] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.13, 3.40, 3.88 [02:15:27] PROBLEM - cp23 NTP time on cp23 is WARNING: NTP WARNING: Offset 0.1150458455 secs [02:19:46] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.62, 2.44, 3.25 [02:23:06] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.53, 2.98, 2.89 [02:23:51] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 8.27, 4.42, 3.79 [02:25:03] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.81, 2.97, 2.90 [02:27:46] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.30, 3.86, 3.78 [02:31:27] RECOVERY - cp23 NTP time on cp23 is OK: NTP OK: Offset 0.07859179378 secs [02:31:46] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.94, 2.59, 3.26 [02:36:48] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.70, 4.12, 3.33 [02:37:46] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.22, 3.28, 3.41 [02:38:44] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.62, 3.94, 3.35 [02:39:24] RECOVERY - cloud12 Puppet on cloud12 is OK: OK: Puppet is currently enabled, last run 8 seconds ago with 0 failures [02:39:46] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.77, 3.07, 3.31 [02:40:41] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.03, 3.21, 3.15 [02:48:33] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 3.93, 4.15, 3.55 [02:48:40] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.30, 7.36, 6.38 [02:50:33] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.23, 3.36, 3.33 [02:50:40] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.07, 6.86, 6.32 [02:52:40] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.08, 6.25, 6.16 [02:55:36] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 7.64, 5.41, 4.13 [03:00:33] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.72, 3.61, 3.34 [03:02:33] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.15, 2.97, 3.13 [03:13:17] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.21, 2.64, 3.73 [03:16:33] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.11, 3.97, 3.41 [03:23:07] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 9.23, 4.80, 4.00 [03:44:44] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.71, 3.00, 3.83 [03:50:33] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.25, 2.97, 3.95 [03:54:33] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.16, 3.35, 3.84 [03:54:35] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.40, 3.49, 3.59 [03:56:33] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.17, 3.04, 3.68 [03:58:30] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.59, 3.72, 3.69 [03:58:40] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.03, 7.05, 6.42 [04:00:40] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 6.60, 6.57, 6.29 [04:02:26] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.26, 2.53, 3.21 [04:02:33] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.09, 3.31, 3.50 [04:10:33] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.03, 3.53, 3.72 [04:21:27] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.49, 7.34, 6.72 [04:22:57] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.54, 3.23, 3.04 [04:23:24] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.13, 7.56, 6.87 [04:24:55] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 3.25, 3.11, 3.01 [04:25:22] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.42, 6.58, 6.58 [04:26:33] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.42, 2.95, 3.31 [04:28:50] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 7.20, 5.26, 3.90 [04:29:16] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.15, 7.11, 6.79 [04:32:46] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.76, 3.82, 3.66 [04:34:44] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.40, 3.04, 3.39 [04:34:52] [02miraheze/MirahezeMagic] 07AgentIsai pushed 031 commit to 03vanishuser [+1/-0/±0] 13https://github.com/miraheze/MirahezeMagic/commit/dbd7288be49e [04:34:54] [02miraheze/MirahezeMagic] 07AgentIsai 03dbd7288 - Create Special:VanishUser [04:34:55] [02MirahezeMagic] 07AgentIsai created branch 03vanishuser - 13https://github.com/miraheze/MirahezeMagic [04:35:09] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.52, 6.35, 6.62 [04:36:33] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.54, 3.31, 3.17 [04:38:33] [02miraheze/MirahezeMagic] 07AgentIsai pushed 031 commit to 03vanishuser [+0/-0/±1] 13https://github.com/miraheze/MirahezeMagic/compare/dbd7288be49e...45cfb95f7e23 [04:38:36] [02miraheze/MirahezeMagic] 07AgentIsai 0345cfb95 - Update extension.json [04:40:29] [02miraheze/MirahezeMagic] 07AgentIsai pushed 031 commit to 03vanishuser [+0/-0/±1] 13https://github.com/miraheze/MirahezeMagic/compare/45cfb95f7e23...62fa1d781871 [04:40:32] [02miraheze/MirahezeMagic] 07AgentIsai 0362fa1d7 - Add alias [04:40:33] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.93, 2.86, 3.05 [04:47:39] [02miraheze/MirahezeMagic] 07AgentIsai pushed 031 commit to 03vanishuser [+0/-0/±1] 13https://github.com/miraheze/MirahezeMagic/compare/62fa1d781871...c5c90530a9fb [04:47:41] [02miraheze/MirahezeMagic] 07AgentIsai 03c5c9053 - i18n [04:48:05] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.85, 10.80, 11.86 [04:53:21] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.65, 3.07, 3.02 [04:55:19] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.13, 3.72, 3.29 [04:56:06] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.64, 11.14, 11.46 [04:58:06] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.15, 10.56, 11.22 [04:59:15] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.98, 3.55, 3.32 [05:00:33] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.48, 3.78, 3.31 [05:01:12] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 3.27, 3.30, 3.24 [05:02:33] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.89, 3.97, 3.45 [05:03:44] [02miraheze/MirahezeMagic] 07AgentIsai pushed 031 commit to 03vanishuser [+0/-0/±1] 13https://github.com/miraheze/MirahezeMagic/compare/c5c90530a9fb...65fc2fcad5aa [05:03:46] [02miraheze/MirahezeMagic] 07AgentIsai 0365fc2fc - docs [05:04:33] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.61, 4.68, 3.77 [05:04:39] [02RemovePII] 07AgentIsai closed pull request 03#68: Create Special:VanishUser - 13https://github.com/miraheze/RemovePII/pull/68 [05:04:45] [02MirahezeMagic] 07AgentIsai opened pull request 03#421: Create VanishUser - 13https://github.com/miraheze/MirahezeMagic/pull/421 [05:06:12] [02MirahezeMagic] 07AgentIsai synchronize pull request 03#421: Create VanishUser - 13https://github.com/miraheze/MirahezeMagic/pull/421 [05:06:14] [02miraheze/MirahezeMagic] 07AgentIsai pushed 031 commit to 03vanishuser [+0/-0/±1] 13https://github.com/miraheze/MirahezeMagic/compare/65fc2fcad5aa...8581470422de [05:06:17] [02miraheze/MirahezeMagic] 07AgentIsai 038581470 - Add notranslate tags to some [05:08:00] [02miraheze/MirahezeMagic] 07github-actions[bot] pushed 031 commit to 03vanishuser [+0/-0/±1] 13https://github.com/miraheze/MirahezeMagic/compare/8581470422de...0671aab2d463 [05:08:01] [02miraheze/MirahezeMagic] 07github-actions 030671aab - CI: lint code to MediaWiki standards [05:08:04] [02MirahezeMagic] 07github-actions[bot] synchronize pull request 03#421: Create VanishUser - 13https://github.com/miraheze/MirahezeMagic/pull/421 [05:09:10] [02MirahezeMagic] 07AgentIsai synchronize pull request 03#421: Create VanishUser - 13https://github.com/miraheze/MirahezeMagic/pull/421 [05:09:13] [02miraheze/MirahezeMagic] 07AgentIsai pushed 031 commit to 03vanishuser [+0/-0/±1] 13https://github.com/miraheze/MirahezeMagic/compare/0671aab2d463...a671c15882d4 [05:09:16] [02miraheze/MirahezeMagic] 07AgentIsai 03a671c15 - Add LogTypes et al and alphabetize [05:10:33] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.65, 3.43, 3.56 [05:10:51] [02miraheze/MirahezeMagic] 07AgentIsai pushed 031 commit to 03vanishuser [+0/-0/±1] 13https://github.com/miraheze/MirahezeMagic/compare/a671c15882d4...22ebebd61526 [05:10:53] [02miraheze/MirahezeMagic] 07AgentIsai 0322ebebd - Remove comma [05:10:54] [02MirahezeMagic] 07AgentIsai synchronize pull request 03#421: Create VanishUser - 13https://github.com/miraheze/MirahezeMagic/pull/421 [05:11:37] miraheze/MirahezeMagic - AgentIsai the build has errored. [05:12:33] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.45, 2.78, 3.30 [05:14:06] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.01, 11.46, 11.31 [05:15:52] [02miraheze/MirahezeMagic] 07AgentIsai pushed 031 commit to 03vanishuser [+0/-0/±1] 13https://github.com/miraheze/MirahezeMagic/compare/22ebebd61526...e09869fe1b22 [05:15:52] [02miraheze/MirahezeMagic] 07AgentIsai 03e09869f - Revert CI weirdness [05:15:54] [02MirahezeMagic] 07AgentIsai synchronize pull request 03#421: Create VanishUser - 13https://github.com/miraheze/MirahezeMagic/pull/421 [05:16:05] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.48, 10.77, 11.11 [05:17:17] [02MirahezeMagic] 07AgentIsai synchronize pull request 03#421: Create VanishUser - 13https://github.com/miraheze/MirahezeMagic/pull/421 [05:17:19] [02miraheze/MirahezeMagic] 07AgentIsai pushed 031 commit to 03vanishuser [+0/-0/±1] 13https://github.com/miraheze/MirahezeMagic/compare/e09869fe1b22...fa000507bc31 [05:17:22] [02miraheze/MirahezeMagic] 07AgentIsai 03fa00050 - Readd ExtensionRegistry [05:18:14] miraheze/MirahezeMagic - AgentIsai the build has errored. [05:18:46] [02miraheze/MirahezeMagic] 07github-actions[bot] pushed 031 commit to 03vanishuser [+0/-0/±1] 13https://github.com/miraheze/MirahezeMagic/compare/fa000507bc31...6885fe00d2f3 [05:18:49] [02miraheze/MirahezeMagic] 07github-actions 036885fe0 - CI: lint code to MediaWiki standards [05:18:50] [02MirahezeMagic] 07github-actions[bot] synchronize pull request 03#421: Create VanishUser - 13https://github.com/miraheze/MirahezeMagic/pull/421 [05:20:05] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.74, 11.29, 11.19 [05:21:11] miraheze/MirahezeMagic - AgentIsai the build has errored. [05:22:06] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.01, 10.23, 10.80 [05:23:24] [02MirahezeMagic] 07AgentIsai synchronize pull request 03#421: Create VanishUser - 13https://github.com/miraheze/MirahezeMagic/pull/421 [05:23:27] [02miraheze/MirahezeMagic] 07AgentIsai pushed 031 commit to 03vanishuser [+0/-0/±1] 13https://github.com/miraheze/MirahezeMagic/compare/6885fe00d2f3...074988323902 [05:23:29] [02miraheze/MirahezeMagic] 07AgentIsai 030749883 - Update SpecialVanishUser.php [05:24:42] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.71, 10.99, 11.91 [05:25:50] miraheze/MirahezeMagic - AgentIsai the build has errored. [05:28:05] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.06, 8.46, 9.85 [05:36:05] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.01, 10.26, 10.15 [05:36:42] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.10, 11.14, 11.34 [05:38:06] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 9.03, 9.61, 9.91 [05:38:43] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.27, 10.88, 11.22 [05:40:42] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.54, 11.43, 11.38 [05:41:02] [02MirahezeMagic] 07AgentIsai synchronize pull request 03#421: Create VanishUser - 13https://github.com/miraheze/MirahezeMagic/pull/421 [05:41:04] [02miraheze/MirahezeMagic] 07AgentIsai pushed 031 commit to 03vanishuser [+0/-0/±1] 13https://github.com/miraheze/MirahezeMagic/compare/074988323902...878881fb8ef8 [05:41:05] [02miraheze/MirahezeMagic] 07AgentIsai 03878881f - Disable PHPCS for certain sections [05:44:18] miraheze/MirahezeMagic - AgentIsai the build has errored. [05:44:42] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.77, 11.63, 11.60 [05:51:34] [02MirahezeMagic] 07AgentIsai synchronize pull request 03#421: Create VanishUser - 13https://github.com/miraheze/MirahezeMagic/pull/421 [05:51:37] [02miraheze/MirahezeMagic] 07AgentIsai pushed 031 commit to 03vanishuser [+0/-0/±1] 13https://github.com/miraheze/MirahezeMagic/compare/878881fb8ef8...fe344647c305 [05:51:40] [02miraheze/MirahezeMagic] 07AgentIsai 03fe34464 - Namespace [05:52:05] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.72, 10.27, 9.88 [05:54:10] miraheze/MirahezeMagic - AgentIsai the build has errored. [05:54:16] [02miraheze/MirahezeMagic] 07AgentIsai pushed 031 commit to 03vanishuser [+1/-1/±5] 13https://github.com/miraheze/MirahezeMagic/compare/fe344647c305...0b1f13a2fe70 [05:54:19] [02miraheze/MirahezeMagic] 07AgentIsai 030b1f13a - Use namespaces [05:54:22] [02MirahezeMagic] 07AgentIsai synchronize pull request 03#421: Create VanishUser - 13https://github.com/miraheze/MirahezeMagic/pull/421 [05:56:49] miraheze/MirahezeMagic - AgentIsai the build has errored. [05:58:06] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 9.44, 10.12, 10.02 [06:10:42] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.65, 10.73, 10.54 [06:14:42] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.18, 11.63, 11.14 [06:18:42] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 11.17, 12.13, 11.49 [06:20:42] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.73, 11.87, 11.48 [06:24:56] PROBLEM - cloud14 Puppet on cloud14 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[ulogd2] [06:28:43] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.87, 8.65, 9.99 [06:42:42] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.44, 11.03, 9.93 [06:43:53] [02MirahezeMagic] 07Universal-Omega commented on pull request 03#421: Create VanishUser - 13https://github.com/miraheze/MirahezeMagic/pull/421#issuecomment-1528952487 [06:44:42] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.35, 10.10, 9.73 [06:52:56] RECOVERY - cloud14 Puppet on cloud14 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [06:58:37] PROBLEM - cp32 NTP time on cp32 is WARNING: NTP WARNING: Offset 0.3070173264 secs [07:05:44] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.82, 10.14, 9.28 [07:07:03] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.51, 9.96, 9.72 [07:07:44] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.05, 9.07, 8.99 [07:08:58] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 10.18, 10.04, 9.78 [07:12:47] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.40, 10.31, 10.05 [07:14:43] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.52, 9.93, 9.95 [07:20:24] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+1/-0/±1] 13https://github.com/miraheze/ssl/compare/420519cdf8d0...c3a8b7524493 [07:20:27] [02miraheze/ssl] 07MirahezeSSLBot 03c3a8b75 - Bot: Add SSL cert for wiki.altilunium.my.id [07:20:43] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.32, 11.27, 10.32 [07:21:28] [02miraheze/dns] 07Reception123 pushed 031 commit to 03master [+1/-0/±0] 13https://github.com/miraheze/dns/compare/21c4bac6bcf0...597937092b6f [07:21:30] [02miraheze/dns] 07Reception123 035979370 - add xomnipedia.org zone [07:21:38] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.95, 10.38, 9.71 [07:22:42] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.75, 11.05, 10.39 [07:23:37] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 9.78, 10.15, 9.71 [07:26:37] RECOVERY - cp32 NTP time on cp32 is OK: NTP OK: Offset 0.008260935545 secs [07:26:42] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.19, 11.82, 10.83 [07:27:36] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 17.53, 12.86, 10.83 [07:45:30] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.60, 11.63, 11.84 [07:48:28] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.90, 7.99, 6.37 [07:48:42] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.53, 11.56, 11.94 [07:50:26] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 4.81, 6.96, 6.20 [07:50:43] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 11.70, 11.88, 12.02 [07:52:24] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 4.64, 6.19, 6.00 [07:53:11] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.74, 11.44, 11.83 [07:53:55] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.42, 2.40, 1.78 [07:55:08] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.06, 11.97, 12.00 [07:55:14] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.71, 11.85, 11.66 [07:55:50] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.52, 1.98, 1.70 [07:57:08] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.07, 11.35, 11.49 [07:59:03] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.38, 11.86, 11.96 [08:02:54] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.76, 11.35, 11.38 [08:04:54] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.14, 11.52, 11.46 [08:06:51] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.02, 10.91, 11.34 [08:08:49] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.53, 10.63, 11.21 [08:20:54] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.62, 8.93, 10.15 [08:26:09] PROBLEM - en.religiononfire.mar.in.ua - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - en.religiononfire.mar.in.ua All nameservers failed to answer the query. [08:26:23] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.55, 10.67, 10.74 [08:28:54] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.70, 11.07, 10.36 [08:30:54] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.21, 10.86, 10.36 [08:32:14] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 7.29, 10.95, 11.20 [08:34:54] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 14.35, 12.32, 10.99 [08:35:59] PROBLEM - cp22 NTP time on cp22 is WARNING: NTP WARNING: Offset 0.1047184765 secs [08:36:09] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.58, 12.17, 11.59 [08:38:06] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.61, 11.45, 11.40 [08:39:36] PROBLEM - db142 Current Load on db142 is WARNING: WARNING - load average: 7.20, 6.30, 3.34 [08:41:36] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 1.41, 4.44, 3.02 [08:42:00] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 19.15, 14.18, 12.38 [08:42:54] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.95, 11.96, 11.53 [08:48:54] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.81, 11.64, 11.35 [08:49:48] RECOVERY - cp22 NTP time on cp22 is OK: NTP OK: Offset 0.09941971302 secs [08:50:54] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.82, 11.60, 11.37 [08:52:13] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.02, 6.41, 5.66 [08:54:54] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.97, 12.01, 11.57 [08:55:24] PROBLEM - en.religiononfire.mar.in.ua - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query mar.in.ua. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [08:56:13] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 4.68, 5.78, 5.59 [09:20:54] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.90, 11.25, 11.94 [09:24:39] RECOVERY - en.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - en.religiononfire.mar.in.ua reverse DNS resolves to cp22.miraheze.org - CNAME OK [09:26:54] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 14.16, 11.97, 11.94 [09:28:54] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.34, 11.06, 11.60 [09:38:54] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.34, 11.97, 11.69 [09:40:54] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.92, 11.36, 11.49 [09:44:54] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.32, 11.25, 11.33 [09:47:36] PROBLEM - db142 Current Load on db142 is CRITICAL: CRITICAL - load average: 8.15, 5.20, 2.74 [09:49:36] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 3.21, 4.77, 2.92 [09:50:54] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.39, 11.24, 11.36 [09:52:54] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 14.16, 11.82, 11.52 [09:56:54] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.26, 10.67, 11.20 [10:02:54] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.31, 10.51, 10.80 [10:03:21] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.37, 10.60, 11.92 [10:06:54] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.99, 10.65, 10.89 [10:07:21] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.09, 11.12, 11.79 [10:09:21] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.24, 10.56, 11.49 [10:10:54] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 15.20, 12.64, 11.62 [10:11:21] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 18.24, 13.35, 12.39 [10:14:54] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.26, 11.83, 11.53 [10:18:54] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.02, 11.92, 11.61 [10:22:54] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.46, 11.62, 11.62 [10:28:13] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.30, 7.38, 6.46 [10:28:37] PROBLEM - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - uk.religiononfire.mar.in.ua All nameservers failed to answer the query. [10:31:21] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.22, 11.26, 11.96 [10:32:13] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.62, 6.68, 6.40 [10:34:40] [02miraheze/ImportDump] 07redbluegreenhat pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/3aeeebe007d3...5490f92f3c08 [10:34:42] [02miraheze/ImportDump] 07redbluegreenhat 035490f92 - eslint: Do not check for possible timing attacks [10:37:29] miraheze/ImportDump - redbluegreenhat the build has errored. [10:38:39] [02miraheze/ImportDump] 07redbluegreenhat pushed 034 commits to 03master [+0/-0/±6] 13https://github.com/miraheze/ImportDump/compare/5490f92f3c08...0cbbe7b1e29c [10:38:40] [02miraheze/ImportDump] 07redbluegreenhat 0373f8271 - Merge pull request https://github.com/miraheze/ImportDump/pull/41 [10:38:43] [02miraheze/ImportDump] 07redbluegreenhat 030cbbe7b - Merge pull request https://github.com/miraheze/ImportDump/pull/40 [10:38:46] [02ImportDump] 07redbluegreenhat closed pull request 03#40: Update mediawiki/mediawiki-phan-config requirement from 0.12.0 to 0.12.1 - 13https://github.com/miraheze/ImportDump/pull/40 [10:38:49] [02ImportDump] 07redbluegreenhat closed pull request 03#41: Bump eslint-config-wikimedia from 0.24.0 to 0.25.0 - 13https://github.com/miraheze/ImportDump/pull/41 [10:38:51] [02miraheze/ImportDump] 07redbluegreenhat deleted branch 03dependabot/npm_and_yarn/eslint-config-wikimedia-0.25.0 [10:38:54] [02ImportDump] 07redbluegreenhat deleted branch 03dependabot/composer/mediawiki/mediawiki-phan-config-0.12.1 - 13https://github.com/miraheze/ImportDump [10:38:55] [02ImportDump] 07redbluegreenhat deleted branch 03dependabot/npm_and_yarn/eslint-config-wikimedia-0.25.0 - 13https://github.com/miraheze/ImportDump [10:38:56] [02miraheze/ImportDump] 07redbluegreenhat deleted branch 03dependabot/composer/mediawiki/mediawiki-phan-config-0.12.1 [10:40:54] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.70, 8.84, 10.09 [10:41:21] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 14.32, 10.00, 10.64 [10:45:21] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.81, 10.72, 10.87 [10:46:54] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.22, 9.83, 10.05 [10:47:21] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 16.50, 12.95, 11.66 [10:48:54] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.88, 11.11, 10.50 [10:50:21] miraheze/ImportDump - redbluegreenhat the build passed. [10:50:52] PROBLEM - cp23 NTP time on cp23 is WARNING: NTP WARNING: Offset 0.1200023293 secs [10:50:54] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.72, 10.95, 10.50 [10:51:21] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.96, 11.44, 11.38 [10:52:54] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.18, 9.57, 10.05 [10:56:55] [02miraheze/ManageWiki] 07redbluegreenhat pushed 033 commits to 03master [+0/-0/±5] 13https://github.com/miraheze/ManageWiki/compare/545a70441aa8...bd2030e8263c [10:56:57] [02miraheze/ManageWiki] 07redbluegreenhat 03bc17f67 - eslint: Do not check for possible timing attacks [10:57:00] [02miraheze/ManageWiki] 07redbluegreenhat 03bd2030e - Merge pull request https://github.com/miraheze/ManageWiki/pull/395 [10:57:02] [02ManageWiki] 07redbluegreenhat closed pull request 03#395: Bump eslint-config-wikimedia from 0.24.0 to 0.25.0 - 13https://github.com/miraheze/ManageWiki/pull/395 [10:57:03] [02miraheze/ManageWiki] 07dependabot[bot] deleted branch 03dependabot/npm_and_yarn/eslint-config-wikimedia-0.25.0 [10:57:06] [02ManageWiki] 07dependabot[bot] deleted branch 03dependabot/npm_and_yarn/eslint-config-wikimedia-0.25.0 - 13https://github.com/miraheze/ManageWiki [10:57:16] PROBLEM - en.religiononfire.mar.in.ua - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query en.religiononfire.mar.in.ua. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [10:57:21] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.68, 11.31, 11.27 [10:57:23] we really do have a lot of extensions huh [10:59:21] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 7.96, 10.04, 10.81 [11:00:03] miraheze/ManageWiki - redbluegreenhat the build passed. [11:02:52] RECOVERY - cp23 NTP time on cp23 is OK: NTP OK: Offset 0.09592404962 secs [11:03:43] [02miraheze/GlobalNewFiles] 07redbluegreenhat pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/GlobalNewFiles/compare/ac4374d40abb...141dd4832a04 [11:03:45] [02GlobalNewFiles] 07redbluegreenhat closed pull request 03#42: Update mediawiki/mediawiki-phan-config requirement from 0.12.0 to 0.12.1 - 13https://github.com/miraheze/GlobalNewFiles/pull/42 [11:03:51] [02miraheze/GlobalNewFiles] 07dependabot[bot] deleted branch 03dependabot/composer/mediawiki/mediawiki-phan-config-0.12.1 [11:03:52] [02GlobalNewFiles] 07dependabot[bot] deleted branch 03dependabot/composer/mediawiki/mediawiki-phan-config-0.12.1 - 13https://github.com/miraheze/GlobalNewFiles [11:04:54] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.84, 10.92, 10.34 [11:07:35] miraheze/GlobalNewFiles - redbluegreenhat the build passed. [11:08:33] [02MirahezeMagic] 07redbluegreenhat commented on pull request 03#421: Create VanishUser - 13https://github.com/miraheze/MirahezeMagic/pull/421#issuecomment-1528997974 [11:08:54] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.58, 10.17, 10.19 [11:11:21] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 15.13, 11.22, 10.70 [11:11:42] I'm gonna call it a day, that's all the extensions I think. [11:15:21] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.70, 11.46, 10.93 [11:17:21] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.10, 11.60, 11.01 [11:26:31] RECOVERY - en.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - en.religiononfire.mar.in.ua reverse DNS resolves to cp22.miraheze.org - CNAME OK [11:28:07] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.10, 11.20, 10.31 [11:28:08] RECOVERY - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - uk.religiononfire.mar.in.ua reverse DNS resolves to cp22.miraheze.org - CNAME OK [11:30:01] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.06, 11.47, 10.54 [11:33:48] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 16.03, 12.44, 11.03 [11:37:21] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.16, 10.93, 11.54 [11:37:36] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.92, 11.62, 11.05 [11:45:11] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.84, 8.91, 10.07 [11:49:21] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 15.88, 11.77, 11.26 [11:52:54] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.29, 10.54, 10.39 [11:55:21] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 7.91, 10.86, 11.18 [11:58:54] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.12, 9.33, 9.91 [12:03:21] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.92, 8.98, 10.16 [12:06:54] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.35, 11.00, 10.16 [12:07:21] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 14.02, 11.17, 10.74 [12:14:54] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.27, 11.90, 11.20 [12:16:54] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 14.23, 12.60, 11.52 [12:18:54] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.87, 11.68, 11.33 [12:28:36] PROBLEM - test131 MediaWiki Rendering on test131 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:30:36] PROBLEM - test131 MediaWiki Rendering on test131 is WARNING: HTTP WARNING: HTTP/1.1 404 Not Found - 302 bytes in 3.750 second response time [12:30:54] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.68, 11.14, 11.04 [12:30:57] PROBLEM - test131 SSH on test131 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:32:21] PROBLEM - test131 Current Load on test131 is CRITICAL: CRITICAL - load average: 14.47, 12.52, 5.76 [12:32:43] PROBLEM - test131 MediaWiki Rendering on test131 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:32:59] PROBLEM - test131 PowerDNS Recursor on test131 is CRITICAL: CRITICAL - Plugin timed out while executing system call [12:32:59] RECOVERY - test131 SSH on test131 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [12:34:39] PROBLEM - test131 MediaWiki Rendering on test131 is WARNING: HTTP WARNING: HTTP/1.1 404 Not Found - 302 bytes in 0.097 second response time [12:34:53] RECOVERY - test131 PowerDNS Recursor on test131 is OK: DNS OK: 0.101 seconds response time. miraheze.org returns 109.228.51.216,217.174.247.33,2a00:da00:1800:326::1,2a00:da00:1800:328::1 [12:40:54] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.64, 11.81, 11.96 [12:41:58] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 0.12, 2.49, 3.78 [12:43:53] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 0.13, 1.73, 3.35 [12:46:54] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.58, 11.59, 11.75 [12:48:08] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.63, 3.11, 1.92 [12:50:08] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.77, 2.43, 1.81 [12:54:32] PROBLEM - matomo121 Current Load on matomo121 is WARNING: WARNING - load average: 3.59, 3.22, 2.67 [12:56:32] RECOVERY - matomo121 Current Load on matomo121 is OK: OK - load average: 2.29, 2.99, 2.66 [12:58:54] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.33, 11.20, 11.85 [12:59:33] PROBLEM - cp33 APT on cp33 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [13:00:08] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.51, 4.25, 2.95 [13:01:30] RECOVERY - cp33 APT on cp33 is OK: APT OK: 36 packages available for upgrade (0 critical updates). [13:02:08] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.89, 3.44, 2.82 [13:04:08] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.28, 2.63, 2.59 [13:04:54] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.41, 11.42, 11.59 [13:06:54] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.81, 11.06, 11.43 [13:08:54] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.90, 11.72, 11.63 [13:09:36] PROBLEM - db142 Current Load on db142 is CRITICAL: CRITICAL - load average: 8.66, 5.86, 3.16 [13:12:54] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.36, 11.71, 11.69 [13:13:36] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 3.04, 5.61, 3.78 [13:14:54] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.51, 12.42, 11.97 [13:23:36] PROBLEM - db142 Current Load on db142 is CRITICAL: CRITICAL - load average: 9.10, 6.56, 4.49 [13:25:36] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 2.73, 5.19, 4.25 [13:28:52] PROBLEM - en.religiononfire.mar.in.ua - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - en.religiononfire.mar.in.ua All nameservers failed to answer the query. [13:52:35] PROBLEM - cp22 NTP time on cp22 is WARNING: NTP WARNING: Offset 0.1165055633 secs [13:58:07] RECOVERY - en.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - en.religiononfire.mar.in.ua reverse DNS resolves to cp23.miraheze.org - CNAME OK [13:58:34] RECOVERY - cp22 NTP time on cp22 is OK: NTP OK: Offset 0.08795192838 secs [14:01:27] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.47, 2.46, 1.83 [14:03:24] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.37, 2.03, 1.75 [14:14:34] PROBLEM - cp22 NTP time on cp22 is WARNING: NTP WARNING: Offset 0.1035326719 secs [14:15:57] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.75, 7.35, 6.51 [14:16:34] RECOVERY - cp22 NTP time on cp22 is OK: NTP OK: Offset 0.09724196792 secs [14:17:52] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.42, 7.42, 6.64 [14:19:47] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.01, 7.60, 6.79 [14:21:42] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.48, 7.09, 6.70 [14:23:37] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.78, 8.13, 7.14 [14:25:32] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 5.17, 6.94, 6.81 [14:27:27] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 6.57, 6.65, 6.71 [14:31:18] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.54, 7.76, 7.17 [14:32:21] RECOVERY - cloud11 IPMI Sensors on cloud11 is OK: IPMI Status: OK [14:36:21] PROBLEM - cloud11 IPMI Sensors on cloud11 is CRITICAL: IPMI Status: Critical [Cntlr 2 Bay 8 = Critical] [14:36:32] PROBLEM - matomo121 Current Load on matomo121 is CRITICAL: CRITICAL - load average: 5.06, 3.85, 3.16 [14:37:03] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.35, 6.39, 6.74 [14:38:32] PROBLEM - matomo121 Current Load on matomo121 is WARNING: WARNING - load average: 3.65, 3.76, 3.21 [14:42:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.66, 6.94, 6.90 [14:44:32] RECOVERY - matomo121 Current Load on matomo121 is OK: OK - load average: 2.95, 3.31, 3.20 [14:44:45] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.46, 7.35, 7.03 [14:50:30] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.56, 7.76, 7.31 [14:54:27] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.63, 3.19, 2.49 [14:56:15] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 4.88, 6.22, 6.76 [14:56:24] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.94, 3.13, 2.55 [15:10:51] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 11.50, 8.81, 7.48 [15:14:41] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 5.18, 7.50, 7.27 [15:16:36] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.19, 7.99, 7.49 [15:18:31] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.50, 3.58, 2.87 [15:20:26] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.95, 3.37, 2.88 [15:20:35] PROBLEM - cp22 NTP time on cp22 is WARNING: NTP WARNING: Offset 0.1526209116 secs [15:24:16] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.48, 7.49, 7.59 [15:27:40] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.84, 3.82, 3.22 [15:29:10] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.14, 3.76, 3.25 [15:29:38] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.63, 4.01, 3.35 [15:31:05] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.49, 3.36, 3.16 [15:31:35] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.99, 3.72, 3.33 [15:33:35] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.64, 3.25, 3.20 [15:36:13] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 4.48, 5.80, 6.53 [15:40:35] RECOVERY - cp22 NTP time on cp22 is OK: NTP OK: Offset 0.09789183736 secs [15:55:15] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 3.85, 4.24, 3.33 [16:01:02] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.58, 3.75, 3.53 [16:02:58] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.95, 3.15, 3.33 [16:03:48] Orange_Star: hey [16:03:53] hi [16:04:23] Orange_Star: Ashley is aware and they think they know how to fix [16:04:35] good to know [16:04:35] I would just mark master as experimental [16:04:41] Add 1.40 jobs though [16:04:43] Too [16:04:46] What's going on by the way? [16:04:46] To CI [16:04:57] With Social Profile not working in master [16:05:08] Orange_Star: they think it's to do with the way the extension is registered [16:05:25] Social Profile is still the very old php entry point [16:07:40] Extension registration was introduced in 1.25 [16:07:45] So 7.5 years ago [16:09:12] May 25 2015 [16:09:23] So 7 years 11 months [16:09:30] Merged Jan 8 2015 [16:09:45] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.90, 3.37, 3.43 [16:11:05] [Grafana] FIRING: Some MediaWiki Appservers are running out of PHP-FPM workers. https://grafana.miraheze.org/d/GtxbP1Xnk?orgId=1 [16:11:17] https://github.com/wikimedia/mediawiki-extensions-SocialProfile/blob/master/SocialProfile.php looks like it would be a drag to switch to extension.json [16:11:28] I do not envy whoever is trying to port it [16:11:41] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.59, 2.84, 3.24 [16:12:37] Orange_Star: CosmicAlpha [16:26:05] [Grafana] RESOLVED: PHP-FPM Worker Usage High https://grafana.miraheze.org/d/GtxbP1Xnk?orgId=1 [16:27:08] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.19, 3.14, 2.84 [16:29:04] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.90, 2.92, 2.79 [16:29:44] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 3.66, 2.95, 1.96 [16:31:05] PROBLEM - en.religiononfire.mar.in.ua - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query mar.in.ua. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [16:31:44] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.51, 2.38, 1.87 [16:35:36] PROBLEM - db142 Current Load on db142 is CRITICAL: CRITICAL - load average: 9.55, 4.97, 2.51 [16:36:05] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.87, 3.91, 3.07 [16:37:36] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 4.78, 4.83, 2.76 [16:38:02] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.29, 3.31, 2.95 [16:39:20] PROBLEM - matomo121 Current Load on matomo121 is WARNING: WARNING - load average: 3.91, 3.46, 3.29 [16:41:16] PROBLEM - matomo121 Current Load on matomo121 is CRITICAL: CRITICAL - load average: 4.02, 3.53, 3.33 [16:43:11] PROBLEM - matomo121 Current Load on matomo121 is WARNING: WARNING - load average: 3.50, 3.44, 3.32 [16:45:07] RECOVERY - matomo121 Current Load on matomo121 is OK: OK - load average: 2.88, 3.15, 3.22 [16:48:13] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.19, 7.07, 6.29 [16:54:11] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.88, 3.54, 2.87 [16:54:13] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 6.02, 6.51, 6.30 [16:56:08] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.94, 3.30, 2.85 [17:00:20] RECOVERY - en.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - en.religiononfire.mar.in.ua reverse DNS resolves to cp23.miraheze.org - CNAME OK [17:05:04] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.34, 7.59, 6.76 [17:06:59] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.51, 6.69, 6.52 [17:09:15] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 9.22, 6.48, 4.09 [17:21:03] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.73, 3.60, 3.77 [17:25:03] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.68, 2.51, 3.28 [17:49:13] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 11.16, 7.54, 6.46 [17:50:34] PROBLEM - cp22 NTP time on cp22 is WARNING: NTP WARNING: Offset 0.1348937452 secs [17:51:08] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.13, 7.13, 6.45 [17:53:03] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 4.91, 6.53, 6.32 [17:55:08] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.69, 3.08, 2.64 [17:57:04] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.72, 2.64, 2.54 [17:58:35] RECOVERY - cp22 NTP time on cp22 is OK: NTP OK: Offset 0.0879137218 secs [18:01:44] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 4.32, 4.18, 2.41 [18:02:33] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.83, 3.59, 3.05 [18:03:44] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.17, 3.02, 2.19 [18:04:30] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.16, 3.66, 3.13 [18:04:32] PROBLEM - matomo121 Current Load on matomo121 is WARNING: WARNING - load average: 3.59, 3.22, 2.87 [18:06:28] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.27, 3.08, 2.97 [18:06:30] [Grafana] FIRING: Some MediaWiki Appservers are running out of PHP-FPM workers. https://grafana.miraheze.org/d/GtxbP1Xnk?orgId=1 [18:06:35] PROBLEM - cp22 NTP time on cp22 is WARNING: NTP WARNING: Offset 0.1385755241 secs [18:10:32] RECOVERY - matomo121 Current Load on matomo121 is OK: OK - load average: 3.01, 3.35, 3.08 [18:11:30] [Grafana] RESOLVED: PHP-FPM Worker Usage High https://grafana.miraheze.org/d/GtxbP1Xnk?orgId=1 [18:14:32] PROBLEM - matomo121 Current Load on matomo121 is WARNING: WARNING - load average: 3.37, 3.44, 3.18 [18:14:34] RECOVERY - cp22 NTP time on cp22 is OK: NTP OK: Offset 0.09834650159 secs [18:15:25] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.94, 3.68, 2.88 [18:16:32] RECOVERY - matomo121 Current Load on matomo121 is OK: OK - load average: 2.57, 3.06, 3.06 [18:17:21] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.87, 3.51, 2.93 [18:19:17] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.17, 3.10, 2.85 [18:25:08] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 3.78, 4.11, 3.42 [18:27:04] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.87, 3.83, 3.39 [18:30:55] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.75, 3.11, 3.19 [18:41:00] [Grafana] FIRING: Some MediaWiki Appservers are running out of PHP-FPM workers. https://grafana.miraheze.org/d/GtxbP1Xnk?orgId=1 [18:42:13] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 11.19, 8.69, 7.10 [18:46:13] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.69, 7.56, 7.02 [18:54:13] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.16, 6.53, 6.78 [18:56:48] PROBLEM - njtelimination.ml - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'njtelimination.ml' expires in 15 day(s) (Tue 16 May 2023 18:37:12 GMT +0000). [19:01:48] PROBLEM - mw142 APT on mw142 is CRITICAL: APT CRITICAL: 67 packages available for upgrade (10 critical updates). [19:02:10] PROBLEM - matomo121 Current Load on matomo121 is CRITICAL: CRITICAL - load average: 4.32, 3.44, 3.12 [19:02:28] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/c3a8b7524493...690fa24f9392 [19:02:29] [02miraheze/ssl] 07MirahezeSSLBot 03690fa24 - Bot: Update SSL cert for njtelimination.ml [19:04:06] RECOVERY - matomo121 Current Load on matomo121 is OK: OK - load average: 2.98, 3.29, 3.11 [19:05:38] PROBLEM - mw122 APT on mw122 is CRITICAL: APT CRITICAL: 67 packages available for upgrade (10 critical updates). [19:07:32] PROBLEM - mw132 APT on mw132 is CRITICAL: APT CRITICAL: 67 packages available for upgrade (10 critical updates). [19:08:46] PROBLEM - mw141 APT on mw141 is CRITICAL: APT CRITICAL: 66 packages available for upgrade (10 critical updates). [19:11:26] PROBLEM - mwtask141 APT on mwtask141 is CRITICAL: APT CRITICAL: 60 packages available for upgrade (10 critical updates). [19:12:36] PROBLEM - mw131 APT on mw131 is CRITICAL: APT CRITICAL: 66 packages available for upgrade (10 critical updates). [19:12:56] PROBLEM - mw121 APT on mw121 is CRITICAL: APT CRITICAL: 67 packages available for upgrade (10 critical updates). [19:22:58] [02mw-config] 07Amanda-Catherine opened pull request 03#5218: Configure $wgDefaultUserOptions for zhtranswiki T10788 - 13https://github.com/miraheze/mw-config/pull/5218 [19:23:55] miraheze/mw-config - Amanda-Catherine the build passed. [19:26:00] [Grafana] RESOLVED: PHP-FPM Worker Usage High https://grafana.miraheze.org/d/GtxbP1Xnk?orgId=1 [19:26:05] RECOVERY - njtelimination.ml - LetsEncrypt on sslhost is OK: OK - Certificate 'njtelimination.ml' will expire on Sat 29 Jul 2023 18:02:20 GMT +0000. [19:26:22] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.54, 3.77, 3.10 [19:28:17] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.80, 3.42, 3.05 [19:30:13] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.88, 2.97, 2.93 [19:34:35] PROBLEM - cp22 NTP time on cp22 is WARNING: NTP WARNING: Offset -0.1104167402 secs [19:40:35] RECOVERY - cp22 NTP time on cp22 is OK: NTP OK: Offset -0.09556549788 secs [19:43:04] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.26, 7.31, 6.88 [19:46:04] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.41, 3.34, 2.83 [19:48:01] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.08, 3.34, 2.88 [19:49:59] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.20, 2.85, 2.75 [19:54:34] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 4.99, 6.09, 6.60 [20:04:13] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.55, 7.34, 6.90 [20:06:13] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 13.57, 9.24, 7.60 [20:12:13] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.50, 7.45, 7.38 [20:18:08] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 6.89, 5.53, 3.78 [20:19:15] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 13.33, 7.16, 4.40 [20:26:08] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.75, 3.35, 3.46 [20:27:05] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.52, 3.92, 3.88 [20:30:08] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.23, 2.86, 3.25 [20:30:14] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.83, 7.53, 7.20 [20:32:13] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.66, 7.30, 7.17 [20:33:04] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.61, 2.54, 3.25 [20:36:13] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 12.99, 8.24, 7.46 [20:37:04] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 7.68, 4.67, 3.88 [20:38:13] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.67, 7.32, 7.21 [20:39:01] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.56, 3.56, 3.34 [20:40:57] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.87, 3.28, 3.27 [20:41:04] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.04, 3.69, 3.69 [20:42:13] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.47, 6.28, 6.79 [20:43:04] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.57, 4.49, 3.98 [20:44:50] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.87, 3.92, 3.53 [20:45:04] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.07, 3.87, 3.81 [20:46:13] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 5.93, 6.99, 7.03 [20:46:45] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.47, 3.27, 3.34 [20:51:03] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.19, 3.42, 3.53 [20:52:34] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.06, 4.24, 3.74 [20:53:04] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.41, 3.22, 3.43 [20:55:04] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.32, 3.35, 3.44 [20:56:13] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 11.37, 8.20, 7.43 [20:57:04] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.21, 2.73, 3.19 [21:00:13] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.63, 8.00, 7.59 [21:05:04] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.93, 3.63, 3.40 [21:06:08] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.30, 3.30, 3.89 [21:07:04] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.29, 3.15, 3.26 [21:08:08] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 6.80, 4.86, 4.41 [21:12:08] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.27, 3.59, 3.97 [21:14:13] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.45, 6.19, 6.64 [21:16:34] PROBLEM - cp22 NTP time on cp22 is WARNING: NTP WARNING: Offset 0.1854599118 secs [21:17:04] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.42, 3.81, 3.45 [21:20:08] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.93, 2.78, 3.37 [21:21:04] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.97, 3.73, 3.53 [21:22:35] RECOVERY - cp22 NTP time on cp22 is OK: NTP OK: Offset 0.08479377627 secs [21:23:03] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.31, 2.85, 3.23 [21:24:08] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.90, 3.51, 3.52 [21:26:08] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.35, 3.02, 3.34 [21:29:00] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.52, 6.99, 6.78 [21:30:55] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.69, 6.52, 6.62 [21:34:34] PROBLEM - cp22 NTP time on cp22 is WARNING: NTP WARNING: Offset -0.1249195337 secs [21:35:03] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 9.65, 5.45, 4.03 [21:38:35] RECOVERY - cp22 NTP time on cp22 is OK: NTP OK: Offset -0.09268051386 secs [21:43:03] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.42, 3.07, 3.44 [21:45:04] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.36, 2.89, 3.33 [21:50:00] [Grafana] FIRING: Some MediaWiki Appservers are running out of PHP-FPM workers. https://grafana.miraheze.org/d/GtxbP1Xnk?orgId=1 [21:55:04] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.16, 3.25, 3.22 [21:55:15] PROBLEM - cloud14 Puppet on cloud14 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[ulogd2] [21:56:34] PROBLEM - cp22 NTP time on cp22 is WARNING: NTP WARNING: Offset 0.1143960357 secs [22:00:40] PROBLEM - cp23 APT on cp23 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [22:01:04] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.21, 3.51, 3.36 [22:02:40] RECOVERY - cp23 APT on cp23 is OK: APT OK: 36 packages available for upgrade (0 critical updates). [22:03:04] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.35, 2.77, 3.11 [22:04:34] RECOVERY - cp22 NTP time on cp22 is OK: NTP OK: Offset 0.07448548079 secs [22:05:00] [Grafana] RESOLVED: PHP-FPM Worker Usage High https://grafana.miraheze.org/d/GtxbP1Xnk?orgId=1 [22:21:04] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.51, 3.08, 2.87 [22:23:15] RECOVERY - cloud14 Puppet on cloud14 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [22:26:21] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.33, 4.32, 3.44 [22:29:03] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.53, 3.23, 3.12 [22:30:12] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.63, 3.76, 3.44 [22:34:08] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.11, 2.95, 3.20 [22:37:04] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.93, 3.88, 3.37 [22:39:04] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.81, 4.65, 3.71 [22:43:03] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.56, 3.28, 3.40 [22:50:34] PROBLEM - cp22 NTP time on cp22 is WARNING: NTP WARNING: Offset 0.1022125185 secs [22:54:35] RECOVERY - cp22 NTP time on cp22 is OK: NTP OK: Offset 0.09918576479 secs [22:58:35] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.10, 7.31, 6.42 [23:00:30] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.82, 7.52, 6.61 [23:02:25] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 4.41, 6.40, 6.31 [23:23:04] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.87, 3.60, 2.94 [23:25:00] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.03, 3.94, 3.16 [23:26:56] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.23, 3.36, 3.04 [23:28:22] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.64, 3.57, 3.20 [23:30:20] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.99, 3.09, 3.07 [23:40:50] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.14, 6.71, 6.27 [23:40:52] PROBLEM - cp23 NTP time on cp23 is WARNING: NTP WARNING: Offset 0.1285857856 secs [23:42:45] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.81, 6.35, 6.19 [23:47:13] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.95, 3.81, 3.12 [23:47:52] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.07, 3.87, 3.29 [23:49:08] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.70, 3.67, 3.15 [23:49:49] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.02, 3.19, 3.11 [23:53:00] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 7.10, 4.82, 3.66 [23:58:47] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.93, 3.93, 3.62