[00:02:12] PROBLEM - cp23 APT on cp23 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [00:02:17] PROBLEM - swiftobject122 Disk Space on swiftobject122 is WARNING: DISK WARNING - free space: / 53766 MB (6% inode=83%); [00:03:27] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.00, 7.47, 7.17 [00:04:11] RECOVERY - cp23 APT on cp23 is OK: APT OK: 36 packages available for upgrade (0 critical updates). [00:04:32] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.57, 2.99, 3.33 [00:09:27] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.23, 7.45, 7.16 [00:11:27] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 5.45, 6.66, 6.91 [00:13:27] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.86, 7.61, 7.23 [00:16:57] PROBLEM - en.religiononfire.mar.in.ua - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - en.religiononfire.mar.in.ua All nameservers failed to answer the query. [00:17:00] PROBLEM - cp22 Current Load on cp22 is CRITICAL: CRITICAL - load average: 5.85, 3.67, 2.03 [00:17:21] PROBLEM - cp22 APT on cp22 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [00:17:27] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.99, 7.87, 7.46 [00:18:54] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.00, 10.42, 11.57 [00:19:00] RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 1.50, 2.91, 1.97 [00:19:20] RECOVERY - cp22 APT on cp22 is OK: APT OK: 36 packages available for upgrade (0 critical updates). [00:19:27] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.48, 8.20, 7.62 [00:22:57] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 9.27, 5.04, 3.79 [00:26:49] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.31, 3.74, 3.58 [00:27:27] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.98, 7.96, 7.87 [00:28:45] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.69, 3.01, 3.32 [00:29:27] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.06, 8.32, 8.03 [00:31:00] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.95, 10.14, 11.78 [00:33:00] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.84, 11.27, 11.97 [00:33:15] PROBLEM - os141 Current Load on os141 is WARNING: WARNING - load average: 3.83, 3.03, 2.25 [00:33:27] PROBLEM - db142 Current Load on db142 is WARNING: WARNING - load average: 6.96, 5.52, 3.76 [00:34:04] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.29, 3.77, 3.16 [00:35:00] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.03, 10.87, 11.74 [00:35:15] RECOVERY - os141 Current Load on os141 is OK: OK - load average: 2.94, 3.00, 2.34 [00:35:27] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 5.68, 5.80, 4.09 [00:35:28] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.26, 7.57, 7.86 [00:37:27] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 11.26, 8.44, 8.10 [00:39:00] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 14.10, 11.88, 11.90 [00:39:28] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.90, 7.92, 7.97 [00:40:54] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.26, 11.45, 10.95 [00:41:14] PROBLEM - os141 Current Load on os141 is WARNING: WARNING - load average: 2.44, 3.66, 2.92 [00:42:04] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.97, 3.77, 3.47 [00:42:54] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.58, 11.63, 11.11 [00:44:04] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.87, 3.17, 3.29 [00:45:13] RECOVERY - os141 Current Load on os141 is OK: OK - load average: 1.99, 2.99, 2.83 [00:46:54] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.32, 11.30, 11.02 [00:49:28] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.24, 7.35, 7.55 [00:50:04] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 3.78, 4.18, 3.66 [00:50:54] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.81, 11.93, 11.40 [00:53:27] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.74, 7.32, 7.50 [00:54:04] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.77, 3.64, 3.56 [00:56:54] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.30, 11.29, 11.18 [00:57:27] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.59, 7.30, 7.39 [00:58:04] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.89, 2.79, 3.24 [00:59:28] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.53, 6.81, 7.19 [01:00:54] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.54, 11.42, 11.33 [01:01:28] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.83, 7.58, 7.41 [01:03:27] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.28, 7.39, 7.36 [01:04:17] PROBLEM - cp32 NTP time on cp32 is WARNING: NTP WARNING: Offset 0.2930670977 secs [01:04:54] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.55, 11.62, 11.36 [01:05:27] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 12.52, 8.85, 7.88 [01:06:04] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.45, 3.92, 3.47 [01:07:27] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.77, 7.86, 7.63 [01:08:04] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.97, 3.50, 3.36 [01:08:54] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.19, 11.41, 11.38 [01:10:04] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.33, 3.06, 3.22 [01:11:27] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.79, 8.05, 7.71 [01:13:26] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.46, 3.46, 3.17 [01:15:26] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.51, 3.06, 3.05 [01:15:27] RECOVERY - en.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - en.religiononfire.mar.in.ua reverse DNS resolves to cp23.miraheze.org - CNAME OK [01:15:28] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.82, 7.74, 7.70 [01:18:54] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.56, 11.89, 11.60 [01:19:27] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.39, 7.75, 7.65 [01:20:17] RECOVERY - cp32 NTP time on cp32 is OK: NTP OK: Offset -0.02492150664 secs [01:21:27] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.70, 3.09, 3.00 [01:21:27] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.91, 7.70, 7.67 [01:23:28] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 10.96, 4.98, 3.64 [01:24:54] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.02, 11.64, 11.69 [01:25:27] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.78, 7.96, 7.72 [01:26:54] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.38, 11.77, 11.72 [01:27:28] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.43, 7.93, 7.76 [01:28:54] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.94, 11.38, 11.58 [01:31:26] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.19, 3.74, 3.78 [01:32:05] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.62, 3.81, 3.20 [01:35:13] PROBLEM - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - uk.religiononfire.mar.in.ua All nameservers failed to answer the query. [01:39:26] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 3.47, 4.07, 3.81 [01:39:27] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 4.28, 5.92, 6.79 [01:40:04] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.42, 3.72, 3.60 [01:42:08] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.98, 3.71, 3.21 [01:42:54] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.97, 11.82, 11.44 [01:43:26] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.24, 3.55, 3.66 [01:44:04] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.81, 4.16, 3.78 [01:44:54] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.94, 11.60, 11.42 [01:45:26] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.54, 4.04, 3.83 [01:46:08] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 2.56, 3.20, 3.12 [01:47:27] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.12, 3.85, 3.79 [01:47:27] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.18, 7.60, 7.15 [01:48:04] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.35, 3.65, 3.69 [01:50:04] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 6.76, 4.16, 3.83 [01:51:26] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 7.42, 4.31, 3.92 [01:54:04] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.71, 3.71, 3.75 [01:55:35] [Grafana] !sre FIRING: The mediawiki job queue has more than 2500 unclaimed jobs https://grafana.miraheze.org/d/GtxbP1Xnk?orgId=1 [01:56:54] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.57, 11.16, 11.25 [01:58:04] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.38, 3.70, 3.67 [01:58:54] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.31, 11.01, 11.20 [01:59:27] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.63, 7.97, 7.92 [02:02:04] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.82, 3.44, 3.57 [02:02:54] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.75, 11.81, 11.43 [02:03:27] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 11.28, 9.06, 8.31 [02:03:57] RECOVERY - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - uk.religiononfire.mar.in.ua reverse DNS resolves to cp23.miraheze.org - CNAME OK [02:04:04] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.40, 4.00, 3.78 [02:05:26] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.78, 2.79, 3.89 [02:06:04] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.62, 3.59, 3.66 [02:08:04] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.25, 4.07, 3.84 [02:08:49] [02mediawiki] 07AgentIsai opened pull request 03#14708: Update 1.40 to latest - 13https://github.com/miraheze/mediawiki/pull/14708 [02:10:04] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.32, 3.42, 3.63 [02:10:47] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.11, 3.51, 3.20 [02:11:26] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.64, 3.12, 3.64 [02:12:04] [02mediawiki] 07AgentIsai closed pull request 03#14708: Update 1.40 to latest - 13https://github.com/miraheze/mediawiki/pull/14708 [02:12:38] [02miraheze/mediawiki] 07AgentIsai created branch 03REL1_40_sync 13https://github.com/miraheze/mediawiki/commit/dab560fefdab1abcd5d497b1c3f3bd9e4e694e5e [02:12:39] [02mediawiki] 07AgentIsai created branch 03REL1_40_sync - 13https://github.com/miraheze/mediawiki [02:12:42] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.49, 3.49, 3.23 [02:13:26] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.82, 2.60, 3.39 [02:14:04] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.82, 3.01, 3.39 [02:14:38] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 2.90, 3.28, 3.19 [02:15:27] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.31, 7.36, 7.84 [02:17:26] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.97, 3.62, 3.63 [02:18:04] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.88, 3.28, 3.39 [02:18:14] [02mediawiki] 07AgentIsai reopened pull request 03#14708: Update 1.40 to latest - 13https://github.com/miraheze/mediawiki/pull/14708 [02:18:49] PROBLEM - cp33 APT on cp33 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [02:19:28] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 10.51, 8.47, 8.13 [02:21:12] [02mediawiki] 07AgentIsai labeled pull request 03#14432: Bump extensions/GlobalBlocking from `1061a15` to `0453d87` - 13https://github.com/miraheze/mediawiki/pull/14432 [02:21:18] [02mediawiki] 07AgentIsai labeled pull request 03#14445: Bump extensions/GrowthExperiments from `c8315ae` to `8f8c5a7` - 13https://github.com/miraheze/mediawiki/pull/14445 [02:21:22] RECOVERY - cp33 APT on cp33 is OK: APT OK: 36 packages available for upgrade (0 critical updates). [02:21:24] [02mediawiki] 07github-actions[bot] closed pull request 03#14432: Bump extensions/GlobalBlocking from `1061a15` to `0453d87` - 13https://github.com/miraheze/mediawiki/pull/14432 [02:21:27] [02miraheze/mediawiki] 07github-actions[bot] deleted branch 03dependabot/submodules/REL1_40/extensions/GlobalBlocking-0453d87 [02:21:27] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.53, 7.70, 7.89 [02:21:30] [02miraheze/mediawiki] 07github-actions[bot] pushed 031 commit to 03REL1_40 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/dab560fefdab...94f9dca5d315 [02:21:32] [02miraheze/mediawiki] 07dependabot[bot] 0394f9dca - Bump extensions/GlobalBlocking from `1061a15` to `0453d87` (#14432) [02:21:35] [02mediawiki] 07github-actions[bot] deleted branch 03dependabot/submodules/REL1_40/extensions/GlobalBlocking-0453d87 - 13https://github.com/miraheze/mediawiki [02:21:36] [02mediawiki] 07github-actions[bot] unlabeled pull request 03#14432: Bump extensions/GlobalBlocking from `1061a15` to `0453d87` - 13https://github.com/miraheze/mediawiki/pull/14432 [02:21:38] [02mediawiki] 07github-actions[bot] closed pull request 03#14445: Bump extensions/GrowthExperiments from `c8315ae` to `8f8c5a7` - 13https://github.com/miraheze/mediawiki/pull/14445 [02:21:41] [02miraheze/mediawiki] 07github-actions[bot] pushed 031 commit to 03REL1_40 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/94f9dca5d315...8405acc01f23 [02:21:42] [02miraheze/mediawiki] 07dependabot[bot] 038405acc - Bump extensions/GrowthExperiments from `c8315ae` to `8f8c5a7` (#14445) [02:21:45] [02miraheze/mediawiki] 07github-actions[bot] deleted branch 03dependabot/submodules/REL1_40/extensions/GrowthExperiments-8f8c5a7 [02:21:48] [02mediawiki] 07github-actions[bot] deleted branch 03dependabot/submodules/REL1_40/extensions/GrowthExperiments-8f8c5a7 - 13https://github.com/miraheze/mediawiki [02:21:49] [02mediawiki] 07github-actions[bot] unlabeled pull request 03#14445: Bump extensions/GrowthExperiments from `c8315ae` to `8f8c5a7` - 13https://github.com/miraheze/mediawiki/pull/14445 [02:22:04] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.56, 2.69, 3.14 [02:22:41] [02mediawiki] 07AgentIsai labeled pull request 03#14517: Bump extensions/CentralNotice from `d9f1f94` to `aa81183` - 13https://github.com/miraheze/mediawiki/pull/14517 [02:22:46] [02mediawiki] 07AgentIsai labeled pull request 03#14564: Bump extensions/GrowthExperiments from `c8315ae` to `11de633` - 13https://github.com/miraheze/mediawiki/pull/14564 [02:22:49] [02mediawiki] 07AgentIsai labeled pull request 03#14584: Bump extensions/CheckUser from `a50f0c0` to `92a7018` - 13https://github.com/miraheze/mediawiki/pull/14584 [02:22:51] [02mediawiki] 07AgentIsai labeled pull request 03#14589: Bump extensions/FlaggedRevs from `409e565` to `4392882` - 13https://github.com/miraheze/mediawiki/pull/14589 [02:22:56] [02mediawiki] 07github-actions[bot] closed pull request 03#14517: Bump extensions/CentralNotice from `d9f1f94` to `aa81183` - 13https://github.com/miraheze/mediawiki/pull/14517 [02:22:59] [02miraheze/mediawiki] 07github-actions[bot] pushed 031 commit to 03REL1_40 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/8405acc01f23...c6f1d7687e55 [02:23:01] [02miraheze/mediawiki] 07dependabot[bot] 03c6f1d76 - Bump extensions/CentralNotice from `d9f1f94` to `aa81183` (#14517) [02:23:03] [02mediawiki] 07AgentIsai labeled pull request 03#14694: Bump extensions/PageTriage from `fbf0c42` to `495fc24` - 13https://github.com/miraheze/mediawiki/pull/14694 [02:23:05] [02miraheze/mediawiki] 07github-actions[bot] deleted branch 03dependabot/submodules/REL1_40/extensions/CentralNotice-aa81183 [02:23:07] [02mediawiki] 07github-actions[bot] deleted branch 03dependabot/submodules/REL1_40/extensions/CentralNotice-aa81183 - 13https://github.com/miraheze/mediawiki [02:23:09] [02mediawiki] 07github-actions[bot] unlabeled pull request 03#14517: Bump extensions/CentralNotice from `d9f1f94` to `aa81183` - 13https://github.com/miraheze/mediawiki/pull/14517 [02:23:10] [02mediawiki] 07github-actions[bot] closed pull request 03#14584: Bump extensions/CheckUser from `a50f0c0` to `92a7018` - 13https://github.com/miraheze/mediawiki/pull/14584 [02:23:13] [02miraheze/mediawiki] 07github-actions[bot] deleted branch 03dependabot/submodules/REL1_40/extensions/CheckUser-92a7018 [02:23:14] [02mediawiki] 07github-actions[bot] deleted branch 03dependabot/submodules/REL1_40/extensions/CheckUser-92a7018 - 13https://github.com/miraheze/mediawiki [02:23:15] [02miraheze/mediawiki] 07github-actions[bot] pushed 031 commit to 03REL1_40 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/c6f1d7687e55...b376addcaf75 [02:23:17] [02miraheze/mediawiki] 07dependabot[bot] 03b376add - Bump extensions/CheckUser from `a50f0c0` to `92a7018` (#14584) [02:23:20] [02mediawiki] 07github-actions[bot] unlabeled pull request 03#14584: Bump extensions/CheckUser from `a50f0c0` to `92a7018` - 13https://github.com/miraheze/mediawiki/pull/14584 [02:23:23] [02mediawiki] 07github-actions[bot] closed pull request 03#14589: Bump extensions/FlaggedRevs from `409e565` to `4392882` - 13https://github.com/miraheze/mediawiki/pull/14589 [02:23:24] [02miraheze/mediawiki] 07github-actions[bot] pushed 031 commit to 03REL1_40 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/b376addcaf75...5a280101550f [02:23:26] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 6.66, 3.81, 3.58 [02:23:26] [02miraheze/mediawiki] 07dependabot[bot] 035a28010 - Bump extensions/FlaggedRevs from `409e565` to `4392882` (#14589) [02:23:28] [02miraheze/mediawiki] 07github-actions[bot] deleted branch 03dependabot/submodules/REL1_40/extensions/FlaggedRevs-4392882 [02:23:30] [02mediawiki] 07github-actions[bot] deleted branch 03dependabot/submodules/REL1_40/extensions/FlaggedRevs-4392882 - 13https://github.com/miraheze/mediawiki [02:23:31] [02mediawiki] 07github-actions[bot] unlabeled pull request 03#14589: Bump extensions/FlaggedRevs from `409e565` to `4392882` - 13https://github.com/miraheze/mediawiki/pull/14589 [02:23:32] [02mediawiki] 07github-actions[bot] closed pull request 03#14694: Bump extensions/PageTriage from `fbf0c42` to `495fc24` - 13https://github.com/miraheze/mediawiki/pull/14694 [02:23:34] [02miraheze/mediawiki] 07github-actions[bot] pushed 031 commit to 03REL1_40 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/5a280101550f...9e21e9fa8585 [02:23:37] [02miraheze/mediawiki] 07dependabot[bot] 039e21e9f - Bump extensions/PageTriage from `fbf0c42` to `495fc24` (#14694) [02:23:40] [02miraheze/mediawiki] 07github-actions[bot] deleted branch 03dependabot/submodules/REL1_40/extensions/PageTriage-495fc24 [02:23:43] [02mediawiki] 07github-actions[bot] deleted branch 03dependabot/submodules/REL1_40/extensions/PageTriage-495fc24 - 13https://github.com/miraheze/mediawiki [02:23:45] [02mediawiki] 07github-actions[bot] unlabeled pull request 03#14694: Bump extensions/PageTriage from `fbf0c42` to `495fc24` - 13https://github.com/miraheze/mediawiki/pull/14694 [02:23:47] [02mediawiki] 07AgentIsai closed pull request 03#14564: Bump extensions/GrowthExperiments from `c8315ae` to `11de633` - 13https://github.com/miraheze/mediawiki/pull/14564 [02:23:50] [02mediawiki] 07dependabot[bot] commented on pull request 03#14564: Bump extensions/GrowthExperiments from `c8315ae` to `11de633` - 13https://github.com/miraheze/mediawiki/pull/14564#issuecomment-1536988721 [02:23:52] [02mediawiki] 07AgentIsai unlabeled pull request 03#14564: Bump extensions/GrowthExperiments from `c8315ae` to `11de633` - 13https://github.com/miraheze/mediawiki/pull/14564 [02:23:53] [02mediawiki] 07dependabot[bot] deleted branch 03dependabot/submodules/REL1_40/extensions/GrowthExperiments-11de633 - 13https://github.com/miraheze/mediawiki [02:23:56] [02miraheze/mediawiki] 07dependabot[bot] deleted branch 03dependabot/submodules/REL1_40/extensions/GrowthExperiments-11de633 [02:25:48] !log [agent@test131] starting deploy of {'config': True} to all [02:25:49] !log [agent@test131] finished deploy of {'config': True} to all - SUCCESS in 0s [02:25:57] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:26:04] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.50, 3.25, 3.26 [02:26:10] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:26:18] !log [agent@test131] starting deploy of {'world': True, 'l10n': True} to all [02:26:27] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:27:27] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 11.16, 8.14, 7.90 [02:28:04] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.68, 3.19, 3.25 [02:29:26] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.11, 3.60, 3.64 [02:30:35] [Grafana] !sre RESOLVED: High Job Queue Backlog https://grafana.miraheze.org/d/GtxbP1Xnk?orgId=1 [02:33:27] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 5.80, 7.22, 7.65 [02:34:04] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.74, 3.48, 3.45 [02:35:26] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.03, 3.69, 3.65 [02:35:27] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 16.96, 9.61, 8.39 [02:36:04] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.13, 3.80, 3.56 [02:37:26] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.26, 3.54, 3.60 [02:38:04] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.72, 3.40, 3.44 [02:39:27] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.81, 7.78, 7.87 [02:40:04] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.88, 2.87, 3.24 [02:40:50] !log [agent@test131] finished deploy of {'world': True, 'l10n': True} to all - SUCCESS in 872s [02:40:54] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:41:28] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.70, 8.23, 8.01 [02:42:08] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.44, 3.26, 3.10 [02:43:26] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.49, 2.71, 3.25 [02:44:08] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 3.08, 3.17, 3.09 [02:45:27] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.91, 7.77, 7.86 [02:57:27] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.69, 7.51, 7.54 [02:58:17] PROBLEM - cp32 NTP time on cp32 is WARNING: NTP WARNING: Offset 0.3780141771 secs [02:59:27] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.64, 7.08, 7.35 [03:00:38] PROBLEM - db112 Backups SQL on db112 is CRITICAL: FILE_AGE CRITICAL: /var/log/sql-backup.log is 1209634 seconds old and 363 bytes [03:00:44] PROBLEM - db112 Backups SQL on db112 is CRITICAL: FILE_AGE CRITICAL: /var/log/sql-backup.log is 1209641 seconds old and 363 bytes [03:03:02] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 21.25, 9.70, 5.44 [03:04:21] PROBLEM - cp33 APT on cp33 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [03:05:27] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.29, 7.37, 7.31 [03:06:20] RECOVERY - cp33 APT on cp33 is OK: APT OK: 36 packages available for upgrade (0 critical updates). [03:06:54] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.12, 10.28, 11.94 [03:07:27] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.05, 6.73, 7.08 [03:08:47] PROBLEM - wiki.zulaclub.net - LetsEncrypt on sslhost is CRITICAL: connect to address wiki.zulaclub.net and port 443: Network is unreachableHTTP CRITICAL - Unable to open TCP socket [03:08:54] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.30, 10.93, 11.96 [03:10:54] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.71, 10.42, 11.68 [03:11:27] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.36, 6.19, 6.79 [03:17:27] PROBLEM - en.religiononfire.mar.in.ua - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query en.religiononfire.mar.in.ua. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [03:18:54] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.22, 9.73, 10.69 [03:22:16] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.68, 7.00, 6.91 [03:22:17] RECOVERY - cp32 NTP time on cp32 is OK: NTP OK: Offset -0.009298413992 secs [03:22:54] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.63, 10.33, 10.79 [03:24:14] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 6.45, 6.65, 6.78 [03:24:16] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.98, 3.23, 3.90 [03:24:54] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.49, 11.46, 11.15 [03:26:12] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.14, 3.61, 3.97 [03:26:54] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.55, 11.44, 11.18 [03:28:08] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.92, 2.99, 3.70 [03:29:00] [02mediawiki] 07wmfgerrit synchronize pull request 03#14708: Update 1.40 to latest - 13https://github.com/miraheze/mediawiki/pull/14708 [03:30:54] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.15, 11.60, 11.29 [03:31:34] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.48, 4.48, 3.60 [03:32:54] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.61, 10.98, 11.08 [03:33:55] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.77, 3.04, 3.41 [03:34:54] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 17.55, 13.03, 11.79 [03:37:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.63, 7.64, 7.08 [03:38:04] RECOVERY - wiki.zulaclub.net - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.zulaclub.net' will expire on Fri 02 Jun 2023 14:39:28 GMT +0000. [03:39:46] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 5.45, 6.85, 6.86 [03:41:38] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.76, 3.90, 3.82 [03:41:43] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.63, 6.60, 6.77 [03:42:54] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.41, 11.57, 11.61 [03:43:22] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.43, 3.33, 3.78 [03:44:54] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.46, 11.80, 11.67 [03:45:30] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.50, 4.02, 3.83 [03:46:42] RECOVERY - en.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - en.religiononfire.mar.in.ua reverse DNS resolves to cp22.miraheze.org - CNAME OK [03:46:54] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.87, 11.78, 11.68 [03:47:26] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.38, 3.66, 3.72 [03:50:27] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 10.38, 7.84, 7.08 [03:51:14] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.96, 2.60, 3.30 [03:52:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 5.75, 7.03, 6.87 [03:53:26] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 8.73, 5.32, 4.32 [03:54:08] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.60, 3.23, 2.83 [03:54:22] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 6.61, 6.75, 6.78 [03:55:27] PROBLEM - db142 Current Load on db142 is CRITICAL: CRITICAL - load average: 8.09, 5.90, 3.34 [03:56:08] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 2.48, 2.90, 2.76 [03:57:00] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.30, 10.46, 11.86 [03:57:27] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 1.96, 4.57, 3.18 [03:58:14] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.80, 7.29, 6.99 [04:00:11] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.15, 7.63, 7.15 [04:02:54] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.31, 10.19, 10.56 [04:04:06] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.14, 7.05, 7.03 [04:05:00] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.08, 10.95, 11.42 [04:06:54] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.68, 11.02, 10.93 [04:07:26] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.62, 2.88, 3.94 [04:07:33] PROBLEM - ns1 NTP time on ns1 is WARNING: NTP WARNING: Offset 0.1174916327 secs [04:10:54] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.61, 11.18, 10.95 [04:12:54] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.01, 11.03, 10.92 [04:15:26] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.03, 2.54, 3.33 [04:19:44] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.54, 7.40, 7.17 [04:21:42] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.50, 7.53, 7.25 [04:23:33] RECOVERY - ns1 NTP time on ns1 is OK: NTP OK: Offset 0.09109988809 secs [04:30:54] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.80, 12.08, 11.45 [04:36:54] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.00, 10.76, 11.13 [04:38:54] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.16, 11.51, 11.37 [04:39:27] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.68, 6.23, 6.70 [04:43:27] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.64, 7.79, 7.25 [04:45:27] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.02, 7.35, 7.14 [04:48:17] PROBLEM - cp32 NTP time on cp32 is WARNING: NTP WARNING: Offset -0.1047335863 secs [04:49:27] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.00, 7.49, 7.19 [04:50:17] PROBLEM - swiftobject122 Disk Space on swiftobject122 is CRITICAL: DISK CRITICAL - free space: / 53362 MB (5% inode=83%); [04:51:27] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 5.94, 6.92, 7.02 [04:52:17] RECOVERY - cp32 NTP time on cp32 is OK: NTP OK: Offset -0.09163594246 secs [04:53:28] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 4.96, 6.20, 6.74 [04:54:54] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.91, 11.64, 12.00 [04:55:26] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.33, 3.63, 2.98 [04:56:54] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.18, 11.99, 12.08 [04:57:26] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.72, 3.96, 3.21 [04:58:54] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.77, 11.66, 11.96 [04:59:26] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.97, 3.26, 3.04 [05:01:04] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.24, 3.29, 2.66 [05:03:27] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.07, 7.74, 7.17 [05:04:54] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 16.03, 12.49, 12.04 [05:05:00] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.70, 3.71, 2.97 [05:05:27] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 5.33, 6.63, 6.82 [05:06:08] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.91, 3.37, 2.84 [05:06:58] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 6.10, 4.50, 3.33 [05:07:28] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 6.21, 6.55, 6.77 [05:08:56] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.24, 3.65, 3.16 [05:10:08] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.31, 3.67, 3.06 [05:10:54] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.60, 3.40, 3.13 [05:12:08] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.85, 3.81, 3.20 [05:16:54] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.40, 11.85, 11.99 [05:18:54] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.99, 12.56, 12.24 [05:20:08] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 3.14, 3.37, 3.24 [05:21:27] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.76, 7.15, 6.98 [05:23:27] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.86, 6.57, 6.78 [05:26:08] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.80, 3.43, 3.28 [05:27:27] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.11, 7.02, 6.91 [05:30:08] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 3.22, 3.34, 3.28 [05:31:27] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.93, 7.75, 7.17 [05:33:27] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.87, 7.36, 7.10 [05:37:22] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.04, 3.61, 3.10 [05:38:56] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.41, 3.79, 3.48 [05:39:20] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 3.21, 3.22, 3.01 [05:39:27] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.48, 7.35, 7.10 [05:41:27] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.66, 7.53, 7.21 [05:44:42] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.36, 3.98, 3.72 [05:46:31] PROBLEM - cp33 APT on cp33 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [05:48:29] RECOVERY - cp33 APT on cp33 is OK: APT OK: 36 packages available for upgrade (0 critical updates). [05:50:54] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.28, 10.51, 11.89 [05:51:27] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 10.31, 7.81, 7.29 [05:52:54] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.01, 11.02, 11.91 [05:55:27] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.73, 7.48, 7.28 [05:56:19] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 3.20, 4.06, 3.13 [05:58:15] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.76, 3.23, 2.94 [06:06:08] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.04, 3.49, 3.47 [06:09:27] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.33, 7.02, 7.00 [06:11:27] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.20, 6.97, 6.98 [06:12:08] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.94, 3.95, 3.71 [06:13:27] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.50, 7.50, 7.14 [06:17:28] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.15, 7.26, 7.17 [06:19:27] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.51, 8.06, 7.49 [06:20:30] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.87, 3.42, 2.71 [06:21:27] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.27, 7.62, 7.41 [06:22:26] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.75, 3.78, 2.92 [06:22:54] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.92, 10.16, 11.47 [06:23:27] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.30, 7.74, 7.46 [06:24:21] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.99, 3.54, 2.94 [06:25:27] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.29, 7.57, 7.43 [06:26:08] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.68, 4.01, 3.78 [06:26:17] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.40, 4.56, 3.39 [06:28:13] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.00, 3.57, 3.16 [06:30:09] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.77, 2.96, 2.98 [06:32:54] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.60, 10.91, 11.13 [06:35:00] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.30, 10.75, 11.88 [06:38:54] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.64, 11.75, 11.51 [06:40:54] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.67, 11.84, 11.56 [06:41:00] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 17.60, 13.13, 12.41 [06:46:54] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.76, 11.84, 11.73 [06:49:27] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.36, 7.24, 7.09 [06:53:27] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.68, 7.39, 7.21 [06:57:00] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.45, 10.72, 11.90 [07:00:08] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.41, 3.71, 3.94 [07:03:27] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 6.03, 6.35, 6.78 [07:04:54] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.29, 11.44, 10.96 [07:05:00] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.24, 11.50, 11.69 [07:07:00] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.80, 11.34, 11.62 [07:10:08] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.36, 4.06, 3.98 [07:11:00] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 16.60, 12.90, 12.11 [07:11:27] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.05, 6.85, 6.85 [07:13:27] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 6.22, 6.62, 6.76 [07:17:27] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.81, 7.46, 7.07 [07:22:54] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.41, 11.70, 11.87 [07:23:27] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.65, 6.42, 6.75 [07:28:54] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 14.54, 11.82, 11.70 [07:42:54] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.42, 11.22, 11.82 [07:50:54] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.25, 11.22, 11.50 [07:51:51] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.39, 7.11, 6.74 [07:52:54] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.74, 11.12, 11.41 [07:58:54] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 15.38, 12.29, 11.76 [07:59:40] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.15, 7.37, 6.92 [08:01:38] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.12, 7.25, 6.93 [08:04:08] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 1.57, 3.07, 3.90 [08:05:01] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.37, 11.29, 11.97 [08:08:08] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 1.54, 2.23, 3.36 [08:09:00] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.72, 12.33, 12.21 [08:15:27] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.77, 8.26, 7.48 [08:19:01] PROBLEM - alphabirdswiki.gq - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'alphabirdswiki.gq' expires in 15 day(s) (Mon 22 May 2023 08:08:58 GMT +0000). [08:19:24] PROBLEM - redkrayolawiki.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'redkrayolawiki.org' expires in 15 day(s) (Mon 22 May 2023 08:13:15 GMT +0000). [08:20:24] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/0127d132cfd0...34d542258f48 [08:20:25] [02miraheze/ssl] 07MirahezeSSLBot 0334d5422 - Bot: Update SSL cert for alphabirdswiki.gq [08:23:34] PROBLEM - yoshipedia.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'yoshipedia.com' expires in 15 day(s) (Mon 22 May 2023 08:00:15 GMT +0000). [08:26:44] PROBLEM - wiki.yunachannel.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.yunachannel.com' expires in 15 day(s) (Mon 22 May 2023 08:07:19 GMT +0000). [08:27:57] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/34d542258f48...0992472240ba [08:28:00] [02miraheze/ssl] 07MirahezeSSLBot 030992472 - Bot: Update SSL cert for redkrayolawiki.org [08:31:12] PROBLEM - wizardia.wiki - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wizardia.wiki' expires in 15 day(s) (Mon 22 May 2023 08:19:58 GMT +0000). [08:31:35] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/0992472240ba...79689b53379f [08:31:38] [02miraheze/ssl] 07MirahezeSSLBot 0379689b5 - Bot: Update SSL cert for yoshipedia.com [08:37:25] PROBLEM - petparents.ga - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'petparents.ga' expires in 15 day(s) (Mon 22 May 2023 08:15:42 GMT +0000). [08:38:56] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/79689b53379f...9280cea99f24 [08:38:59] [02miraheze/ssl] 07MirahezeSSLBot 039280cea - Bot: Update SSL cert for wizardia.wiki [08:43:37] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/9280cea99f24...4a131c37f3ce [08:43:38] [02miraheze/ssl] 07MirahezeSSLBot 034a131c3 - Bot: Update SSL cert for petparents.ga [08:45:28] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.35, 7.30, 7.87 [08:46:29] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/4a131c37f3ce...d024aa60ea23 [08:46:30] [02miraheze/ssl] 07MirahezeSSLBot 03d024aa6 - Bot: Update SSL cert for wiki.yunachannel.com [08:47:10] PROBLEM - wows.wiki - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wows.wiki' expires in 15 day(s) (Mon 22 May 2023 08:24:27 GMT +0000). [08:47:35] PROBLEM - db101 Backups SQL on db101 is WARNING: FILE_AGE WARNING: /var/log/sql-backup.log is 864169 seconds old and 1753 bytes [08:48:30] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/d024aa60ea23...d79ce9aa957b [08:48:31] [02miraheze/ssl] 07MirahezeSSLBot 03d79ce9a - Bot: Update SSL cert for wows.wiki [08:52:37] RECOVERY - yoshipedia.com - LetsEncrypt on sslhost is OK: OK - Certificate 'yoshipedia.com' will expire on Fri 04 Aug 2023 07:31:28 GMT +0000. [08:54:54] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.81, 10.63, 11.79 [08:59:27] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 4.44, 5.70, 6.77 [09:00:23] RECOVERY - wizardia.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'wizardia.wiki' will expire on Fri 04 Aug 2023 07:38:48 GMT +0000. [09:02:54] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.27, 11.12, 11.43 [09:06:51] RECOVERY - petparents.ga - LetsEncrypt on sslhost is OK: OK - Certificate 'petparents.ga' will expire on Fri 04 Aug 2023 07:43:30 GMT +0000. [09:07:00] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.56, 10.91, 11.75 [09:09:00] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.36, 11.31, 11.78 [09:10:54] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.31, 11.99, 11.78 [09:12:54] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.42, 12.46, 12.00 [09:15:51] RECOVERY - wows.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'wows.wiki' will expire on Fri 04 Aug 2023 07:48:23 GMT +0000. [09:17:05] RECOVERY - alphabirdswiki.gq - LetsEncrypt on sslhost is OK: OK - Certificate 'alphabirdswiki.gq' will expire on Fri 04 Aug 2023 07:20:14 GMT +0000. [09:18:12] RECOVERY - redkrayolawiki.org - LetsEncrypt on sslhost is OK: OK - Certificate 'redkrayolawiki.org' will expire on Fri 04 Aug 2023 07:27:51 GMT +0000. [09:18:54] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.76, 11.62, 11.81 [09:23:00] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.82, 11.40, 11.92 [09:25:09] RECOVERY - wiki.yunachannel.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.yunachannel.com' will expire on Fri 04 Aug 2023 07:46:21 GMT +0000. [09:27:00] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.32, 11.43, 11.78 [09:28:34] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 8.24, 5.00, 2.47 [09:29:00] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.83, 10.69, 11.44 [09:32:34] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.31, 3.04, 2.26 [09:34:54] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 14.68, 11.44, 11.17 [09:38:54] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.20, 11.37, 11.23 [09:41:00] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 15.51, 12.55, 11.59 [09:45:00] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.20, 11.23, 11.30 [09:48:54] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.02, 10.55, 10.65 [09:50:54] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.69, 9.95, 10.40 [09:51:00] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.43, 8.90, 10.20 [09:54:54] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 9.17, 9.69, 10.20 [10:06:54] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.75, 10.86, 10.31 [10:08:11] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.14, 6.70, 5.71 [10:09:15] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.20, 12.11, 10.81 [10:10:08] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 6.04, 6.25, 5.65 [10:11:44] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+1/-0/±1] 13https://github.com/miraheze/ssl/compare/d79ce9aa957b...e76a4c5e4528 [10:11:46] [02miraheze/ssl] 07MirahezeSSLBot 03e76a4c5 - Bot: Add SSL cert for null-cpu.emudev.org [10:13:47] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+1/-0/±1] 13https://github.com/miraheze/ssl/compare/e76a4c5e4528...5343974372dc [10:13:50] [02miraheze/ssl] 07MirahezeSSLBot 035343974 - Bot: Add SSL cert for wiki.coolstation.space [10:14:18] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+1/-0/±1] 13https://github.com/miraheze/ssl/compare/5343974372dc...04de25b072f7 [10:14:19] [02miraheze/ssl] 07MirahezeSSLBot 0304de25b - Bot: Add SSL cert for internalwiki.coolstation.space [10:14:54] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.88, 9.72, 10.12 [10:16:37] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+1/-0/±1] 13https://github.com/miraheze/ssl/compare/04de25b072f7...8e9893cb4dd1 [10:16:38] [02miraheze/ssl] 07MirahezeSSLBot 038e9893c - Bot: Add SSL cert for wiki.kirbygang.com [10:18:54] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.29, 11.99, 10.96 [10:20:54] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.75, 11.35, 10.87 [10:21:00] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.90, 11.23, 11.21 [10:21:43] !log reception@mwtask141:~$ sudo -u www-data php swiftdump.php --wiki intercriaturaswiki [10:21:48] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [10:34:43] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.97, 12.34, 11.44 [10:36:41] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.08, 10.94, 11.05 [10:36:48] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.48, 8.87, 10.12 [10:46:33] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.64, 10.56, 10.34 [10:48:31] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.71, 10.88, 10.46 [10:50:08] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.77, 7.59, 6.18 [10:50:29] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.16, 11.10, 10.60 [10:52:24] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.47, 9.67, 10.16 [10:54:25] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.66, 11.64, 10.88 [10:55:02] PROBLEM - cp22 NTP time on cp22 is WARNING: NTP WARNING: Offset 0.2074718177 secs [10:56:02] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 4.85, 6.27, 6.10 [10:57:53] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.39, 3.72, 2.24 [10:58:21] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.70, 11.27, 10.95 [10:59:53] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.19, 3.47, 2.35 [11:01:53] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.10, 2.64, 2.18 [11:02:17] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 6.74, 8.89, 10.04 [11:03:01] RECOVERY - cp22 NTP time on cp22 is OK: NTP OK: Offset 0.01602062583 secs [11:12:04] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.55, 10.79, 10.22 [11:17:58] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.11, 11.76, 10.77 [11:19:56] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.80, 11.52, 10.80 [11:24:45] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.38, 10.77, 9.83 [11:25:50] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.70, 11.66, 11.03 [11:27:48] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.14, 10.81, 10.80 [11:29:46] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.00, 12.01, 11.25 [11:31:44] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.47, 11.87, 11.31 [11:32:36] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.78, 10.65, 10.35 [11:37:37] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.25, 11.66, 11.33 [11:38:30] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 9.28, 9.88, 10.15 [11:39:35] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.02, 11.08, 11.14 [11:41:33] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.02, 11.43, 11.25 [11:43:31] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.27, 10.64, 10.98 [11:51:23] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 14.12, 11.83, 11.29 [11:52:10] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.56, 11.67, 10.70 [11:56:06] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.79, 11.81, 11.03 [11:57:17] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.53, 11.57, 11.43 [12:03:54] PROBLEM - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query mar.in.ua. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [12:04:04] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 18.40, 13.24, 11.57 [12:07:16] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 17.54, 13.25, 11.93 [12:28:12] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.49, 6.43, 6.02 [12:30:10] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.70, 6.12, 5.96 [12:33:29] RECOVERY - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - uk.religiononfire.mar.in.ua reverse DNS resolves to cp23.miraheze.org - CNAME OK [12:50:04] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.32, 11.42, 11.92 [12:56:48] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.05, 3.09, 2.41 [12:58:04] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.06, 10.76, 11.21 [12:58:46] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 0.99, 2.27, 2.19 [12:59:01] PROBLEM - cp22 NTP time on cp22 is WARNING: NTP WARNING: Offset 0.1368280053 secs [13:00:04] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.92, 11.38, 11.40 [13:02:04] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.37, 11.70, 11.51 [13:05:16] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.55, 11.21, 11.88 [13:07:16] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.27, 11.80, 12.02 [13:08:04] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.19, 11.87, 11.70 [13:09:01] RECOVERY - cp22 NTP time on cp22 is OK: NTP OK: Offset 0.08782145381 secs [13:14:04] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 11.79, 12.13, 11.85 [13:20:04] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.82, 11.92, 11.86 [13:24:04] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.42, 12.08, 11.93 [13:24:28] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 6.65, 3.86, 2.55 [13:28:59] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 9.47, 5.00, 2.69 [13:30:57] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 2.27, 3.73, 2.51 [13:32:23] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.01, 3.92, 3.24 [13:32:55] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.13, 2.82, 2.32 [13:33:52] PROBLEM - cp33 NTP time on cp33 is WARNING: NTP WARNING: Offset 0.1623910367 secs [13:36:20] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.31, 6.58, 6.19 [13:36:21] PROBLEM - matomo121 Current Load on matomo121 is WARNING: WARNING - load average: 3.91, 3.28, 2.87 [13:38:18] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.37, 6.40, 6.19 [13:38:19] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.23, 3.02, 3.04 [13:38:21] RECOVERY - matomo121 Current Load on matomo121 is OK: OK - load average: 2.59, 2.96, 2.80 [13:44:10] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.13, 7.13, 6.54 [13:45:29] PROBLEM - db142 Current Load on db142 is WARNING: WARNING - load average: 7.71, 5.70, 3.40 [13:48:06] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 5.73, 6.81, 6.58 [13:49:29] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 1.62, 4.38, 3.49 [13:53:52] RECOVERY - cp33 NTP time on cp33 is OK: NTP OK: Offset 0.07528468966 secs [13:54:00] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.41, 6.29, 6.44 [13:59:04] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.02, 3.87, 3.22 [14:00:30] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 4.13, 3.58, 2.31 [14:01:02] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.24, 2.84, 2.91 [14:02:00] [Grafana] FIRING: Some MediaWiki Appservers are running out of PHP-FPM workers. https://grafana.miraheze.org/d/GtxbP1Xnk?orgId=1 [14:02:28] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.86, 2.86, 2.20 [14:12:00] [Grafana] RESOLVED: PHP-FPM Worker Usage High https://grafana.miraheze.org/d/GtxbP1Xnk?orgId=1 [14:12:18] PROBLEM - cloud12 Puppet on cloud12 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[ulogd2] [14:15:34] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.93, 8.01, 6.94 [14:17:32] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.81, 7.73, 6.95 [14:19:29] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.94, 8.14, 7.20 [14:21:27] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.94, 7.73, 7.16 [14:25:23] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.29, 6.33, 6.71 [14:26:47] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 8.24, 6.22, 4.04 [14:31:15] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.55, 6.85, 6.83 [14:32:43] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.11, 3.77, 3.61 [14:33:13] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 6.21, 6.65, 6.76 [14:34:41] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.54, 4.45, 3.90 [14:36:40] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.98, 3.48, 3.60 [14:40:14] PROBLEM - os141 Current Load on os141 is CRITICAL: CRITICAL - load average: 5.33, 3.18, 1.74 [14:40:18] RECOVERY - cloud12 Puppet on cloud12 is OK: OK: Puppet is currently enabled, last run 46 seconds ago with 0 failures [14:40:37] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.89, 2.89, 3.31 [14:42:13] RECOVERY - os141 Current Load on os141 is OK: OK - load average: 1.28, 2.51, 1.68 [14:43:18] PROBLEM - en.religiononfire.mar.in.ua - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query en.religiononfire.mar.in.ua. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [14:46:16] PROBLEM - matomo121 Current Load on matomo121 is CRITICAL: CRITICAL - load average: 4.06, 3.42, 2.99 [14:47:52] PROBLEM - cp33 NTP time on cp33 is WARNING: NTP WARNING: Offset -0.1096430123 secs [14:48:16] PROBLEM - matomo121 Current Load on matomo121 is WARNING: WARNING - load average: 3.56, 3.55, 3.09 [14:50:16] RECOVERY - matomo121 Current Load on matomo121 is OK: OK - load average: 2.59, 3.25, 3.04 [14:52:18] PROBLEM - cp33 APT on cp33 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [14:54:15] PROBLEM - matomo121 Current Load on matomo121 is WARNING: WARNING - load average: 3.36, 3.44, 3.18 [14:54:26] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.93, 3.57, 3.27 [14:56:14] RECOVERY - matomo121 Current Load on matomo121 is OK: OK - load average: 2.60, 3.21, 3.13 [14:56:25] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.99, 4.58, 3.69 [14:57:15] RECOVERY - cp33 APT on cp33 is OK: APT OK: 36 packages available for upgrade (0 critical updates). [14:59:46] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.49, 8.41, 7.20 [15:02:21] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.17, 3.25, 3.44 [15:03:46] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 5.43, 7.57, 7.18 [15:03:52] RECOVERY - cp33 NTP time on cp33 is OK: NTP OK: Offset -0.08556467295 secs [15:04:19] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.11, 2.64, 3.20 [15:09:46] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.99, 7.45, 7.17 [15:11:46] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.06, 7.19, 7.13 [15:17:46] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.08, 6.19, 6.72 [15:21:46] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.83, 7.38, 7.07 [15:23:46] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 5.96, 6.70, 6.85 [15:24:04] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.94, 3.85, 3.25 [15:25:46] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.35, 6.41, 6.74 [15:26:02] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.67, 3.85, 3.33 [15:28:01] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.19, 3.95, 3.42 [15:29:37] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.75, 3.47, 2.93 [15:30:00] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.78, 3.11, 3.17 [15:31:36] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.44, 3.69, 3.07 [15:33:30] [Grafana] FIRING: Some MediaWiki Appservers are running out of PHP-FPM workers. https://grafana.miraheze.org/d/GtxbP1Xnk?orgId=1 [15:33:46] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.36, 7.15, 6.88 [15:35:46] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 4.12, 6.06, 6.51 [15:39:32] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.63, 3.51, 3.58 [15:40:17] PROBLEM - db142 Current Load on db142 is CRITICAL: CRITICAL - load average: 9.90, 7.07, 4.90 [15:42:15] PROBLEM - os141 Current Load on os141 is CRITICAL: CRITICAL - load average: 5.04, 3.27, 1.93 [15:43:30] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.91, 2.70, 3.23 [15:44:13] RECOVERY - os141 Current Load on os141 is OK: OK - load average: 1.82, 2.71, 1.89 [15:44:15] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 2.85, 5.95, 5.05 [15:48:30] [Grafana] RESOLVED: PHP-FPM Worker Usage High https://grafana.miraheze.org/d/GtxbP1Xnk?orgId=1 [15:50:34] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.97, 8.03, 7.00 [15:52:32] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 5.43, 7.07, 6.77 [15:54:30] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.19, 6.43, 6.57 [15:56:46] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.37, 3.50, 3.11 [15:58:45] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.88, 3.11, 3.04 [16:03:26] PROBLEM - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - uk.religiononfire.mar.in.ua All nameservers failed to answer the query. [16:11:08] RECOVERY - en.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - en.religiononfire.mar.in.ua reverse DNS resolves to cp22.miraheze.org - CNAME OK [16:21:29] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 223.49, 224.87, 98.01 [16:22:06] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.97, 4.43, 3.41 [16:25:54] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.23, 6.69, 6.23 [16:27:52] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 6.24, 6.50, 6.22 [16:30:03] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.56, 3.36, 3.34 [16:31:46] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.80, 6.87, 6.48 [16:31:55] PROBLEM - matomo121 Current Load on matomo121 is WARNING: WARNING - load average: 3.87, 3.43, 3.00 [16:33:01] RECOVERY - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - uk.religiononfire.mar.in.ua reverse DNS resolves to cp22.miraheze.org - CNAME OK [16:33:46] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.87, 6.41, 6.35 [16:35:54] PROBLEM - matomo121 Current Load on matomo121 is CRITICAL: CRITICAL - load average: 4.53, 3.80, 3.22 [16:37:46] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.35, 7.25, 6.78 [16:39:46] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.36, 8.21, 7.20 [16:39:53] PROBLEM - matomo121 Current Load on matomo121 is WARNING: WARNING - load average: 3.03, 3.55, 3.27 [16:41:46] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 5.95, 7.54, 7.09 [16:41:53] RECOVERY - matomo121 Current Load on matomo121 is OK: OK - load average: 2.59, 3.27, 3.20 [16:42:07] PROBLEM - mw121 MediaWiki Rendering on mw121 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 5903 bytes in 0.011 second response time [16:42:18] PROBLEM - cloud12 Puppet on cloud12 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[ulogd2] [16:46:52] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.81, 4.02, 3.39 [16:48:52] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.35, 3.54, 3.30 [16:49:51] PROBLEM - matomo121 Current Load on matomo121 is CRITICAL: CRITICAL - load average: 4.32, 3.59, 3.32 [16:50:51] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.75, 2.94, 3.11 [16:51:51] PROBLEM - matomo121 Current Load on matomo121 is WARNING: WARNING - load average: 3.71, 3.67, 3.39 [16:53:46] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.42, 6.49, 6.80 [16:56:34] RECOVERY - mw121 MediaWiki Rendering on mw121 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 8.130 second response time [16:57:49] RECOVERY - matomo121 Current Load on matomo121 is OK: OK - load average: 3.21, 3.36, 3.34 [17:10:18] RECOVERY - cloud12 Puppet on cloud12 is OK: OK: Puppet is currently enabled, last run 48 seconds ago with 0 failures [17:10:41] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.17, 3.79, 3.08 [17:14:41] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.95, 3.47, 3.14 [17:16:41] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 6.52, 4.67, 3.62 [17:17:29] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.52, 7.47, 6.85 [17:20:00] [Grafana] FIRING: Some MediaWiki Appservers are running out of PHP-FPM workers. https://grafana.miraheze.org/d/GtxbP1Xnk?orgId=1 [17:21:29] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.42, 6.72, 6.71 [17:22:41] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.79, 3.72, 3.69 [17:26:41] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.71, 2.76, 3.31 [17:28:14] PROBLEM - db142 Current Load on db142 is WARNING: WARNING - load average: 7.33, 6.19, 3.78 [17:30:00] [Grafana] RESOLVED: PHP-FPM Worker Usage High https://grafana.miraheze.org/d/GtxbP1Xnk?orgId=1 [17:30:13] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 3.36, 5.30, 3.77 [17:36:08] PROBLEM - db142 Current Load on db142 is WARNING: WARNING - load average: 7.19, 7.12, 5.08 [17:36:38] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.85, 2.56, 3.83 [17:38:07] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 2.43, 5.40, 4.70 [17:38:41] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.12, 3.85, 3.45 [17:40:41] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.79, 3.84, 3.52 [17:42:34] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.72, 3.09, 3.57 [17:42:41] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.26, 3.84, 3.54 [17:44:33] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.86, 2.71, 3.38 [17:44:41] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.72, 3.02, 3.28 [18:04:41] PROBLEM - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query uk.religiononfire.mar.in.ua. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [18:22:17] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 5.43, 6.85, 6.42 [18:24:15] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.31, 6.40, 6.30 [18:32:05] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 10.16, 7.92, 6.88 [18:34:02] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 4.90, 6.70, 6.56 [18:34:16] PROBLEM - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - uk.religiononfire.mar.in.ua All nameservers failed to answer the query. [18:38:00] [Grafana] FIRING: Some MediaWiki Appservers are running out of PHP-FPM workers. https://grafana.miraheze.org/d/GtxbP1Xnk?orgId=1 [18:43:00] [Grafana] RESOLVED: PHP-FPM Worker Usage High https://grafana.miraheze.org/d/GtxbP1Xnk?orgId=1 [18:58:00] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 9.07, 5.47, 3.76 [19:02:37] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.84, 4.76, 3.61 [19:03:50] PROBLEM - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query mar.in.ua. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [19:13:51] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.81, 3.31, 3.87 [19:19:48] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.64, 4.08, 3.99 [19:21:10] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.96, 7.36, 6.75 [19:21:47] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.22, 3.87, 3.93 [19:23:08] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.37, 6.42, 6.47 [19:25:46] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.41, 4.37, 4.10 [19:27:44] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.56, 3.80, 3.91 [19:30:20] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.43, 1.98, 3.81 [19:33:25] PROBLEM - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - uk.religiononfire.mar.in.ua All nameservers failed to answer the query. [19:33:41] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.93, 2.62, 3.37 [19:34:18] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.53, 2.67, 3.62 [19:36:16] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.33, 2.66, 3.52 [19:38:15] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.35, 2.48, 3.35 [19:41:01] PROBLEM - en.religiononfire.mar.in.ua - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - en.religiononfire.mar.in.ua All nameservers failed to answer the query. [19:44:46] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 11.07, 8.03, 6.96 [19:48:42] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 5.32, 6.98, 6.80 [19:52:38] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.33, 7.80, 7.13 [19:56:34] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 5.84, 7.34, 7.15 [20:02:28] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.07, 6.07, 6.62 [20:02:59] RECOVERY - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - uk.religiononfire.mar.in.ua reverse DNS resolves to cp22.miraheze.org - CNAME OK [20:10:16] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.36, 6.89, 6.87 [20:10:18] RECOVERY - en.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - en.religiononfire.mar.in.ua reverse DNS resolves to cp22.miraheze.org - CNAME OK [20:16:10] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.46, 6.19, 6.64 [20:21:08] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 6.97, 5.91, 4.85 [20:22:02] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.17, 8.88, 7.71 [20:23:08] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 6.70, 6.22, 5.10 [20:23:41] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.05, 3.90, 3.02 [20:25:40] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.25, 3.34, 2.93 [20:29:54] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.46, 7.62, 7.71 [20:34:31] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.89, 4.14, 3.37 [20:36:30] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.68, 3.44, 3.21 [20:37:06] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.20, 3.28, 2.57 [20:38:29] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.75, 2.94, 3.05 [20:39:46] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.91, 5.96, 6.75 [20:45:02] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.43, 3.89, 3.49 [20:49:00] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.30, 3.34, 3.39 [21:12:22] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.07, 6.88, 6.48 [21:16:18] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.32, 6.51, 6.46 [21:31:00] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 5.99, 7.14, 6.76 [21:32:58] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.02, 6.55, 6.59 [21:33:34] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.74, 3.88, 3.23 [21:35:33] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.48, 3.36, 3.12 [21:42:04] PROBLEM - en.religiononfire.mar.in.ua - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - en.religiononfire.mar.in.ua All nameservers failed to answer the query. [21:43:28] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.40, 3.78, 3.38 [21:44:04] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.99, 11.26, 11.96 [21:47:26] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.36, 3.14, 3.22 [21:54:04] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.95, 11.09, 11.18 [21:56:04] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.21, 10.22, 10.85 [21:58:04] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.00, 11.26, 11.15 [22:00:30] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.62, 7.14, 6.49 [22:02:28] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.68, 6.86, 6.46 [22:04:26] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 4.96, 6.16, 6.25 [22:06:14] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.34, 3.75, 3.34 [22:10:12] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.95, 3.59, 3.39 [22:11:21] PROBLEM - en.religiononfire.mar.in.ua - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query mar.in.ua. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [22:12:11] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.18, 3.17, 3.26 [22:14:04] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.06, 10.50, 11.69 [22:16:04] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.21, 11.15, 11.78 [22:18:04] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.35, 10.39, 11.45 [22:21:16] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.82, 10.32, 11.88 [22:22:05] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.91, 3.61, 3.27 [22:27:16] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.10, 11.50, 11.83 [22:29:16] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.62, 10.71, 11.50 [22:30:01] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.72, 3.92, 3.64 [22:31:16] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.38, 11.85, 11.85 [22:32:00] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 3.30, 4.03, 3.74 [22:33:16] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.48, 11.14, 11.60 [22:34:04] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.14, 10.92, 10.69 [22:35:16] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.92, 11.87, 11.80 [22:35:58] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.12, 3.51, 3.59 [22:37:16] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.57, 10.91, 11.45 [22:38:04] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.87, 11.52, 11.01 [22:41:16] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 15.23, 13.43, 12.35 [22:41:55] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.06, 3.05, 3.37 [22:42:04] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.20, 11.69, 11.20 [22:44:04] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.19, 11.52, 11.22 [22:45:16] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 7.75, 11.32, 11.81 [22:48:04] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.67, 11.61, 11.29 [22:54:04] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.82, 11.83, 11.61 [22:54:32] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 7.10, 4.05, 2.82 [22:58:30] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.30, 3.64, 2.92 [22:58:30] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 3.93, 2.81, 1.63 [23:00:22] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.53, 7.54, 6.78 [23:00:29] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 13.04, 5.38, 2.64 [23:00:45] PROBLEM - cp23 APT on cp23 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [23:02:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.91, 7.38, 6.83 [23:02:28] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 30.03, 14.58, 7.10 [23:02:44] RECOVERY - cp23 APT on cp23 is OK: APT OK: 36 packages available for upgrade (0 critical updates). [23:03:16] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.47, 10.09, 10.58 [23:03:42] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 3.77, 4.03, 3.42 [23:04:04] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 16.28, 12.51, 11.63 [23:04:26] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.13, 3.13, 2.35 [23:07:16] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.47, 10.52, 10.67 [23:08:15] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.26, 7.14, 6.88 [23:09:16] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.08, 11.08, 10.83 [23:09:38] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.21, 3.89, 3.61 [23:10:12] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.91, 6.54, 6.68 [23:13:36] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 3.00, 3.17, 3.37 [23:17:34] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.59, 3.81, 3.57 [23:18:17] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.09, 2.43, 3.89 [23:19:33] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.26, 3.57, 3.50 [23:21:32] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.72, 3.10, 3.33 [23:22:04] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.40, 11.50, 11.97 [23:24:04] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 11.77, 11.88, 12.06 [23:24:14] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.64, 3.77, 3.97 [23:25:30] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.12, 3.61, 3.48 [23:26:04] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.20, 11.21, 11.77 [23:26:12] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.88, 3.02, 3.67 [23:27:29] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.09, 3.20, 3.36 [23:30:10] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.47, 2.20, 3.20 [23:33:24] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.25, 3.75, 3.55 [23:34:04] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 17.11, 12.55, 11.96 [23:37:22] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.06, 2.97, 3.29 [23:43:29] PROBLEM - db142 Current Load on db142 is WARNING: WARNING - load average: 7.13, 4.87, 2.75 [23:46:04] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.99, 11.14, 11.97 [23:47:29] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 4.00, 5.66, 3.66 [23:48:17] PROBLEM - cp23 NTP time on cp23 is WARNING: NTP WARNING: Offset 0.1092016399 secs [23:56:04] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 14.41, 11.50, 11.57 [23:58:04] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.59, 10.52, 11.22