[00:01:22] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 2.85, 3.57, 2.25 [00:03:34] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.28, 4.21, 3.76 [00:05:14] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 0.60, 2.56, 2.20 [00:07:26] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.96, 3.76, 3.68 [00:10:28] PROBLEM - cp32 NTP time on cp32 is WARNING: NTP WARNING: Offset 0.3385260999 secs [00:11:20] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 3.91, 4.18, 3.88 [00:13:20] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.44, 3.75, 3.74 [00:17:25] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.46, 3.13, 2.72 [00:19:20] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.11, 2.95, 3.39 [00:19:25] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 6.09, 4.39, 3.24 [00:21:25] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.54, 3.68, 3.12 [00:23:18] PROBLEM - db142 Current Load on db142 is WARNING: WARNING - load average: 7.52, 6.13, 4.24 [00:23:25] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.62, 3.85, 3.23 [00:25:18] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 2.81, 4.72, 3.94 [00:29:18] PROBLEM - db142 Current Load on db142 is CRITICAL: CRITICAL - load average: 8.29, 6.73, 4.92 [00:29:24] PROBLEM - os141 Current Load on os141 is WARNING: WARNING - load average: 3.81, 3.45, 2.71 [00:31:18] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 6.40, 6.29, 4.97 [00:31:19] RECOVERY - os141 Current Load on os141 is OK: OK - load average: 3.32, 3.28, 2.73 [00:32:28] RECOVERY - cp32 NTP time on cp32 is OK: NTP OK: Offset -0.01612171531 secs [00:38:06] PROBLEM - db142 Current Load on db142 is CRITICAL: CRITICAL - load average: 10.80, 8.71, 6.44 [00:38:07] PROBLEM - os141 Current Load on os141 is CRITICAL: CRITICAL - load average: 5.48, 4.57, 3.47 [00:39:25] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.11, 3.85, 4.00 [00:41:25] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.63, 3.95, 4.00 [00:43:25] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.58, 3.44, 3.81 [00:44:38] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.56, 3.58, 3.21 [00:45:43] PROBLEM - db142 Current Load on db142 is WARNING: WARNING - load average: 3.72, 7.05, 6.82 [00:45:48] PROBLEM - os141 Current Load on os141 is WARNING: WARNING - load average: 2.64, 3.96, 3.72 [00:46:34] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.16, 3.06, 3.06 [00:47:37] PROBLEM - db142 Current Load on db142 is CRITICAL: CRITICAL - load average: 8.59, 8.13, 7.25 [00:47:44] PROBLEM - os141 Current Load on os141 is CRITICAL: CRITICAL - load average: 4.78, 4.42, 3.92 [00:49:31] PROBLEM - db142 Current Load on db142 is WARNING: WARNING - load average: 5.77, 7.44, 7.11 [00:49:40] PROBLEM - os141 Current Load on os141 is WARNING: WARNING - load average: 3.01, 3.75, 3.73 [00:50:27] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.33, 3.49, 3.26 [00:53:19] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 4.51, 6.15, 6.69 [00:54:19] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.71, 3.39, 3.29 [00:55:24] RECOVERY - os141 Current Load on os141 is OK: OK - load average: 2.67, 2.95, 3.35 [00:57:25] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.09, 3.15, 3.37 [00:59:18] PROBLEM - db142 Current Load on db142 is CRITICAL: CRITICAL - load average: 9.68, 7.68, 7.15 [00:59:20] PROBLEM - os141 Current Load on os141 is CRITICAL: CRITICAL - load average: 5.99, 4.52, 3.90 [00:59:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.56, 7.25, 7.85 [01:00:27] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 3.41, 3.14, 1.91 [01:01:25] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 4.00, 3.76, 3.57 [01:02:26] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.22, 2.49, 1.82 [01:03:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 13.52, 9.42, 8.51 [01:03:25] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 6.98, 4.48, 3.82 [01:07:25] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.08, 3.82, 3.77 [01:11:25] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.50, 3.68, 3.67 [01:13:25] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.79, 2.89, 3.38 [01:15:18] PROBLEM - os141 Current Load on os141 is WARNING: WARNING - load average: 1.00, 2.98, 3.90 [01:15:18] PROBLEM - db142 Current Load on db142 is WARNING: WARNING - load average: 1.91, 5.78, 7.50 [01:17:18] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 0.93, 4.27, 6.75 [01:19:18] RECOVERY - os141 Current Load on os141 is OK: OK - load average: 0.78, 1.67, 3.14 [01:19:37] PROBLEM - swiftobject121 APT on swiftobject121 is WARNING: APT WARNING: 0 packages available for upgrade (0 critical updates). warnings detected, errors detected. [01:21:40] PROBLEM - swiftobject121 APT on swiftobject121 is CRITICAL: APT CRITICAL: 52 packages available for upgrade (7 critical updates). [01:21:49] [02miraheze/.github] 07The-Voidwalker pushed 031 commit to 03patch-reusableWorkflows [+1/-1/±0] 13https://github.com/miraheze/.github/commit/9e40bbc9c787 [01:21:51] [02miraheze/.github] 07The-Voidwalker 039e40bbc - change to re-usable test [01:21:53] [02.github] 07The-Voidwalker created branch 03patch-reusableWorkflows - 13https://github.com/miraheze/.github [01:22:03] [02.github] 07The-Voidwalker opened pull request 03#32: change to re-usable test - 13https://github.com/miraheze/.github/pull/32 [01:23:12] PROBLEM - cp23 APT on cp23 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [01:25:15] RECOVERY - cp23 APT on cp23 is OK: APT OK: 34 packages available for upgrade (0 critical updates). [01:25:20] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.68, 5.01, 3.90 [01:25:25] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 9.61, 6.82, 4.57 [01:29:04] PROBLEM - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query mar.in.ua. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [01:29:20] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.22, 3.53, 3.56 [01:30:26] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 2.77, 3.71, 2.50 [01:31:20] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.63, 3.06, 3.39 [01:31:25] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.39, 3.83, 3.92 [01:32:26] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 0.63, 2.57, 2.22 [01:32:27] PROBLEM - wiki.albrusmusic.ru - reverse DNS on sslhost is WARNING: Timeout: The DNS operation timed out after 5.404748439788818 seconds [01:34:19] [02miraheze/.github] 07The-Voidwalker pushed 031 commit to 03patch-reusableWorkflows [+1/-0/±0] 13https://github.com/miraheze/.github/compare/9e40bbc9c787...54025e04c757 [01:34:20] [02miraheze/.github] 07The-Voidwalker 0354025e0 - add new default action [01:34:23] [02.github] 07The-Voidwalker synchronize pull request 03#32: change to re-usable test - 13https://github.com/miraheze/.github/pull/32 [01:35:25] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.02, 2.52, 3.34 [01:40:13] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 3.85, 4.03, 3.69 [01:42:09] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.63, 3.54, 3.55 [01:44:04] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.08, 3.42, 3.48 [01:45:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.72, 7.54, 7.99 [01:47:56] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.37, 3.29, 3.43 [01:49:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.61, 8.22, 8.16 [01:49:52] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.80, 3.00, 3.30 [01:52:10] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 6.71, 3.81, 3.20 [01:52:52] [02ManageWiki] 07The-Voidwalker created branch 03The-Voidwalker-patch-1 - 13https://github.com/miraheze/ManageWiki [01:52:53] [02miraheze/ManageWiki] 07The-Voidwalker pushed 031 commit to 03The-Voidwalker-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ManageWiki/commit/65eb8db3bf03 [01:52:56] [02miraheze/ManageWiki] 07The-Voidwalker 0365eb8db - testing alternative CI options [01:52:57] [02ManageWiki] 07The-Voidwalker opened pull request 03#411: testing alternative CI options - 13https://github.com/miraheze/ManageWiki/pull/411 [01:53:59] [02miraheze/ManageWiki] 07The-Voidwalker pushed 031 commit to 03The-Voidwalker-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ManageWiki/compare/65eb8db3bf03...2d427a9fab21 [01:54:00] [02miraheze/ManageWiki] 07The-Voidwalker 032d427a9 - Update mediawiki-tests.yml [01:54:01] [02ManageWiki] 07The-Voidwalker synchronize pull request 03#411: testing alternative CI options - 13https://github.com/miraheze/ManageWiki/pull/411 [01:55:18] [02miraheze/.github] 07The-Voidwalker pushed 031 commit to 03patch-reusableWorkflows [+0/-0/±1] 13https://github.com/miraheze/.github/compare/54025e04c757...87a834b228d3 [01:55:20] [02miraheze/.github] 07The-Voidwalker 0387a834b - spelling [01:55:23] [02.github] 07The-Voidwalker synchronize pull request 03#32: change to re-usable test - 13https://github.com/miraheze/.github/pull/32 [01:57:37] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.08, 3.58, 3.42 [01:57:37] RECOVERY - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - uk.religiononfire.mar.in.ua reverse DNS resolves to cp23.miraheze.org - CNAME OK [01:57:57] miraheze/ManageWiki - The-Voidwalker the build passed. [01:58:23] miraheze/ManageWiki - The-Voidwalker the build passed. [01:59:33] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.06, 3.04, 3.24 [01:59:36] miraheze/ManageWiki - The-Voidwalker the build passed. [02:01:10] RECOVERY - wiki.albrusmusic.ru - reverse DNS on sslhost is OK: SSL OK - wiki.albrusmusic.ru reverse DNS resolves to cp23.miraheze.org - CNAME OK [02:01:44] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.16, 3.40, 3.51 [02:04:20] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 7.49, 10.95, 5.79 [02:06:21] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.26, 3.78, 3.42 [02:07:29] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.14, 3.52, 3.53 [02:08:17] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.90, 3.85, 3.49 [02:08:20] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 1.38, 5.98, 4.95 [02:11:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.88, 7.26, 7.88 [02:11:25] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.62, 3.65, 3.62 [02:12:08] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.98, 2.95, 3.21 [02:13:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.17, 7.58, 7.91 [02:13:25] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 6.00, 4.45, 3.91 [02:14:10] [02miraheze/ManageWiki] 07The-Voidwalker pushed 031 commit to 03The-Voidwalker-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ManageWiki/compare/2d427a9fab21...ca4599ce3f7e [02:14:11] [02miraheze/ManageWiki] 07The-Voidwalker 03ca4599c - try different notification strategy [02:14:13] [02ManageWiki] 07The-Voidwalker synchronize pull request 03#411: testing alternative CI options - 13https://github.com/miraheze/ManageWiki/pull/411 [02:15:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.82, 7.75, 7.95 [02:15:25] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.77, 3.82, 3.75 [02:17:10] miraheze/ManageWiki - The-Voidwalker the build has errored. [02:17:25] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 3.54, 4.01, 3.85 [02:19:11] [02miraheze/ManageWiki] 07The-Voidwalker pushed 031 commit to 03The-Voidwalker-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ManageWiki/compare/ca4599ce3f7e...5a009179df73 [02:19:12] [02miraheze/ManageWiki] 07The-Voidwalker 035a00917 - modify spacing [02:19:14] [02ManageWiki] 07The-Voidwalker synchronize pull request 03#411: testing alternative CI options - 13https://github.com/miraheze/ManageWiki/pull/411 [02:19:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 10.27, 8.21, 8.04 [02:19:25] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.04, 3.73, 3.77 [02:25:25] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.22, 3.73, 3.69 [02:25:25] miraheze/ManageWiki - The-Voidwalker the build passed. [02:27:25] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.90, 3.00, 3.43 [02:27:36] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.15, 2.96, 2.77 [02:29:11] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 23.26, 8.44, 3.89 [02:29:31] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.29, 2.69, 2.70 [02:31:25] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 3.80, 4.04, 3.78 [02:32:31] [02miraheze/.github] 07The-Voidwalker pushed 032 commits to 03patch-reusableWorkflows [+0/-0/±3] 13https://github.com/miraheze/.github/compare/87a834b228d3...2c842e92f925 [02:32:32] [02miraheze/.github] 07The-Voidwalker 037ece506 - split tests into sections [02:32:34] [02miraheze/.github] 07The-Voidwalker 032c842e9 - Merge branch 'patch-reusableWorkflows' of https://github.com/miraheze/.github into patch-reusableWorkflows [02:32:36] [02.github] 07The-Voidwalker synchronize pull request 03#32: change to re-usable test - 13https://github.com/miraheze/.github/pull/32 [02:35:25] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.68, 3.78, 3.74 [02:36:56] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 0.58, 3.00, 3.26 [02:39:25] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.52, 2.81, 3.34 [02:40:13] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.76, 3.47, 3.17 [02:41:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 5.72, 7.11, 7.93 [02:42:09] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.65, 3.02, 3.03 [02:42:40] [02miraheze/.github] 07The-Voidwalker pushed 031 commit to 03patch-reusableWorkflows [+0/-0/±1] 13https://github.com/miraheze/.github/compare/2c842e92f925...b91fb44a90f1 [02:42:42] [02miraheze/.github] 07The-Voidwalker 03b91fb44 - remove localsettings at the start of each test [02:42:45] [02.github] 07The-Voidwalker synchronize pull request 03#32: change to re-usable test - 13https://github.com/miraheze/.github/pull/32 [02:44:09] [02miraheze/.github] 07The-Voidwalker pushed 031 commit to 03patch-reusableWorkflows [+0/-0/±1] 13https://github.com/miraheze/.github/compare/b91fb44a90f1...f62479709922 [02:44:10] [02miraheze/.github] 07The-Voidwalker 03f624797 - Revert "try using github-actions to push updates" [02:44:13] [02.github] 07The-Voidwalker synchronize pull request 03#32: change to re-usable test - 13https://github.com/miraheze/.github/pull/32 [02:44:51] PROBLEM - cloud12 Puppet on cloud12 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[ulogd2] [02:45:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 10.70, 8.10, 8.06 [02:45:25] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.95, 3.33, 3.32 [02:46:13] [02miraheze/.github] 07The-Voidwalker pushed 031 commit to 03patch-reusableWorkflows [+0/-0/±1] 13https://github.com/miraheze/.github/compare/f62479709922...bf92968e4f8c [02:46:15] [02miraheze/.github] 07The-Voidwalker 03bf92968 - don't try to sync for non-master changes [02:46:17] [02.github] 07The-Voidwalker synchronize pull request 03#32: change to re-usable test - 13https://github.com/miraheze/.github/pull/32 [02:47:22] [02miraheze/.github] 07The-Voidwalker deleted branch 03patch-reusableWorkflows [02:47:24] [02.github] 07The-Voidwalker closed pull request 03#32: change to re-usable test - 13https://github.com/miraheze/.github/pull/32 [02:47:25] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.93, 3.40, 3.36 [02:47:26] [02miraheze/.github] 07The-Voidwalker pushed 031 commit to 03master [+1/-0/±2] 13https://github.com/miraheze/.github/compare/fccd6bdfec74...89c4668a0e7b [02:47:27] [02miraheze/.github] 07The-Voidwalker 0389c4668 - change to re-usable test (#32) [02:47:29] [02.github] 07The-Voidwalker deleted branch 03patch-reusableWorkflows - 13https://github.com/miraheze/.github [02:53:11] [02miraheze/.github] 07The-Voidwalker pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/.github/compare/89c4668a0e7b...9ea6a1f48407 [02:53:12] [02miraheze/.github] 07The-Voidwalker 039ea6a1f - update to php 8.2 [02:53:27] [02miraheze/PDFEmbed] 07The-Voidwalker pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/PDFEmbed/compare/f9956a3f6806...95d4e0d53eeb [02:53:28] [02miraheze/PDFEmbed] 07The-Voidwalker 0395d4e0d - Update workflow [02:53:31] [02miraheze/CustomHeader] 07The-Voidwalker pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/CustomHeader/compare/b02cde412542...4a9cc2664409 [02:53:33] [02miraheze/CustomHeader] 07The-Voidwalker 034a9cc26 - Update workflow [02:53:34] [02miraheze/MirahezeMagic] 07The-Voidwalker pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/MirahezeMagic/compare/4918d473256b...98d525253637 [02:53:37] [02miraheze/MirahezeMagic] 07The-Voidwalker 0398d5252 - Update workflow [02:53:39] [02miraheze/YouTube] 07The-Voidwalker pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/YouTube/compare/d663901be2f4...d4124e928de0 [02:53:40] [02miraheze/YouTube] 07The-Voidwalker 03d4124e9 - Update workflow [02:53:41] [02miraheze/WikiDiscover] 07The-Voidwalker pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/WikiDiscover/compare/9a2877ccf3cf...8809c30b31f1 [02:53:44] [02miraheze/WikiDiscover] 07The-Voidwalker 038809c30 - Update workflow [02:53:45] [02miraheze/DataDump] 07The-Voidwalker pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/DataDump/compare/98d720a9cbf4...f089656664e9 [02:53:47] [02miraheze/DataDump] 07The-Voidwalker 03f089656 - Update workflow [02:53:50] [02miraheze/RottenLinks] 07The-Voidwalker pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/RottenLinks/compare/53432a9e9ef5...07ec9aa3d8f1 [02:53:52] [02miraheze/RottenLinks] 07The-Voidwalker 0307ec9aa - Update workflow [02:53:52] [02miraheze/RemovePII] 07The-Voidwalker pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/RemovePII/compare/10d663c5de46...84f03c952aa3 [02:53:55] [02miraheze/RemovePII] 07The-Voidwalker 0384f03c9 - Update workflow [02:53:58] [02miraheze/CreateWiki] 07The-Voidwalker pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/0cbd7911ed4c...d31ba34d924d [02:54:02] [02miraheze/CreateWiki] 07The-Voidwalker 03d31ba34 - Update workflow [02:54:04] [02miraheze/ManageWiki] 07The-Voidwalker pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ManageWiki/compare/0579c4ff6388...58efe058c46f [02:54:07] PROBLEM - cp23 APT on cp23 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [02:54:08] [02miraheze/ManageWiki] 07The-Voidwalker 0358efe05 - Update workflow [02:54:08] [02miraheze/MatomoAnalytics] 07The-Voidwalker pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/MatomoAnalytics/compare/606a54d40fb9...04caa63610d3 [02:54:09] [02miraheze/MatomoAnalytics] 07The-Voidwalker 0304caa63 - Update workflow [02:54:10] [02miraheze/GlobalNewFiles] 07The-Voidwalker pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/GlobalNewFiles/compare/1b3b98ea804a...55c9c4d6e603 [02:54:12] [02miraheze/GlobalNewFiles] 07The-Voidwalker 0355c9c4d - Update workflow [02:54:14] [02miraheze/SpriteSheet] 07The-Voidwalker pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/SpriteSheet/compare/2ffb9ba587c2...f87cf81af935 [02:54:14] [02miraheze/SpriteSheet] 07The-Voidwalker 03f87cf81 - Update workflow [02:54:17] [02miraheze/ImportDump] 07The-Voidwalker pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/ad9a5adf87d3...1abb19c39ee5 [02:54:20] [02miraheze/ImportDump] 07The-Voidwalker 031abb19c - Update workflow [02:54:23] [02miraheze/IncidentReporting] 07The-Voidwalker pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/IncidentReporting/compare/1ce0d96d6808...6e7f6a7dbeaa [02:54:24] [02miraheze/IncidentReporting] 07The-Voidwalker 036e7f6a7 - Update workflow [02:57:08] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.62, 3.58, 3.41 [02:59:03] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.26, 2.77, 3.14 [02:59:03] PROBLEM - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query uk.religiononfire.mar.in.ua. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [02:59:33] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.92, 3.32, 2.86 [02:59:57] miraheze/DataDump - The-Voidwalker the build passed. [03:00:17] miraheze/CustomHeader - The-Voidwalker the build passed. [03:00:32] miraheze/PDFEmbed - The-Voidwalker the build passed. [03:00:38] miraheze/WikiDiscover - The-Voidwalker the build passed. [03:01:06] miraheze/YouTube - The-Voidwalker the build passed. [03:02:04] RECOVERY - cp23 APT on cp23 is OK: APT OK: 34 packages available for upgrade (0 critical updates). [03:02:26] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 3.63, 4.02, 2.88 [03:03:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.56, 7.49, 7.93 [03:04:26] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.21, 2.92, 2.61 [03:04:48] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.50, 3.78, 3.53 [03:05:14] miraheze/RottenLinks - The-Voidwalker the build passed. [03:05:20] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.88, 4.18, 3.37 [03:07:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.46, 7.44, 7.77 [03:07:25] miraheze/ManageWiki - The-Voidwalker the build passed. [03:07:33] miraheze/MatomoAnalytics - The-Voidwalker the build passed. [03:09:54] PROBLEM - wiki.zulaclub.net - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.zulaclub.net All nameservers failed to answer the query. [03:10:10] miraheze/GlobalNewFiles - The-Voidwalker the build passed. [03:10:33] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.79, 2.90, 3.23 [03:10:51] RECOVERY - cloud12 Puppet on cloud12 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [03:11:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.21, 7.62, 7.78 [03:11:24] miraheze/SpriteSheet - The-Voidwalker the build passed. [03:12:25] miraheze/IncidentReporting - The-Voidwalker the build passed. [03:15:34] [02.github] 07The-Voidwalker commented on pull request 03#31: Add PHP 8.2 tests - 13https://github.com/miraheze/.github/pull/31#issuecomment-1588459210 [03:15:36] [02.github] 07The-Voidwalker closed pull request 03#31: Add PHP 8.2 tests - 13https://github.com/miraheze/.github/pull/31 [03:18:49] miraheze/MirahezeMagic - The-Voidwalker the build passed. [03:21:17] miraheze/RemovePII - The-Voidwalker the build passed. [03:21:20] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.15, 3.84, 3.98 [03:21:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.92, 7.52, 7.44 [03:22:01] miraheze/CreateWiki - The-Voidwalker the build passed. [03:23:20] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.28, 3.71, 3.90 [03:26:44] miraheze/ImportDump - The-Voidwalker the build passed. [03:27:20] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.45, 3.31, 3.72 [03:29:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.57, 7.71, 7.60 [03:30:44] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 22.97, 11.23, 5.30 [03:31:08] PROBLEM - cp23 APT on cp23 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [03:31:20] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.49, 2.47, 3.29 [03:31:30] PROBLEM - cp23 SSH on cp23 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [03:33:10] RECOVERY - cp23 APT on cp23 is OK: APT OK: 34 packages available for upgrade (0 critical updates). [03:33:26] RECOVERY - cp23 SSH on cp23 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [03:38:48] RECOVERY - wiki.zulaclub.net - reverse DNS on sslhost is OK: SSL OK - wiki.zulaclub.net reverse DNS resolves to cp22.miraheze.org - CNAME OK [03:41:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.52, 7.85, 7.52 [03:43:19] PROBLEM - polandballwiki.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for polandballwiki.com could not be found [03:44:26] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 3.06, 2.64, 3.88 [03:48:26] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 0.90, 2.04, 3.40 [03:50:57] PROBLEM - www.polandballwiki.com - LetsEncrypt on sslhost is CRITICAL: connect to address www.polandballwiki.com and port 443: Network is unreachableHTTP CRITICAL - Unable to open TCP socket [03:53:43] PROBLEM - www.polandballwiki.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for www.polandballwiki.com could not be found [03:53:46] PROBLEM - polandballwiki.com - LetsEncrypt on sslhost is CRITICAL: connect to address polandballwiki.com and port 443: Network is unreachableHTTP CRITICAL - Unable to open TCP socket [03:54:00] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.02, 3.43, 3.06 [03:55:56] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.59, 2.72, 2.84 [04:00:30] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 6.49, 5.45, 3.96 [04:02:26] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 1.73, 3.98, 3.60 [04:04:26] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 0.78, 2.86, 3.23 [04:05:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 4.93, 7.22, 7.79 [04:13:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.59, 7.97, 7.81 [04:17:32] PROBLEM - ping6 on cp33 is WARNING: PING WARNING - Packet loss = 0%, RTA = 122.97 ms [04:18:53] PROBLEM - ping6 on ns1 is WARNING: PING WARNING - Packet loss = 0%, RTA = 123.08 ms [04:18:55] PROBLEM - ping6 on cp32 is WARNING: PING WARNING - Packet loss = 0%, RTA = 122.78 ms [04:19:18] PROBLEM - db142 Current Load on db142 is WARNING: WARNING - load average: 7.93, 6.41, 3.43 [04:21:18] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 4.30, 5.63, 3.51 [04:23:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 5.49, 7.60, 7.86 [04:27:03] RECOVERY - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - uk.religiononfire.mar.in.ua reverse DNS resolves to cp23.miraheze.org - CNAME OK [04:29:06] PROBLEM - ping6 on cp32 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 122.68 ms [04:31:08] PROBLEM - ping6 on cp32 is WARNING: PING WARNING - Packet loss = 0%, RTA = 122.46 ms [04:31:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.08, 7.70, 7.65 [04:32:26] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 11.16, 5.50, 3.33 [04:36:26] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 0.47, 2.90, 2.78 [04:37:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 5.94, 7.22, 7.53 [04:47:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.03, 7.95, 7.56 [04:49:20] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.95, 4.06, 3.04 [04:55:20] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.89, 3.86, 3.38 [04:57:20] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.81, 4.34, 3.61 [04:59:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.96, 7.93, 7.98 [05:01:20] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.30, 3.57, 3.45 [05:01:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.45, 8.03, 8.01 [05:03:20] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.65, 3.16, 3.30 [05:03:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.09, 7.59, 7.84 [05:19:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.03, 7.74, 7.53 [05:23:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 5.80, 7.34, 7.48 [05:29:21] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 4.75, 5.69, 6.72 [05:30:29] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 6.80, 4.33, 2.31 [05:32:17] PROBLEM - cp23 APT on cp23 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [05:34:27] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 3.07, 3.90, 2.64 [05:34:32] RECOVERY - cp23 APT on cp23 is OK: APT OK: 34 packages available for upgrade (0 critical updates). [05:36:26] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.60, 3.08, 2.50 [05:38:17] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.19, 7.02, 6.93 [05:42:10] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 6.26, 6.37, 6.68 [05:51:55] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.38, 6.76, 6.61 [05:52:04] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.33, 11.14, 11.97 [05:58:04] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 14.32, 12.52, 12.21 [05:59:42] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.58, 6.66, 6.78 [06:00:27] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 12.21, 6.49, 3.36 [06:02:05] PROBLEM - cp23 APT on cp23 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [06:07:18] PROBLEM - db142 Current Load on db142 is CRITICAL: CRITICAL - load average: 8.40, 5.83, 3.24 [06:07:29] RECOVERY - cp23 APT on cp23 is OK: APT OK: 34 packages available for upgrade (0 critical updates). [06:09:18] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 6.08, 5.96, 3.62 [06:10:26] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 0.71, 2.95, 3.34 [06:15:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.61, 7.26, 6.84 [06:17:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 10.14, 8.63, 7.41 [06:21:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.23, 7.77, 7.32 [06:27:17] PROBLEM - cp23 APT on cp23 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [06:28:27] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 5.90, 4.83, 3.65 [06:29:17] RECOVERY - cp23 APT on cp23 is OK: APT OK: 34 packages available for upgrade (0 critical updates). [06:29:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.33, 7.95, 7.49 [06:31:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.60, 7.78, 7.49 [06:32:26] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.16, 3.36, 3.37 [06:34:04] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.62, 11.20, 12.00 [06:36:04] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.97, 11.48, 12.02 [06:37:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 10.68, 8.32, 7.69 [06:39:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.59, 7.87, 7.60 [06:40:04] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.97, 10.82, 11.64 [06:40:15] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.06, 11.03, 11.97 [06:41:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 7.68, 8.01, 7.69 [06:42:15] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 14.80, 12.88, 12.56 [06:44:04] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.31, 11.59, 11.77 [06:47:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.07, 7.93, 7.84 [06:52:04] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.83, 10.90, 11.71 [06:54:15] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.50, 10.43, 11.66 [06:54:40] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.82, 2.86, 2.15 [06:55:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 10.55, 7.79, 7.65 [06:56:04] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.25, 11.63, 11.79 [06:56:35] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.35, 2.30, 2.03 [06:57:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.72, 7.42, 7.54 [06:58:15] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 14.14, 12.59, 12.28 [07:01:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.21, 7.24, 7.38 [07:02:27] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 4.39, 5.02, 3.24 [07:03:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 5.93, 6.66, 7.15 [07:04:26] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 1.25, 3.63, 2.94 [07:06:26] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.29, 2.86, 2.74 [07:07:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.16, 7.27, 7.24 [07:11:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.88, 7.26, 7.25 [07:12:04] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.50, 10.66, 11.84 [07:13:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.36, 8.34, 7.67 [07:19:08] PROBLEM - swiftobject121 APT on swiftobject121 is WARNING: APT WARNING: 0 packages available for upgrade (0 critical updates). warnings detected, errors detected. [07:19:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.71, 7.87, 7.69 [07:21:10] PROBLEM - swiftobject121 APT on swiftobject121 is CRITICAL: APT CRITICAL: 52 packages available for upgrade (7 critical updates). [07:21:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.72, 8.16, 7.81 [07:22:04] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.15, 11.61, 11.63 [07:24:04] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.84, 11.45, 11.58 [07:29:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.39, 7.57, 7.80 [07:32:15] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.01, 10.59, 11.68 [07:33:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.03, 7.63, 7.74 [07:34:04] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.54, 11.43, 11.43 [07:34:15] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.30, 11.27, 11.78 [07:35:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 5.82, 6.89, 7.45 [07:36:04] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.36, 11.46, 11.44 [07:40:04] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.99, 11.42, 11.38 [07:41:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.91, 7.28, 7.30 [07:42:04] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.81, 10.29, 10.99 [07:44:04] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.64, 10.97, 11.13 [07:46:04] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.64, 11.02, 11.14 [07:46:58] RECOVERY - cloud11 IPMI Sensors on cloud11 is OK: IPMI Status: OK [07:47:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.64, 7.83, 7.62 [07:48:04] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 14.91, 12.22, 11.55 [07:50:58] PROBLEM - cloud11 IPMI Sensors on cloud11 is CRITICAL: IPMI Status: Critical [Cntlr 2 Bay 8 = Critical] [07:51:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.03, 8.40, 7.86 [07:52:04] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.73, 11.99, 11.65 [07:54:15] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.06, 10.95, 11.72 [07:57:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.44, 7.60, 7.66 [07:59:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.70, 7.93, 7.76 [08:01:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.63, 7.86, 7.76 [08:02:15] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 15.49, 11.78, 11.56 [08:03:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 14.57, 9.93, 8.50 [08:04:04] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 14.99, 11.86, 11.32 [08:06:15] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.53, 10.83, 11.30 [08:09:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 5.79, 6.99, 7.64 [08:10:15] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.94, 11.42, 11.36 [08:12:04] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.71, 11.90, 11.75 [08:13:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.63, 7.18, 7.49 [08:14:04] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 17.25, 13.70, 12.41 [08:18:40] PROBLEM - cp23 APT on cp23 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [08:19:42] PROBLEM - swiftobject121 APT on swiftobject121 is WARNING: APT WARNING: 0 packages available for upgrade (0 critical updates). warnings detected, errors detected. [08:21:27] RECOVERY - cp23 APT on cp23 is OK: APT OK: 34 packages available for upgrade (0 critical updates). [08:21:44] PROBLEM - swiftobject121 APT on swiftobject121 is CRITICAL: APT CRITICAL: 52 packages available for upgrade (7 critical updates). [08:25:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 5.17, 7.40, 7.89 [08:29:03] PROBLEM - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - uk.religiononfire.mar.in.ua All nameservers failed to answer the query. [08:31:04] RECOVERY - ping6 on cp32 is OK: PING OK - Packet loss = 0%, RTA = 113.08 ms [08:31:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.16, 6.77, 7.32 [08:31:29] RECOVERY - ping6 on cp33 is OK: PING OK - Packet loss = 0%, RTA = 103.00 ms [08:32:04] RECOVERY - ping6 on ns1 is OK: PING OK - Packet loss = 0%, RTA = 105.86 ms [08:35:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.71, 7.44, 7.47 [08:41:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.31, 7.72, 7.53 [08:43:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.85, 7.38, 7.43 [08:44:04] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.96, 11.39, 12.00 [08:46:04] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.06, 11.50, 11.96 [08:49:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.09, 7.96, 7.62 [08:50:00] PROBLEM - swiftobject121 APT on swiftobject121 is WARNING: APT WARNING: 0 packages available for upgrade (0 critical updates). warnings detected, errors detected. [08:51:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.79, 7.86, 7.63 [08:52:04] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.56, 11.51, 11.96 [08:53:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.76, 8.07, 7.72 [08:54:07] PROBLEM - swiftobject121 APT on swiftobject121 is CRITICAL: APT CRITICAL: 52 packages available for upgrade (7 critical updates). [08:57:37] RECOVERY - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - uk.religiononfire.mar.in.ua reverse DNS resolves to cp23.miraheze.org - CNAME OK [08:59:08] PROBLEM - cp23 APT on cp23 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [09:01:08] RECOVERY - cp23 APT on cp23 is OK: APT OK: 34 packages available for upgrade (0 critical updates). [09:01:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.10, 7.32, 7.61 [09:04:04] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.43, 11.71, 11.66 [09:04:15] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.36, 10.49, 11.74 [09:05:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.03, 7.12, 7.41 [09:06:04] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.80, 11.60, 11.64 [09:09:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.97, 7.20, 7.38 [09:10:15] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 14.65, 11.88, 11.88 [09:13:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.71, 7.49, 7.42 [09:15:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 5.75, 6.86, 7.20 [09:19:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.40, 6.81, 7.03 [09:20:15] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.61, 11.47, 11.83 [09:20:31] PROBLEM - ping6 on cp33 is WARNING: PING WARNING - Packet loss = 0%, RTA = 122.21 ms [09:21:08] PROBLEM - ping6 on ns1 is WARNING: PING WARNING - Packet loss = 0%, RTA = 121.46 ms [09:22:15] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.70, 12.22, 12.06 [09:22:30] RECOVERY - ping6 on cp33 is OK: PING OK - Packet loss = 0%, RTA = 103.46 ms [09:23:10] RECOVERY - ping6 on ns1 is OK: PING OK - Packet loss = 0%, RTA = 104.57 ms [09:23:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.61, 7.40, 7.24 [09:25:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.65, 8.05, 7.48 [09:26:15] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.63, 11.22, 11.68 [09:27:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.06, 7.69, 7.42 [09:28:15] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.26, 11.57, 11.72 [09:30:15] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.77, 11.61, 11.73 [09:30:33] PROBLEM - cp23 NTP time on cp23 is WARNING: NTP WARNING: Offset 0.1067584753 secs [09:32:04] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 15.23, 12.31, 11.53 [09:32:15] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.88, 12.03, 11.85 [09:33:21] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 4.91, 6.00, 6.79 [09:34:15] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.87, 11.95, 11.88 [09:36:15] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.26, 11.97, 11.89 [09:37:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.79, 7.56, 7.18 [09:44:04] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.06, 11.60, 11.87 [09:44:33] RECOVERY - cp23 NTP time on cp23 is OK: NTP OK: Offset 0.08883795142 secs [09:46:15] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.54, 11.19, 11.90 [09:49:45] PROBLEM - ping6 on ns1 is WARNING: PING WARNING - Packet loss = 0%, RTA = 123.90 ms [09:50:14] PROBLEM - ping6 on cp33 is WARNING: PING WARNING - Packet loss = 0%, RTA = 121.89 ms [09:50:28] PROBLEM - ping6 on cp32 is WARNING: PING WARNING - Packet loss = 0%, RTA = 122.71 ms [09:52:15] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.17, 11.15, 11.51 [09:52:30] RECOVERY - ping6 on cp32 is OK: PING OK - Packet loss = 0%, RTA = 113.77 ms [09:53:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.36, 7.91, 7.97 [09:53:50] RECOVERY - ping6 on ns1 is OK: PING OK - Packet loss = 0%, RTA = 104.64 ms [09:54:11] RECOVERY - ping6 on cp33 is OK: PING OK - Packet loss = 0%, RTA = 103.74 ms [09:54:15] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.58, 10.76, 11.32 [09:55:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.19, 7.85, 7.93 [09:56:04] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.69, 11.67, 11.57 [09:58:15] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.31, 11.85, 11.62 [09:59:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.98, 7.72, 7.86 [10:00:15] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.51, 11.31, 11.48 [10:04:15] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.32, 11.37, 11.43 [10:06:15] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.77, 11.14, 11.34 [10:07:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.40, 7.59, 7.69 [10:09:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.17, 7.04, 7.47 [10:10:15] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 15.35, 12.27, 11.68 [10:14:04] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.25, 11.19, 11.90 [10:14:15] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 7.86, 10.79, 11.31 [10:16:04] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.04, 11.75, 12.01 [10:16:33] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 7.64, 4.93, 2.85 [10:18:04] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.98, 11.00, 11.73 [10:18:29] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 1.96, 3.65, 2.62 [10:20:26] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.85, 3.14, 2.56 [10:21:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 10.45, 8.38, 7.86 [10:22:04] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 15.60, 12.73, 12.20 [10:22:15] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 15.68, 12.39, 11.73 [10:23:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.21, 7.83, 7.72 [10:27:17] PROBLEM - cp23 APT on cp23 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [10:27:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 7.84, 8.21, 7.94 [10:29:17] RECOVERY - cp23 APT on cp23 is OK: APT OK: 34 packages available for upgrade (0 critical updates). [10:29:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.77, 7.77, 7.81 [10:31:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.61, 8.14, 7.94 [10:33:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.37, 7.87, 7.87 [10:37:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.61, 8.13, 7.95 [10:39:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 5.62, 7.23, 7.65 [10:45:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.36, 7.68, 7.68 [10:45:58] PROBLEM - cp22 Current Load on cp22 is WARNING: WARNING - load average: 3.69, 3.40, 2.18 [10:47:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.26, 7.51, 7.62 [10:47:58] RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 1.16, 2.53, 2.01 [10:49:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.84, 7.91, 7.74 [10:49:39] PROBLEM - swiftobject121 APT on swiftobject121 is WARNING: APT WARNING: 0 packages available for upgrade (0 critical updates). warnings detected, errors detected. [10:51:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.92, 7.65, 7.68 [10:51:42] PROBLEM - swiftobject121 APT on swiftobject121 is CRITICAL: APT CRITICAL: 52 packages available for upgrade (7 critical updates). [10:56:01] PROBLEM - cp23 APT on cp23 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [10:58:01] RECOVERY - cp23 APT on cp23 is OK: APT OK: 34 packages available for upgrade (0 critical updates). [11:01:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.59, 8.21, 7.87 [11:03:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.88, 7.95, 7.81 [11:05:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.20, 8.01, 7.84 [11:17:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.50, 7.58, 7.89 [11:18:14] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 8.36, 6.83, 6.32 [11:19:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 11.11, 8.94, 8.34 [11:19:58] PROBLEM - swiftobject121 APT on swiftobject121 is WARNING: APT WARNING: 0 packages available for upgrade (0 critical updates). warnings detected, errors detected. [11:20:09] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 6.39, 6.61, 6.30 [11:20:18] PROBLEM - wiki.minecraftathome.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.minecraftathome.com could not be found [11:22:01] PROBLEM - swiftobject121 APT on swiftobject121 is CRITICAL: APT CRITICAL: 52 packages available for upgrade (7 critical updates). [11:30:27] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 16.08, 6.81, 3.69 [11:32:45] PROBLEM - cp23 APT on cp23 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [11:34:45] RECOVERY - cp23 APT on cp23 is OK: APT OK: 34 packages available for upgrade (0 critical updates). [11:38:26] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 0.80, 3.12, 3.28 [11:41:19] PROBLEM - os141 Current Load on os141 is WARNING: WARNING - load average: 3.42, 2.64, 1.39 [11:43:18] RECOVERY - os141 Current Load on os141 is OK: OK - load average: 2.01, 2.64, 1.56 [11:46:26] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 3.40, 3.45, 3.27 [11:48:26] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.39, 2.70, 3.01 [11:50:14] PROBLEM - db121 Current Load on db121 is CRITICAL: CRITICAL - load average: 12.81, 17.09, 8.45 [11:55:59] RECOVERY - db121 Current Load on db121 is OK: OK - load average: 0.97, 6.10, 6.17 [12:37:18] PROBLEM - db142 Current Load on db142 is CRITICAL: CRITICAL - load average: 9.09, 6.19, 3.74 [12:39:18] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 3.45, 5.19, 3.68 [13:05:10] !log root@swiftproxy111:/home/paladox# swift post miraheze-adiaprojectwiki-local-thumb --read-acl 'mw:media,mw:media,.r:*' --write-acl 'mw:media,mw:media' [13:05:18] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [13:16:34] [02.github] 07paladox commented on pull request 03#30: Bump actions/cache from 3.3.0 to 3.3.1 in /workflow-templates - 13https://github.com/miraheze/.github/pull/30#issuecomment-1589297082 [13:16:37] [02.github] 07dependabot[bot] edited pull request 03#30: Bump actions/cache from 3.3.0 to 3.3.1 in /workflow-templates - 13https://github.com/miraheze/.github/pull/30 [13:16:59] [02.github] 07dependabot[bot] commented on pull request 03#30: Bump actions/cache from 3.3.0 to 3.3.1 in /workflow-templates - 13https://github.com/miraheze/.github/pull/30#issuecomment-1589297841 [13:17:00] [02.github] 07dependabot[bot] edited pull request 03#30: Bump actions/cache from 3.3.0 to 3.3.1 in /workflow-templates - 13https://github.com/miraheze/.github/pull/30 [13:17:01] [02.github] 07dependabot[bot] closed pull request 03#30: Bump actions/cache from 3.3.0 to 3.3.1 in /workflow-templates - 13https://github.com/miraheze/.github/pull/30 [13:17:03] [02.github] 07dependabot[bot] deleted branch 03dependabot/github_actions/workflow-templates/actions/cache-3.3.1 - 13https://github.com/miraheze/.github [13:17:04] [02miraheze/.github] 07dependabot[bot] deleted branch 03dependabot/github_actions/workflow-templates/actions/cache-3.3.1 [13:28:39] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 4.00, 3.45, 2.54 [13:32:32] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.12, 2.41, 2.33 [13:33:27] PROBLEM - matomo121 Current Load on matomo121 is WARNING: WARNING - load average: 3.60, 3.08, 2.70 [13:35:18] PROBLEM - db142 Current Load on db142 is WARNING: WARNING - load average: 7.43, 5.60, 2.91 [13:35:21] RECOVERY - matomo121 Current Load on matomo121 is OK: OK - load average: 3.17, 3.00, 2.70 [13:37:18] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 4.53, 4.84, 2.95 [13:39:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 5.42, 6.57, 7.67 [13:41:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.82, 7.82, 8.02 [13:59:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 5.39, 6.90, 7.97 [14:01:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.64, 7.62, 8.07 [14:12:51] PROBLEM - cloud12 Puppet on cloud12 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[ulogd2] [14:21:30] [Grafana] FIRING: Some MediaWiki Appservers are running out of PHP-FPM workers. https://grafana.miraheze.org/d/GtxbP1Xnk?orgId=1 [14:31:30] [Grafana] RESOLVED: PHP-FPM Worker Usage High https://grafana.miraheze.org/d/GtxbP1Xnk?orgId=1 [14:37:51] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 7.19, 6.89, 6.35 [14:38:51] RECOVERY - cloud12 Puppet on cloud12 is OK: OK: Puppet is currently enabled, last run 7 seconds ago with 0 failures [14:39:49] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 6.69, 6.67, 6.33 [15:11:50] PROBLEM - matomo121 Current Load on matomo121 is WARNING: WARNING - load average: 3.38, 3.45, 3.08 [15:13:44] RECOVERY - matomo121 Current Load on matomo121 is OK: OK - load average: 1.97, 2.95, 2.94 [15:16:04] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.68, 4.00, 2.95 [15:17:59] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.16, 3.51, 2.88 [15:19:55] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.99, 2.96, 2.75 [15:39:20] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.69, 3.24, 2.91 [15:41:07] PROBLEM - cp23 APT on cp23 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [15:41:20] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.28, 3.56, 3.04 [15:43:14] RECOVERY - cp23 APT on cp23 is OK: APT OK: 34 packages available for upgrade (0 critical updates). [15:43:20] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.19, 2.97, 2.89 [15:49:48] PROBLEM - swiftobject121 APT on swiftobject121 is WARNING: APT WARNING: 0 packages available for upgrade (0 critical updates). warnings detected, errors detected. [15:50:04] PROBLEM - cp22 NTP time on cp22 is WARNING: NTP WARNING: Offset 0.1555487812 secs [15:50:26] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 2.94, 3.81, 2.85 [15:51:52] PROBLEM - swiftobject121 APT on swiftobject121 is CRITICAL: APT CRITICAL: 52 packages available for upgrade (7 critical updates). [15:52:26] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.83, 2.93, 2.63 [15:54:05] RECOVERY - cp22 NTP time on cp22 is OK: NTP OK: Offset 0.05307480693 secs [15:58:26] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 3.62, 3.38, 2.90 [16:00:26] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.04, 2.51, 2.64 [16:04:30] PROBLEM - ping6 on cp33 is CRITICAL: PING CRITICAL - Packet loss = 0%, RTA = 245.53 ms [16:04:38] PROBLEM - ping6 on cp32 is CRITICAL: PING CRITICAL - Packet loss = 0%, RTA = 261.00 ms [16:05:29] PROBLEM - ping6 on ns1 is CRITICAL: PING CRITICAL - Packet loss = 0%, RTA = 212.73 ms [16:08:26] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 3.71, 2.88, 2.62 [16:10:26] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 2.72, 2.65, 2.56 [16:12:25] PROBLEM - ping6 on cp33 is WARNING: PING WARNING - Packet loss = 0%, RTA = 175.72 ms [16:14:23] PROBLEM - ping6 on cp33 is CRITICAL: PING CRITICAL - Packet loss = 0%, RTA = 202.61 ms [16:16:22] PROBLEM - ping6 on cp33 is WARNING: PING WARNING - Packet loss = 0%, RTA = 177.29 ms [16:17:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.43, 7.20, 7.95 [16:18:21] PROBLEM - ping6 on cp33 is CRITICAL: PING CRITICAL - Packet loss = 0%, RTA = 200.33 ms [16:23:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.70, 7.81, 7.90 [16:26:14] PROBLEM - test2.specialchat.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'test2.specialchat.org' expires in 15 day(s) (Thu 29 Jun 2023 16:14:39 GMT +0000). [16:28:26] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 4.12, 3.51, 2.82 [16:28:57] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/10c340df80dd...4832f044ad16 [16:28:59] [02miraheze/ssl] 07MirahezeSSLBot 034832f04 - Bot: Update SSL cert for test2.specialchat.org [16:30:26] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.51, 2.76, 2.63 [16:47:22] PROBLEM - ping6 on cp32 is WARNING: PING WARNING - Packet loss = 0%, RTA = 173.60 ms [16:49:24] PROBLEM - ping6 on cp32 is CRITICAL: PING CRITICAL - Packet loss = 0%, RTA = 290.27 ms [16:49:59] PROBLEM - ping6 on cp33 is WARNING: PING WARNING - Packet loss = 0%, RTA = 172.04 ms [16:51:58] PROBLEM - ping6 on cp33 is CRITICAL: PING CRITICAL - Packet loss = 0%, RTA = 193.35 ms [16:55:55] PROBLEM - ping6 on cp33 is WARNING: PING WARNING - Packet loss = 0%, RTA = 172.76 ms [16:57:54] PROBLEM - ping6 on cp33 is CRITICAL: PING CRITICAL - Packet loss = 0%, RTA = 181.28 ms [16:58:27] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.99, 3.72, 2.78 [16:59:35] PROBLEM - ping6 on cp32 is WARNING: PING WARNING - Packet loss = 0%, RTA = 179.51 ms [17:00:23] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.36, 3.58, 2.84 [17:01:37] PROBLEM - ping6 on cp32 is CRITICAL: PING CRITICAL - Packet loss = 0%, RTA = 230.10 ms [17:02:19] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.80, 3.98, 3.07 [17:05:01] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 6.96, 6.49, 6.05 [17:05:18] PROBLEM - os141 Current Load on os141 is WARNING: WARNING - load average: 3.58, 2.54, 1.35 [17:06:56] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 6.34, 6.59, 6.15 [17:07:18] RECOVERY - os141 Current Load on os141 is OK: OK - load average: 2.35, 2.27, 1.39 [17:11:47] PROBLEM - ping6 on cp32 is WARNING: PING WARNING - Packet loss = 0%, RTA = 161.78 ms [17:12:00] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.92, 3.92, 3.64 [17:13:19] PROBLEM - wiki.gab.pt.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.gab.pt.eu.org All nameservers failed to answer the query. [17:13:56] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.78, 4.28, 3.78 [17:15:30] PROBLEM - cp23 APT on cp23 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [17:15:51] PROBLEM - ping6 on cp32 is CRITICAL: PING CRITICAL - Packet loss = 0%, RTA = 259.30 ms [17:15:53] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.99, 3.32, 3.48 [17:17:00] [Grafana] FIRING: Some MediaWiki Appservers are running out of PHP-FPM workers. https://grafana.miraheze.org/d/GtxbP1Xnk?orgId=1 [17:17:30] RECOVERY - cp23 APT on cp23 is OK: APT OK: 34 packages available for upgrade (0 critical updates). [17:17:49] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.32, 2.91, 3.31 [17:24:15] RECOVERY - test2.specialchat.org - LetsEncrypt on sslhost is OK: OK - Certificate 'test2.specialchat.org' will expire on Mon 11 Sep 2023 15:28:49 GMT +0000. [17:27:14] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 7.78, 5.39, 3.61 [17:30:06] PROBLEM - ping6 on cp32 is WARNING: PING WARNING - Packet loss = 0%, RTA = 178.23 ms [17:31:04] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.00, 3.74, 3.34 [17:32:08] PROBLEM - ping6 on cp32 is CRITICAL: PING CRITICAL - Packet loss = 0%, RTA = 233.50 ms [17:33:00] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.29, 3.00, 3.12 [17:35:20] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.87, 3.41, 3.03 [17:38:15] RECOVERY - ping6 on cp32 is OK: PING OK - Packet loss = 0%, RTA = 113.04 ms [17:39:29] RECOVERY - ping6 on cp33 is OK: PING OK - Packet loss = 0%, RTA = 113.18 ms [17:39:42] RECOVERY - ping6 on ns1 is OK: PING OK - Packet loss = 0%, RTA = 113.33 ms [17:41:20] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.18, 3.00, 2.99 [17:43:19] PROBLEM - wiki.gab.pt.eu.org - reverse DNS on sslhost is WARNING: SSL WARNING - rDNS OK but records conflict. {'NS': ['NS.ANKH.FR.eu.org.', 'NS1.eu.org.', 'NS1.ERIOMEM.NET.'], 'CNAME': 'bouncingwiki.miraheze.org.'} [17:46:04] PROBLEM - cp22 NTP time on cp22 is WARNING: NTP WARNING: Offset 0.101593405 secs [17:57:00] [Grafana] RESOLVED: PHP-FPM Worker Usage High https://grafana.miraheze.org/d/GtxbP1Xnk?orgId=1 [18:08:05] RECOVERY - cp22 NTP time on cp22 is OK: NTP OK: Offset 0.08772233129 secs [18:09:02] PROBLEM - cp23 APT on cp23 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [18:11:08] RECOVERY - cp23 APT on cp23 is OK: APT OK: 34 packages available for upgrade (0 critical updates). [18:29:04] PROBLEM - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query mar.in.ua. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [18:29:30] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 4.31, 2.70, 2.13 [18:31:19] PROBLEM - wiki.orvyn.ca - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.orvyn.ca' expires in 15 day(s) (Thu 29 Jun 2023 18:05:26 GMT +0000). [18:31:27] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 3.40, 2.67, 2.17 [18:32:59] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/4832f044ad16...0641977c3ac2 [18:33:02] [02miraheze/ssl] 07MirahezeSSLBot 030641977 - Bot: Update SSL cert for wiki.orvyn.ca [18:46:04] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.32, 4.11, 3.19 [18:46:49] PROBLEM - cp23 APT on cp23 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [18:48:00] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.65, 3.19, 2.96 [18:49:32] RECOVERY - cp23 APT on cp23 is OK: APT OK: 34 packages available for upgrade (0 critical updates). [18:55:47] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.07, 3.59, 3.17 [18:57:43] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.74, 3.81, 3.31 [18:59:38] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.34, 3.35, 3.20 [19:01:03] RECOVERY - wiki.orvyn.ca - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.orvyn.ca' will expire on Mon 11 Sep 2023 17:32:51 GMT +0000. [19:14:11] PROBLEM - mw121 MediaWiki Rendering on mw121 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:18:00] PROBLEM - cp23 APT on cp23 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [19:18:15] RECOVERY - mw121 MediaWiki Rendering on mw121 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 4.274 second response time [19:20:37] RECOVERY - cp23 APT on cp23 is OK: APT OK: 34 packages available for upgrade (0 critical updates). [19:30:42] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 3.35, 3.50, 2.80 [19:32:38] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 2.41, 3.31, 2.83 [19:33:40] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.85, 3.60, 2.78 [19:37:20] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.66, 4.39, 3.21 [19:37:34] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.42, 3.53, 2.98 [19:39:29] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.29, 2.82, 2.79 [19:41:20] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.59, 3.30, 3.07 [19:47:20] PROBLEM - decyclopedia.tk - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'decyclopedia.tk' expires in 15 day(s) (Thu 29 Jun 2023 19:31:55 GMT +0000). [19:49:26] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/0641977c3ac2...672e1f68e223 [19:49:29] [02miraheze/ssl] 07MirahezeSSLBot 03672e1f6 - Bot: Update SSL cert for decyclopedia.tk [19:49:36] PROBLEM - swiftobject121 APT on swiftobject121 is WARNING: APT WARNING: 0 packages available for upgrade (0 critical updates). warnings detected, errors detected. [19:51:39] PROBLEM - swiftobject121 APT on swiftobject121 is CRITICAL: APT CRITICAL: 52 packages available for upgrade (7 critical updates). [19:52:13] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 3.22, 4.03, 3.54 [19:54:09] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 0.94, 2.91, 3.19 [19:59:12] [02miraheze/.github] 07dependabot[bot] pushed 031 commit to 03dependabot/github_actions/actions/cache-3.3.1 [+0/-0/±1] 13https://github.com/miraheze/.github/commit/96bfea2c9826 [19:59:13] [02miraheze/.github] 07dependabot[bot] 0396bfea2 - Bump actions/cache from 3.3.0 to 3.3.1 [19:59:15] [02.github] 07dependabot[bot] created branch 03dependabot/github_actions/actions/cache-3.3.1 - 13https://github.com/miraheze/.github [19:59:17] [02.github] 07dependabot[bot] opened pull request 03#33: Bump actions/cache from 3.3.0 to 3.3.1 - 13https://github.com/miraheze/.github/pull/33 [19:59:18] [02.github] 07dependabot[bot] labeled pull request 03#33: Bump actions/cache from 3.3.0 to 3.3.1 - 13https://github.com/miraheze/.github/pull/33 [20:05:00] [Grafana] FIRING: Some MediaWiki Appservers are running out of PHP-FPM workers. https://grafana.miraheze.org/d/GtxbP1Xnk?orgId=1 [20:06:35] PROBLEM - matomo121 APT on matomo121 is CRITICAL: APT CRITICAL: 54 packages available for upgrade (14 critical updates). [20:10:00] [Grafana] RESOLVED: PHP-FPM Worker Usage High https://grafana.miraheze.org/d/GtxbP1Xnk?orgId=1 [20:10:58] PROBLEM - phab121 APT on phab121 is CRITICAL: APT CRITICAL: 57 packages available for upgrade (18 critical updates). [20:12:39] PROBLEM - comprehensibleinputwiki.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'comprehensibleinputwiki.org' expires in 15 day(s) (Thu 29 Jun 2023 19:49:30 GMT +0000). [20:16:10] RECOVERY - decyclopedia.tk - LetsEncrypt on sslhost is OK: OK - Certificate 'decyclopedia.tk' will expire on Mon 11 Sep 2023 18:49:19 GMT +0000. [20:16:58] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/672e1f68e223...ec044caebb1a [20:17:00] [02miraheze/ssl] 07MirahezeSSLBot 03ec044ca - Bot: Update SSL cert for comprehensibleinputwiki.org [20:17:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.63, 7.36, 7.90 [20:18:46] PROBLEM - jobchron121 APT on jobchron121 is CRITICAL: APT CRITICAL: 63 packages available for upgrade (18 critical updates). [20:21:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.35, 7.99, 7.96 [20:23:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.08, 7.67, 7.85 [20:23:21] PROBLEM - cloud14 Puppet on cloud14 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[ulogd2] [20:23:43] PROBLEM - mon141 APT on mon141 is CRITICAL: APT CRITICAL: 34 packages available for upgrade (18 critical updates). [20:25:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 7.70, 8.05, 7.99 [20:27:03] RECOVERY - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - uk.religiononfire.mar.in.ua reverse DNS resolves to cp23.miraheze.org - CNAME OK [20:27:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.32, 7.90, 7.95 [20:27:59] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 9.82, 5.07, 3.39 [20:29:51] PROBLEM - reports121 APT on reports121 is CRITICAL: APT CRITICAL: 57 packages available for upgrade (14 critical updates). [20:35:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.95, 8.01, 7.87 [20:35:42] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.44, 3.57, 3.43 [20:37:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.31, 7.76, 7.80 [20:37:38] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.76, 3.21, 3.30 [20:43:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.15, 8.24, 7.90 [20:49:20] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.08, 3.67, 3.19 [20:51:20] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.56, 3.20, 3.07 [20:51:21] RECOVERY - cloud14 Puppet on cloud14 is OK: OK: Puppet is currently enabled, last run 49 seconds ago with 0 failures [20:54:30] [Grafana] FIRING: Some MediaWiki Appservers are running out of PHP-FPM workers. https://grafana.miraheze.org/d/GtxbP1Xnk?orgId=1 [20:55:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 5.62, 7.20, 7.82 [20:58:27] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 6.16, 4.05, 2.85 [21:00:26] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 2.38, 3.25, 2.70 [21:03:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.56, 8.17, 7.91 [21:10:41] RECOVERY - comprehensibleinputwiki.org - LetsEncrypt on sslhost is OK: OK - Certificate 'comprehensibleinputwiki.org' will expire on Mon 11 Sep 2023 19:16:51 GMT +0000. [21:13:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 4.89, 7.06, 7.72 [21:15:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.02, 7.64, 7.85 [21:17:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.34, 7.77, 7.89 [21:19:20] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.39, 4.11, 3.23 [21:19:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.07, 8.25, 8.05 [21:21:25] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 6.73, 4.93, 3.46 [21:23:20] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.91, 3.28, 3.13 [21:24:30] [Grafana] RESOLVED: PHP-FPM Worker Usage High https://grafana.miraheze.org/d/GtxbP1Xnk?orgId=1 [21:25:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.64, 7.73, 7.97 [21:31:25] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.42, 4.00, 3.88 [21:33:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.00, 8.18, 7.99 [21:33:25] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 3.42, 4.19, 3.98 [21:35:25] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.73, 3.61, 3.79 [21:39:25] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.66, 2.66, 3.32 [21:39:52] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.53, 2.82, 2.56 [21:41:48] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.79, 3.22, 2.72 [21:41:48] PROBLEM - cp23 APT on cp23 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [21:43:19] PROBLEM - wiki.gab.pt.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.gab.pt.eu.org All nameservers failed to answer the query. [21:43:51] RECOVERY - cp23 APT on cp23 is OK: APT OK: 34 packages available for upgrade (0 critical updates). [21:45:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.77, 7.68, 7.98 [21:45:39] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.86, 3.72, 3.09 [21:47:35] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.92, 3.11, 2.94 [21:49:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.71, 7.65, 7.84 [21:55:20] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.79, 3.37, 3.03 [21:57:20] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.50, 2.95, 2.91 [21:59:02] PROBLEM - en.religiononfire.mar.in.ua - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query en.religiononfire.mar.in.ua. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [22:00:59] PROBLEM - mw141 Current Load on mw141 is CRITICAL: CRITICAL - load average: 14.63, 10.03, 7.77 [22:01:18] PROBLEM - db142 Current Load on db142 is CRITICAL: CRITICAL - load average: 9.98, 7.94, 4.21 [22:02:58] RECOVERY - mw141 Current Load on mw141 is OK: OK - load average: 6.72, 8.78, 7.59 [22:03:18] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 1.77, 5.51, 3.77 [22:07:20] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 8.85, 5.11, 3.81 [22:07:25] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 6.78, 4.13, 3.31 [22:09:25] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.73, 3.88, 3.32 [22:11:25] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.27, 3.25, 3.16 [22:13:19] PROBLEM - wiki.gab.pt.eu.org - reverse DNS on sslhost is WARNING: SSL WARNING - rDNS OK but records conflict. {'NS': ['NS.ANKH.FR.eu.org.', 'NS1.eu.org.', 'NS1.ERIOMEM.NET.'], 'CNAME': 'bouncingwiki.miraheze.org.'} [22:17:25] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.20, 3.64, 3.29 [22:19:20] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.44, 3.32, 3.66 [22:19:25] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.83, 2.97, 3.09 [22:21:20] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.38, 2.63, 3.36 [22:27:20] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.43, 4.09, 3.74 [22:27:34] RECOVERY - en.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - en.religiononfire.mar.in.ua reverse DNS resolves to cp23.miraheze.org - CNAME OK [22:29:20] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.20, 3.38, 3.52 [22:31:20] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.51, 2.76, 3.28 [22:46:10] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.52, 3.06, 2.91 [22:48:05] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.79, 2.83, 2.84 [22:53:18] PROBLEM - db142 Current Load on db142 is CRITICAL: CRITICAL - load average: 12.62, 6.89, 3.58 [22:55:18] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 5.42, 6.49, 3.86 [22:57:41] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.60, 5.02, 3.82 [23:01:31] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.23, 3.85, 3.58 [23:03:30] [Grafana] FIRING: Some MediaWiki Appservers are running out of PHP-FPM workers. https://grafana.miraheze.org/d/GtxbP1Xnk?orgId=1 [23:07:20] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.67, 4.40, 3.43 [23:07:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.06, 7.33, 7.95 [23:07:25] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.12, 3.08, 3.34 [23:09:20] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.82, 3.87, 3.35 [23:11:20] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.42, 4.41, 3.60 [23:11:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.22, 7.33, 7.75 [23:15:20] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.70, 3.84, 3.56 [23:17:24] PROBLEM - mwtask141 Disk Space on mwtask141 is WARNING: DISK WARNING - free space: / 7694 MB (10% inode=89%); [23:19:20] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.00, 2.85, 3.22 [23:21:59] PROBLEM - cp23 APT on cp23 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [23:24:15] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.06, 3.90, 3.40 [23:27:12] RECOVERY - cp23 APT on cp23 is OK: APT OK: 34 packages available for upgrade (0 critical updates). [23:28:05] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.96, 3.26, 3.27 [23:31:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.64, 7.29, 7.97 [23:35:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.15, 7.45, 7.86 [23:37:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.56, 7.50, 7.83 [23:37:41] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.04, 4.07, 3.51 [23:40:59] PROBLEM - matomo121 HTTPS on matomo121 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 358 bytes in 0.010 second response time [23:41:00] PROBLEM - mail121 webmail.miraheze.org HTTPS on mail121 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [23:41:30] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.28, 3.42, 3.40 [23:43:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.51, 7.82, 7.83 [23:43:25] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 7.85, 4.49, 3.75 [23:44:22] PROBLEM - cp23 APT on cp23 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [23:46:25] RECOVERY - cp23 APT on cp23 is OK: APT OK: 34 packages available for upgrade (0 critical updates). [23:49:25] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.19, 3.81, 3.68 [23:53:25] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 3.10, 3.14, 3.40 [23:55:58] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 8.90, 5.25, 3.74 [23:57:25] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.84, 3.24, 3.41 [23:58:30] [Grafana] RESOLVED: PHP-FPM Worker Usage High https://grafana.miraheze.org/d/GtxbP1Xnk?orgId=1 [23:59:25] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.30, 2.61, 3.16 [23:59:32] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 4.09, 2.73, 1.91