[00:00:27] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.33, 10.38, 9.73 [00:00:29] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.30, 3.30, 3.48 [00:00:53] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.52, 4.04, 3.64 [00:01:07] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.25, 1.99, 1.95 [00:01:45] PROBLEM - gluster111 Puppet on gluster111 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [00:02:53] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.27, 3.81, 3.62 [00:02:59] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.37, 3.71, 3.64 [00:03:07] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.84, 1.94, 1.94 [00:04:42] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.54, 1.74, 1.41 [00:04:53] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 7.72, 5.09, 4.09 [00:04:59] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 6.59, 4.75, 4.02 [00:06:41] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.85, 1.40, 1.32 [00:07:17] RECOVERY - wiki.vinesh.eu.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.vinesh.eu.org' will expire on Sat 17 Sep 2022 22:28:24 GMT +0000. [00:07:49] RECOVERY - www.bluepageswiki.org - LetsEncrypt on sslhost is OK: OK - Certificate 'www.bluepageswiki.org' will expire on Sat 17 Sep 2022 22:39:35 GMT +0000. [00:08:27] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 8.58, 9.65, 9.74 [00:12:53] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.80, 3.71, 3.83 [00:12:59] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.63, 3.88, 3.98 [00:16:53] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 7.41, 4.67, 4.11 [00:16:59] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.34, 3.97, 3.99 [00:18:37] PROBLEM - gluster101 Puppet on gluster101 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [00:18:53] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.94, 3.89, 3.89 [00:18:59] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.42, 3.72, 3.89 [00:19:07] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.71, 2.16, 1.97 [00:20:53] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.59, 4.11, 3.97 [00:20:59] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 7.06, 4.88, 4.29 [00:21:15] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.17, 10.18, 9.84 [00:22:53] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.73, 3.59, 3.80 [00:25:07] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.50, 1.98, 1.98 [00:28:36] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 9.99, 7.70, 6.23 [00:29:45] RECOVERY - gluster111 Puppet on gluster111 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [00:30:35] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 5.35, 6.87, 6.11 [00:30:53] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.90, 3.92, 3.78 [00:31:00] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 9.07, 9.83, 9.95 [00:32:34] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 4.74, 6.11, 5.92 [00:32:53] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.94, 3.61, 3.69 [00:32:59] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.26, 3.65, 3.93 [00:33:01] PROBLEM - gluster121 Puppet on gluster121 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [00:36:47] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.34, 10.64, 10.10 [00:38:44] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 8.10, 9.96, 9.94 [00:38:59] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.10, 3.21, 3.59 [00:39:59] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.48, 3.18, 3.97 [00:40:53] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 3.03, 3.13, 3.40 [00:40:59] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.17, 3.08, 3.49 [00:42:59] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 1.91, 2.58, 3.26 [00:44:31] RECOVERY - gluster101 Puppet on gluster101 is OK: OK: Puppet is currently enabled, last run 26 seconds ago with 0 failures [00:45:27] [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_38/extensions/RottenLinks-29bb9c7 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/commit/526c08348e49 [00:45:29] [02miraheze/mediawiki] 07dependabot[bot] 03526c083 - Bump extensions/RottenLinks from `8796456` to `29bb9c7` [00:45:30] [02mediawiki] 07dependabot[bot] opened pull request 03#7727: Bump extensions/RottenLinks from `8796456` to `29bb9c7` - 13https://github.com/miraheze/mediawiki/pull/7727 [00:45:31] [url] Page not found · GitHub · GitHub | github.com [00:45:32] [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_38/extensions/RottenLinks-29bb9c7 - 13https://github.com/miraheze/mediawiki [00:45:32] [url] Page not found · GitHub · GitHub | github.com [00:45:33] [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_38/extensions/CreateWiki-ed0639a [+0/-0/±1] 13https://github.com/miraheze/mediawiki/commit/f1a4a1f5cbe0 [00:45:35] [02miraheze/mediawiki] 07dependabot[bot] 03f1a4a1f - Bump extensions/CreateWiki from `93ad283` to `ed0639a` [00:45:36] [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_38/extensions/CreateWiki-ed0639a - 13https://github.com/miraheze/mediawiki [00:45:37] [url] Page not found · GitHub · GitHub | github.com [00:45:38] [02mediawiki] 07dependabot[bot] opened pull request 03#7728: Bump extensions/CreateWiki from `93ad283` to `ed0639a` - 13https://github.com/miraheze/mediawiki/pull/7728 [00:45:38] [url] Page not found · GitHub · GitHub | github.com [00:45:41] [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_38/extensions/Arrays-6ac129a [+0/-0/±1] 13https://github.com/miraheze/mediawiki/commit/2a73d0ca82f9 [00:45:42] [02miraheze/mediawiki] 07dependabot[bot] 032a73d0c - Bump extensions/Arrays from `ce3f628` to `6ac129a` [00:45:44] [02mediawiki] 07dependabot[bot] opened pull request 03#7729: Bump extensions/Arrays from `ce3f628` to `6ac129a` - 13https://github.com/miraheze/mediawiki/pull/7729 [00:45:44] [url] Page not found · GitHub · GitHub | github.com [00:45:45] [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_38/extensions/Arrays-6ac129a - 13https://github.com/miraheze/mediawiki [00:45:46] ... [00:45:47] [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_38/extensions/PageTriage-f7c61b6 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/commit/a4000ef549f4 [00:45:49] [02miraheze/mediawiki] 07dependabot[bot] 03a4000ef - Bump extensions/PageTriage from `182376b` to `f7c61b6` [00:45:50] [02mediawiki] 07dependabot[bot] opened pull request 03#7730: Bump extensions/PageTriage from `182376b` to `f7c61b6` - 13https://github.com/miraheze/mediawiki/pull/7730 [00:45:50] ... [00:45:52] [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_38/extensions/PageTriage-f7c61b6 - 13https://github.com/miraheze/mediawiki [00:45:52] ... [00:45:53] [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_38/skins/Evelution-4f3f6d3 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/commit/09a48b2b1bf6 [00:45:55] [02miraheze/mediawiki] 07dependabot[bot] 0309a48b2 - Bump skins/Evelution from `ff670ad` to `4f3f6d3` [00:45:56] [02mediawiki] 07dependabot[bot] opened pull request 03#7731: Bump skins/Evelution from `ff670ad` to `4f3f6d3` - 13https://github.com/miraheze/mediawiki/pull/7731 [00:45:58] [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_38/skins/Evelution-4f3f6d3 - 13https://github.com/miraheze/mediawiki [00:45:59] [02mediawiki] 07github-actions[bot] labeled pull request 03#7727: Bump extensions/RottenLinks from `8796456` to `29bb9c7` - 13https://github.com/miraheze/mediawiki/pull/7727 [00:46:01] [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_38/extensions/SpriteSheet-cecfdc8 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/commit/ea110b663557 [00:46:02] [02miraheze/mediawiki] 07dependabot[bot] 03ea110b6 - Bump extensions/SpriteSheet from `f24e809` to `cecfdc8` [00:46:04] [02mediawiki] 07github-actions[bot] labeled pull request 03#7728: Bump extensions/CreateWiki from `93ad283` to `ed0639a` - 13https://github.com/miraheze/mediawiki/pull/7728 [00:46:05] [02mediawiki] 07dependabot[bot] opened pull request 03#7732: Bump extensions/SpriteSheet from `f24e809` to `cecfdc8` - 13https://github.com/miraheze/mediawiki/pull/7732 [00:46:07] [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_38/extensions/SpriteSheet-cecfdc8 - 13https://github.com/miraheze/mediawiki [00:46:08] [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_38/extensions/GrowthExperiments-8413d8b [+0/-0/±1] 13https://github.com/miraheze/mediawiki/commit/79ab33e581c3 [00:46:10] [02miraheze/mediawiki] 07dependabot[bot] 0379ab33e - Bump extensions/GrowthExperiments from `57ab500` to `8413d8b` [00:46:11] [02mediawiki] 07dependabot[bot] opened pull request 03#7733: Bump extensions/GrowthExperiments from `57ab500` to `8413d8b` - 13https://github.com/miraheze/mediawiki/pull/7733 [00:46:13] [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_38/extensions/GrowthExperiments-8413d8b - 13https://github.com/miraheze/mediawiki [00:46:14] [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_38/extensions/WikiSEO-0d34c0d [+0/-0/±1] 13https://github.com/miraheze/mediawiki/commit/f04872ec93a1 [00:46:16] [02miraheze/mediawiki] 07dependabot[bot] 03f04872e - Bump extensions/WikiSEO from `fa1c3b4` to `0d34c0d` [00:46:17] [02mediawiki] 07dependabot[bot] opened pull request 03#7734: Bump extensions/WikiSEO from `fa1c3b4` to `0d34c0d` - 13https://github.com/miraheze/mediawiki/pull/7734 [00:46:19] [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_38/extensions/WikiSEO-0d34c0d - 13https://github.com/miraheze/mediawiki [00:46:20] [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_38/extensions/Variables-b28b78e [+0/-0/±1] 13https://github.com/miraheze/mediawiki/commit/bec237c4b65a [00:46:22] [02miraheze/mediawiki] 07dependabot[bot] 03bec237c - Bump extensions/Variables from `5f46b7d` to `b28b78e` [00:46:23] [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_38/extensions/Variables-b28b78e - 13https://github.com/miraheze/mediawiki [00:46:25] [02mediawiki] 07github-actions[bot] labeled pull request 03#7729: Bump extensions/Arrays from `ce3f628` to `6ac129a` - 13https://github.com/miraheze/mediawiki/pull/7729 [00:46:26] [02mediawiki] 07dependabot[bot] opened pull request 03#7735: Bump extensions/Variables from `5f46b7d` to `b28b78e` - 13https://github.com/miraheze/mediawiki/pull/7735 [00:46:28] [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_38/extensions/StructuredNavigation-005f244 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/commit/3108034ad610 [00:46:29] [02miraheze/mediawiki] 07dependabot[bot] 033108034 - Bump extensions/StructuredNavigation from `eac23fe` to `005f244` [00:46:31] [02mediawiki] 07github-actions[bot] labeled pull request 03#7730: Bump extensions/PageTriage from `182376b` to `f7c61b6` - 13https://github.com/miraheze/mediawiki/pull/7730 [00:46:32] [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_38/extensions/StructuredNavigation-005f244 - 13https://github.com/miraheze/mediawiki [00:46:34] [02mediawiki] 07dependabot[bot] opened pull request 03#7736: Bump extensions/StructuredNavigation from `eac23fe` to `005f244` - 13https://github.com/miraheze/mediawiki/pull/7736 [00:46:35] [02mediawiki] 07github-actions[bot] labeled pull request 03#7732: Bump extensions/SpriteSheet from `f24e809` to `cecfdc8` - 13https://github.com/miraheze/mediawiki/pull/7732 [00:46:37] [02mediawiki] 07github-actions[bot] labeled pull request 03#7733: Bump extensions/GrowthExperiments from `57ab500` to `8413d8b` - 13https://github.com/miraheze/mediawiki/pull/7733 [00:46:38] [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_38/extensions/PDFEmbed-1170024 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/commit/d386a2e84771 [00:46:40] [02miraheze/mediawiki] 07dependabot[bot] 03d386a2e - Bump extensions/PDFEmbed from `dff6fac` to `1170024` [00:46:41] [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_38/extensions/PDFEmbed-1170024 - 13https://github.com/miraheze/mediawiki [00:46:43] [02mediawiki] 07dependabot[bot] opened pull request 03#7737: Bump extensions/PDFEmbed from `dff6fac` to `1170024` - 13https://github.com/miraheze/mediawiki/pull/7737 [00:46:44] [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_38/extensions/DataDump-0c39251 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/commit/d417c2d48755 [00:46:46] [02miraheze/mediawiki] 07dependabot[bot] 03d417c2d - Bump extensions/DataDump from `d880fb9` to `0c39251` [00:46:47] [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_38/extensions/DataDump-0c39251 - 13https://github.com/miraheze/mediawiki [00:46:49] [02mediawiki] 07dependabot[bot] opened pull request 03#7738: Bump extensions/DataDump from `d880fb9` to `0c39251` - 13https://github.com/miraheze/mediawiki/pull/7738 [00:46:50] [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_38/extensions/WikiDiscover-0fcef42 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/commit/3dc9ffe59fa0 [00:46:52] [02miraheze/mediawiki] 07dependabot[bot] 033dc9ffe - Bump extensions/WikiDiscover from `10ea74c` to `0fcef42` [00:46:53] [02mediawiki] 07dependabot[bot] opened pull request 03#7739: Bump extensions/WikiDiscover from `10ea74c` to `0fcef42` - 13https://github.com/miraheze/mediawiki/pull/7739 [00:46:55] [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_38/extensions/WikiDiscover-0fcef42 - 13https://github.com/miraheze/mediawiki [00:46:56] [02mediawiki] 07github-actions[bot] labeled pull request 03#7734: Bump extensions/WikiSEO from `fa1c3b4` to `0d34c0d` - 13https://github.com/miraheze/mediawiki/pull/7734 [00:46:58] [02mediawiki] 07github-actions[bot] labeled pull request 03#7735: Bump extensions/Variables from `5f46b7d` to `b28b78e` - 13https://github.com/miraheze/mediawiki/pull/7735 [00:46:59] [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_38/extensions/ManageWiki-e654457 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/commit/f95e74ae4857 [00:47:01] [02miraheze/mediawiki] 07dependabot[bot] 03f95e74a - Bump extensions/ManageWiki from `60a2f51` to `e654457` [00:47:02] [02mediawiki] 07dependabot[bot] opened pull request 03#7740: Bump extensions/ManageWiki from `60a2f51` to `e654457` - 13https://github.com/miraheze/mediawiki/pull/7740 [00:47:04] [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_38/extensions/ManageWiki-e654457 - 13https://github.com/miraheze/mediawiki [00:47:05] [02mediawiki] 07github-actions[bot] labeled pull request 03#7736: Bump extensions/StructuredNavigation from `eac23fe` to `005f244` - 13https://github.com/miraheze/mediawiki/pull/7736 [00:47:07] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.18, 1.81, 1.83 [00:47:07] [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_38/extensions/TitleBlacklist-6217bfa [+0/-0/±1] 13https://github.com/miraheze/mediawiki/commit/c269f544dd0d [00:47:08] [02miraheze/mediawiki] 07dependabot[bot] 03c269f54 - Bump extensions/TitleBlacklist from `76ff44d` to `6217bfa` [00:47:10] [02mediawiki] 07dependabot[bot] opened pull request 03#7741: Bump extensions/TitleBlacklist from `76ff44d` to `6217bfa` - 13https://github.com/miraheze/mediawiki/pull/7741 [00:47:11] [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_38/extensions/TitleBlacklist-6217bfa - 13https://github.com/miraheze/mediawiki [00:47:13] [02mediawiki] 07github-actions[bot] labeled pull request 03#7737: Bump extensions/PDFEmbed from `dff6fac` to `1170024` - 13https://github.com/miraheze/mediawiki/pull/7737 [00:47:14] [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_38/extensions/MirahezeMagic-c400474 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/commit/541139203705 [00:47:16] [02miraheze/mediawiki] 07dependabot[bot] 035411392 - Bump extensions/MirahezeMagic from `648b9f9` to `c400474` [00:47:17] [02mediawiki] 07dependabot[bot] opened pull request 03#7742: Bump extensions/MirahezeMagic from `648b9f9` to `c400474` - 13https://github.com/miraheze/mediawiki/pull/7742 [00:47:19] [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_38/extensions/MirahezeMagic-c400474 - 13https://github.com/miraheze/mediawiki [00:47:20] [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_38/extensions/RemovePII-20686b4 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/commit/b42d712d519d [00:47:22] [02miraheze/mediawiki] 07dependabot[bot] 03b42d712 - Bump extensions/RemovePII from `d7a42ec` to `20686b4` [00:47:23] [02mediawiki] 07github-actions[bot] labeled pull request 03#7738: Bump extensions/DataDump from `d880fb9` to `0c39251` - 13https://github.com/miraheze/mediawiki/pull/7738 [00:47:25] [02mediawiki] 07dependabot[bot] opened pull request 03#7743: Bump extensions/RemovePII from `d7a42ec` to `20686b4` - 13https://github.com/miraheze/mediawiki/pull/7743 [00:47:26] [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_38/extensions/RemovePII-20686b4 - 13https://github.com/miraheze/mediawiki [00:47:28] [02mediawiki] 07github-actions[bot] labeled pull request 03#7739: Bump extensions/WikiDiscover from `10ea74c` to `0fcef42` - 13https://github.com/miraheze/mediawiki/pull/7739 [00:47:29] [02mediawiki] 07github-actions[bot] labeled pull request 03#7740: Bump extensions/ManageWiki from `60a2f51` to `e654457` - 13https://github.com/miraheze/mediawiki/pull/7740 [00:47:31] [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_38/extensions/IncidentReporting-9d3f347 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/commit/a9f69953cc9d [00:47:32] [02miraheze/mediawiki] 07dependabot[bot] 03a9f6995 - Bump extensions/IncidentReporting from `e598dac` to `9d3f347` [00:47:34] [02mediawiki] 07dependabot[bot] opened pull request 03#7744: Bump extensions/IncidentReporting from `e598dac` to `9d3f347` - 13https://github.com/miraheze/mediawiki/pull/7744 [00:47:35] [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_38/extensions/IncidentReporting-9d3f347 - 13https://github.com/miraheze/mediawiki [00:47:37] [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_38/extensions/LockAuthor-fadbef1 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/commit/ccc22b24f3b8 [00:47:38] [02miraheze/mediawiki] 07dependabot[bot] 03ccc22b2 - Bump extensions/LockAuthor from `8c03267` to `fadbef1` [00:47:40] [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_38/extensions/LockAuthor-fadbef1 - 13https://github.com/miraheze/mediawiki [00:47:41] [02mediawiki] 07dependabot[bot] opened pull request 03#7745: Bump extensions/LockAuthor from `8c03267` to `fadbef1` - 13https://github.com/miraheze/mediawiki/pull/7745 [00:47:43] [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_38/extensions/GlobalNewFiles-b314d6b [+0/-0/±1] 13https://github.com/miraheze/mediawiki/commit/2d620aae2a6f [00:47:44] [02miraheze/mediawiki] 07dependabot[bot] 032d620aa - Bump extensions/GlobalNewFiles from `48001f0` to `b314d6b` [00:47:46] [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_38/extensions/GlobalNewFiles-b314d6b - 13https://github.com/miraheze/mediawiki [00:47:47] [02mediawiki] 07dependabot[bot] opened pull request 03#7746: Bump extensions/GlobalNewFiles from `48001f0` to `b314d6b` - 13https://github.com/miraheze/mediawiki/pull/7746 [00:47:49] [02mediawiki] 07github-actions[bot] labeled pull request 03#7741: Bump extensions/TitleBlacklist from `76ff44d` to `6217bfa` - 13https://github.com/miraheze/mediawiki/pull/7741 [00:47:50] [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_38/extensions/Moderation-20f6879 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/commit/0ad359e112b9 [00:47:52] [02miraheze/mediawiki] 07dependabot[bot] 030ad359e - Bump extensions/Moderation from `7e7b55c` to `20f6879` [00:47:53] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.04, 2.59, 3.40 [00:47:53] [02mediawiki] 07dependabot[bot] opened pull request 03#7747: Bump extensions/Moderation from `7e7b55c` to `20f6879` - 13https://github.com/miraheze/mediawiki/pull/7747 [00:47:54] [url] Page not found · GitHub · GitHub | github.com [00:47:55] [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_38/extensions/Moderation-20f6879 - 13https://github.com/miraheze/mediawiki [00:47:56] [02mediawiki] 07github-actions[bot] labeled pull request 03#7742: Bump extensions/MirahezeMagic from `648b9f9` to `c400474` - 13https://github.com/miraheze/mediawiki/pull/7742 [00:47:58] [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_38/extensions/MatomoAnalytics-52c204f [+0/-0/±1] 13https://github.com/miraheze/mediawiki/commit/405826a3531b [00:47:59] [02miraheze/mediawiki] 07dependabot[bot] 03405826a - Bump extensions/MatomoAnalytics from `423bd1f` to `52c204f` [00:48:01] [02mediawiki] 07github-actions[bot] labeled pull request 03#7744: Bump extensions/IncidentReporting from `e598dac` to `9d3f347` - 13https://github.com/miraheze/mediawiki/pull/7744 [00:48:02] [02mediawiki] 07github-actions[bot] labeled pull request 03#7743: Bump extensions/RemovePII from `d7a42ec` to `20686b4` - 13https://github.com/miraheze/mediawiki/pull/7743 [00:48:04] [02mediawiki] 07dependabot[bot] opened pull request 03#7748: Bump extensions/MatomoAnalytics from `423bd1f` to `52c204f` - 13https://github.com/miraheze/mediawiki/pull/7748 [00:48:05] [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_38/extensions/MatomoAnalytics-52c204f - 13https://github.com/miraheze/mediawiki [00:48:07] [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_38/extensions/YouTube-01ce5f3 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/commit/fed2cc343329 [00:48:08] [02miraheze/mediawiki] 07dependabot[bot] 03fed2cc3 - Bump extensions/YouTube from `258af9f` to `01ce5f3` [00:48:10] [02mediawiki] 07dependabot[bot] opened pull request 03#7749: Bump extensions/YouTube from `258af9f` to `01ce5f3` - 13https://github.com/miraheze/mediawiki/pull/7749 [00:48:11] [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_38/extensions/YouTube-01ce5f3 - 13https://github.com/miraheze/mediawiki [00:48:13] [02mediawiki] 07github-actions[bot] labeled pull request 03#7745: Bump extensions/LockAuthor from `8c03267` to `fadbef1` - 13https://github.com/miraheze/mediawiki/pull/7745 [00:48:14] [02mediawiki] 07github-actions[bot] labeled pull request 03#7746: Bump extensions/GlobalNewFiles from `48001f0` to `b314d6b` - 13https://github.com/miraheze/mediawiki/pull/7746 [00:48:16] [02mediawiki] 07github-actions[bot] labeled pull request 03#7748: Bump extensions/MatomoAnalytics from `423bd1f` to `52c204f` - 13https://github.com/miraheze/mediawiki/pull/7748 [00:48:17] [02mediawiki] 07github-actions[bot] labeled pull request 03#7747: Bump extensions/Moderation from `7e7b55c` to `20f6879` - 13https://github.com/miraheze/mediawiki/pull/7747 [00:48:19] [02mediawiki] 07github-actions[bot] labeled pull request 03#7747: Bump extensions/Moderation from `7e7b55c` to `20f6879` - 13https://github.com/miraheze/mediawiki/pull/7747 [00:48:20] [02mediawiki] 07github-actions[bot] labeled pull request 03#7749: Bump extensions/YouTube from `258af9f` to `01ce5f3` - 13https://github.com/miraheze/mediawiki/pull/7749 [00:48:59] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.62, 3.20, 3.27 [00:50:59] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.31, 4.10, 3.61 [00:52:59] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.21, 3.69, 3.52 [00:53:47] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.85, 3.72, 3.65 [00:54:59] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 1.96, 3.12, 3.33 [00:55:45] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.28, 3.81, 3.68 [00:57:44] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.75, 3.49, 3.59 [00:59:01] RECOVERY - gluster121 Puppet on gluster121 is OK: OK: Puppet is currently enabled, last run 26 seconds ago with 0 failures [00:59:46] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.53, 3.78, 3.32 [01:00:59] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.58, 4.19, 3.72 [01:01:40] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.82, 3.98, 3.74 [01:02:59] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.92, 3.83, 3.65 [01:03:39] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.21, 3.61, 3.63 [01:03:43] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.23, 3.79, 3.46 [01:05:41] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.09, 3.16, 3.27 [01:08:58] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.84, 1.82, 1.41 [01:08:59] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.92, 3.15, 3.40 [01:09:34] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.39, 2.73, 3.20 [01:10:58] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.89, 1.45, 1.32 [01:17:38] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query bellinrattin.it. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [01:18:59] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.26, 4.50, 3.79 [01:19:25] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.55, 3.90, 3.53 [01:19:29] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.32, 3.69, 3.37 [01:20:58] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 5.92, 3.44, 2.08 [01:21:24] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 6.56, 4.92, 3.94 [01:22:52] hi [01:23:17] who is there? [01:26:58] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.12, 1.82, 1.77 [01:30:58] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.18, 1.56, 1.68 [01:31:45] PROBLEM - gluster111 Puppet on gluster111 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [01:33:07] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.44, 1.75, 1.98 [01:43:07] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.01, 1.76, 1.85 [01:45:07] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.77, 1.74, 1.83 [01:47:04] RECOVERY - dnd.bellinrattin.it - reverse DNS on sslhost is OK: SSL OK - dnd.bellinrattin.it reverse DNS resolves to cp20.miraheze.org - CNAME OK [01:47:07] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.45, 1.95, 1.89 [01:55:07] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.53, 1.88, 1.94 [01:56:59] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.27, 3.39, 3.91 [01:58:58] Hi Hispano76 [02:00:41] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 8.27, 3.96, 2.20 [02:06:59] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.50, 4.04, 3.96 [02:07:07] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.32, 1.46, 1.67 [02:12:35] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 0.88, 1.83, 1.89 [02:12:59] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.92, 3.84, 3.97 [02:14:34] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.93, 2.15, 1.99 [02:16:33] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.18, 1.80, 1.88 [02:16:59] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.44, 4.30, 4.07 [02:18:11] PROBLEM - gluster101 Puppet on gluster101 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [02:19:07] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.75, 1.97, 1.75 [02:20:31] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 3.51, 2.59, 2.15 [02:22:59] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.72, 3.45, 3.96 [02:22:59] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.98, 3.76, 3.92 [02:23:06] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.64, 1.95, 1.81 [02:24:30] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.37, 1.95, 1.99 [02:26:53] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.75, 3.34, 3.94 [02:29:07] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.35, 1.55, 1.68 [02:29:45] RECOVERY - gluster111 Puppet on gluster111 is OK: OK: Puppet is currently enabled, last run 25 seconds ago with 0 failures [02:30:27] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.97, 1.22, 1.64 [02:30:53] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.19, 3.76, 3.95 [02:30:59] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.18, 4.00, 3.94 [02:32:59] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.85, 3.53, 3.77 [02:34:53] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.52, 3.42, 3.80 [02:38:53] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.48, 3.87, 3.88 [02:38:59] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.95, 3.48, 3.53 [02:39:07] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.34, 2.03, 1.83 [02:40:59] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.26, 3.74, 3.71 [02:40:59] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.22, 3.59, 3.59 [02:41:07] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.95, 2.00, 1.84 [02:42:02] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.09, 1.89, 1.59 [02:42:53] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.26, 3.53, 3.75 [02:42:59] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.07, 3.53, 3.55 [02:44:53] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 6.72, 4.65, 4.12 [02:45:18] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 3.00, 3.20, 2.26 [02:45:58] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.13, 1.68, 1.58 [02:47:07] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.30, 2.00, 1.88 [02:55:13] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 0.64, 1.69, 1.99 [02:57:12] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 1.54, 1.83, 2.01 [02:59:11] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.20, 1.53, 1.87 [03:03:07] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.55, 1.86, 1.97 [03:03:09] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.03, 1.28, 1.69 [03:16:01] RECOVERY - gluster101 Puppet on gluster101 is OK: OK: Puppet is currently enabled, last run 19 seconds ago with 0 failures [03:19:07] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.26, 1.91, 1.87 [03:25:07] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.56, 1.84, 1.89 [03:26:59] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.74, 3.60, 3.99 [03:28:59] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.26, 4.60, 4.33 [03:31:54] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.68, 1.85, 1.55 [03:32:59] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.35, 3.53, 3.97 [03:33:01] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 1.48, 2.05, 1.56 [03:33:53] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.03, 1.52, 1.47 [03:34:59] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.47, 1.50, 1.42 [03:36:59] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.04, 3.88, 3.99 [03:38:59] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.22, 3.83, 3.97 [03:41:07] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.48, 1.54, 1.69 [03:48:00] PROBLEM - gluster101 Puppet on gluster101 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [03:48:59] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.88, 4.01, 3.92 [03:49:07] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.07, 1.82, 1.74 [03:50:53] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.84, 3.58, 3.95 [03:52:53] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.21, 4.14, 4.09 [03:53:07] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.36, 1.79, 1.76 [03:54:59] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.88, 3.79, 3.91 [03:57:07] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.44, 1.64, 1.70 [03:58:59] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.30, 3.79, 3.99 [04:00:53] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.80, 3.39, 3.82 [04:00:59] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.05, 3.74, 3.93 [04:02:59] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.68, 4.00, 3.88 [04:04:59] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.83, 3.93, 3.99 [04:06:53] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.73, 3.81, 3.87 [04:06:59] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.59, 3.42, 3.69 [04:08:53] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.03, 3.43, 3.72 [04:10:53] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.03, 3.80, 3.83 [04:12:59] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.73, 3.88, 3.72 [04:14:53] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 1.79, 3.15, 3.59 [04:14:59] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 1.93, 2.77, 3.36 [04:16:00] RECOVERY - gluster101 Puppet on gluster101 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [04:16:59] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.23, 3.49, 3.60 [04:18:59] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.13, 3.62, 3.53 [04:19:07] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.70, 2.04, 1.76 [04:20:59] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.72, 3.39, 3.45 [04:22:53] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.71, 3.02, 3.38 [04:22:59] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.47, 3.66, 3.54 [04:22:59] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.02, 3.64, 3.66 [04:24:59] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.87, 3.36, 3.44 [04:24:59] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.37, 3.46, 3.59 [04:26:53] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.74, 3.41, 3.44 [04:26:59] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.67, 3.68, 3.54 [04:28:53] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.48, 3.81, 3.58 [04:33:07] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.46, 1.87, 1.96 [04:34:53] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.54, 3.93, 3.62 [04:34:59] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.77, 4.00, 3.74 [04:35:07] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.62, 2.10, 2.03 [04:38:53] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 1.71, 3.23, 3.45 [04:38:59] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.31, 3.62, 3.70 [04:40:53] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.50, 3.11, 3.38 [04:42:59] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.63, 3.52, 3.59 [04:44:53] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.28, 3.89, 3.65 [04:44:59] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.50, 3.98, 3.66 [04:46:53] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.17, 3.73, 3.63 [04:46:59] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.91, 3.68, 3.68 [04:48:03] [02mediawiki] 07Universal-Omega closed pull request 03#7747: Bump extensions/Moderation from `7e7b55c` to `20f6879` - 13https://github.com/miraheze/mediawiki/pull/7747 [04:48:04] [url] Page not found · GitHub · GitHub | github.com [04:48:04] [02miraheze/mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_38/extensions/Moderation-20f6879 [04:48:06] [02mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_38/extensions/Moderation-20f6879 - 13https://github.com/miraheze/mediawiki [04:48:07] [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03REL1_38 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/2ae1c3a0966b...5b4d484432ce [04:48:08] [url] Comparing 2ae1c3a0966b...5b4d484432ce · miraheze/mediawiki · GitHub | github.com [04:48:09] [02miraheze/mediawiki] 07dependabot[bot] 035b4d484 - Bump extensions/Moderation from `7e7b55c` to `20f6879` (#7747) [04:48:19] [02mediawiki] 07Universal-Omega labeled pull request 03#7727: Bump extensions/RottenLinks from `8796456` to `29bb9c7` - 13https://github.com/miraheze/mediawiki/pull/7727 [04:48:19] [url] Page not found · GitHub · GitHub | github.com [04:48:20] [02mediawiki] 07Universal-Omega labeled pull request 03#7728: Bump extensions/CreateWiki from `93ad283` to `ed0639a` - 13https://github.com/miraheze/mediawiki/pull/7728 [04:48:21] [url] Page not found · GitHub · GitHub | github.com [04:48:22] [02mediawiki] 07Universal-Omega labeled pull request 03#7729: Bump extensions/Arrays from `ce3f628` to `6ac129a` - 13https://github.com/miraheze/mediawiki/pull/7729 [04:48:22] [url] Page not found · GitHub · GitHub | github.com [04:48:23] [02mediawiki] 07Universal-Omega labeled pull request 03#7730: Bump extensions/PageTriage from `182376b` to `f7c61b6` - 13https://github.com/miraheze/mediawiki/pull/7730 [04:48:24] ... [04:48:25] [02mediawiki] 07Universal-Omega labeled pull request 03#7731: Bump skins/Evelution from `ff670ad` to `4f3f6d3` - 13https://github.com/miraheze/mediawiki/pull/7731 [04:48:25] ... [04:48:26] [02mediawiki] 07Universal-Omega labeled pull request 03#7732: Bump extensions/SpriteSheet from `f24e809` to `cecfdc8` - 13https://github.com/miraheze/mediawiki/pull/7732 [04:48:27] ... [04:48:28] [02mediawiki] 07Universal-Omega labeled pull request 03#7733: Bump extensions/GrowthExperiments from `57ab500` to `8413d8b` - 13https://github.com/miraheze/mediawiki/pull/7733 [04:48:28] [url] Page not found · GitHub · GitHub | github.com [04:48:29] [02mediawiki] 07Universal-Omega labeled pull request 03#7734: Bump extensions/WikiSEO from `fa1c3b4` to `0d34c0d` - 13https://github.com/miraheze/mediawiki/pull/7734 [04:48:30] [url] Page not found · GitHub · GitHub | github.com [04:48:31] [02mediawiki] 07Universal-Omega labeled pull request 03#7735: Bump extensions/Variables from `5f46b7d` to `b28b78e` - 13https://github.com/miraheze/mediawiki/pull/7735 [04:48:32] [02mediawiki] 07Universal-Omega labeled pull request 03#7736: Bump extensions/StructuredNavigation from `eac23fe` to `005f244` - 13https://github.com/miraheze/mediawiki/pull/7736 [04:48:34] [02mediawiki] 07Universal-Omega labeled pull request 03#7737: Bump extensions/PDFEmbed from `dff6fac` to `1170024` - 13https://github.com/miraheze/mediawiki/pull/7737 [04:48:35] [02mediawiki] 07Universal-Omega labeled pull request 03#7738: Bump extensions/DataDump from `d880fb9` to `0c39251` - 13https://github.com/miraheze/mediawiki/pull/7738 [04:48:37] [02mediawiki] 07Universal-Omega labeled pull request 03#7739: Bump extensions/WikiDiscover from `10ea74c` to `0fcef42` - 13https://github.com/miraheze/mediawiki/pull/7739 [04:48:38] [02mediawiki] 07Universal-Omega labeled pull request 03#7740: Bump extensions/ManageWiki from `60a2f51` to `e654457` - 13https://github.com/miraheze/mediawiki/pull/7740 [04:48:40] [02mediawiki] 07Universal-Omega labeled pull request 03#7741: Bump extensions/TitleBlacklist from `76ff44d` to `6217bfa` - 13https://github.com/miraheze/mediawiki/pull/7741 [04:48:41] [02mediawiki] 07Universal-Omega labeled pull request 03#7742: Bump extensions/MirahezeMagic from `648b9f9` to `c400474` - 13https://github.com/miraheze/mediawiki/pull/7742 [04:48:43] [02mediawiki] 07Universal-Omega labeled pull request 03#7743: Bump extensions/RemovePII from `d7a42ec` to `20686b4` - 13https://github.com/miraheze/mediawiki/pull/7743 [04:48:44] [02mediawiki] 07Universal-Omega labeled pull request 03#7744: Bump extensions/IncidentReporting from `e598dac` to `9d3f347` - 13https://github.com/miraheze/mediawiki/pull/7744 [04:48:46] [02mediawiki] 07Universal-Omega labeled pull request 03#7745: Bump extensions/LockAuthor from `8c03267` to `fadbef1` - 13https://github.com/miraheze/mediawiki/pull/7745 [04:48:47] [02mediawiki] 07Universal-Omega labeled pull request 03#7746: Bump extensions/GlobalNewFiles from `48001f0` to `b314d6b` - 13https://github.com/miraheze/mediawiki/pull/7746 [04:48:49] [02mediawiki] 07Universal-Omega labeled pull request 03#7748: Bump extensions/MatomoAnalytics from `423bd1f` to `52c204f` - 13https://github.com/miraheze/mediawiki/pull/7748 [04:48:50] [02mediawiki] 07Universal-Omega labeled pull request 03#7749: Bump extensions/YouTube from `258af9f` to `01ce5f3` - 13https://github.com/miraheze/mediawiki/pull/7749 [04:48:52] [02mediawiki] 07github-actions[bot] closed pull request 03#7727: Bump extensions/RottenLinks from `8796456` to `29bb9c7` - 13https://github.com/miraheze/mediawiki/pull/7727 [04:48:53] [02miraheze/mediawiki] 07github-actions[bot] pushed 031 commit to 03REL1_38 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/5b4d484432ce...4535deda72a6 [04:48:54] [url] Comparing 5b4d484432ce...4535deda72a6 · miraheze/mediawiki · GitHub | github.com [04:48:55] [02miraheze/mediawiki] 07dependabot[bot] 034535ded - Bump extensions/RottenLinks from `8796456` to `29bb9c7` (#7727) [04:48:56] [02miraheze/mediawiki] 07github-actions[bot] deleted branch 03dependabot/submodules/REL1_38/extensions/RottenLinks-29bb9c7 [04:48:58] [02mediawiki] 07github-actions[bot] deleted branch 03dependabot/submodules/REL1_38/extensions/RottenLinks-29bb9c7 - 13https://github.com/miraheze/mediawiki [04:48:58] [url] Page not found · GitHub · GitHub | github.com [04:48:59] [02mediawiki] 07github-actions[bot] unlabeled pull request 03#7727: Bump extensions/RottenLinks from `8796456` to `29bb9c7` - 13https://github.com/miraheze/mediawiki/pull/7727 [04:49:00] [url] Page not found · GitHub · GitHub | github.com [04:49:01] [02mediawiki] 07github-actions[bot] closed pull request 03#7730: Bump extensions/PageTriage from `182376b` to `f7c61b6` - 13https://github.com/miraheze/mediawiki/pull/7730 [04:49:01] [url] Page not found · GitHub · GitHub | github.com [04:49:02] [02miraheze/mediawiki] 07github-actions[bot] deleted branch 03dependabot/submodules/REL1_38/extensions/PageTriage-f7c61b6 [04:49:04] [02miraheze/mediawiki] 07github-actions[bot] pushed 031 commit to 03REL1_38 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/4535deda72a6...ee93da6285db [04:49:04] [url] Comparing 4535deda72a6...ee93da6285db · miraheze/mediawiki · GitHub | github.com [04:49:05] [02miraheze/mediawiki] 07dependabot[bot] 03ee93da6 - Bump extensions/PageTriage from `182376b` to `f7c61b6` (#7730) [04:49:07] [02mediawiki] 07github-actions[bot] deleted branch 03dependabot/submodules/REL1_38/extensions/PageTriage-f7c61b6 - 13https://github.com/miraheze/mediawiki [04:49:07] ... [04:49:08] [02mediawiki] 07github-actions[bot] unlabeled pull request 03#7730: Bump extensions/PageTriage from `182376b` to `f7c61b6` - 13https://github.com/miraheze/mediawiki/pull/7730 [04:49:09] ... [04:49:10] [02mediawiki] 07github-actions[bot] closed pull request 03#7728: Bump extensions/CreateWiki from `93ad283` to `ed0639a` - 13https://github.com/miraheze/mediawiki/pull/7728 [04:49:10] [url] Page not found · GitHub · GitHub | github.com [04:49:11] [02miraheze/mediawiki] 07github-actions[bot] deleted branch 03dependabot/submodules/REL1_38/extensions/CreateWiki-ed0639a [04:49:13] [02miraheze/mediawiki] 07github-actions[bot] pushed 031 commit to 03REL1_38 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/ee93da6285db...83053c16017a [04:49:13] [url] Comparing ee93da6285db...83053c16017a · miraheze/mediawiki · GitHub | github.com [04:49:14] [02miraheze/mediawiki] 07dependabot[bot] 0383053c1 - Bump extensions/CreateWiki from `93ad283` to `ed0639a` (#7728) [04:49:16] [02mediawiki] 07github-actions[bot] deleted branch 03dependabot/submodules/REL1_38/extensions/CreateWiki-ed0639a - 13https://github.com/miraheze/mediawiki [04:49:16] [url] Page not found · GitHub · GitHub | github.com [04:49:17] [02mediawiki] 07github-actions[bot] closed pull request 03#7736: Bump extensions/StructuredNavigation from `eac23fe` to `005f244` - 13https://github.com/miraheze/mediawiki/pull/7736 [04:49:18] [url] Page not found · GitHub · GitHub | github.com [04:49:19] [02mediawiki] 07github-actions[bot] unlabeled pull request 03#7728: Bump extensions/CreateWiki from `93ad283` to `ed0639a` - 13https://github.com/miraheze/mediawiki/pull/7728 [04:49:19] [url] Page not found · GitHub · GitHub | github.com [04:49:20] [02miraheze/mediawiki] 07github-actions[bot] deleted branch 03dependabot/submodules/REL1_38/extensions/StructuredNavigation-005f244 [04:49:22] [02miraheze/mediawiki] 07github-actions[bot] pushed 031 commit to 03REL1_38 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/83053c16017a...39510ce064c4 [04:49:22] [url] Comparing 83053c16017a...39510ce064c4 · miraheze/mediawiki · GitHub | github.com [04:49:23] [02miraheze/mediawiki] 07dependabot[bot] 0339510ce - Bump extensions/StructuredNavigation from `eac23fe` to `005f244` (#7736) [04:49:25] [02mediawiki] 07github-actions[bot] deleted branch 03dependabot/submodules/REL1_38/extensions/StructuredNavigation-005f244 - 13https://github.com/miraheze/mediawiki [04:49:25] [url] Page not found · GitHub · GitHub | github.com [04:49:26] [02mediawiki] 07github-actions[bot] unlabeled pull request 03#7736: Bump extensions/StructuredNavigation from `eac23fe` to `005f244` - 13https://github.com/miraheze/mediawiki/pull/7736 [04:49:27] ... [04:49:28] [02mediawiki] 07github-actions[bot] closed pull request 03#7733: Bump extensions/GrowthExperiments from `57ab500` to `8413d8b` - 13https://github.com/miraheze/mediawiki/pull/7733 [04:49:29] ... [04:49:29] [02miraheze/mediawiki] 07github-actions[bot] pushed 031 commit to 03REL1_38 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/39510ce064c4...1a4fe38c3e29 [04:49:30] [url] Comparing 39510ce064c4...1a4fe38c3e29 · miraheze/mediawiki · GitHub | github.com [04:49:31] [02miraheze/mediawiki] 07dependabot[bot] 031a4fe38 - Bump extensions/GrowthExperiments from `57ab500` to `8413d8b` (#7733) [04:49:32] [02miraheze/mediawiki] 07github-actions[bot] deleted branch 03dependabot/submodules/REL1_38/extensions/GrowthExperiments-8413d8b [04:49:34] [02mediawiki] 07github-actions[bot] deleted branch 03dependabot/submodules/REL1_38/extensions/GrowthExperiments-8413d8b - 13https://github.com/miraheze/mediawiki [04:49:34] [url] Page not found · GitHub · GitHub | github.com [04:49:35] [02mediawiki] 07github-actions[bot] unlabeled pull request 03#7733: Bump extensions/GrowthExperiments from `57ab500` to `8413d8b` - 13https://github.com/miraheze/mediawiki/pull/7733 [04:49:36] [url] Page not found · GitHub · GitHub | github.com [04:49:37] [02mediawiki] 07github-actions[bot] closed pull request 03#7738: Bump extensions/DataDump from `d880fb9` to `0c39251` - 13https://github.com/miraheze/mediawiki/pull/7738 [04:49:37] [url] Page not found · GitHub · GitHub | github.com [04:49:38] [02miraheze/mediawiki] 07github-actions[bot] pushed 031 commit to 03REL1_38 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/1a4fe38c3e29...ab9dc6c00ab7 [04:49:39] [url] Comparing 1a4fe38c3e29...ab9dc6c00ab7 · miraheze/mediawiki · GitHub | github.com [04:49:40] [02miraheze/mediawiki] 07dependabot[bot] 03ab9dc6c - Bump extensions/DataDump from `d880fb9` to `0c39251` (#7738) [04:49:41] [02miraheze/mediawiki] 07github-actions[bot] deleted branch 03dependabot/submodules/REL1_38/extensions/DataDump-0c39251 [04:49:43] [02mediawiki] 07github-actions[bot] deleted branch 03dependabot/submodules/REL1_38/extensions/DataDump-0c39251 - 13https://github.com/miraheze/mediawiki [04:49:43] [url] Page not found · GitHub · GitHub | github.com [04:49:44] [02mediawiki] 07github-actions[bot] closed pull request 03#7737: Bump extensions/PDFEmbed from `dff6fac` to `1170024` - 13https://github.com/miraheze/mediawiki/pull/7737 [04:49:45] [url] Page not found · GitHub · GitHub | github.com [04:49:46] [02mediawiki] 07github-actions[bot] unlabeled pull request 03#7738: Bump extensions/DataDump from `d880fb9` to `0c39251` - 13https://github.com/miraheze/mediawiki/pull/7738 [04:49:46] ... [04:49:47] [02miraheze/mediawiki] 07github-actions[bot] deleted branch 03dependabot/submodules/REL1_38/extensions/PDFEmbed-1170024 [04:49:49] [02miraheze/mediawiki] 07github-actions[bot] pushed 031 commit to 03REL1_38 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/ab9dc6c00ab7...dc6faf1225d9 [04:49:50] [url] Comparing ab9dc6c00ab7...dc6faf1225d9 · miraheze/mediawiki · GitHub | github.com [04:49:50] [02miraheze/mediawiki] 07dependabot[bot] 03dc6faf1 - Bump extensions/PDFEmbed from `dff6fac` to `1170024` (#7737) [04:49:52] [02mediawiki] 07github-actions[bot] deleted branch 03dependabot/submodules/REL1_38/extensions/PDFEmbed-1170024 - 13https://github.com/miraheze/mediawiki [04:49:52] ... [04:49:53] [02mediawiki] 07github-actions[bot] closed pull request 03#7741: Bump extensions/TitleBlacklist from `76ff44d` to `6217bfa` - 13https://github.com/miraheze/mediawiki/pull/7741 [04:49:54] [url] Page not found · GitHub · GitHub | github.com [04:49:55] [02miraheze/mediawiki] 07github-actions[bot] pushed 031 commit to 03REL1_38 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/dc6faf1225d9...059e4a199756 [04:49:55] [url] Comparing dc6faf1225d9...059e4a199756 · miraheze/mediawiki · GitHub | github.com [04:49:56] [02miraheze/mediawiki] 07dependabot[bot] 03059e4a1 - Bump extensions/TitleBlacklist from `76ff44d` to `6217bfa` (#7741) [04:49:58] [02mediawiki] 07github-actions[bot] unlabeled pull request 03#7737: Bump extensions/PDFEmbed from `dff6fac` to `1170024` - 13https://github.com/miraheze/mediawiki/pull/7737 [04:49:58] [url] Page not found · GitHub · GitHub | github.com [04:49:59] [02miraheze/mediawiki] 07github-actions[bot] deleted branch 03dependabot/submodules/REL1_38/extensions/TitleBlacklist-6217bfa [04:50:01] [02mediawiki] 07github-actions[bot] deleted branch 03dependabot/submodules/REL1_38/extensions/TitleBlacklist-6217bfa - 13https://github.com/miraheze/mediawiki [04:50:01] [url] Page not found · GitHub · GitHub | github.com [04:50:02] [02mediawiki] 07github-actions[bot] unlabeled pull request 03#7741: Bump extensions/TitleBlacklist from `76ff44d` to `6217bfa` - 13https://github.com/miraheze/mediawiki/pull/7741 [04:50:03] [url] Page not found · GitHub · GitHub | github.com [04:50:04] [02mediawiki] 07github-actions[bot] closed pull request 03#7743: Bump extensions/RemovePII from `d7a42ec` to `20686b4` - 13https://github.com/miraheze/mediawiki/pull/7743 [04:50:04] [url] Page not found · GitHub · GitHub | github.com [04:50:05] [02miraheze/mediawiki] 07github-actions[bot] deleted branch 03dependabot/submodules/REL1_38/extensions/RemovePII-20686b4 [04:50:07] [02mediawiki] 07github-actions[bot] deleted branch 03dependabot/submodules/REL1_38/extensions/RemovePII-20686b4 - 13https://github.com/miraheze/mediawiki [04:50:07] ... [04:50:08] [02miraheze/mediawiki] 07github-actions[bot] pushed 031 commit to 03REL1_38 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/059e4a199756...c3461e3cc2f8 [04:50:09] [url] Comparing 059e4a199756...c3461e3cc2f8 · miraheze/mediawiki · GitHub | github.com [04:50:10] [02miraheze/mediawiki] 07dependabot[bot] 03c3461e3 - Bump extensions/RemovePII from `d7a42ec` to `20686b4` (#7743) [04:50:11] [02mediawiki] 07github-actions[bot] unlabeled pull request 03#7743: Bump extensions/RemovePII from `d7a42ec` to `20686b4` - 13https://github.com/miraheze/mediawiki/pull/7743 [04:50:12] ... [04:50:13] [02mediawiki] 07github-actions[bot] closed pull request 03#7746: Bump extensions/GlobalNewFiles from `48001f0` to `b314d6b` - 13https://github.com/miraheze/mediawiki/pull/7746 [04:50:13] [url] Page not found · GitHub · GitHub | github.com [04:50:14] [02miraheze/mediawiki] 07github-actions[bot] pushed 031 commit to 03REL1_38 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/c3461e3cc2f8...f30ff3891cca [04:50:15] [url] Comparing c3461e3cc2f8...f30ff3891cca · miraheze/mediawiki · GitHub | github.com [04:50:16] [02miraheze/mediawiki] 07dependabot[bot] 03f30ff38 - Bump extensions/GlobalNewFiles from `48001f0` to `b314d6b` (#7746) [04:50:17] [02miraheze/mediawiki] 07github-actions[bot] deleted branch 03dependabot/submodules/REL1_38/extensions/GlobalNewFiles-b314d6b [04:50:19] [02mediawiki] 07github-actions[bot] deleted branch 03dependabot/submodules/REL1_38/extensions/GlobalNewFiles-b314d6b - 13https://github.com/miraheze/mediawiki [04:50:19] [url] Page not found · GitHub · GitHub | github.com [04:50:20] [02mediawiki] 07github-actions[bot] closed pull request 03#7734: Bump extensions/WikiSEO from `fa1c3b4` to `0d34c0d` - 13https://github.com/miraheze/mediawiki/pull/7734 [04:50:21] [url] Page not found · GitHub · GitHub | github.com [04:50:22] [02mediawiki] 07github-actions[bot] unlabeled pull request 03#7746: Bump extensions/GlobalNewFiles from `48001f0` to `b314d6b` - 13https://github.com/miraheze/mediawiki/pull/7746 [04:50:22] [url] Page not found · GitHub · GitHub | github.com [04:50:23] [02miraheze/mediawiki] 07github-actions[bot] pushed 031 commit to 03REL1_38 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/f30ff3891cca...9570b4819c28 [04:50:24] [url] Comparing f30ff3891cca...9570b4819c28 · miraheze/mediawiki · GitHub | github.com [04:50:25] [02miraheze/mediawiki] 07dependabot[bot] 039570b48 - Bump extensions/WikiSEO from `fa1c3b4` to `0d34c0d` (#7734) [04:50:26] [02miraheze/mediawiki] 07github-actions[bot] deleted branch 03dependabot/submodules/REL1_38/extensions/WikiSEO-0d34c0d [04:50:28] [02mediawiki] 07github-actions[bot] deleted branch 03dependabot/submodules/REL1_38/extensions/WikiSEO-0d34c0d - 13https://github.com/miraheze/mediawiki [04:50:28] [url] Page not found · GitHub · GitHub | github.com [04:50:29] [02mediawiki] 07github-actions[bot] unlabeled pull request 03#7734: Bump extensions/WikiSEO from `fa1c3b4` to `0d34c0d` - 13https://github.com/miraheze/mediawiki/pull/7734 [04:50:30] ... [04:50:31] [02mediawiki] 07github-actions[bot] closed pull request 03#7740: Bump extensions/ManageWiki from `60a2f51` to `e654457` - 13https://github.com/miraheze/mediawiki/pull/7740 [04:50:31] ... [04:50:32] [02miraheze/mediawiki] 07github-actions[bot] pushed 031 commit to 03REL1_38 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/9570b4819c28...8cd9570cf6d3 [04:50:33] [url] Comparing 9570b4819c28...8cd9570cf6d3 · miraheze/mediawiki · GitHub | github.com [04:50:34] [02miraheze/mediawiki] 07dependabot[bot] 038cd9570 - Bump extensions/ManageWiki from `60a2f51` to `e654457` (#7740) [04:50:35] [02miraheze/mediawiki] 07github-actions[bot] deleted branch 03dependabot/submodules/REL1_38/extensions/ManageWiki-e654457 [04:50:37] [02mediawiki] 07github-actions[bot] deleted branch 03dependabot/submodules/REL1_38/extensions/ManageWiki-e654457 - 13https://github.com/miraheze/mediawiki [04:50:37] [url] Page not found · GitHub · GitHub | github.com [04:50:38] [02mediawiki] 07github-actions[bot] closed pull request 03#7739: Bump extensions/WikiDiscover from `10ea74c` to `0fcef42` - 13https://github.com/miraheze/mediawiki/pull/7739 [04:50:39] [url] Page not found · GitHub · GitHub | github.com [04:50:40] [02mediawiki] 07github-actions[bot] unlabeled pull request 03#7740: Bump extensions/ManageWiki from `60a2f51` to `e654457` - 13https://github.com/miraheze/mediawiki/pull/7740 [04:50:40] [url] Page not found · GitHub · GitHub | github.com [04:50:41] [02miraheze/mediawiki] 07github-actions[bot] pushed 031 commit to 03REL1_38 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/8cd9570cf6d3...322fb298daee [04:50:42] [url] Comparing 8cd9570cf6d3...322fb298daee · miraheze/mediawiki · GitHub | github.com [04:50:43] [02miraheze/mediawiki] 07dependabot[bot] 03322fb29 - Bump extensions/WikiDiscover from `10ea74c` to `0fcef42` (#7739) [04:50:44] [02miraheze/mediawiki] 07github-actions[bot] deleted branch 03dependabot/submodules/REL1_38/extensions/WikiDiscover-0fcef42 [04:50:46] [02mediawiki] 07github-actions[bot] deleted branch 03dependabot/submodules/REL1_38/extensions/WikiDiscover-0fcef42 - 13https://github.com/miraheze/mediawiki [04:50:46] [url] Page not found · GitHub · GitHub | github.com [04:50:47] [02mediawiki] 07github-actions[bot] closed pull request 03#7742: Bump extensions/MirahezeMagic from `648b9f9` to `c400474` - 13https://github.com/miraheze/mediawiki/pull/7742 [04:50:48] [url] Page not found · GitHub · GitHub | github.com [04:50:49] [02mediawiki] 07github-actions[bot] unlabeled pull request 03#7739: Bump extensions/WikiDiscover from `10ea74c` to `0fcef42` - 13https://github.com/miraheze/mediawiki/pull/7739 [04:50:49] ... [04:50:50] [02miraheze/mediawiki] 07github-actions[bot] pushed 031 commit to 03REL1_38 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/322fb298daee...d7255facdc94 [04:50:51] [url] Comparing 322fb298daee...d7255facdc94 · miraheze/mediawiki · GitHub | github.com [04:50:52] [02miraheze/mediawiki] 07dependabot[bot] 03d7255fa - Bump extensions/MirahezeMagic from `648b9f9` to `c400474` (#7742) [04:50:53] [02miraheze/mediawiki] 07github-actions[bot] deleted branch 03dependabot/submodules/REL1_38/extensions/MirahezeMagic-c400474 [04:50:55] [02mediawiki] 07github-actions[bot] deleted branch 03dependabot/submodules/REL1_38/extensions/MirahezeMagic-c400474 - 13https://github.com/miraheze/mediawiki [04:50:55] ... [04:50:56] [02mediawiki] 07github-actions[bot] unlabeled pull request 03#7742: Bump extensions/MirahezeMagic from `648b9f9` to `c400474` - 13https://github.com/miraheze/mediawiki/pull/7742 [04:50:57] [url] Page not found · GitHub · GitHub | github.com [04:50:58] [02mediawiki] 07github-actions[bot] closed pull request 03#7744: Bump extensions/IncidentReporting from `e598dac` to `9d3f347` - 13https://github.com/miraheze/mediawiki/pull/7744 [04:50:58] [url] Page not found · GitHub · GitHub | github.com [04:50:59] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.10, 3.68, 3.67 [04:50:59] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.32, 3.11, 3.39 [04:50:59] [02miraheze/mediawiki] 07github-actions[bot] pushed 031 commit to 03REL1_38 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/d7255facdc94...8c472b9c3bb0 [04:51:00] [url] Comparing d7255facdc94...8c472b9c3bb0 · miraheze/mediawiki · GitHub | github.com [04:51:01] [02miraheze/mediawiki] 07dependabot[bot] 038c472b9 - Bump extensions/IncidentReporting from `e598dac` to `9d3f347` (#7744) [04:51:02] [02mediawiki] 07github-actions[bot] deleted branch 03dependabot/submodules/REL1_38/extensions/IncidentReporting-9d3f347 - 13https://github.com/miraheze/mediawiki [04:51:03] [url] Page not found · GitHub · GitHub | github.com [04:51:04] [02miraheze/mediawiki] 07github-actions[bot] deleted branch 03dependabot/submodules/REL1_38/extensions/IncidentReporting-9d3f347 [04:51:05] [02mediawiki] 07github-actions[bot] unlabeled pull request 03#7744: Bump extensions/IncidentReporting from `e598dac` to `9d3f347` - 13https://github.com/miraheze/mediawiki/pull/7744 [04:51:06] [url] Page not found · GitHub · GitHub | github.com [04:51:07] [02mediawiki] 07github-actions[bot] closed pull request 03#7729: Bump extensions/Arrays from `ce3f628` to `6ac129a` - 13https://github.com/miraheze/mediawiki/pull/7729 [04:51:07] [url] Page not found · GitHub · GitHub | github.com [04:51:08] [02miraheze/mediawiki] 07github-actions[bot] deleted branch 03dependabot/submodules/REL1_38/extensions/Arrays-6ac129a [04:51:10] [02miraheze/mediawiki] 07github-actions[bot] pushed 031 commit to 03REL1_38 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/8c472b9c3bb0...702d663dc359 [04:51:10] [url] Comparing 8c472b9c3bb0...702d663dc359 · miraheze/mediawiki · GitHub | github.com [04:51:11] [02miraheze/mediawiki] 07dependabot[bot] 03702d663 - Bump extensions/Arrays from `ce3f628` to `6ac129a` (#7729) [04:51:13] [02mediawiki] 07github-actions[bot] deleted branch 03dependabot/submodules/REL1_38/extensions/Arrays-6ac129a - 13https://github.com/miraheze/mediawiki [04:51:13] ... [04:51:14] [02mediawiki] 07github-actions[bot] closed pull request 03#7745: Bump extensions/LockAuthor from `8c03267` to `fadbef1` - 13https://github.com/miraheze/mediawiki/pull/7745 [04:51:15] ... [04:51:16] [02mediawiki] 07github-actions[bot] unlabeled pull request 03#7729: Bump extensions/Arrays from `ce3f628` to `6ac129a` - 13https://github.com/miraheze/mediawiki/pull/7729 [04:51:16] [url] Page not found · GitHub · GitHub | github.com [04:51:17] [02miraheze/mediawiki] 07github-actions[bot] pushed 031 commit to 03REL1_38 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/702d663dc359...56eddfa1eaf2 [04:51:18] [url] Comparing 702d663dc359...56eddfa1eaf2 · miraheze/mediawiki · GitHub | github.com [04:51:19] [02miraheze/mediawiki] 07dependabot[bot] 0356eddfa - Bump extensions/LockAuthor from `8c03267` to `fadbef1` (#7745) [04:51:20] [02miraheze/mediawiki] 07github-actions[bot] deleted branch 03dependabot/submodules/REL1_38/extensions/LockAuthor-fadbef1 [04:51:22] [02mediawiki] 07github-actions[bot] deleted branch 03dependabot/submodules/REL1_38/extensions/LockAuthor-fadbef1 - 13https://github.com/miraheze/mediawiki [04:51:22] [url] Page not found · GitHub · GitHub | github.com [04:51:23] [02mediawiki] 07github-actions[bot] unlabeled pull request 03#7745: Bump extensions/LockAuthor from `8c03267` to `fadbef1` - 13https://github.com/miraheze/mediawiki/pull/7745 [04:51:24] [url] Page not found · GitHub · GitHub | github.com [04:51:25] [02mediawiki] 07github-actions[bot] closed pull request 03#7748: Bump extensions/MatomoAnalytics from `423bd1f` to `52c204f` - 13https://github.com/miraheze/mediawiki/pull/7748 [04:51:25] [url] Page not found · GitHub · GitHub | github.com [04:51:26] [02miraheze/mediawiki] 07github-actions[bot] deleted branch 03dependabot/submodules/REL1_38/extensions/MatomoAnalytics-52c204f [04:51:28] [02miraheze/mediawiki] 07github-actions[bot] pushed 031 commit to 03REL1_38 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/56eddfa1eaf2...c9bd7306f0db [04:51:28] [url] Comparing 56eddfa1eaf2...c9bd7306f0db · miraheze/mediawiki · GitHub | github.com [04:51:29] [02miraheze/mediawiki] 07dependabot[bot] 03c9bd730 - Bump extensions/MatomoAnalytics from `423bd1f` to `52c204f` (#7748) [04:51:31] [02mediawiki] 07github-actions[bot] deleted branch 03dependabot/submodules/REL1_38/extensions/MatomoAnalytics-52c204f - 13https://github.com/miraheze/mediawiki [04:51:31] [url] Page not found · GitHub · GitHub | github.com [04:51:32] [02mediawiki] 07github-actions[bot] unlabeled pull request 03#7748: Bump extensions/MatomoAnalytics from `423bd1f` to `52c204f` - 13https://github.com/miraheze/mediawiki/pull/7748 [04:51:33] ... [04:51:34] [02mediawiki] 07github-actions[bot] closed pull request 03#7735: Bump extensions/Variables from `5f46b7d` to `b28b78e` - 13https://github.com/miraheze/mediawiki/pull/7735 [04:51:34] ... [04:51:35] [02miraheze/mediawiki] 07github-actions[bot] pushed 031 commit to 03REL1_38 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/c9bd7306f0db...2a6e2ecac531 [04:51:36] [url] Comparing c9bd7306f0db...2a6e2ecac531 · miraheze/mediawiki · GitHub | github.com [04:51:37] [02miraheze/mediawiki] 07dependabot[bot] 032a6e2ec - Bump extensions/Variables from `5f46b7d` to `b28b78e` (#7735) [04:51:38] [02miraheze/mediawiki] 07github-actions[bot] deleted branch 03dependabot/submodules/REL1_38/extensions/Variables-b28b78e [04:51:40] [02mediawiki] 07github-actions[bot] deleted branch 03dependabot/submodules/REL1_38/extensions/Variables-b28b78e - 13https://github.com/miraheze/mediawiki [04:51:40] [url] Page not found · GitHub · GitHub | github.com [04:51:41] [02mediawiki] 07github-actions[bot] unlabeled pull request 03#7735: Bump extensions/Variables from `5f46b7d` to `b28b78e` - 13https://github.com/miraheze/mediawiki/pull/7735 [04:51:42] [url] Page not found · GitHub · GitHub | github.com [04:51:43] [02mediawiki] 07github-actions[bot] closed pull request 03#7732: Bump extensions/SpriteSheet from `f24e809` to `cecfdc8` - 13https://github.com/miraheze/mediawiki/pull/7732 [04:51:43] [url] Page not found · GitHub · GitHub | github.com [04:51:44] [02miraheze/mediawiki] 07github-actions[bot] pushed 031 commit to 03REL1_38 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/2a6e2ecac531...3eb1dbd41004 [04:51:45] [url] Comparing 2a6e2ecac531...3eb1dbd41004 · miraheze/mediawiki · GitHub | github.com [04:51:46] [02miraheze/mediawiki] 07dependabot[bot] 033eb1dbd - Bump extensions/SpriteSheet from `f24e809` to `cecfdc8` (#7732) [04:51:48] [02miraheze/mediawiki] 07github-actions[bot] deleted branch 03dependabot/submodules/REL1_38/extensions/SpriteSheet-cecfdc8 [04:51:49] [02mediawiki] 07github-actions[bot] deleted branch 03dependabot/submodules/REL1_38/extensions/SpriteSheet-cecfdc8 - 13https://github.com/miraheze/mediawiki [04:51:49] [url] Page not found · GitHub · GitHub | github.com [04:51:50] [02mediawiki] 07github-actions[bot] unlabeled pull request 03#7732: Bump extensions/SpriteSheet from `f24e809` to `cecfdc8` - 13https://github.com/miraheze/mediawiki/pull/7732 [04:51:51] [url] Page not found · GitHub · GitHub | github.com [04:51:52] [02mediawiki] 07github-actions[bot] closed pull request 03#7749: Bump extensions/YouTube from `258af9f` to `01ce5f3` - 13https://github.com/miraheze/mediawiki/pull/7749 [04:51:52] ... [04:51:53] [02miraheze/mediawiki] 07github-actions[bot] pushed 031 commit to 03REL1_38 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/3eb1dbd41004...1622a7088a29 [04:51:54] [url] Comparing 3eb1dbd41004...1622a7088a29 · miraheze/mediawiki · GitHub | github.com [04:51:55] [02miraheze/mediawiki] 07dependabot[bot] 031622a70 - Bump extensions/YouTube from `258af9f` to `01ce5f3` (#7749) [04:51:56] [02mediawiki] 07github-actions[bot] deleted branch 03dependabot/submodules/REL1_38/extensions/YouTube-01ce5f3 - 13https://github.com/miraheze/mediawiki [04:51:57] ... [04:51:58] [02miraheze/mediawiki] 07github-actions[bot] deleted branch 03dependabot/submodules/REL1_38/extensions/YouTube-01ce5f3 [04:51:59] [02mediawiki] 07github-actions[bot] unlabeled pull request 03#7749: Bump extensions/YouTube from `258af9f` to `01ce5f3` - 13https://github.com/miraheze/mediawiki/pull/7749 [04:52:00] [url] Page not found · GitHub · GitHub | github.com [04:52:01] [02mediawiki] 07github-actions[bot] closed pull request 03#7731: Bump skins/Evelution from `ff670ad` to `4f3f6d3` - 13https://github.com/miraheze/mediawiki/pull/7731 [04:52:01] [url] Page not found · GitHub · GitHub | github.com [04:52:02] [02miraheze/mediawiki] 07github-actions[bot] pushed 031 commit to 03REL1_38 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/1622a7088a29...6ded66661a8e [04:52:03] [url] Comparing 1622a7088a29...6ded66661a8e · miraheze/mediawiki · GitHub | github.com [04:52:04] [02miraheze/mediawiki] 07dependabot[bot] 036ded666 - Bump skins/Evelution from `ff670ad` to `4f3f6d3` (#7731) [04:52:05] [02miraheze/mediawiki] 07github-actions[bot] deleted branch 03dependabot/submodules/REL1_38/skins/Evelution-4f3f6d3 [04:52:07] [02mediawiki] 07github-actions[bot] deleted branch 03dependabot/submodules/REL1_38/skins/Evelution-4f3f6d3 - 13https://github.com/miraheze/mediawiki [04:52:07] [url] Page not found · GitHub · GitHub | github.com [04:52:08] [02mediawiki] 07github-actions[bot] unlabeled pull request 03#7731: Bump skins/Evelution from `ff670ad` to `4f3f6d3` - 13https://github.com/miraheze/mediawiki/pull/7731 [04:52:09] [url] Page not found · GitHub · GitHub | github.com [04:52:59] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.22, 3.40, 3.57 [04:53:19] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.50, 1.75, 1.48 [04:55:18] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.19, 1.47, 1.41 [04:56:53] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 1.92, 2.71, 3.22 [04:56:59] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.30, 2.90, 3.32 [04:59:07] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.63, 1.80, 1.97 [05:00:53] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.82, 3.43, 3.48 [05:00:59] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.87, 3.60, 3.60 [05:01:07] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.18, 1.90, 1.98 [05:02:11] PROBLEM - wiki.mistleague.io - reverse DNS on sslhost is WARNING: NXDOMAIN: The DNS query name does not exist: mistleague.io. [05:04:53] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.13, 3.02, 3.32 [05:06:59] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 3.10, 3.20, 3.40 [05:17:52] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.40, 4.11, 3.64 [05:19:43] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.51, 3.74, 3.52 [05:21:49] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.14, 3.93, 3.69 [05:23:40] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.82, 3.31, 3.41 [05:23:52] PROBLEM - wiki.msnld.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.msnld.com' expires in 15 day(s) (Wed 06 Jul 2022 05:11:48 GMT +0000). [05:25:38] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.00, 2.86, 3.23 [05:25:46] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 1.94, 2.93, 3.33 [05:31:36] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/ac74bd0e767e...c10dc38ca416 [05:31:36] [url] Comparing ac74bd0e767e...c10dc38ca416 · miraheze/ssl · GitHub | github.com [05:31:37] [02miraheze/ssl] 07MirahezeSSLBot 03c10dc38 - Bot: Update SSL cert for wiki.msnld.com [05:35:30] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.74, 3.56, 3.33 [05:37:20] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.54, 3.57, 3.16 [05:39:19] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.26, 3.08, 3.03 [05:41:25] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.46, 3.33, 3.35 [05:45:01] !log sudo service ircrcbot start [05:45:07] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:49:13] !log moved survey data to survey2021 and deleted entries from survey (db101) [05:49:18] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:55:02] [02MirahezeMagic] 07AgentIsai opened pull request 03#341: Miraheze Survey 2022 - 13https://github.com/miraheze/MirahezeMagic/pull/341 [05:55:02] [url] Page not found · GitHub · GitHub | github.com [05:57:37] miraheze/MirahezeMagic - AgentIsai the build has errored. [06:01:01] PROBLEM - gluster121 Puppet on gluster121 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [06:01:45] PROBLEM - gluster111 Puppet on gluster111 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [06:03:59] !log changed viewpolicy for 2 phab files [06:04:04] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:08:36] [02MirahezeMagic] 07AgentIsai synchronize pull request 03#341: Miraheze Survey 2022 - 13https://github.com/miraheze/MirahezeMagic/pull/341 [06:08:37] [url] Page not found · GitHub · GitHub | github.com [06:11:10] miraheze/MirahezeMagic - AgentIsai the build has errored. [06:11:45] [02MirahezeMagic] 07AgentIsai synchronize pull request 03#341: Miraheze Survey 2022 - 13https://github.com/miraheze/MirahezeMagic/pull/341 [06:11:46] [url] Page not found · GitHub · GitHub | github.com [06:11:58] [02miraheze/mw-config] 07Reception123 pushed 031 commit to 03Reception123-patch-1 [+0/-0/±1] 13https://github.com/miraheze/mw-config/commit/39e428e9a91a [06:12:00] [02miraheze/mw-config] 07Reception123 0339e428e - change whobasewiki license to BYSA3.0 per T9412 [06:12:01] [02mw-config] 07Reception123 created branch 03Reception123-patch-1 - 13https://github.com/miraheze/mw-config [06:12:02] ... [06:12:06] [02mw-config] 07Reception123 opened pull request 03#4784: change whobasewiki license to BYSA3.0 per T9412 - 13https://github.com/miraheze/mw-config/pull/4784 [06:12:06] ... [06:12:41] [02MirahezeMagic] 07AgentIsai edited pull request 03#341: Miraheze Survey 2022 - 13https://github.com/miraheze/MirahezeMagic/pull/341 [06:12:41] ... [06:12:42] [02MirahezeMagic] 07RhinosF1 commented on pull request 03#341: Miraheze Survey 2022 - 13https://github.com/miraheze/MirahezeMagic/pull/341#issuecomment-1160015888 [06:12:42] [url] Miraheze Survey 2022 by AgentIsai · Pull Request #341 · miraheze/MirahezeMagic · GitHub | github.com [06:12:47] [02MirahezeMagic] 07AgentIsai edited pull request 03#341: Miraheze Survey 2022 - 13https://github.com/miraheze/MirahezeMagic/pull/341 [06:12:47] [url] Page not found · GitHub · GitHub | github.com [06:12:48] [02MirahezeMagic] 07AgentIsai edited pull request 03#341: Miraheze Survey 2022 - 13https://github.com/miraheze/MirahezeMagic/pull/341 [06:12:49] [url] Page not found · GitHub · GitHub | github.com [06:13:15] miraheze/mw-config - Reception123 the build passed. [06:14:50] [02mw-config] 07Reception123 closed pull request 03#4784: change whobasewiki license to BYSA3.0 per T9412 - 13https://github.com/miraheze/mw-config/pull/4784 [06:14:51] [url] Page not found · GitHub · GitHub | github.com [06:14:52] [02miraheze/mw-config] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/b8ddb797caab...0978e34cdd9c [06:14:53] [url] Comparing b8ddb797caab...0978e34cdd9c · miraheze/mw-config · GitHub | github.com [06:14:53] [02miraheze/mw-config] 07Reception123 030978e34 - change whobasewiki license to BYSA3.0 per T9412 (#4784) [06:14:55] [02miraheze/mw-config] 07Reception123 deleted branch 03Reception123-patch-1 [06:14:56] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query dnd.bellinrattin.it. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [06:14:56] [02mw-config] 07Reception123 deleted branch 03Reception123-patch-1 - 13https://github.com/miraheze/mw-config [06:14:57] [url] Page not found · GitHub · GitHub | github.com [06:15:54] miraheze/mw-config - Reception123 the build passed. [06:20:02] miraheze/MirahezeMagic - AgentIsai the build passed. [06:22:36] PROBLEM - cloud11 Puppet on cloud11 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[ulogd2] [06:23:17] RECOVERY - wiki.msnld.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.msnld.com' will expire on Sun 18 Sep 2022 04:31:29 GMT +0000. [06:25:30] PROBLEM - cp21 Current Load on cp21 is WARNING: WARNING - load average: 1.94, 1.92, 1.17 [06:27:30] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 0.88, 1.50, 1.10 [06:27:45] RECOVERY - gluster111 Puppet on gluster111 is OK: OK: Puppet is currently enabled, last run 3 seconds ago with 0 failures [06:29:01] RECOVERY - gluster121 Puppet on gluster121 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [06:44:23] RECOVERY - dnd.bellinrattin.it - reverse DNS on sslhost is OK: SSL OK - dnd.bellinrattin.it reverse DNS resolves to cp21.miraheze.org - CNAME OK [06:48:00] PROBLEM - gluster101 Puppet on gluster101 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): File[/etc/apt/trusted.gpg.d/puppetlabs.gpg] [06:50:36] RECOVERY - cloud11 Puppet on cloud11 is OK: OK: Puppet is currently enabled, last run 20 seconds ago with 0 failures [07:11:13] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.84, 3.28, 2.89 [07:11:59] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.18, 3.90, 3.28 [07:13:12] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.63, 2.96, 2.82 [07:15:56] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.92, 3.80, 3.37 [07:16:00] RECOVERY - gluster101 Puppet on gluster101 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [07:16:12] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.92, 3.80, 3.23 [07:18:10] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.40, 3.27, 3.10 [07:19:53] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 3.38, 3.35, 3.26 [07:22:06] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.32, 4.05, 3.44 [07:24:04] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.61, 3.57, 3.35 [07:24:32] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.28, 2.23, 1.44 [07:26:32] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.16, 1.89, 1.42 [07:28:01] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.77, 3.61, 3.37 [07:28:32] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.07, 1.65, 1.39 [07:31:01] PROBLEM - gluster121 Puppet on gluster121 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [07:31:58] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.12, 3.26, 3.31 [08:00:00] PROBLEM - db121 Current Load on db121 is WARNING: WARNING - load average: 7.60, 5.60, 3.53 [08:02:00] PROBLEM - db121 Current Load on db121 is CRITICAL: CRITICAL - load average: 8.31, 6.43, 4.08 [08:02:09] PROBLEM - mw121 MediaWiki Rendering on mw121 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:02:12] PROBLEM - mw111 MediaWiki Rendering on mw111 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:02:13] PROBLEM - cp20 Stunnel HTTP for mw111 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:02:14] PROBLEM - cp21 Stunnel HTTP for mw111 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:02:19] PROBLEM - cp31 Stunnel HTTP for mw101 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:02:22] PROBLEM - cp21 Stunnel HTTP for mw101 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:02:27] PROBLEM - cp31 Stunnel HTTP for mw111 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:02:41] PROBLEM - cp30 Stunnel HTTP for mw101 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:02:47] PROBLEM - cp31 Stunnel HTTP for mw102 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:02:49] PROBLEM - mw101 MediaWiki Rendering on mw101 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:02:49] PROBLEM - cp30 Stunnel HTTP for mw102 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:03:01] PROBLEM - cp21 Stunnel HTTP for mw121 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:03:10] PROBLEM - cp31 Stunnel HTTP for mw121 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:03:14] PROBLEM - cp31 Stunnel HTTP for mw112 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:03:14] PROBLEM - cp20 Stunnel HTTP for mw101 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:03:15] PROBLEM - cp30 Stunnel HTTP for mw111 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:03:17] PROBLEM - cp30 Stunnel HTTP for mw121 on cp30 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 328 bytes in 0.233 second response time [08:03:22] PROBLEM - cp20 Stunnel HTTP for mw112 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:03:28] PROBLEM - cp20 Stunnel HTTP for mw121 on cp20 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 328 bytes in 0.015 second response time [08:03:40] PROBLEM - mw112 MediaWiki Rendering on mw112 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:03:42] PROBLEM - cp20 Stunnel HTTP for mw102 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:03:44] PROBLEM - mw102 MediaWiki Rendering on mw102 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:03:51] PROBLEM - cp30 Stunnel HTTP for mw112 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:04:11] RECOVERY - mw121 MediaWiki Rendering on mw121 is OK: HTTP OK: HTTP/1.1 200 OK - 29915 bytes in 6.909 second response time [08:04:16] RECOVERY - cp31 Stunnel HTTP for mw101 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15887 bytes in 0.973 second response time [08:04:21] RECOVERY - cp21 Stunnel HTTP for mw101 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15893 bytes in 0.024 second response time [08:04:37] RECOVERY - cp30 Stunnel HTTP for mw101 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15893 bytes in 0.314 second response time [08:04:44] RECOVERY - mw101 MediaWiki Rendering on mw101 is OK: HTTP OK: HTTP/1.1 200 OK - 29915 bytes in 0.953 second response time [08:04:46] RECOVERY - cp30 Stunnel HTTP for mw102 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15893 bytes in 0.315 second response time [08:04:47] RECOVERY - cp31 Stunnel HTTP for mw102 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15893 bytes in 0.306 second response time [08:04:55] RECOVERY - cp21 Stunnel HTTP for mw121 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15893 bytes in 0.023 second response time [08:05:08] RECOVERY - cp31 Stunnel HTTP for mw121 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15893 bytes in 0.309 second response time [08:05:11] RECOVERY - cp31 Stunnel HTTP for mw112 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15893 bytes in 0.312 second response time [08:05:13] RECOVERY - cp20 Stunnel HTTP for mw101 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15893 bytes in 0.023 second response time [08:05:15] RECOVERY - cp30 Stunnel HTTP for mw111 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15893 bytes in 0.466 second response time [08:05:16] RECOVERY - cp30 Stunnel HTTP for mw121 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15893 bytes in 0.334 second response time [08:05:18] RECOVERY - cp20 Stunnel HTTP for mw112 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15887 bytes in 0.020 second response time [08:05:22] RECOVERY - cp20 Stunnel HTTP for mw121 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15893 bytes in 0.021 second response time [08:05:36] RECOVERY - cp20 Stunnel HTTP for mw102 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15893 bytes in 0.025 second response time [08:05:39] RECOVERY - mw112 MediaWiki Rendering on mw112 is OK: HTTP OK: HTTP/1.1 200 OK - 29915 bytes in 0.322 second response time [08:05:43] RECOVERY - mw102 MediaWiki Rendering on mw102 is OK: HTTP OK: HTTP/1.1 200 OK - 29915 bytes in 0.402 second response time [08:05:46] RECOVERY - cp30 Stunnel HTTP for mw112 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15893 bytes in 0.339 second response time [08:06:00] PROBLEM - db121 Current Load on db121 is WARNING: WARNING - load average: 5.50, 6.92, 4.90 [08:06:11] RECOVERY - mw111 MediaWiki Rendering on mw111 is OK: HTTP OK: HTTP/1.1 200 OK - 29915 bytes in 0.310 second response time [08:06:11] RECOVERY - cp20 Stunnel HTTP for mw111 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15893 bytes in 0.020 second response time [08:06:19] RECOVERY - cp21 Stunnel HTTP for mw111 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15879 bytes in 0.778 second response time [08:06:32] RECOVERY - cp31 Stunnel HTTP for mw111 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15893 bytes in 0.312 second response time [08:08:00] RECOVERY - db121 Current Load on db121 is OK: OK - load average: 2.14, 5.25, 4.53 [08:11:28] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.84, 3.51, 2.86 [08:13:26] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.60, 3.23, 2.84 [08:22:01] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.87, 3.44, 2.80 [08:23:59] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.38, 3.01, 2.71 [08:29:01] RECOVERY - gluster121 Puppet on gluster121 is OK: OK: Puppet is currently enabled, last run 31 seconds ago with 0 failures [09:17:59] PROBLEM - gluster101 Puppet on gluster101 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [09:30:32] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 3.06, 1.88, 1.37 [09:32:32] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.34, 1.67, 1.35 [09:33:01] PROBLEM - gluster121 Puppet on gluster121 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): File[/etc/apt/trusted.gpg.d/puppetlabs.gpg] [09:44:32] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.10, 1.77, 1.44 [09:46:00] RECOVERY - gluster101 Puppet on gluster101 is OK: OK: Puppet is currently enabled, last run 27 seconds ago with 0 failures [09:46:32] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.63, 1.74, 1.47 [09:48:32] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.61, 1.67, 1.47 [09:59:01] RECOVERY - gluster121 Puppet on gluster121 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [10:18:27] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.61, 9.55, 8.54 [10:20:28] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 8.40, 9.23, 8.56 [10:26:32] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.21, 1.71, 1.33 [10:28:32] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.67, 1.62, 1.33 [10:33:01] PROBLEM - gluster121 Puppet on gluster121 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [10:38:33] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.98, 3.45, 3.02 [10:40:32] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.58, 3.04, 2.91 [10:59:01] RECOVERY - gluster121 Puppet on gluster121 is OK: OK: Puppet is currently enabled, last run 27 seconds ago with 0 failures [11:09:25] [02miraheze/ErrorPages] 07translatewiki pushed 031 commit to 03master [+1/-0/±0] 13https://github.com/miraheze/ErrorPages/compare/e1c0f27ef9f7...a537415c9d72 [11:09:26] [url] Comparing e1c0f27ef9f7...a537415c9d72 · miraheze/ErrorPages · GitHub | github.com [11:09:26] [02miraheze/ErrorPages] 07translatewiki 03a537415 - Localisation updates from https://translatewiki.net. [11:09:27] [url] Main page - translatewiki.net | translatewiki.net [11:09:28] [02miraheze/CreateWiki] 07translatewiki pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/ed0639a5f36b...d9b7b043f0ee [11:09:28] [url] Comparing ed0639a5f36b...d9b7b043f0ee · miraheze/CreateWiki · GitHub | github.com [11:09:29] [02miraheze/CreateWiki] 07translatewiki 03d9b7b04 - Localisation updates from https://translatewiki.net. [11:09:30] [url] Main page - translatewiki.net | translatewiki.net [11:09:31] [02miraheze/ImportDump] 07translatewiki pushed 031 commit to 03master [+0/-0/±2] 13https://github.com/miraheze/ImportDump/compare/9e79dca86e79...f794dd9186ba [11:09:32] [url] Comparing 9e79dca86e79...f794dd9186ba · miraheze/ImportDump · GitHub | github.com [11:09:32] [02miraheze/ImportDump] 07translatewiki 03f794dd9 - Localisation updates from https://translatewiki.net. [11:09:33] [url] Main page - translatewiki.net | translatewiki.net [11:09:34] [02miraheze/landing] 07translatewiki pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/landing/compare/ac5a596a0417...ef0defdd8f56 [11:09:34] [url] Comparing ac5a596a0417...ef0defdd8f56 · miraheze/landing · GitHub | github.com [11:09:35] [02miraheze/landing] 07translatewiki 03ef0defd - Localisation updates from https://translatewiki.net. [11:09:36] [url] Main page - translatewiki.net | translatewiki.net [11:09:37] [02miraheze/MirahezeMagic] 07translatewiki pushed 031 commit to 03master [+0/-0/±5] 13https://github.com/miraheze/MirahezeMagic/compare/c400474be602...aed8726bd8e6 [11:09:38] [url] Comparing c400474be602...aed8726bd8e6 · miraheze/MirahezeMagic · GitHub | github.com [11:09:38] [02miraheze/MirahezeMagic] 07translatewiki 03aed8726 - Localisation updates from https://translatewiki.net. [11:09:39] [url] Main page - translatewiki.net | translatewiki.net [11:10:19] miraheze/landing - translatewiki the build passed. [11:10:58] miraheze/ErrorPages - translatewiki the build passed. [11:19:30] miraheze/CreateWiki - translatewiki the build passed. [11:20:01] miraheze/ImportDump - translatewiki the build passed. [11:21:24] miraheze/MirahezeMagic - translatewiki the build passed. [11:31:45] PROBLEM - gluster111 Puppet on gluster111 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): File[/etc/apt/trusted.gpg.d/puppetlabs.gpg] [11:48:00] PROBLEM - gluster101 Puppet on gluster101 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [11:55:12] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.54, 2.93, 2.66 [11:57:45] RECOVERY - gluster111 Puppet on gluster111 is OK: OK: Puppet is currently enabled, last run 27 seconds ago with 0 failures [11:59:09] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.96, 3.16, 2.81 [12:16:00] RECOVERY - gluster101 Puppet on gluster101 is OK: OK: Puppet is currently enabled, last run 39 seconds ago with 0 failures [12:19:54] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.94, 10.48, 9.61 [12:21:51] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 8.92, 9.92, 9.51 [12:22:32] PROBLEM - matomo101 APT on matomo101 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [12:23:00] PROBLEM - matomo101 Current Load on matomo101 is CRITICAL: CRITICAL - load average: 12.94, 6.95, 3.86 [12:23:11] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.56, 3.47, 3.04 [12:24:30] RECOVERY - matomo101 APT on matomo101 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [12:25:10] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 3.21, 3.35, 3.04 [12:28:32] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.73, 1.47, 1.23 [12:28:59] RECOVERY - matomo101 Current Load on matomo101 is OK: OK - load average: 1.15, 3.14, 3.15 [12:30:32] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.08, 1.25, 1.17 [12:31:04] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.28, 3.93, 3.39 [12:31:37] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.10, 3.72, 3.34 [12:33:02] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 1.93, 3.16, 3.17 [12:33:35] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.11, 3.18, 3.19 [12:52:59] PROBLEM - matomo101 Current Load on matomo101 is WARNING: WARNING - load average: 2.44, 3.54, 2.96 [12:54:59] RECOVERY - matomo101 Current Load on matomo101 is OK: OK - load average: 1.31, 2.78, 2.75 [12:57:14] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.68, 3.58, 3.25 [12:59:12] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.80, 3.18, 3.14 [13:01:01] PROBLEM - gluster121 Puppet on gluster121 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [13:10:32] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.63, 3.41, 3.16 [13:12:30] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.60, 3.06, 3.06 [13:16:32] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.15, 1.53, 1.35 [13:18:32] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.92, 1.62, 1.40 [13:20:32] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.15, 1.35, 1.32 [13:21:53] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.43, 3.01, 2.71 [13:25:49] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.36, 2.95, 2.76 [13:26:19] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.45, 3.40, 3.13 [13:28:17] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.61, 4.25, 3.47 [13:34:13] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.04, 3.89, 3.66 [13:36:12] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.20, 3.92, 3.69 [13:37:36] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.14, 3.96, 3.32 [13:39:26] Reception123: https://phabricator.miraheze.org/T9423#190773 [13:39:27] [url] ⚓ T9423 set up Query Service | phabricator.miraheze.org [13:39:31] ugochimobi: hi [13:39:33] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.58, 3.83, 3.35 [13:40:09] RhinosF1: yo [13:41:31] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.36, 4.50, 3.65 [13:41:49] ugochimobi: WDQS can barely be kept running by the Wikimedia Search team [13:42:39] RhinosF1: hum, like, they're the only one that can keep it running? [13:42:48] ugochimobi: they struggle too [13:42:58] it's an engineering nightmare [13:43:14] I'm almost crying [13:43:34] although, I've seen quite a lot of standalone wdqs [13:44:06] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.82, 3.99, 3.89 [13:44:36] ugochimobi: on our scale [13:45:03] we'd need at least 2 VMs for redundancy and it setup per wiki [13:45:16] VMs? [13:45:25] ugochimobi: virtual machines [13:45:26] [discord] virtual machines [13:45:28] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.15, 3.82, 3.58 [13:45:37] we'd need more resources than mediawiki takes [13:45:42] [discord] oh boy, that is a nightmare [13:46:31] but why is it like that though? [13:47:25] ugochimobi: because it's not built for miraheze and blazegraph is awful [13:47:28] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.60, 3.76, 3.68 [13:47:45] ah [13:49:25] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.44, 3.71, 3.54 [13:51:23] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.27, 3.36, 3.45 [13:51:25] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.78, 2.81, 3.31 [13:51:37] PROBLEM - matomo101 Current Load on matomo101 is CRITICAL: CRITICAL - load average: 9.97, 6.56, 3.96 [13:52:00] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 1.52, 2.73, 3.37 [13:53:22] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.53, 3.08, 3.33 [13:53:23] PROBLEM - matomo101 APT on matomo101 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [13:55:19] for example; https://query.linkedopendata.eu/ [13:55:21] RECOVERY - matomo101 APT on matomo101 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [13:55:30] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CRITICAL - load average: 2.18, 1.89, 1.37 [13:55:36] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 3.09, 2.32, 1.64 [13:57:21] ugochimobi: i don't think it's effective use of resources [13:57:29] we see what Reception123 or CosmicAlpha say [13:57:30] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 0.99, 1.65, 1.35 [13:57:32] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.58, 2.00, 1.60 [13:58:24] :(, I can literally say that you're their mouthpiece at this point [13:59:01] RECOVERY - gluster121 Puppet on gluster121 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [14:00:52] PROBLEM - grayravens.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'grayravens.com' expires in 15 day(s) (Wed 06 Jul 2022 13:43:28 GMT +0000). [14:01:23] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 0.82, 1.52, 1.50 [14:03:00] I would agree, atm there's not enough interest to justify that I don't think [14:03:31] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/c10dc38ca416...768e5057a58a [14:03:32] [url] Comparing c10dc38ca416...768e5057a58a · miraheze/ssl · GitHub | github.com [14:03:33] [02miraheze/ssl] 07MirahezeSSLBot 03768e505 - Bot: Update SSL cert for grayravens.com [14:04:10] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.84, 3.57, 3.42 [14:05:27] PROBLEM - matomo101 Current Load on matomo101 is WARNING: WARNING - load average: 2.81, 3.27, 3.96 [14:06:09] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.23, 3.18, 3.30 [14:11:23] RECOVERY - matomo101 Current Load on matomo101 is OK: OK - load average: 1.85, 2.43, 3.36 [14:20:00] PROBLEM - gluster101 Puppet on gluster101 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [14:21:14] PROBLEM - matomo101 HTTPS on matomo101 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 358 bytes in 0.036 second response time [14:21:40] Reception123: not enough interest? [14:21:41] PROBLEM - cp20 Stunnel HTTP for matomo101 on cp20 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 358 bytes in 1.622 second response time [14:21:43] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.66, 3.21, 3.01 [14:21:45] PROBLEM - cp21 Stunnel HTTP for matomo101 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:21:47] PROBLEM - matomo101 APT on matomo101 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [14:21:54] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.15, 3.56, 3.28 [14:22:02] PROBLEM - cp30 Stunnel HTTP for matomo101 on cp30 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 358 bytes in 0.515 second response time [14:22:03] PROBLEM - cp31 Stunnel HTTP for matomo101 on cp31 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 358 bytes in 0.345 second response time [14:22:18] PROBLEM - matomo101 Current Load on matomo101 is CRITICAL: CRITICAL - load average: 15.63, 8.54, 5.25 [14:22:18] we'd look at how many wikibase instances we currently have, before we'd look into who needs it, then interests.. [14:22:59] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.37, 7.02, 6.07 [14:23:41] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.66, 3.03, 2.97 [14:23:53] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 3.34, 3.33, 3.23 [14:25:00] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 9.42, 8.06, 6.57 [14:27:37] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.34, 3.71, 3.23 [14:27:48] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.66, 4.01, 3.47 [14:28:24] PROBLEM - matomo101 Puppet on matomo101 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [14:28:25] PROBLEM - matomo101 PowerDNS Recursor on matomo101 is CRITICAL: CRITICAL - Plugin timed out while executing system call [14:29:13] Reception123: ^ matomo issues? [14:29:36] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.87, 3.63, 3.26 [14:29:38] PROBLEM - matomo101 NTP time on matomo101 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:29:44] RECOVERY - grayravens.com - LetsEncrypt on sslhost is OK: OK - Certificate 'grayravens.com' will expire on Sun 18 Sep 2022 13:03:26 GMT +0000. [14:29:46] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.24, 3.74, 3.45 [14:30:23] RECOVERY - matomo101 PowerDNS Recursor on matomo101 is OK: DNS OK: 2.260 seconds response time. miraheze.org returns 198.244.148.90,2001:41d0:801:2000::1b80,2001:41d0:801:2000::4c25,51.195.220.68 [14:30:28] RECOVERY - matomo101 Puppet on matomo101 is OK: OK: Puppet is currently enabled, last run 35 minutes ago with 0 failures [14:30:59] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 5.90, 7.85, 7.08 [14:31:29] RECOVERY - matomo101 HTTPS on matomo101 is OK: HTTP OK: HTTP/1.1 200 OK - 99077 bytes in 3.379 second response time [14:31:38] RECOVERY - matomo101 NTP time on matomo101 is OK: NTP OK: Offset -0.000985532999 secs [14:31:50] RECOVERY - cp30 Stunnel HTTP for matomo101 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 99069 bytes in 1.224 second response time [14:31:53] RECOVERY - cp21 Stunnel HTTP for matomo101 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 99061 bytes in 0.466 second response time [14:31:55] RECOVERY - cp20 Stunnel HTTP for matomo101 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 99061 bytes in 0.907 second response time [14:32:25] RECOVERY - matomo101 APT on matomo101 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [14:32:26] RECOVERY - cp31 Stunnel HTTP for matomo101 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 99069 bytes in 0.917 second response time [14:32:59] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 3.85, 6.30, 6.59 [14:33:33] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 1.89, 3.21, 3.22 [14:33:44] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.67, 3.37, 3.40 [14:33:55] looks to be improving [14:38:39] PROBLEM - wiki.parappa.dev - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.parappa.dev' expires in 15 day(s) (Wed 06 Jul 2022 14:12:03 GMT +0000). [14:41:39] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.42, 3.85, 3.37 [14:43:38] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.57, 3.69, 3.37 [14:44:51] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/768e5057a58a...0f93e17a5707 [14:44:52] [url] Comparing 768e5057a58a...0f93e17a5707 · miraheze/ssl · GitHub | github.com [14:44:53] [02miraheze/ssl] 07MirahezeSSLBot 030f93e17 - Bot: Update SSL cert for wiki.parappa.dev [14:46:00] RECOVERY - gluster101 Puppet on gluster101 is OK: OK: Puppet is currently enabled, last run 26 seconds ago with 0 failures [14:49:25] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.86, 1.82, 1.64 [14:49:33] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 3.33, 3.35, 3.28 [14:51:21] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.02, 1.89, 1.69 [14:51:43] PROBLEM - cp30 Stunnel HTTP for matomo101 on cp30 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 358 bytes in 1.552 second response time [14:52:31] :( [14:53:16] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 0.95, 1.52, 1.57 [14:53:23] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.84, 3.56, 3.41 [14:53:38] RECOVERY - cp30 Stunnel HTTP for matomo101 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 99069 bytes in 0.780 second response time [14:55:21] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 3.05, 3.39, 3.37 [14:55:27] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.20, 3.44, 3.34 [14:57:11] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.86, 3.61, 3.32 [14:59:16] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.58, 3.69, 3.50 [14:59:24] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.92, 3.88, 3.54 [15:01:09] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.03, 3.72, 3.48 [15:01:22] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.62, 3.42, 3.41 [15:03:07] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.13, 3.18, 3.31 [15:03:13] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.02, 3.71, 3.57 [15:03:21] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.18, 3.01, 3.26 [15:07:03] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.82, 3.72, 3.53 [15:07:10] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.71, 3.92, 3.70 [15:07:44] PROBLEM - bast101 NTP time on bast101 is WARNING: NTP WARNING: Offset 0.2974804044 secs [15:07:48] RECOVERY - wiki.parappa.dev - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.parappa.dev' will expire on Sun 18 Sep 2022 13:44:45 GMT +0000. [15:08:04] PROBLEM - matomo101 Current Load on matomo101 is WARNING: WARNING - load average: 3.19, 2.54, 3.91 [15:09:08] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.86, 4.10, 3.78 [15:09:15] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.49, 3.84, 3.54 [15:11:00] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.14, 4.03, 3.70 [15:13:12] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.42, 3.75, 3.58 [15:15:10] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.12, 4.12, 3.72 [15:15:59] RECOVERY - matomo101 Current Load on matomo101 is OK: OK - load average: 1.82, 2.34, 3.34 [15:17:12] PROBLEM - bast121 NTP time on bast121 is WARNING: NTP WARNING: Offset 0.296250701 secs [15:18:32] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.65, 1.73, 1.45 [15:20:00] PROBLEM - gluster101 Puppet on gluster101 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [15:20:32] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.19, 1.52, 1.41 [15:21:55] PROBLEM - matomo101 Current Load on matomo101 is CRITICAL: CRITICAL - load average: 9.61, 5.13, 4.09 [15:24:18] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 3.16, 2.35, 1.45 [15:26:17] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.38, 1.98, 1.43 [15:28:16] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.76, 1.54, 1.33 [15:31:48] PROBLEM - matomo101 Current Load on matomo101 is WARNING: WARNING - load average: 2.17, 3.11, 3.79 [15:32:28] [02mw-config] 07AgentIsai opened pull request 03#4785: Enable MirahezeSurvey - 13https://github.com/miraheze/mw-config/pull/4785 [15:32:29] [url] Page not found · GitHub · GitHub | github.com [15:33:44] miraheze/mw-config - AgentIsai the build passed. [15:39:18] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.32, 10.04, 8.99 [15:39:43] RECOVERY - matomo101 Current Load on matomo101 is OK: OK - load average: 2.50, 2.68, 3.28 [15:43:12] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 9.29, 9.75, 9.12 [15:50:05] PROBLEM - matomo101 APT on matomo101 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [15:50:48] PROBLEM - matomo101 Current Load on matomo101 is CRITICAL: CRITICAL - load average: 21.98, 10.02, 5.78 [15:51:19] PROBLEM - cp31 Stunnel HTTP for matomo101 on cp31 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 358 bytes in 0.351 second response time [15:51:29] PROBLEM - matomo101 HTTPS on matomo101 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:51:39] PROBLEM - cp30 Stunnel HTTP for matomo101 on cp30 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 358 bytes in 1.768 second response time [15:51:47] PROBLEM - cp21 Stunnel HTTP for matomo101 on cp21 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 358 bytes in 0.029 second response time [15:55:32] PROBLEM - matomo101 PowerDNS Recursor on matomo101 is CRITICAL: CRITICAL - Plugin timed out while executing system call [15:56:20] PROBLEM - cp20 Stunnel HTTP for matomo101 on cp20 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 358 bytes in 0.043 second response time [15:56:59] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 8.04, 7.07, 5.96 [15:57:14] RECOVERY - cp31 Stunnel HTTP for matomo101 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 99069 bytes in 0.767 second response time [15:57:30] PROBLEM - cp21 Current Load on cp21 is WARNING: WARNING - load average: 1.77, 1.39, 1.27 [15:57:31] RECOVERY - matomo101 PowerDNS Recursor on matomo101 is OK: DNS OK: 3.035 seconds response time. miraheze.org returns 198.244.148.90,2001:41d0:801:2000::1b80,2001:41d0:801:2000::4c25,51.195.220.68 [15:57:36] RECOVERY - matomo101 HTTPS on matomo101 is OK: HTTP OK: HTTP/1.1 200 OK - 99077 bytes in 1.341 second response time [15:57:42] RECOVERY - cp30 Stunnel HTTP for matomo101 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 99069 bytes in 1.023 second response time [15:57:53] RECOVERY - cp21 Stunnel HTTP for matomo101 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 99061 bytes in 0.438 second response time [15:58:19] RECOVERY - cp20 Stunnel HTTP for matomo101 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 99061 bytes in 0.564 second response time [15:58:30] RECOVERY - matomo101 APT on matomo101 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [15:58:59] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 6.82, 7.07, 6.10 [15:59:30] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 0.83, 1.15, 1.19 [16:00:59] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 6.06, 6.75, 6.10 [16:02:02] [Grafana] FIRING: Some MediaWiki Appservers are running out of PHP-FPM workers. https://grafana.miraheze.org/d/GtxbP1Xnk [16:02:17] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-2 [+0/-0/±1] 13https://github.com/miraheze/mw-config/commit/d13a2b341b01 [16:02:19] [02miraheze/mw-config] 07Universal-Omega 03d13a2b3 - Attempt fix to licensing rights text and URL [16:02:20] [02mw-config] 07Universal-Omega created branch 03Universal-Omega-patch-2 - 13https://github.com/miraheze/mw-config [16:02:20] [url] Page not found · GitHub · GitHub | github.com [16:02:22] [02mw-config] 07Universal-Omega opened pull request 03#4786: Attempt fix to licensing rights text and URL - 13https://github.com/miraheze/mw-config/pull/4786 [16:02:22] [url] Page not found · GitHub · GitHub | github.com [16:03:18] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-2 [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/d13a2b341b01...24d64cec6239 [16:03:18] [url] Comparing d13a2b341b01...24d64cec6239 · miraheze/mw-config · GitHub | github.com [16:03:19] [02miraheze/mw-config] 07Universal-Omega 0324d64ce - Update LocalSettings.php [16:03:21] [02mw-config] 07Universal-Omega synchronize pull request 03#4786: Attempt fix to licensing rights text and URL - 13https://github.com/miraheze/mw-config/pull/4786 [16:03:21] [url] Page not found · GitHub · GitHub | github.com [16:03:34] miraheze/mw-config - Universal-Omega the build passed. [16:04:27] miraheze/mw-config - Universal-Omega the build passed. [16:07:02] [Grafana] RESOLVED: PHP-FPM Worker Usage High https://grafana.miraheze.org/d/GtxbP1Xnk [16:11:12] RECOVERY - bast121 NTP time on bast121 is OK: NTP OK: Offset -0.01819834113 secs [16:14:46] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-2 [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/24d64cec6239...2406a338b146 [16:14:47] [url] Comparing 24d64cec6239...2406a338b146 · miraheze/mw-config · GitHub | github.com [16:14:48] [02miraheze/mw-config] 07Universal-Omega 032406a33 - Add comments [16:14:49] [02mw-config] 07Universal-Omega synchronize pull request 03#4786: Attempt fix to licensing rights text and URL - 13https://github.com/miraheze/mw-config/pull/4786 [16:14:50] [url] Page not found · GitHub · GitHub | github.com [16:15:50] miraheze/mw-config - Universal-Omega the build passed. [16:16:00] RECOVERY - gluster101 Puppet on gluster101 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [16:20:23] PROBLEM - matomo101 APT on matomo101 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [16:23:12] PROBLEM - cp31 Stunnel HTTP for matomo101 on cp31 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 358 bytes in 0.545 second response time [16:23:18] PROBLEM - matomo101 HTTPS on matomo101 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 358 bytes in 4.180 second response time [16:23:23] PROBLEM - matomo101 PowerDNS Recursor on matomo101 is CRITICAL: CRITICAL - Plugin timed out while executing system call [16:23:38] PROBLEM - cp20 Stunnel HTTP for matomo101 on cp20 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 358 bytes in 0.086 second response time [16:23:44] PROBLEM - cp30 Stunnel HTTP for matomo101 on cp30 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 358 bytes in 0.343 second response time [16:23:45] PROBLEM - cp21 Stunnel HTTP for matomo101 on cp21 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 358 bytes in 0.265 second response time [16:24:59] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.30, 3.11, 3.95 [16:25:25] RECOVERY - matomo101 PowerDNS Recursor on matomo101 is OK: DNS OK: 5.410 seconds response time. miraheze.org returns 198.244.148.90,2001:41d0:801:2000::1b80,2001:41d0:801:2000::4c25,51.195.220.68 [16:31:53] PROBLEM - matomo101 PowerDNS Recursor on matomo101 is CRITICAL: CRITICAL - Plugin timed out while executing system call [16:33:56] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 8.54, 7.44, 6.63 [16:34:10] PROBLEM - matomo101 Puppet on matomo101 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [16:34:59] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.20, 3.02, 3.92 [16:35:44] RECOVERY - bast101 NTP time on bast101 is OK: NTP OK: Offset -0.02792179585 secs [16:35:55] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.15, 7.24, 6.64 [16:35:58] PROBLEM - matomo101 Redis Process on matomo101 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [16:36:02] [02miraheze/MirahezeMagic] 07Reception123 pushed 031 commit to 03master [+0/-0/±2] 13https://github.com/miraheze/MirahezeMagic/compare/aed8726bd8e6...e248de844b6c [16:36:03] [url] Comparing aed8726bd8e6...e248de844b6c · miraheze/MirahezeMagic · GitHub | github.com [16:36:04] [02miraheze/MirahezeMagic] 07AgentIsai 03e248de8 - Miraheze Survey 2022 (#341) [16:36:05] [02MirahezeMagic] 07Reception123 closed pull request 03#341: Miraheze Survey 2022 - 13https://github.com/miraheze/MirahezeMagic/pull/341 [16:36:06] ... [16:36:09] [02mw-config] 07Reception123 closed pull request 03#4785: Enable MirahezeSurvey - 13https://github.com/miraheze/mw-config/pull/4785 [16:36:09] [url] Page not found · GitHub · GitHub | github.com [16:36:10] [02miraheze/mw-config] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/0978e34cdd9c...5845c4a709a0 [16:36:11] [url] Comparing 0978e34cdd9c...5845c4a709a0 · miraheze/mw-config · GitHub | github.com [16:36:12] [02miraheze/mw-config] 07AgentIsai 035845c4a - Enable MirahezeSurvey (#4785) [16:36:59] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.52, 3.97, 4.15 [16:37:15] [02miraheze/mediawiki] 07Reception123 pushed 031 commit to 03REL1_38 [+0/-0/±2] 13https://github.com/miraheze/mediawiki/compare/6ded66661a8e...fbe64e38815b [16:37:16] [url] Comparing 6ded66661a8e...fbe64e38815b · miraheze/mediawiki · GitHub | github.com [16:37:17] [02miraheze/mediawiki] 07Reception123 03fbe64e3 - Update MirahezeMagic [16:37:20] miraheze/mw-config - Reception123 the build passed. [16:37:31] Reception123: did Owen review? [16:37:59] PROBLEM - matomo101 SSH on matomo101 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:38:04] PROBLEM - cp30 Stunnel HTTP for mwtask111 on cp30 is CRITICAL: HTTP CRITICAL - No data received from host [16:38:06] RhinosF1: yep, he told me via DM it was okay [16:38:11] RECOVERY - matomo101 Redis Process on matomo101 is OK: PROCS OK: 1 process with args 'redis-server' [16:38:29] Reception123: try and get approvals done in public for records please :) [16:38:58] I agree that's preferable and always encourage it but in this case it wasn't that official to ask [16:38:59] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.81, 3.33, 3.88 [16:38:59] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.08, 3.55, 3.68 [16:39:04] but usually I always like public task confirmations as well [16:39:17] especially for complex issues, so we don't get into "they said X" debates [16:39:43] PROBLEM - cp21 Varnish Backends on cp21 is CRITICAL: 2 backends are down. mw102 mw112 [16:39:51] Yep! [16:40:04] RECOVERY - cp30 Stunnel HTTP for mwtask111 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15891 bytes in 0.329 second response time [16:40:46] PROBLEM - cp20 Varnish Backends on cp20 is CRITICAL: 3 backends are down. mw102 mw111 mw112 [16:40:59] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.88, 3.45, 3.61 [16:41:53] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 6.12, 6.69, 6.60 [16:42:07] RECOVERY - matomo101 SSH on matomo101 is OK: SSH OK - OpenSSH_8.4p1 Debian-5 (protocol 2.0) [16:42:46] RECOVERY - cp20 Varnish Backends on cp20 is OK: All 14 backends are healthy [16:42:59] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.22, 3.73, 3.90 [16:42:59] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.59, 3.83, 3.73 [16:43:43] RECOVERY - cp21 Varnish Backends on cp21 is OK: All 14 backends are healthy [16:44:57] miraheze/MirahezeMagic - Reception123 the build passed. [16:45:05] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.73, 1.64, 1.12 [16:45:49] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.73, 7.93, 7.16 [16:47:03] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.27, 1.61, 1.18 [16:48:24] PROBLEM - matomo101 conntrack_table_size on matomo101 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [16:48:37] PROBLEM - matomo101 SSH on matomo101 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:50:48] RECOVERY - matomo101 conntrack_table_size on matomo101 is OK: OK: nf_conntrack is 0 % full [16:52:54] PROBLEM - matomo101 NTP time on matomo101 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:56:32] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.08, 1.89, 1.51 [16:56:49] PROBLEM - mw101 MediaWiki Rendering on mw101 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:57:28] RECOVERY - matomo101 NTP time on matomo101 is OK: NTP OK: Offset -0.005474716425 secs [16:58:10] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CRITICAL - load average: 2.12, 1.91, 1.54 [16:58:32] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 0.80, 1.42, 1.38 [16:58:39] PROBLEM - cp30 Stunnel HTTP for mw102 on cp30 is CRITICAL: HTTP CRITICAL - No data received from host [16:58:43] RECOVERY - mw101 MediaWiki Rendering on mw101 is OK: HTTP OK: HTTP/1.1 200 OK - 29915 bytes in 0.279 second response time [16:58:46] PROBLEM - matomo101 Redis Process on matomo101 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [16:58:52] PROBLEM - matomo101 ferm_active on matomo101 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [16:58:54] PROBLEM - cp30 Varnish Backends on cp30 is CRITICAL: 2 backends are down. mw101 mw111 [16:58:57] PROBLEM - cp30 Stunnel HTTP for mw111 on cp30 is CRITICAL: HTTP CRITICAL - No data received from host [16:59:10] PROBLEM - cp31 Stunnel HTTP for mw102 on cp31 is CRITICAL: HTTP CRITICAL - No data received from host [16:59:16] PROBLEM - cp21 Stunnel HTTP for mw102 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:59:38] PROBLEM - cp20 Stunnel HTTP for mw102 on cp20 is CRITICAL: HTTP CRITICAL - No data received from host [17:00:01] PROBLEM - mw102 MediaWiki Rendering on mw102 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:00:03] PROBLEM - cp20 Stunnel HTTP for mail121 on cp20 is CRITICAL: HTTP CRITICAL - No data received from host [17:00:04] PROBLEM - cp21 Current Load on cp21 is WARNING: WARNING - load average: 1.10, 1.73, 1.53 [17:00:26] PROBLEM - cp20 Stunnel HTTP for phab121 on cp20 is CRITICAL: HTTP CRITICAL - No data received from host [17:00:32] [Grafana] FIRING: Some MediaWiki Appservers are running out of PHP-FPM workers. https://grafana.miraheze.org/d/GtxbP1Xnk [17:00:36] PROBLEM - cp21 Stunnel HTTP for test101 on cp21 is CRITICAL: HTTP CRITICAL - No data received from host [17:00:45] PROBLEM - cp21 Stunnel HTTP for mon111 on cp21 is CRITICAL: HTTP CRITICAL - No data received from host [17:00:55] PROBLEM - cp21 Stunnel HTTP for mw112 on cp21 is CRITICAL: HTTP CRITICAL - No data received from host [17:00:56] PROBLEM - cp21 Stunnel HTTP for mw111 on cp21 is CRITICAL: HTTP CRITICAL - No data received from host [17:00:57] PROBLEM - cp20 Stunnel HTTP for mwtask111 on cp20 is CRITICAL: HTTP CRITICAL - No data received from host [17:01:06] PROBLEM - matomo101 conntrack_table_size on matomo101 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [17:01:06] PROBLEM - cp21 Stunnel HTTP for reports121 on cp21 is CRITICAL: HTTP CRITICAL - No data received from host [17:01:23] PROBLEM - cp20 Stunnel HTTP for mw121 on cp20 is CRITICAL: HTTP CRITICAL - No data received from host [17:01:24] PROBLEM - cp30 Stunnel HTTP for phab121 on cp30 is CRITICAL: HTTP CRITICAL - No data received from host [17:01:26] PROBLEM - cp31 Varnish Backends on cp31 is CRITICAL: 3 backends are down. mw102 mw112 mw121 [17:01:30] PROBLEM - cp21 Stunnel HTTP for mw101 on cp21 is CRITICAL: HTTP CRITICAL - No data received from host [17:01:45] PROBLEM - gluster111 Puppet on gluster111 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [17:02:00] RECOVERY - mw102 MediaWiki Rendering on mw102 is OK: HTTP OK: HTTP/1.1 200 OK - 29915 bytes in 0.427 second response time [17:02:14] PROBLEM - cp31 Stunnel HTTP for mwtask111 on cp31 is CRITICAL: HTTP CRITICAL - No data received from host [17:02:29] PROBLEM - cp21 Varnish Backends on cp21 is CRITICAL: 7 backends are down. mw101 mw102 mw111 mw112 mw121 mw122 mediawiki [17:02:36] RECOVERY - cp21 Stunnel HTTP for test101 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15895 bytes in 0.180 second response time [17:02:42] RECOVERY - cp30 Stunnel HTTP for mw102 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15893 bytes in 0.306 second response time [17:02:44] RECOVERY - cp21 Stunnel HTTP for mon111 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 34513 bytes in 0.782 second response time [17:02:46] PROBLEM - cp20 Varnish Backends on cp20 is CRITICAL: 5 backends are down. mw102 mw111 mw112 mw121 mw122 [17:02:53] RECOVERY - cp21 Stunnel HTTP for mw111 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15893 bytes in 0.022 second response time [17:02:55] RECOVERY - cp21 Stunnel HTTP for mw112 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15879 bytes in 0.020 second response time [17:02:56] RECOVERY - cp20 Stunnel HTTP for mwtask111 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15891 bytes in 0.357 second response time [17:02:57] RECOVERY - cp30 Stunnel HTTP for mw111 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15893 bytes in 0.320 second response time [17:03:01] PROBLEM - mw101 MediaWiki Rendering on mw101 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:03:06] RECOVERY - cp21 Stunnel HTTP for reports121 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 10881 bytes in 0.028 second response time [17:03:07] RECOVERY - cp21 Stunnel HTTP for mw102 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15893 bytes in 0.591 second response time [17:03:08] PROBLEM - cp20 Stunnel HTTP for mw101 on cp20 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 328 bytes in 0.861 second response time [17:03:12] RECOVERY - cp31 Stunnel HTTP for mw102 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15893 bytes in 2.438 second response time [17:03:18] RECOVERY - cp20 Stunnel HTTP for mw121 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15893 bytes in 0.021 second response time [17:03:25] RECOVERY - cp30 Stunnel HTTP for phab121 on cp30 is OK: HTTP OK: Status line output matched "500" - 2855 bytes in 0.275 second response time [17:03:27] RECOVERY - cp20 Stunnel HTTP for mw102 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15893 bytes in 0.030 second response time [17:03:33] PROBLEM - cp20 Stunnel HTTP for test101 on cp20 is CRITICAL: HTTP CRITICAL - No data received from host [17:03:34] PROBLEM - matomo101 php-fpm on matomo101 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [17:03:38] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 5.15, 6.27, 6.77 [17:03:51] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 0.39, 1.29, 1.42 [17:03:55] PROBLEM - cp21 HTTP 4xx/5xx ERROR Rate on cp21 is CRITICAL: CRITICAL - NGINX Error Rate is 93% [17:04:09] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 2 datacenters are down: 198.244.148.90/cpweb, 2001:41d0:801:2000::1b80/cpweb [17:04:12] PROBLEM - cp30 Stunnel HTTP for mw101 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:04:14] RECOVERY - cp31 Stunnel HTTP for mwtask111 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15891 bytes in 0.316 second response time [17:04:18] PROBLEM - cp31 Stunnel HTTP for mw101 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:04:21] RECOVERY - cp20 Stunnel HTTP for phab121 on cp20 is OK: HTTP OK: Status line output matched "500" - 2855 bytes in 0.055 second response time [17:04:23] PROBLEM - matomo101 NTP time on matomo101 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:04:26] PROBLEM - ns1 GDNSD Datacenters on ns1 is CRITICAL: CRITICAL - 2 datacenters are down: 198.244.148.90/cpweb, 2001:41d0:801:2000::1b80/cpweb [17:05:32] RECOVERY - cp20 Stunnel HTTP for test101 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15895 bytes in 0.029 second response time [17:05:55] RECOVERY - cp21 HTTP 4xx/5xx ERROR Rate on cp21 is OK: OK - NGINX Error Rate is 3% [17:06:10] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [17:06:24] RECOVERY - matomo101 Redis Process on matomo101 is OK: PROCS OK: 1 process with args 'redis-server' [17:06:26] RECOVERY - ns1 GDNSD Datacenters on ns1 is OK: OK - all datacenters are online [17:06:32] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.15, 1.67, 1.41 [17:06:36] RECOVERY - matomo101 NTP time on matomo101 is OK: NTP OK: Offset -0.006608337164 secs [17:07:00] PROBLEM - cp20 Stunnel HTTP for mw122 on cp20 is CRITICAL: HTTP CRITICAL - No data received from host [17:07:45] RECOVERY - cp21 Stunnel HTTP for mw101 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15879 bytes in 0.579 second response time [17:07:46] RECOVERY - cp20 Stunnel HTTP for mail121 on cp20 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 427 bytes in 0.924 second response time [17:08:14] RECOVERY - cp21 Varnish Backends on cp21 is OK: All 14 backends are healthy [17:08:14] RECOVERY - cp30 Stunnel HTTP for mw101 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15887 bytes in 0.310 second response time [17:08:22] RECOVERY - cp31 Stunnel HTTP for mw101 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15893 bytes in 1.308 second response time [17:08:23] paladox, Reception123: ^ everything was down temporarily a minute ago, semi-recovering, but not sure why that keeps happening with "No data received from host" [17:08:24] PROBLEM - cp20 Stunnel HTTP for puppet111 on cp20 is CRITICAL: HTTP CRITICAL - No data received from host [17:08:32] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 0.68, 1.28, 1.30 [17:08:54] RECOVERY - cp30 Varnish Backends on cp30 is OK: All 14 backends are healthy [17:08:59] RECOVERY - cp20 Stunnel HTTP for mw122 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15893 bytes in 3.719 second response time [17:09:07] RECOVERY - mw101 MediaWiki Rendering on mw101 is OK: HTTP OK: HTTP/1.1 200 OK - 29915 bytes in 3.573 second response time [17:09:14] RECOVERY - cp20 Stunnel HTTP for mw101 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15893 bytes in 0.621 second response time [17:09:26] RECOVERY - cp31 Varnish Backends on cp31 is OK: All 14 backends are healthy [17:10:24] RECOVERY - cp20 Stunnel HTTP for puppet111 on cp20 is OK: HTTP OK: Status line output matched "403" - 289 bytes in 0.012 second response time [17:11:01] PROBLEM - cp30 Stunnel HTTP for mw102 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:11:22] PROBLEM - cp21 Stunnel HTTP for mw102 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:11:42] PROBLEM - cp20 Stunnel HTTP for mw102 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:11:43] PROBLEM - cp31 Stunnel HTTP for mw102 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:12:08] PROBLEM - matomo101 Redis Process on matomo101 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [17:12:28] PROBLEM - mw102 MediaWiki Rendering on mw102 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:12:46] RECOVERY - cp20 Varnish Backends on cp20 is OK: All 14 backends are healthy [17:13:12] RECOVERY - matomo101 php-fpm on matomo101 is OK: PROCS OK: 9 processes with command name 'php-fpm7.4' [17:13:12] RECOVERY - matomo101 conntrack_table_size on matomo101 is OK: OK: nf_conntrack is 0 % full [17:13:42] RECOVERY - matomo101 ferm_active on matomo101 is OK: OK ferm input default policy is set [17:13:44] RECOVERY - cp20 Stunnel HTTP for mw102 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15893 bytes in 8.153 second response time [17:13:48] RECOVERY - cp31 Stunnel HTTP for mw102 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15879 bytes in 5.574 second response time [17:14:27] RECOVERY - mw102 MediaWiki Rendering on mw102 is OK: HTTP OK: HTTP/1.1 200 OK - 29915 bytes in 0.359 second response time [17:15:04] RECOVERY - cp30 Stunnel HTTP for mw102 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15893 bytes in 0.342 second response time [17:15:22] RECOVERY - cp21 Stunnel HTTP for mw102 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15887 bytes in 0.063 second response time [17:16:21] RECOVERY - matomo101 Redis Process on matomo101 is OK: PROCS OK: 1 process with args 'redis-server' [17:18:30] RECOVERY - matomo101 SSH on matomo101 is OK: SSH OK - OpenSSH_8.4p1 Debian-5 (protocol 2.0) [17:20:47] PROBLEM - matomo101 NTP time on matomo101 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:21:25] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 8.70, 7.24, 6.87 [17:21:32] PROBLEM - cp21 Stunnel HTTP for mw102 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:21:58] PROBLEM - cp20 Stunnel HTTP for mw102 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:22:55] PROBLEM - cp30 Varnish Backends on cp30 is CRITICAL: 1 backends are down. mw111 [17:22:55] PROBLEM - matomo101 SSH on matomo101 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:23:23] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.01, 7.06, 6.85 [17:23:27] RECOVERY - cp21 Stunnel HTTP for mw102 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15887 bytes in 0.020 second response time [17:24:01] RECOVERY - cp20 Stunnel HTTP for mw102 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15879 bytes in 9.386 second response time [17:25:02] PROBLEM - matomo101 ferm_active on matomo101 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [17:25:18] PROBLEM - matomo101 conntrack_table_size on matomo101 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [17:25:22] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 6.13, 6.78, 6.77 [17:25:39] CosmicAlpha: got a 503 on deploy [17:25:47] but not sure if that's what caused it or if it failed *because* of the 503 [17:25:49] cc RhinosF1 [17:26:04] RECOVERY - matomo101 Puppet on matomo101 is OK: OK: Puppet is currently enabled, last run 36 minutes ago with 0 failures [17:26:21] RECOVERY - cp30 Stunnel HTTP for matomo101 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 99069 bytes in 0.849 second response time [17:26:26] nope unrelated since it's now recovered [17:26:27] Reception123: I think it failed because 503 [17:26:44] RECOVERY - matomo101 PowerDNS Recursor on matomo101 is OK: DNS OK: 0.494 seconds response time. miraheze.org returns 198.244.148.90,2001:41d0:801:2000::1b80,2001:41d0:801:2000::4c25,51.195.220.68 [17:26:46] RECOVERY - cp31 Stunnel HTTP for matomo101 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 99046 bytes in 0.799 second response time [17:26:57] RECOVERY - matomo101 ferm_active on matomo101 is OK: OK ferm input default policy is set [17:27:02] RECOVERY - matomo101 SSH on matomo101 is OK: SSH OK - OpenSSH_8.4p1 Debian-5 (protocol 2.0) [17:27:02] yeah that seems likely [17:27:18] RECOVERY - matomo101 conntrack_table_size on matomo101 is OK: OK: nf_conntrack is 0 % full [17:27:36] RECOVERY - matomo101 APT on matomo101 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [17:27:48] RECOVERY - matomo101 NTP time on matomo101 is OK: NTP OK: Offset -0.007875710726 secs [17:27:51] RECOVERY - cp21 Stunnel HTTP for matomo101 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 99061 bytes in 0.764 second response time [17:27:55] RECOVERY - cp20 Stunnel HTTP for matomo101 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 99061 bytes in 0.432 second response time [17:28:01] RECOVERY - matomo101 HTTPS on matomo101 is OK: HTTP OK: HTTP/1.1 200 OK - 99077 bytes in 0.532 second response time [17:28:55] RECOVERY - cp30 Varnish Backends on cp30 is OK: All 14 backends are healthy [17:28:56] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 11.88, 10.94, 9.41 [17:29:45] RECOVERY - gluster111 Puppet on gluster111 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [17:30:32] [Grafana] RESOLVED: PHP-FPM Worker Usage High https://grafana.miraheze.org/d/GtxbP1Xnk [17:30:54] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 8.82, 10.20, 9.33 [17:31:18] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 8.76, 6.92, 6.67 [17:33:17] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 5.17, 6.48, 6.56 [17:48:00] PROBLEM - gluster101 Puppet on gluster101 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [17:56:38] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.33, 1.87, 1.58 [17:58:34] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.75, 1.82, 1.59 [18:00:32] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.19, 1.90, 1.65 [18:01:01] PROBLEM - gluster121 Puppet on gluster121 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [18:02:32] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.41, 1.80, 1.65 [18:06:32] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.07, 1.58, 1.62 [18:08:09] PROBLEM - test101 Puppet on test101 is WARNING: WARNING: Puppet is currently disabled, message: Universal Omega, last run 13 minutes ago with 0 failures [18:09:44] [02mw-config] 07Universal-Omega closed pull request 03#4786: Attempt fix to licensing rights text and URL - 13https://github.com/miraheze/mw-config/pull/4786 [18:09:44] [url] Page not found · GitHub · GitHub | github.com [18:09:45] [02miraheze/mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-2 [18:09:47] [02mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-2 - 13https://github.com/miraheze/mw-config [18:09:47] [url] Page not found · GitHub · GitHub | github.com [18:09:48] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±2] 13https://github.com/miraheze/mw-config/compare/5845c4a709a0...481b1e34051a [18:09:49] [url] Comparing 5845c4a709a0...481b1e34051a · miraheze/mw-config · GitHub | github.com [18:09:50] [02miraheze/mw-config] 07Universal-Omega 03481b1e3 - Attempt fix to licensing rights text and URL (#4786) [18:10:30] !log manually deploy config to mw* [18:10:37] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:10:51] MirahezeLSBot is gone from here. [18:11:11] miraheze/mw-config - Universal-Omega the build passed. [18:16:00] RECOVERY - gluster101 Puppet on gluster101 is OK: OK: Puppet is currently enabled, last run 49 seconds ago with 0 failures [18:16:32] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.94, 1.85, 1.66 [18:18:32] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 0.83, 1.56, 1.58 [18:20:35] Reception123: restart log relay [18:21:04] PROBLEM - matomo101 Current Load on matomo101 is WARNING: WARNING - load average: 2.78, 2.46, 4.00 [18:24:44] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.77, 1.58, 1.21 [18:26:32] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.60, 1.90, 1.72 [18:26:43] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.10, 1.84, 1.36 [18:27:00] RECOVERY - matomo101 Current Load on matomo101 is OK: OK - load average: 1.93, 1.84, 3.22 [18:28:32] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.08, 1.55, 1.61 [18:28:42] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.25, 1.57, 1.32 [18:29:01] RECOVERY - gluster121 Puppet on gluster121 is OK: OK: Puppet is currently enabled, last run 38 seconds ago with 0 failures [18:36:27] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 12.00, 10.52, 9.63 [18:37:36] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/commit/24cb959a385d [18:37:37] [02miraheze/ImportDump] 07Universal-Omega 0324cb959 - Support pulling interwiki prefixes if the given source includes a path [18:37:39] [02ImportDump] 07Universal-Omega created branch 03Universal-Omega-patch-1 - 13https://github.com/miraheze/ImportDump [18:37:39] [url] Page not found · GitHub · GitHub | github.com [18:37:40] [02ImportDump] 07Universal-Omega opened pull request 03#13: Support pulling interwiki prefixes if the given source includes a path - 13https://github.com/miraheze/ImportDump/pull/13 [18:37:41] [url] Page not found · GitHub · GitHub | github.com [18:38:59] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 5.81, 4.67, 3.08 [18:40:27] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 8.67, 9.81, 9.58 [18:40:59] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 6.82, 5.61, 3.62 [18:42:59] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 4.91, 5.07, 3.66 [18:47:48] miraheze/ImportDump - Universal-Omega the build passed. [18:50:44] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/24cb959a385d...ece9c2f458aa [18:50:45] [url] Comparing 24cb959a385d...ece9c2f458aa · miraheze/ImportDump · GitHub | github.com [18:50:46] [02miraheze/ImportDump] 07Universal-Omega 03ece9c2f - Update ImportDumpRequestManager.php [18:50:47] [02ImportDump] 07Universal-Omega synchronize pull request 03#13: Support pulling interwiki prefixes if the given source includes a path - 13https://github.com/miraheze/ImportDump/pull/13 [18:50:48] [url] Page not found · GitHub · GitHub | github.com [18:51:11] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query dnd.bellinrattin.it. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [18:55:17] !log sudo -u www-data php /srv/mediawiki/w/extensions/WikiSEO/maintenance/GenerateDescription.php --wiki=gratispaideiawiki 0,4 --force [18:55:26] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:57:04] [02mw-config] 07Universal-Omega closed pull request 03#4698: Remove `$wgCitizenEnableDrawerSubSearch` from ManageWikiSettings - 13https://github.com/miraheze/mw-config/pull/4698 [18:57:04] [url] Page not found · GitHub · GitHub | github.com [18:57:05] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±2] 13https://github.com/miraheze/mw-config/compare/481b1e34051a...c41d699960f0 [18:57:06] [url] Comparing 481b1e34051a...c41d699960f0 · miraheze/mw-config · GitHub | github.com [18:57:07] [02miraheze/mw-config] 07alistair3149 03c41d699 - Remove `$wgCitizenEnableDrawerSubSearch` from ManageWikiSettings (#4698) [18:58:14] miraheze/mw-config - Universal-Omega the build passed. [18:59:34] miraheze/ImportDump - Universal-Omega the build passed. [19:00:34] !log sudo -u www-data /usr/local/bin/foreachwikiindblist /home/universalomega/citizen.json /srv/mediawiki/w/extensions/ManageWiki/maintenance/populateWikiSettings.php --wgsetting=wgCitizenEnableDrawerSubSearch --sourcelist=false --remove [19:00:44] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:01:45] PROBLEM - gluster111 Puppet on gluster111 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [19:03:57] !log manually deploy config to mw* [19:04:04] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:05:16] [02ImportDump] 07Universal-Omega closed pull request 03#13: Support pulling interwiki prefixes if the given source includes a path - 13https://github.com/miraheze/ImportDump/pull/13 [19:05:17] [url] Page not found · GitHub · GitHub | github.com [19:05:18] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/f794dd9186ba...d8e0e6cad3bf [19:05:18] [url] Comparing f794dd9186ba...d8e0e6cad3bf · miraheze/ImportDump · GitHub | github.com [19:05:19] [02miraheze/ImportDump] 07Universal-Omega 03d8e0e6c - Support pulling interwiki prefixes if the given source includes a path (#13) [19:05:21] [02ImportDump] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 - 13https://github.com/miraheze/ImportDump [19:05:21] ... [19:05:22] [02miraheze/ImportDump] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 [19:07:09] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.40, 10.51, 9.62 [19:07:17] RhinosF1: log relay? [19:07:38] Reception123: the thing that posts to irc from server [19:07:57] MirahezeLSBot [19:08:00] ah [19:09:30] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.28, 2.52, 1.56 [19:10:23] I wonder what that service is called [19:11:28] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 0.49, 1.78, 1.41 [19:13:26] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.41, 1.35, 1.29 [19:13:29] [02miraheze/mw-config] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/c41d699960f0...8f4409b41e57 [19:13:30] [url] Comparing c41d699960f0...8f4409b41e57 · miraheze/mw-config · GitHub | github.com [19:13:31] [02miraheze/mw-config] 07Reception123 038f4409b - rm upgrade sitenotices [19:13:52] FYI I've removed the upgrade sitenotices as 5 days have passed and it's probably annoying for people to have 3 sitenotices at all times [19:14:10] Reception123: the service should be in puppet [19:14:17] yeah I'll look now [19:14:33] miraheze/mw-config - Reception123 the build passed. [19:15:24] miraheze/ImportDump - Universal-Omega the build passed. [19:15:27] Reception123: irclogserverbot [19:15:41] RhinosF1: I found it just a second before this DM :P [19:15:46] !log sudo service irclogserverbot restart on mon111 [19:15:49] *this message [19:15:54] :) [19:15:59] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:17:19] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.21, 2.13, 1.62 [19:18:51] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 9.61, 10.19, 10.03 [19:21:15] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.92, 1.92, 1.64 [19:21:18] Reception123: we're not-for-profit not non-profit [19:22:02] RhinosF1: where did that slip in? [19:22:11] the survey is last year's + Agent's changes [19:22:35] Reception123: one of the Qs [19:22:43] RhinosF1: it's from years before, so I guess blame JohnLewis! [19:22:56] but will fix, the terms do get confusing so I don't blame him [19:22:59] Blame John sounds good [19:23:02] And yes it is [19:23:13] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.86, 1.58, 1.55 [19:23:36] !log [@mwtask111] starting deploy of {'config': True} to all [19:23:50] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:23:53] !log [@mwtask111] finished deploy of {'config': True} to all - SUCCESS in 17s [19:23:58] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:24:39] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.54, 10.33, 10.12 [19:25:07] [02miraheze/MirahezeMagic] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/MirahezeMagic/compare/e248de844b6c...7cdb17acff4a [19:25:08] [url] Comparing e248de844b6c...7cdb17acff4a · miraheze/MirahezeMagic · GitHub | github.com [19:25:09] [02miraheze/MirahezeMagic] 07Reception123 037cdb17a - non-profit->not-for-profit [19:29:45] RECOVERY - gluster111 Puppet on gluster111 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [19:30:30] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 8.37, 10.11, 10.17 [19:31:03] PROBLEM - cp31 Stunnel HTTP for mw111 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:31:27] PROBLEM - cp30 Stunnel HTTP for mw111 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:32:28] [02miraheze/mediawiki] 07Reception123 pushed 031 commit to 03REL1_38 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/fbe64e38815b...1a600c6f7244 [19:32:28] [url] Comparing fbe64e38815b...1a600c6f7244 · miraheze/mediawiki · GitHub | github.com [19:32:29] [02miraheze/mediawiki] 07Reception123 031a600c6 - Update MM [19:32:49] !log [reception@mwtask111] starting deploy of {'world': True, 'l10n': True} to all [19:33:01] PROBLEM - gluster121 Puppet on gluster121 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): File[/etc/apt/trusted.gpg.d/puppetlabs.gpg] [19:33:05] RECOVERY - cp31 Stunnel HTTP for mw111 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15887 bytes in 5.301 second response time [19:33:06] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:33:30] RECOVERY - cp30 Stunnel HTTP for mw111 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15893 bytes in 3.525 second response time [19:34:11] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/commit/68525a1c4d70 [19:34:12] [02miraheze/ImportDump] 07Universal-Omega 0368525a1 - Support inserting interwiki prefixes [19:34:14] [02ImportDump] 07Universal-Omega created branch 03Universal-Omega-patch-1 - 13https://github.com/miraheze/ImportDump [19:34:14] [url] Page not found · GitHub · GitHub | github.com [19:34:15] [02ImportDump] 07Universal-Omega opened pull request 03#14: Support inserting interwiki prefixes - 13https://github.com/miraheze/ImportDump/pull/14 [19:34:16] [url] Page not found · GitHub · GitHub | github.com [19:34:27] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.16, 10.45, 10.25 [19:34:52] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/68525a1c4d70...98fcfbc48ea8 [19:34:53] [url] Comparing 68525a1c4d70...98fcfbc48ea8 · miraheze/ImportDump · GitHub | github.com [19:34:54] [02miraheze/ImportDump] 07Universal-Omega 0398fcfbc - Update ServiceWiring.php [19:34:55] [02ImportDump] 07Universal-Omega synchronize pull request 03#14: Support inserting interwiki prefixes - 13https://github.com/miraheze/ImportDump/pull/14 [19:34:56] [url] Page not found · GitHub · GitHub | github.com [19:35:38] [02ImportDump] 07Universal-Omega edited pull request 03#14: Support inserting interwiki prefixes - 13https://github.com/miraheze/ImportDump/pull/14 [19:35:39] [url] Page not found · GitHub · GitHub | github.com [19:35:54] miraheze/MirahezeMagic - Reception123 the build passed. [19:36:27] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.44, 11.02, 10.47 [19:38:27] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.58, 10.73, 10.43 [19:40:27] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 13.10, 11.68, 10.81 [19:40:59] PROBLEM - mwtask111 Current Load on mwtask111 is WARNING: WARNING - load average: 3.41, 3.18, 2.43 [19:41:30] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CRITICAL - load average: 1.26, 2.28, 1.66 [19:42:44] miraheze/ImportDump - Universal-Omega the build passed. [19:42:59] RECOVERY - mwtask111 Current Load on mwtask111 is OK: OK - load average: 3.38, 3.22, 2.54 [19:43:04] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.62, 9.67, 8.88 [19:43:30] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 0.40, 1.65, 1.51 [19:44:04] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.02, 2.54, 1.73 [19:44:59] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.74, 9.11, 8.76 [19:46:03] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/98fcfbc48ea8...54f68158cbaf [19:46:03] [url] Comparing 98fcfbc48ea8...54f68158cbaf · miraheze/ImportDump · GitHub | github.com [19:46:04] [02miraheze/ImportDump] 07Universal-Omega 0354f6815 - Update ImportDumpRequestViewer.php [19:46:06] [02ImportDump] 07Universal-Omega synchronize pull request 03#14: Support inserting interwiki prefixes - 13https://github.com/miraheze/ImportDump/pull/14 [19:46:06] [url] Page not found · GitHub · GitHub | github.com [19:46:27] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.54, 11.18, 10.97 [19:48:02] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.10, 1.82, 1.62 [19:49:20] miraheze/ImportDump - Universal-Omega the build has errored. [19:50:01] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.07, 1.68, 1.60 [19:50:03] RECOVERY - dnd.bellinrattin.it - reverse DNS on sslhost is OK: SSL OK - dnd.bellinrattin.it reverse DNS resolves to cp21.miraheze.org - CNAME OK [19:53:57] !log [reception@mwtask111] starting deploy of {'world': True, 'files': '/srv/mediawiki/w/extensions/MirahezeMagic/i18n/en.json'} to all [19:54:05] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:54:27] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.04, 11.13, 10.93 [19:54:59] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.39, 3.33, 3.91 [19:55:46] !log [reception@mwtask111] DEPLOY ABORTED: Non-Zero Exit Code in prep, see output. [19:55:54] !log [reception@mwtask111] starting deploy of {'files': '/srv/mediawiki/w/extensions/MirahezeMagic/i18n/en.json'} to all [19:55:54] PROBLEM - mwtask111 Current Load on mwtask111 is WARNING: WARNING - load average: 3.90, 3.62, 3.09 [19:55:54] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:56:05] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:56:17] !log [reception@mwtask111] starting deploy of {'files': '/srv/mediawiki/w/extensions/MirahezeMagic/i18n/miraheze/en.json'} to all [19:56:27] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.76, 10.90, 10.90 [19:56:27] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:57:53] RECOVERY - mwtask111 Current Load on mwtask111 is OK: OK - load average: 3.00, 3.31, 3.03 [19:58:32] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.48, 1.83, 1.49 [19:58:33] !log [reception@mwtask111] starting deploy of {'files': 'w/extensions/MirahezeMagic/includes/SpecialMirahezeSurvey.php'} to all [19:58:42] !log [reception@mwtask111] finished deploy of {'files': 'w/extensions/MirahezeMagic/includes/SpecialMirahezeSurvey.php'} to all - SUCCESS in 9s [19:58:44] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:58:53] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:58:53] !log [reception@mwtask111] starting deploy of {'l10n': True, 'lang': 'en'} to all [19:59:05] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:00:59] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.29, 3.64, 3.83 [20:01:44] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.39, 10.12, 8.70 [20:02:32] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.39, 1.64, 1.49 [20:03:44] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 8.98, 9.30, 8.56 [20:03:49] PROBLEM - mwtask111 Current Load on mwtask111 is CRITICAL: CRITICAL - load average: 4.16, 3.82, 3.33 [20:06:27] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 15.04, 12.61, 11.56 [20:06:59] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.57, 3.50, 3.75 [20:09:46] PROBLEM - mwtask111 Current Load on mwtask111 is WARNING: WARNING - load average: 3.05, 3.81, 3.54 [20:10:27] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.32, 11.44, 11.37 [20:10:59] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.31, 3.64, 3.74 [20:12:59] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.08, 3.42, 3.64 [20:13:01] PROBLEM - test101 Redis Process on test101 is CRITICAL: PROCS CRITICAL: 0 processes with args 'redis-server' [20:13:14] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.88, 9.85, 9.06 [20:13:32] !log [reception@mwtask111] finished deploy of {'l10n': True, 'lang': 'en'} to all - SUCCESS in 878s [20:13:34] !log [reception@mwtask111] finished deploy of {'world': True, 'l10n': True} to all - SUCCESS in 2444s [20:13:38] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:13:43] RECOVERY - mwtask111 Current Load on mwtask111 is OK: OK - load average: 1.50, 2.77, 3.20 [20:13:44] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:13:50] PROBLEM - test101 JobChron Service on test101 is CRITICAL: PROCS CRITICAL: 0 processes with args 'redisJobChronService' [20:14:13] PROBLEM - test101 JobRunner Service on test101 is CRITICAL: PROCS CRITICAL: 0 processes with args 'redisJobRunnerService' [20:15:14] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.68, 8.85, 8.79 [20:16:27] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 6.85, 8.71, 10.20 [20:16:53] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.59, 3.65, 3.97 [20:18:00] PROBLEM - gluster101 Puppet on gluster101 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [20:18:59] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.36, 4.18, 3.86 [20:20:59] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.27, 3.39, 3.60 [20:26:53] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 6.44, 4.12, 3.92 [20:26:59] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 8.00, 4.52, 3.86 [20:27:47] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.48, 2.02, 1.55 [20:28:59] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.82, 3.85, 3.70 [20:29:01] RECOVERY - gluster121 Puppet on gluster121 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [20:29:45] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.91, 1.58, 1.44 [20:34:53] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.56, 3.93, 3.94 [20:40:53] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.38, 4.50, 4.16 [20:41:17] PROBLEM - cloud10 Puppet on cloud10 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[ulogd2] [20:42:27] PROBLEM - matomo101 Current Load on matomo101 is WARNING: WARNING - load average: 3.87, 3.22, 2.68 [20:42:59] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.56, 4.43, 3.96 [20:44:26] RECOVERY - matomo101 Current Load on matomo101 is OK: OK - load average: 2.77, 2.99, 2.66 [20:46:00] RECOVERY - gluster101 Puppet on gluster101 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [20:52:22] PROBLEM - matomo101 Current Load on matomo101 is CRITICAL: CRITICAL - load average: 8.03, 5.47, 3.73 [20:54:32] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 5.31, 6.18, 3.22 [20:55:00] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.54, 10.43, 9.53 [20:56:19] PROBLEM - matomo101 Current Load on matomo101 is WARNING: WARNING - load average: 2.96, 3.99, 3.50 [21:00:16] RECOVERY - matomo101 Current Load on matomo101 is OK: OK - load average: 2.12, 3.17, 3.29 [21:00:51] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 9.37, 10.19, 9.75 [21:00:53] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.02, 3.56, 3.99 [21:01:45] PROBLEM - gluster111 Puppet on gluster111 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [21:04:32] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 0.40, 1.33, 1.99 [21:04:47] !log [universalomega@test101] starting deploy of {'pull': 'config', 'config': True, 'ignoretime': True} to all [21:04:51] !log [universalomega@test101] finished deploy of {'pull': 'config', 'config': True, 'ignoretime': True} to all - SUCCESS in 4s [21:04:53] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:04:58] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:05:01] RECOVERY - test101 Redis Process on test101 is OK: PROCS OK: 1 process with args 'redis-server' [21:06:09] RECOVERY - test101 Puppet on test101 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [21:06:13] RECOVERY - test101 JobRunner Service on test101 is OK: PROCS OK: 1 process with args 'redisJobRunnerService' [21:06:38] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.52, 10.98, 10.20 [21:07:57] miraheze/mw-config - Universal-Omega the build passed. [21:08:53] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.66, 4.18, 4.03 [21:08:59] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.61, 3.81, 4.00 [21:09:16] RECOVERY - cloud10 Puppet on cloud10 is OK: OK: Puppet is currently enabled, last run 12 seconds ago with 0 failures [21:09:28] miraheze/mw-config - Universal-Omega the build passed. [21:10:31] miraheze/mw-config - Universal-Omega the build passed. [21:10:32] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 0.42, 0.97, 1.62 [21:10:32] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 8.65, 9.96, 9.97 [21:10:59] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.07, 4.27, 4.14 [21:13:05] miraheze/ImportDump - Universal-Omega the build has errored. [21:22:02] PROBLEM - matomo101 Current Load on matomo101 is CRITICAL: CRITICAL - load average: 11.13, 5.92, 3.89 [21:22:04] !log [@test101] starting deploy of {'config': True} to all [21:22:05] !log [@test101] finished deploy of {'config': True} to all - SUCCESS in 1s [21:22:13] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:22:22] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:22:35] PROBLEM - cp21 Stunnel HTTP for matomo101 on cp21 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 358 bytes in 0.881 second response time [21:22:45] PROBLEM - matomo101 APT on matomo101 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [21:22:49] !log [@mwtask111] starting deploy of {'config': True} to all [21:22:53] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.99, 3.52, 3.95 [21:22:57] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:22:59] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.42, 3.10, 3.88 [21:22:59] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 8.12, 6.89, 5.94 [21:23:01] !log [@mwtask111] finished deploy of {'config': True} to all - SUCCESS in 11s [21:23:09] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:23:21] miraheze/ImportDump - Universal-Omega the build passed. [21:23:38] PROBLEM - cp30 Stunnel HTTP for matomo101 on cp30 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 358 bytes in 0.252 second response time [21:23:50] RECOVERY - test101 JobChron Service on test101 is OK: PROCS OK: 1 process with args 'redisJobChronService' [21:24:34] RECOVERY - cp21 Stunnel HTTP for matomo101 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 99061 bytes in 1.010 second response time [21:24:43] RECOVERY - matomo101 APT on matomo101 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [21:24:59] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 6.05, 6.70, 6.00 [21:25:38] RECOVERY - cp30 Stunnel HTTP for matomo101 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 99069 bytes in 1.243 second response time [21:26:53] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.78, 3.98, 3.99 [21:28:59] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 6.91, 4.60, 4.20 [21:31:01] PROBLEM - gluster121 Puppet on gluster121 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [21:31:46] CosmicAlpha: gratispaideiawiki returns exceptions https://gratispaideia.miraheze.org/wiki/Main_Page [21:31:53] I'm sure after that script [21:31:55] PROBLEM - matomo101 Current Load on matomo101 is WARNING: WARNING - load average: 1.78, 3.32, 3.86 [21:32:37] maybe a maintainance script needs to be run, or you look into it [21:32:52] ugochimobi: I'm mobile now. Bit it maybe been related to https://github.com/miraheze/mw-config/commit/a593e2d05cce5d56dad8541a03097fd5d199573f [21:32:52] [url] setup entitySources for gratisdatawiki and co (#4678) · miraheze/mw-config@a593e2d · GitHub | github.com [21:32:59] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.10, 3.86, 3.99 [21:34:09] CosmicAlpha: oh, let me see [21:34:27] I will revert it. [21:35:04] miraheze/mw-config - Universal-Omega the build passed. [21:35:33] CosmicAlpha: you think so? [21:35:56] Reverted, and then opened https://github.com/miraheze/mw-config/pull/4788, I'll look into it later when I have time. [21:35:56] [url] Revert "Revert "setup entitySources for gratisdatawiki and co"" by Universal-Omega · Pull Request #4788 · miraheze/mw-config · GitHub | github.com [21:36:42] miraheze/mw-config - Universal-Omega the build passed. [21:36:44] CosmicAlpha: right, okay [21:36:45] miraheze/mw-config - Universal-Omega the build passed. [21:36:59] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.64, 3.94, 3.96 [21:37:51] RECOVERY - matomo101 Current Load on matomo101 is OK: OK - load average: 2.27, 2.47, 3.30 [21:38:59] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.68, 3.93, 3.96 [21:39:07] PROBLEM - wiki.autocountsoft.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.autocountsoft.com' expires in 15 day(s) (Wed 06 Jul 2022 21:13:42 GMT +0000). [21:40:59] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 6.65, 4.88, 4.30 [21:46:59] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.20, 3.31, 3.80 [21:48:59] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 7.00, 4.64, 4.22 [21:51:09] PROBLEM - matomo101 APT on matomo101 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [21:51:46] PROBLEM - matomo101 Current Load on matomo101 is CRITICAL: CRITICAL - load average: 17.21, 8.89, 5.27 [21:51:48] PROBLEM - cp31 Stunnel HTTP for matomo101 on cp31 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 358 bytes in 0.601 second response time [21:51:49] PROBLEM - cp30 Stunnel HTTP for matomo101 on cp30 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 358 bytes in 1.393 second response time [21:52:28] !log [@test101] starting deploy of {'config': True} to all [21:52:30] !log [@test101] finished deploy of {'config': True} to all - SUCCESS in 1s [21:52:31] !log [@mwtask111] starting deploy of {'config': True} to all [21:52:33] PROBLEM - cp21 Stunnel HTTP for matomo101 on cp21 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 358 bytes in 1.507 second response time [21:52:40] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:52:41] !log [@mwtask111] finished deploy of {'config': True} to all - SUCCESS in 10s [21:52:46] PROBLEM - cp20 Stunnel HTTP for matomo101 on cp20 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 358 bytes in 0.138 second response time [21:52:51] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:52:59] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.95, 3.81, 3.99 [21:53:05] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:53:16] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:53:23] PROBLEM - matomo101 HTTPS on matomo101 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 358 bytes in 0.111 second response time [21:54:32] RECOVERY - cp21 Stunnel HTTP for matomo101 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 99061 bytes in 0.615 second response time [21:56:55] RECOVERY - cp20 Stunnel HTTP for matomo101 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 99061 bytes in 1.444 second response time [21:56:59] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.34, 3.80, 3.92 [21:57:26] RECOVERY - matomo101 HTTPS on matomo101 is OK: HTTP OK: HTTP/1.1 200 OK - 99077 bytes in 2.331 second response time [21:57:27] RECOVERY - matomo101 APT on matomo101 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [21:57:39] RECOVERY - cp30 Stunnel HTTP for matomo101 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 99069 bytes in 2.093 second response time [21:57:45] RECOVERY - cp31 Stunnel HTTP for matomo101 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 99069 bytes in 1.845 second response time [21:58:30] [02ImportDump] 07Universal-Omega synchronize pull request 03#14: Support inserting interwiki prefixes - 13https://github.com/miraheze/ImportDump/pull/14 [21:58:31] [url] Page not found · GitHub · GitHub | github.com [21:58:41] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/54f68158cbaf...d1a765db67e1 [21:58:41] [url] Comparing 54f68158cbaf...d1a765db67e1 · miraheze/ImportDump · GitHub | github.com [21:58:42] [02miraheze/ImportDump] 07Universal-Omega 03d1a765d - Update ImportDumpRequestViewer.php [21:59:01] RECOVERY - gluster121 Puppet on gluster121 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [21:59:45] RECOVERY - gluster111 Puppet on gluster111 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [22:03:28] [02mw-config] 07Universal-Omega closed pull request 03#4678: setup entitySources for gratisdatawiki and co - 13https://github.com/miraheze/mw-config/pull/4678 [22:03:29] [url] Page not found · GitHub · GitHub | github.com [22:09:03] RECOVERY - wiki.autocountsoft.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.autocountsoft.com' will expire on Sun 18 Sep 2022 20:39:54 GMT +0000. [22:10:53] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.92, 3.41, 3.93 [22:11:07] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.46, 1.55, 1.98 [22:12:59] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.31, 3.05, 3.93 [22:13:27] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03revert-4678-patch-73 [+0/-0/±1] 13https://github.com/miraheze/mw-config/commit/f0ba5a831fae [22:13:28] [02miraheze/mw-config] 07Universal-Omega 03f0ba5a8 - Revert "setup entitySources for gratisdatawiki and co (#4678)" [22:14:00] [02mw-config] 07Universal-Omega created branch 03revert-4787-revert-4678-patch-73 - 13https://github.com/miraheze/mw-config [22:14:01] [url] Page not found · GitHub · GitHub | github.com [22:14:59] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.13, 3.77, 3.99 [22:18:00] PROBLEM - gluster101 Puppet on gluster101 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [22:18:29] [02mw-config] 07Universal-Omega created branch 03revert-4678-patch-73 - 13https://github.com/miraheze/mw-config [22:18:30] [url] Page not found · GitHub · GitHub | github.com [22:18:56] [02miraheze/mw-config] 07Universal-Omega deleted branch 03revert-4678-patch-73 [22:18:58] Well that was delayed... [22:18:59] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.44, 3.94, 4.01 [22:20:59] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.77, 3.87, 3.98 [22:21:07] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.28, 1.81, 1.83 [22:21:44] PROBLEM - cp30 Stunnel HTTP for matomo101 on cp30 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 358 bytes in 0.296 second response time [22:22:47] [02mw-config] 07Universal-Omega synchronize pull request 03#4678: setup entitySources for gratisdatawiki and co - 13https://github.com/miraheze/mw-config/pull/4678 [22:22:48] [url] Page not found · GitHub · GitHub | github.com [22:22:53] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.02, 3.95, 3.91 [22:22:59] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.00, 4.53, 4.15 [22:22:59] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 6.30, 4.99, 4.39 [22:23:07] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.60, 1.75, 1.80 [22:24:18] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/8f4409b41e57...a593e2d05cce [22:24:18] [url] Comparing 8f4409b41e57...a593e2d05cce · miraheze/mw-config · GitHub | github.com [22:24:19] [02miraheze/mw-config] 07ugochimobi 03a593e2d - setup entitySources for gratisdatawiki and co (#4678) [22:24:53] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.30, 3.27, 3.66 [22:24:59] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.15, 3.97, 3.99 [22:25:38] RECOVERY - cp30 Stunnel HTTP for matomo101 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 99069 bytes in 1.192 second response time [22:26:59] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.38, 3.66, 3.98 [22:27:07] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.14, 1.40, 1.65 [22:29:55] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/a593e2d05cce...8bab1c32165f [22:29:56] [url] Comparing a593e2d05cce...8bab1c32165f · miraheze/mw-config · GitHub | github.com [22:29:57] [02miraheze/mw-config] 07Universal-Omega 038bab1c3 - Revert "setup entitySources for gratisdatawiki and co" (#4787) [22:32:59] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.12, 3.41, 3.64 [22:32:59] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.73, 3.83, 3.89 [22:33:36] [02mw-config] 07Universal-Omega opened pull request 03#4787: Revert "setup entitySources for gratisdatawiki and co" - 13https://github.com/miraheze/mw-config/pull/4787 [22:33:36] [url] Page not found · GitHub · GitHub | github.com [22:33:54] [02mw-config] 07Universal-Omega deleted branch 03revert-4678-patch-73 - 13https://github.com/miraheze/mw-config [22:33:55] ... [22:34:53] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.58, 3.10, 3.40 [22:34:59] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.23, 3.38, 3.61 [22:35:40] [02mw-config] 07Universal-Omega closed pull request 03#4787: Revert "setup entitySources for gratisdatawiki and co" - 13https://github.com/miraheze/mw-config/pull/4787 [22:35:41] ... [22:35:42] [02mw-config] 07Universal-Omega opened pull request 03#4788: Revert "Revert "setup entitySources for gratisdatawiki and co"" - 13https://github.com/miraheze/mw-config/pull/4788 [22:35:42] [url] Page not found · GitHub · GitHub | github.com [22:35:43] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03revert-4787-revert-4678-patch-73 [+0/-0/±1] 13https://github.com/miraheze/mw-config/commit/e9128cb4b31a [22:35:45] [02miraheze/mw-config] 07Universal-Omega 03e9128cb - Revert "Revert "setup entitySources for gratisdatawiki and co" (#4787)" [22:36:27] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.30, 9.65, 8.70 [22:36:44] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/0f93e17a5707...9e3b6073ef51 [22:36:45] [url] Comparing 0f93e17a5707...9e3b6073ef51 · miraheze/ssl · GitHub | github.com [22:36:45] [02miraheze/ssl] 07MirahezeSSLBot 039e3b607 - Bot: Update SSL cert for wiki.autocountsoft.com [22:36:47] [02mw-config] 07Universal-Omega closed pull request 03#4699: Add search-related Citizen config to ManageWikiSettings - 13https://github.com/miraheze/mw-config/pull/4699 [22:36:47] [url] Page not found · GitHub · GitHub | github.com [22:36:59] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.99, 3.67, 3.84 [22:37:10] miraheze/mw-config - Universal-Omega the build passed. [22:38:27] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 8.91, 9.40, 8.73 [22:38:53] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.57, 4.04, 3.73 [22:40:08] [02mw-config] 07Universal-Omega closed pull request 03#4710: add Kartographer config to ManageWiki - 13https://github.com/miraheze/mw-config/pull/4710 [22:40:08] [url] Page not found · GitHub · GitHub | github.com [22:40:53] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.45, 3.87, 3.71 [22:40:55] miraheze/mw-config - Universal-Omega the build passed. [22:42:12] [02mw-config] 07Universal-Omega closed pull request 03#4704: Temporarily adjust setting to allow me to reset my Betaheze password - 13https://github.com/miraheze/mw-config/pull/4704 [22:42:13] [url] Page not found · GitHub · GitHub | github.com [22:42:14] [02mw-config] 07Universal-Omega commented on pull request 03#4736: Set new RemovePII DPA validation variables - 13https://github.com/miraheze/mw-config/pull/4736#issuecomment-1160912631 [22:42:14] [url] Set new RemovePII DPA validation variables by Universal-Omega · Pull Request #4736 · miraheze/mw-config · GitHub | github.com [22:42:19] [02mw-config] 07Universal-Omega commented on pull request 03#4704: Temporarily adjust setting to allow me to reset my Betaheze password - 13https://github.com/miraheze/mw-config/pull/4704#issuecomment-1160912269 [22:42:19] [url] Temporarily adjust setting to allow me to reset my Betaheze password by dmehus · Pull Request #4704 · miraheze/mw-config · GitHub | github.com [22:43:24] PROBLEM - matomo101 Current Load on matomo101 is WARNING: WARNING - load average: 2.25, 2.74, 3.79 [22:45:07] !log temp install nginx on cloud12 (no open firewalls so won't serve any traffic). For internal use. [22:45:13] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:45:48] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-1/±0] 13https://github.com/miraheze/mw-config/compare/6cf5c2cde20f...57f4efc026af [22:45:49] [url] Comparing 6cf5c2cde20f...57f4efc026af · miraheze/mw-config · GitHub | github.com [22:45:49] [02miraheze/mw-config] 07Universal-Omega 0357f4efc - Delete StaticSiteConfiguration.php [22:45:53] miraheze/mw-config - Universal-Omega the build passed. [22:46:00] RECOVERY - gluster101 Puppet on gluster101 is OK: OK: Puppet is currently enabled, last run 42 seconds ago with 0 failures [22:46:59] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 6.43, 4.17, 3.88 [22:48:59] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.31, 3.11, 3.37 [22:49:04] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±2] 13https://github.com/miraheze/mw-config/compare/d3bd72e1cf8d...6cf5c2cde20f [22:49:04] [url] Comparing d3bd72e1cf8d...6cf5c2cde20f · miraheze/mw-config · GitHub | github.com [22:49:05] [02miraheze/mw-config] 07ugochimobi 036cf5c2c - add Kartographer config to ManageWiki (#4710) [22:49:22] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.89, 1.61, 1.53 [22:49:23] PROBLEM - matomo101 Current Load on matomo101 is CRITICAL: CRITICAL - load average: 4.88, 3.44, 3.75 [22:50:03] !log [@test101] starting deploy of {'config': True} to all [22:50:04] !log [@test101] finished deploy of {'config': True} to all - SUCCESS in 0s [22:50:08] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:50:15] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:50:59] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.63, 3.58, 3.72 [22:51:17] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.53, 1.64, 1.56 [22:51:25] PROBLEM - cp20 Stunnel HTTP for matomo101 on cp20 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 358 bytes in 0.030 second response time [22:51:36] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±2] 13https://github.com/miraheze/mw-config/compare/8bab1c32165f...d3bd72e1cf8d [22:51:36] [url] Comparing 8bab1c32165f...d3bd72e1cf8d · miraheze/mw-config · GitHub | github.com [22:51:37] PROBLEM - cp30 Stunnel HTTP for matomo101 on cp30 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 358 bytes in 0.271 second response time [22:51:37] [02miraheze/mw-config] 07alistair3149 03d3bd72e - Add search-related Citizen config to ManageWikiSettings (#4699) [22:51:52] PROBLEM - matomo101 APT on matomo101 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [22:52:29] PROBLEM - matomo101 HTTPS on matomo101 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 358 bytes in 0.043 second response time [22:52:33] PROBLEM - cp21 Stunnel HTTP for matomo101 on cp21 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 358 bytes in 0.265 second response time [22:52:53] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.20, 3.56, 3.56 [22:52:59] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.46, 3.64, 3.71 [22:52:59] PROBLEM - cp31 Stunnel HTTP for matomo101 on cp31 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 358 bytes in 0.289 second response time [22:53:17] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.33, 6.22, 5.47 [22:53:25] !log [@mwtask111] starting deploy of {'config': True} to all [22:53:35] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:53:36] !log [@mwtask111] finished deploy of {'config': True} to all - SUCCESS in 10s [22:53:57] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:54:59] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.06, 3.69, 3.52 [22:56:53] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.64, 3.46, 3.55 [22:56:59] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 3.16, 3.31, 3.39 [22:56:59] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.19, 3.51, 3.65 [22:59:13] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 8.08, 6.98, 6.01 [23:01:36] RECOVERY - cp20 Stunnel HTTP for matomo101 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 99061 bytes in 3.905 second response time [23:01:42] RECOVERY - cp30 Stunnel HTTP for matomo101 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 99046 bytes in 1.584 second response time [23:01:45] PROBLEM - gluster111 Puppet on gluster111 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [23:02:11] [02miraheze/MirahezeMagic] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/MirahezeMagic/commit/4eada4af0d91 [23:02:13] [02miraheze/MirahezeMagic] 07Universal-Omega 034eada4a - CI: replace use of deprecated wfGetDB with LoadBalancer [23:02:14] [02MirahezeMagic] 07Universal-Omega created branch 03Universal-Omega-patch-1 - 13https://github.com/miraheze/MirahezeMagic [23:02:14] [url] Page not found · GitHub · GitHub | github.com [23:02:15] [02MirahezeMagic] 07Universal-Omega opened pull request 03#342: CI: replace use of deprecated wfGetDB with LoadBalancer - 13https://github.com/miraheze/MirahezeMagic/pull/342 [23:02:16] [url] Page not found · GitHub · GitHub | github.com [23:02:53] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.93, 3.13, 3.39 [23:03:11] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 6.11, 6.95, 6.25 [23:03:14] RECOVERY - cp31 Stunnel HTTP for matomo101 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 99069 bytes in 1.117 second response time [23:04:33] RECOVERY - matomo101 HTTPS on matomo101 is OK: HTTP OK: HTTP/1.1 200 OK - 99077 bytes in 3.619 second response time [23:04:45] RECOVERY - matomo101 APT on matomo101 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [23:04:46] RECOVERY - cp21 Stunnel HTTP for matomo101 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 99061 bytes in 0.726 second response time [23:04:53] miraheze/MirahezeMagic - Universal-Omega the build has errored. [23:04:59] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.86, 4.01, 3.77 [23:05:09] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 5.30, 6.51, 6.18 [23:05:54] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.36, 3.61, 3.39 [23:06:59] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.05, 3.57, 3.64 [23:07:22] [02miraheze/MirahezeMagic] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/MirahezeMagic/compare/4eada4af0d91...145572a3e696 [23:07:23] [url] Comparing 4eada4af0d91...145572a3e696 · miraheze/MirahezeMagic · GitHub | github.com [23:07:24] [02miraheze/MirahezeMagic] 07Universal-Omega 03145572a - Update globals.php [23:07:25] [02MirahezeMagic] 07Universal-Omega synchronize pull request 03#342: CI: replace use of deprecated wfGetDB with LoadBalancer - 13https://github.com/miraheze/MirahezeMagic/pull/342 [23:07:25] [url] Page not found · GitHub · GitHub | github.com [23:07:36] PROBLEM - db112 Current Load on db112 is WARNING: WARNING - load average: 5.53, 4.75, 3.25 [23:07:52] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.44, 3.19, 3.27 [23:08:53] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.55, 3.47, 3.47 [23:09:36] RECOVERY - db112 Current Load on db112 is OK: OK - load average: 4.77, 4.61, 3.37 [23:10:05] miraheze/MirahezeMagic - Universal-Omega the build has errored. [23:12:53] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.74, 4.05, 3.69 [23:13:23] [02MirahezeMagic] 07Universal-Omega closed pull request 03#342: CI: replace use of deprecated wfGetDB with LoadBalancer - 13https://github.com/miraheze/MirahezeMagic/pull/342 [23:13:23] [url] Page not found · GitHub · GitHub | github.com [23:13:24] [02miraheze/MirahezeMagic] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/MirahezeMagic/compare/7cdb17acff4a...f518b683aa65 [23:13:25] [url] Comparing 7cdb17acff4a...f518b683aa65 · miraheze/MirahezeMagic · GitHub | github.com [23:13:26] [02miraheze/MirahezeMagic] 07Universal-Omega 03f518b68 - CI: replace use of deprecated wfGetDB with LoadBalancer (#342) [23:13:27] [02miraheze/MirahezeMagic] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 [23:13:29] [02MirahezeMagic] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 - 13https://github.com/miraheze/MirahezeMagic [23:13:29] [url] Page not found · GitHub · GitHub | github.com [23:13:40] miraheze/MirahezeMagic - Universal-Omega the build has errored. [23:14:53] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.86, 3.88, 3.66 [23:14:59] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.40, 3.69, 3.58 [23:16:28] miraheze/MirahezeMagic - Universal-Omega the build has errored. [23:16:53] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 6.50, 4.51, 3.90 [23:16:59] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.63, 3.60, 3.56 [23:18:59] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.97, 4.02, 3.71 [23:19:59] miraheze/MirahezeMagic - Universal-Omega the build has errored. [23:20:59] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.88, 4.00, 3.74 [23:21:07] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.18, 1.76, 1.51 [23:22:36] [02miraheze/MirahezeMagic] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/MirahezeMagic/commit/06b30de002a2 [23:22:38] [02miraheze/MirahezeMagic] 07Universal-Omega 0306b30de - CI: use getMaintenanceConnectionRef [23:22:39] [02MirahezeMagic] 07Universal-Omega created branch 03Universal-Omega-patch-1 - 13https://github.com/miraheze/MirahezeMagic [23:22:40] [url] Page not found · GitHub · GitHub | github.com [23:22:41] [02MirahezeMagic] 07Universal-Omega opened pull request 03#343: CI: use getMaintenanceConnectionRef - 13https://github.com/miraheze/MirahezeMagic/pull/343 [23:22:41] ... [23:22:53] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.27, 3.88, 3.82 [23:23:06] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.50, 1.67, 1.51 [23:23:36] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.40, 3.65, 3.44 [23:25:24] miraheze/MirahezeMagic - Universal-Omega the build has errored. [23:25:35] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.61, 3.48, 3.40 [23:27:33] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.26, 3.74, 3.50 [23:28:53] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.86, 4.18, 3.92 [23:28:59] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.70, 4.01, 3.71 [23:29:45] RECOVERY - gluster111 Puppet on gluster111 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [23:31:01] PROBLEM - gluster121 Puppet on gluster121 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [23:31:11] PROBLEM - matomo101 Current Load on matomo101 is WARNING: WARNING - load average: 1.60, 1.58, 3.88 [23:31:19] [02miraheze/MirahezeMagic] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/MirahezeMagic/compare/06b30de002a2...e58b6aa262a5 [23:31:19] [url] Comparing 06b30de002a2...e58b6aa262a5 · miraheze/MirahezeMagic · GitHub | github.com [23:31:20] [02miraheze/MirahezeMagic] 07Universal-Omega 03e58b6aa - Update globals.php [23:31:22] [02MirahezeMagic] 07Universal-Omega synchronize pull request 03#343: CI: use getMaintenanceConnectionRef - 13https://github.com/miraheze/MirahezeMagic/pull/343 [23:31:22] [url] Page not found · GitHub · GitHub | github.com [23:31:30] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.01, 3.54, 3.50 [23:32:53] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.97, 3.74, 3.83 [23:33:07] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.26, 1.82, 1.63 [23:33:29] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.39, 3.02, 3.31 [23:34:21] miraheze/MirahezeMagic - Universal-Omega the build has errored. [23:34:59] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.24, 3.61, 3.64 [23:35:07] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.56, 1.69, 1.60 [23:35:08] RECOVERY - matomo101 Current Load on matomo101 is OK: OK - load average: 1.81, 1.61, 3.37 [23:36:59] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.27, 2.99, 3.40 [23:37:24] [02miraheze/MirahezeMagic] 07Universal-Omega pushed 031 commit to 03revert-342-Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/MirahezeMagic/commit/269d6e366ee9 [23:37:25] [02miraheze/MirahezeMagic] 07Universal-Omega 03269d6e3 - Revert "CI: replace use of deprecated wfGetDB with LoadBalancer (#342)" [23:37:27] [02MirahezeMagic] 07Universal-Omega created branch 03revert-342-Universal-Omega-patch-1 - 13https://github.com/miraheze/MirahezeMagic [23:37:27] [url] Page not found · GitHub · GitHub | github.com [23:37:28] [02MirahezeMagic] 07Universal-Omega opened pull request 03#344: Revert "CI: replace use of deprecated wfGetDB with LoadBalancer" - 13https://github.com/miraheze/MirahezeMagic/pull/344 [23:37:29] ... [23:37:33] miraheze/MirahezeMagic - Universal-Omega the build has errored. [23:37:35] [02MirahezeMagic] 07Universal-Omega closed pull request 03#344: Revert "CI: replace use of deprecated wfGetDB with LoadBalancer" - 13https://github.com/miraheze/MirahezeMagic/pull/344 [23:37:36] [url] Page not found · GitHub · GitHub | github.com [23:37:37] [02miraheze/MirahezeMagic] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/MirahezeMagic/compare/f518b683aa65...2baad3083b8d [23:37:38] [url] Comparing f518b683aa65...2baad3083b8d · miraheze/MirahezeMagic · GitHub | github.com [23:37:38] [02miraheze/MirahezeMagic] 07Universal-Omega 032baad30 - Revert "CI: replace use of deprecated wfGetDB with LoadBalancer (#342)" (#344) [23:40:12] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.04, 1.60, 1.18 [23:40:48] miraheze/MirahezeMagic - Universal-Omega the build has errored. [23:40:59] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.10, 3.62, 3.60 [23:41:03] miraheze/MirahezeMagic - Universal-Omega the build has errored. [23:42:11] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.70, 1.57, 1.21 [23:42:53] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.39, 3.47, 3.52 [23:42:59] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.96, 3.93, 3.70 [23:43:45] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.13, 1.76, 1.27 [23:45:43] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.27, 1.58, 1.26 [23:46:16] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.47, 3.66, 3.49 [23:46:53] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.18, 3.69, 3.62 [23:48:53] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.31, 3.79, 3.65 [23:48:59] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.28, 3.52, 3.71 [23:49:07] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.14, 1.86, 1.65 [23:50:13] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 3.03, 3.30, 3.37 [23:52:53] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.52, 3.52, 3.58 [23:54:08] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.06, 3.60, 3.51 [23:55:07] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.63, 1.89, 1.77 [23:58:53] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.60, 3.10, 3.37 [23:59:07] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.60, 1.65, 1.69