[01:01:16] (03PS1) 10Catrope: Zuul: [mediawiki/extensions/VueTest] Mark as in production [integration/config] - 10https://gerrit.wikimedia.org/r/884143 (https://phabricator.wikimedia.org/T315621) [08:39:11] !log devtools: fix git security warning on deployment server by cherry-picking https://gerrit.wikimedia.org/r/c/operations/puppet/+/868002 on the puppet master | T325128 [08:39:14] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [08:39:14] T325128: git: detected dubious ownership in repository at '/srv/mediawiki-staging' - https://phabricator.wikimedia.org/T325128 [08:57:46] 10GitLab (CI & Job Runners), 10Release-Engineering-Team, 10CirrusSearch, 10Discovery-Search: Consider adding "official" docker.elastic.co images to the list of allowed images for gitlab runners - https://phabricator.wikimedia.org/T327519 (10dcausse) >>! In T327519#8561516, @bd808 wrote: > 7.10.2 is the fin... [10:06:52] 10GitLab (CI & Job Runners), 10serviceops-collab: add disk space usage to grafana dashboard for gitlab-runners - https://phabricator.wikimedia.org/T327435 (10Jelto) I like the idea of having disk usage in the gitlab-runner dasboard too. Although this will be for Trusted Runners only, as Shared Runners in WMCS... [10:08:47] 10GitLab, 10Release-Engineering-Team (GitLab IV: Mise En Place 🍱), 10serviceops-collab: Convert runner-1030.gitlab-runners.eqiad1.wikimedia.cloud to an instance-wide shared runner - https://phabricator.wikimedia.org/T327949 (10Jelto) Small hint: de-registration and re-registration broke the networking of `ru... [10:45:19] 10GitLab, 10Release-Engineering-Team, 10serviceops-collab, 10Patch-For-Review: Align the GitLab runner tags - https://phabricator.wikimedia.org/T325069 (10Jelto) >>! In T325069#8562871, @bd808 wrote: > > Was @demon's suggestion of renaming as `public-cloud` considered? What's your reasonable guess about t... [10:47:01] 10Release-Engineering-Team (Blocking 🧱), 10Projects-Cleanup, 10Wikidata, 10Wikidata-Query-Service: Archive or delete wikidata/query/flink-swift-plugin - https://phabricator.wikimedia.org/T314273 (10demon) [10:53:07] 10Phabricator: Maximum execution time of 30 seconds exceeded /srv/deployment/phabricator/deployment-cache/revs/f68dc24350bc897955d57eeac681db872b0b9e61/phabricator/src/applications/calendar/parser/data/PhutilCalendarRecurrenceRule.php:1251 - https://phabricator.wikimedia.org/T328118 (10I) [10:58:10] 10GitLab (Infrastructure), 10Toolforge, 10cloud-services-team, 10serviceops-collab, 10Kubernetes: gitlab: enable agent server for kubernetes (KAS) - https://phabricator.wikimedia.org/T320483 (10aborrero) NOTE: gitlab upstream seems to be moving into FluxCD for gitops https://gitlab.com/gitlab-org/gitlab/... [11:02:48] 10Release-Engineering-Team (Blocking 🧱), 10Projects-Cleanup, 10Wikidata, 10Wikidata-Query-Service: Archive or delete wikidata/query/flink-swift-plugin - https://phabricator.wikimedia.org/T314273 (10demon) [11:05:17] (03PS1) 10Chad: Removing wikidata/query/flink-swift-plugin per T314273 [integration/config] - 10https://gerrit.wikimedia.org/r/884283 [12:43:01] ACKNOWLEDGEMENT - Host gerrit2002 is DOWN: PING CRITICAL - Packet loss = 100% amusso hardware reboot [13:02:11] 10Gerrit, 10Release-Engineering-Team, 10serviceops-collab: apache2 fails to start after gerrit hosts are rebooted - https://phabricator.wikimedia.org/T326125 (10hashar) [13:37:37] 10Release-Engineering-Team (Radar), 10SRE Observability: Alert RelEng when mw-client-error editing dashboard shows errors at a rate of over 1000 errors in a 12 hr period - https://phabricator.wikimedia.org/T293694 (10kostajh) >>! In T293694#7445303, @colewhite wrote: >>>! In T293694#7438791, @Jdlrobson wrote:... [13:54:18] 10Release-Engineering-Team, 10Desktop Improvements (Vector 2022), 10UniversalLanguageSelector, 10Language-Team (Language-2023-January-March), and 2 others: Unexpected "Page contents not supported in other languages" in non-article namespace - https://phabricator.wikimedia.org/T326788 (10ngkountas) a:03ngk... [14:08:12] (03CR) 10Hashar: Removing wikidata/query/flink-swift-plugin per T314273 (032 comments) [integration/config] - 10https://gerrit.wikimedia.org/r/884283 (owner: 10Chad) [14:08:18] (03PS2) 10Hashar: Archive wikidata/query/flink-swift-plugin [integration/config] - 10https://gerrit.wikimedia.org/r/884283 (https://phabricator.wikimedia.org/T314273) (owner: 10Chad) [14:10:16] (03PS1) 10Hashar: Add Chad Horohoe to CI allow list [integration/config] - 10https://gerrit.wikimedia.org/r/884309 [14:10:54] (03CR) 10Hashar: [C: 03+2] Archive wikidata/query/flink-swift-plugin [integration/config] - 10https://gerrit.wikimedia.org/r/884283 (https://phabricator.wikimedia.org/T314273) (owner: 10Chad) [14:10:58] (03CR) 10Hashar: [C: 03+2] "This way you will have CI triggers on patch you propose." [integration/config] - 10https://gerrit.wikimedia.org/r/884309 (owner: 10Hashar) [14:12:19] (03Merged) 10jenkins-bot: Archive wikidata/query/flink-swift-plugin [integration/config] - 10https://gerrit.wikimedia.org/r/884283 (https://phabricator.wikimedia.org/T314273) (owner: 10Chad) [14:12:29] (03Merged) 10jenkins-bot: Add Chad Horohoe to CI allow list [integration/config] - 10https://gerrit.wikimedia.org/r/884309 (owner: 10Hashar) [14:12:34] 10Release-Engineering-Team (Blocking 🧱), 10Projects-Cleanup, 10Wikidata, 10Wikidata-Query-Service, 10Patch-For-Review: Archive or delete wikidata/query/flink-swift-plugin - https://phabricator.wikimedia.org/T314273 (10hashar) [14:13:00] !log Reloaded Zuul for https://gerrit.wikimedia.org/r/884283 [14:13:01] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [14:13:11] !log Reloaded Zuul for https://gerrit.wikimedia.org/r/884309 [14:13:12] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [14:14:18] 10Release-Engineering-Team (Blocking 🧱), 10Projects-Cleanup, 10Wikidata, 10Wikidata-Query-Service, 10Patch-For-Review: Archive or delete wikidata/query/flink-swift-plugin - https://phabricator.wikimedia.org/T314273 (10hashar) 05Open→03Resolved Seems like the last step was to mark the repository archi... [14:14:33] (03CR) 10Hashar: [C: 03+2] "Nice :)" [integration/config] - 10https://gerrit.wikimedia.org/r/884143 (https://phabricator.wikimedia.org/T315621) (owner: 10Catrope) [14:15:44] (03Merged) 10jenkins-bot: Zuul: [mediawiki/extensions/VueTest] Mark as in production [integration/config] - 10https://gerrit.wikimedia.org/r/884143 (https://phabricator.wikimedia.org/T315621) (owner: 10Catrope) [14:23:55] !log Reloaded Zuul for https://gerrit.wikimedia.org/r/c/integration/config/+/884143 | T315621 [14:23:57] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [14:23:59] T315621: Install VueTest extension in beta labs and test.wikipedia.org - https://phabricator.wikimedia.org/T315621 [14:24:29] (03CR) 10Hashar: [C: 03+2] zuul: Add Superpes to allowlist [integration/config] - 10https://gerrit.wikimedia.org/r/884127 (owner: 10Zabe) [14:25:50] (03Merged) 10jenkins-bot: zuul: Add Superpes to allowlist [integration/config] - 10https://gerrit.wikimedia.org/r/884127 (owner: 10Zabe) [14:26:54] (03CR) 10Hashar: [C: 03+2] "Deployed. CI will now triggers job whenever Superpes sends a patchset or comments "recheck" on a change. Thanks Zabe!" [integration/config] - 10https://gerrit.wikimedia.org/r/884127 (owner: 10Zabe) [14:39:55] 10Gerrit, 10Release-Engineering-Team: Remove plugins/.eslintrc.json - https://phabricator.wikimedia.org/T328134 (10hashar) [14:40:44] (03PS1) 10Hashar: scap: remove plugins/.eslintrc.json on finalize stage [software/gerrit] (deploy/wmf/stable-3.5) - 10https://gerrit.wikimedia.org/r/884317 (https://phabricator.wikimedia.org/T328134) [14:40:57] (03CR) 10Hashar: [C: 04-1] scap: remove plugins/.eslintrc.json on finalize stage [software/gerrit] (deploy/wmf/stable-3.5) - 10https://gerrit.wikimedia.org/r/884317 (https://phabricator.wikimedia.org/T328134) (owner: 10Hashar) [14:41:17] (03CR) 10Hashar: [C: 04-1] "I will try to refactor the eslint config instead and use that in last resort." [software/gerrit] (deploy/wmf/stable-3.5) - 10https://gerrit.wikimedia.org/r/884317 (https://phabricator.wikimedia.org/T328134) (owner: 10Hashar) [17:14:05] 10Release-Engineering-Team (Radar), 10SRE Observability: Alert RelEng when mw-client-error editing dashboard shows errors at a rate of over 1000 errors in a 12 hr period - https://phabricator.wikimedia.org/T293694 (10colewhite) >>! In T293694#8564483, @kostajh wrote: > Is it possible to use the [OpenSearch Ale... [18:09:03] 10GitLab, 10Release-Engineering-Team, 10serviceops-collab, 10Patch-For-Review: Align the GitLab runner tags - https://phabricator.wikimedia.org/T325069 (10bd808) >>! In T325069#8564146, @Jelto wrote: > I'd estimate that would block RelEng for at least multiple days including opening the MR, reviewing, merg... [18:20:01] is there a way to render a .gitlab-ci.yml file into its "final form", essentially resolve all dependencies, recursively, until i can see what the resulting configuration is? [18:35:48] It seems https://www.mediawiki.org/wiki/MediaWiki_1.40/wmf.20 is empty. Did something break or has this moved elsewhere? \cc brennen jnuche [18:40:53] Krinkle: hmm - possibly something broke [18:40:57] wouldn't be the first time [18:42:21] I'm trying to find the cause of a possible self-inflicted DDOS on Commons file pages. Lacking a bit of detail at the moment to quickly search relevant commit messages. I'll regex something in Gerrit for now. [18:47:40] yeah, i'll see what i can do about the changelog. [18:59:28] changelog: https://integration.wikimedia.org/ci/job/train-deploy-notes/4337/console [18:59:32] well [18:59:35] changelog problem [19:01:00] i filled it in manually in the meanwhile [19:07:31] (03PS1) 10Thcipriani: Train Notes: use new upstream in dockerfile [integration/config] - 10https://gerrit.wikimedia.org/r/884365 [19:08:35] (03PS2) 10Thcipriani: Train Notes: use new upstream in dockerfile [integration/config] - 10https://gerrit.wikimedia.org/r/884365 [19:30:28] (03CR) 10Brennen Bearnes: [C: 03+2] Train Notes: use new upstream in dockerfile [integration/config] - 10https://gerrit.wikimedia.org/r/884365 (owner: 10Thcipriani) [19:31:38] (03Merged) 10jenkins-bot: Train Notes: use new upstream in dockerfile [integration/config] - 10https://gerrit.wikimedia.org/r/884365 (owner: 10Thcipriani) [19:35:19] !log Updating docker-pkg files on contint primary for https://gerrit.wikimedia.org/r/c/integration/config/+/884365/ [19:35:20] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [19:38:07] hrm. [19:44:01] (03PS1) 10Umherirrender: Zuul: [mediawiki/extensions/PushAll] Add basic tests [integration/config] - 10https://gerrit.wikimedia.org/r/884370 [19:44:54] thcipriani: hmm, whoops - i think that needs a changelog entry? [19:47:08] * brennen makes one [19:52:16] (03PS1) 10Brennen Bearnes: add changelog entry for new release upstream [integration/config] - 10https://gerrit.wikimedia.org/r/884372 [20:27:28] 10GitLab (CI & Job Runners), 10serviceops-collab: add disk space usage to grafana dashboard for gitlab-runners - https://phabricator.wikimedia.org/T327435 (10Dzahn) >>! In T327435#8564033, @Jelto wrote: > I like the idea of having disk usage in the gitlab-runner dasboard too. > We can pair on Monday if you li... [20:34:28] (03CR) 10Thcipriani: [C: 03+2] "whoops, thank you!" [integration/config] - 10https://gerrit.wikimedia.org/r/884372 (owner: 10Brennen Bearnes) [20:35:38] (03Merged) 10jenkins-bot: add changelog entry for new release upstream [integration/config] - 10https://gerrit.wikimedia.org/r/884372 (owner: 10Brennen Bearnes) [20:42:29] !log Updating docker-pkg files on contint primary for https://gerrit.wikimedia.org/r/884372 [20:42:30] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [20:53:15] (03PS1) 10Thcipriani: Train release notes: use new docker image [integration/config] - 10https://gerrit.wikimedia.org/r/884375 [20:54:34] (03CR) 10Thcipriani: [C: 03+2] Train release notes: use new docker image [integration/config] - 10https://gerrit.wikimedia.org/r/884375 (owner: 10Thcipriani) [20:55:41] (03Merged) 10jenkins-bot: Train release notes: use new docker image [integration/config] - 10https://gerrit.wikimedia.org/r/884375 (owner: 10Thcipriani) [22:39:25] 10GitLab (Integrations), 10Phabricator, 10Release-Engineering-Team (GitLab IV: Mise En Place 🍱): GitLab comments should come from a GitLabBot instead of gerritbot - https://phabricator.wikimedia.org/T327424 (10jeena) [23:48:54] 10GitLab (Infrastructure), 10serviceops-collab: Migrate gitlab-test instance to bullseye - https://phabricator.wikimedia.org/T318521 (10Dzahn) >>! In T318521#8551236, @taavi wrote: > Sure! Is it fine to re-use the existing port/extra IP? Yes, it's fine. > It's not possible to map a floating IP directly as an...