[07:15:03] 10Release-Engineering-Team (Deployment Training Requests): Deployment training request for TheresNoTime - https://phabricator.wikimedia.org/T305191 (10ArielGlenn) Uh... I don't know what you meant to change the time slot to, but in any case, I was there, you weren't, but no patches were scheduled either. 🤷 [07:46:38] 10Phabricator: Tasks created via Phabricator APIs have restricted edit policy - https://phabricator.wikimedia.org/T305998 (10Aklapper) Hmm, the setting that Majavah found has not been changed since 2019 (which makes me assume that nearly all Forms have a non-default setting) and its current setting probably had... [07:58:53] 10Beta-Cluster-Infrastructure, 10Wikidata, 10Wikidata-Query-Service, 10wdwb-tech: Upgrade deployment-wdqs01 host to Buster - https://phabricator.wikimedia.org/T306054 (10Lucas_Werkmeister_WMDE) [07:58:57] 10Beta-Cluster-Infrastructure, 10Cloud-VPS (Debian Stretch Deprecation): Cloud VPS "deployment-prep" project Stretch deprecation - https://phabricator.wikimedia.org/T306068 (10Lucas_Werkmeister_WMDE) [08:01:06] 10Beta-Cluster-Infrastructure, 10Cloud-VPS (Debian Stretch Deprecation): Cloud VPS "deployment-prep" project Stretch deprecation - https://phabricator.wikimedia.org/T306068 (10Lucas_Werkmeister_WMDE) [08:07:46] 10Release-Engineering-Team (Radar), 10Scap, 10serviceops: Deploy Scap version 4.6.1 - https://phabricator.wikimedia.org/T305949 (10JMeybohm) 05In progress→03Resolved [08:09:00] 10Beta-Cluster-Infrastructure, 10Wikidata, 10Wikidata-Query-Service, 10wdwb-tech: Upgrade deployment-wdqs01 host to Buster - https://phabricator.wikimedia.org/T306054 (10Jdforrester-WMF) Happy for it to be just deleted, sure. [08:12:06] 10Beta-Cluster-Infrastructure, 10Cloud-VPS (Debian Stretch Deprecation): Cloud VPS "deployment-prep" project Stretch deprecation - https://phabricator.wikimedia.org/T306068 (10Jdforrester-WMF) Duplicate of {T278641}; would it be unhelpful to merge this task into that, if @StrikerBot is looking for this particu... [08:12:50] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Radar), 10serviceops: docker-report-releng failing on multiple image tags because of certificate validation error - https://phabricator.wikimedia.org/T304875 (10JMeybohm) 05Open→03Resolved a:03JMeybohm I've removed the images from the... [08:14:15] 10Beta-Cluster-Infrastructure, 10Data-Engineering, 10Data-Engineering-Kanban, 10Event-Platform: Upgrade event platform related VMs in deployment-prep to Debian bullsye (or buster) - https://phabricator.wikimedia.org/T304433 (10Jdforrester-WMF) [08:14:22] 10Beta-Cluster-Infrastructure, 10Release-Engineering-Team (Radar): Migrate deployment-prep away from Debian Stretch to Buster/Bullseye - https://phabricator.wikimedia.org/T278641 (10Jdforrester-WMF) [08:33:42] (03CR) 10Jaime Nuche: [C: 03+1] Add utils.temp_to_permanent_file (032 comments) [tools/scap] - 10https://gerrit.wikimedia.org/r/779507 (owner: 10Ahmon Dancy) [08:40:13] (03CR) 10Jaime Nuche: [C: 03+2] "Yesterday I didn't remember that Antoine is on vacation this week, so I'm gonna +2 the patch" [tools/scap] - 10https://gerrit.wikimedia.org/r/779559 (https://phabricator.wikimedia.org/T305466) (owner: 10Ahmon Dancy) [08:41:23] (03Merged) 10jenkins-bot: Fix utils.find_nearest_host and its caller [tools/scap] - 10https://gerrit.wikimedia.org/r/779559 (https://phabricator.wikimedia.org/T305466) (owner: 10Ahmon Dancy) [08:43:13] 10Beta-Cluster-Infrastructure, 10Wikidata, 10Wikidata-Query-Service, 10wdwb-tech: Upgrade deployment-wdqs01 host to Buster - https://phabricator.wikimedia.org/T306054 (10dcausse) I can confirm, this host is not used. [09:22:34] (03CR) 10Jaime Nuche: [C: 04-1] sync-apaches: Include deploy servers as rsync sources (031 comment) [tools/scap] - 10https://gerrit.wikimedia.org/r/779962 (https://phabricator.wikimedia.org/T305466) (owner: 10Ahmon Dancy) [10:58:29] 10GitLab (Project Migration), 10Release-Engineering-Team (GitLabsperiment), 10User-brennen: Mirror all active Gerrit repositories to GitLab instance - https://phabricator.wikimedia.org/T305984 (10Aklapper) Thanks, that makes a lot of sense! I hope it'll be visually clear to everyone (e.g. potential new contr... [11:38:56] (03CR) 10Jaime Nuche: [C: 03+2] Revive install_requires in setup.py [tools/scap] - 10https://gerrit.wikimedia.org/r/779925 (owner: 10Ahmon Dancy) [11:39:54] (03Merged) 10jenkins-bot: Revive install_requires in setup.py [tools/scap] - 10https://gerrit.wikimedia.org/r/779925 (owner: 10Ahmon Dancy) [13:31:43] (03CR) 10SBassett: [C: 03+1] "LGTM" [integration/config] - 10https://gerrit.wikimedia.org/r/779969 (https://phabricator.wikimedia.org/T305723) (owner: 10Mstyles) [14:00:09] (03PS1) 10Daimona Eaytoy: layout: [mediawiki/extensions/CampaignEvents] Add apitests [integration/config] - 10https://gerrit.wikimedia.org/r/780824 [14:28:47] (03CR) 10Ahmon Dancy: [C: 03+2] Add utils.temp_to_permanent_file [tools/scap] - 10https://gerrit.wikimedia.org/r/779507 (owner: 10Ahmon Dancy) [14:29:44] (03Merged) 10jenkins-bot: Add utils.temp_to_permanent_file [tools/scap] - 10https://gerrit.wikimedia.org/r/779507 (owner: 10Ahmon Dancy) [14:32:46] 10Release-Engineering-Team (🌱 Spring Cleaning — April 2022), 10Patch-For-Review, 10Release, 10Train Deployments: 1.39.0-wmf.7 deployment blockers - https://phabricator.wikimedia.org/T305213 (10dancy) [14:38:29] (03CR) 10Ahmon Dancy: [C: 03+2] scap update-interwiki-cache: Don't overwrite interwiki.php in place [tools/scap] - 10https://gerrit.wikimedia.org/r/778318 (https://phabricator.wikimedia.org/T304529) (owner: 10Ahmon Dancy) [14:39:24] (03Merged) 10jenkins-bot: scap update-interwiki-cache: Don't overwrite interwiki.php in place [tools/scap] - 10https://gerrit.wikimedia.org/r/778318 (https://phabricator.wikimedia.org/T304529) (owner: 10Ahmon Dancy) [14:54:17] (03PS2) 10Ahmon Dancy: sync-apaches: Include deploy servers as rsync sources [tools/scap] - 10https://gerrit.wikimedia.org/r/779962 (https://phabricator.wikimedia.org/T305466) [14:55:34] (03CR) 10Ahmon Dancy: sync-apaches: Include deploy servers as rsync sources (031 comment) [tools/scap] - 10https://gerrit.wikimedia.org/r/779962 (https://phabricator.wikimedia.org/T305466) (owner: 10Ahmon Dancy) [14:59:17] (03CR) 10Jaime Nuche: [C: 03+2] sync-apaches: Include deploy servers as rsync sources (031 comment) [tools/scap] - 10https://gerrit.wikimedia.org/r/779962 (https://phabricator.wikimedia.org/T305466) (owner: 10Ahmon Dancy) [15:02:21] (03Merged) 10jenkins-bot: sync-apaches: Include deploy servers as rsync sources [tools/scap] - 10https://gerrit.wikimedia.org/r/779962 (https://phabricator.wikimedia.org/T305466) (owner: 10Ahmon Dancy) [15:17:29] 10Release-Engineering-Team (🌱 Spring Cleaning — April 2022), 10Release, 10Train Deployments: 1.39.0-wmf.8 deployment blockers - https://phabricator.wikimedia.org/T305214 (10Krinkle) [15:19:33] Krinkle: how does that block? It's from 2 trains ago and wikitech is only half production? Does that come from the all new logspam should block next? [15:25:19] Oh it's next week you've blocked [15:44:08] 10GitLab (Infrastructure), 10Release-Engineering-Team (Priority Backlog 📥), 10SecTeam-Processed, 10Security, 10Upstream: Enabling CORS for raw file URLs - https://phabricator.wikimedia.org/T305700 (10sbassett) >>! In T305700#7854175, @brennen wrote: > I'll confess that I'm uncertain whether there are dan... [15:44:47] RhinosF1: https://wikitech.wikimedia.org/wiki/Deployments/Holding_the_train#Deprecations [15:45:23] Krinkle: it's not a deprecation is it? [15:47:19] RhinosF1: clarified [15:48:12] Krinkle: ah [15:55:37] (03CR) 10Ahmon Dancy: [C: 03+2] jjb: Define test pipeline for image-suggestions [integration/config] - 10https://gerrit.wikimedia.org/r/777872 (https://phabricator.wikimedia.org/T303408) (owner: 10Eevans) [15:55:59] (03CR) 10Ahmon Dancy: [C: 03+2] "I ran" [integration/config] - 10https://gerrit.wikimedia.org/r/777872 (https://phabricator.wikimedia.org/T303408) (owner: 10Eevans) [15:56:38] 10GitLab (Infrastructure), 10Release-Engineering-Team (Priority Backlog 📥), 10SecTeam-Processed, 10Security, 10Upstream: Enabling CORS for raw file URLs - https://phabricator.wikimedia.org/T305700 (10brennen) > It might be worth using something like wmfusercontent.org (or a similar, new domain/server) to... [15:58:06] (03Merged) 10jenkins-bot: jjb: Define test pipeline for image-suggestions [integration/config] - 10https://gerrit.wikimedia.org/r/777872 (https://phabricator.wikimedia.org/T303408) (owner: 10Eevans) [16:09:13] !log removed or renamed 4 filters from mediawiki-new-errors per check-new-error-tasks/check.sh [16:09:14] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [16:39:11] 10GitLab (Integrations), 10Release-Engineering-Team (Radar), 10Wikimedia-Interwiki-links: Evaluate an interwiki to WMF GitLab - https://phabricator.wikimedia.org/T305755 (10brennen) [16:58:23] 10Release-Engineering-Team, 10serviceops: Pushes to docker-registry are too slow - https://phabricator.wikimedia.org/T306201 (10dancy) [17:18:02] 10Release-Engineering-Team (🌱 Spring Cleaning — April 2022), 10Patch-For-Review, 10Release, 10Train Deployments: 1.39.0-wmf.7 deployment blockers - https://phabricator.wikimedia.org/T305213 (10dancy) [17:52:29] 10Release-Engineering-Team, 10serviceops: Pushes to docker-registry are too slow - https://phabricator.wikimedia.org/T306201 (10dancy) [17:58:51] 10Release-Engineering-Team (Radar), 10MW-on-K8s, 10serviceops, 10Kubernetes, 10Patch-For-Review: Kubernetes credentials on deployment servers should be available to deployers, not all users - https://phabricator.wikimedia.org/T305729 (10dancy) Problems detected today: * `WARNING: Kubernetes configuration... [18:35:58] (03Abandoned) 10Arlolra: Make extension-quibble non-voting for parsoid [integration/config] - 10https://gerrit.wikimedia.org/r/779967 (https://phabricator.wikimedia.org/T305931) (owner: 10Arlolra) [18:52:07] 10GitLab (Project Migration), 10Release-Engineering-Team (🌱 Spring Cleaning — April 2022), 10Community-Tech: Create new GitLab project group: commtech - https://phabricator.wikimedia.org/T304580 (10brennen) 05Open→03Resolved a:03brennen - Created https://gitlab.wikimedia.org/repos/commtech - Added team... [19:06:53] 10GitLab (Project Migration), 10Release-Engineering-Team (🌱 Spring Cleaning — April 2022), 10Community-Tech: Create new GitLab project group: commtech - https://phabricator.wikimedia.org/T304580 (10Aklapper) @brennen: (General note from the side line: If this is a WMF thingy then it might make sense to prefi... [19:09:39] 10Continuous-Integration-Config, 10Toolhub, 10Documentation: Publish docs on doc.wikimedia.org - https://phabricator.wikimedia.org/T305914 (10bd808) p:05Triage→03Medium [19:11:15] (03CR) 10Reedy: "Can this just land anytime?" [integration/config] - 10https://gerrit.wikimedia.org/r/779969 (https://phabricator.wikimedia.org/T305723) (owner: 10Mstyles) [19:38:04] (03CR) 10SBassett: [C: 03+1] zuul: Invoke publish pipeline for security-api (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/779969 (https://phabricator.wikimedia.org/T305723) (owner: 10Mstyles) [20:01:40] (03PS4) 10Reedy: zuul: Invoke publish pipeline for security-api [integration/config] - 10https://gerrit.wikimedia.org/r/779969 (https://phabricator.wikimedia.org/T305723) (owner: 10Mstyles) [20:02:28] (03CR) 10Reedy: "Guess I need to double check if the `trigger-security-api-pipeline-publish` job has been built and itself published by JJB" [integration/config] - 10https://gerrit.wikimedia.org/r/779969 (https://phabricator.wikimedia.org/T305723) (owner: 10Mstyles) [20:03:27] (03CR) 10Reedy: zuul: Invoke publish pipeline for security-api (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/779969 (https://phabricator.wikimedia.org/T305723) (owner: 10Mstyles) [20:16:35] 10GitLab (Project Migration), 10Release-Engineering-Team (🌱 Spring Cleaning — April 2022), 10Community-Tech: Create new GitLab project group: commtech - https://phabricator.wikimedia.org/T304580 (10Dzahn) What about projects that have WMF and non-WMF people working together? I agree though that it seems we n... [20:32:27] (03CR) 10Mstyles: zuul: Invoke publish pipeline for security-api (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/779969 (https://phabricator.wikimedia.org/T305723) (owner: 10Mstyles) [21:47:53] (03PS1) 10Ahmon Dancy: followup fix: scap prep can try to chmod dir not owned by user [tools/scap] - 10https://gerrit.wikimedia.org/r/781059 [21:48:48] (03CR) 10Ahmon Dancy: [C: 03+2] "Tested in train-dev" [tools/scap] - 10https://gerrit.wikimedia.org/r/781059 (owner: 10Ahmon Dancy) [21:49:45] (03Merged) 10jenkins-bot: followup fix: scap prep can try to chmod dir not owned by user [tools/scap] - 10https://gerrit.wikimedia.org/r/781059 (owner: 10Ahmon Dancy) [22:24:37] (03CR) 10Reedy: [C: 03+2] zuul: Invoke publish pipeline for security-api [integration/config] - 10https://gerrit.wikimedia.org/r/779969 (https://phabricator.wikimedia.org/T305723) (owner: 10Mstyles) [22:27:37] (03Merged) 10jenkins-bot: zuul: Invoke publish pipeline for security-api [integration/config] - 10https://gerrit.wikimedia.org/r/779969 (https://phabricator.wikimedia.org/T305723) (owner: 10Mstyles) [22:30:13] !log Reloading Zuul to deploy https://gerrit.wikimedia.org/r/779969 [22:30:14] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [23:08:08] 10GitLab (CI & Job Runners), 10serviceops: upgrade gitlab-runners to bullseye - https://phabricator.wikimedia.org/T297659 (10Dzahn) All, 10, gitlab-runner instances in the cloud VPS project are now on bullseye. The puppetmaster isn't but not sure if that is part of it. And then there are other runners, used...