[01:47:18] (03PS1) 10Brian Wolff: Remove php8.1 as voting for REL1_39. Doesn't pass currently. [integration/config] - 10https://gerrit.wikimedia.org/r/831644 [07:13:19] 10Continuous-Integration-Config, 10MW-1.35-release, 10MW-1.37-release, 10MW-1.38-release, and 2 others: Make PHP 8.1 voting on currently supported MW release branches - https://phabricator.wikimedia.org/T316080 (10hashar) [07:18:30] (03PS2) 10Hashar: Remove php8.1 as voting for REL1_39. Doesn't pass currently. [integration/config] - 10https://gerrit.wikimedia.org/r/831644 (https://phabricator.wikimedia.org/T316080) (owner: 10Brian Wolff) [07:22:30] (03CR) 10Hashar: "The fix for 8.1 is https://gerrit.wikimedia.org/r/c/mediawiki/core/+/817898 which got reverted by https://gerrit.wikimedia.org/r/c/mediaw" [integration/config] - 10https://gerrit.wikimedia.org/r/831644 (https://phabricator.wikimedia.org/T316080) (owner: 10Brian Wolff) [09:36:33] 10Continuous-Integration-Infrastructure, 10Jenkins, 10Release-Engineering-Team: Upgrade Jenkins to latest LTS 2.361.1 - https://phabricator.wikimedia.org/T317418 (10hashar) I have upgraded Jenkins on releases* hosts and restarted https://releases-jenkins.wikimedia.org/ [09:43:41] 10Continuous-Integration-Infrastructure, 10Jenkins, 10Release-Engineering-Team (Priority Backlog đŸ“Ĩ): Use Jenkins upstream systemd unit instead of our own - https://phabricator.wikimedia.org/T308637 (10hashar) I ran puppet on all the Jenkins. On releases1002 I went to do the Jenkins upgrade (T317418) and the... [11:07:03] 10Release-Engineering-Team (Priority Backlog đŸ“Ĩ), 10Patch-For-Review, 10Release, 10Train Deployments: 1.40.0-wmf.1 deployment blockers - https://phabricator.wikimedia.org/T314190 (10Ladsgroup) [11:36:02] 10Continuous-Integration-Infrastructure, 10Jenkins, 10Release-Engineering-Team (Priority Backlog đŸ“Ĩ): Use Jenkins upstream systemd unit instead of our own - https://phabricator.wikimedia.org/T308637 (10hashar) 05Open→03Resolved I have compared the output of `systemctl show jenkins` before vs after, it lo... [11:36:05] 10Continuous-Integration-Infrastructure, 10Jenkins, 10Release-Engineering-Team (Next), 10Patch-For-Review: Upgrade Jenkins to the next LTS, 2.332.2 - https://phabricator.wikimedia.org/T307339 (10hashar) [11:36:45] 10Continuous-Integration-Infrastructure, 10Jenkins, 10Release-Engineering-Team: Upgrade Jenkins to latest LTS 2.361.1 - https://phabricator.wikimedia.org/T317418 (10hashar) 05Open→03Resolved a:03hashar I have upgraded all Jenkins and as a bonus we now use the upstream systemd service (T308637) [12:56:08] 10Project-Admins, 10NFDI: Create project tag for MediaWiki-extensions-Shibboleth - https://phabricator.wikimedia.org/T309719 (10Aklapper) 05Stalled→03Resolved a:03Aklapper Requested public project #mediawiki-extensions-shibboleth has been created: https://phabricator.wikimedia.org/project/view/6146/ (In... [12:57:35] 10Project-Admins, 10MediaWiki-extensions-Shibboleth, 10NFDI: Create project tag for MediaWiki-extensions-Shibboleth - https://phabricator.wikimedia.org/T309719 (10Aklapper) [12:58:07] 10Project-Admins, 10MediaWiki-extensions-Shibboleth, 10NFDI: Create project tag for MediaWiki-extensions-Shibboleth - https://phabricator.wikimedia.org/T309719 (10Aklapper) >>! In T309719#8202780, @Physikerwelt wrote: > @Aklapper How would you suggest potential issues like this? Filing a dedicated bug repor... [12:59:18] 10Project-Admins: Create component for product infrastructure orphaned project tickets - https://phabricator.wikimedia.org/T311246 (10Aklapper) 05Stalled→03Declined There's nothing that can be done if nobody answers, thus declining for the time being [13:12:03] 10Project-Admins, 10Instrument-ClientError: Archive inactive #Instrument-ClientError project tag? - https://phabricator.wikimedia.org/T313640 (10Aklapper) Thanks for the explanation. I'd like to move https://phabricator.wikimedia.org/project/view/5018/ to a new top-level project `Instrument-ClientError` then. [13:12:35] 10Project-Admins: Make subproject #Instrument-ClientError a top-level project - https://phabricator.wikimedia.org/T313640 (10Aklapper) [13:22:24] 10Release-Engineering-Team (Blocking 🧱), 10Data Pipelines (Sprint 01): Increase maximum artifacts size on Gitlab Registry to accommodate files >1GB - https://phabricator.wikimedia.org/T317555 (10Antoine_Quhen) [13:46:48] 10Continuous-Integration-Config, 10MediaUploader: Run tests for Extension:MediaUploader on REL1_37 - https://phabricator.wikimedia.org/T316479 (10hashar) The general use is T196467 [13:51:22] (03Abandoned) 10Prod: Start branching WatchSubpages [tools/release] - 10https://gerrit.wikimedia.org/r/663892 (https://phabricator.wikimedia.org/T237809) (owner: 10Prod) [13:54:17] 10Beta-Cluster-Infrastructure, 10MediaWiki-extensions-Phonos, 10Community-Tech (CommTech-Sprint-33): Phonos links to unroutable domain/URL for the MP3 file - https://phabricator.wikimedia.org/T317417 (10TheresNoTime) I know @MusikAnimal is working on this (thank you!), so this is more of a general question —... [14:27:32] 10GitLab (CI & Job Runners), 10Release-Engineering-Team (Priority Backlog đŸ“Ĩ), 10Patch-For-Review, 10User-brennen: Deploy buildkitd to trusted GitLab runners - https://phabricator.wikimedia.org/T308271 (10Jelto) >>! In T308271#8230189, @thcipriani wrote: > In the firewall configuration section of the [[ htt... [14:52:50] 10Release-Engineering-Team (Seen), 10Scap, 10Epic, 10Goal: Automate the Train - https://phabricator.wikimedia.org/T196515 (10dancy) [14:53:39] 10Release-Engineering-Team (Priority Backlog đŸ“Ĩ), 10Scap, 10Patch-For-Review: Automated Tuesday Train via a timer - https://phabricator.wikimedia.org/T310395 (10dancy) 05Open→03Resolved [14:57:27] 10Release-Engineering-Team (Priority Backlog đŸ“Ĩ), 10Scap: Create alerts for automated Tuesday Train timer - https://phabricator.wikimedia.org/T310396 (10dancy) [14:58:22] 10Release-Engineering-Team (Priority Backlog đŸ“Ĩ), 10Scap: Create alerts for automated Tuesday Train timer - https://phabricator.wikimedia.org/T310396 (10dancy) 05Open→03Resolved [15:06:05] 10Release-Engineering-Team (Blocking 🧱), 10Data Pipelines (Sprint 01): Increase maximum artifacts size on Gitlab Registry to accommodate files >1GB - https://phabricator.wikimedia.org/T317555 (10Antoine_Quhen) Yes, the fails on the package upload to the Gitlab project repository. Here is the return to the POST... [15:12:59] 10Release-Engineering-Team (Priority Backlog đŸ“Ĩ), 10Patch-For-Review, 10Release, 10Train Deployments: 1.40.0-wmf.1 deployment blockers - https://phabricator.wikimedia.org/T314190 (10dancy) I tried rolling forward to testwikis again but soon after that various errors from `includes/libs/objectcache/APCUBagOS... [15:20:30] 10Release-Engineering-Team (Priority Backlog đŸ“Ĩ), 10Patch-For-Review, 10Release, 10Train Deployments: 1.40.0-wmf.1 deployment blockers - https://phabricator.wikimedia.org/T314190 (10dancy) [15:34:16] (03CR) 10Ahmon Dancy: docs: Describe SCAP_REVS_DIR, SCAP_CURRENT_REV_DIR, SCAP_DONE_REV_DIR (034 comments) [tools/scap] - 10https://gerrit.wikimedia.org/r/831630 (owner: 10Dduvall) [15:41:21] (03PS1) 10Ahmon Dancy: Less verbose php-fpm-restart progress reporting when no tty [tools/scap] - 10https://gerrit.wikimedia.org/r/831912 [15:53:48] (03CR) 10Ahmon Dancy: [C: 03+2] Less verbose php-fpm-restart progress reporting when no tty [tools/scap] - 10https://gerrit.wikimedia.org/r/831912 (owner: 10Ahmon Dancy) [15:59:31] (03Merged) 10jenkins-bot: Less verbose php-fpm-restart progress reporting when no tty [tools/scap] - 10https://gerrit.wikimedia.org/r/831912 (owner: 10Ahmon Dancy) [16:10:31] hashar: Editorconfig is pissing me off. [16:10:39] oh [16:10:41] what is up with it? [16:10:51] is that cause it is enforced on CI and fails for random reason? [16:11:05] or the conf is wrong? Or your editor mangles spaces etc? [16:11:52] For train-dev I'm finally converting mirror-repos.sh to mirror-repos.py. In one bit of code I have a multiline string defined and editorconfig is trying to enforce indentation rules within the content of the string which makes no sense to me. [16:12:20] (the 'ec' tool, specifically) [16:23:31] ah yes [16:23:53] so yeah that is broken definitely cause the editorconfig does not have any knowledge about python varying indentation [16:24:00] let me find the fi [16:24:00] x [16:26:05] Thanks! I'm going afk for a few. [16:27:09] the one I did for integration/config is https://gerrit.wikimedia.org/r/c/integration/config/+/756047 [16:27:38] which runs `ec -disable-indentation` against python/yaml files [16:27:47] commands = [16:27:47] /bin/bash -c "ec $(git ls-files -- ':!*/changelog' ':!*.py' ':!*.yaml' ':!*.rb')" [16:27:47] /bin/bash -c "ec -disable-indentation $(git ls-files '*/changelog' '*.py' '*.yaml' ':*.rb')" [16:28:27] another option would be to disable the indentation check in .editorconfig but last time I checked that was not possible with editorconfig-checker [16:29:36] I think the upstream bug is https://github.com/editorconfig-checker/editorconfig-checker/issues/182 to which I commented at the time [16:34:20] and apparently the indentation check can be disabled entirely from an `.ecrc` file https://github.com/editorconfig-checker/editorconfig-checker#configuration [17:22:41] 10Release-Engineering-Team (Bonus Level 🕹ī¸), 10Patch-For-Review, 10Release, 10Train Deployments: 1.40.0-wmf.1 deployment blockers - https://phabricator.wikimedia.org/T314190 (10dancy) [17:35:50] 10Release-Engineering-Team, 10Security-Team, 10SecTeam-Processed, 10Security: Potential misassociation of Git/Gerrit username and LDAP username - https://phabricator.wikimedia.org/T316029 (10sbassett) [17:45:14] hashar: Thanks! I'll go with the `--disable-indentation` option. [17:58:17] (03PS1) 10Ahmon Dancy: Replace mirror-repos.sh with mirror-repos.py [tools/train-dev] - 10https://gerrit.wikimedia.org/r/831940 [18:04:24] Project beta-code-update-eqiad build #408816: 15ABORTED in 13 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/408816/ [18:04:40] (me^) [18:22:31] 10Release-Engineering-Team, 10GrowthExperiments, 10Growth-Team (Current Sprint), 10Performance Issue, 10Performance-Team (Radar): GrowthExperiments Special:Homepage: investigate performance regression since September 6 2022 - https://phabricator.wikimedia.org/T317187 (10aaron) [18:40:43] (03PS2) 10Dduvall: docs: Describe SCAP_REVS_DIR, SCAP_CURRENT_REV_DIR, SCAP_DONE_REV_DIR [tools/scap] - 10https://gerrit.wikimedia.org/r/831630 [18:43:52] (03CR) 10Dduvall: docs: Describe SCAP_REVS_DIR, SCAP_CURRENT_REV_DIR, SCAP_DONE_REV_DIR (034 comments) [tools/scap] - 10https://gerrit.wikimedia.org/r/831630 (owner: 10Dduvall) [18:47:39] 10GitLab (CI & Job Runners), 10Release-Engineering-Team (Priority Backlog đŸ“Ĩ), 10Patch-For-Review, 10User-brennen: Deploy buildkitd to trusted GitLab runners - https://phabricator.wikimedia.org/T308271 (10dduvall) >>! In T308271#8232572, @Jelto wrote: >>>! In T308271#8229736, @dduvall wrote: >> >> For some... [18:54:15] (03CR) 10Ahmon Dancy: "Thanks Dan! The extra information helps a lot." [tools/scap] - 10https://gerrit.wikimedia.org/r/831630 (owner: 10Dduvall) [18:54:37] (03CR) 10Ahmon Dancy: [C: 03+2] docs: Describe SCAP_REVS_DIR, SCAP_CURRENT_REV_DIR, SCAP_DONE_REV_DIR [tools/scap] - 10https://gerrit.wikimedia.org/r/831630 (owner: 10Dduvall) [19:00:23] (03Merged) 10jenkins-bot: docs: Describe SCAP_REVS_DIR, SCAP_CURRENT_REV_DIR, SCAP_DONE_REV_DIR [tools/scap] - 10https://gerrit.wikimedia.org/r/831630 (owner: 10Dduvall) [19:17:27] (03CR) 10Brian Wolff: Remove php8.1 as voting for REL1_39. Doesn't pass currently. (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/831644 (https://phabricator.wikimedia.org/T316080) (owner: 10Brian Wolff) [19:28:33] (03PS2) 10Ahmon Dancy: Replace mirror-repos.sh with mirror-repos.py [tools/train-dev] - 10https://gerrit.wikimedia.org/r/831940 [19:29:01] (03CR) 10CI reject: [V: 04-1] Replace mirror-repos.sh with mirror-repos.py [tools/train-dev] - 10https://gerrit.wikimedia.org/r/831940 (owner: 10Ahmon Dancy) [19:29:26] (03PS3) 10Ahmon Dancy: Replace mirror-repos.sh with mirror-repos.py [tools/train-dev] - 10https://gerrit.wikimedia.org/r/831940 [19:38:09] (03PS4) 10Ahmon Dancy: Replace mirror-repos.sh with mirror-repos.py [tools/train-dev] - 10https://gerrit.wikimedia.org/r/831940 [19:38:34] (03CR) 10CI reject: [V: 04-1] Replace mirror-repos.sh with mirror-repos.py [tools/train-dev] - 10https://gerrit.wikimedia.org/r/831940 (owner: 10Ahmon Dancy) [19:39:33] (03PS5) 10Ahmon Dancy: Replace mirror-repos.sh with mirror-repos.py [tools/train-dev] - 10https://gerrit.wikimedia.org/r/831940 [19:46:06] (03CR) 10Ahmon Dancy: "Ready for review. Tested on Linux and Mac OS" [tools/train-dev] - 10https://gerrit.wikimedia.org/r/831940 (owner: 10Ahmon Dancy) [19:46:22] (03PS6) 10Ahmon Dancy: Replace mirror-repos.sh with mirror-repos.py [tools/train-dev] - 10https://gerrit.wikimedia.org/r/831940 [20:34:15] (03PS1) 10Cwhite: enable use of both ecs and legacy schemas [releng/phatality] - 10https://gerrit.wikimedia.org/r/831964 (https://phabricator.wikimedia.org/T314098) [20:34:28] (03CR) 10CI reject: [V: 04-1] enable use of both ecs and legacy schemas [releng/phatality] - 10https://gerrit.wikimedia.org/r/831964 (https://phabricator.wikimedia.org/T314098) (owner: 10Cwhite) [20:34:42] (03PS2) 10Cwhite: enable use of both ecs and legacy schemas [releng/phatality] - 10https://gerrit.wikimedia.org/r/831964 (https://phabricator.wikimedia.org/T314098) [20:34:52] (03CR) 10CI reject: [V: 04-1] enable use of both ecs and legacy schemas [releng/phatality] - 10https://gerrit.wikimedia.org/r/831964 (https://phabricator.wikimedia.org/T314098) (owner: 10Cwhite) [21:21:23] (03PS1) 10Ahmon Dancy: Delete bin/train-branch-cut-job.sh [tools/release] - 10https://gerrit.wikimedia.org/r/831989 [21:22:34] (03CR) 10Ahmon Dancy: [C: 03+2] Delete bin/train-branch-cut-job.sh [tools/release] - 10https://gerrit.wikimedia.org/r/831989 (owner: 10Ahmon Dancy) [21:23:19] (03Merged) 10jenkins-bot: Delete bin/train-branch-cut-job.sh [tools/release] - 10https://gerrit.wikimedia.org/r/831989 (owner: 10Ahmon Dancy) [21:25:31] (03PS1) 10Ahmon Dancy: make-container-image: Report how long image pushes take [tools/release] - 10https://gerrit.wikimedia.org/r/831991 [21:31:30] (03CR) 10Ahmon Dancy: [C: 03+2] make-container-image: Report how long image pushes take [tools/release] - 10https://gerrit.wikimedia.org/r/831991 (owner: 10Ahmon Dancy) [21:32:11] (03Merged) 10jenkins-bot: make-container-image: Report how long image pushes take [tools/release] - 10https://gerrit.wikimedia.org/r/831991 (owner: 10Ahmon Dancy) [21:34:24] 10Release-Engineering-Team (Radar), 10serviceops: Pushes to docker-registry are too slow - https://phabricator.wikimedia.org/T306201 (10dancy) 05Open→03Resolved a:03dancy I'm closing this ticket. Recent image pushes have had satisfactory performance. [21:42:44] (03PS1) 10Ahmon Dancy: webserver image Makefile: Set shell to /bin/bash [tools/release] - 10https://gerrit.wikimedia.org/r/831994 [21:45:25] (03CR) 10Ahmon Dancy: [C: 03+2] webserver image Makefile: Set shell to /bin/bash [tools/release] - 10https://gerrit.wikimedia.org/r/831994 (owner: 10Ahmon Dancy) [21:46:31] (03Merged) 10jenkins-bot: webserver image Makefile: Set shell to /bin/bash [tools/release] - 10https://gerrit.wikimedia.org/r/831994 (owner: 10Ahmon Dancy) [21:58:47] 10Release-Engineering-Team (Bonus Level 🕹ī¸), 10MW-on-K8s, 10serviceops, 10Patch-For-Review: Make scap deploy to kubernetes together with the legacy systems - https://phabricator.wikimedia.org/T299648 (10dancy) @joe (and others) Is there any objection to scap running `helmfile apply` for both eqiad and codf... [22:00:34] 10Release-Engineering-Team (Blocking 🧱), 10Data Pipelines (Sprint 01): Increase maximum artifacts size on Gitlab Registry to accommodate files >1GB - https://phabricator.wikimedia.org/T317555 (10thcipriani) >>! In T317555#8232761, @Antoine_Quhen wrote: > Yes, the fails on the package upload to the Gitlab proje... [22:14:15] !log delete deployment-urldownloader02 [22:14:16] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [22:33:06] 10Release-Engineering-Team (Bonus Level 🕹ī¸), 10MW-on-K8s, 10serviceops, 10Patch-For-Review: Make scap deploy to kubernetes together with the legacy systems - https://phabricator.wikimedia.org/T299648 (10dancy) Notes on the impact on deployer experience when scap config flags `build_mw_container_image` and... [23:13:50] Is this the place to ask for help with gitlab? [23:15:00] I am trying to clone over ssh for the first time, and it's telling me I don't have permission even though I've uploaded my ssh keys and an trying to clone my own repo. [23:15:06] I'm guessing some confusion about my username, maybe [23:15:41] This is what I'm trying to clone: https://gitlab.wikimedia.org/andrew/toolviews [23:23:40] andrewbogott: well, I can see that it is owned by "Andrew Bogott" and I can clone it [23:23:54] I also see it was forked from another repo under another namespace [23:23:58] maybe that has something to do with it [23:24:11] you're using git@gitlab.wikimedia.org:andrew/toolviews.git ? [23:24:11] btw gitlab has a dedicated channel at -gitlab as well [23:24:18] oh, nice, let's move there [23:25:00] #wikimedia-gitlab that is [23:32:25] (03PS1) 10Cwhite: wip [releng/phatality] - 10https://gerrit.wikimedia.org/r/832004 [23:59:58] 10Phabricator, 10Release-Engineering-Team (Bonus Level 🕹ī¸), 10Patch-For-Review, 10User-brennen: Deploy Phabricator with scap - https://phabricator.wikimedia.org/T313259 (10Dzahn) We now have the following sudo config on all Phabricator servers: any command as phab-deploy: ` cat /etc/sudoers.d/scap_phab-...