[06:56:27] 10Continuous-Integration-Config, 10Release-Engineering-Team (Doing), 10BlueSpice: BlueSpice related tests fails on gate-and-submit-1.31 in quibble-composer tests - https://phabricator.wikimedia.org/T235807 (10Osnard) @Reedy Why has this been declined? There was a discussion, there was a patch, there were no... [07:26:49] 10Continuous-Integration-Config, 10Release-Engineering-Team (Doing), 10BlueSpice: BlueSpice related tests fails on gate-and-submit-1.31 in quibble-composer tests - https://phabricator.wikimedia.org/T235807 (10Aklapper) Probably because `1.31` saw its end of life months ago. If you still run 1.31.x you have s... [08:00:55] 10Release-Engineering-Team, 10SRE, 10SRE-Access-Requests, 10serviceops, 10Patch-For-Review: Add some users to the docker group on deployment servers - https://phabricator.wikimedia.org/T303450 (10Joe) 05Openβ†’03Resolved [09:11:21] 10Release-Engineering-Team (Radar), 10CommRel-Specialists-Support, 10DBA: Stop announcing and scheduling primary database switchovers - https://phabricator.wikimedia.org/T303605 (10Ladsgroup) If there is no major objection by Monday 28th, I will move forward to implementing this. For minor objections to det... [09:14:33] 10Release-Engineering-Team (Radar), 10CommRel-Specialists-Support, 10DBA: Stop announcing and scheduling primary database switchovers - https://phabricator.wikimedia.org/T303605 (10Marostegui) Yay \o/ [09:37:47] 10Gerrit, 10Wikidata, 10Wikidata Query UI, 10wdwb-tech: wikidata-query-gui-build doesn’t work when latest commit is by dependabot (commit-msg hook adds Change-Id in wrong place) - https://phabricator.wikimedia.org/T295601 (10hashar) I supposed the code is somewhere in https://github.com/dependabot/dependab... [10:17:41] 10Release-Engineering-Team (πŸš‚πŸ§ͺ Trainsperiment Week): Delete wmf branches from Gerrit repositories - https://phabricator.wikimedia.org/T303828 (10hashar) One can inspect all extensions and skins by cloning the mono repositories `mediawiki/extensions` and `mediawiki/skins` (warning: huge). I ran a little script to... [10:20:39] 10Continuous-Integration-Config, 10Release-Engineering-Team (Doing), 10BlueSpice: BlueSpice related tests fails on gate-and-submit-1.31 in quibble-composer tests - https://phabricator.wikimedia.org/T235807 (10Osnard) This is not about REL1_31 at all. It applies to REL1_35 and every other branch as well. Yes,... [11:30:22] 10Phabricator, 10Release-Engineering-Team (Next): Make assignees or setters of a past Due Date on a non-closed task more aware of that task - https://phabricator.wikimedia.org/T293734 (10Aklapper) [11:30:29] 10Phabricator (Upstream), 10Upstream: Send reminder email on open/stalled tasks when Due Date is reached - https://phabricator.wikimedia.org/T302785 (10Aklapper) [11:31:09] 10Phabricator: Temporary "RuntimeException: Undefined index" trying to access task 60224 - https://phabricator.wikimedia.org/T290587 (10Aklapper) 05Openβ†’03Declined Cannot reproduce [11:32:45] 10Release-Engineering-Team (Radar), 10CommRel-Specialists-Support, 10DBA: Stop announcing and scheduling primary database switchovers - https://phabricator.wikimedia.org/T303605 (10Trizek-WMF) [11:34:33] 10Release-Engineering-Team (Radar), 10CommRel-Specialists-Support, 10DBA: Stop announcing and scheduling primary database switchovers - https://phabricator.wikimedia.org/T303605 (10Trizek-WMF) >>! In T303605#7780812, @Ladsgroup wrote: > If there is no major objection by Monday 28th, I will move forward to im... [11:42:45] 10Release-Engineering-Team (Radar), 10CommRel-Specialists-Support, 10DBA: Stop announcing and scheduling primary database switchovers - https://phabricator.wikimedia.org/T303605 (10Ladsgroup) hmm, good point, We can change the plans a bit. Move it forward and start the test run for two weeks in March 21[1] a... [11:42:45] do you know if gitlab.w.o has this enabled? https://docs.gitlab.com/ee/administration/clusters/kas.html [11:44:44] 10Project-Admins, 10MediaViewer, 10Structured-Data-Backlog, 10PM: Convert MediaViewer tracking tasks to Phab workboard columns; use board columns for categories only instead of progress tracking - https://phabricator.wikimedia.org/T282946 (10Aklapper) 05Openβ†’03Resolved a:03Aklapper Done [11:44:51] 10Release-Engineering-Team (Radar), 10CommRel-Specialists-Support, 10DBA: Stop announcing and scheduling primary database switchovers - https://phabricator.wikimedia.org/T303605 (10Trizek-WMF) Thank you. Do you plan to have a blogpost about it, listing reasons and implications? What would be the best sent... [11:45:19] 10Release-Engineering-Team (Radar), 10CommRel-Specialists-Support, 10DBA, 10User-notice: Stop announcing and scheduling primary database switchovers - https://phabricator.wikimedia.org/T303605 (10Trizek-WMF) [11:52:24] 10Release-Engineering-Team (Radar), 10CommRel-Specialists-Support, 10DBA, 10User-notice: Stop announcing and scheduling primary database switchovers - https://phabricator.wikimedia.org/T303605 (10Ladsgroup) >>! In T303605#7781344, @Trizek-WMF wrote: > Thank you. > > Do you plan to have a blogpost about i... [11:53:05] 10Release-Engineering-Team, 10Growth-Team, 10PageCuration, 10Patch-For-Review, and 2 others: quibble-vendor-mysql-php72-noselenium-docker fails for a noop PageTriage patch - https://phabricator.wikimedia.org/T303092 (10kostajh) >>! In T303092#7781210, @gerritbot wrote: > Change 771336 had a related patch s... [11:54:59] 10Release-Engineering-Team (Radar), 10CommRel-Specialists-Support, 10DBA, 10User-notice: Stop announcing and scheduling primary database switchovers - https://phabricator.wikimedia.org/T303605 (10Marostegui) >>! In T303605#7781344, @Trizek-WMF wrote: > Thank you. > > Do you plan to have a blogpost about... [12:07:06] (03CR) 10Jaime Nuche: scap clean: Allow re-running even if branch dir doesn't exist (031 comment) [tools/scap] - 10https://gerrit.wikimedia.org/r/770993 (owner: 10Ahmon Dancy) [13:18:40] 10Release-Engineering-Team (Radar), 10DBA, 10CommRel-Specialists-Support (Jan-Mar-2022): Update Tech News preloads and documentation for the new primary database switchovers workflow - https://phabricator.wikimedia.org/T303937 (10Trizek-WMF) [13:24:18] 10Release-Engineering-Team (Radar), 10CommRel-Specialists-Support, 10DBA, 10User-notice: Stop announcing and scheduling primary database switchovers - https://phabricator.wikimedia.org/T303605 (10Trizek-WMF) The best practice nowadays is to have blogposts about changes, showing how our infrastructure, our... [13:26:49] 10Release-Engineering-Team (Radar), 10CommRel-Specialists-Support, 10DBA, 10User-notice: Stop announcing and scheduling primary database switchovers - https://phabricator.wikimedia.org/T303605 (10Trizek-WMF) [13:27:07] 10Release-Engineering-Team (Radar), 10CommRel-Specialists-Support, 10DBA, 10User-notice: Stop announcing and scheduling primary database switchovers - https://phabricator.wikimedia.org/T303605 (10Trizek-WMF) [13:31:19] 10Release-Engineering-Team (Radar), 10Data-Persistence (Consultation), 10CommRel-Specialists-Support (Jan-Mar-2022): Update Tech News preloads and documentation for the new primary database switchovers workflow - https://phabricator.wikimedia.org/T303937 (10Marostegui) [13:49:44] 10Release-Engineering-Team (Radar), 10CommRel-Specialists-Support, 10DBA, 10User-notice: Stop announcing and scheduling primary database switchovers - https://phabricator.wikimedia.org/T303605 (10Ladsgroup) >>! In T303605#7781678, @Trizek-WMF wrote: > The best practice nowadays is to have blogposts about c... [13:54:29] 10Phabricator, 10Release-Engineering-Team, 10Discovery-Search (Current work): Ensure Phabricator is compatible with Elasticsearch 7.10 - https://phabricator.wikimedia.org/T303445 (10Gehel) >>! In T303445#7765399, @RhinosF1 wrote: > I don't see any docs to say it's explicitly not supported. > > There seem to... [14:13:46] 10Release-Engineering-Team (Radar), 10CommRel-Specialists-Support, 10DBA, 10User-notice: Stop announcing and scheduling primary database switchovers - https://phabricator.wikimedia.org/T303605 (10Trizek-WMF) >>! In T303605#7781926, @Ladsgroup wrote: > It'll be in https://wikitech.wikimedia.org/wiki/Deploym... [14:13:52] 10Beta-Cluster-Infrastructure, 10Maps (Kartotherian): [beta] Can't use SPARQL queries in beta cluster maps - https://phabricator.wikimedia.org/T303954 (10awight) [14:14:43] 10Beta-Cluster-Infrastructure, 10Maps (Kartotherian): [beta] Can't use SPARQL queries in beta cluster maps - https://phabricator.wikimedia.org/T303954 (10awight) [14:16:40] (Queue (Jenkins jobs + Zuul functions) alert) firing: Queue (Jenkins jobs + Zuul functions) alert - https://alerts.wikimedia.org [14:31:40] (Queue (Jenkins jobs + Zuul functions) alert) firing: (2) Queue (Jenkins jobs + Zuul functions) alert - https://alerts.wikimedia.org [14:38:26] 10Phabricator, 10Release-Engineering-Team, 10Discovery-Search (Current work): Ensure Phabricator is compatible with Elasticsearch 7.10 - https://phabricator.wikimedia.org/T303445 (10thcipriani) The current phabricator config defines a few search engines. MySQL is the default. We switched to using ElasticSear... [14:40:36] 10Continuous-Integration-Infrastructure, 10Quality-and-Test-Engineering-Team (QTE), 10ci-test-error (WMF-deployed Build Failure): All codehealth jobs failing due to older nodejs version - https://phabricator.wikimedia.org/T303958 (10kostajh) [14:40:53] 10Continuous-Integration-Infrastructure, 10Code-Health-Metrics, 10Quality-and-Test-Engineering-Team (QTE), 10ci-test-error (WMF-deployed Build Failure): All codehealth jobs failing due to older nodejs version - https://phabricator.wikimedia.org/T303958 (10kostajh) [14:42:47] 10MediaWiki-Releasing, 10MW-1.38-notes, 10MW-1.38-release, 10MW-1.39-notes (1.39.0-wmf.1; 2022-03-21): Branch REL1_38 for MediaWiki and all extensions and skins - https://phabricator.wikimedia.org/T302909 (10MarkAHershberger) >>! In T302909#7764095, @Jdforrester-WMF wrote: > Nominally scheduled as https://... [14:44:57] 10Phabricator, 10Release-Engineering-Team (Priority Backlog πŸ“₯), 10Discovery-Search (Current work): Ensure Phabricator is compatible with Elasticsearch 7.10 - https://phabricator.wikimedia.org/T303445 (10thcipriani) [14:51:31] (03CR) 10Ahmon Dancy: scap clean: Allow re-running even if branch dir doesn't exist (031 comment) [tools/scap] - 10https://gerrit.wikimedia.org/r/770993 (owner: 10Ahmon Dancy) [14:51:40] (Queue (Jenkins jobs + Zuul functions) alert) resolved: Queue (Jenkins jobs + Zuul functions) alert - https://alerts.wikimedia.org [15:00:36] 10Release-Engineering-Team (Next), 10Patch-For-Review, 10Release, 10Train Deployments: 1.38.0-wmf.26 deployment blockers - https://phabricator.wikimedia.org/T300202 (10kostajh) @jeena not sure if this is a regression (and I can't reproduce it) but just fyi {T303960} [15:02:49] 10Release-Engineering-Team (Next), 10Patch-For-Review, 10Release, 10Train Deployments: 1.38.0-wmf.26 deployment blockers - https://phabricator.wikimedia.org/T300202 (10jeena) Thanks @kostajh. I'll keep an eye out for it in the logs [15:05:57] 10Release-Engineering-Team, 10SRE, 10SRE-Access-Requests, 10serviceops: Add some users to the docker group on deployment servers - https://phabricator.wikimedia.org/T303450 (10dancy) I verified that I can run docker commands now. Thanks @Joe! [15:11:58] 10MediaWiki-Releasing, 10MW-1.38-notes, 10MW-1.38-release, 10MW-1.39-notes (1.39.0-wmf.1; 2022-03-21): Branch REL1_38 for MediaWiki and all extensions and skins - https://phabricator.wikimedia.org/T302909 (10MarkAHershberger) Notes from meeting with James et al about this process: * code failed php8 which... [15:14:00] (03CR) 10Dduvall: "Testing this now." [tools/scap] - 10https://gerrit.wikimedia.org/r/765649 (https://phabricator.wikimedia.org/T295494) (owner: 10Jeena Huneidi) [15:19:04] 10Release-Engineering-Team (πŸš‚πŸ§ͺ Trainsperiment Week): Ensure train-branch-bot can cut 3 branches during Train Experiment Week - https://phabricator.wikimedia.org/T303367 (10hashar) [15:19:58] 10Release-Engineering-Team (πŸš‚πŸ§ͺ Trainsperiment Week): Ensure train-branch-bot can cut 3 branches during Train Experiment Week - https://phabricator.wikimedia.org/T303367 (10hashar) [15:20:00] 10Release-Engineering-Team (πŸš‚πŸ§ͺ Trainsperiment Week): Ensure train-branch-bot can cut three branches - https://phabricator.wikimedia.org/T303834 (10hashar) [15:22:14] (03CR) 10Jaime Nuche: [C: 03+1] scap clean: Allow re-running even if branch dir doesn't exist (031 comment) [tools/scap] - 10https://gerrit.wikimedia.org/r/770993 (owner: 10Ahmon Dancy) [15:27:19] 10Release-Engineering-Team (πŸš‚πŸ§ͺ Trainsperiment Week): Move from semantic to date based versionning for wmf deployment - https://phabricator.wikimedia.org/T303966 (10hashar) [15:27:53] 10Release-Engineering-Team (πŸš‚πŸ§ͺ Trainsperiment Week): Move from semantic to date based versionning for wmf deployment - https://phabricator.wikimedia.org/T303966 (10hashar) [15:31:33] (03PS2) 10Ahmon Dancy: scap clean: Allow re-running even if branch dir doesn't exist [tools/scap] - 10https://gerrit.wikimedia.org/r/770993 [15:31:38] 10Release-Engineering-Team (πŸš‚πŸ§ͺ Trainsperiment Week): Ensure train-branch-bot can cut 3 branches during Train Experiment Week - https://phabricator.wikimedia.org/T303367 (10hashar) Beside `MAJOR_VERSION=1.38.0` being hardcoded (see T303966 to stop using the MediaWiki version in the branch name) the script is stra... [15:32:22] (03CR) 10Ahmon Dancy: scap clean: Allow re-running even if branch dir doesn't exist (031 comment) [tools/scap] - 10https://gerrit.wikimedia.org/r/770993 (owner: 10Ahmon Dancy) [15:32:27] (03CR) 10Dduvall: [C: 03+2] "This is great! I tested a normal parent-child dependency chain, a Depends-On relation, and a merge conflict. All worked well." [tools/scap] - 10https://gerrit.wikimedia.org/r/765649 (https://phabricator.wikimedia.org/T295494) (owner: 10Jeena Huneidi) [15:33:57] (03CR) 10Jeena Huneidi: Exit if change is not mergeable (031 comment) [tools/scap] - 10https://gerrit.wikimedia.org/r/765649 (https://phabricator.wikimedia.org/T295494) (owner: 10Jeena Huneidi) [15:34:14] (03Merged) 10jenkins-bot: Exit if change is not mergeable [tools/scap] - 10https://gerrit.wikimedia.org/r/765649 (https://phabricator.wikimedia.org/T295494) (owner: 10Jeena Huneidi) [15:34:58] 10Release-Engineering-Team, 10MW-on-K8s, 10Release Pipeline: Display mergeable status in scap backport --list output - https://phabricator.wikimedia.org/T303967 (10dduvall) [15:37:59] (03CR) 10Jaime Nuche: [C: 03+2] scap clean: Allow re-running even if branch dir doesn't exist [tools/scap] - 10https://gerrit.wikimedia.org/r/770993 (owner: 10Ahmon Dancy) [15:38:50] (03Merged) 10jenkins-bot: scap clean: Allow re-running even if branch dir doesn't exist [tools/scap] - 10https://gerrit.wikimedia.org/r/770993 (owner: 10Ahmon Dancy) [15:59:28] 10Release-Engineering-Team (πŸš‚πŸ§ͺ Trainsperiment Week): Coordinate with PET prior to train experiment week - https://phabricator.wikimedia.org/T303745 (10dduvall) p:05Triageβ†’03Medium a:03dduvall [16:05:43] 10Release-Engineering-Team, 10MW-on-K8s, 10Release Pipeline: Display mergeable status in scap backport --list output - https://phabricator.wikimedia.org/T303967 (10hashar) TLDR: use `mergeable` field from the response. The scap plugin queries the REST API `/changes/{change-id}/detail` which returns a [[ h... [16:30:58] 10GitLab (CI & Job Runners), 10Security Team AppSec, 10Security-Team, 10Security: Create initial proof of concept application security pipeline repository - https://phabricator.wikimedia.org/T289293 (10sbassett) Going to call this one done for now. [[ https://gitlab.wikimedia.org/repos/security/gitlab-ci-... [16:32:11] 10GitLab, 10Release-Engineering-Team (Done by Fri 03 Sep), 10Security Team AppSec, 10Security-Team, and 2 others: Create Security Team group within gitlab.wikimedia.org - https://phabricator.wikimedia.org/T289292 (10sbassett) [16:32:28] 10GitLab (CI & Job Runners), 10Security Team AppSec, 10Security-Team, 10Security: Create initial proof of concept application security pipeline repository - https://phabricator.wikimedia.org/T289293 (10sbassett) 05Stalledβ†’03In progress [16:32:35] 10GitLab (CI & Job Runners), 10Security Team AppSec, 10Security-Team, 10Security: Create initial proof of concept application security pipeline repository - https://phabricator.wikimedia.org/T289293 (10sbassett) [16:39:10] 10GitLab (CI & Job Runners), 10Security Team AppSec, 10Security-Team, 10Security: Create initial proof of concept application security pipeline repository - https://phabricator.wikimedia.org/T289293 (10sbassett) [16:40:56] 10Release-Engineering-Team (πŸš‚πŸ§ͺ Trainsperiment Week): Move from semantic to date based versionning for wmf deployment - https://phabricator.wikimedia.org/T303966 (10brennen) Noting after discussion that this is a future nice-to-have; not necessary for first trainsperiment week and would probably break a variety o... [16:42:10] 10Release-Engineering-Team (Seen), 10Scap: Avoid rsyncing 2GB of L10N each day during train experiment week, if possible - https://phabricator.wikimedia.org/T303749 (10thcipriani) [16:44:40] (Queue (Jenkins jobs + Zuul functions) alert) firing: Queue (Jenkins jobs + Zuul functions) alert - https://alerts.wikimedia.org [16:46:01] 10Release-Engineering-Team (πŸš‚πŸ§ͺ Trainsperiment Week): Figure out if / how we need to schedule train log triage sessions during train experiment week - https://phabricator.wikimedia.org/T303763 (10thcipriani) 05Openβ†’03Resolved a:03thcipriani We do! Doing as part of the deployment sessions we invite everyone to! [16:46:58] 10Release-Engineering-Team (πŸš‚πŸ§ͺ Trainsperiment Week): Figure out if / how we need to schedule train log triage sessions during train experiment week - https://phabricator.wikimedia.org/T303763 (10hashar) Google meet sessions will be setup via {T303366} We have agreed to have a log triage after each deployment, t... [16:47:37] 10Release-Engineering-Team (πŸš‚πŸ§ͺ Trainsperiment Week): Change / create train blocker tasks in Phabricator to correctly model the train experiment week - https://phabricator.wikimedia.org/T303748 (10thcipriani) a:03thcipriani [16:50:40] 10Release-Engineering-Team (πŸš‚πŸ§ͺ Trainsperiment Week), 10Scap: Ensure we can use new scap commands reliably (scap prep auto, e.g.) - https://phabricator.wikimedia.org/T303746 (10thcipriani) 05Openβ†’03Declined [16:51:31] 10Release-Engineering-Team (πŸš‚πŸ§ͺ Trainsperiment Week): Talk to security team about patch management during trainsperiment week - https://phabricator.wikimedia.org/T303743 (10thcipriani) a:03brennen [16:51:40] 10Release-Engineering-Team (πŸš‚πŸ§ͺ Trainsperiment Week): Determine if we need to communicate anything special about forward and backwards compatibility during train experiment week - https://phabricator.wikimedia.org/T303759 (10thcipriani) a:03dduvall [16:53:07] 10Release-Engineering-Team (πŸš‚πŸ§ͺ Trainsperiment Week), 10Performance-Team (Radar): Talk to Performance team and ServiceOps about caching for train experiment week - https://phabricator.wikimedia.org/T303758 (10thcipriani) a:03thcipriani [16:53:27] 10Continuous-Integration-Infrastructure, 10Code-Health-Metrics, 10Quality-and-Test-Engineering-Team (QTE), 10ci-test-error (WMF-deployed Build Failure): All codehealth jobs failing due to older nodejs version - https://phabricator.wikimedia.org/T303958 (10zeljkofilipin) Related to {T267890}? [16:54:48] 10Release-Engineering-Team (πŸš‚πŸ§ͺ Trainsperiment Week): Ensure coordination is set up with SRE for trainsperiment week - https://phabricator.wikimedia.org/T303742 (10thcipriani) a:03thcipriani [16:55:05] 10Release-Engineering-Team (πŸš‚πŸ§ͺ Trainsperiment Week), 10Scap: Ensure we can leave a single fallback version of MediaWiki in place during train experiment week - https://phabricator.wikimedia.org/T303747 (10thcipriani) 05Openβ†’03Resolved [16:56:01] 10Release-Engineering-Team (πŸš‚πŸ§ͺ Trainsperiment Week), 10Scap: Ensure we can leave a single fallback version of MediaWiki in place during train experiment week - https://phabricator.wikimedia.org/T303747 (10brennen) After discussion: `scap clean` is time-based, this should not be an issue - the previous week's t... [16:56:59] 10Release-Engineering-Team (πŸš‚πŸ§ͺ Trainsperiment Week), 10Patch-For-Review: multiversion/MWScript.php: Allow specifying a specific version of code to run - https://phabricator.wikimedia.org/T303878 (10brennen) 05Openβ†’03In progress [16:57:01] 10Release-Engineering-Team (πŸš‚πŸ§ͺ Trainsperiment Week), 10Scap: Automate rebuild l10n cache for Train - https://phabricator.wikimedia.org/T245187 (10brennen) [16:57:19] 10Release-Engineering-Team (πŸš‚πŸ§ͺ Trainsperiment Week): Ensure train-branch-bot can cut 3 branches during Train Experiment Week - https://phabricator.wikimedia.org/T303367 (10thcipriani) a:03dduvall [16:58:15] 10Release-Engineering-Team (πŸš‚πŸ§ͺ Trainsperiment Week): What things look at the task for the specific train verison? - https://phabricator.wikimedia.org/T303978 (10thcipriani) [16:58:27] 10Release-Engineering-Team (πŸš‚πŸ§ͺ Trainsperiment Week): What things look at the task for the specific train verison? - https://phabricator.wikimedia.org/T303978 (10thcipriani) [16:58:50] 10Release-Engineering-Team (πŸš‚πŸ§ͺ Trainsperiment Week): Update deployment calendar/roadmap to reflect upcoming train experiment week - https://phabricator.wikimedia.org/T303365 (10thcipriani) a:03thcipriani [16:59:37] 10Release-Engineering-Team (πŸš‚πŸ§ͺ Trainsperiment Week): Schedule Google meets for deploy windows during train experiment week - https://phabricator.wikimedia.org/T303366 (10thcipriani) a:03TAdeleye_WMF [17:00:36] 10Release-Engineering-Team (πŸš‚πŸ§ͺ Trainsperiment Week): Schedule Google meets for deploy windows during train experiment week - https://phabricator.wikimedia.org/T303366 (10thcipriani) Let's explicitly invite QTE people as optional but make sure folks can join with link(?) [17:02:47] 10Release-Engineering-Team (πŸš‚πŸ§ͺ Trainsperiment Week): Delete wmf branches from Gerrit repositories - https://phabricator.wikimedia.org/T303828 (10thcipriani) a:03jnuche [17:04:40] (Queue (Jenkins jobs + Zuul functions) alert) firing: (2) Queue (Jenkins jobs + Zuul functions) alert - https://alerts.wikimedia.org [17:14:27] 10Release-Engineering-Team (πŸš‚πŸ§ͺ Trainsperiment Week), 10Performance-Team (Radar): Talk to Performance team and ServiceOps about caching for train experiment week - https://phabricator.wikimedia.org/T303758 (10thcipriani) I asked @akosiaris for ServiceOps thoughts on Tuesday, he said he'd check in with others an... [17:14:33] 10Release-Engineering-Team (πŸš‚πŸ§ͺ Trainsperiment Week), 10Performance-Team (Radar): Talk to Performance team and ServiceOps about caching for train experiment week - https://phabricator.wikimedia.org/T303758 (10thcipriani) p:05Triageβ†’03Medium [17:16:11] 10Release-Engineering-Team (πŸš‚πŸ§ͺ Trainsperiment Week): What things look at the task for the specific train verison? - https://phabricator.wikimedia.org/T303978 (10brennen) See also: T303751, just in case, but I don't //think// anything is looking at that API except for `deploy-promote` to report the task in logs. [17:24:40] (Queue (Jenkins jobs + Zuul functions) alert) resolved: Queue (Jenkins jobs + Zuul functions) alert - https://alerts.wikimedia.org [17:30:51] (03CR) 10Ahmon Dancy: Exit if change is not mergeable (031 comment) [tools/scap] - 10https://gerrit.wikimedia.org/r/765649 (https://phabricator.wikimedia.org/T295494) (owner: 10Jeena Huneidi) [17:32:50] (03CR) 10Jeena Huneidi: Exit if change is not mergeable (031 comment) [tools/scap] - 10https://gerrit.wikimedia.org/r/765649 (https://phabricator.wikimedia.org/T295494) (owner: 10Jeena Huneidi) [17:36:16] (03PS1) 10Jeena Huneidi: gerrit plugin: update Crd docstring [tools/scap] - 10https://gerrit.wikimedia.org/r/771412 [17:36:38] 10Release-Engineering-Team (πŸš‚πŸ§ͺ Trainsperiment Week), 10Release, 10Train Deployments: πŸ§ͺπŸš‚ Trainsperiment Week: 1.39.0-wmf.1, 1.39.0-wmf.2, 1.39.0-wmf.3, 1.39.0-wmf.4 deployment blockers - https://phabricator.wikimedia.org/T300203 (10thcipriani) a:05hasharβ†’03None [17:37:26] 10Release-Engineering-Team (πŸš‚πŸ§ͺ Trainsperiment Week), 10Scap: Automate rebuild l10n cache for Train - https://phabricator.wikimedia.org/T245187 (10dancy) [17:37:32] 10Release-Engineering-Team (πŸš‚πŸ§ͺ Trainsperiment Week), 10Patch-For-Review: multiversion/MWScript.php: Allow specifying a specific version of code to run - https://phabricator.wikimedia.org/T303878 (10dancy) 05In progressβ†’03Resolved [17:37:49] 10Release-Engineering-Team (Next), 10Patch-For-Review, 10Release, 10Train Deployments: 1.38.0-wmf.25 deployment blockers - https://phabricator.wikimedia.org/T300201 (10thcipriani) 05Openβ†’03Resolved [17:38:39] (03CR) 10Ahmon Dancy: gerrit plugin: update Crd docstring (031 comment) [tools/scap] - 10https://gerrit.wikimedia.org/r/771412 (owner: 10Jeena Huneidi) [17:43:25] (03PS2) 10Jeena Huneidi: gerrit plugin: Rename Crd class [tools/scap] - 10https://gerrit.wikimedia.org/r/771412 [17:43:44] (03CR) 10Jeena Huneidi: gerrit plugin: Rename Crd class (031 comment) [tools/scap] - 10https://gerrit.wikimedia.org/r/771412 (owner: 10Jeena Huneidi) [17:44:27] (03CR) 10Ahmon Dancy: [C: 03+2] "So much better!" [tools/scap] - 10https://gerrit.wikimedia.org/r/771412 (owner: 10Jeena Huneidi) [17:44:52] (03CR) 10Jeena Huneidi: gerrit plugin: Rename Crd class (031 comment) [tools/scap] - 10https://gerrit.wikimedia.org/r/771412 (owner: 10Jeena Huneidi) [17:45:47] (03Merged) 10jenkins-bot: gerrit plugin: Rename Crd class [tools/scap] - 10https://gerrit.wikimedia.org/r/771412 (owner: 10Jeena Huneidi) [17:48:03] 10Release-Engineering-Team (πŸš‚πŸ§ͺ Trainsperiment Week), 10Release, 10Train Deployments: πŸ§ͺπŸš‚ Trainsperiment Week: 1.39.0-wmf.1, 1.39.0-wmf.2, 1.39.0-wmf.3, 1.39.0-wmf.4 deployment blockers - https://phabricator.wikimedia.org/T300203 (10thcipriani) [17:48:29] 10Release-Engineering-Team (πŸš‚πŸ§ͺ Trainsperiment Week): Ensure train-branch-bot can cut 3 branches during Train Experiment Week - https://phabricator.wikimedia.org/T303367 (10dduvall) p:05Triageβ†’03Medium [17:48:37] 10Release-Engineering-Team (πŸš‚πŸ§ͺ Trainsperiment Week): Change / create train blocker tasks in Phabricator to correctly model the train experiment week - https://phabricator.wikimedia.org/T303748 (10thcipriani) 05Openβ†’03Resolved [17:53:46] thcipriani: shall i bump the `MAJOR_VERSION` in https://releases-jenkins.wikimedia.org/job/Automatic%20branch%20cut/configure now? [17:54:14] i forget how we navigate major version changes with regard to automated branch cutting [17:56:31] 10Release-Engineering-Team (πŸš‚πŸ§ͺ Trainsperiment Week): Delete wmf branches from Gerrit repositories - https://phabricator.wikimedia.org/T303828 (10dduvall) [17:56:36] dduvall: please do [17:56:59] traditionally we've handled it by forgetting to bump it and then bumping it and manually re-running the job. [17:57:28] :) [17:57:36] * dduvall does [17:57:38] <3 [17:58:54] 10Release-Engineering-Team (πŸš‚πŸ§ͺ Trainsperiment Week): Ensure train-branch-bot can cut 3 branches during Train Experiment Week - https://phabricator.wikimedia.org/T303367 (10dduvall) I've bumped the `MAJOR_VERSION` in https://releases-jenkins.wikimedia.org/job/Automatic%20branch%20cut/ in preparation for next week... [18:07:09] 10Release-Engineering-Team (πŸš‚πŸ§ͺ Trainsperiment Week): Ensure train-branch-bot can cut 3 branches during Train Experiment Week - https://phabricator.wikimedia.org/T303367 (10dduvall) I've changed the schedule to the following: ` TZ=UTC 0 2 * * 2 0 14 21 3 * 0 2 22 3 * 0 2 23 3 * ` Note that triggers for next wee... [18:08:21] 10Gerrit, 10Codex: VueTest repo lagging in extensions meta repo - https://phabricator.wikimedia.org/T303992 (10Reedy) [18:09:36] 10Release-Engineering-Team (πŸš‚πŸ§ͺ Trainsperiment Week): Talk to security team about patch management during trainsperiment week - https://phabricator.wikimedia.org/T303743 (10brennen) 05Openβ†’03Resolved Communications communicated, no concerns raised. [18:13:08] 10Gerrit, 10Codex, 10Patch-For-Review: VueTest repo lagging in extensions meta repo - https://phabricator.wikimedia.org/T303992 (10Reedy) Not 100% sure that's the right fix.. But if `branch = .` means `current branch`... That's not gonna work. Hence swapping for `branch = main` [18:17:46] 10Gerrit, 10Codex, 10Patch-For-Review: VueTest repo lagging in extensions meta repo - https://phabricator.wikimedia.org/T303992 (10Reedy) Obviously this works fine when everything uses master (including the meta repo)... And similarly when we branch extension branches... [18:19:38] 10Release-Engineering-Team (Radar), 10Data-Persistence (Consultation), 10CommRel-Specialists-Support (Jan-Mar-2022): Update Tech News preloads and documentation for the new primary database switchovers workflow - https://phabricator.wikimedia.org/T303937 (10Trizek-WMF) p:05Triageβ†’03Medium [19:20:59] 10GitLab (Administration, Settings & Policy), 10Release-Engineering-Team, 10Upstream, 10User-brennen: GitLab group permissions are not inherited by sub-groups for groups of users invited to the parent repo - https://phabricator.wikimedia.org/T300939 (10brennen) 05Openβ†’03Stalled p:05Triageβ†’03Low I t... [19:25:59] 10GitLab (Auth & Access), 10Release-Engineering-Team, 10User-brennen: Investigate what's required to allow a user to fork or transfer a project to a group - https://phabricator.wikimedia.org/T300935 (10brennen) 05In progressβ†’03Resolved a:03brennen I checked and it seems like the desired targets are ava... [19:28:55] 10Continuous-Integration-Infrastructure, 10Code-Health-Metrics, 10Quality-and-Test-Engineering-Team (QTE), 10ci-test-error (WMF-deployed Build Failure): All codehealth jobs failing due to older nodejs version - https://phabricator.wikimedia.org/T303958 (10Jdforrester-WMF) >>! In T303958#7782765, @zeljkofil... [19:33:51] (03CR) 10Ahmon Dancy: Provide scap prep auto history browsing and replay (032 comments) [tools/scap] - 10https://gerrit.wikimedia.org/r/763864 (https://phabricator.wikimedia.org/T301417) (owner: 10Dduvall) [19:40:20] 10Gerrit, 10Codex, 10Patch-For-Review: VueTest repo lagging in extensions meta repo - https://phabricator.wikimedia.org/T303992 (10Reedy) Per @Jdforrester-WMF >Can we fix VueTest to not violate our instructions not to change this until GitLab, and use master like every other repo instead? I've added a `mas... [19:43:39] !log apply https://gerrit.wikimedia.org/r/c/mediawiki/extensions/CentralAuth/+/771347/ on deployment-prep [19:43:40] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [19:48:40] !log apply https://gerrit.wikimedia.org/r/c/mediawiki/extensions/CentralAuth/+/769424/ on deployment-prep [19:48:41] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [19:56:41] 10Release-Engineering-Team (Next), 10Patch-For-Review, 10Release, 10Train Deployments: 1.38.0-wmf.26 deployment blockers - https://phabricator.wikimedia.org/T300202 (10Jdlrobson) [19:57:37] 10Release-Engineering-Team (Next), 10Patch-For-Review, 10Release, 10Train Deployments: 1.38.0-wmf.26 deployment blockers - https://phabricator.wikimedia.org/T300202 (10Jdlrobson) New train blocker: T304002 Not sure what's causing this but my guess is the #ip_masking project. [19:59:33] (03PS1) 10Jforrester: jjb: Provide generic-node14-browser-direct-coverage-docker-publish [integration/config] - 10https://gerrit.wikimedia.org/r/771439 [19:59:35] (03PS1) 10Jforrester: Zuul: [mediawiki/services/function-{evalu,orchestr}ator] Switch to npm coverage job [integration/config] - 10https://gerrit.wikimedia.org/r/771440 [20:02:22] (03CR) 10jerkins-bot: [V: 04-1] Zuul: [mediawiki/services/function-{evalu,orchestr}ator] Switch to npm coverage job [integration/config] - 10https://gerrit.wikimedia.org/r/771440 (owner: 10Jforrester) [20:02:29] 10Gerrit, 10Codex, 10Patch-For-Review: VueTest repo lagging in extensions meta repo - https://phabricator.wikimedia.org/T303992 (10hashar) Having the submodule configured with `branch = main` would have solved it, however when the parent repo is branched for REL* branch one would have to remember to update t... [20:03:36] thcipriani: ok your additions to the calendar don't match my horrible regex https://gerrit.wikimedia.org/r/plugins/gitiles/labs/tools/train-blockers/+/refs/heads/master/update.php#28 [20:05:25] 10Gerrit, 10Codex, 10Patch-For-Review: VueTest repo lagging in extensions meta repo - https://phabricator.wikimedia.org/T303992 (10Reedy) >>! In T303992#7783623, @hashar wrote: > Having the submodule configured with `branch = main` would have solved it, however when the parent repo is branched for REL* branc... [20:07:39] (03CR) 10Jforrester: [C: 03+2] "Deployed." [integration/config] - 10https://gerrit.wikimedia.org/r/771439 (owner: 10Jforrester) [20:08:21] (03PS2) 10Jforrester: Zuul: [mediawiki/services/function-evaluator] Switch to npm coverage job [integration/config] - 10https://gerrit.wikimedia.org/r/771440 [20:08:24] taavi: :D [20:08:35] taavi: brennen is currently poking at this [20:08:39] (03PS3) 10Jforrester: Zuul: [mediawiki/services/function-evaluator] Switch to npm coverage job [integration/config] - 10https://gerrit.wikimedia.org/r/771440 (https://phabricator.wikimedia.org/T302607) [20:08:46] (03CR) 10Jforrester: [C: 03+2] Zuul: [mediawiki/services/function-evaluator] Switch to npm coverage job [integration/config] - 10https://gerrit.wikimedia.org/r/771440 (https://phabricator.wikimedia.org/T302607) (owner: 10Jforrester) [20:09:05] thanks [20:10:10] (03Merged) 10jenkins-bot: jjb: Provide generic-node14-browser-direct-coverage-docker-publish [integration/config] - 10https://gerrit.wikimedia.org/r/771439 (owner: 10Jforrester) [20:10:52] (03Merged) 10jenkins-bot: Zuul: [mediawiki/services/function-evaluator] Switch to npm coverage job [integration/config] - 10https://gerrit.wikimedia.org/r/771440 (https://phabricator.wikimedia.org/T302607) (owner: 10Jforrester) [20:11:31] 10Gerrit, 10Codex: VueTest repo lagging in extensions meta repo - https://phabricator.wikimedia.org/T303992 (10hashar) >>! In T303992#7783625, @Reedy wrote: > We stopped creating a branch in mediawiki/extensions after REL1_35; there is no REL1_36 (or later) branch Oh that is great. One less problem so :-] W... [20:13:31] !log Zuul: [mediawiki/services/function-evaluator and …/function-orchestrator] Switch to npm coverage job for T302607 and T302608 [20:13:34] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [20:13:34] T302607: Publish function-orchestrator's test code coverage - https://phabricator.wikimedia.org/T302607 [20:13:35] T302608: Publish function-evaluator's test code coverage - https://phabricator.wikimedia.org/T302608 [20:24:16] 10Continuous-Integration-Config: CI job mwext-php72-phan-docker is running for normal tests and experimental tests on mediawiki extensions - https://phabricator.wikimedia.org/T304007 (10Umherirrender) [20:26:46] 10Project-Admins, 10WMIT-Infrastructure: Create Tag for WMIT-CiviCRM - https://phabricator.wikimedia.org/T303835 (10Aklapper) 05Openβ†’03Resolved a:03Aklapper Requested public project #WMIT-CiviCRM has been created: https://phabricator.wikimedia.org/project/view/5827/ (In case you need to edit the project... [20:34:48] 10Project-Admins: Create project tag for Wikinews - https://phabricator.wikimedia.org/T303039 (10Aklapper) 05Openβ†’03Declined @Lens0021: If this will be a definite list of tasks which all could be declared "resolved" at some point, then whoever works on this could create an #epic task with smaller subtasks to... [20:38:53] 10Project-Admins: Create project tag for <#Equity-Landscape> - https://phabricator.wikimedia.org/T303879 (10Aklapper) 05Openβ†’03Resolved a:03Aklapper Requested public project #equity-landscape has been created: https://phabricator.wikimedia.org/project/view/5828/ (In case you need to edit the project itself... [20:45:44] 10Release-Engineering-Team, 10Growth-Team, 10PageCuration, 10Patch-For-Review, and 2 others: quibble-vendor-mysql-php72-noselenium-docker fails for a noop PageTriage patch - https://phabricator.wikimedia.org/T303092 (10aaron) The method, getMultiWithUnionSetCallback(), seems to expect explicit "false" valu... [20:50:38] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team, 10Code-Health-Metrics, 10Quality-and-Test-Engineering-Team (QTE), 10ci-test-error (WMF-deployed Build Failure): All codehealth jobs failing due to older nodejs version - https://phabricator.wikimedia.org/T303958 (10kostajh) Ah, right. W... [20:51:30] Hmmm.... https://integration.wikimedia.org/ci/view/Beta/job/beta-mediawiki-config-update-eqiad/ has no run in 10 days? This does not seem right. [20:52:06] bd808: it's deliberate [20:52:17] Some scap bug means the other sync job was also doing it [20:52:51] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team, 10Code-Health-Metrics, 10Quality-and-Test-Engineering-Team (QTE), 10ci-test-error (WMF-deployed Build Failure): All codehealth jobs failing due to older nodejs version - https://phabricator.wikimedia.org/T303958 (10kostajh) a:03kostajh [20:53:16] hmmm... like the newer scap had tried to take over that functionality? [20:53:41] bd808: https://phabricator.wikimedia.org/T302905 [20:53:51] That probably explains better than me [20:54:17] or not [20:55:44] okey doke. I just saw kostajh wonder why the config that is live in prod is not live in beta and thought I'd check the job. Looks like I no longer understand how things are supposed to work so I'll wander off. :) [20:56:35] (03PS1) 10Kosta Harlan: dockerfiles: Install node14 on sonar-scanner image [integration/config] - 10https://gerrit.wikimedia.org/r/771459 (https://phabricator.wikimedia.org/T303958) [20:59:25] (03CR) 10Jforrester: dockerfiles: Install node14 on sonar-scanner image (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/771459 (https://phabricator.wikimedia.org/T303958) (owner: 10Kosta Harlan) [21:00:08] (03CR) 10Kosta Harlan: dockerfiles: Install node14 on sonar-scanner image (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/771459 (https://phabricator.wikimedia.org/T303958) (owner: 10Kosta Harlan) [21:00:47] (03PS2) 10Kosta Harlan: dockerfiles: Install node14 on sonar-scanner image [integration/config] - 10https://gerrit.wikimedia.org/r/771459 (https://phabricator.wikimedia.org/T303958) [21:01:30] (03PS3) 10Kosta Harlan: dockerfiles: Install node14 on sonar-scanner image [integration/config] - 10https://gerrit.wikimedia.org/r/771459 (https://phabricator.wikimedia.org/T303958) [21:02:35] so i think it's the additional list item for `* group1 to [[mw:MediaWiki_1.39/wmf.1|1.39.0-wmf.1]]` that breaks the match. [21:02:58] (03PS4) 10Kosta Harlan: [WIP] dockerfiles: Install node14 on sonar-scanner image [integration/config] - 10https://gerrit.wikimedia.org/r/771459 (https://phabricator.wikimedia.org/T303958) [21:04:46] (03CR) 10Dduvall: Provide scap prep auto history browsing and replay (032 comments) [tools/scap] - 10https://gerrit.wikimedia.org/r/763864 (https://phabricator.wikimedia.org/T301417) (owner: 10Dduvall) [21:26:39] 10Release-Engineering-Team, 10Scap, 10Infrastructure-Foundations, 10serviceops, 10Patch-For-Review: Use scap to deploy itself to scap targets - https://phabricator.wikimedia.org/T303559 (10jbond) Sorry for the slow response on this, there is already a function, wmflib::role_hosts, which dose alsmot what... [21:30:38] (03PS1) 10Dduvall: Fix history.log() and garbage collection locking [tools/scap] - 10https://gerrit.wikimedia.org/r/771465 (https://phabricator.wikimedia.org/T301417) [21:30:45] (03PS5) 10Kosta Harlan: dockerfiles: Install node14 on sonar-scanner image [integration/config] - 10https://gerrit.wikimedia.org/r/771459 (https://phabricator.wikimedia.org/T303958) [21:33:39] 10Release-Engineering-Team (πŸš‚πŸ§ͺ Trainsperiment Week): Ensure train-branch-bot can cut 3 branches during Train Experiment Week - https://phabricator.wikimedia.org/T303367 (10dduvall) 05Openβ†’03Resolved Approved schedule is: ` TZ=UTC # min hour day-of-month month dayofweek # weekly branch cut on Tuesdays at 020... [21:34:05] (03CR) 10Ahmon Dancy: Fix history.log() and garbage collection locking (031 comment) [tools/scap] - 10https://gerrit.wikimedia.org/r/771465 (https://phabricator.wikimedia.org/T301417) (owner: 10Dduvall) [21:38:53] (03CR) 10Dduvall: Fix history.log() and garbage collection locking (031 comment) [tools/scap] - 10https://gerrit.wikimedia.org/r/771465 (https://phabricator.wikimedia.org/T301417) (owner: 10Dduvall) [21:39:09] https://regex101.com/r/lGLsbo/2 [21:39:45] That's pretty cool [21:39:48] (03CR) 10Dduvall: Fix history.log() and garbage collection locking (031 comment) [tools/scap] - 10https://gerrit.wikimedia.org/r/771465 (https://phabricator.wikimedia.org/T301417) (owner: 10Dduvall) [21:39:50] thcipriani, taavi: know any reason the bits that show what group is going to what version need to be separate list items? (other than cometic) [21:40:01] 'cosmetic [21:40:16] yeah this regex101 thing is pretty slick. [21:40:28] tyler mentioned it, i hadn't really used it much. [21:41:58] (03CR) 10Ahmon Dancy: Fix history.log() and garbage collection locking (031 comment) [tools/scap] - 10https://gerrit.wikimedia.org/r/771465 (https://phabricator.wikimedia.org/T301417) (owner: 10Dduvall) [21:42:52] (03PS2) 10Dduvall: Fix all concurrent access to history log file [tools/scap] - 10https://gerrit.wikimedia.org/r/771465 (https://phabricator.wikimedia.org/T301417) [21:43:51] (03CR) 10Dduvall: Fix all concurrent access to history log file (031 comment) [tools/scap] - 10https://gerrit.wikimedia.org/r/771465 (https://phabricator.wikimedia.org/T301417) (owner: 10Dduvall) [21:47:51] 10Release-Engineering-Team (πŸš‚πŸ§ͺ Trainsperiment Week): Determine if we need to communicate anything special about forward and backwards compatibility during train experiment week - https://phabricator.wikimedia.org/T303759 (10dduvall) p:05Triageβ†’03Medium [21:49:46] 10Release-Engineering-Team (πŸš‚πŸ§ͺ Trainsperiment Week): Determine if we need to communicate anything special about forward and backwards compatibility during train experiment week - https://phabricator.wikimedia.org/T303759 (10dduvall) This is still unknown. I've reached out to PET and we have @DAlangi_WMF joining... [21:51:21] 10Release-Engineering-Team (πŸš‚πŸ§ͺ Trainsperiment Week): Coordinate with PET prior to train experiment week - https://phabricator.wikimedia.org/T303745 (10dduvall) 05Openβ†’03Resolved @DAlangi_WMF from #platform_engineering will be joining us for deployment windows during next week's Trainsperiments. πŸŽ‰ Leaving {T3... [21:51:36] 10Release-Engineering-Team (πŸš‚πŸ§ͺ Trainsperiment Week): Coordinate with PET prior to train experiment week - https://phabricator.wikimedia.org/T303745 (10dduvall) [21:51:38] 10Release-Engineering-Team (πŸš‚πŸ§ͺ Trainsperiment Week): Determine if we need to communicate anything special about forward and backwards compatibility during train experiment week - https://phabricator.wikimedia.org/T303759 (10dduvall) [21:58:12] (03PS6) 10Jforrester: dockerfiles: [sonar-scanner] Upgrade nodejs from node10 to node14 [integration/config] - 10https://gerrit.wikimedia.org/r/771459 (https://phabricator.wikimedia.org/T303958) (owner: 10Kosta Harlan) [21:58:19] (03CR) 10Jforrester: [C: 03+2] "➜ integration-config git:(review/kosta_harlan/T303958) ./dockerfiles/debug-image sonar-scanner" [integration/config] - 10https://gerrit.wikimedia.org/r/771459 (https://phabricator.wikimedia.org/T303958) (owner: 10Kosta Harlan) [21:58:56] (03CR) 10Ahmon Dancy: [C: 03+2] Fix all concurrent access to history log file [tools/scap] - 10https://gerrit.wikimedia.org/r/771465 (https://phabricator.wikimedia.org/T301417) (owner: 10Dduvall) [21:59:44] (03Merged) 10jenkins-bot: Fix all concurrent access to history log file [tools/scap] - 10https://gerrit.wikimedia.org/r/771465 (https://phabricator.wikimedia.org/T301417) (owner: 10Dduvall) [22:00:01] (03Merged) 10jenkins-bot: dockerfiles: [sonar-scanner] Upgrade nodejs from node10 to node14 [integration/config] - 10https://gerrit.wikimedia.org/r/771459 (https://phabricator.wikimedia.org/T303958) (owner: 10Kosta Harlan) [22:00:33] !log Docker: Publishing sonar-scanner:4.6.0.2311-3 for T303958 [22:00:35] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [22:00:35] T303958: All codehealth jobs failing due to older nodejs version - https://phabricator.wikimedia.org/T303958 [22:05:22] (03PS1) 10Jforrester: jjb: Update sonar-scanner uses to images with node14 not node10 [integration/config] - 10https://gerrit.wikimedia.org/r/771470 (https://phabricator.wikimedia.org/T303958) [22:05:57] (03CR) 10Hashar: [C: 03+1] ":)" [integration/config] - 10https://gerrit.wikimedia.org/r/771470 (https://phabricator.wikimedia.org/T303958) (owner: 10Jforrester) [22:13:10] (03CR) 10Jforrester: [C: 03+2] "Deployed, now working again. Thanks Kosta!" [integration/config] - 10https://gerrit.wikimedia.org/r/771470 (https://phabricator.wikimedia.org/T303958) (owner: 10Jforrester) [22:14:14] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team, 10Code-Health-Metrics, 10Quality-and-Test-Engineering-Team (QTE), and 2 others: All codehealth jobs failing due to older nodejs version - https://phabricator.wikimedia.org/T303958 (10Jdforrester-WMF) 05Openβ†’03Resolved Thanks! [22:14:55] 10Release-Engineering-Team (Done by Feb 23 🧟), 10Scap, 10User-dduvall: Add rollback mechanism to `scap prep auto` - https://phabricator.wikimedia.org/T301417 (10dduvall) 05Openβ†’03Resolved [22:14:59] 10Release-Engineering-Team (Done by Feb 23 🧟), 10Scap, 10User-dduvall: Add rollback mechanism to `scap prep auto` - https://phabricator.wikimedia.org/T301417 (10dduvall) [22:16:35] (03Merged) 10jenkins-bot: jjb: Update sonar-scanner uses to images with node14 not node10 [integration/config] - 10https://gerrit.wikimedia.org/r/771470 (https://phabricator.wikimedia.org/T303958) (owner: 10Jforrester) [22:20:47] 10Release-Engineering-Team (πŸš‚πŸ§ͺ Trainsperiment Week), 10Patch-For-Review: Ensure train-blockers.toolforge.org will find correct train blocker during train experiment week - https://phabricator.wikimedia.org/T303751 (10brennen) Tested against new deployment schedule, and modified the first block so it'll get pic... [23:33:14] 10Release-Engineering-Team (Next), 10Patch-For-Review, 10Release, 10Train Deployments: 1.38.0-wmf.26 deployment blockers - https://phabricator.wikimedia.org/T300202 (10Jdlrobson) Hi @jeena we've prepared a backport https://gerrit.wikimedia.org/r/771395 (nothing to do with IP masking). Patch is working on b... [23:40:33] 10Release-Engineering-Team (Next), 10Patch-For-Review, 10Release, 10Train Deployments: 1.38.0-wmf.26 deployment blockers - https://phabricator.wikimedia.org/T300202 (10jeena) Thanks for the update @Jdlrobson. I think it will be fine to backport tomorrow since there are still remaining blockers but in the c... [23:48:40] (03CR) 10Ahmon Dancy: Fix all concurrent access to history log file (031 comment) [tools/scap] - 10https://gerrit.wikimedia.org/r/771465 (https://phabricator.wikimedia.org/T301417) (owner: 10Dduvall)