[01:53:03] 10WikimediaDebug, 07Essential-Work, 10Test Kitchen (Experiment Platform Sprint 30): Update WikimediaDebug to fetch active experiment config and allow selection of experiments and groups - https://phabricator.wikimedia.org/T438283#12336352 (10cjming) a:03cjming [01:53:13] 10WikimediaDebug, 07Essential-Work, 10Test Kitchen (Experiment Platform Sprint 30): Add Test Kitchen functionality to WikimediaDebug - https://phabricator.wikimedia.org/T437240#12336354 (10cjming) a:03cjming [02:20:53] 10Continuous-Integration-Infrastructure, 10Castor, 07Spike, 06Test Platform (Arusha 30): Test out the https://github.com/git-pkgs/proxy/ for CI - https://phabricator.wikimedia.org/T437005#12336393 (10Mhurd) [02:22:04] (03PS1) 10Apehitkey: zuul: add Ow0cast to CI allowlist [integration/config] - 10https://gerrit.wikimedia.org/r/1342827 [02:22:54] (03CR) 10CI reject: [V:04-1] zuul: add Ow0cast to CI allowlist [integration/config] - 10https://gerrit.wikimedia.org/r/1342827 (owner: 10Apehitkey) [02:23:24] (03PS2) 10Apehitkey: zuul: add Ow0cast to CI allowlist [integration/config] - 10https://gerrit.wikimedia.org/r/1342827 [02:23:57] (03PS3) 10Apehitkey: zuul: add Ow0cast to CI allowlist [integration/config] - 10https://gerrit.wikimedia.org/r/1342827 [02:26:50] (03PS1) 10Pwangai: Recover from an npm cache that has lost files [integration/quibble] - 10https://gerrit.wikimedia.org/r/1342828 (https://phabricator.wikimedia.org/T438206) [02:46:14] (03CR) 10Pwangai: "This change does not stop the cache being damaged in the first place," [integration/quibble] - 10https://gerrit.wikimedia.org/r/1342828 (https://phabricator.wikimedia.org/T438206) (owner: 10Pwangai) [02:56:47] (03CR) 10Pwangai: "I verified locally, and to be sure I tested this on agent-999. I downloaded a copy of the cache from the namespace, deleted three packet c" [integration/quibble] - 10https://gerrit.wikimedia.org/r/1342828 (https://phabricator.wikimedia.org/T438206) (owner: 10Pwangai) [07:12:27] (03CR) 10Hashar: [C:03+1] "Happy to have the image built and jobs updated at any point :)" [integration/config] - 10https://gerrit.wikimedia.org/r/1330226 (https://phabricator.wikimedia.org/T436173) (owner: 10Phedenskog) [07:24:04] 06Release-Engineering-Team (Priority Backlog πŸ“₯), 10MediaWiki-extensions-DonationInterface, 06Moderator-Tools-Team, 10PersonalDashboard, and 6 others: Noisy log: normalized_message: ResourceLoader duplicate registration warning. Another module has already b... - https://phabricator.wikimedia.org/T438387#12336631 [07:24:15] 06Release-Engineering-Team (Priority Backlog πŸ“₯), 07Essential-Work, 05Release, 05Train Deployments: 1.47.0-wmf.20 deployment blockers - https://phabricator.wikimedia.org/T430839#12336637 (10jnuche) [07:24:19] 06Release-Engineering-Team (Priority Backlog πŸ“₯), 10MediaWiki-extensions-DonationInterface, 06Moderator-Tools-Team, 10PersonalDashboard, and 6 others: Noisy log: normalized_message: ResourceLoader duplicate registration warning. Another module has already b... - https://phabricator.wikimedia.org/T438387#12336636 [07:26:44] (03CR) 10Phedenskog: "I haven't done it before but can try on Monday 😊" [integration/config] - 10https://gerrit.wikimedia.org/r/1330226 (https://phabricator.wikimedia.org/T436173) (owner: 10Phedenskog) [09:22:52] 10Phabricator maintenance bot: Maintenance bot's project_grouper fails hard when a rule is invalid - https://phabricator.wikimedia.org/T438453 (10Urbanecm) 03NEW [09:25:22] 10Phabricator maintenance bot, 07Security: @Maintenance_bot can't see/doesn't act on security tasks - https://phabricator.wikimedia.org/T391674#12337014 (10Urbanecm) FWIW, this would also mean "Toolforge has credentials that can see any security ticket". Which, given the disclaimers the Cloud's ToU have (https... [10:18:30] (03CR) 10Phedenskog: "What about adding a couple of test cases for the new fixes?" [integration/quibble] - 10https://gerrit.wikimedia.org/r/1342828 (https://phabricator.wikimedia.org/T438206) (owner: 10Pwangai) [10:31:23] (03CR) 10Phedenskog: Recover from an npm cache that has lost files (031 comment) [integration/quibble] - 10https://gerrit.wikimedia.org/r/1342828 (https://phabricator.wikimedia.org/T438206) (owner: 10Pwangai) [11:12:16] (03PS3) 10Arendpieter: castor: Stop blocking builds on the cache save [integration/config] - 10https://gerrit.wikimedia.org/r/1341139 (https://phabricator.wikimedia.org/T352319) [11:13:22] (03CR) 10Arendpieter: "Thanks, and sure. The plugin fix turns the interrupted case into ABORTED, which is the InterruptedException half. The CancellationExceptio" [integration/config] - 10https://gerrit.wikimedia.org/r/1341139 (https://phabricator.wikimedia.org/T352319) (owner: 10Arendpieter) [12:04:04] (03CR) 10Hashar: [C:03+2] Zuul: [mediawiki/extensions/WikimediaAntiAbuse] Add CheckUser dep. [integration/config] - 10https://gerrit.wikimedia.org/r/1342739 (https://phabricator.wikimedia.org/T435925) (owner: 10Dreamy Jazz) [12:06:19] (03Merged) 10jenkins-bot: Zuul: [mediawiki/extensions/WikimediaAntiAbuse] Add CheckUser dep. [integration/config] - 10https://gerrit.wikimedia.org/r/1342739 (https://phabricator.wikimedia.org/T435925) (owner: 10Dreamy Jazz) [12:11:01] 10Beta-Cluster-Infrastructure, 10GrowthExperiments-NewcomerTasks, 06Growth-Team (FY2026-27 Q1 Sprint 6), 05MW-1.47-notes (1.47.0-wmf.21; 2026-09-22), 07Regression: [enwiki beta] Special:NewcomerTasksInfo gives Internal error - https://phabricator.wikimedia.org/T438254#12337558 (10DMburugu) 05Openβ†’... [12:23:20] 10Phabricator (Upstream), 07Upstream: Editing an existing task description which mentions a user should not readd the user as Subscriber - https://phabricator.wikimedia.org/T96464#12337593 (10Aklapper) a:05Aklapperβ†’03None [12:41:29] 10Gerrit, 13Patch-For-Review, 07Upstream: Gerrit's syntax highlighting for PHP code breaks when encountering an apostrophe in a // comment in a function call - https://phabricator.wikimedia.org/T372404#12337624 (10Paladox) https://github.com/highlightjs/highlight.js/pull/4527 Should fix this as well (not mer... [12:41:58] (03CR) 10Hashar: [C:03+2] "Deployed" [integration/config] - 10https://gerrit.wikimedia.org/r/1342739 (https://phabricator.wikimedia.org/T435925) (owner: 10Dreamy Jazz) [13:05:10] 10Continuous-Integration-Infrastructure, 10Castor: gate-and-submit backlogged due to waiting for castor-save-workspace-cache - https://phabricator.wikimedia.org/T353925#12337768 (10hashar) After several weeks of tricks and optimization, I am pretty convinced @Peter found the root cause. https://gerrit.wikimed... [13:06:46] 06Release-Engineering-Team (Doing 😎), 10Catalyst (Luka Ijo Pimeja Jan), 07Essential-Work, 13Patch-For-Review: CAPI: Use Helm v4 - https://phabricator.wikimedia.org/T429768#12337776 (10jnuche) Tested: * Env creation & deletion * Env recreation w/ & w/o code server (Patchdemo) * Env recreation w/ code ser... [13:13:54] 10Continuous-Integration-Infrastructure, 10Castor, 06cloud-services-team, 10Cloud-VPS (Quota-requests), 06Test Platform (Arusha 30): Apply the 4x-iops Cinder volume type to the Castor cache volume (integration-castor06) - https://phabricator.wikimedia.org/T437127#12337817 (10fgiunchedi) Thank you for the... [13:18:00] 06Release-Engineering-Team, 06Data-Platform-SRE (2026-09-18 - 2026-10-09): archiva1002 has stale jobs in /var/cache/archiva that uses all the disk space - https://phabricator.wikimedia.org/T425083#12337908 (10Gehel) [13:20:39] 10Continuous-Integration-Infrastructure, 06Release-Engineering-Team, 10Castor: npm cache saved by castor get corrupted for unknown reason - https://phabricator.wikimedia.org/T295351#12337973 (10hashar) From T438206 a timeline is: A job is in gate-and-submit and succeed, starts running the PostBuildScript fo... [13:23:46] (03PS3) 10Jforrester: jjb: Update Node from 24.18.0 to 26.8.2 for Quibble jobs [integration/config] - 10https://gerrit.wikimedia.org/r/1342058 (https://phabricator.wikimedia.org/T438085) [13:32:22] 10Continuous-Integration-Infrastructure, 06Release-Engineering-Team, 06DC-Ops, 10ops-eqiad, and 2 others: Check and fix BIOS on new Supermicro cloudvirt* systems - https://phabricator.wikimedia.org/T435537#12338238 (10fgiunchedi) a:05Andrewβ†’03fgiunchedi [13:32:27] (03CR) 10CI reject: [V:04-1] jjb: move Maven jobs to new maven-jobs.yaml [integration/config] - 10https://gerrit.wikimedia.org/r/1343058 (owner: 10Hashar) [13:33:31] (03PS2) 10Hashar: jjb: move Maven jobs to new maven-jobs.yaml [integration/config] - 10https://gerrit.wikimedia.org/r/1343058 [13:37:32] (03CR) 10Jforrester: [C:03+2] jjb: Update Node from 24.18.0 to 26.8.2 for Quibble jobs [integration/config] - 10https://gerrit.wikimedia.org/r/1342058 (https://phabricator.wikimedia.org/T438085) (owner: 10Jforrester) [13:37:35] (03CR) 10Jforrester: [C:03+2] Zuul: Migrate MediaWiki-land independent CI Node from 24 to 26 [integration/config] - 10https://gerrit.wikimedia.org/r/1342059 (https://phabricator.wikimedia.org/T438085) (owner: 10Jforrester) [13:39:11] (03Merged) 10jenkins-bot: jjb: Update Node from 24.18.0 to 26.8.2 for Quibble jobs [integration/config] - 10https://gerrit.wikimedia.org/r/1342058 (https://phabricator.wikimedia.org/T438085) (owner: 10Jforrester) [13:42:27] (03PS3) 10Jforrester: Zuul: Migrate MediaWiki-land independent CI Node from 24 to 26 [integration/config] - 10https://gerrit.wikimedia.org/r/1342059 (https://phabricator.wikimedia.org/T438085) [13:46:05] (03CR) 10Jforrester: "…" [integration/config] - 10https://gerrit.wikimedia.org/r/1342059 (https://phabricator.wikimedia.org/T438085) (owner: 10Jforrester) [13:47:43] (03Merged) 10jenkins-bot: Zuul: Migrate MediaWiki-land independent CI Node from 24 to 26 [integration/config] - 10https://gerrit.wikimedia.org/r/1342059 (https://phabricator.wikimedia.org/T438085) (owner: 10Jforrester) [13:48:53] !log Zuul: Migrate MediaWiki-land independent CI Node from 24 to 26, for T438085 [13:48:56] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [13:48:56] T438085: Upgrade all CI jobs for WMF-deployed projects from Node 24 to Node 26 - https://phabricator.wikimedia.org/T438085 [13:57:02] (03PS1) 10Jforrester: jjb: Provide Node 26 Codex jobs [integration/config] - 10https://gerrit.wikimedia.org/r/1343068 (https://phabricator.wikimedia.org/T438085) [13:57:04] (03PS1) 10Jforrester: Zuul: Remaining Node 24 -> 26 migrations [integration/config] - 10https://gerrit.wikimedia.org/r/1343069 (https://phabricator.wikimedia.org/T438085) [13:57:06] (03PS1) 10Jforrester: jjb: Migrate incidental Node use to Node 26 [integration/config] - 10https://gerrit.wikimedia.org/r/1343070 (https://phabricator.wikimedia.org/T438085) [13:57:09] (03PS1) 10Jforrester: jjb: Drop Node 24 jobs, now unused [integration/config] - 10https://gerrit.wikimedia.org/r/1343071 (https://phabricator.wikimedia.org/T438085) [13:57:43] (03CR) 10Jforrester: [C:03+2] jjb: Provide Node 26 Codex jobs [integration/config] - 10https://gerrit.wikimedia.org/r/1343068 (https://phabricator.wikimedia.org/T438085) (owner: 10Jforrester) [13:59:21] (03Merged) 10jenkins-bot: jjb: Provide Node 26 Codex jobs [integration/config] - 10https://gerrit.wikimedia.org/r/1343068 (https://phabricator.wikimedia.org/T438085) (owner: 10Jforrester) [13:59:28] (03CR) 10Jforrester: [C:03+2] Zuul: Remaining Node 24 -> 26 migrations [integration/config] - 10https://gerrit.wikimedia.org/r/1343069 (https://phabricator.wikimedia.org/T438085) (owner: 10Jforrester) [14:01:23] (03Merged) 10jenkins-bot: Zuul: Remaining Node 24 -> 26 migrations [integration/config] - 10https://gerrit.wikimedia.org/r/1343069 (https://phabricator.wikimedia.org/T438085) (owner: 10Jforrester) [14:01:53] !log Zuul: Remaining Node 24 -> 26 migrations [14:01:54] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [14:05:54] (03PS2) 10Jforrester: jjb: Migrate incidental Node use to Node 26 [integration/config] - 10https://gerrit.wikimedia.org/r/1343070 (https://phabricator.wikimedia.org/T438085) [14:05:55] (03PS2) 10Jforrester: jjb: Drop Node 24 jobs, now unused [integration/config] - 10https://gerrit.wikimedia.org/r/1343071 (https://phabricator.wikimedia.org/T438085) [14:05:55] (03PS1) 10Jforrester: Docker: [ajv, sonar-scanner] Update Node from 24.18.0 to 26.8.2 [integration/config] - 10https://gerrit.wikimedia.org/r/1343075 (https://phabricator.wikimedia.org/T438085) [14:05:57] (03PS1) 10Jforrester: jjb: Migrate sonar-scanner to images with Node 26 [integration/config] - 10https://gerrit.wikimedia.org/r/1343076 (https://phabricator.wikimedia.org/T438085) [14:05:59] (03PS1) 10Jforrester: Docker: Drop Node 24 images, no longer used [integration/config] - 10https://gerrit.wikimedia.org/r/1343077 (https://phabricator.wikimedia.org/T438085) [14:08:41] (03PS1) 10Wandji collins: jjb: Provide labs-tools-wdaudiolex-be [integration/config] - 10https://gerrit.wikimedia.org/r/1343079 [14:25:55] (03PS1) 10Wandji collins: zuul: [labs/tools/wdaudiolex]: Add labs-tools-wdaudiolex test [integration/config] - 10https://gerrit.wikimedia.org/r/1343085 [14:27:35] 06Release-Engineering-Team (Doing 😎), 10Catalyst (Luka Ijo Pimeja Jan), 07Essential-Work, 13Patch-For-Review: CAPI: Use Helm v4 - https://phabricator.wikimedia.org/T429768#12338537 (10jnuche) Also tested: * Env created with Helm v3 can be successfully recreated with Helm v4 (Patchdemo) [14:27:42] (03CR) 10CI reject: [V:04-1] zuul: [labs/tools/wdaudiolex]: Add labs-tools-wdaudiolex test [integration/config] - 10https://gerrit.wikimedia.org/r/1343085 (owner: 10Wandji collins) [14:28:19] 06Release-Engineering-Team (Doing 😎), 10Catalyst (Luka Ijo Pimeja Jan), 07Essential-Work, 13Patch-For-Review: CAPI: Use Helm v4 - https://phabricator.wikimedia.org/T429768#12338540 (10jnuche) 05Openβ†’03Resolved In production [14:34:01] (03CR) 10Hashar: "Almost! CI fails because the jobs have not been defined in `jjb/labs.yaml` which is needed to have them created in Jenkins ;)" [integration/config] - 10https://gerrit.wikimedia.org/r/1343085 (owner: 10Wandji collins) [14:34:05] (03PS2) 10Hashar: Add tox for labs/tools/wdaudiolex [integration/config] - 10https://gerrit.wikimedia.org/r/1343085 (owner: 10Wandji collins) [14:34:21] (03CR) 10Jforrester: "Why do you want your own version of this? The general `tox` job will behave identically, and won't need individual maintenance for your re" [integration/config] - 10https://gerrit.wikimedia.org/r/1343079 (owner: 10Wandji collins) [14:34:48] (03CR) 10Hashar: [C:03+2] Add tox for labs/tools/wdaudiolex [integration/config] - 10https://gerrit.wikimedia.org/r/1343085 (owner: 10Wandji collins) [14:34:55] (03CR) 10Jforrester: [C:04-2] Add tox for labs/tools/wdaudiolex [integration/config] - 10https://gerrit.wikimedia.org/r/1343085 (owner: 10Wandji collins) [14:35:15] (03PS3) 10Hashar: Add tox for labs/tools/wdaudiolex-be [integration/config] - 10https://gerrit.wikimedia.org/r/1343085 (owner: 10Wandji collins) [14:35:23] (03CR) 10Jforrester: "Per my comment on the other patch." [integration/config] - 10https://gerrit.wikimedia.org/r/1343085 (owner: 10Wandji collins) [14:36:12] (03PS4) 10Hashar: Add tox for labs/tools/wdaudiolex-be [integration/config] - 10https://gerrit.wikimedia.org/r/1343085 (owner: 10Wandji collins) [14:37:58] (03CR) 10Hashar: "That is how the labs tools are made, that prevent them from all sharing the same gate-and-submit queue 😊" [integration/config] - 10https://gerrit.wikimedia.org/r/1343079 (owner: 10Wandji collins) [14:38:32] James_F: bunch of tox jobs have specific name so they don't share the same queue [14:38:44] I wasn't aware of the change doing jjb [14:38:57] so I have amended the one for zuul to have it create the jobs as well: https://gerrit.wikimedia.org/r/c/integration/config/+/1343085 [14:39:43] hashar: Yes, I know, it’s a disaster. [14:40:12] We have a generic tox job that is more than fine for repos that get < 1 request an hour, which is almost all of them. [14:40:24] they are cheap really [14:40:38] Each time we upgrade we have to upgrade 20 labs jobs created years ago with no contact details. [14:40:44] I file Phab tasks asking if it’s OK to bumo. [14:40:46] I wait. [14:40:49] I wait more. [14:40:58] Eventually after a year I just migrate them. [14:41:08] It’s a huge waste of my time, and doesn’t add any real value. [14:41:54] I merely reused the same pattern used in jjb/python-jobs.yaml [14:42:15] Yes, that’s been done in the past but I’ve been steering people away from it for a while now. [14:42:33] We can land this now and revert in an hour if you want? But they’ll lose the history of old builds. [14:42:35] * hashar nods [14:42:46] do as you want, I was about to leave for an appointment anyway ;) [14:42:51] Ack. [14:43:00] I felet that one could be merged right now so the person doesn't have to wait next week :b [14:43:48] and I think I will eventually get rid of tox and offer to migrate to `nox` but E_NOT_ENOUGH_TIME [14:43:52] anyway week-end time!!!! [14:44:00] (03PS5) 10Jforrester: Zuul: [labs/tools/wdaudiolex-be] Install tox CI [integration/config] - 10https://gerrit.wikimedia.org/r/1343085 (owner: 10Wandji collins) [14:44:09] (03CR) 10Jforrester: [C:03+2] Zuul: [labs/tools/wdaudiolex-be] Install tox CI [integration/config] - 10https://gerrit.wikimedia.org/r/1343085 (owner: 10Wandji collins) [14:44:18] thx! [14:44:20] πŸŽ‰ [14:45:28] 06Release-Engineering-Team (Doing 😎), 10Catalyst, 10QS-Test-Automation, 07Essential-Work: Investigate retry mechanism for catalyst provisioning error - https://phabricator.wikimedia.org/T437955#12338618 (10jnuche) a:03jnuche >>! In T437955#12324428, @thcipriani wrote: > Looking closely at the error logs... [14:45:56] (03Merged) 10jenkins-bot: Zuul: [labs/tools/wdaudiolex-be] Install tox CI [integration/config] - 10https://gerrit.wikimedia.org/r/1343085 (owner: 10Wandji collins) [14:46:07] 06Release-Engineering-Team (Doing 😎), 10QS-Test-Automation, 10Catalyst (Luka Ijo Pimeja Jan), 07Essential-Work: Investigate retry mechanism for catalyst provisioning error - https://phabricator.wikimedia.org/T437955#12338644 (10jnuche) [14:46:21] !log Zuul: [labs/tools/wdaudiolex-be] Install tox CI [14:46:22] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [14:49:39] (03PS1) 10Phedenskog: Add timeout for npm ci [integration/quibble] - 10https://gerrit.wikimedia.org/r/1343093 (https://phabricator.wikimedia.org/T438492) [14:55:02] (03PS1) 10Jforrester: Zuul: Move repos to the generic tox job except where they need something special [integration/config] - 10https://gerrit.wikimedia.org/r/1343095 [14:55:02] (03PS1) 10Jforrester: jjb: Drop bespoke tox jobs that added nothing except a queue, now unused [integration/config] - 10https://gerrit.wikimedia.org/r/1343096 [15:14:48] (03PS1) 10Jforrester: jjb: Provide tox-mysqld job to share between repos [integration/config] - 10https://gerrit.wikimedia.org/r/1343103 [15:14:48] (03PS1) 10Jforrester: Zuul: Use tox-mysqld over bespokes [integration/config] - 10https://gerrit.wikimedia.org/r/1343104 [15:14:49] (03PS1) 10Jforrester: jjb: Drop equivalents to tox-mysqld, now unused [integration/config] - 10https://gerrit.wikimedia.org/r/1343105 [15:16:15] (03PS1) 10Jforrester: Zuul: Don't run wikibase-selenium-gate on wmf/ branches [integration/config] - 10https://gerrit.wikimedia.org/r/1343106 [15:16:26] (03CR) 10Jforrester: [C:03+2] Zuul: Don't run wikibase-selenium-gate on wmf/ branches [integration/config] - 10https://gerrit.wikimedia.org/r/1343106 (owner: 10Jforrester) [15:18:01] (03Merged) 10jenkins-bot: Zuul: Don't run wikibase-selenium-gate on wmf/ branches [integration/config] - 10https://gerrit.wikimedia.org/r/1343106 (owner: 10Jforrester) [15:22:35] (03PS1) 10Jforrester: Revert "Zuul: Remaining Node 24 -> 26 migrations" [integration/config] - 10https://gerrit.wikimedia.org/r/1343110 (https://phabricator.wikimedia.org/T438085) [15:22:36] (03PS1) 10Jforrester: Revert "Zuul: Migrate MediaWiki-land independent CI Node from 24 to 26" [integration/config] - 10https://gerrit.wikimedia.org/r/1343111 (https://phabricator.wikimedia.org/T438085) [15:22:42] (03CR) 10Jforrester: [C:03+2] Revert "Zuul: Remaining Node 24 -> 26 migrations" [integration/config] - 10https://gerrit.wikimedia.org/r/1343110 (https://phabricator.wikimedia.org/T438085) (owner: 10Jforrester) [15:22:48] (03CR) 10Jforrester: [C:03+2] Revert "Zuul: Migrate MediaWiki-land independent CI Node from 24 to 26" [integration/config] - 10https://gerrit.wikimedia.org/r/1343111 (https://phabricator.wikimedia.org/T438085) (owner: 10Jforrester) [15:23:02] (03PS2) 10Jforrester: Revert "Zuul: Remaining Node 24 -> 26 migrations" [integration/config] - 10https://gerrit.wikimedia.org/r/1343110 (https://phabricator.wikimedia.org/T438085) [15:23:08] (03CR) 10Jforrester: "…" [integration/config] - 10https://gerrit.wikimedia.org/r/1343110 (https://phabricator.wikimedia.org/T438085) (owner: 10Jforrester) [15:23:10] (03CR) 10CI reject: [V:04-1] Revert "Zuul: Migrate MediaWiki-land independent CI Node from 24 to 26" [integration/config] - 10https://gerrit.wikimedia.org/r/1343111 (https://phabricator.wikimedia.org/T438085) (owner: 10Jforrester) [15:23:16] (03PS2) 10Jforrester: Revert "Zuul: Migrate MediaWiki-land independent CI Node from 24 to 26" [integration/config] - 10https://gerrit.wikimedia.org/r/1343111 (https://phabricator.wikimedia.org/T438085) [15:23:22] (03CR) 10Jforrester: "…" [integration/config] - 10https://gerrit.wikimedia.org/r/1343111 (https://phabricator.wikimedia.org/T438085) (owner: 10Jforrester) [15:23:27] (03PS3) 10Jforrester: Revert "Zuul: Migrate MediaWiki-land independent CI Node from 24 to 26" [integration/config] - 10https://gerrit.wikimedia.org/r/1343111 (https://phabricator.wikimedia.org/T438085) [15:23:29] (03CR) 10Jforrester: "…" [integration/config] - 10https://gerrit.wikimedia.org/r/1343111 (https://phabricator.wikimedia.org/T438085) (owner: 10Jforrester) [15:24:14] (03CR) 10jenkins-bot: Revert "Zuul: Migrate MediaWiki-land independent CI Node from 24 to 26" [integration/config] - 10https://gerrit.wikimedia.org/r/1343111 (https://phabricator.wikimedia.org/T438085) (owner: 10Jforrester) [15:24:42] (03Merged) 10jenkins-bot: Revert "Zuul: Remaining Node 24 -> 26 migrations" [integration/config] - 10https://gerrit.wikimedia.org/r/1343110 (https://phabricator.wikimedia.org/T438085) (owner: 10Jforrester) [15:24:57] (03Merged) 10jenkins-bot: Revert "Zuul: Migrate MediaWiki-land independent CI Node from 24 to 26" [integration/config] - 10https://gerrit.wikimedia.org/r/1343111 (https://phabricator.wikimedia.org/T438085) (owner: 10Jforrester) [15:25:51] Hi releng folks, does anyone here have a recommendation for how to mock values provided to a virtual config.json file (Generated by ResourceLoader) in a QUnit test? Adding the config in QUnit.newMwEnvironment doesn't seem to override the pseudo-file injected by mw.loader.impl at page load time [15:27:15] !log CI Node reverted to 24. [15:27:16] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [15:34:15] Sorry, never mind, using 'require' at the head of the file means it will only ever be pulled in once and not on every test. I'll just attach the config to somewhere accessible so I can overwrite it per test [15:51:44] 10Continuous-Integration-Infrastructure (Zuul upgrade), 06Collaboration-Services: Back up Zuul encryption keys - https://phabricator.wikimedia.org/T436131#12338963 (10LSobanski) p:05Triageβ†’03Medium [15:56:42] 06Release-Engineering-Team (Priority Backlog πŸ“₯), 10MediaWiki-extensions-DonationInterface, 06Moderator-Tools-Team, 10PersonalDashboard, and 7 others: Noisy log: normalized_message: ResourceLoader duplicate registration warning. Another module has already b... - https://phabricator.wikimedia.org/T438387#12338982 [15:56:43] (03CR) 10Wandji collins: "So this is no longer needed if I understand correctly?" [integration/config] - 10https://gerrit.wikimedia.org/r/1343079 (owner: 10Wandji collins) [15:58:16] (03PS2) 10Pwangai: Recover from an npm cache that has lost files [integration/quibble] - 10https://gerrit.wikimedia.org/r/1342828 (https://phabricator.wikimedia.org/T438206) [15:59:27] (03CR) 10Pwangai: Recover from an npm cache that has lost files (031 comment) [integration/quibble] - 10https://gerrit.wikimedia.org/r/1342828 (https://phabricator.wikimedia.org/T438206) (owner: 10Pwangai) [16:03:32] 06Release-Engineering-Team (Priority Backlog πŸ“₯), 10MediaWiki-extensions-DonationInterface, 06Moderator-Tools-Team, 10PersonalDashboard, and 8 others: Noisy log: normalized_message: ResourceLoader duplicate registration warning. Another module has already b... - https://phabricator.wikimedia.org/T438387#12339035 [16:06:04] (03PS1) 10Jforrester: Revert "jjb: Update Node from 24.18.0 to 26.8.2 for Quibble jobs" [integration/config] - 10https://gerrit.wikimedia.org/r/1343120 (https://phabricator.wikimedia.org/T438085) [16:06:27] (03CR) 10Jforrester: [C:03+2] Revert "jjb: Update Node from 24.18.0 to 26.8.2 for Quibble jobs" [integration/config] - 10https://gerrit.wikimedia.org/r/1343120 (https://phabricator.wikimedia.org/T438085) (owner: 10Jforrester) [16:08:08] (03CR) 10Pwangai: "Acknowledged" [integration/quibble] - 10https://gerrit.wikimedia.org/r/1342828 (https://phabricator.wikimedia.org/T438206) (owner: 10Pwangai) [16:08:24] (03Merged) 10jenkins-bot: Revert "jjb: Update Node from 24.18.0 to 26.8.2 for Quibble jobs" [integration/config] - 10https://gerrit.wikimedia.org/r/1343120 (https://phabricator.wikimedia.org/T438085) (owner: 10Jforrester) [16:09:21] 06Release-Engineering-Team (Priority Backlog πŸ“₯), 10MediaWiki-extensions-DonationInterface, 06Moderator-Tools-Team, 10PersonalDashboard, and 8 others: Noisy log: normalized_message: ResourceLoader duplicate registration warning. Another module has already b... - https://phabricator.wikimedia.org/T438387#12339061 [16:14:42] 06Release-Engineering-Team (Priority Backlog πŸ“₯), 10MediaWiki-extensions-DonationInterface, 06Moderator-Tools-Team, 10PersonalDashboard, and 8 others: Noisy log: normalized_message: ResourceLoader duplicate registration warning. Another module has already b... - https://phabricator.wikimedia.org/T438387#12339084 [16:18:52] 06Release-Engineering-Team (Priority Backlog πŸ“₯), 10MediaWiki-extensions-DonationInterface, 06Moderator-Tools-Team, 10PersonalDashboard, and 8 others: Noisy log: normalized_message: ResourceLoader duplicate registration warning. Another module has already b... - https://phabricator.wikimedia.org/T438387#12339099 [16:28:17] (03CR) 10Jforrester: "Sorry, yes, over-taken by the other patch. You should be all set." [integration/config] - 10https://gerrit.wikimedia.org/r/1343079 (owner: 10Wandji collins) [16:28:20] (03Abandoned) 10Jforrester: jjb: Provide labs-tools-wdaudiolex-be [integration/config] - 10https://gerrit.wikimedia.org/r/1343079 (owner: 10Wandji collins) [16:32:06] 06Release-Engineering-Team (Priority Backlog πŸ“₯), 10MediaWiki-extensions-DonationInterface, 06Moderator-Tools-Team, 10PersonalDashboard, and 8 others: Noisy log: normalized_message: ResourceLoader duplicate registration warning. Another module has already b... - https://phabricator.wikimedia.org/T438387#12339152 [16:52:04] (03CR) 10Wandji collins: "Done" [integration/config] - 10https://gerrit.wikimedia.org/r/1288021 (owner: 10Wandji collins) [16:57:50] 06Release-Engineering-Team (Priority Backlog πŸ“₯), 10MediaWiki-extensions-DonationInterface, 06Moderator-Tools-Team, 10PersonalDashboard, and 8 others: Noisy log: normalized_message: ResourceLoader duplicate registration warning. Another module has already b... - https://phabricator.wikimedia.org/T438387#12339276 [16:58:42] 06Release-Engineering-Team (Priority Backlog πŸ“₯), 10MediaWiki-extensions-DonationInterface, 06Moderator-Tools-Team, 10PersonalDashboard, and 6 others: Noisy log: normalized_message: ResourceLoader duplicate registration warning. Another module has already b... - https://phabricator.wikimedia.org/T438387#12339278 [17:20:07] I need an emergency deploy for https://gerrit.wikimedia.org/r/c/1343126 -- context is T438387, are SRE ok with a deployment? (cc: thcipriani: herron: not sure who the train conductor is) I can deploy. [17:20:07] T438387: Noisy log: normalized_message: ResourceLoader duplicate registration warning. Another module has already been registered as vue-router - https://phabricator.wikimedia.org/T438387 [17:21:17] * thcipriani looks [17:24:14] JSherman: I'm aware of that one, and deploy is ok with me. Coordinate with SRE on call (herron is not in this channel, so check in -operations) [17:25:09] thcipriani: ack, wilco, thanks! [17:57:50] (03open) 10akhatun: Add linked artifact lambdas repo [repos/releng/gitlab-trusted-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-trusted-runner/-/merge_requests/191 [18:23:25] (03PS1) 10Hashar: tox: update flake8 4.0.1..7.3.0 [integration/config] - 10https://gerrit.wikimedia.org/r/1343137 [19:38:04] FIRING: PuppetAgentStaleLastRun: Last Puppet run was over 24 hours ago on instance deployment-mwmaint03 in project deployment-prep - https://prometheus-alerts.wmcloud.org/?q=alertname%3DPuppetAgentStaleLastRun [19:55:22] 06Release-Engineering-Team (Priority Backlog πŸ“₯), 10MediaWiki-extensions-DonationInterface, 06Moderator-Tools-Team, 10PersonalDashboard, and 7 others: Noisy log: normalized_message: ResourceLoader duplicate registration warning. Another module has already b... - https://phabricator.wikimedia.org/T438387#12340240 [20:09:50] (03PS1) 10Vaughn Walters: jjb: [catalyst-daily-Cargo] Add Cargo job [integration/config] - 10https://gerrit.wikimedia.org/r/1343149 (https://phabricator.wikimedia.org/T433071) [20:15:15] (03CR) 10Vaughn Walters: [C:03+2] jjb: [catalyst-daily-Cargo] Add Cargo job [integration/config] - 10https://gerrit.wikimedia.org/r/1343149 (https://phabricator.wikimedia.org/T433071) (owner: 10Vaughn Walters) [20:16:56] (03Merged) 10jenkins-bot: jjb: [catalyst-daily-Cargo] Add Cargo job [integration/config] - 10https://gerrit.wikimedia.org/r/1343149 (https://phabricator.wikimedia.org/T433071) (owner: 10Vaughn Walters) [20:40:40] (03PS1) 10Vaughn Walters: jjb: [catalyst-daily-CommunityRequests] Add CommunityRequests job [integration/config] - 10https://gerrit.wikimedia.org/r/1343153 (https://phabricator.wikimedia.org/T433076) [20:42:25] (03Merged) 10jenkins-bot: jjb: [catalyst-daily-CommunityRequests] Add CommunityRequests job [integration/config] - 10https://gerrit.wikimedia.org/r/1343153 (https://phabricator.wikimedia.org/T433076) (owner: 10Vaughn Walters) [21:28:26] (03PS1) 10Vaughn Walters: jjb: [catalyst-daily-examples] Add examples job [integration/config] - 10https://gerrit.wikimedia.org/r/1343166 (https://phabricator.wikimedia.org/T433080) [21:28:36] (03CR) 10Vaughn Walters: [V:03+2 C:03+2] jjb: [catalyst-daily-examples] Add examples job [integration/config] - 10https://gerrit.wikimedia.org/r/1343166 (https://phabricator.wikimedia.org/T433080) (owner: 10Vaughn Walters) [21:29:56] (03Merged) 10jenkins-bot: jjb: [catalyst-daily-examples] Add examples job [integration/config] - 10https://gerrit.wikimedia.org/r/1343166 (https://phabricator.wikimedia.org/T433080) (owner: 10Vaughn Walters) [22:08:43] 10Scap: Scap's logstash checker for channels outside "error" and "exception" - https://phabricator.wikimedia.org/T438570 (10thcipriani) 03NEW [22:09:48] 06Release-Engineering-Team (Priority Backlog πŸ“₯), 10MediaWiki-extensions-DonationInterface, 06Moderator-Tools-Team, 10PersonalDashboard, and 7 others: Noisy log: normalized_message: ResourceLoader duplicate registration warning. Another module has already b... - https://phabricator.wikimedia.org/T438387#12340850