[00:10:51] (03PS1) 10Ahmon Dancy: bin/scap: Move SCAP_SRC to the front of sys.path [tools/scap] - 10https://gerrit.wikimedia.org/r/767258 [00:23:48] (03CR) 10Thcipriani: [C: 03+2] bin/scap: Move SCAP_SRC to the front of sys.path [tools/scap] - 10https://gerrit.wikimedia.org/r/767258 (owner: 10Ahmon Dancy) [00:24:28] (03Merged) 10jenkins-bot: bin/scap: Move SCAP_SRC to the front of sys.path [tools/scap] - 10https://gerrit.wikimedia.org/r/767258 (owner: 10Ahmon Dancy) [04:12:32] 10Phabricator: Add project-filtering to the Token Leader Board - https://phabricator.wikimedia.org/T302850 (10Samwilson) [07:04:41] 10Phabricator (Upstream): Add project-filtering to the Token Leader Board - https://phabricator.wikimedia.org/T302850 (10Peachey88) [07:10:39] 10Release-Engineering-Team, 10Scap, 10serviceops: Deploy Scap version 4.4.1 - https://phabricator.wikimedia.org/T302464 (10Joe) 05In progress→03Resolved [07:10:42] 10Release-Engineering-Team (Done by Feb 23🔥), 10MW-on-K8s, 10serviceops, 10Patch-For-Review: Build MediaWiki images for kubernetes on the deployment servers - https://phabricator.wikimedia.org/T297673 (10Joe) [08:10:22] 10GitLab (Infrastructure), 10serviceops, 10Patch-For-Review: Migrate gitlab-test instance to puppet - https://phabricator.wikimedia.org/T297411 (10Jelto) [08:10:43] 10GitLab (Infrastructure), 10Cloud-VPS (Project-requests): Create additional network port in project devtools - https://phabricator.wikimedia.org/T302803 (10Jelto) 05Resolved→03Open Thanks a lot for setting up the additional port! I can confirm that the port is present in Horizon Interface. However the po... [08:27:29] 10GitLab (Infrastructure), 10Cloud-VPS (Project-requests): Create additional network port in project devtools - https://phabricator.wikimedia.org/T302803 (10Majavah) >>! In T302803#7746425, @Jelto wrote: > However the port is marked as down and is not associated with the instance `gitlab-prod-1001`. Right. I... [08:30:25] (03PS6) 10Kosta Harlan: dockerfiles: Install memcached and php-memcached for Quibble [integration/config] - 10https://gerrit.wikimedia.org/r/757867 (https://phabricator.wikimedia.org/T300340) [08:33:26] (03PS7) 10Kosta Harlan: dockerfiles: Install memcached and php-memcached for Quibble [integration/config] - 10https://gerrit.wikimedia.org/r/757867 (https://phabricator.wikimedia.org/T300340) [08:37:49] (03PS8) 10Kosta Harlan: dockerfiles: Install memcached and php-memcached for Quibble [integration/config] - 10https://gerrit.wikimedia.org/r/757867 (https://phabricator.wikimedia.org/T300340) [08:52:04] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Doing), 10Zuul, 10Patch-For-Review: "systemctl restart zuul" does not gracefully restart Zuul scheduler - https://phabricator.wikimedia.org/T257040 (10hashar) I had to revert the patch that emits SIGUSR1, when testing it against zuul-merg... [08:53:56] 10GitLab (Infrastructure), 10serviceops, 10Patch-For-Review: Migrate gitlab-test instance to puppet - https://phabricator.wikimedia.org/T297411 (10Jelto) [08:54:12] 10GitLab (Infrastructure), 10Cloud-VPS (Project-requests): Create additional network port in project devtools - https://phabricator.wikimedia.org/T302803 (10Jelto) 05Open→03Resolved The keepalived VIP configuration was not clear for me from looking at the horizon interface. I configured the additional IP... [09:06:06] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Doing), 10Zuul, 10Patch-For-Review: "systemctl restart zuul" does not gracefully restart Zuul scheduler - https://phabricator.wikimedia.org/T257040 (10hashar) 05Open→03Declined Zuul will remain stopping, I dont' think there is much po... [09:54:16] (03PS11) 10Jaime Nuche: cli config args: passthrough to local `scap` subprocess calls [tools/scap] - 10https://gerrit.wikimedia.org/r/767084 (https://phabricator.wikimedia.org/T302487) [09:55:40] (03CR) 10jerkins-bot: [V: 04-1] cli config args: passthrough to local `scap` subprocess calls [tools/scap] - 10https://gerrit.wikimedia.org/r/767084 (https://phabricator.wikimedia.org/T302487) (owner: 10Jaime Nuche) [10:02:59] (03PS12) 10Jaime Nuche: cli config args: passthrough to local `scap` subprocess calls [tools/scap] - 10https://gerrit.wikimedia.org/r/767084 (https://phabricator.wikimedia.org/T302487) [10:08:02] (03CR) 10Jaime Nuche: [C: 04-2] cli config args: passthrough to local `scap` subprocess calls [tools/scap] - 10https://gerrit.wikimedia.org/r/767084 (https://phabricator.wikimedia.org/T302487) (owner: 10Jaime Nuche) [10:12:33] (03CR) 10Jaime Nuche: [C: 04-2] cli config args: passthrough to local `scap` subprocess calls (031 comment) [tools/scap] - 10https://gerrit.wikimedia.org/r/767084 (https://phabricator.wikimedia.org/T302487) (owner: 10Jaime Nuche) [10:19:21] 10GitLab (Infrastructure), 10serviceops, 10Patch-For-Review: Migrate gitlab-test instance to puppet - https://phabricator.wikimedia.org/T297411 (10Jelto) With the help of @Majavah the correct configuration of private and public/floating IP was found. https and cloning over SSH works now. Thanks again! The t... [10:30:54] (03PS13) 10Jaime Nuche: cli config args: passthrough to local `scap` subprocess calls [tools/scap] - 10https://gerrit.wikimedia.org/r/767084 (https://phabricator.wikimedia.org/T302487) [10:33:50] (03CR) 10Kosta Harlan: "The images build, but in retrospect, we should probably wait for 1.4.1 since quibble 1.4.0 can't be deployed due to T302226" [integration/config] - 10https://gerrit.wikimedia.org/r/757867 (https://phabricator.wikimedia.org/T300340) (owner: 10Kosta Harlan) [10:38:14] (03CR) 10Jaime Nuche: cli config args: passthrough to local `scap` subprocess calls (034 comments) [tools/scap] - 10https://gerrit.wikimedia.org/r/767084 (https://phabricator.wikimedia.org/T302487) (owner: 10Jaime Nuche) [10:38:30] 10Project-Admins, 10SRE, 10Kubernetes: Document what #discovery-system is - https://phabricator.wikimedia.org/T282948 (10Aklapper) [10:43:09] 10Phabricator (Upstream), 10Upstream: Add project-filtering to the Token Leader Board - https://phabricator.wikimedia.org/T302850 (10Aklapper) p:05Triage→03Lowest Tokens don't have any clear meaning and I don't see a use case in this task... What would this be used for? [10:43:20] 10Phabricator (Upstream), 10Upstream: Add project-filtering to the Token Leader Board - https://phabricator.wikimedia.org/T302850 (10Aklapper) [10:55:51] 10Beta-Cluster-Infrastructure, 10SRE, 10Traffic, 10Beta-Cluster-reproducible: Beta cluster down: Error: 502, Next Hop Connection Failed (Feb 2022) - https://phabricator.wikimedia.org/T302699 (10JMeybohm) p:05Triage→03Medium deployment-mediawiki11 has been replaced by deployment-mediawiki12 (although th... [11:06:26] 10Beta-Cluster-Infrastructure, 10SRE, 10Traffic, 10Beta-Cluster-reproducible: Beta cluster down: Error: 502, Next Hop Connection Failed (Feb 2022) - https://phabricator.wikimedia.org/T302699 (10Vgutierrez) hmm if that's the case horizon data for deployment-prep-cache needs to be updated as well cause right... [11:21:46] 10Beta-Cluster-Infrastructure, 10SRE, 10Traffic, 10Beta-Cluster-reproducible: Beta cluster down: Error: 502, Next Hop Connection Failed (Feb 2022) - https://phabricator.wikimedia.org/T302699 (10JMeybohm) I was really just relaying from T300525 but it looks like something is off. deployment-mediawiki11 was... [11:37:00] 10Beta-Cluster-Infrastructure, 10SRE, 10Traffic, 10Beta-Cluster-reproducible: Beta cluster down: Error: 502, Next Hop Connection Failed (Feb 2022) - https://phabricator.wikimedia.org/T302699 (10Majavah) >>! In T302699#7746972, @JMeybohm wrote: > I was really just relaying from T300525 but it looks like som... [12:44:04] (03PS1) 10Krinkle: zuul: Install MobileFrontend when testing Echo [integration/config] - 10https://gerrit.wikimedia.org/r/767493 (https://phabricator.wikimedia.org/T299780) [14:32:11] 10Gerrit, 10Upstream: Gerrit should feature customizable message on Login page (No 'Forgot password' link in the gerrit login page.) - https://phabricator.wikimedia.org/T60205 (10hashar) 05Open→03Resolved Thank you @Dzahn [14:33:53] 10Continuous-Integration-Infrastructure, 10MinervaNeue, 10Vector, 10Accessibility, and 3 others: Add automated accessibility tests in CI to generate accessibility benchmarks for Skins - https://phabricator.wikimedia.org/T301184 (10zeljkofilipin) > Patch in MinervaNeue: https://gerrit.wikimedia.org/r/c/medi... [14:45:59] 10Release-Engineering-Team (Doing), 10GerritBot, 10Developer Productivity, 10Patch-For-Review, 10Regression: Gerritbot turns "+" into space, thus breaking most Gerrit URLs - https://phabricator.wikimedia.org/T280197 (10hashar) 05Resolved→03Open Reopening since `escapedSubject` cause double quotes to... [14:52:32] (03CR) 10Krinkle: [C: 03+2] "Let's see if stuff breaks with this applied. Keeping revert hammer handy..." [integration/config] - 10https://gerrit.wikimedia.org/r/767493 (https://phabricator.wikimedia.org/T299780) (owner: 10Krinkle) [14:53:05] hashar: thanks for going through old tasks recently. Helps a lot with clarity and direction :) [14:54:21] (03Merged) 10jenkins-bot: zuul: Install MobileFrontend when testing Echo [integration/config] - 10https://gerrit.wikimedia.org/r/767493 (https://phabricator.wikimedia.org/T299780) (owner: 10Krinkle) [15:04:09] !log resolve merge conflicts on deployment-puppetmaster04 [15:04:10] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [15:27:43] !log Reloading Zuul to deploy https://gerrit.wikimedia.org/r/767493 [15:27:44] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [15:27:47] Thanks taavi :) [15:39:12] Krinkle: I went on trying to flush the tasks from #gerrit [15:39:38] but I don't feel very productive going through all those old tasks :-| I am glad you appreciate the effort, that is encouraging! [15:41:50] 10Release-Engineering-Team, 10Scap, 10serviceops: Deploy Scap version 4.4.1 - https://phabricator.wikimedia.org/T302464 (10dancy) Thanks @Joe ! [15:42:21] Hey hashar! [15:43:08] good morning! [15:50:50] (03CR) 10Ahmon Dancy: [C: 03+2] cli config args: passthrough to local `scap` subprocess calls [tools/scap] - 10https://gerrit.wikimedia.org/r/767084 (https://phabricator.wikimedia.org/T302487) (owner: 10Jaime Nuche) [15:51:33] (03Merged) 10jenkins-bot: cli config args: passthrough to local `scap` subprocess calls [tools/scap] - 10https://gerrit.wikimedia.org/r/767084 (https://phabricator.wikimedia.org/T302487) (owner: 10Jaime Nuche) [15:56:04] !log Updating scap to 4.4.1-1+0~20220302155149.192~1.gbpe351d6 in beta [15:56:05] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [16:22:40] 10Release-Engineering-Team (Done by Feb 23 🧟), 10MW-on-K8s, 10serviceops, 10Patch-For-Review: Build MediaWiki images for kubernetes on the deployment servers - https://phabricator.wikimedia.org/T297673 (10dancy) [16:24:33] 10Release-Engineering-Team (Doing), 10Scap: Preserve supplied command-line config in local Scap subprocess calls - https://phabricator.wikimedia.org/T302487 (10jnuche) 05In progress→03Resolved [16:25:16] 10Scap: Preserve supplied command-line config in local Scap subprocess calls - https://phabricator.wikimedia.org/T302487 (10jnuche) [16:25:55] 10Release-Engineering-Team, 10Scap, 10MW-on-K8s, 10serviceops: Deploy MediaWiki images for kubernetes from the deployment servers - https://phabricator.wikimedia.org/T302539 (10dancy) [16:28:18] 10GitLab (Project Migration), 10Release-Engineering-Team (Done by Feb 23 🧟): Create new GitLab project group: search-platform - https://phabricator.wikimedia.org/T301444 (10brennen) 05Open→03Resolved a:03brennen **Actions taken:** - created https://gitlab.wikimedia.org/repos/search-platform - create... [17:09:31] (03CR) 10Jeena Huneidi: [C: 03+2] Scap backport: legacy deployment [tools/scap] - 10https://gerrit.wikimedia.org/r/764910 (https://phabricator.wikimedia.org/T294466) (owner: 10Jeena Huneidi) [17:12:12] (03Merged) 10jenkins-bot: Scap backport: legacy deployment [tools/scap] - 10https://gerrit.wikimedia.org/r/764910 (https://phabricator.wikimedia.org/T294466) (owner: 10Jeena Huneidi) [17:20:33] kostajh: two minor changes to fix qunit warnings from Echo, if you have a minute :) https://gerrit.wikimedia.org/r/c/mediawiki/extensions/Echo/+/767255/3 [17:29:37] 10Project-Admins, 10User-TheresNoTime: Create project tag for ipfs - https://phabricator.wikimedia.org/T302890 (10TheresNoTime) [17:33:08] Project beta-code-update-eqiad build #382066: 04FAILURE in 1.7 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/382066/ [17:42:24] dancy: looks like the new scap cause a race condition when updating the git repos on deployment-prep [17:42:42] beta-code-update-eqiad now upates operations/mediawiki-config I am guessing as a submodule [17:43:00] but we have a postmerge job configured on that repo which fetch & checkout whatever has been merged [17:43:15] I haven't investigatedtoo far though, that is a theory [17:43:20] Yippee, build fixed! [17:43:21] Project beta-code-update-eqiad build #382067: 09FIXED in 1 min 49 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/382067/ [17:43:35] if we have mediawiki-config updated as part of the rest of the code, we should probably drop the postmerge bot from mediawiki-config [17:51:58] * dancy reads [17:52:55] I see. I was wondering about that failure as well. So two things were operating on the repo at the same time? [17:53:11] yeah, I think the postmerge operation can be removed. [17:56:18] and/or I can add some interlock in `scap prep auto`. [17:56:38] I'll do that since it's probably a good idea anyway. [17:56:48] that is what I am thinking [17:56:52] git reflog might have some details [17:57:08] then if the code update job and the new scap auto update mediawiki-config, we can just drop the postmerge [17:57:43] and maybe announce the change somewhere, I think people might rely on the postmerge job reporting back on the gerrit change as a way to confirm beta config got updated [17:59:46] I'll make the change in scap so that people can still rely on that behavior. [18:01:39] 10MediaWiki-Releasing, 10MW-1.38-release: Release MW 1.38.0 - https://phabricator.wikimedia.org/T302893 (10Jdforrester-WMF) [18:17:14] 10Release-Engineering-Team (Doing), 10GerritBot, 10Developer Productivity, 10Patch-For-Review, 10Regression: Gerritbot turns "+" into space, thus breaking most Gerrit URLs - https://phabricator.wikimedia.org/T280197 (10hashar) 05Open→03Resolved Got tested on T281552#7748235 :] [19:04:55] (03PS1) 10QChris: Allow “Gerrit Managers” to import history [wikidata/propertysuggester/RecommenderServer] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/767567 [19:04:58] (03CR) 10QChris: [V: 03+2 C: 03+2] Allow “Gerrit Managers” to import history [wikidata/propertysuggester/RecommenderServer] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/767567 (owner: 10QChris) [19:10:49] (03PS1) 10QChris: Import done. Revoke import grants [wikidata/propertysuggester/RecommenderServer] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/767568 [19:10:59] (03CR) 10QChris: [V: 03+2 C: 03+2] Import done. Revoke import grants [wikidata/propertysuggester/RecommenderServer] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/767568 (owner: 10QChris) [19:15:04] 10Release-Engineering-Team, 10Scap: Add lock to scap prep - https://phabricator.wikimedia.org/T302905 (10dancy) [19:15:30] Project beta-code-update-eqiad build #382077: 04FAILURE in 2 min 30 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/382077/ [19:15:30] Project beta-mediawiki-config-update-eqiad build #216: 04FAILURE in 2 min 43 sec: https://integration.wikimedia.org/ci/job/beta-mediawiki-config-update-eqiad/216/ [19:20:32] 10MediaWiki-Releasing, 10MW-1.38-release: Announce 1.38 forthcoming "pencils down" and likely timeline to wikitech-l etc. - https://phabricator.wikimedia.org/T302906 (10Jdforrester-WMF) [19:21:03] 10Release-Engineering-Team, 10Scap: Add lock to scap prep - https://phabricator.wikimedia.org/T302905 (10dancy) [19:23:28] 10Continuous-Integration-Config, 10MW-1.38-release: Configure CI to support REL1_38 - https://phabricator.wikimedia.org/T302908 (10Jdforrester-WMF) [19:24:31] 10MediaWiki-Releasing, 10MW-1.38-release: Branch REL1_38 for MediaWiki and all extensions and skins - https://phabricator.wikimedia.org/T302909 (10Jdforrester-WMF) [19:24:37] 10MediaWiki-Releasing, 10MW-1.38-release: Branch REL1_38 for MediaWiki and all extensions and skins - https://phabricator.wikimedia.org/T302909 (10Jdforrester-WMF) [19:25:05] Yippee, build fixed! [19:25:06] Project beta-code-update-eqiad build #382078: 09FIXED in 2 min 5 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/382078/ [19:25:29] 10MediaWiki-Releasing, 10Documentation, 10MW-1.38-notes, 10MW-1.38-release: Finish up RELEASE-NOTES for 1.38.0 - https://phabricator.wikimedia.org/T302911 (10Jdforrester-WMF) [19:26:07] 10MediaWiki-Releasing, 10MW-1.38-release: Release 1.38.0-rc.0 - https://phabricator.wikimedia.org/T302912 (10Jdforrester-WMF) [19:28:54] 10MediaWiki-Releasing, 10MW-1.38-release: Write release announcement for 1.38.0-rc.0 - https://phabricator.wikimedia.org/T302913 (10Jdforrester-WMF) [19:29:20] 10MediaWiki-Releasing, 10MW-1.38-release: Write and send release announcement for 1.38.0 - https://phabricator.wikimedia.org/T302914 (10Jdforrester-WMF) [19:43:18] (03PS1) 10Jforrester: Zuul: Configure CI for the forthcoming REL1_38 branches [integration/config] - 10https://gerrit.wikimedia.org/r/767572 (https://phabricator.wikimedia.org/T302908) [19:43:20] (03PS1) 10Jforrester: jjb: [mediawiki-php-security] and [quibble-integration] Add REL1_38 branch [integration/config] - 10https://gerrit.wikimedia.org/r/767573 (https://phabricator.wikimedia.org/T302908) [19:45:07] 10Release-Engineering-Team (Next), 10tech-decision-forum, 10Code-Stewardship-Reviews, 10Documentation: Document checklist steps to undeploy / sunset a codebase on WMF servers (not: archiving) - https://phabricator.wikimedia.org/T294329 (10Aklapper) [19:45:39] 10Release-Engineering-Team (Next), 10tech-decision-forum, 10Code-Stewardship-Reviews, 10Documentation: Document checklist steps to undeploy / sunset a codebase on WMF servers (not: archiving) - https://phabricator.wikimedia.org/T294329 (10Aklapper) I've copied some intransparent access-restricted Google Do... [19:47:22] (03PS1) 10Ahmon Dancy: Don't exclude master hosts from sync-apaches phase [tools/scap] - 10https://gerrit.wikimedia.org/r/767575 [19:50:12] (03CR) 10Dzahn: [C: 03+2] Don't exclude master hosts from sync-apaches phase [tools/scap] - 10https://gerrit.wikimedia.org/r/767575 (owner: 10Ahmon Dancy) [19:50:34] (03CR) 10Jforrester: [C: 03+2] Zuul: Configure CI for the forthcoming REL1_38 branches [integration/config] - 10https://gerrit.wikimedia.org/r/767572 (https://phabricator.wikimedia.org/T302908) (owner: 10Jforrester) [19:50:55] (03Merged) 10jenkins-bot: Don't exclude master hosts from sync-apaches phase [tools/scap] - 10https://gerrit.wikimedia.org/r/767575 (owner: 10Ahmon Dancy) [19:52:23] (03Merged) 10jenkins-bot: Zuul: Configure CI for the forthcoming REL1_38 branches [integration/config] - 10https://gerrit.wikimedia.org/r/767572 (https://phabricator.wikimedia.org/T302908) (owner: 10Jforrester) [19:53:35] !log Zuul: Configure CI for the forthcoming REL1_38 branches for T302908 [19:53:38] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [19:53:41] T302908: Configure CI to support REL1_38 - https://phabricator.wikimedia.org/T302908 [19:54:33] (03CR) 10Jforrester: [C: 03+2] "Deployed." [integration/config] - 10https://gerrit.wikimedia.org/r/767573 (https://phabricator.wikimedia.org/T302908) (owner: 10Jforrester) [19:55:40] 10MediaWiki-Releasing, 10MW-1.38-release: Release MW 1.38.0 - https://phabricator.wikimedia.org/T302893 (10Jdforrester-WMF) [19:56:01] 10Continuous-Integration-Config, 10MW-1.38-release, 10Patch-For-Review: Configure CI to support REL1_38 - https://phabricator.wikimedia.org/T302908 (10Jdforrester-WMF) 05Open→03Resolved a:03Jdforrester-WMF [19:56:16] (03Merged) 10jenkins-bot: jjb: [mediawiki-php-security] and [quibble-integration] Add REL1_38 branch [integration/config] - 10https://gerrit.wikimedia.org/r/767573 (https://phabricator.wikimedia.org/T302908) (owner: 10Jforrester) [20:00:48] (03PS1) 10Ahmon Dancy: Release 4.4.2-1 [tools/scap] - 10https://gerrit.wikimedia.org/r/767578 [20:00:49] (03CR) 10Ahmon Dancy: [C: 03+2] Release 4.4.2-1 [tools/scap] - 10https://gerrit.wikimedia.org/r/767578 (owner: 10Ahmon Dancy) [20:01:30] (03Merged) 10jenkins-bot: Release 4.4.2-1 [tools/scap] - 10https://gerrit.wikimedia.org/r/767578 (owner: 10Ahmon Dancy) [20:03:24] 10Release-Engineering-Team, 10Scap, 10serviceops: Deploy Scap version 4.4.2 - https://phabricator.wikimedia.org/T302919 (10dancy) [20:03:38] 10Release-Engineering-Team, 10Scap, 10serviceops: Deploy Scap version 4.4.2 - https://phabricator.wikimedia.org/T302919 (10dancy) p:05Triage→03High [20:11:15] James_F: is the cut Monday? [20:11:43] Very early on Tuesdays. [20:12:00] Depending on your time zone, it happens on Mondays. [20:14:17] Ty [20:14:36] * RhinosF1 is moaning at Miraheze SRE to make sure he has time to clean up our stuff ready for the cut [20:15:01] Ack. [20:15:09] Hopefully it won’t be disruptive. [20:15:23] But there’s always someone that rushes through a bunch of breaking changes. [20:15:35] https://wikitech.wikimedia.org/wiki/Deployments#deploycal-item-20220308T0200 [20:16:22] James_F: I'm pretty sure one of our extensions is completely broken [20:16:30] I'm not looking forward to testing [20:16:59] Joy. [20:19:21] 10MediaWiki-Releasing, 10MW-1.38-release: Announce 1.38 forthcoming "pencils down" and likely timeline to wikitech-l etc. - https://phabricator.wikimedia.org/T302906 (10Jdforrester-WMF) 05Open→03Resolved a:03Jdforrester-WMF [20:19:27] 10MediaWiki-Releasing, 10MW-1.38-release: Release MW 1.38.0 - https://phabricator.wikimedia.org/T302893 (10Jdforrester-WMF) [20:21:05] 10MediaWiki-Releasing, 10MW-1.38-release: Announce 1.38 forthcoming "pencils down" and likely timeline to wikitech-l etc. - https://phabricator.wikimedia.org/T302906 (10Jdforrester-WMF) wikitech-l: https://lists.wikimedia.org/hyperkitty/list/wikitech-l@lists.wikimedia.org/thread/WNF4WUIUSGJJZXU3LA2IOFGSP6OR6QT... [20:21:30] James_F: https://bash.toolforge.org/quip/3EWHd3wB8Fs0LHO5i8LD [20:21:44] RhinosF1: Quite. ;-) [20:21:45] I guarantee my list will be 10 times bigger than 1.37 [20:21:46] 10Release-Engineering-Team, 10Scap, 10serviceops: Deploy Scap version 4.4.2 - https://phabricator.wikimedia.org/T302919 (10Dzahn) a:03Dzahn [20:22:53] 10Release-Engineering-Team, 10Scap, 10serviceops: Deploy Scap version 4.4.2 - https://phabricator.wikimedia.org/T302919 (10Dzahn) built following the docs, except replaced deneb with build2001, that's the new build host replacing deneb. uploaded and imported on apt1001, copied to strech and bullseye from bu... [20:42:32] 10Release-Engineering-Team, 10Scap, 10serviceops: Deploy Scap version 4.4.2 - https://phabricator.wikimedia.org/T302919 (10Dzahn) ` scap was updated: 4.4.1-1 -> 4.4.2-1 mw[2252,2271-2272,2374,2376].codfw.wmnet,mw[1311,1414-1418,1447-1450 ].eqiad.wmnet,mwdebug[2001-2002].codfw.wmnet,mwdebug[1001-1002].eqiad... [20:50:08] 10Release-Engineering-Team, 10Scap, 10serviceops: Deploy Scap version 4.4.2 - https://phabricator.wikimedia.org/T302919 (10Dzahn) I did everything the docs say to do (https://wikitech.wikimedia.org/wiki/Scap/Release) including test deploy etc.. except the very last step "Later or the next day you can rollout... [21:08:07] (03PS3) 10Krinkle: make-deploy-notes: Simplify and prettify botclasses.php [tools/release] - 10https://gerrit.wikimedia.org/r/709851 [21:14:04] Yippee, build fixed! [21:14:05] Project beta-mediawiki-config-update-eqiad build #217: 09FIXED in 1 min 24 sec: https://integration.wikimedia.org/ci/job/beta-mediawiki-config-update-eqiad/217/ [21:30:59] (03CR) 10Ahmon Dancy: "I will try running the script." [tools/release] - 10https://gerrit.wikimedia.org/r/709851 (owner: 10Krinkle) [21:34:31] (03CR) 10Ahmon Dancy: [V: 03+1] "test-botclasses.php worked for me." [tools/release] - 10https://gerrit.wikimedia.org/r/709851 (owner: 10Krinkle) [21:48:54] 10Release-Engineering-Team, 10Scap, 10serviceops: Deploy Scap version 4.4.2 - https://phabricator.wikimedia.org/T302919 (10Dzahn) 05Open→03Resolved ` scap was updated: 4.4.1-1 -> 4.4.2-1 an-airflow[1001-1002].eqiad.wmnet,an- coord[1001-1002].eqiad.wmnet,an-launcher1002.eqiad.wmnet,an-test- client1001.e... [21:49:39] (03CR) 10Ahmon Dancy: [V: 03+1] make-deploy-notes: Simplify and prettify botclasses.php (031 comment) [tools/release] - 10https://gerrit.wikimedia.org/r/709851 (owner: 10Krinkle) [21:49:56] 10Release-Engineering-Team, 10Scap, 10serviceops: Deploy Scap version 4.4.1 - https://phabricator.wikimedia.org/T302464 (10Dzahn) scap 4.4.2 built and rolled out everywhere (T302919) [21:56:40] (03PS4) 10Ahmon Dancy: make-deploy-notes: Simplify and prettify botclasses.php [tools/release] - 10https://gerrit.wikimedia.org/r/709851 (owner: 10Krinkle) [21:57:25] (03CR) 10jerkins-bot: [V: 04-1] make-deploy-notes: Simplify and prettify botclasses.php [tools/release] - 10https://gerrit.wikimedia.org/r/709851 (owner: 10Krinkle) [21:59:11] (03PS5) 10Ahmon Dancy: make-deploy-notes: Simplify and prettify botclasses.php [tools/release] - 10https://gerrit.wikimedia.org/r/709851 (owner: 10Krinkle) [22:00:12] (03CR) 10Ahmon Dancy: "I usually avoid pushing on top of other people's work but I though it might be easier for you to see in a diff what I was trying to sugges" [tools/release] - 10https://gerrit.wikimedia.org/r/709851 (owner: 10Krinkle) [22:00:20] (03CR) 10Krinkle: make-deploy-notes: Simplify and prettify botclasses.php (031 comment) [tools/release] - 10https://gerrit.wikimedia.org/r/709851 (owner: 10Krinkle) [22:03:15] (03CR) 10Krinkle: make-deploy-notes: Simplify and prettify botclasses.php (032 comments) [tools/release] - 10https://gerrit.wikimedia.org/r/709851 (owner: 10Krinkle) [22:06:39] (03CR) 10Ahmon Dancy: make-deploy-notes: Simplify and prettify botclasses.php (031 comment) [tools/release] - 10https://gerrit.wikimedia.org/r/709851 (owner: 10Krinkle) [22:09:35] (03CR) 10Krinkle: make-deploy-notes: Simplify and prettify botclasses.php (031 comment) [tools/release] - 10https://gerrit.wikimedia.org/r/709851 (owner: 10Krinkle) [22:12:17] (03CR) 10Ahmon Dancy: make-deploy-notes: Simplify and prettify botclasses.php (031 comment) [tools/release] - 10https://gerrit.wikimedia.org/r/709851 (owner: 10Krinkle) [22:19:49] (03CR) 10Arlolra: [C: 03+2] Adapt HTML postprocessing for talk namespace and DiscussionTools [integration/visualdiff] - 10https://gerrit.wikimedia.org/r/767239 (owner: 10Subramanya Sastry) [22:20:35] (03Merged) 10jenkins-bot: Adapt HTML postprocessing for talk namespace and DiscussionTools [integration/visualdiff] - 10https://gerrit.wikimedia.org/r/767239 (owner: 10Subramanya Sastry) [22:54:09] 10GitLab (CI & Job Runners), 10serviceops, 10Patch-For-Review: upgrade gitlab-runners to bullseye - https://phabricator.wikimedia.org/T297659 (10Dzahn) - created a new instance `gitlab-runner-1001 [22:55:53] (03PS6) 10Krinkle: make-deploy-notes: Simplify and prettify botclasses.php [tools/release] - 10https://gerrit.wikimedia.org/r/709851 [23:25:20] 10GitLab (CI & Job Runners), 10serviceops, 10Patch-For-Review: upgrade gitlab-runners to bullseye - https://phabricator.wikimedia.org/T297659 (10Dzahn) [23:25:36] 10GitLab (CI & Job Runners), 10serviceops, 10Patch-For-Review: upgrade gitlab-runners to bullseye - https://phabricator.wikimedia.org/T297659 (10Dzahn) 05Open→03In progress [23:49:08] (03CR) 10Ahmon Dancy: [C: 03+2] make-deploy-notes: Simplify and prettify botclasses.php [tools/release] - 10https://gerrit.wikimedia.org/r/709851 (owner: 10Krinkle) [23:49:47] (03Merged) 10jenkins-bot: make-deploy-notes: Simplify and prettify botclasses.php [tools/release] - 10https://gerrit.wikimedia.org/r/709851 (owner: 10Krinkle)