[00:08:30] (03open) 10bd808: keystone: Update bin/kubeconfig.py to expect envvars at kubectl runtime [repos/releng/zuul/tofu-provisioning] - 10https://gitlab.wikimedia.org/repos/releng/zuul/tofu-provisioning/-/merge_requests/42 (https://phabricator.wikimedia.org/T398367) [00:09:03] (03update) 10bd808: keystone: Update bin/kubeconfig.py to expect envvars at kubectl runtime [repos/releng/zuul/tofu-provisioning] - 10https://gitlab.wikimedia.org/repos/releng/zuul/tofu-provisioning/-/merge_requests/42 (https://phabricator.wikimedia.org/T398367) [03:42:05] (03open) 10aklapper: Add debug output for various crawler created crashes [repos/phabricator/phabricator] (wmf/stable) - 10https://gitlab.wikimedia.org/repos/phabricator/phabricator/-/merge_requests/92 [04:06:12] 10Phabricator, 10Release-Engineering-Team (Doing 😎): Description change for `WMDEGHPhabBot` - https://phabricator.wikimedia.org/T400611#11041715 (10Aklapper) 05Open→03Resolved a:03Aklapper Uh yes that's very welcome! Thanks! Done. [06:33:43] 10Phabricator, 10Release-Engineering-Team (Doing 😎): Description change for `WMDEGHPhabBot` - https://phabricator.wikimedia.org/T400611#11041808 (10seanleong-WMDE) Thanks! @Aklapper [07:21:52] 10GitLab (Infrastructure), 06collaboration-services, 13Patch-For-Review: Gitlab switchover (gitlab2002 → gitlab1004) - https://phabricator.wikimedia.org/T400252#11041921 (10Jelto) Todays replica restore was affected by the bug mentioned in T399306#11020503. The restore finished 06:31 UTC and would have delay... [08:52:29] 10Continuous-Integration-Infrastructure, 07Jenkins, 06Release-Engineering-Team, 06collaboration-services: dpkg error when deploying Jenkins to releases2003.codfw.wmnet - https://phabricator.wikimedia.org/T400645#11042081 (10hashar) 05Open→03Declined Jnuche did the Jenkins deployment and it indeed f... [09:14:34] 10GitLab (Infrastructure), 06collaboration-services, 13Patch-For-Review: Gitlab switchover (gitlab2002 → gitlab1004) - https://phabricator.wikimedia.org/T400252#11042160 (10Jelto) [09:29:26] 10GitLab (Infrastructure), 06collaboration-services, 13Patch-For-Review: Gitlab switchover (gitlab2002 → gitlab1004) - https://phabricator.wikimedia.org/T400252#11042197 (10Jelto) [09:36:03] 10GitLab (Infrastructure), 06collaboration-services, 13Patch-For-Review: Gitlab switchover (gitlab2002 → gitlab1004) - https://phabricator.wikimedia.org/T400252#11042208 (10Jelto) [09:45:57] 06Gerrit-Privilege-Requests: Allow Daniel to create Gerrit repos - https://phabricator.wikimedia.org/T400630#11042236 (10hashar) 05Open→03Resolved a:03hashar I have added @daniel to the [[ https://gerrit.wikimedia.org/r/admin/groups/93b1e277b72d0e0a883afbc0a87948dd6dd0d7b7,members | Gerrit Managers ]]... [10:00:52] 10Continuous-Integration-Config, 10Continuous-Integration-Infrastructure, 07Jenkins, 10Wikifunctions, and 3 others: ${{SCRIPT, template="wikimedia.template"}} is not sending a correct template - https://phabricator.wikimedia.org/T400286#11042276 (10hashar) [10:06:13] 10Beta-Cluster-Infrastructure, 07Chinese-Sites: "The text of this revision is missing or corrupted" on Chinese Wikipedia Beta Cluster - https://phabricator.wikimedia.org/T400531#11042296 (10Diskdance) 05Open→03Resolved a:03Diskdance Resolved after deleting and recreating the page. Closing. [10:06:19] 10Continuous-Integration-Config, 10MediaWiki-Core-Tests, 07Documentation, 13Patch-For-Review: Jenkins-bot should remind users to add documentation for new functions - https://phabricator.wikimedia.org/T179632#11042299 (10hashar) a:03Umherirrender [10:48:06] 10Phabricator, 06SRE: traffic from Discord and Slack unfurler service is blocked by phabricator.wikimedia.org - https://phabricator.wikimedia.org/T400540#11042397 (10Aklapper) [10:55:19] 06Gerrit-Privilege-Requests: Allow Daniel to create Gerrit repos - https://phabricator.wikimedia.org/T400630#11042417 (10daniel) Thank you @hashar! [11:10:53] 10GitLab (Administration, Settings & Policy), 06collaboration-services: Impersonation of bot accounts on GitLab is broken - https://phabricator.wikimedia.org/T400685 (10Jelto) 03NEW [11:38:49] 10GitLab (Administration, Settings & Policy), 06collaboration-services: Impersonation of bot accounts on GitLab is broken - https://phabricator.wikimedia.org/T400685#11042531 (10Jelto) a:05eoghan→03None [11:55:30] 10Gerrit, 06collaboration-services: Document "Gerrit is down (and requires a puppet change to put it back)" - https://phabricator.wikimedia.org/T398637#11042561 (10ABran-WMF) [11:55:49] 10Gerrit, 06collaboration-services, 06SRE, 06Traffic: Document how to deploy changes to DNS repo without Gerrit working - https://phabricator.wikimedia.org/T336754#11042563 (10ABran-WMF) [12:11:35] 10Gerrit (Gerrit 3.10): Upgrade to Gerrit 3.10.7 - https://phabricator.wikimedia.org/T400688 (10hashar) 03NEW [12:40:32] (03merge) 10aklapper: Add debug output for various crawler created crashes [repos/phabricator/phabricator] (wmf/stable) - 10https://gitlab.wikimedia.org/repos/phabricator/phabricator/-/merge_requests/92 [12:53:03] 10Beta-Cluster-Infrastructure, 06Release-Engineering-Team, 07Essential-Work: PHP on Beta cluster fails due to mismatching PCRE - https://phabricator.wikimedia.org/T387276#11042754 (10hashar) We had the same libpcre2 / PHP mismatch with the php 8.3 packages (T398245#11010808). I have filed T400693 to have... [14:46:46] 10Release-Engineering-Team (Radar), 06Data-Engineering: Create a GitLab CI/CD Component project for WMF CI/CD templates and components - https://phabricator.wikimedia.org/T382430#11043433 (10Ottomata) I heard @amastilovic say today that GitLab CI components can't be used for manual CI job runs? If so, that is... [14:52:56] 10Continuous-Integration-Infrastructure, 10MediaWiki-Vagrant: mediawiki-vagrant-ruby2.7-rake fails: Could not find 'bundler' (1.17.3) - https://phabricator.wikimedia.org/T400362#11043456 (10hashar) That specific error `Could not find 'bundler' (1.17.3) required by your /src/Gemfile.lock` can be addressed by re... [14:53:04] 10Continuous-Integration-Infrastructure, 10MediaWiki-Vagrant: mediawiki-vagrant-ruby2.7-rake fails: Could not find 'bundler' (1.17.3) - https://phabricator.wikimedia.org/T400362#11043463 (10hashar) →14Duplicate dup:03T398469 [14:53:09] 10Continuous-Integration-Config, 10Continuous-Integration-Infrastructure (Zuul upgrade), 06Release-Engineering-Team, 10MediaWiki-Vagrant, 07Essential-Work: Migrate mediawiki/vagrant CI to Bullseye and remove custom image - https://phabricator.wikimedia.org/T398469#11043460 (10hashar) [14:55:36] 10Phabricator (phabricator-next), 06Release-Engineering-Team, 06collaboration-services: Deploy Phabricator/Phorge 2025-07-29 - https://phabricator.wikimedia.org/T400718 (10brennen) 03NEW [14:56:19] (03open) 10brennen: update submodules for 2025-07-29 deploy [repos/phabricator/deployment] (wmf/stable) - 10https://gitlab.wikimedia.org/repos/phabricator/deployment/-/merge_requests/75 (https://phabricator.wikimedia.org/T400718) [15:01:56] (03merge) 10brennen: update submodules for 2025-07-29 deploy [repos/phabricator/deployment] (wmf/stable) - 10https://gitlab.wikimedia.org/repos/phabricator/deployment/-/merge_requests/75 (https://phabricator.wikimedia.org/T400718) [15:02:17] 10Phabricator (2025-07-29), 06Release-Engineering-Team, 06collaboration-services, 13Patch-For-Review: Deploy Phabricator/Phorge 2025-07-29 - https://phabricator.wikimedia.org/T400718#11043550 (10ops-monitoring-bot) Icinga downtime and Alertmanager silence (ID=e02c3a78-2453-407b-9be3-a79b6e9e3a3e) set by je... [15:02:43] 10Phabricator (2025-07-29), 06Release-Engineering-Team, 06collaboration-services, 13Patch-For-Review: Deploy Phabricator/Phorge 2025-07-29 - https://phabricator.wikimedia.org/T400718#11043561 (10ops-monitoring-bot) Icinga downtime and Alertmanager silence (ID=a27f3c96-5ac4-4315-ab63-808b96b02b9c) set by je... [15:03:12] 10Phabricator (2025-07-29), 06Release-Engineering-Team, 06collaboration-services, 13Patch-For-Review: Deploy Phabricator/Phorge 2025-07-29 - https://phabricator.wikimedia.org/T400718#11043564 (10ops-monitoring-bot) Icinga downtime and Alertmanager silence (ID=caedccfa-f965-4787-9e5e-f025c091308f) set by je... [15:07:09] 10Phabricator (2025-07-29), 10Release-Engineering-Team (Doing 😎), 06collaboration-services: Deploy Phabricator/Phorge 2025-07-29 - https://phabricator.wikimedia.org/T400718#11043619 (10Aklapper) 05Open→03Resolved This deployment included * Arcanist: Backport of upstream fix for crash in Czech transla... [15:07:30] (03merge) 10bd808: keystone: Update bin/kubeconfig.py to expect envvars at kubectl runtime [repos/releng/zuul/tofu-provisioning] - 10https://gitlab.wikimedia.org/repos/releng/zuul/tofu-provisioning/-/merge_requests/42 (https://phabricator.wikimedia.org/T398367) [15:23:52] 10Phabricator (Upstream), 10Release-Engineering-Team (Doing 😎), 07Upstream: "Unhandled Exception ("RuntimeException") page with Undefined offset: 2" browsing any tasks using Czech language UI - https://phabricator.wikimedia.org/T399752#11043689 (10Aklapper) 05Open→03Resolved Deployed now in our Wikim... [15:32:25] 10Phabricator (Upstream), 10Release-Engineering-Team (Doing 😎), 07Upstream: "Unhandled Exception ("RuntimeException") page with Undefined offset: 2" browsing any tasks using Czech language UI - https://phabricator.wikimedia.org/T399752#11043757 (10Pppery) Pluralization is one of the areas in which the Ph... [15:40:06] Project beta-code-update-eqiad build #558816: 04FAILURE in 5.2 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/558816/ [15:43:03] Project beta-code-update-eqiad build #558817: 04STILL FAILING in 3 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/558817/ [15:46:47] `! [rejected] 1.43.0-rc.0 -> 1.43.0-rc.0 (would clobber existing tag)` -- 1.43.0-rc.0 got double tagged? [15:48:29] 10Phabricator (2025-07-29), 10Release-Engineering-Team (Doing 😎), 06collaboration-services: Deploy Phabricator/Phorge 2025-07-29 - https://phabricator.wikimedia.org/T400718#11043848 (10Pppery) Note: My translation commit in https://gerrit.wikimedia.org/r/c/phabricator/translations/+/1169700 did not direc... [15:51:34] 10Phabricator (2025-07-29), 10Release-Engineering-Team (Doing 😎), 06collaboration-services: Deploy Phabricator/Phorge 2025-07-29 - https://phabricator.wikimedia.org/T400718#11043854 (10Aklapper) Ah, I'm sorry for oversimplifying (which sounds more professional than "not fully understanding what I was doi... [15:53:03] Project beta-code-update-eqiad build #558818: 04STILL FAILING in 2.5 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/558818/ [15:55:50] !log `cd /srv/mediawiki-staging/php-master && sudo -u jenkins-deploy git fetch --tags --jobs 2 --no-recurse-submodules --force origin master` on deployment-deploy04.deployment-prep.eqiad1.wikimedia.cloud [15:55:51] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [15:57:49] the next update job should succeed. Apparently there were duplicate tags for 1.43.0 and 1.43.0-rc.0 pushed to mediawiki/core.git today. [16:02:23] where did those duplicate tags come from? that seems worrying [16:07:05] Yippee, build fixed! [16:07:05] Project beta-code-update-eqiad build #558819: 09FIXED in 4 min 4 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/558819/ [16:10:25] 10Continuous-Integration-Infrastructure (Zuul upgrade), 10Cloud-VPS (Quota-requests): Large quota increase for zuul Cloud VPS project - https://phabricator.wikimedia.org/T400305#11043919 (10dcaro) a:03dcaro [16:11:33] 10Beta-Cluster-Infrastructure, 07Beta-Cluster-reproducible, 05MW-1.43-release: Duplicate git tags for 1.43.0-rc.0 and 1.43.0 in mediawiki/core.git - https://phabricator.wikimedia.org/T400729 (10bd808) 03NEW [16:12:53] 10Beta-Cluster-Infrastructure, 07Beta-Cluster-reproducible, 05MW-1.43-release: Duplicate git tags for 1.43.0-rc.0 and 1.43.0 in mediawiki/core.git - https://phabricator.wikimedia.org/T400729#11043947 (10bd808) The failing git fetch in Beta Cluster was fixed manually. `lang=shell-session root@deployment-deplo... [16:13:47] taavi: I haven't dug into that deeply yet, but I did start T400729 [16:13:48] T400729: Duplicate git tags for 1.43.0-rc.0 and 1.43.0 in mediawiki/core.git - https://phabricator.wikimedia.org/T400729 [16:14:24] 10Continuous-Integration-Infrastructure, 10VisualEditor, 07ci-test-error: CI error because installing pngquant-bin NPM library fails with HTTP 429 - https://phabricator.wikimedia.org/T400730#11043956 (10Tgr) We have, I think, some sort of NPM cache for CI, but this probably bypasses that. Not sure what can b... [16:15:03] 10Continuous-Integration-Infrastructure (Zuul upgrade), 10Cloud-VPS (Quota-requests): Large quota increase for zuul Cloud VPS project - https://phabricator.wikimedia.org/T400305#11043959 (10dcaro) 05Open→03Resolved p:05Triage→03High I think I got all the quotas :) {F65689252} Enjoy! [16:17:37] 10Beta-Cluster-Infrastructure, 10MediaWiki-Releasing, 07Beta-Cluster-reproducible, 05MW-1.43-release: Duplicate git tags for 1.43.0-rc.0 and 1.43.0 in mediawiki/core.git - https://phabricator.wikimedia.org/T400729#11043973 (10A_smart_kitten) [16:24:13] 10Beta-Cluster-Infrastructure, 10MediaWiki-Releasing, 07Beta-Cluster-reproducible, 05MW-1.43-release: Duplicate git tags for 1.43.0-rc.0 and 1.43.0 in mediawiki/core.git - https://phabricator.wikimedia.org/T400729#11043993 (10A_smart_kitten) - https://gerrit.wikimedia.org/r/plugins/gitiles/mediawiki/core/+... [16:24:19] 10Beta-Cluster-Infrastructure, 10MediaWiki-Releasing, 07Beta-Cluster-reproducible, 05MW-1.43-release: Duplicate git tags for 1.43.0-rc.0 and 1.43.0 in mediawiki/core.git - https://phabricator.wikimedia.org/T400729#11043994 (10bd808) Exploring things a bit in a git clone that has not been force updated yet:... [16:25:13] 10Beta-Cluster-Infrastructure, 10MediaWiki-Releasing, 07Beta-Cluster-reproducible, 05MW-1.43-release: Duplicate git tags for 1.43.0-rc.0 and 1.43.0 in mediawiki/core.git - https://phabricator.wikimedia.org/T400729#11044007 (10Krinkle) I still have the original tag in my local clone: ` tag 1.43.0 Tagger: A... [16:46:49] 10Beta-Cluster-Infrastructure, 10MediaWiki-Releasing, 07Beta-Cluster-reproducible, 05MW-1.43-release: Duplicate git tags for 1.43.0-rc.0 and 1.43.0 in mediawiki/core.git - https://phabricator.wikimedia.org/T400729#11044068 (10bd808) Old tags without GPG signatures: ` $ git rev-parse 1.43.0-rc.0 25990d47740... [16:47:19] 10Beta-Cluster-Infrastructure, 10MediaWiki-Releasing, 07Beta-Cluster-reproducible, 05MW-1.43-release: Duplicate git tags for 1.43.0-rc.0 and 1.43.0 in mediawiki/core.git - https://phabricator.wikimedia.org/T400729#11044070 (10thcipriani) hrm, so, tags are never meant to update (hence why fetching updated t... [17:03:53] 10Beta-Cluster-Infrastructure, 10MediaWiki-Releasing, 07Beta-Cluster-reproducible, 05MW-1.43-release: Duplicate git tags for 1.43.0-rc.0 and 1.43.0 in mediawiki/core.git - https://phabricator.wikimedia.org/T400729#11044136 (10Krinkle) I've chatted with @Atieno. The reason for the update was to add the miss... [17:04:05] Project beta-code-update-eqiad build #558825: 04FAILURE in 2.6 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/558825/ [17:10:48] 10Beta-Cluster-Infrastructure, 10MediaWiki-Releasing, 07Beta-Cluster-reproducible, 05MW-1.43-release: Duplicate git tags for 1.43.0-rc.0 and 1.43.0 in mediawiki/core.git - https://phabricator.wikimedia.org/T400729#11044163 (10bd808) `lang=shell-session root@deployment-deploy04:/srv/mediawiki-staging/php-ma... [17:11:01] !log `cd /srv/mediawiki-staging/php-master && sudo -u jenkins-deploy git fetch --tags --jobs 2 --no-recurse-submodules --force origin master` on deployment-deploy04.deployment-prep.eqiad1.wikimedia.cloud a second time (T400729) [17:11:06] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [17:11:06] T400729: Duplicate git tags for 1.43.0-rc.0 and 1.43.0 in mediawiki/core.git - https://phabricator.wikimedia.org/T400729 [17:15:26] Yippee, build fixed! [17:15:26] Project beta-code-update-eqiad build #558826: 09FIXED in 2 min 25 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/558826/ [17:29:10] (03open) 10dancy: Add sub-submodule test patch [repos/releng/train-dev] - 10https://gitlab.wikimedia.org/repos/releng/train-dev/-/merge_requests/151 [17:29:13] (03update) 10dancy: Add sub-submodule test patch [repos/releng/train-dev] - 10https://gitlab.wikimedia.org/repos/releng/train-dev/-/merge_requests/151 [17:30:19] (03merge) 10dancy: Add sub-submodule test patch [repos/releng/train-dev] - 10https://gitlab.wikimedia.org/repos/releng/train-dev/-/merge_requests/151 [17:31:24] (03open) 10dancy: Teach apply-patches about submodules [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/923 [17:31:28] (03update) 10dancy: Teach apply-patches about submodules [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/923 [17:33:56] (03update) 10dancy: Teach apply-patches about submodules [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/923 [17:33:57] (03merge) 10dancy: Teach apply-patches about submodules [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/923 [17:34:46] (03open) 10dancy: Release 4.193.0 [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/924 [17:36:22] (03merge) 10dancy: Release 4.193.0 [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/924 [17:37:10] 10Beta-Cluster-Infrastructure, 10MediaWiki-Releasing, 07Beta-Cluster-reproducible, 05MW-1.43-release: Duplicate git tags for 1.43.0-rc.0 and 1.43.0 in mediawiki/core.git - https://phabricator.wikimedia.org/T400729#11044272 (10bd808) a:03Krinkle Assigning to @Krinkle. I will leave it to him and @Atieno to... [17:51:33] (03open) 10bd808: kubernetes: Remove local_sensitive_file.kubeconfig generation [repos/releng/zuul/tofu-provisioning] - 10https://gitlab.wikimedia.org/repos/releng/zuul/tofu-provisioning/-/merge_requests/43 [17:52:56] 10Beta-Cluster-Infrastructure, 10MediaWiki-Releasing, 07Beta-Cluster-reproducible, 05MW-1.43-release, 10MW-Interfaces-Team (MWI-Roadmap): Duplicate git tags for 1.43.0-rc.0 and 1.43.0 in mediawiki/core.git - https://phabricator.wikimedia.org/T400729#11044327 (10Atieno) [17:53:53] 10Beta-Cluster-Infrastructure, 10MediaWiki-Releasing, 07Beta-Cluster-reproducible, 05MW-1.43-release, 10MW-Interfaces-Team (MWI-Sprint-15 (2025-07-29 to 2025-08-12)): Duplicate git tags for 1.43.0-rc.0 and 1.43.0 in mediawiki/core.git - https://phabricator.wikimedia.org/T400729#11044330 (10Atieno) [17:54:48] 10Beta-Cluster-Infrastructure, 10MediaWiki-Releasing, 07Beta-Cluster-reproducible, 05MW-1.43-release, 10MW-Interfaces-Team (MWI-Sprint-15 (2025-07-29 to 2025-08-12)): Duplicate git tags for 1.43.0-rc.0 and 1.43.0 in mediawiki/core.git - https://phabricator.wikimedia.org/T400729#11044331 (10Atieno) I will... [20:15:40] (03open) 10dduvall: docs: Refactor README to focus on common usage patterns [repos/releng/blubber] - 10https://gitlab.wikimedia.org/repos/releng/blubber/-/merge_requests/140 [20:15:49] (03update) 10dduvall: docs: Refactor README to focus on common usage patterns [repos/releng/blubber] - 10https://gitlab.wikimedia.org/repos/releng/blubber/-/merge_requests/140 [20:15:51] (03update) 10dduvall: docs: Refactor README to focus on common usage patterns [repos/releng/blubber] - 10https://gitlab.wikimedia.org/repos/releng/blubber/-/merge_requests/140 [20:36:33] (03merge) 10bd808: kubernetes: Remove local_sensitive_file.kubeconfig generation [repos/releng/zuul/tofu-provisioning] - 10https://gitlab.wikimedia.org/repos/releng/zuul/tofu-provisioning/-/merge_requests/43 [20:45:04] (03open) 10bd808: kubernetes: scale v128 cluster up to 10 worker nodes [repos/releng/zuul/tofu-provisioning] - 10https://gitlab.wikimedia.org/repos/releng/zuul/tofu-provisioning/-/merge_requests/44 [20:51:28] (03merge) 10bd808: kubernetes: scale v128 cluster up to 10 worker nodes [repos/releng/zuul/tofu-provisioning] - 10https://gitlab.wikimedia.org/repos/releng/zuul/tofu-provisioning/-/merge_requests/44 [21:51:41] 10Release-Engineering-Team (Radar), 06Data-Engineering: Create a GitLab CI/CD Component project for WMF CI/CD templates and components - https://phabricator.wikimedia.org/T382430#11045258 (10amastilovic) >>! In T382430#11043433, @Ottomata wrote: > I heard @amastilovic say today that GitLab CI components can't... [21:52:33] 10Release-Engineering-Team (Priority Backlog 📥), 07OKR-Work: Audit "MediaWiki branch and publish WMF single-version image" job failures and recruit help fixing flakey tests - https://phabricator.wikimedia.org/T400761 (10bd808) 03NEW [21:54:18] 10Release-Engineering-Team (Priority Backlog 📥), 07OKR-Work: Audit "MediaWiki branch and publish WMF single-version image" job failures and recruit help fixing flaky tests - https://phabricator.wikimedia.org/T400761#11045283 (10bd808) [22:15:34] (03open) 10dduvall: docs: Syntax highlight blubber config in examples [repos/releng/blubber] - 10https://gitlab.wikimedia.org/repos/releng/blubber/-/merge_requests/141 [22:20:18] (03merge) 10dduvall: docs: Syntax highlight blubber config in examples [repos/releng/blubber] - 10https://gitlab.wikimedia.org/repos/releng/blubber/-/merge_requests/141 [22:25:46] 10Continuous-Integration-Infrastructure (Zuul upgrade), 06collaboration-services: request mysql database for new zuul - https://phabricator.wikimedia.org/T400766 (10Dzahn) 03NEW [22:27:31] 10Continuous-Integration-Infrastructure (Zuul upgrade), 06collaboration-services: request mysql database for new zuul - https://phabricator.wikimedia.org/T400766#11045430 (10Dzahn) 05Open→03Invalid should be duplicate of T394844 [22:28:04] 10Continuous-Integration-Infrastructure (Zuul upgrade), 06collaboration-services: puppetize setup of new zuul VMs - https://phabricator.wikimedia.org/T395938#11045436 (10Dzahn) [22:28:06] 10Continuous-Integration-Infrastructure (Zuul upgrade), 06collaboration-services, 06Data-Persistence, 10Data-Persistence-Backup, and 2 others: Request mariadb database for Zuul - https://phabricator.wikimedia.org/T394844#11045437 (10Dzahn) [22:57:08] mutante: progressing well on the the Zuul setup I see. Nice! [23:04:45] 10Continuous-Integration-Infrastructure (Zuul upgrade), 13Patch-For-Review: Provision Kubernetes cluster and bastion using OpenTofu and Magnum - https://phabricator.wikimedia.org/T396936#11045497 (10bd808) New upstream bug reports for https://github.com/terraform-provider-openstack/terraform-provider-openstack... [23:06:58] (03open) 10bd808: ci: Replace TF_PLAN_APPLY_ARGS with inputs.tofu-plan-apply-args [repos/releng/zuul/tofu-provisioning] - 10https://gitlab.wikimedia.org/repos/releng/zuul/tofu-provisioning/-/merge_requests/45 [23:33:42] (03merge) 10bd808: ci: Replace TF_PLAN_APPLY_ARGS with inputs.tofu-plan-apply-args [repos/releng/zuul/tofu-provisioning] - 10https://gitlab.wikimedia.org/repos/releng/zuul/tofu-provisioning/-/merge_requests/45