[05:25:46] 10Beta-Cluster-Infrastructure, 10SRE, 10SRE-swift-storage: Captchas are broken in the beta cluster - https://phabricator.wikimedia.org/T344834 (10Tgr) According to the [[https://gerrit.wikimedia.org/r/plugins/gitiles/operations/puppet/+/ad097dd6ef45fad3612ca33371f5c478870fbaa6/modules/swift/templates/proxy-s... [05:52:11] 10Phabricator, 10Release-Engineering-Team (Priority Backlog šŸ“„), 10Documentation: Update [[mw:Phabricator/Code]] after migrating our upstream to Phorge - https://phabricator.wikimedia.org/T341808 (10brennen) [05:52:13] 10Phabricator, 10Technical-Debt: Remove custom WMF Phab downstream hacks superseded by upstream Phorge changes - https://phabricator.wikimedia.org/T341799 (10brennen) [05:52:15] 10Phabricator: New post for Phabricating Phabricator - https://phabricator.wikimedia.org/T340223 (10brennen) [05:52:19] 10Phabricator, 10Release-Engineering-Team (Escape GoatsšŸ), 10collaboration-services, 10User-brennen: Migrate phabricator.wikimedia.org to Phorge as upstream - https://phabricator.wikimedia.org/T333885 (10brennen) 05In progressā†’03Resolved One update re: rollbacks: As best I could tell from a quick rever... [06:00:19] 10Phabricator, 10Release-Engineering-Team (Radar), 10DBA, 10Data-Persistence-Backup, and 2 others: phabricator->phorge migration - database handling - https://phabricator.wikimedia.org/T335080 (10brennen) Copying from T333885#9115703: > One update re: rollbacks: As best I could tell from a quick revert of... [06:04:44] 10Beta-Cluster-Infrastructure, 10SRE, 10SRE-swift-storage: Captchas are broken in the beta cluster - https://phabricator.wikimedia.org/T344834 (10Urbanecm_WMF) Thanks for the info, @Tgr! I [fixed](https://gerrit.wikimedia.org/r/plugins/gitiles/cloud/instance-puppet/+/bf3e99977c63c4b65bfd211d3fd960e7700f5d5f%... [06:08:16] 10Beta-Cluster-Infrastructure, 10SRE, 10SRE-swift-storage: Captchas are broken in the beta cluster - https://phabricator.wikimedia.org/T344834 (10Urbanecm_WMF) 05Openā†’03Resolved p:05Triageā†’03High a:03Urbanecm_WMF Boldly resolving. [06:25:52] 10Beta-Cluster-Infrastructure: Captchas are broken in the beta cluster - https://phabricator.wikimedia.org/T344834 (10Ladsgroup) SRE (and to be exact data persistence team) don't maintain swift in beta cluster. I try to spend some time on it in my 10% time but it's explicitly excluded from the team's responsibil... [06:34:04] 10GitLab (CI & Job Runners): Allow GitLab CI containers to connect to services - https://phabricator.wikimedia.org/T344818 (10hashar) [06:36:05] 10Beta-Cluster-Infrastructure: Captchas are broken in the beta cluster - https://phabricator.wikimedia.org/T344834 (10RhinosF1) @Ladsgroup: Is there anyone specifically responsible or is this a similar situation to beta as a whole? [06:47:05] 10Beta-Cluster-Infrastructure: Captchas are broken in the beta cluster - https://phabricator.wikimedia.org/T344834 (10Aklapper) See T215217 [07:10:41] 10Phabricator, 10Release-Engineering-Team (Priority Backlog šŸ“„): Stop logging Bugzilla to Phabricator redirector misses - https://phabricator.wikimedia.org/T344884 (10Aklapper) p:05Triageā†’03Low [07:13:09] 10Release-Engineering-Team, 10Wikimedia-Site-requests: Clarify whether config patches need reviews before being scheduled for deployment - https://phabricator.wikimedia.org/T344409 (10TTO) The experience of getting things done as a volunteer (in my case, getting a new extension deployed) is already incredibly... [07:24:39] (03PS1) 10Sohom Datta: Add BetaFeature dependency to ProofreadPage CI [integration/config] - 10https://gerrit.wikimedia.org/r/952050 [07:26:38] (03CR) 10Samwilson: [C: 03+1] Add BetaFeature dependency to ProofreadPage CI [integration/config] - 10https://gerrit.wikimedia.org/r/952050 (owner: 10Sohom Datta) [07:31:07] 10Release-Engineering-Team (Deployment Training Requests): Deployment training request for Kizule - https://phabricator.wikimedia.org/T344885 (10Kizule) [07:31:40] 10Release-Engineering-Team (Deployment Training Requests): Deployment training request for Sergio Gimeno - https://phabricator.wikimedia.org/T320722 (10ArielGlenn) Hey @Sgs we missed you this morning at the deployment window for training. Or were you going to do the UTC late window this time? [07:34:01] 10Phabricator, 10Release-Engineering-Team (Radar), 10DBA, 10Data-Persistence-Backup, and 2 others: phabricator->phorge migration - database handling - https://phabricator.wikimedia.org/T335080 (10Marostegui) I am going to start it everywhere but the "special" host. Will do that on Friday [07:39:11] 10Release-Engineering-Team (Deployment Training Requests): Deployment training request for Kizule - https://phabricator.wikimedia.org/T344885 (10Kizule) [07:53:17] 10Release-Engineering-Team, 10sre-alert-triage: Alert triage: overdue critical alert - https://phabricator.wikimedia.org/T342755 (10fgiunchedi) >>! In T342755#9114368, @thcipriani wrote: > Hrm. We get an email from the systemd timer for this, so the alert is probably not necessary. > > We're not very familiar... [08:02:31] 10Gerrit, 10Mobile: Missing sign in links on mobile - https://phabricator.wikimedia.org/T344891 (10Reedy) [08:11:26] 10Gerrit, 10Mobile: Missing sign in links on mobile - https://phabricator.wikimedia.org/T344891 (10Reedy) [08:13:03] 10Gerrit: Sign in page should have Sign up link - https://phabricator.wikimedia.org/T344892 (10Reedy) [08:47:47] 10Gerrit, 10Upstream: Sign in page should have Sign up link - https://phabricator.wikimedia.org/T344892 (10hashar) The login page comes from Gerrit when authentication backend is set to LDAP. The HTML file in #upstream is `resources/com/google/gerrit/httpd/auth/ldap/LoginForm.html`. It might worth reporting to... [08:59:05] 10Gerrit, 10Mobile: Missing sign in links on mobile - https://phabricator.wikimedia.org/T344891 (10hashar) The link is further to the right and ends up hidden. Maybe we can remove the {nav Wikimedia Code Review} text though I have no idea how to do that in CSS. The content comes from operations/puppet: ` lan... [08:59:20] 10Gerrit, 10Upstream: Sign in page should have Sign up link - https://phabricator.wikimedia.org/T344892 (10hashar) p:05Triageā†’03Low [08:59:29] 10Gerrit, 10Mobile: Missing sign in links on mobile - https://phabricator.wikimedia.org/T344891 (10hashar) p:05Triageā†’03Low [09:03:19] 10Beta-Cluster-Infrastructure: Captchas are broken in the beta cluster - https://phabricator.wikimedia.org/T344834 (10MatthewVernon) How swift credentials are done in prod was changed as part of T162123 to make it possible for our swiftrepl replacement to have access to the necessary credentials from puppet (rat... [09:08:08] Project beta-scap-sync-world build #117569: 04FAILURE in 3 min 0 sec: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/117569/ [09:18:08] Project beta-scap-sync-world build #117570: 04STILL FAILING in 3 min 0 sec: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/117570/ [09:18:12] (03CR) 10Hashar: [C: 03+2] Add BetaFeature dependency to ProofreadPage CI [integration/config] - 10https://gerrit.wikimedia.org/r/952050 (owner: 10Sohom Datta) [09:19:22] (03Merged) 10jenkins-bot: Add BetaFeature dependency to ProofreadPage CI [integration/config] - 10https://gerrit.wikimedia.org/r/952050 (owner: 10Sohom Datta) [09:19:57] !log Reloaded Zuul for https://gerrit.wikimedia.org/r/c/integration/config/+/952050 [09:19:58] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [09:20:03] (03CR) 10Hashar: [C: 03+2] "Deployed" [integration/config] - 10https://gerrit.wikimedia.org/r/952050 (owner: 10Sohom Datta) [09:21:49] 10Release-Engineering-Team (Seen), 10MW-on-K8s, 10SRE, 10Traffic, and 2 others: Migrate internal traffic to k8s - https://phabricator.wikimedia.org/T333120 (10Joe) [09:26:11] Yippee, build fixed! [09:26:12] Project beta-scap-sync-world build #117571: 09FIXED in 1 min 6 sec: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/117571/ [09:30:01] 10Release-Engineering-Team (Seen), 10Gerrit (Gerrit 3.6): Upgrade to Gerrit 3.6 - https://phabricator.wikimedia.org/T309870 (10hashar) [09:30:03] 10Release-Engineering-Team (Priority Backlog šŸ“„), 10Developer Productivity, 10Gerrit (Gerrit 3.6): Clone with commit-msg hook command not interpreted correctly on zsh - https://phabricator.wikimedia.org/T342536 (10hashar) [09:35:34] 10Release-Engineering-Team (Priority Backlog šŸ“„), 10Developer Productivity, 10Gerrit (Gerrit 3.6): Clone with commit-msg hook command not interpreted correctly on zsh - https://phabricator.wikimedia.org/T342536 (10hashar) I removed T309870 as a parent since: * the dependency is the other way around * I use Ph... [10:06:19] (03CR) 10Hashar: [C: 04-1] "The `MW_QUIBBLE_CI` environment variable is set in the os environment by Quibble which is thus exposed to any commands it might run (npm t" [integration/quibble] - 10https://gerrit.wikimedia.org/r/952016 (owner: 10Krinkle) [10:06:51] (03CR) 10Hashar: [C: 03+2] docker: Remove unused checksum files for Composer and Node.js [integration/quibble] - 10https://gerrit.wikimedia.org/r/952014 (owner: 10Krinkle) [10:10:28] 10Continuous-Integration-Config: Upgrade all CI jobs for WMF-deployed projects from Node 16 to Node 18 - https://phabricator.wikimedia.org/T331180 (10hashar) [10:10:30] 10Continuous-Integration-Infrastructure: Create WMF CI images and jobs for Node.js 18 - https://phabricator.wikimedia.org/T331181 (10hashar) 05Resolvedā†’03Open We have the Docker images via https://gerrit.wikimedia.org/r/c/integration/config/+/894126 but lacking the associated Jenkins jobs :) [10:10:32] 10Fresh, 10Growth-Team, 10GrowthExperiments: Add Fresh support for Node.js 18 (with npm 9) - https://phabricator.wikimedia.org/T337647 (10hashar) [10:16:14] (03CR) 10Reedy: zuul: Remove some Renameuser dependencies (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/896311 (https://phabricator.wikimedia.org/T27482) (owner: 10Majavah) [10:25:19] (03Merged) 10jenkins-bot: docker: Remove unused checksum files for Composer and Node.js [integration/quibble] - 10https://gerrit.wikimedia.org/r/952014 (owner: 10Krinkle) [10:49:46] 10Gerrit, 10Upstream: Sign in page should have Sign up link - https://phabricator.wikimedia.org/T344892 (10Reedy) >>! In T344892#9116083, @hashar wrote: > The login page comes from Gerrit when authentication backend is set to LDAP. The HTML file in #upstream is `resources/com/google/gerrit/httpd/auth/ldap/Logi... [10:50:44] 10Gerrit, 10Mobile: Missing sign in links on mobile - https://phabricator.wikimedia.org/T344891 (10Reedy) >>! In T344891#9116102, @hashar wrote: > The link is further to the right and ends up hidden. Maybe we can remove the {nav Wikimedia Code Review} text though I have no idea how to do that in CSS. I think... [10:54:07] 10GitLab (Account Approval), 10Release-Engineering-Team: Requesting GitLab account activation for USER[S] - https://phabricator.wikimedia.org/T344902 (10Reputation22) [10:59:14] 10GitLab (Account Approval), 10Release-Engineering-Team: Requesting GitLab account activation for USER[S] - https://phabricator.wikimedia.org/T344902 (10Soda) Vouching for @Reputation22 they need the access to contribute to #VideoCutTool [11:05:41] 10GitLab (Account Approval), 10Release-Engineering-Team: Requesting GitLab account activation for Reputation22 - https://phabricator.wikimedia.org/T344902 (10Aklapper) [11:08:52] 10Phabricator, 10Technical-Debt: Remove custom WMF Phab downstream hacks superseded by upstream Phorge changes - https://phabricator.wikimedia.org/T341799 (10Aklapper) [11:29:19] is it just me or is phabricator a bit flaky at the moment? [11:29:24] right now it wonā€™t load for me [11:29:37] and probably itā€™ll come back in a minute or so but it also happened about half an hour ago [11:29:45] (now itā€™s back again) [11:30:39] Lucas_WMDE: Anything in particular? [11:30:44] Won't load at all? JS isuses? [11:30:55] It's possibly related to the move to phorge [11:31:19] Other then the activity feed not working (known), I've not noticed anything [11:31:25] wonā€™t load at all. firefox goes spinny and eventually stops loading and leaves me on the blank new tab again [11:31:36] I mainly notice it when Iā€™m writing a comment and it either wonā€™t submit or canā€™t upload an attached image [11:47:14] Try flushing caches for phab? Could be some weird stale js causing problems [11:51:57] I haven't experienced anything flaky [11:52:36] ...and https://phabricator.wikimedia.org/feed/ loads for me too. Did you really mean "activity feed", or only the widgets on the front page? [13:40:25] 10GitLab (Pipeline Services MigrationšŸ¤), 10collaboration-services, 10Patch-For-Review: Move micro sites from Ganeti to Kubernetes and from Gerrit to GitLab - https://phabricator.wikimedia.org/T300171 (10CodeReviewBot) jelto opened https://gitlab.wikimedia.org/repos/releng/gitlab-trusted-runner/-/merge_reques... [13:45:36] 10GitLab (Pipeline Services MigrationšŸ¤), 10collaboration-services, 10Patch-For-Review: Move micro sites from Ganeti to Kubernetes and from Gerrit to GitLab - https://phabricator.wikimedia.org/T300171 (10CodeReviewBot) jelto merged https://gitlab.wikimedia.org/repos/releng/gitlab-trusted-runner/-/merge_reques... [13:46:58] (03CR) 10Lucas Werkmeister (WMDE): Run EntitySchema CI on master once a day (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/948558 (https://phabricator.wikimedia.org/T333660) (owner: 10Michael GroƟe) [13:53:49] 10GitLab (Pipeline Services MigrationšŸ¤), 10collaboration-services, 10Patch-For-Review: Move micro sites from Ganeti to Kubernetes and from Gerrit to GitLab - https://phabricator.wikimedia.org/T300171 (10CodeReviewBot) jelto opened https://gitlab.wikimedia.org/repos/sre/miscweb/bugzilla/-/merge_requests/1 ad... [13:54:47] 10GitLab (Pipeline Services MigrationšŸ¤), 10collaboration-services, 10Patch-For-Review: Move micro sites from Ganeti to Kubernetes and from Gerrit to GitLab - https://phabricator.wikimedia.org/T300171 (10CodeReviewBot) jelto merged https://gitlab.wikimedia.org/repos/sre/miscweb/bugzilla/-/merge_requests/1 ad... [13:57:32] (03PS1) 10Sohom Datta: Add BetaFeatures as a phan dependency to ProofreadPage [integration/config] - 10https://gerrit.wikimedia.org/r/952218 [14:03:12] (03PS2) 10Jforrester: Zuul: [mediawiki/extensions/ProofreadPage] Add BetaFeatures to phan dependencies [integration/config] - 10https://gerrit.wikimedia.org/r/952218 (owner: 10Sohom Datta) [14:03:16] (03CR) 10Jforrester: [C: 03+2] Zuul: [mediawiki/extensions/ProofreadPage] Add BetaFeatures to phan dependencies [integration/config] - 10https://gerrit.wikimedia.org/r/952218 (owner: 10Sohom Datta) [14:04:37] (03Merged) 10jenkins-bot: Zuul: [mediawiki/extensions/ProofreadPage] Add BetaFeatures to phan dependencies [integration/config] - 10https://gerrit.wikimedia.org/r/952218 (owner: 10Sohom Datta) [14:04:59] 10GitLab (Pipeline Services MigrationšŸ¤), 10collaboration-services, 10Patch-For-Review: Move micro sites from Ganeti to Kubernetes and from Gerrit to GitLab - https://phabricator.wikimedia.org/T300171 (10Jelto) >>! In T300171#9016375, @Dzahn wrote: > Yep! So regarding static-bugzilla on Gerrit. That content r... [14:05:05] 10GitLab (Pipeline Services MigrationšŸ¤), 10collaboration-services, 10Patch-For-Review: Move micro sites from Ganeti to Kubernetes and from Gerrit to GitLab - https://phabricator.wikimedia.org/T300171 (10Jelto) [14:07:38] !log Zuul: [mediawiki/extensions/ProofreadPage] Add BetaFeatures to phan dependencies [14:07:40] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [14:11:52] 10GitLab (Pipeline Services MigrationšŸ¤), 10Content-Transform-Team, 10Maintenance-Worktype: Migrate content-transform pipeline repos to GitLab - https://phabricator.wikimedia.org/T344735 (10MSantos) [14:13:31] (03CR) 10Krinkle: Follows-up 8aabc136595 from 2018, which is interesting because Apache wasn't added until 2020 with 5439da36e5. (031 comment) [integration/quibble] - 10https://gerrit.wikimedia.org/r/952016 (owner: 10Krinkle) [14:18:19] (03PS2) 10Krinkle: Fix missing MW_QUIBBLE_CI env in Apache/php-fpm context [integration/quibble] - 10https://gerrit.wikimedia.org/r/952016 [14:18:23] (03PS1) 10Krinkle: docs: Document how to test Quibble changes [integration/quibble] - 10https://gerrit.wikimedia.org/r/952224 [14:20:51] (03PS3) 10Krinkle: Fix missing MW_QUIBBLE_CI env in Apache/php-fpm context [integration/quibble] - 10https://gerrit.wikimedia.org/r/952016 [14:23:29] (03CR) 10CI reject: [V: 04-1] Fix missing MW_QUIBBLE_CI env in Apache/php-fpm context [integration/quibble] - 10https://gerrit.wikimedia.org/r/952016 (owner: 10Krinkle) [14:49:36] 10GitLab (Account Approval), 10Release-Engineering-Team: Requesting GitLab account activation for Reputation22 - https://phabricator.wikimedia.org/T344902 (10brennen) 05Openā†’03Resolved a:03brennen [15:03:39] (03CR) 10Michael GroƟe: Run EntitySchema CI on master once a day (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/948558 (https://phabricator.wikimedia.org/T333660) (owner: 10Michael GroƟe) [15:37:31] 10Release-Engineering-Team, 10Scap, 10Wikimedia-production-error: Maintenance script appservers running code from wmf.20 when version not live - https://phabricator.wikimedia.org/T344929 (10DAlangi_WMF) [15:39:49] 10Release-Engineering-Team (Priority Backlog šŸ“„), 10Patch-For-Review, 10Release, 10Train Deployments: 1.41.0-wmf.23 deployment blockers - https://phabricator.wikimedia.org/T343725 (10thcipriani) [15:39:51] 10Release-Engineering-Team, 10Scap, 10Wikimedia-production-error: Maintenance script appservers running code from wmf.20 when version not live - https://phabricator.wikimedia.org/T344929 (10thcipriani) [15:43:36] 10Release-Engineering-Team, 10Scap, 10Wikimedia-production-error: Maintenance script appservers running code from wmf.20 when version not live - https://phabricator.wikimedia.org/T344929 (10ArielGlenn) grep on mwmaint1002 for php, looking for long running stuff, gives me only Jul11 0:00 /bin/bash /usr... [15:54:50] 10Release-Engineering-Team, 10Wikimedia-Site-requests: Clarify whether config patches need reviews before being scheduled for deployment - https://phabricator.wikimedia.org/T344409 (10Anoop) > Another pair of eyes will review this patch in Gerrit. I always assumed deployer would be reviewer of patch, also it w... [16:16:09] 10Release-Engineering-Team, 10Scap, 10Wikimedia-production-error: Maintenance script appservers running code from wmf.20 when version not live - https://phabricator.wikimedia.org/T344929 (10bd808) I was happy to find an item in [[https://logstash.wikimedia.org/app/discover#/doc/logstash-*/logstash-deploy-1-7... [16:30:18] 10Phabricator, 10Technical-Debt: Remove custom WMF Phab downstream hacks superseded by upstream Phorge changes - https://phabricator.wikimedia.org/T341799 (10Aklapper) [16:37:13] 10Release-Engineering-Team, 10Scap, 10Wikimedia-production-error: Maintenance script appservers running code from wmf.20 when version not live - https://phabricator.wikimedia.org/T344929 (10Urbanecm) 05Openā†’03Declined I've started both scripts manually as part of {T315510}. This script is a long-running... [16:37:15] 10Release-Engineering-Team (Priority Backlog šŸ“„), 10Patch-For-Review, 10Release, 10Train Deployments: 1.41.0-wmf.23 deployment blockers - https://phabricator.wikimedia.org/T343725 (10Urbanecm) [16:37:24] 10Release-Engineering-Team, 10Scap, 10Wikimedia-production-error: Maintenance script appservers running code from wmf.20 when version not live - https://phabricator.wikimedia.org/T344929 (10bd808) >>! In T344929#9117840, @bd808 wrote: > There are two similar processes running at this moment on mwmaint1002 th... [16:40:49] 10Continuous-Integration-Config, 10MW-1.39-notes (1.39.0-wmf.9; 2022-04-25), 10Patch-For-Review: Evaluate phpbench for benchmarking and guarding against performance regressions - https://phabricator.wikimedia.org/T291549 (10Aklapper) [17:02:29] 10Gitlab-Application-Security-Pipeline: Establish a more specific policy/best practices around security include failures - https://phabricator.wikimedia.org/T342469 (10Mstyles) Draft: https://docs.google.com/document/d/1ZJ8dTAZeTaHCkeGyl5fWbMQGtzMS3kp2D7ylabjq4B0/edit#heading=h.uw614m9wst4l [17:22:44] 10Release-Engineering-Team, 10sre-alert-triage: Alert triage: overdue critical alert - https://phabricator.wikimedia.org/T342755 (10thcipriani) >>! In T342755#9115945, @fgiunchedi wrote: >>>! In T342755#9114368, @thcipriani wrote: >> Hrm. We get an email from the systemd timer for this, so the alert is probabl... [17:26:20] thcipriani: is there a fun story behind https://gitlab.wikimedia.org/repos/releng/release/-/blob/main/make-deployment-calendar/deployments-calendar.yaml being encoded in YAML's JSON-compatible 'flow' style, or is that just how you like to see YAML written? [17:56:12] i'm not sure if the story is fun, but i think somebody switched it from json to yaml at some point. [19:25:48] 10GitLab (CI & Job Runners), 10Release-Engineering-Team (Priority Backlog šŸ“„): Migrate to using new GitLab CI runner authentication scheme - https://phabricator.wikimedia.org/T344951 (10dduvall) [19:35:03] 10Release-Engineering-Team (Priority Backlog šŸ“„): Adopt gitlab-cloud-runner Digital Ocean based cluster as the default for untagged jobs - https://phabricator.wikimedia.org/T344874 (10dduvall) WMCS runners are no longer scheduling untagged jobs. Thanks for the review/merge, @Jelto ! [19:35:28] 10Release-Engineering-Team (Priority Backlog šŸ“„): Adopt gitlab-cloud-runner Digital Ocean based cluster as the default for untagged jobs - https://phabricator.wikimedia.org/T344874 (10dduvall) 05Openā†’03Resolved [19:46:56] 10Phabricator: Exception: Map returned by "newPagingMapFromCursorObject()" in class "ManiphestTaskQuery" omits required key - https://phabricator.wikimedia.org/T344241 (10thcipriani) Also saw this one today from a search: `Map returned by "newPagingMapFromCursorObject()" in class "ManiphestTaskQuery" omits requi... [19:55:18] 10Phabricator (Upstream), 10Upstream: "Tags" field doesn't contain project when new task is opened in a new tab via the workboard - https://phabricator.wikimedia.org/T316199 (10thcipriani) 05Openā†’03Resolved Should be deployed now. Thanks @Dylsss ! [20:36:23] 10Release-Engineering-Team (Priority Backlog šŸ“„), 10Epic, 10Patch-For-Review, 10Release Pipeline (Blubber): Upgrade docker on integration hosts for fixes to BuildKit builder - https://phabricator.wikimedia.org/T318382 (10dduvall) >>! In T318382#8377321, @dduvall wrote: >>>! In T318382#8317695, @dduvall wrot...