[01:20:13] (03CR) 10Jforrester: Zuul: [mediawiki/extensions/VisualEditor] Re-add DiscussionTools dependency (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/837710 (https://phabricator.wikimedia.org/T319202) (owner: 10Jforrester) [01:39:29] (03CR) 10Jforrester: "Hmm, clever, though I'm not sure if this is quite right. Also these aren't "submodules", that's a git term." [integration/config] - 10https://gerrit.wikimedia.org/r/948653 (https://phabricator.wikimedia.org/T328240) (owner: 10Umherirrender) [01:41:58] (03PS6) 10Jforrester: jjb: [quibble-fundraising-{ext}…] Directly clone each extension dependency [integration/config] - 10https://gerrit.wikimedia.org/r/948653 (https://phabricator.wikimedia.org/T328240) (owner: 10Umherirrender) [05:30:26] 10Scap, 10PyBal, 10SRE, 10Traffic, and 3 others: High rate of errors and increased latency on uncached MediaWiki requests due to infrastructure outage - https://phabricator.wikimedia.org/T337497 (10Joe) 05Open→03Resolved a:03Joe The problem that caused this outage has been fixed. [07:35:48] 10Release-Engineering-Team: Clarify whether config patches need reviews before being scheduled for deployment - https://phabricator.wikimedia.org/T344409 (10taavi) [07:38:26] 10Release-Engineering-Team: Clarify whether config patches need reviews before being scheduled for deployment - https://phabricator.wikimedia.org/T344409 (10ArielGlenn) Counterpoint: knowing the config settings doesn't mean understanding the code activated by those changes or its possible impacts. At least, not... [07:59:45] 10Release-Engineering-Team: Clarify whether config patches need reviews before being scheduled for deployment - https://phabricator.wikimedia.org/T344409 (10Joe) I have another take on this. I think, given those are config patches, the main question is not the //how//, but the //what//. In some cases, a configu... [08:13:28] 10GitLab (Pipeline Services Migration🐤), 10Research, 10collaboration-services: Move research webpages to gitlab - https://phabricator.wikimedia.org/T334511 (10Clement_Goubert) [08:43:47] 10Release-Engineering-Team: Clarify whether config patches need reviews before being scheduled for deployment - https://phabricator.wikimedia.org/T344409 (10kostajh) Establishing a culture of getting a +1 for safety / QA makes sense to me, even if that would result in waiting additional hours or days before depl... [08:47:57] 10GitLab (CI & Job Runners), 10Release-Engineering-Team (Escape Goats🐐), 10Patch-For-Review: Replace deprecated `CI_JOB_JWT` CI variable in Kokkuri - https://phabricator.wikimedia.org/T337474 (10CodeReviewBot) jnuche merged https://gitlab.wikimedia.org/repos/releng/kokkuri/-/merge_requests/73 jwt: replace d... [09:02:52] 10GitLab (Pipeline Services Migration🐤), 10Release-Engineering-Team, 10MediaWiki-Docker, 10dev-images, and 3 others: MySQL/MariaDB images for development environments - https://phabricator.wikimedia.org/T238925 (10kostajh) >>! In T238925#9000146, @hashar wrote: >>>! In T238925#8996824, @kostajh wrote: >>>>... [09:04:10] 10GitLab (CI & Job Runners), 10Release-Engineering-Team (Escape Goats🐐), 10Patch-For-Review: Replace deprecated `CI_JOB_JWT` CI variable in Kokkuri - https://phabricator.wikimedia.org/T337474 (10CodeReviewBot) jnuche opened https://gitlab.wikimedia.org/repos/releng/kokkuri/-/merge_requests/84 Revert "jwt: r... [09:08:53] 10GitLab (CI & Job Runners), 10Release-Engineering-Team (Escape Goats🐐), 10Patch-For-Review: Replace deprecated `CI_JOB_JWT` CI variable in Kokkuri - https://phabricator.wikimedia.org/T337474 (10CodeReviewBot) jnuche merged https://gitlab.wikimedia.org/repos/releng/kokkuri/-/merge_requests/84 Revert "jwt: r... [11:17:51] 10GitLab (Integrations), 10Phabricator, 10Release-Engineering-Team (Escape Goats🐐): Get GitLab to render `T{\d}+` in MR overviews, comments, etc. as links to Phabricator - https://phabricator.wikimedia.org/T337570 (10Jelto) Maybe it's possible to add a new GitLab flavored markdown (GLFM) extension which unde... [11:34:18] (03CR) 10Umherirrender: jjb: [quibble-fundraising-{ext}…] Directly clone each extension dependency (033 comments) [integration/config] - 10https://gerrit.wikimedia.org/r/948653 (https://phabricator.wikimedia.org/T328240) (owner: 10Umherirrender) [12:20:20] 10GitLab (CI & Job Runners), 10Release-Engineering-Team (Escape Goats🐐), 10Patch-For-Review: Replace deprecated `CI_JOB_JWT` CI variable in Kokkuri - https://phabricator.wikimedia.org/T337474 (10CodeReviewBot) jnuche opened https://gitlab.wikimedia.org/repos/releng/kokkuri/-/merge_requests/85 jwt: replace d... [12:26:01] 10GitLab (CI & Job Runners), 10Release-Engineering-Team (Escape Goats🐐), 10Patch-For-Review: Replace deprecated `CI_JOB_JWT` CI variable in Kokkuri - https://phabricator.wikimedia.org/T337474 (10CodeReviewBot) jnuche merged https://gitlab.wikimedia.org/repos/releng/kokkuri/-/merge_requests/85 jwt: replace d... [12:33:00] 10Release-Engineering-Team (Escape Goats🐐), 10Patch-For-Review, 10Release, 10Train Deployments: 1.41.0-wmf.22 deployment blockers - https://phabricator.wikimedia.org/T343724 (10Urbanecm) [12:35:49] 10GitLab (CI & Job Runners), 10Release-Engineering-Team (Escape Goats🐐), 10Patch-For-Review: Replace deprecated `CI_JOB_JWT` CI variable in Kokkuri - https://phabricator.wikimedia.org/T337474 (10CodeReviewBot) jnuche opened https://gitlab.wikimedia.org/repos/releng/kokkuri/-/merge_requests/86 use latest ver... [12:36:33] 10GitLab (Pipeline Services Migration🐤), 10Research, 10collaboration-services, 10Patch-For-Review: Move research webpages to gitlab - https://phabricator.wikimedia.org/T334511 (10Jelto) On the infrastructure side everything is prepared for switching both services to GitLab and Kubernetes/wikikube. I invit... [12:38:29] 10GitLab (CI & Job Runners), 10Release-Engineering-Team (Escape Goats🐐), 10Patch-For-Review: Replace deprecated `CI_JOB_JWT` CI variable in Kokkuri - https://phabricator.wikimedia.org/T337474 (10CodeReviewBot) jnuche merged https://gitlab.wikimedia.org/repos/releng/kokkuri/-/merge_requests/86 use latest ver... [12:54:46] 10Continuous-Integration-Infrastructure, 10Jenkins, 10Release-Engineering-Team (Escape Goats🐐), 10Patch-For-Review: Add Scap3 config option to disable systemd services on secondary hosts - https://phabricator.wikimedia.org/T343447 (10CodeReviewBot) jnuche merged https://gitlab.wikimedia.org/repos/releng/sc... [13:20:20] 10Scap, 10MW-on-K8s: scap backport fails to build a image for k8s deployment - https://phabricator.wikimedia.org/T344438 (10Urbanecm_WMF) [13:20:27] 10Scap, 10MW-on-K8s: scap backport fails to build a image for k8s deployment - https://phabricator.wikimedia.org/T344438 (10Urbanecm_WMF) p:05Triage→03High Seems like a critical bug. [13:23:44] 10Scap, 10MW-on-K8s: scap backport fails to build a image for k8s deployment - https://phabricator.wikimedia.org/T344438 (10Clement_Goubert) Tagging #infrastructure-foundations #packaging because that looks like it may be an issue with the signing of the InRelease file on the apt repo. [13:24:11] 10Scap, 10Infrastructure-Foundations, 10MW-on-K8s, 10Packaging: scap backport fails to build a image for k8s deployment - https://phabricator.wikimedia.org/T344438 (10Clement_Goubert) [13:24:35] 10WikimediaDebug, 10Observability-Tracing: Add support for request tracing to WikimediaDebug browser extension - https://phabricator.wikimedia.org/T340573 (10Krinkle) [13:24:43] 10WikimediaDebug: Extract and display hostname from server header - https://phabricator.wikimedia.org/T340727 (10Krinkle) [13:26:42] 10Scap, 10Infrastructure-Foundations, 10MW-on-K8s, 10Packaging: scap backport fails to build a image for k8s deployment - https://phabricator.wikimedia.org/T344438 (10Urbanecm_WMF) >>! In T344438#9099184, @Clement_Goubert wrote: > Tagging #infrastructure-foundations #packaging because that looks like it ma... [13:37:05] 10Fresh, 10good first task: Document the security reasons for mounting .git as read-only - https://phabricator.wikimedia.org/T259977 (10Krinkle) [13:37:23] 10Fresh, 10Developer Productivity: Document how to restrict which paths may be mounted by Docker/Podman Desktop - https://phabricator.wikimedia.org/T259976 (10Krinkle) [13:37:34] 10Fresh, 10MediaWiki-Core-Tests, 10Browser-Tests, 10User-zeljkofilipin: Fresh problem when running Selenium tests - https://phabricator.wikimedia.org/T313899 (10Krinkle) [13:37:46] 10Fresh, 10ARM support, 10User-zeljkofilipin: ECONNREFUSED error when running Selenium tests on M1 Mac - https://phabricator.wikimedia.org/T308889 (10Krinkle) [13:38:29] 10Continuous-Integration-Config, 10Fresnel, 10OOUI: Add a Fresnel task to OOUI repo to check performance impacts of changes as they get made - https://phabricator.wikimedia.org/T220024 (10Krinkle) [13:38:36] 10Scap, 10Infrastructure-Foundations, 10MW-on-K8s, 10Packaging: scap backport fails to build a image for k8s deployment - https://phabricator.wikimedia.org/T344438 (10Clement_Goubert) 05Open→03In progress p:05High→03Unbreak! Raising to UBN, this breaks all mw-on-k8s deployments. [13:39:30] 10WikimediaDebug, 10Patch-For-Review: Support WebExtensions Manifest v3 - https://phabricator.wikimedia.org/T312694 (10Krinkle) [13:40:41] 10Scap, 10Infrastructure-Foundations, 10MW-on-K8s, 10Packaging: scap backport fails to build a image for k8s deployment - https://phabricator.wikimedia.org/T344438 (10Clement_Goubert) @Joe is investigating [13:40:49] 10WikimediaDebug: Make WikimediaDebug status more sticky - https://phabricator.wikimedia.org/T315111 (10Krinkle) [13:41:07] 10WikimediaDebug: Disallow enabling "XHGui" and "Inline profile" together - https://phabricator.wikimedia.org/T259952 (10Krinkle) [13:41:42] 10WikimediaDebug, 10Upstream: Display better error message in XHGui for empty profile - https://phabricator.wikimedia.org/T259950 (10Krinkle) [13:41:54] 10WikimediaDebug, 10observability, 10Patch-For-Review: Prometheus exporter for XHGui - https://phabricator.wikimedia.org/T256039 (10Krinkle) [13:42:30] 10WikimediaDebug, 10Performance-Team: Upstream XHGui changes - https://phabricator.wikimedia.org/T254793 (10Krinkle) 05Open→03Resolved [13:42:47] 10WikimediaDebug: Evaluate single-tab mode for WikimediaDebug - https://phabricator.wikimedia.org/T269031 (10Krinkle) [13:45:24] 10Release-Engineering-Team (Radar), 10Scap, 10MediaWiki-Internationalization, 10Performance-Team (Radar): Use static php array files for l10n cache at WMF (instead of CDB) - https://phabricator.wikimedia.org/T99740 (10Krinkle) [13:57:46] 10Release-Engineering-Team (Seen), 10MW-on-K8s: Experiment with generating json config - https://phabricator.wikimedia.org/T267057 (10Krinkle) [14:33:45] 10GitLab, 10Release-Engineering-Team: Test Trusted Contributors group in devtools GitLab - https://phabricator.wikimedia.org/T344379 (10dancy) [14:48:51] (03PS1) 10Urbanecm: Provide a secondary database [integration/quibble] - 10https://gerrit.wikimedia.org/r/949986 (https://phabricator.wikimedia.org/T342763) [14:51:26] (03CR) 10CI reject: [V: 04-1] Provide a secondary database [integration/quibble] - 10https://gerrit.wikimedia.org/r/949986 (https://phabricator.wikimedia.org/T342763) (owner: 10Urbanecm) [14:56:04] (03PS2) 10Urbanecm: Provide a secondary database [integration/quibble] - 10https://gerrit.wikimedia.org/r/949986 (https://phabricator.wikimedia.org/T342763) [14:57:07] (03PS3) 10Urbanecm: Provide a secondary database [integration/quibble] - 10https://gerrit.wikimedia.org/r/949986 (https://phabricator.wikimedia.org/T342763) [14:59:24] (03CR) 10CI reject: [V: 04-1] Provide a secondary database [integration/quibble] - 10https://gerrit.wikimedia.org/r/949986 (https://phabricator.wikimedia.org/T342763) (owner: 10Urbanecm) [15:31:34] 10Scap, 10Infrastructure-Foundations, 10MW-on-K8s, 10Packaging: scap backport fails to build a image for k8s deployment - https://phabricator.wikimedia.org/T344438 (10Clement_Goubert) 05In progress→03Resolved a:03Clement_Goubert We encountered another issue while fixing, which delayed resolution a bi... [15:32:39] 10Continuous-Integration-Infrastructure, 10Jenkins, 10Release-Engineering-Team (Escape Goats🐐), 10Patch-For-Review: Add Scap3 config option to disable systemd services on secondary hosts - https://phabricator.wikimedia.org/T343447 (10CodeReviewBot) jnuche merged https://gitlab.wikimedia.org/repos/releng/je... [15:37:26] (03PS4) 10Urbanecm: Provide a secondary database [integration/quibble] - 10https://gerrit.wikimedia.org/r/949986 (https://phabricator.wikimedia.org/T342763) [15:38:26] 10Release-Engineering-Team (Escape Goats🐐), 10Patch-For-Review, 10Release, 10Train Deployments: 1.41.0-wmf.22 deployment blockers - https://phabricator.wikimedia.org/T343724 (10Urbanecm) [15:39:41] 10Continuous-Integration-Infrastructure, 10Jenkins, 10Release-Engineering-Team (Escape Goats🐐), 10Patch-For-Review: Add Scap3 config option to disable systemd services on secondary hosts - https://phabricator.wikimedia.org/T343447 (10jnuche) 05Open→03Resolved [15:40:05] (03CR) 10CI reject: [V: 04-1] Provide a secondary database [integration/quibble] - 10https://gerrit.wikimedia.org/r/949986 (https://phabricator.wikimedia.org/T342763) (owner: 10Urbanecm) [16:13:51] 10GitLab (Administration, Settings & Policy), 10Phabricator, 10Release-Engineering-Team (Priority Backlog 📥), 10User-brennen: Create a form for tracking administrative privilege requests for GitLab - https://phabricator.wikimedia.org/T314495 (10Aklapper) 05Open→03Resolved a:03brennen >>! In T314495#8... [16:22:12] 10Release-Engineering-Team (Deployment Training Requests): Deployment Training Request for jebe - https://phabricator.wikimedia.org/T341559 (10thcipriani) ## {icon check-circle-o} Training completed! Hey @JEbe-WMF thanks for attending deployment training Here's a list of the next steps to take: * Attend **MOR... [16:22:47] 10Release-Engineering-Team (Deployment Training Requests): Deployment Training Request for jebe - https://phabricator.wikimedia.org/T341559 (10thcipriani) 05Open→03Resolved a:03thcipriani [16:24:58] 10Release-Engineering-Team (Deployment Training Requests): Deployment training request for Sergio Gimeno - https://phabricator.wikimedia.org/T320722 (10thcipriani) 05Open→03Invalid 👋 @Sgs — closing this task for now. If you're still interested in training, please re-open and update the date/timeslot you'd b... [16:25:45] 10Release-Engineering-Team (Deployment Training Requests): Deployment training request for allanjeremy.thisdot - https://phabricator.wikimedia.org/T332313 (10thcipriani) 👋 @allanjeremy.thisdot — closing this task for now. If you're still interested in training, please re-open and update the date/timeslot you'd... [16:25:55] 10Release-Engineering-Team (Deployment Training Requests): Deployment training request for allanjeremy.thisdot - https://phabricator.wikimedia.org/T332313 (10thcipriani) 05Open→03Invalid [16:29:16] 10Release-Engineering-Team (Deployment Training Requests): Deployment training request for dbrant - https://phabricator.wikimedia.org/T344157 (10thcipriani) p:05Triage→03Medium Hey @Dbrant I added you just now to the window for today 😬 If //that's// too short of notice for you, happy to add you on the 31st... [16:45:26] 10Release-Engineering-Team: Clarify whether config patches need reviews before being scheduled for deployment - https://phabricator.wikimedia.org/T344409 (10matmarex) I'd support removing this point from the documentation. I always assumed that the deployer serves as the "other pair of eyes" and reviews the pat... [16:50:32] 10GitLab (Integrations), 10Phabricator, 10Release-Engineering-Team (Escape Goats🐐): Get GitLab to render `T{\d}+` in MR overviews, comments, etc. as links to Phabricator - https://phabricator.wikimedia.org/T337570 (10dduvall) >>! In T337570#9098829, @Jelto wrote: > Maybe it's possible to add a new GitLab fla... [17:29:10] 10Release-Engineering-Team: Clarify whether config patches need reviews before being scheduled for deployment - https://phabricator.wikimedia.org/T344409 (10thcipriani) I'll grant that most of the time a deployer is the only reviewer. But having more reviewers makes deploying easier so I'm pro leaving the langua... [18:03:38] (03PS5) 10Urbanecm: Provide a secondary database [integration/quibble] - 10https://gerrit.wikimedia.org/r/949986 (https://phabricator.wikimedia.org/T342763) [18:05:06] (03PS6) 10Urbanecm: Provide a secondary database [integration/quibble] - 10https://gerrit.wikimedia.org/r/949986 (https://phabricator.wikimedia.org/T342763) [19:39:34] 10Release-Engineering-Team (Escape Goats🐐), 10Patch-For-Review, 10Release, 10Train Deployments: 1.41.0-wmf.22 deployment blockers - https://phabricator.wikimedia.org/T343724 (10thcipriani) a:05brennen→03dancy [19:39:36] 10Release-Engineering-Team (Priority Backlog 📥), 10Release, 10Train Deployments: 1.41.0-wmf.23 deployment blockers - https://phabricator.wikimedia.org/T343725 (10thcipriani) p:05Triage→03Medium a:03dduvall [19:56:29] (03PS7) 10Urbanecm: Provide a secondary database [integration/quibble] - 10https://gerrit.wikimedia.org/r/949986 (https://phabricator.wikimedia.org/T342763)