[00:23:14] 10Gerrit, 06Release-Engineering-Team, 06Collaboration-Services, 06Privacy Engineering, and 3 others: Gerrit API docs loads fonts from Google - https://phabricator.wikimedia.org/T393763#12409408 (10Dzahn) deployed httpd config change on gerrit servers. added content-security-policy headers. Only on ` 10Gerrit, 06Release-Engineering-Team, 06Collaboration-Services, 06Privacy Engineering, and 2 others: Gerrit API docs loads fonts from Google - https://phabricator.wikimedia.org/T393763#12409421 (10Dzahn) 05Open→03Resolved a:03Dzahn before: {F106905918} now: {F106905917} [02:10:11] (03PS6) 10Clare Ming: Add Test Kitchen experiment overrides to the header and popup [performance/WikimediaDebug] - 10https://gerrit.wikimedia.org/r/1344123 (https://phabricator.wikimedia.org/T438283) [02:25:08] (03PS1) 10Kosta Harlan: Zuul: [mediawiki/extensions/WikimediaAntiAbuse] Add AbuseFilter dependency [integration/config] - 10https://gerrit.wikimedia.org/r/1352698 (https://phabricator.wikimedia.org/T440534) [02:41:13] 10Beta-Cluster-Infrastructure, 07Crosswiki, 10Wiki-Setup (Create): Create templates wiki to hold global templates and documentation during development and testing - https://phabricator.wikimedia.org/T440142#12409525 (10Bugreporter) [02:41:42] 10Beta-Cluster-Infrastructure, 07Crosswiki, 10Wiki-Setup (Create): Create templates wiki to hold global templates and documentation during development and testing - https://phabricator.wikimedia.org/T440142#12409526 (10Bugreporter) [02:54:32] (03PS7) 10Clare Ming: Add Test Kitchen experiment overrides to the header and popup [performance/WikimediaDebug] - 10https://gerrit.wikimedia.org/r/1344123 (https://phabricator.wikimedia.org/T438283) [02:56:12] (03CR) 10Clare Ming: Add Test Kitchen experiment overrides to the header and popup (032 comments) [performance/WikimediaDebug] - 10https://gerrit.wikimedia.org/r/1344123 (https://phabricator.wikimedia.org/T438283) (owner: 10Clare Ming) [03:53:51] 10Continuous-Integration-Infrastructure, 06Release-Engineering-Team, 06Test Platform, 06tools-infrastructure-team: Add more CPUs to quibble jobs - https://phabricator.wikimedia.org/T439808#12409614 (10Peter) a:03Peter Let me ask for a quota increase as the first step. [05:00:22] 10Beta-Cluster-Infrastructure, 07Crosswiki, 10Wiki-Setup (Create): Create templates wiki to hold global templates and documentation during development and testing - https://phabricator.wikimedia.org/T440142#12409642 (10Bugreporter) Note WikiMirror is not yet ready to be deployed to production wikis. There ar... [05:45:13] (03PS1) 10Kevin Bazira: decision-models: containerize clef model-server [integration/config] - 10https://gerrit.wikimedia.org/r/1352881 (https://phabricator.wikimedia.org/T440223) [05:49:33] (03PS2) 10Kevin Bazira: inference-services: Add CI pipeline jobs for clef model-server [integration/config] - 10https://gerrit.wikimedia.org/r/1352499 (https://phabricator.wikimedia.org/T440223) [05:51:00] (03Abandoned) 10Kevin Bazira: decision-models: containerize clef model-server [integration/config] - 10https://gerrit.wikimedia.org/r/1352881 (https://phabricator.wikimedia.org/T440223) (owner: 10Kevin Bazira) [05:58:44] (03CR) 10Kevin Bazira: "We added the test pipeline." [integration/config] - 10https://gerrit.wikimedia.org/r/1352499 (https://phabricator.wikimedia.org/T440223) (owner: 10Kevin Bazira) [06:00:27] (03CR) 10Hashar: [C:03+2] Zuul: [mediawiki/extensions/WikimediaAntiAbuse] Add AbuseFilter dependency [integration/config] - 10https://gerrit.wikimedia.org/r/1352698 (https://phabricator.wikimedia.org/T440534) (owner: 10Kosta Harlan) [06:01:33] (03Merged) 10jenkins-bot: Zuul: [mediawiki/extensions/WikimediaAntiAbuse] Add AbuseFilter dependency [integration/config] - 10https://gerrit.wikimedia.org/r/1352698 (https://phabricator.wikimedia.org/T440534) (owner: 10Kosta Harlan) [08:48:42] 06Release-Engineering-Team (Doing 😎), 10MediaWiki-Change-tagging, 10QS-Test-Automation, 10Catalyst (Luka Ijo Pimeja Jan), 07Essential-Work: Catalyst the first edit using each tag is saved without its tag - https://phabricator.wikimedia.org/T439780#12410188 (10jnuche) [11:41:54] 06Release-Engineering-Team (Doing 😎), 07Essential-Work, 05Release, 05Train Deployments: 1.47.0-wmf.23 deployment blockers - https://phabricator.wikimedia.org/T438219#12410910 (10Aklapper) 05Open→03Resolved 🔥 This is fine. 🔥 [11:59:14] 10Diffusion, 10Phabricator (Upstream), 06Release-Engineering-Team (Doing 😎), 07Upstream: Bad repo data: PhabricatorDataNotAttachedException browsing particular git repositories - https://phabricator.wikimedia.org/T421682#12410998 (10Aklapper) a:03Aklapper [12:14:05] 10Diffusion, 10Phabricator (Upstream), 06Release-Engineering-Team (Doing 😎), 07Upstream: Bad repo data: PhabricatorDataNotAttachedException browsing particular git repositories - https://phabricator.wikimedia.org/T421682#12411066 (10Aklapper) [14:10:24] (03PS1) 10Kosta Harlan: Zuul: [mediawiki/extensions/WikimediaAntiAbuse] Add CheckUser phan dependency [integration/config] - 10https://gerrit.wikimedia.org/r/1353231 [14:29:03] (03PS1) 10Jforrester: jjb: Create mediawiki-core-docker-compose-images job [integration/config] - 10https://gerrit.wikimedia.org/r/1353244 [14:29:04] (03PS1) 10Jforrester: Zuul: [mediawiki/core] Add experimental docker check job [integration/config] - 10https://gerrit.wikimedia.org/r/1353245 [14:29:26] (03CR) 10Santiago Faci: [C:03+1] "As far as I can say, it looks good to me. I have been testing it locally and it's working as expected" [performance/WikimediaDebug] - 10https://gerrit.wikimedia.org/r/1344123 (https://phabricator.wikimedia.org/T438283) (owner: 10Clare Ming) [14:30:21] (03CR) 10CI reject: [V:04-1] Zuul: [mediawiki/core] Add experimental docker check job [integration/config] - 10https://gerrit.wikimedia.org/r/1353245 (owner: 10Jforrester) [14:30:25] (03CR) 10CI reject: [V:04-1] jjb: Create mediawiki-core-docker-compose-images job [integration/config] - 10https://gerrit.wikimedia.org/r/1353244 (owner: 10Jforrester) [14:35:58] hashar: o/ just sharing this here in case it got lost in all the pings : ) [14:35:58] https://gerrit.wikimedia.org/r/c/integration/config/+/1352499/comments/f9c40251_f0655d8d [14:35:58] please have a look whenever you get a minute. thanks! [14:45:43] kevinbazira: !! :) [14:48:30] oh [14:48:37] but you merged https://gerrit.wikimedia.org/r/c/machinelearning/liftwing/inference-services/+/1352454 withouta CI run :b [14:48:48] and https://gerrit.wikimedia.org/r/c/machinelearning/liftwing/inference-services/+/1352492?usp=search as well [14:48:56] so who knows whether they pass :b I guess the wyill [14:49:06] that addresses the issue I had in mind about "in which order to merge those patches" [14:50:20] https://gerrit.wikimedia.org/r/c/integration/config/+/1352499/comments/01b768ba_1d78d3f0 [14:50:22] I am deploying it [14:51:39] great. thanks! once it's up and running we'll trigger CI by adding changes under `src/models/decision_models/clef/`. [14:51:47] yeah [14:51:55] then the thing is you got those patches merged without any tests [14:51:59] being run by CI [14:52:20] so POTENTIALLY it COULD have broken the repo for the next person touching that clef decision model :) [14:52:36] I am picky :b [14:52:41] (03CR) 10CI reject: [V:04-1] inference-services: Add CI pipeline jobs for clef model-server [integration/config] - 10https://gerrit.wikimedia.org/r/1352499 (https://phabricator.wikimedia.org/T440223) (owner: 10Kevin Bazira) [14:53:38] (03CR) 10Hashar: [C:03+2] "CI failed because I forgot to deploy the jobs." [integration/config] - 10https://gerrit.wikimedia.org/r/1352499 (https://phabricator.wikimedia.org/T440223) (owner: 10Kevin Bazira) [14:53:46] "I am picky :b" no worries, I am used to you by now : ) [14:54:05] in this specific case it is not much of a trouble [14:54:13] but for MediaWiki environment it can cause some troubles [14:54:22] (03Merged) 10jenkins-bot: inference-services: Add CI pipeline jobs for clef model-server [integration/config] - 10https://gerrit.wikimedia.org/r/1352499 (https://phabricator.wikimedia.org/T440223) (owner: 10Kevin Bazira) [14:54:44] yep it isn't, we usually do this for the isvc repo [14:55:01] I have deployed the CI config change, so you can send a dummy change to Gerrit and verify it triggers the tests for the clef decisions model [14:55:16] super. thanks a lot for your help. [14:55:46] thx for caring about the inference models (what ever it is :b ) [15:14:02] 10Scap: Newline in scap sync-file message: no notification, no SAL entry - https://phabricator.wikimedia.org/T217558#12412203 (10dancy) →14Duplicate dup:03T438270 [15:14:02] 06Release-Engineering-Team, 10Scap: scap shouldn't attempt to !log messages with a newline - https://phabricator.wikimedia.org/T438270#12412205 (10dancy) [15:17:03] 06Release-Engineering-Team (Priority Backlog 📥), 10Scap, 06ServiceOps, 07Essential-Work: Image building is running out of space in `/srv` - https://phabricator.wikimedia.org/T438148#12412223 (10dancy) 05Open→03Resolved a:03dancy [15:20:06] 06Release-Engineering-Team (Seen), 10Scap, 07Sustainability (Incident Followup): Scap sync-file: report the file on IRC/SAL on canary error rate failure - https://phabricator.wikimedia.org/T186064#12412231 (10dancy) 05Open→03Declined mw-on-k8s makes this irrelevant. [15:22:11] 10Scap: Don't continue scap if sync to all proxies failed - https://phabricator.wikimedia.org/T110791#12412251 (10dancy) 05Open→03Resolved a:03dancy Modern scap mediawiki deployments are staged (testservers, canaries, production) and support stopping and rolling back at any stage. [15:23:06] 10Scap: scap shouldn't log completion (it should log fail!) - https://phabricator.wikimedia.org/T110793#12412259 (10dancy) 05Open→03Resolved a:03dancy This should be the case w/ modern scap. [15:23:41] 10Scap: scap should log the names of the last N hosts - https://phabricator.wikimedia.org/T67025#12412281 (10dancy) 05Open→03Declined Obsolete w/ mw-on-k8s. [15:24:36] 06Release-Engineering-Team (Seen), 10Scap: [scap] Local sync script on any individual server should be atomic - https://phabricator.wikimedia.org/T22085#12412284 (10dancy) 05Open→03Declined Obsoleted by mw-on-k8s. [15:25:04] 10WikimediaDebug, 07Essential-Work, 13Patch-For-Review, 10Test Kitchen (Experiment Platform Sprint 31): Add Test Kitchen functionality to WikimediaDebug - https://phabricator.wikimedia.org/T437240#12412294 (10KReid-WMF) [15:25:10] 10WikimediaDebug, 07Essential-Work, 13Patch-For-Review, 10Test Kitchen (Experiment Platform Sprint 31): Update WikimediaDebug to fetch active experiment config and allow selection of experiments and groups - https://phabricator.wikimedia.org/T438283#12412296 (10KReid-WMF) [15:25:18] 10Scap: [scap] Report summary of file updated at end of scap/sync-* - https://phabricator.wikimedia.org/T69091#12412305 (10dancy) 05Open→03Declined Obsoleted by mw-on-k8s. [15:26:52] 10Scap: [scap] Add a file recording deploy information to all scap/sync-* calls - https://phabricator.wikimedia.org/T72477#12412335 (10dancy) 05Open→03Declined Somewhat obsoleted by mw-on-k8s and possibly completely covered by `/w/deployment-info.php` now. [15:33:29] 10Scap, 06SRE Observability, 13Patch-For-Review: Scap cli statd logging uses inactive statsd endpoint - https://phabricator.wikimedia.org/T436513#12412371 (10dancy) 05Open→03Resolved a:03dancy [15:40:32] 06Release-Engineering-Team, 10Scap, 06Data-Platform-SRE, 10Wikidata, 10Wikidata-Query-Service: scap deploy should not repool a wdqs node that is depooled - https://phabricator.wikimedia.org/T361246#12412440 (10dancy) @dcausse: Do you happen to remember what deployment command you issued that resulted in... [15:41:56] 06Release-Engineering-Team (Radar), 10Scap, 10MW-on-K8s, 06ServiceOps, 10ServiceOps-SharedInfra: Pushing mediawiki-multiversion Docker image from deploy server takes 4 minutes - https://phabricator.wikimedia.org/T341441#12412463 (10dancy) 05Open→03Declined Image push times seem to be satisfactory... [15:42:36] 10Scap, 10MediaWiki-Vendor: Can't scap sync-dir vendor - https://phabricator.wikimedia.org/T301344#12412469 (10dancy) [15:43:10] 10Scap, 10MediaWiki-Vendor: Can't scap sync-dir vendor - https://phabricator.wikimedia.org/T301344#12412472 (10dancy) 05Open→03Declined [15:46:20] 06Release-Engineering-Team, 10Scap, 07Voice & Tone: scap: inconsistent use of dashes and underscores in step names - https://phabricator.wikimedia.org/T340745#12412497 (10dancy) 05Open→03Resolved a:03dancy There is a lot less of this inconsistency now. There are a few stragglers (e.g. cache_git_in... [15:48:37] 06Release-Engineering-Team, 10Scap: Scap sync stops when searching in GNU screen, starts running hours later when resuming screen - https://phabricator.wikimedia.org/T334420#12412527 (10dancy) 05Open→03Declined Declining due to lack of bare metal hosts in production now. [15:49:22] 10Scap, 06serviceops-deprecated, 06SRE-OnFire, 07Sustainability (Incident Followup): Add etcdmirror status check to scap - https://phabricator.wikimedia.org/T317403#12412545 (10dancy) Please provide information on how to determine if etcdmirror is down, or configuration servers are in a degraded state. [15:50:22] 10Scap: scap backport includes ProxyWarning errors - https://phabricator.wikimedia.org/T320436#12412554 (10dancy) @Urbanecm Is this ticket a request for action (e.g., hiding the retry warnings), or just a note (in which case I will close it)? [15:50:43] 06Release-Engineering-Team, 10Scap, 10MW-on-K8s: Scap Mediawiki K8s deployments - https://phabricator.wikimedia.org/T318536#12412556 (10dancy) 05Open→03Resolved a:03dancy [15:51:34] 06Release-Engineering-Team (Radar), 10Scap, 10MW-on-K8s, 06serviceops-deprecated: Deploy MediaWiki images for kubernetes from the deployment servers - https://phabricator.wikimedia.org/T302539#12412559 (10dancy) 05Stalled→03Resolved [15:53:06] 10Scap: scap backport includes ProxyWarning errors - https://phabricator.wikimedia.org/T320436#12412562 (10Urbanecm) >>! In T320436#12412554, @dancy wrote: > @Urbanecm Is this ticket a request for action (e.g., hiding the retry warnings), or just a note (in which case I will close it)? I consider warning as "so... [15:57:02] 10Scap: scap backport includes ProxyWarning errors - https://phabricator.wikimedia.org/T320436#12412584 (10dancy) >>! In T320436#12412562, @Urbanecm wrote: >>>! In T320436#12412554, @dancy wrote: >> @Urbanecm Is this ticket a request for action (e.g., hiding the retry warnings), or just a note (in which case I w... [16:07:00] (03open) 10dancy: log.py: Hide urllib3 retrying messages [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/1343 (https://phabricator.wikimedia.org/T320436) [16:07:25] (03update) 10dancy: log.py: Hide urllib3 retrying messages [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/1343 (https://phabricator.wikimedia.org/T320436) [16:10:10] (03merge) 10dancy: log.py: Hide urllib3 retrying messages [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/1343 (https://phabricator.wikimedia.org/T320436) [16:11:50] (03open) 10dancy: Release 4.296.0 [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/1344 [16:11:51] (03update) 10dancy: Release 4.296.0 [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/1344 [16:14:40] (03merge) 10dancy: Release 4.296.0 [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/1344 [16:22:12] 10Scap, 13Patch-For-Review: scap backport includes ProxyWarning errors - https://phabricator.wikimedia.org/T320436#12412684 (10dancy) 05Open→03Resolved a:03dancy Fixed in scap 4.296.0. [16:25:43] (03CR) 10Phuedx: [C:04-1] "There's a minor bug with the row validation which allows me to add two rows for the same experiment with competing groups, e.g. exp1:group" [performance/WikimediaDebug] - 10https://gerrit.wikimedia.org/r/1344123 (https://phabricator.wikimedia.org/T438283) (owner: 10Clare Ming) [16:41:14] (03open) 10dancy: 0.8.0: Support podManagementPolicy and terminationGracePeriodSeconds [repos/releng/buildkit-chart] - 10https://gitlab.wikimedia.org/repos/releng/buildkit-chart/-/merge_requests/5 [16:41:45] (03update) 10dancy: 0.8.0: Support podManagementPolicy and terminationGracePeriodSeconds [repos/releng/buildkit-chart] - 10https://gitlab.wikimedia.org/repos/releng/buildkit-chart/-/merge_requests/5 [16:41:54] (03merge) 10dancy: 0.8.0: Support podManagementPolicy and terminationGracePeriodSeconds [repos/releng/buildkit-chart] - 10https://gitlab.wikimedia.org/repos/releng/buildkit-chart/-/merge_requests/5 [16:45:52] (03PS8) 10Clare Ming: Add Test Kitchen experiment overrides to the header and popup [performance/WikimediaDebug] - 10https://gerrit.wikimedia.org/r/1344123 (https://phabricator.wikimedia.org/T438283) [16:46:25] (03CR) 10Clare Ming: "good catch! latest commit applies fix" [performance/WikimediaDebug] - 10https://gerrit.wikimedia.org/r/1344123 (https://phabricator.wikimedia.org/T438283) (owner: 10Clare Ming) [16:51:44] (03PS9) 10Clare Ming: Add Test Kitchen experiment overrides to the header and popup [performance/WikimediaDebug] - 10https://gerrit.wikimedia.org/r/1344123 (https://phabricator.wikimedia.org/T438283) [16:57:51] !log Restarting buildkitd pods in gitlab-cloud-runners (prod) [16:57:51] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [16:57:56] 10WikimediaDebug, 07Essential-Work, 13Patch-For-Review, 10Test Kitchen (Experiment Platform Sprint 31): Update WikimediaDebug to fetch active experiment config and allow selection of experiments and groups - https://phabricator.wikimedia.org/T438283#12412882 (10cjming) latest screenshots to rep latest comm... [16:58:35] (03CR) 10Clare Ming: "updated screenshots to represent latest commits" [performance/WikimediaDebug] - 10https://gerrit.wikimedia.org/r/1344123 (https://phabricator.wikimedia.org/T438283) (owner: 10Clare Ming) [17:02:38] (03open) 10dancy: buildkitd/buildkitd-values.yaml.tftpl: Improve autoscaling interaction [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/654 [17:02:51] (03update) 10dancy: buildkitd/buildkitd-values.yaml.tftpl: Improve autoscaling interaction [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/654 [17:04:13] (03merge) 10dancy: buildkitd/buildkitd-values.yaml.tftpl: Improve autoscaling interaction [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/654 [17:15:08] 10WikimediaDebug, 07Essential-Work, 13Patch-For-Review, 10Test Kitchen (Experiment Platform Sprint 31): Update WikimediaDebug to fetch active experiment config and allow selection of experiments and groups - https://phabricator.wikimedia.org/T438283#12412931 (10cjming) as for documentation, proposing the f... [17:58:30] (03PS1) 10SD0001: zuul: add Mr. Starfleet Command to CI allowlist [integration/config] - 10https://gerrit.wikimedia.org/r/1353335 (https://phabricator.wikimedia.org/T436312) [18:49:44] (03CR) 10Brennen Bearnes: "Looking at this since I'm on RelEng clinic duty this week." [performance/WikimediaDebug] - 10https://gerrit.wikimedia.org/r/1344123 (https://phabricator.wikimedia.org/T438283) (owner: 10Clare Ming) [19:01:07] the change-list has been redesigned on mobile: https://gerrit-review.googlesource.com/q/hashtag:%22narrow-change-list%22+(status:open%20OR%20status:merged) [19:02:28] size is removed, labels are now shown (although a limit is applied) and repository and change number are also shown. [19:03:55] 🥳 "To reduce the time developers need to test and fix issues quickly: Over the last seven days the gated pipeline p75 for CI jobs was 9 minutes 12 seconds, the second week in a row under 10 minutes and the best week so far. When we started measuring in mid-August the p75 was about 13-15 minutes, so the pipeline is roughly >30% faster than where [19:03:55] we began." [19:04:14] Nice! [19:04:26] we've appreciated the speed up on our civi builds lately as well! [20:00:26] o/ [20:00:50] (03CR) 10Clare Ming: "thanks @bbearnes@wikimedia.org - it should be safe to deploy - the consumer TK extension has the relevant patch merged (https://gerrit.wik" [performance/WikimediaDebug] - 10https://gerrit.wikimedia.org/r/1344123 (https://phabricator.wikimedia.org/T438283) (owner: 10Clare Ming) [20:02:32] are we all good to self-service in queue order? [20:02:40] i can deploy for those needing a deployer [20:03:54] obvious-dust: i can ship your config patch and mine out together [20:05:10] cjming: yes, that won't be a problem [20:05:19] cool - starting [20:05:42] 🚀 [20:35:40] (03open) 10dancy: backport: Consolidate backport SAL [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/1345 (https://phabricator.wikimedia.org/T385116) [20:37:17] (03update) 10dancy: backport: Consolidate backport SAL [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/1345 (https://phabricator.wikimedia.org/T385116) [20:37:21] (03update) 10dancy: backport: Consolidate backport SAL [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/1345 (https://phabricator.wikimedia.org/T385116) [20:38:40] 06Release-Engineering-Team, 10Scap, 06Data-Platform-SRE, 10Wikidata, 10Wikidata-Query-Service: scap deploy should not repool a wdqs node that is depooled - https://phabricator.wikimedia.org/T361246#12413887 (10dcausse) >>! In T361246#12412440, @dancy wrote: > @dcausse: Do you happen to remember what depl... [20:39:21] (03open) 10jforrester: releases: Bump wdio-mediawiki from 6.5.2 to 6.5.3 [repos/ci-tools/libup-config] - 10https://gitlab.wikimedia.org/repos/ci-tools/libup-config/-/merge_requests/150 [20:39:25] (03merge) 10jforrester: releases: Bump wdio-mediawiki from 6.5.2 to 6.5.3 [repos/ci-tools/libup-config] - 10https://gitlab.wikimedia.org/repos/ci-tools/libup-config/-/merge_requests/150 [20:42:12] 06Release-Engineering-Team (Doing 😎), 06ServiceOps, 05Goal: [FY25-26 WE6.1.4] Establish Pretrain production design for MVP - https://phabricator.wikimedia.org/T417704#12413895 (10Scott_French) 05Open→03Resolved I've finally had time to tweak (albeit minimally) https://www.mediawiki.org/wiki/Wikimedia... [21:33:55] 10Continuous-Integration-Infrastructure, 07Zuul, 06Collaboration-Services, 10Observability-Alerting: Port zuul checks to Prometheus/Alertmanager - https://phabricator.wikimedia.org/T384939#12414018 (10Dzahn) reviewed and now merged! most should be gone! [21:35:04] 10Continuous-Integration-Infrastructure, 07Zuul, 06Collaboration-Services, 10Observability-Alerting: Port zuul checks to Prometheus/Alertmanager - https://phabricator.wikimedia.org/T384939#12414023 (10Dzahn) cc @hnowlan thanks for the patch! [22:47:01] 10Scap: scap backport/scap deploy-promote: Offer to revert changes - https://phabricator.wikimedia.org/T440666 (10dancy) 03NEW [22:47:20] 10Scap: scap backport/scap deploy-promote: Offer to revert changes - https://phabricator.wikimedia.org/T440666#12414200 (10dancy) p:05Triage→03Medium [22:56:28] 06Release-Engineering-Team, 10Scap, 06Data-Platform-SRE, 10Wikidata, 10Wikidata-Query-Service: scap deploy should not repool a wdqs node that is depooled - https://phabricator.wikimedia.org/T361246#12414220 (10dancy) 05Open→03Declined >>! In T361246#12413887, @dcausse wrote: >>>! In T361246#12412... [23:06:26] 06Release-Engineering-Team (Doing 😎), 10Release Pipeline: ST6.1.4 Refactor Pipelinelib to use buildx and generate SBOMs - https://phabricator.wikimedia.org/T440668 (10dduvall) 03NEW [23:06:47] 06Release-Engineering-Team (Doing 😎), 10Release Pipeline: ST6.1.4 Refactor Pipelinelib to use buildx and generate SBOMs - https://phabricator.wikimedia.org/T440668#12414244 (10dduvall) 05Open→03In progress p:05Triage→03Medium a:03dduvall [23:12:56] 06Release-Engineering-Team (Doing 😎), 10Release Pipeline: Upgrade integration-agent-docker instances to trixie - https://phabricator.wikimedia.org/T440670 (10dduvall) 03NEW [23:13:18] 06Release-Engineering-Team (Doing 😎), 10Release Pipeline: Upgrade integration-agent-docker instances to trixie - https://phabricator.wikimedia.org/T440670#12414268 (10dduvall) 05Open→03In progress p:05Triage→03Medium [23:14:18] !log registering new trixie based integration-agent-docker-1095 agent with Jenkins [23:14:19] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [23:22:51] (03CR) 10Brennen Bearnes: [C:03+2] Add Test Kitchen experiment overrides to the header and popup [performance/WikimediaDebug] - 10https://gerrit.wikimedia.org/r/1344123 (https://phabricator.wikimedia.org/T438283) (owner: 10Clare Ming) [23:23:15] (03Merged) 10jenkins-bot: Add Test Kitchen experiment overrides to the header and popup [performance/WikimediaDebug] - 10https://gerrit.wikimedia.org/r/1344123 (https://phabricator.wikimedia.org/T438283) (owner: 10Clare Ming) [23:30:05] (03PS1) 10Brennen Bearnes: Tag v3.4.0 [performance/WikimediaDebug] - 10https://gerrit.wikimedia.org/r/1353498 [23:30:50] (03CR) 10Brennen Bearnes: [C:03+2] "Self-merging version bureaucracy." [performance/WikimediaDebug] - 10https://gerrit.wikimedia.org/r/1353498 (owner: 10Brennen Bearnes) [23:31:12] (03Merged) 10jenkins-bot: Tag v3.4.0 [performance/WikimediaDebug] - 10https://gerrit.wikimedia.org/r/1353498 (owner: 10Brennen Bearnes) [23:52:30] 06Release-Engineering-Team, 10WikimediaDebug, 07Essential-Work: WikimediaDebug: Fix outstanding Firefox Developer Hub warning(s) - https://phabricator.wikimedia.org/T440673 (10brennen) 03NEW [23:53:16] 10WikimediaDebug, 07Essential-Work, 10Test Kitchen (Experiment Platform Sprint 31): Update WikimediaDebug to fetch active experiment config and allow selection of experiments and groups - https://phabricator.wikimedia.org/T438283#12414339 (10brennen) Submitted v3.4.0 of WikimediaDebug for review for both Fir... [23:53:45] 06Release-Engineering-Team (Radar), 10WikimediaDebug, 07Essential-Work, 10Test Kitchen (Experiment Platform Sprint 31): Update WikimediaDebug to fetch active experiment config and allow selection of experiments and groups - https://phabricator.wikimedia.org/T438283#12414341 (10brennen) [23:55:30] 06Release-Engineering-Team (Radar), 10WikimediaDebug, 07Essential-Work, 10Test Kitchen (Experiment Platform Sprint 31): Update WikimediaDebug to fetch active experiment config and allow selection of experiments and groups - https://phabricator.wikimedia.org/T438283#12414345 (10brennen) From Mozilla: > Tha...