[04:29:39] (03open) 10ryankemper: allow kafka-configurator on trusted runners [repos/releng/gitlab-trusted-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-trusted-runner/-/merge_requests/192 (https://phabricator.wikimedia.org/T435282) [05:24:11] (03PS3) 10Hashar: utils: script to verify package-lock.json integrity [integration/config] - 10https://gerrit.wikimedia.org/r/1343551 (https://phabricator.wikimedia.org/T437697) [05:25:28] (03CR) 10CI reject: [V:04-1] utils: script to verify package-lock.json integrity [integration/config] - 10https://gerrit.wikimedia.org/r/1343551 (https://phabricator.wikimedia.org/T437697) (owner: 10Hashar) [05:26:49] (03PS4) 10Hashar: utils: script to verify package-lock.json integrity [integration/config] - 10https://gerrit.wikimedia.org/r/1343551 (https://phabricator.wikimedia.org/T437697) [06:51:28] 10Continuous-Integration-Config, 10VisualEditor: Grunt "src" does multiple full globs which is inefficient - https://phabricator.wikimedia.org/T438811 (10hashar) 03NEW [07:21:54] !log Purge opcache on deployment-jobrunner06.deployment-prep [07:21:55] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [07:24:54] 10Beta-Cluster-Infrastructure, 10Wikidata, 10Wikidata Integration in Wikimedia projects (Kanban Board): Beta cluster jobrunner may be running stale code - https://phabricator.wikimedia.org/T438656#12348580 (10awight) I found that I had to clear the opcache on the jobrunner again, after deploying a configurat... [07:25:40] 10Beta-Cluster-Infrastructure, 10Wikidata, 10Wikidata Integration in Wikimedia projects (Kanban Board): Beta cluster jobrunner opcache is not updated during automated deployments - https://phabricator.wikimedia.org/T438656#12348582 (10awight) [07:58:46] (03merge) 10jnuche: allow kafka-configurator on trusted runners [repos/releng/gitlab-trusted-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-trusted-runner/-/merge_requests/192 (https://phabricator.wikimedia.org/T435282) (owner: 10ryankemper) [08:34:19] 10Continuous-Integration-Infrastructure, 06Release-Engineering-Team (Seen), 10observability, 06SRE, 05Goal: Add Prometheus exporter to Jenkins instances - https://phabricator.wikimedia.org/T182759#12348805 (10ABran-WMF) [08:38:36] 10Beta-Cluster-Infrastructure, 06Data-Engineering, 10Event-Platform: Beta: Old code in jobrunner06 - https://phabricator.wikimedia.org/T438818 (10JMonton-WMF) 03NEW [08:39:02] 10Beta-Cluster-Infrastructure, 06Data-Engineering, 10Event-Platform: Beta: Old code in jobrunner06 - https://phabricator.wikimedia.org/T438818#12348824 (10JMonton-WMF) I'll try to create a patch that forces the jobrunner06 to be updated too, and find who owns or can review this. [08:53:21] !log Restarted CI Jenkins on contint1003 to apply https://gerrit.wikimedia.org/r/c/operations/puppet/+/1343675 "jenkins: exit the JVM on OutOfMemoryError" # T435791 [08:53:22] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [09:03:49] (03open) 10hashar: jenkins: exit the JVM on OutOfMemoryError [repos/releng/jenkins-deploy] - 10https://gitlab.wikimedia.org/repos/releng/jenkins-deploy/-/merge_requests/127 (https://phabricator.wikimedia.org/T435791) [09:06:25] jnuche: I sent a mr for the release jenkins to have the jvm start with -XX:+ExitOnOutOfMemoryError (and fix the systemd override which prevented it from restarting jenkins `restart=no`). https://gitlab.wikimedia.org/repos/releng/jenkins-deploy/-/merge_requests/127 [09:06:45] I have applied that on the CI Jenkins via puppet, so I am merely syncing up [09:06:49] there is no rush for patch! [09:18:46] hashar: ack [09:27:53] 10Phabricator: Related changes in GitLab are not always shown - https://phabricator.wikimedia.org/T438826 (10fnegri) 03NEW [09:33:00] (03open) 10samtar: make-release: Add ModeratorToolkit [repos/releng/release] - 10https://gitlab.wikimedia.org/repos/releng/release/-/merge_requests/270 (https://phabricator.wikimedia.org/T438334) [09:40:34] 10Phabricator, 06Collaboration-Services: decom / return phab1006 (was: phab1006 Setup) - https://phabricator.wikimedia.org/T437421#12349148 (10LSobanski) p:05Triageβ†’03Medium [09:41:19] 10Beta-Cluster-Infrastructure: Nonexistent beta site forwards to production - https://phabricator.wikimedia.org/T438829#12349171 (10awight) [09:49:16] 10Beta-Cluster-Infrastructure, 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10Event-Platform: Beta: Old code in jobrunner06 - https://phabricator.wikimedia.org/T438818#12349210 (10JMonton-WMF) [09:49:32] 10Beta-Cluster-Infrastructure, 10Wikidata, 10Wikidata Integration in Wikimedia projects (Kanban Board): Beta cluster wikibase repo cannot add sitelinks - https://phabricator.wikimedia.org/T438735#12349213 (10awight) [09:59:36] 10Beta-Cluster-Infrastructure, 10Wikidata, 07ContentSecurityPolicy, 10Wikidata Integration in Wikimedia projects (Kanban Board): Beta cluster wikibase repo cannot add sitelinks - https://phabricator.wikimedia.org/T438735#12349300 (10awight) It looks like the autocomplete request is blocked by beta cluster... [11:44:19] (03merge) 10jnuche: jenkins: exit the JVM on OutOfMemoryError [repos/releng/jenkins-deploy] - 10https://gitlab.wikimedia.org/repos/releng/jenkins-deploy/-/merge_requests/127 (https://phabricator.wikimedia.org/T435791) (owner: 10hashar) [12:48:39] (03update) 10arnaudb: Add repos/sre/aphlict [repos/releng/gitlab-trusted-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-trusted-runner/-/merge_requests/190 (https://phabricator.wikimedia.org/T436657) [12:48:47] (03update) 10arnaudb: Add repos/sre/aphlict [repos/releng/gitlab-trusted-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-trusted-runner/-/merge_requests/190 (https://phabricator.wikimedia.org/T436657) [12:50:07] (03update) 10arnaudb: Add repos/sre/aphlict [repos/releng/gitlab-trusted-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-trusted-runner/-/merge_requests/190 (https://phabricator.wikimedia.org/T436657) [12:50:15] (03update) 10arnaudb: Add repos/sre/aphlict [repos/releng/gitlab-trusted-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-trusted-runner/-/merge_requests/190 (https://phabricator.wikimedia.org/T436657) [12:54:06] 10Beta-Cluster-Infrastructure, 10Wikidata, 10Wikidata Integration in Wikimedia projects (Kanban Board): Beta cluster wikidata sitelinks are wrong - https://phabricator.wikimedia.org/T438841 (10awight) 03NEW [12:59:01] 10Beta-Cluster-Infrastructure, 10Wikidata, 10Wikidata Integration in Wikimedia projects (Kanban Board): Beta cluster wikidata sitelinks are wrong - https://phabricator.wikimedia.org/T438841#12349948 (10awight) [13:02:30] 10Beta-Cluster-Infrastructure, 10Wikidata, 10Wikidata Integration in Wikimedia projects (Kanban Board): Beta cluster wikidata sitelinks are wrong - https://phabricator.wikimedia.org/T438841#12349959 (10awight) [13:19:24] arnaudb: (nit) Aphlict is the notification system for Phabricator isn't it? We have a hierarchy for Phab project at https://gitlab.wikimedia.org/repos/phabricator so maybe having it under `phabricator/*` would be a better fit rather than `repos/sre/aphlict` [13:22:32] done hashar https://gitlab.wikimedia.org/repos/phabricator/aphlict/ [13:23:13] it destroyed my MR 🫠 [13:24:02] or, weirdly, it did not moved it (https://gitlab.wikimedia.org/repos/releng/gitlab-trusted-runner/-/merge_requests/190) [13:24:07] 10GitLab, 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): Trusted-runner access for developer-activity-pipelines (publish a container image) - https://phabricator.wikimedia.org/T438042#12350068 (10Antoine_Quhen) 05Openβ†’03Resolved [13:24:43] oh shoot I confused the two, ignore my rambling sorry [13:35:33] 10Phabricator, 06Release-Engineering-Team: Related changes in GitLab are not always shown - https://phabricator.wikimedia.org/T438826#12350126 (10Aklapper) 05Openβ†’03Stalled Please make `Bug: T432571 Signed-off-by: David Caro dcaro@wikimedia.org` be on two separate lines. Then let's check `T432571` again af... [13:41:39] 10Phabricator, 06Release-Engineering-Team: Related changes in GitLab are not always shown - https://phabricator.wikimedia.org/T438826#12350154 (10fnegri) They are on separate lines, but are rendered as Markdown and the line break is swallowed. :/ {F104319169} [13:44:11] 10Phabricator, 06Release-Engineering-Team: Related changes in GitLab are not always shown - https://phabricator.wikimedia.org/T438826#12350163 (10Aklapper) Then please try to insert an empty line between `Bug:` and `Signed-off-by:` :) [13:47:00] (03approved) 10jforrester: make-release: Add ModeratorToolkit [repos/releng/release] - 10https://gitlab.wikimedia.org/repos/releng/release/-/merge_requests/270 (https://phabricator.wikimedia.org/T438334) (owner: 10samtar) [13:47:06] (03merge) 10jforrester: make-release: Add ModeratorToolkit [repos/releng/release] - 10https://gitlab.wikimedia.org/repos/releng/release/-/merge_requests/270 (https://phabricator.wikimedia.org/T438334) (owner: 10samtar) [13:58:21] (03update) 10arnaudb: Add repos/sre/aphlict [repos/releng/gitlab-trusted-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-trusted-runner/-/merge_requests/190 (https://phabricator.wikimedia.org/T436657) [14:12:30] 06Release-Engineering-Team, 10Ceph, 06Infrastructure-Foundations, 10SRE-swift-storage: Test the Docker Registry's GC with Releng/MediaWiki images - https://phabricator.wikimedia.org/T437297#12350288 (10MatthewVernon) [14:35:11] (03update) 10arnaudb: Add repos/phabricator/aphlict/ [repos/releng/gitlab-trusted-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-trusted-runner/-/merge_requests/190 (https://phabricator.wikimedia.org/T436657) [14:35:37] (03update) 10arnaudb: Add repos/phabricator/aphlict [repos/releng/gitlab-trusted-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-trusted-runner/-/merge_requests/190 (https://phabricator.wikimedia.org/T436657) [14:51:50] (03merge) 10dancy: Add repos/phabricator/aphlict [repos/releng/gitlab-trusted-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-trusted-runner/-/merge_requests/190 (https://phabricator.wikimedia.org/T436657) (owner: 10arnaudb) [14:56:32] (03update) 10dancy: Makefile: Add targets for the local development environment [repos/releng/blubber] - 10https://gitlab.wikimedia.org/repos/releng/blubber/-/merge_requests/181 [14:56:35] (03update) 10dancy: CONTRIBUTING.md: Update instructions [repos/releng/blubber] - 10https://gitlab.wikimedia.org/repos/releng/blubber/-/merge_requests/182 [15:13:32] 10Phabricator, 06Release-Engineering-Team, 06Collaboration-Services, 13Patch-For-Review: Move aphlict to k8s - https://phabricator.wikimedia.org/T436657#12350801 (10ABran-WMF) the first version of Aphlict's Docker image has been published: `2026-09-22 15:10:22,893 Target 'production' image published to 'do... [15:21:49] 06Release-Engineering-Team, 10Scap (SpiderPig πŸ•ΈοΈ): Spiderpig tabs get out of sync when using browser back button - https://phabricator.wikimedia.org/T433287#12350870 (10dancy) 05Openβ†’03Resolved a:03dancy Fix deployed in scap 4.290.0 [15:22:44] 06Release-Engineering-Team (Priority Backlog πŸ“₯), 10Scap (SpiderPig πŸ•ΈοΈ), 10Phatality: SpiderPig log view: Integrate Phatality-style search & reporting features for errors - https://phabricator.wikimedia.org/T397094#12350877 (10dancy) Search function deployed in scap 4.290.0. Reporting not done. [15:29:24] (03update) 10dancy: Update Beta Cluster-related documentation [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/1317 (https://phabricator.wikimedia.org/T435393 https://phabricator.wikimedia.org/T436470) (owner: 10southparkfan) [15:29:40] (03CR) 10Hashar: [C:03+2] Zuul: [mediawiki/extensions/DynamicPageListEngine] Add Scribunto Phan dependency [integration/config] - 10https://gerrit.wikimedia.org/r/1343291 (owner: 10Fomafix) [15:31:24] (03Merged) 10jenkins-bot: Zuul: [mediawiki/extensions/DynamicPageListEngine] Add Scribunto Phan dependency [integration/config] - 10https://gerrit.wikimedia.org/r/1343291 (owner: 10Fomafix) [15:32:36] (03merge) 10dancy: Update Beta Cluster-related documentation [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/1317 (https://phabricator.wikimedia.org/T435393 https://phabricator.wikimedia.org/T436470) (owner: 10southparkfan) [15:40:16] 06Release-Engineering-Team, 10Ceph, 06Infrastructure-Foundations, 10SRE-swift-storage: Test the Docker Registry's GC with Releng/MediaWiki images - https://phabricator.wikimedia.org/T437297#12350968 (10elukey) @dancy hi! I am close to complete the first cleanup of the old MediaWiki manifests, and now I'd l... [15:48:06] 10Diffusion, 10Phabricator: Diffusion web viewer does not handle nonexistent files - https://phabricator.wikimedia.org/T438875 (10Pppery) 03NEW [15:48:37] 10Diffusion, 10Phabricator: Diffusion web viewer does not handle nonexistent files - https://phabricator.wikimedia.org/T438875#12350984 (10Pppery) [16:01:22] (03open) 10dancy: git: Do not let auto gc run in the background [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/1330 (https://phabricator.wikimedia.org/T438236) [16:04:17] (03merge) 10dancy: git: Do not let auto gc run in the background [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/1330 (https://phabricator.wikimedia.org/T438236) [16:05:14] (03open) 10dancy: Release 4.291.0 [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/1331 [16:07:55] (03merge) 10dancy: Release 4.291.0 [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/1331 [16:37:21] (03PS5) 10Hashar: utils: script to verify package-lock.json integrity [integration/config] - 10https://gerrit.wikimedia.org/r/1343551 (https://phabricator.wikimedia.org/T437697) [16:41:34] (03CR) 10Hashar: [C:03+2] tox: update flake8 4.0.1..7.3.0 [integration/config] - 10https://gerrit.wikimedia.org/r/1343137 (owner: 10Hashar) [16:43:28] (03Merged) 10jenkins-bot: tox: update flake8 4.0.1..7.3.0 [integration/config] - 10https://gerrit.wikimedia.org/r/1343137 (owner: 10Hashar) [16:51:02] 10Phabricator, 06Release-Engineering-Team: Related changes in GitLab are not always shown - https://phabricator.wikimedia.org/T438826#12351441 (10fnegri) > Then please try to insert an empty line between Bug: and Signed-off-by: :) An empty line might break other workflows. This was discussed in {T351253} and... [16:57:35] (03approved) 10dduvall: Makefile: Add targets for the local development environment [repos/releng/blubber] - 10https://gitlab.wikimedia.org/repos/releng/blubber/-/merge_requests/181 (owner: 10dancy) [16:58:57] (03approved) 10dduvall: CONTRIBUTING.md: Update instructions [repos/releng/blubber] - 10https://gitlab.wikimedia.org/repos/releng/blubber/-/merge_requests/182 (owner: 10dancy) [17:02:53] (03merge) 10dancy: Makefile: Add targets for the local development environment [repos/releng/blubber] - 10https://gitlab.wikimedia.org/repos/releng/blubber/-/merge_requests/181 [17:03:03] (03update) 10dancy: CONTRIBUTING.md: Update instructions [repos/releng/blubber] - 10https://gitlab.wikimedia.org/repos/releng/blubber/-/merge_requests/182 [17:03:35] (03update) 10dancy: CONTRIBUTING.md: Update instructions [repos/releng/blubber] - 10https://gitlab.wikimedia.org/repos/releng/blubber/-/merge_requests/182 [17:40:59] (03merge) 10dancy: CONTRIBUTING.md: Update instructions [repos/releng/blubber] - 10https://gitlab.wikimedia.org/repos/releng/blubber/-/merge_requests/182 [17:49:33] 06Release-Engineering-Team (Priority Backlog πŸ“₯), 07Essential-Work, 05Release, 05Train Deployments: 1.47.0-wmf.21 deployment blockers - https://phabricator.wikimedia.org/T438217#12351746 (10jeena) [17:50:46] 06Release-Engineering-Team (Priority Backlog πŸ“₯), 10MediaWiki-extensions-DonationInterface, 06Moderator-Tools-Team, 10PersonalDashboard, and 5 others: Noisy log: normalized_message: ResourceLoader duplicate registration warning. Another module has already b... - https://phabricator.wikimedia.org/T438387#12351763 [18:02:38] 06Release-Engineering-Team (Priority Backlog πŸ“₯), 10MediaWiki-extensions-DonationInterface, 06Moderator-Tools-Team, 10PersonalDashboard, and 5 others: Noisy log: normalized_message: ResourceLoader duplicate registration warning. Another module has already b... - https://phabricator.wikimedia.org/T438387#12351831 [18:04:21] 06Release-Engineering-Team (Priority Backlog πŸ“₯), 10MediaWiki-extensions-DonationInterface, 06Moderator-Tools-Team, 10PersonalDashboard, and 5 others: Noisy log: normalized_message: ResourceLoader duplicate registration warning. Another module has already b... - https://phabricator.wikimedia.org/T438387#12351834 [18:06:38] 06Release-Engineering-Team (Priority Backlog πŸ“₯), 10MediaWiki-extensions-DonationInterface, 06Moderator-Tools-Team, 10PersonalDashboard, and 5 others: Noisy log: normalized_message: ResourceLoader duplicate registration warning. Another module has already b... - https://phabricator.wikimedia.org/T438387#12351846 [18:10:39] (03update) 10dancy: scripts/release.sh: Ensure git chglog call will succeed [repos/releng/blubber] - 10https://gitlab.wikimedia.org/repos/releng/blubber/-/merge_requests/183 [18:10:40] (03update) 10dancy: RELEASE.md: Updated text [repos/releng/blubber] - 10https://gitlab.wikimedia.org/repos/releng/blubber/-/merge_requests/184 [18:10:47] (03open) 10dancy: scripts/release.sh: Ensure git chglog call will succeed [repos/releng/blubber] - 10https://gitlab.wikimedia.org/repos/releng/blubber/-/merge_requests/183 [18:10:48] (03open) 10dancy: RELEASE.md: Updated text [repos/releng/blubber] - 10https://gitlab.wikimedia.org/repos/releng/blubber/-/merge_requests/184 [18:11:35] (03update) 10dancy: scripts/release.sh: Ensure git chglog call will succeed [repos/releng/blubber] - 10https://gitlab.wikimedia.org/repos/releng/blubber/-/merge_requests/183 [18:11:39] (03update) 10dancy: RELEASE.md: Updated text [repos/releng/blubber] - 10https://gitlab.wikimedia.org/repos/releng/blubber/-/merge_requests/184 [18:12:04] 06Release-Engineering-Team (Priority Backlog πŸ“₯), 10MediaWiki-extensions-DonationInterface, 06Moderator-Tools-Team, 10PersonalDashboard, and 5 others: Noisy log: normalized_message: ResourceLoader duplicate registration warning. Another module has already b... - https://phabricator.wikimedia.org/T438387#12351852 [18:12:41] 06Release-Engineering-Team (Priority Backlog πŸ“₯), 10MediaWiki-extensions-DonationInterface, 06Moderator-Tools-Team, 10PersonalDashboard, and 5 others: Noisy log: normalized_message: ResourceLoader duplicate registration warning. Another module has already b... - https://phabricator.wikimedia.org/T438387#12351865 [18:12:43] 06Release-Engineering-Team (Priority Backlog πŸ“₯), 07Essential-Work, 05Release, 05Train Deployments: 1.47.0-wmf.21 deployment blockers - https://phabricator.wikimedia.org/T438217#12351867 (10Jdforrester-WMF) [18:12:46] 06Release-Engineering-Team (Priority Backlog πŸ“₯), 10MediaWiki-extensions-DonationInterface, 06Moderator-Tools-Team, 10PersonalDashboard, and 5 others: Noisy log: normalized_message: ResourceLoader duplicate registration warning. Another module has already b... - https://phabricator.wikimedia.org/T438387#12351866 [18:17:02] !log Remove deployment-mwmaint03.deployment-prep.eqiad1.wikimedia.cloud from scap::dsh::groups.mediawiki-installation.host in deployment-prep project puppet config (T435393) to stop wmf-beta-update-all spam. [18:17:07] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [18:17:07] T435393: Beta Cluster: Switch to PHP 8.5, includes writing Puppet changes to support PHP 8.5 on baremetal - https://phabricator.wikimedia.org/T435393 [18:36:53] 10Diffusion, 10Phabricator: Diffusion web viewer does not handle nonexistent files - https://phabricator.wikimedia.org/T438875#12351934 (10Aklapper) β†’14Duplicate dup:03T435627 [18:36:56] 10Diffusion, 10Phabricator (Upstream), 06Release-Engineering-Team (Doing 😎), 07Upstream: Attempting to view a non-existent file through Diffusion causes an unhandled CommandException - https://phabricator.wikimedia.org/T435627#12351936 (10Aklapper) [18:37:13] 10Diffusion, 10Phabricator (Upstream), 07Upstream: Diffusion web viewer does not handle nonexistent files - https://phabricator.wikimedia.org/T438875#12351938 (10Aklapper) [18:50:47] 10Continuous-Integration-Infrastructure, 07Zuul, 06Collaboration-Services, 10Observability-Alerting, 13Patch-For-Review: Port zuul checks to Prometheus/Alertmanager - https://phabricator.wikimedia.org/T384939#12351995 (10hashar) [18:51:43] 10Continuous-Integration-Infrastructure, 07Zuul, 06Collaboration-Services, 10Observability-Alerting, 13Patch-For-Review: Port zuul checks to Prometheus/Alertmanager - https://phabricator.wikimedia.org/T384939#12351998 (10hashar) [18:53:33] 10GitLab, 06Release-Engineering-Team: kokkuri:setup-variables failing for repos/releng/release!268 (due to being a fork?) - https://phabricator.wikimedia.org/T436899#12352009 (10Jdforrester-WMF) >>! In T436899#12344881, @Tgr wrote: > Same happening at Patchdemo (https://gitlab.wikimedia.org/tgr/patchdemo/-/pip... [18:56:04] 06Release-Engineering-Team, 10Scap: Recent "Branch cut test patches" job git concurrency failures - https://phabricator.wikimedia.org/T438236#12352034 (10dancy) 05Openβ†’03Resolved a:03dancy Fix deployed in scap 4.291.0. [19:01:16] seems gerrit has added experimental support for stack diffing. [19:02:23] you can see it live at https://gerrit-review.googlesource.com/c/gerrit/+/633786 [19:15:26] (03open) 10dancy: Add repos/sre/miscweb/attribution [repos/releng/gitlab-trusted-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-trusted-runner/-/merge_requests/193 (https://phabricator.wikimedia.org/T437635) [19:16:25] (03merge) 10dancy: Add repos/sre/miscweb/attribution [repos/releng/gitlab-trusted-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-trusted-runner/-/merge_requests/193 (https://phabricator.wikimedia.org/T437635) [19:28:14] (03update) 10dancy: logstash: Match the fields of a query exactly [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/1313 (https://phabricator.wikimedia.org/T435419) [19:28:16] (03update) 10dancy: logstash: Match the fields of a query exactly [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/1313 (https://phabricator.wikimedia.org/T435419) [19:31:07] (03merge) 10dancy: logstash: Match the fields of a query exactly [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/1313 (https://phabricator.wikimedia.org/T435419) [19:34:47] 06Release-Engineering-Team (Doing 😎), 10QS-Test-Automation, 10Catalyst (Luka Ijo Pimeja Jan), 07Essential-Work: Investigate retry mechanism for catalyst provisioning error - https://phabricator.wikimedia.org/T437955#12352309 (10jeena) @jnuche I recall that failures were timeouts while streaming logs, n... [19:37:16] 10Phabricator, 06Release-Engineering-Team: Related changes in GitLab are not always shown - https://phabricator.wikimedia.org/T438826#12352330 (10brennen) > I think the filter added in T395728: 'Related GitLab patches' box includes patches for unrelated tasks (that begin with the current task's ID) is too stri... [19:38:05] FIRING: PuppetAgentStaleLastRun: Last Puppet run was over 24 hours ago on instance deployment-mwmaint03 in project deployment-prep - https://prometheus-alerts.wmcloud.org/?q=alertname%3DPuppetAgentStaleLastRun [19:42:13] (03PS1) 10Umherirrender: zuul: [mediawiki/extensions/Campaigns] Add CentralAuth for phan [integration/config] - 10https://gerrit.wikimedia.org/r/1344074 [19:57:44] 10Beta-Cluster-Infrastructure, 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10Event-Platform: Beta: Old code in jobrunner06 - https://phabricator.wikimedia.org/T438818#12352392 (10Southparkfan) β†’14Duplicate dup:03T438656 [19:57:47] 10Beta-Cluster-Infrastructure, 10Wikidata, 10Wikidata Integration in Wikimedia projects (Kanban Board): Beta cluster jobrunner opcache is not updated during automated deployments - https://phabricator.wikimedia.org/T438656#12352389 (10Southparkfan) [20:01:04] FIRING: PuppetAgentDisabled: Puppet agent disabled on instance deployment-mwmaint03 in project deployment-prep - https://prometheus-alerts.wmcloud.org/?q=alertname%3DPuppetAgentDisabled [20:08:41] 10Beta-Cluster-Infrastructure, 10Wikidata, 10Wikidata Integration in Wikimedia projects (Kanban Board): Beta cluster jobrunner opcache is not updated during automated deployments - https://phabricator.wikimedia.org/T438656#12352420 (10Southparkfan) Hi @JMonton-WMF, @awight, `deployment-jobrunner06` is a... [20:08:46] 10Beta-Cluster-Infrastructure, 10Wikidata, 10Wikidata Integration in Wikimedia projects (Kanban Board): Beta cluster jobrunner opcache is not updated during automated deployments - https://phabricator.wikimedia.org/T438656#12352422 (10Southparkfan) 05Openβ†’03Resolved a:03Southparkfan [20:12:53] (03approved) 10dduvall: scripts/release.sh: Ensure git chglog call will succeed [repos/releng/blubber] - 10https://gitlab.wikimedia.org/repos/releng/blubber/-/merge_requests/183 (owner: 10dancy) [20:13:29] (03approved) 10dduvall: RELEASE.md: Updated text [repos/releng/blubber] - 10https://gitlab.wikimedia.org/repos/releng/blubber/-/merge_requests/184 (owner: 10dancy) [20:14:18] (03PS1) 10Pwangai: api-testing: Do not install core's npm dependencies twice [integration/quibble] - 10https://gerrit.wikimedia.org/r/1344086 (https://phabricator.wikimedia.org/T438906) [20:38:38] (03open) 10southparkfan: scaps-installed-in-beta: Switch to new Cumin host [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/1332 (https://phabricator.wikimedia.org/T436470) [20:42:55] 10Beta-Cluster-Infrastructure, 10Cloud-VPS (Debian Bullseye Deprecation): Replace deployment-rdb01 (Bullseye deprecation) - https://phabricator.wikimedia.org/T436480#12352573 (10Southparkfan) 05Openβ†’03In progress a:03Southparkfan [20:54:22] 10Scap, 06SRE Observability: Scap's logstash checker for channels outside "error" and "exception" - https://phabricator.wikimedia.org/T438570#12352636 (10thcipriani) Tagging in #sre_observability This task is about protecting o11y infrastructure from the impacts of deployments. In the task description, I'm t... [20:54:56] 10Beta-Cluster-Infrastructure, 06SRE, 06Traffic: Beta cluster haproxy does not support `warn-blocked-traffic-after` keyword - https://phabricator.wikimedia.org/T428052#12352640 (10Southparkfan) 05Openβ†’03Resolved a:03BCornwall Thanks to Brett's work on T436468, this hack is no longer needed. I have... [20:58:19] (03merge) 10dancy: scaps-installed-in-beta: Switch to new Cumin host [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/1332 (https://phabricator.wikimedia.org/T436470) (owner: 10southparkfan) [20:58:55] (03merge) 10dancy: scripts/release.sh: Ensure git chglog call will succeed [repos/releng/blubber] - 10https://gitlab.wikimedia.org/repos/releng/blubber/-/merge_requests/183 [20:58:59] (03update) 10dancy: RELEASE.md: Updated text [repos/releng/blubber] - 10https://gitlab.wikimedia.org/repos/releng/blubber/-/merge_requests/184 [20:59:05] (03update) 10dancy: RELEASE.md: Updated text [repos/releng/blubber] - 10https://gitlab.wikimedia.org/repos/releng/blubber/-/merge_requests/184 [21:04:28] (03merge) 10dancy: RELEASE.md: Updated text [repos/releng/blubber] - 10https://gitlab.wikimedia.org/repos/releng/blubber/-/merge_requests/184 [21:04:42] (03CR) 10Hashar: api-testing: Do not install core's npm dependencies twice (031 comment) [integration/quibble] - 10https://gerrit.wikimedia.org/r/1344086 (https://phabricator.wikimedia.org/T438906) (owner: 10Pwangai) [21:05:36] (03CR) 10Hashar: [C:03+2] zuul: [mediawiki/extensions/Campaigns] Add CentralAuth for phan [integration/config] - 10https://gerrit.wikimedia.org/r/1344074 (owner: 10Umherirrender) [21:07:16] (03Merged) 10jenkins-bot: zuul: [mediawiki/extensions/Campaigns] Add CentralAuth for phan [integration/config] - 10https://gerrit.wikimedia.org/r/1344074 (owner: 10Umherirrender) [21:24:03] 10Beta-Cluster-Infrastructure, 10Cloud-VPS (Debian Bullseye Deprecation), 13Patch-For-Review: Replace deployment-cumin-3 (Bullseye deprecation) - https://phabricator.wikimedia.org/T436470#12352721 (10Southparkfan) 05In progressβ†’03Resolved βœ… [21:33:38] (03update) 10dancy: version: 1.8.1 [repos/releng/blubber] - 10https://gitlab.wikimedia.org/repos/releng/blubber/-/merge_requests/185 [21:33:42] (03open) 10dancy: version: 1.8.1 [repos/releng/blubber] - 10https://gitlab.wikimedia.org/repos/releng/blubber/-/merge_requests/185 [21:39:11] (03update) 10dancy: Release 4.292.0 [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/1333 [21:39:13] (03open) 10dancy: Release 4.292.0 [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/1333 [21:39:41] (03merge) 10dancy: version: 1.8.1 [repos/releng/blubber] - 10https://gitlab.wikimedia.org/repos/releng/blubber/-/merge_requests/185 [21:42:19] (03merge) 10dancy: Release 4.292.0 [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/1333 [22:21:14] (03PS1) 10Neriah: Zuul: [mediawiki/extension/NewUserMessage] Add CheckUser dependency [integration/config] - 10https://gerrit.wikimedia.org/r/1344105 (https://phabricator.wikimedia.org/T437743) [23:03:52] (03PS1) 10Vaughn Walters: jjb: [catalyst-daily-GlobalWatchlist] Add GlobalWatchlist job [integration/config] - 10https://gerrit.wikimedia.org/r/1344108 (https://phabricator.wikimedia.org/T433082) [23:03:52] (03CR) 10Vaughn Walters: [C:03+2] "tests passed at https://integration.wikimedia.org/ci/view/selenium-daily/job/catalyst-daily-GlobalWatchlist/" [integration/config] - 10https://gerrit.wikimedia.org/r/1344108 (https://phabricator.wikimedia.org/T433082) (owner: 10Vaughn Walters) [23:05:29] (03Merged) 10jenkins-bot: jjb: [catalyst-daily-GlobalWatchlist] Add GlobalWatchlist job [integration/config] - 10https://gerrit.wikimedia.org/r/1344108 (https://phabricator.wikimedia.org/T433082) (owner: 10Vaughn Walters) [23:19:45] (03PS1) 10Vaughn Walters: jjb: [catalyst-daily-ContactPage] Add ContactPage job [integration/config] - 10https://gerrit.wikimedia.org/r/1344110 (https://phabricator.wikimedia.org/T433077) [23:19:45] (03CR) 10Vaughn Walters: [C:03+2] "Test is green at https://integration.wikimedia.org/ci/view/selenium-daily/job/catalyst-daily-ContactPage/" [integration/config] - 10https://gerrit.wikimedia.org/r/1344110 (https://phabricator.wikimedia.org/T433077) (owner: 10Vaughn Walters) [23:21:20] (03Merged) 10jenkins-bot: jjb: [catalyst-daily-ContactPage] Add ContactPage job [integration/config] - 10https://gerrit.wikimedia.org/r/1344110 (https://phabricator.wikimedia.org/T433077) (owner: 10Vaughn Walters) [23:43:09] (03PS1) 10Vaughn Walters: jjb: [catalyst-daily-ElectronPdfService] Add ElectronPdfService job [integration/config] - 10https://gerrit.wikimedia.org/r/1344111 (https://phabricator.wikimedia.org/T433079) [23:43:10] (03CR) 10Vaughn Walters: [C:03+2] "Test is green here https://integration.wikimedia.org/ci/view/selenium-daily/job/catalyst-daily-ElectronPdfService/, merging" [integration/config] - 10https://gerrit.wikimedia.org/r/1344111 (https://phabricator.wikimedia.org/T433079) (owner: 10Vaughn Walters) [23:44:47] (03Merged) 10jenkins-bot: jjb: [catalyst-daily-ElectronPdfService] Add ElectronPdfService job [integration/config] - 10https://gerrit.wikimedia.org/r/1344111 (https://phabricator.wikimedia.org/T433079) (owner: 10Vaughn Walters)