[06:44:06] 10Beta-Cluster-Infrastructure, 10Wikidata, 06Wikidata-Omega: Beta Cluster code is no longer auto-updating - https://phabricator.wikimedia.org/T440884#12423597 (10mahmoud.abdelsattar.wmde) @Southparkfan Thanks for your efforts! [06:45:22] 10GitLab (Account Approval), 06Release-Engineering-Team: Requesting GitLab account activation for mildrette] - https://phabricator.wikimedia.org/T440941 (10101) 03NEW [07:34:46] 10Gerrit, 06Collaboration-Services, 07Incident Severity 1, 13Patch-For-Review, 07Sustainability (Incident Followup): Add the the ability to warm caches to Gerrit switchover cookbook - https://phabricator.wikimedia.org/T440177#12423786 (10hashar) The Gerrit replicas do not expose the main web UI ( https:/... [08:13:54] 10Continuous-Integration-Infrastructure, 06Release-Engineering-Team, 06Test Platform, 06tools-infrastructure-team: Add more CPUs to quibble jobs - https://phabricator.wikimedia.org/T439808#12423861 (10fgiunchedi) Something else I wanted to add: with more instances I think a test with two executors instead... [08:14:45] 06Release-Engineering-Team (Doing 😎), 06Collaboration-Services, 13Patch-For-Review: Replace Go templates with Rego policy DSL in the JWT authorizer - https://phabricator.wikimedia.org/T346331#12423863 (10LSobanski) [09:20:30] hashar: (or other gerrit admin lurking) gerrit admin help would be welcomed in private [09:22:56] (no longer needed, apologies) [09:26:11] 10GitLab (Account Approval), 06Release-Engineering-Team (Doing 😎): Requesting GitLab account activation for mildrette - https://phabricator.wikimedia.org/T440941#12424092 (10Aklapper) 05Open→03Resolved a:03Aklapper Done. [09:26:14] 10GitLab (Account Approval), 06Release-Engineering-Team (Doing 😎): Requesting GitLab account activation for mildrette - https://phabricator.wikimedia.org/T440941#12424096 (10Aklapper) [09:32:12] 10GitLab (Account Approval), 06Release-Engineering-Team (Doing 😎): Requesting GitLab account activation for adstein - https://phabricator.wikimedia.org/T439655#12424111 (10Aklapper) 05Open→03Resolved a:03Aklapper Approved. (Sorry that this took a while!) Happy hacking! [09:33:24] 10GitLab (Account Approval), 06Release-Engineering-Team (Doing 😎): Requesting GitLab account activation for shwetamishra - https://phabricator.wikimedia.org/T440798#12424118 (10Aklapper) 05Open→03Resolved a:03Aklapper Approved. Happy hacking! [09:54:30] 06Release-Engineering-Team (Priority Backlog 📥), 07Essential-Work, 05Release, 05Train Deployments: 1.47.0-wmf.24 deployment blockers - https://phabricator.wikimedia.org/T438220#12424227 (10Aklapper) FYI testwiki so far throwing the following new issues: {T440951}, {T440954} [10:45:41] 06Release-Engineering-Team (Doing 😎), 10MediaWiki-Change-tagging, 10QS-Test-Automation, 10Catalyst (Luka Ijo Pimeja Jan), 07Essential-Work: Catalyst the first edit using each tag is saved without its tag - https://phabricator.wikimedia.org/T439780#12424466 (10jnuche) Daily RevisionSlider tests now pass o... [10:49:40] 10Continuous-Integration-Infrastructure, 07Zuul, 06Collaboration-Services, 10Observability-Alerting: Port zuul checks to Prometheus/Alertmanager - https://phabricator.wikimedia.org/T384939#12424472 (10hnowlan) 05Open→03Resolved a:03hnowlan Thank you for the review and the merge! [11:27:52] 06Release-Engineering-Team, 10Scap, 06Collaboration-Services, 06ServiceOps, and 3 others: Proposal: scap deploy-service - https://phabricator.wikimedia.org/T412941#12424653 (10Jelto) [11:40:21] 10Continuous-Integration-Infrastructure, 06Release-Engineering-Team, 06Test Platform, 06tools-infrastructure-team: Add more CPUs to quibble jobs - https://phabricator.wikimedia.org/T439808#12424760 (10Peter) I'm thinking like this: when we move away from Jenkins and only use Zuul on K8, then it makes sense... [11:42:10] 10Diffusion, 10Phabricator, 06Release-Engineering-Team, 07Performance Issue: Diffusion code view: Per-file change info is slow to load despite caching (diffusion.lastmodifiedquery) - https://phabricator.wikimedia.org/T403215#12424774 (10Aklapper) Output from https://gitlab.wikimedia.org/repos/phabricator/p... [11:57:54] 10Continuous-Integration-Config, 10MediaWiki-Core-Tests: CI does not run structure tests for skin? - https://phabricator.wikimedia.org/T440973 (10hashar) 03NEW [11:58:04] 10Continuous-Integration-Config, 10MediaWiki-Core-Tests: CI does not run structure tests for skin? - https://phabricator.wikimedia.org/T440973#12424869 (10hashar) [12:01:27] 10Phabricator: Requesting rename to "VeritasSapientiae" - https://phabricator.wikimedia.org/T440974 (10HideonRosie) 03NEW [12:07:44] 10Gerrit: Rename my Phabricator (done, thx) and Gerrit account - https://phabricator.wikimedia.org/T244537#12424943 (10HideonRosie) 05Open→03Resolved Closing for following reason: 1. Phabricator username renamed; 2; Phabricator account disabled; 3. For the Gerrit account, see https://wikitech.wikimedia.o... [12:15:04] 10Continuous-Integration-Config, 10MediaWiki-Core-Tests: CI does not run structure tests for skin? - https://phabricator.wikimedia.org/T440973#12424982 (10hashar) The issue is caught properly when I run Quibble locally using: ` quibble --phpunit-testsuite=structure --run=phpunit-database mediawiki/skins/Timel... [12:15:20] 06Release-Engineering-Team (Priority Backlog 📥), 07Essential-Work, 05Release, 05Train Deployments: 1.47.0-wmf.24 deployment blockers - https://phabricator.wikimedia.org/T438220#12424983 (10hashar) [12:26:35] 10Continuous-Integration-Config, 10MediaWiki-Core-Tests: CI does not run structure tests for skin? - https://phabricator.wikimedia.org/T440973#12425029 (10hashar) p:05Triage→03Unbreak! Looking at the `quibble-vendor-mysql-php83` output: ` name=quibble.commands:>>> Start: PHPUnit unit tests quibble.commands... [12:30:28] 06Release-Engineering-Team (Doing 😎), 06Abstract Wikipedia team, 10Catalyst, 07Essential-Work: AW Catalyst CI job failing with "Host '10.42.5.125' is not allowed to connect to this MariaDB server" - https://phabricator.wikimedia.org/T436136#12425038 (10jnuche) 05In progress→03Resolved a:03jnuche... [12:45:10] 10Continuous-Integration-Config, 10MediaWiki-Core-Tests: CI does not run structure tests for skin? - https://phabricator.wikimedia.org/T440973#12425075 (10hashar) ` $ ./vendor/bin/phpunit --testsuite=skins Using PHP 8.4.26 Running with MediaWiki settings because there might be integration tests PHPUnit 9.6.34... [12:59:11] (03PS1) 10Mpostoronca: Zuul: [mediawiki/extensions/WikimediaAntiAbuse] Add GlobalPreferences dependency [integration/config] - 10https://gerrit.wikimedia.org/r/1354782 (https://phabricator.wikimedia.org/T439688) [13:28:54] 10Continuous-Integration-Config, 10MediaWiki-Core-Tests: CI does not run structure tests for skin? - https://phabricator.wikimedia.org/T440973#12425278 (10hashar) From reading [[ https://gerrit.wikimedia.org/r/c/mediawiki/core/+/1247681 | mediawiki/core #1247681 ]] it seems to have removed "skins" terminology... [13:38:47] 10Continuous-Integration-Config, 10MediaWiki-Core-Tests: CI does not run structure tests for skin? - https://phabricator.wikimedia.org/T440973#12425338 (10hashar) [13:38:48] 10Phabricator, 06Release-Engineering-Team (Doing 😎): Requesting rename to "VeritasSapientiae" - https://phabricator.wikimedia.org/T440974#12425340 (10Aklapper) 05Open→03Resolved a:03Aklapper Done! [13:51:05] 06Release-Engineering-Team (Doing 😎), 06Abstract Wikipedia team, 10Catalyst, 07Essential-Work: AW Catalyst CI job failing with "Host '10.42.5.125' is not allowed to connect to this MariaDB server" - https://phabricator.wikimedia.org/T436136#12425368 (10Jdforrester-WMF) Thanks! [13:55:32] https://gerrit-review.googlesource.com/c/gerrit/+/642124 [13:55:33] Redesigns the change list on mobile further [13:55:43] https://usercontent.irccloud-cdn.com/file/qPqC7mWr/image.png [13:56:08] paladox: You mean, I might actually be able to use gerrit on mobile? Amazing. [13:56:18] branches added with https://gerrit-review.googlesource.com/c/gerrit/+/642143 [13:56:27] <3 [13:56:41] James_F: yeh, I had redesigned the mobile nav in 3.11. In future releases I've improved it further (redesigned the nav more) [13:57:44] https://usercontent.irccloud-cdn.com/file/yeTyyNr7/Screenshot%202026-10-13%20at%2014.57.31.png [13:57:54] Very cool. [13:57:56] is what the sidebar looks like (in 3.11 it is collapsed tho) [14:00:27] I've also made it so that select, checkbox, radio all have the same experience across all browsers (it is also more modern looking) [14:12:39] 10Continuous-Integration-Config, 10MediaWiki-Core-Tests: CI does not run structure tests for skin? - https://phabricator.wikimedia.org/T440973#12425526 (10hashar) p:05Unbreak!→03High [14:18:59] (03CR) 10Hashar: [C:03+2] Zuul: [mediawiki/extensions/WikimediaAntiAbuse] Add GlobalPreferences dependency [integration/config] - 10https://gerrit.wikimedia.org/r/1354782 (https://phabricator.wikimedia.org/T439688) (owner: 10Mpostoronca) [14:20:19] (03Merged) 10jenkins-bot: Zuul: [mediawiki/extensions/WikimediaAntiAbuse] Add GlobalPreferences dependency [integration/config] - 10https://gerrit.wikimedia.org/r/1354782 (https://phabricator.wikimedia.org/T439688) (owner: 10Mpostoronca) [14:22:21] (03CR) 10Hashar: [C:03+2] "Maybe once all the legacy PCC reports have vanished 😊 But yeah eventually, I guess as part of the new Zuul for sure." [software/gerrit] (deploy/wmf/stable-3.10) - 10https://gerrit.wikimedia.org/r/1244816 (https://phabricator.wikimedia.org/T414621) (owner: 10Jforrester) [14:22:53] (03Merged) 10jenkins-bot: wm-pcc: switch commands from experimental to new puppet [software/gerrit] (deploy/wmf/stable-3.10) - 10https://gerrit.wikimedia.org/r/1244816 (https://phabricator.wikimedia.org/T414621) (owner: 10Jforrester) [14:30:06] (03CR) 10Hashar: [C:03+1] "I have deployed the Gerrit plugin update Ied625bb0272d1a33651a493f7c4202576b39bf06 which should now:" [integration/config] - 10https://gerrit.wikimedia.org/r/1234515 (https://phabricator.wikimedia.org/T414621) (owner: 10Jforrester) [14:54:11] hashar: Did you want to announce this new improvement to the SREs? [14:56:33] (03open) 10dancy: Release 4.297.0 [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/1351 [14:56:34] (03update) 10dancy: Release 4.297.0 [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/1351 [14:59:04] James_F: I havent' checked it, let me try now [14:59:36] (03merge) 10dancy: Release 4.297.0 [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/1351 [15:15:58] 10Phabricator, 06Collaboration-Services, 06Infrastructure-Foundations, 10Mail, 06SRE: Replace Exim on phabricator servers with Postfix - https://phabricator.wikimedia.org/T378029#12425861 (10jhathaway) a:05jhathaway→03None [15:39:08] 10Continuous-Integration-Infrastructure, 06Release-Engineering-Team, 06Test Platform, 06tools-infrastructure-team: Add more CPUs to quibble jobs - https://phabricator.wikimedia.org/T439808#12426046 (10fgiunchedi) >>! In T439808#12424760, @Peter wrote: > I'm thinking like this: when we move away from Jenkin... [15:48:34] 06Release-Engineering-Team (Priority Backlog 📥), 07Essential-Work, 05Release, 05Train Deployments: 1.47.0-wmf.24 deployment blockers - https://phabricator.wikimedia.org/T438220#12426151 (10Urbanecm_WMF) Flagging {T440997}. [15:50:39] (03PS1) 10Jdlrobson: Remove catalyst job for Minerva [integration/config] - 10https://gerrit.wikimedia.org/r/1354828 (https://phabricator.wikimedia.org/T424984) [15:55:32] (03CR) 10Jforrester: [C:04-1] "Needs to follow the repo naming rules. (I'll do it and deploy.)" [integration/config] - 10https://gerrit.wikimedia.org/r/1354828 (https://phabricator.wikimedia.org/T424984) (owner: 10Jdlrobson) [16:04:16] James_F: that looks about right on https://gerrit.wikimedia.org/r/c/operations/puppet/+/1354817 [16:04:30] there is a bit missing which is that after the PCC has ran, there is no more actions to rerun it :b [16:04:59] Huh. Where does that come from? [16:08:53] 06Release-Engineering-Team (Priority Backlog 📥), 07Essential-Work, 05Release, 05Train Deployments: 1.47.0-wmf.24 deployment blockers - https://phabricator.wikimedia.org/T438220#12426287 (10Tgr) [16:10:01] (03PS2) 10Jforrester: jjb: Drop catalyst-daily-MinervaNeue, flaky and unwanted [integration/config] - 10https://gerrit.wikimedia.org/r/1354828 (https://phabricator.wikimedia.org/T424984) (owner: 10Jdlrobson) [16:10:18] James_F: via some magic javascript https://gerrit.wikimedia.org/r/c/operations/software/gerrit/+/1354830 [16:10:24] I ll revisit tomorrow, it is becoming late [16:11:01] I am off [16:11:30] (03CR) 10Jforrester: [C:03+2] jjb: Drop catalyst-daily-MinervaNeue, flaky and unwanted [integration/config] - 10https://gerrit.wikimedia.org/r/1354828 (https://phabricator.wikimedia.org/T424984) (owner: 10Jdlrobson) [16:12:47] (03Merged) 10jenkins-bot: jjb: Drop catalyst-daily-MinervaNeue, flaky and unwanted [integration/config] - 10https://gerrit.wikimedia.org/r/1354828 (https://phabricator.wikimedia.org/T424984) (owner: 10Jdlrobson) [16:13:13] (03CR) 10Jforrester: [C:03+2] "Deployed." [integration/config] - 10https://gerrit.wikimedia.org/r/1354828 (https://phabricator.wikimedia.org/T424984) (owner: 10Jdlrobson) [17:04:15] 10Scap: scap backport/scap deploy-promote: Offer to revert changes - https://phabricator.wikimedia.org/T440666#12426673 (10dancy) Scap 4.297.0 will now automatically create and merge the revert to wikiversions.json if it rolls back during deploy-promote. [17:04:46] 10Scap: Consolidate log output if patch is being backported to multiple branches at the same time - https://phabricator.wikimedia.org/T385116#12426706 (10dancy) 05Open→03Resolved a:03dancy Scap 4.297.0 has been deployed with this change. [17:07:38] (03open) 10dancy: scap: Set the configured umask in clean, php-fpm-restart and deploy-service [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/1352 [17:07:59] (03update) 10dancy: scap: Set the configured umask in clean, php-fpm-restart and deploy-service [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/1352 [17:10:23] (03merge) 10dancy: scap: Set the configured umask in clean, php-fpm-restart and deploy-service [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/1352 [17:10:44] (03open) 10dancy: requirements.txt: Pin alembic, and hide its plugin messages [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/1353 [17:11:08] (03update) 10dancy: requirements.txt: Pin alembic, and hide its plugin messages [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/1353 [17:13:58] (03merge) 10dancy: requirements.txt: Pin alembic, and hide its plugin messages [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/1353 [17:26:37] 10Phabricator, 06Release-Engineering-Team (Priority Backlog 📥): Update to Phorge/Arcanist upstream 2026.xx - https://phabricator.wikimedia.org/T428547#12426878 (10Aklapper) [17:26:37] 10Phabricator (Upstream), 06Release-Engineering-Team (Doing 😎), 07Upstream: Don't offer "Show Hidden Columns" when there are no hidden columns (Manage Board) - https://phabricator.wikimedia.org/T90779#12426877 (10Aklapper) [17:27:07] 10Phabricator (Upstream), 06Release-Engineering-Team (Doing 😎), 07Upstream: Manage Board: Display number of hidden columns with "Show/Hide Hidden Columns" - https://phabricator.wikimedia.org/T90779#12426879 (10Aklapper) [18:39:00] 10Continuous-Integration-Config, 10MediaWiki-Core-Tests: CI does not run structure tests for skin? - https://phabricator.wikimedia.org/T440973#12427231 (10Daimona) >>! In T440973#12425278, @hashar wrote: > From reading [[ https://gerrit.wikimedia.org/r/c/mediawiki/core/+/1247681 | mediawiki/core #1247681 ]] it... [20:57:45] (03open) 10dancy: deploy-service: Accept a list of environments and releases [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/1354 (https://phabricator.wikimedia.org/T412941) [21:07:40] (03update) 10dancy: deploy-service: Accept a list of environments and releases [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/1354 (https://phabricator.wikimedia.org/T412941) [21:07:41] (03update) 10dancy: deploy-service: Accept a list of environments and releases [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/1354 (https://phabricator.wikimedia.org/T412941) [21:07:58] !log Starting Beta Cluster deployment server switchover - T435393 [21:08:01] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [21:08:01] T435393: Beta Cluster: Switch to PHP 8.5, includes writing Puppet changes to support PHP 8.5 on baremetal - https://phabricator.wikimedia.org/T435393 [21:09:29] (03merge) 10dancy: deploy-service: Accept a list of environments and releases [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/1354 (https://phabricator.wikimedia.org/T412941) [21:10:30] (03open) 10dancy: Release 4.298.0 [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/1355 [21:13:32] (03merge) 10dancy: Release 4.298.0 [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/1355 [22:05:54] !log Finished Beta Cluster deployment server switchover, deployment-deploy06 is now the active deployment server - T435393 [22:05:56] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [22:05:57] T435393: Beta Cluster: Switch to PHP 8.5, includes writing Puppet changes to support PHP 8.5 on baremetal - https://phabricator.wikimedia.org/T435393 [22:18:11] 10Beta-Cluster-Infrastructure, 06MediaWiki-Engineering, 10Cloud-VPS (Debian Bullseye Deprecation), 13Patch-For-Review: Beta Cluster: Switch to PHP 8.5, includes writing Puppet changes to support PHP 8.5 on baremetal - https://phabricator.wikimedia.org/T435393#12428116 (10Southparkfan) The critical steps of... [22:55:32] (03open) 10jhuneidi: Update catalyst-code-server [repos/releng/dev-images] - 10https://gitlab.wikimedia.org/repos/releng/dev-images/-/merge_requests/125 (https://phabricator.wikimedia.org/T438720) [23:12:28] 10Continuous-Integration-Infrastructure, 06Release-Engineering-Team (Doing 😎), 10Release Pipeline: Upgrade integration-agent-docker instances to trixie - https://phabricator.wikimedia.org/T440670#12428405 (10dduvall) Thanks, @hashar. It appears that `zuul-cloner` hangs while doing `import git` and that hangs...