[00:02:59] (03update) 10catrope: Add a script for checking which security patches can't be backported [repos/releng/release] - 10https://gitlab.wikimedia.org/repos/releng/release/-/merge_requests/282 [00:19:27] (03PS2) 10Vaughn Walters: jjb: [catalyst-daily-EntitySchema] Add EntitySchema job [integration/config] - 10https://gerrit.wikimedia.org/r/1369153 (https://phabricator.wikimedia.org/T444678) [00:19:27] (03CR) 10Vaughn Walters: "Tests are updated and are green on first pass https://integration.wikimedia.org/ci/view/selenium-daily/job/catalyst-daily-EntitySchema/1/c" [integration/config] - 10https://gerrit.wikimedia.org/r/1369153 (https://phabricator.wikimedia.org/T444678) (owner: 10Vaughn Walters) [00:19:34] (03CR) 10Vaughn Walters: [C:03+2] jjb: [catalyst-daily-EntitySchema] Add EntitySchema job [integration/config] - 10https://gerrit.wikimedia.org/r/1369153 (https://phabricator.wikimedia.org/T444678) (owner: 10Vaughn Walters) [00:20:52] (03Merged) 10jenkins-bot: jjb: [catalyst-daily-EntitySchema] Add EntitySchema job [integration/config] - 10https://gerrit.wikimedia.org/r/1369153 (https://phabricator.wikimedia.org/T444678) (owner: 10Vaughn Walters) [00:47:49] 06Release-Engineering-Team (Priority Backlog 📥), 07Essential-Work, 05Release, 05Train Deployments: 1.48.0-wmf.5 deployment blockers - https://phabricator.wikimedia.org/T442223#12553048 (10SecurityPatchBot) [01:55:17] 10GitLab (CI & Job Runners), 06Release-Engineering-Team, 10a Wikimedia CLI: runner-1036 & runner-1034.gitlab-runners.eqiad1.wikimedia.cloud running out of space - https://phabricator.wikimedia.org/T443833#12553345 (10xcollazo) > I pruned volumes on runner-1036 Thanks for the fix @brennen. Is there any way... [02:16:13] 10Continuous-Integration-Infrastructure, 10Castor, 06Test Platform (San Miguel de Allende 31): Keep npm debug logs out of the castor cache - https://phabricator.wikimedia.org/T437376#12553374 (10Mhurd) [02:18:27] (03PS1) 10Mhurd: dockerfiles: keep the global npmrc in use under npm --prefix [integration/config] - 10https://gerrit.wikimedia.org/r/1369162 (https://phabricator.wikimedia.org/T437376) [02:24:34] 10Continuous-Integration-Infrastructure, 10Castor, 06Test Platform (San Miguel de Allende 31): Let CI jobs fetch Composer packages through the cache proxy - https://phabricator.wikimedia.org/T444738 (10Mhurd) 03NEW [02:29:05] (03PS1) 10Mhurd: jjb: point Composer at integration-cache-proxy when Zuul asks [integration/config] - 10https://gerrit.wikimedia.org/r/1369164 (https://phabricator.wikimedia.org/T444738) [04:28:53] 10Continuous-Integration-Infrastructure, 06Release-Engineering-Team (Radar), 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, and 2 others: CI build slow and timing out sometimes - https://phabricator.wikimedia.org/T434024#12553484 (10Lars) From timing out at 30 minutes, we're now running 3-5 minute... [04:41:01] (03update) 10mhurd: Add a dashboard for moving from Castor to the cache proxy [repos/releng/develstats] - 10https://gitlab.wikimedia.org/repos/releng/develstats/-/merge_requests/103 [04:41:08] (03update) 10mhurd: Add a dashboard for moving from Castor to the cache proxy [repos/releng/develstats] - 10https://gitlab.wikimedia.org/repos/releng/develstats/-/merge_requests/103 [05:08:06] (03update) 10mhurd: Add a dashboard for moving from Castor to the cache proxy [repos/releng/develstats] - 10https://gitlab.wikimedia.org/repos/releng/develstats/-/merge_requests/103 [05:11:45] (03update) 10mhurd: Add a dashboard for moving from Castor to the cache proxy [repos/releng/develstats] - 10https://gitlab.wikimedia.org/repos/releng/develstats/-/merge_requests/103 [05:35:10] (03update) 10mhurd: Add a dashboard for moving from Castor to the cache proxy [repos/releng/develstats] - 10https://gitlab.wikimedia.org/repos/releng/develstats/-/merge_requests/103 [05:35:15] (03update) 10mhurd: Add a dashboard for moving from Castor to the cache proxy [repos/releng/develstats] - 10https://gitlab.wikimedia.org/repos/releng/develstats/-/merge_requests/103 [09:03:33] (03PS1) 10Hashar: dockerfiles: reparent on ci-trixie [integration/config] - 10https://gerrit.wikimedia.org/r/1369333 [09:03:56] (03CR) 10Hashar: [C:03+2] dockerfiles: reparent on ci-trixie [integration/config] - 10https://gerrit.wikimedia.org/r/1369333 (owner: 10Hashar) [09:05:22] (03CR) 10CI reject: [V:04-1] dockerfiles: reparent on ci-trixie [integration/config] - 10https://gerrit.wikimedia.org/r/1369333 (owner: 10Hashar) [09:09:57] (03PS2) 10Hashar: dockerfiles: reparent castor on ci-trixie [integration/config] - 10https://gerrit.wikimedia.org/r/1369333 [09:12:55] 10GitLab (CI & Job Runners), 06Release-Engineering-Team, 10a Wikimedia CLI: runner-1036 & runner-1034.gitlab-runners.eqiad1.wikimedia.cloud running out of space - https://phabricator.wikimedia.org/T443833#12553818 (10Addshore) Apparently there might also be clear-docker-cache prune-volumes ? [09:20:50] (03CR) 10Hashar: [C:03+2] dockerfiles: reparent castor on ci-trixie [integration/config] - 10https://gerrit.wikimedia.org/r/1369333 (owner: 10Hashar) [09:22:26] (03Merged) 10jenkins-bot: dockerfiles: reparent castor on ci-trixie [integration/config] - 10https://gerrit.wikimedia.org/r/1369333 (owner: 10Hashar) [09:23:56] (03CR) 10Jforrester: "Yes! Thank you." [integration/config] - 10https://gerrit.wikimedia.org/r/1369333 (owner: 10Hashar) [09:25:04] (03PS1) 10Hashar: jjb: update jobs to reparent Castor on ci-trixie [integration/config] - 10https://gerrit.wikimedia.org/r/1369340 [09:25:24] (03CR) 10Hashar: [C:03+2] jjb: update jobs to reparent Castor on ci-trixie [integration/config] - 10https://gerrit.wikimedia.org/r/1369340 (owner: 10Hashar) [09:27:15] (03Merged) 10jenkins-bot: jjb: update jobs to reparent Castor on ci-trixie [integration/config] - 10https://gerrit.wikimedia.org/r/1369340 (owner: 10Hashar) [09:28:24] hashar: `rg --files-without-match 'Depends:' dockerfiles/*/control` gives only the two scratch images and python2-build-bullseye, nice. [09:31:38] (03merge) 10addshore: build(deps): bump golang.org/x/image from 0.47.0 to 0.48.0 [repos/releng/cli] - 10https://gitlab.wikimedia.org/repos/releng/cli/-/merge_requests/810 (owner: 10project_16_bot_622d7b6d682aa66907ad1bffedf5b9e6) [09:32:17] (03merge) 10addshore: build(deps): bump github.com/gofrs/flock from 0.13.1 to 0.13.2 [repos/releng/cli] - 10https://gitlab.wikimedia.org/repos/releng/cli/-/merge_requests/811 (owner: 10project_16_bot_622d7b6d682aa66907ad1bffedf5b9e6) [09:33:12] (03merge) 10addshore: Bump docker-registry.wikimedia.org/repos/search-platform/cirrussearch-opensearch-image from v2.19.5-3 to v2.19.5-4 [repos/releng/cli] - 10https://gitlab.wikimedia.org/repos/releng/cli/-/merge_requests/807 (owner: 10project_16_bot_841eade40a22c56a6272172b8cb67384) [09:34:00] (03update) 10addshore: Bump traefik from v3.7.17 to v3.7.18 [repos/releng/cli] - 10https://gitlab.wikimedia.org/repos/releng/cli/-/merge_requests/806 (owner: 10project_16_bot_841eade40a22c56a6272172b8cb67384) [09:34:03] (03update) 10addshore: Bump traefik from v3.7.17 to v3.7.18 [repos/releng/cli] - 10https://gitlab.wikimedia.org/repos/releng/cli/-/merge_requests/806 (owner: 10project_16_bot_841eade40a22c56a6272172b8cb67384) [09:34:20] (03merge) 10addshore: Bump traefik from v3.7.17 to v3.7.18 [repos/releng/cli] - 10https://gitlab.wikimedia.org/repos/releng/cli/-/merge_requests/806 (owner: 10project_16_bot_841eade40a22c56a6272172b8cb67384) [09:54:54] (03CR) 10Jforrester: [C:03+2] Zuul: [BlueSpiceExtendedStatistics] Add HitCounters dependency [integration/config] - 10https://gerrit.wikimedia.org/r/1369107 (owner: 10Hslater) [09:56:36] (03Merged) 10jenkins-bot: Zuul: [BlueSpiceExtendedStatistics] Add HitCounters dependency [integration/config] - 10https://gerrit.wikimedia.org/r/1369107 (owner: 10Hslater) [09:57:18] !log Zuul: [BlueSpiceExtendedStatistics] Add HitCounters dependency [09:57:19] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [10:34:29] (03merge) 10addshore: Bump docker-registry.wikimedia.org/releng/quibble-bookworm-php83 from 1.22.0-s8 to 1.22.0-s9 [repos/releng/cli] - 10https://gitlab.wikimedia.org/repos/releng/cli/-/merge_requests/799 (owner: 10project_16_bot_841eade40a22c56a6272172b8cb67384) [10:34:55] (03merge) 10addshore: Bump docker-registry.wikimedia.org/repos/data-engineering/eventgate-wikimedia from v1.36.0 to v1.38.0 [repos/releng/cli] - 10https://gitlab.wikimedia.org/repos/releng/cli/-/merge_requests/798 (owner: 10project_16_bot_841eade40a22c56a6272172b8cb67384) [10:35:34] (03merge) 10addshore: Bump golang from 1.26.10 to 1.26.11 [repos/releng/cli] - 10https://gitlab.wikimedia.org/repos/releng/cli/-/merge_requests/805 (owner: 10project_16_bot_841eade40a22c56a6272172b8cb67384) [10:36:26] (03merge) 10addshore: Bump prom/prometheus from v3.15.1 to v3.16.0 [repos/releng/cli] - 10https://gitlab.wikimedia.org/repos/releng/cli/-/merge_requests/808 (owner: 10project_16_bot_841eade40a22c56a6272172b8cb67384) [10:36:56] (03merge) 10addshore: build(deps): bump golang.org/x/net from 0.60.0 to 0.62.0 [repos/releng/cli] - 10https://gitlab.wikimedia.org/repos/releng/cli/-/merge_requests/796 (owner: 10project_16_bot_622d7b6d682aa66907ad1bffedf5b9e6) [10:37:06] (03update) 10addshore: build(deps): bump golang.org/x/term from 0.47.0 to 0.48.0 [repos/releng/cli] - 10https://gitlab.wikimedia.org/repos/releng/cli/-/merge_requests/812 (owner: 10project_16_bot_622d7b6d682aa66907ad1bffedf5b9e6) [10:37:10] (03update) 10addshore: build(deps): bump golang.org/x/term from 0.47.0 to 0.48.0 [repos/releng/cli] - 10https://gitlab.wikimedia.org/repos/releng/cli/-/merge_requests/812 (owner: 10project_16_bot_622d7b6d682aa66907ad1bffedf5b9e6) [10:41:47] (03CR) 10Hashar: [C:03+2] build: Updating postcss-selector-parser to 6.1.6 [integration/docroot] - 10https://gerrit.wikimedia.org/r/1368249 (owner: 10Libraryupgrader) [10:44:26] (03PS1) 10Jforrester: Zuul: [mediawiki/extensions/Newsletter] Move Echo dep up, now added [integration/config] - 10https://gerrit.wikimedia.org/r/1369397 (https://phabricator.wikimedia.org/T410057) [10:45:29] (03CR) 10Jforrester: [C:03+2] Zuul: [mediawiki/extensions/Newsletter] Move Echo dep up, now added [integration/config] - 10https://gerrit.wikimedia.org/r/1369397 (https://phabricator.wikimedia.org/T410057) (owner: 10Jforrester) [10:47:23] (03Merged) 10jenkins-bot: Zuul: [mediawiki/extensions/Newsletter] Move Echo dep up, now added [integration/config] - 10https://gerrit.wikimedia.org/r/1369397 (https://phabricator.wikimedia.org/T410057) (owner: 10Jforrester) [10:47:42] 06Release-Engineering-Team (Radar), 10Scap, 10Citoid, 10CXServer, and 21 others: Migrate node-based services in production to node26 - https://phabricator.wikimedia.org/T437512#12554368 (10Aklapper) [10:52:03] (03merge) 10addshore: Include CLI versions in User-Agent identities [repos/releng/cli] - 10https://gitlab.wikimedia.org/repos/releng/cli/-/merge_requests/801 [10:52:15] (03update) 10esanders: runner: Support repositories with an ESLint flat config [repos/ci-tools/libup] - 10https://gitlab.wikimedia.org/repos/ci-tools/libup/-/merge_requests/128 (https://phabricator.wikimedia.org/T267941) [11:03:24] (03merge) 10addshore: build(deps): bump github.com/spf13/pflag from 1.0.10 to 1.1.0 [repos/releng/cli] - 10https://gitlab.wikimedia.org/repos/releng/cli/-/merge_requests/802 (owner: 10project_16_bot_622d7b6d682aa66907ad1bffedf5b9e6) [11:04:13] 10Continuous-Integration-Infrastructure, 10Cloud-VPS, 06tools-infrastructure-team, 10Wikidata, and 2 others: Wikibase selenium tests timeout, seemingly due to "memory compaction" events on CI VMs - https://phabricator.wikimedia.org/T281122#12554652 (10fnegri) [11:09:25] (03merge) 10addshore: build(deps): bump github.com/docker/cli from 29.9.2+incompatible to 29.9.3+incompatible [repos/releng/cli] - 10https://gitlab.wikimedia.org/repos/releng/cli/-/merge_requests/803 (owner: 10project_16_bot_622d7b6d682aa66907ad1bffedf5b9e6) [11:11:52] (03close) 10addshore: Bump docker-registry.wikimedia.org/wikimedia/mediawiki-libs-shellbox image group to 2026-11-02-141242 [repos/releng/cli] - 10https://gitlab.wikimedia.org/repos/releng/cli/-/merge_requests/797 (owner: 10project_16_bot_841eade40a22c56a6272172b8cb67384) [11:15:08] (03CR) 10Hashar: [C:03+2] "I guess I got mislead when testing using my Debian provided `npm` which has:" [integration/config] - 10https://gerrit.wikimedia.org/r/1369162 (https://phabricator.wikimedia.org/T437376) (owner: 10Mhurd) [11:16:30] (03Merged) 10jenkins-bot: dockerfiles: keep the global npmrc in use under npm --prefix [integration/config] - 10https://gerrit.wikimedia.org/r/1369162 (https://phabricator.wikimedia.org/T437376) (owner: 10Mhurd) [11:18:58] (03Abandoned) 10Hashar: jjb: qemu: give up connecting after some time [integration/config] - 10https://gerrit.wikimedia.org/r/1365900 (owner: 10Hashar) [11:19:11] (03Abandoned) 10Hashar: jjb: upgrade QEmu image from Bullseye to Trixie [integration/config] - 10https://gerrit.wikimedia.org/r/1365867 (https://phabricator.wikimedia.org/T443872) (owner: 10Hashar) [11:21:21] James_F: indeed! There are less root images now :] [11:21:53] I'll see to get SREs to review/merges the patches I have prepared which would let us reparent the operations-puppet image to Bookworm [11:24:21] (03merge) 10addshore: Bump docker-registry.wikimedia.org/wikimedia/mediawiki-libs-shellbox image group to 2026-11-10-141215 [repos/releng/cli] - 10https://gitlab.wikimedia.org/repos/releng/cli/-/merge_requests/809 (owner: 10project_16_bot_841eade40a22c56a6272172b8cb67384) [11:32:31] (03CR) 10Hashar: [C:03+2] "Thx! 😎" [fresh] - 10https://gerrit.wikimedia.org/r/1369132 (https://phabricator.wikimedia.org/T439828) (owner: 10Krinkle) [11:34:19] (03PS1) 10Hashar: jjb: update jobs to keep global npmrc with npm --prefix [integration/config] - 10https://gerrit.wikimedia.org/r/1369404 (https://phabricator.wikimedia.org/T437376) [11:34:46] jjb/mediawiki.yaml:654:docker-registry.wikimedia.org/releng/quibble-coverage:1.22.0-s2 > 1.22.0-s13 # T441467 [11:34:47] T441467: phpunit-coverage-php83-publish always fails due to pcov not being available - https://phabricator.wikimedia.org/T441467 [11:34:52] bah I gotta revisit that one and finally fix it [11:38:33] (03Merged) 10jenkins-bot: fresh-install: Restore muted grey for install steps [fresh] - 10https://gerrit.wikimedia.org/r/1369132 (https://phabricator.wikimedia.org/T439828) (owner: 10Krinkle) [11:54:50] (03CR) 10Hashar: [C:03+2] jjb: update jobs to keep global npmrc with npm --prefix [integration/config] - 10https://gerrit.wikimedia.org/r/1369404 (https://phabricator.wikimedia.org/T437376) (owner: 10Hashar) [11:56:18] (03Merged) 10jenkins-bot: jjb: update jobs to keep global npmrc with npm --prefix [integration/config] - 10https://gerrit.wikimedia.org/r/1369404 (https://phabricator.wikimedia.org/T437376) (owner: 10Hashar) [12:14:58] hashar: Yeah. :-( [13:35:50] (03PS1) 10Hashar: dockerfiles: load PHP pcov but disable it by default [integration/config] - 10https://gerrit.wikimedia.org/r/1369431 (https://phabricator.wikimedia.org/T420009) [13:39:48] 10GitLab (Account Approval), 06Release-Engineering-Team: Requesting GitLab account activation for [YOUR DEVELOPER ACCOUNT USERNAME HERE] - https://phabricator.wikimedia.org/T444797#12555308 (10Aklapper) Thanks for your interest! Which project(s) in GitLab do you plan to work on? [13:45:55] 10GitLab (Account Approval), 06Release-Engineering-Team: Requesting GitLab account activation for CodeSparks45 - https://phabricator.wikimedia.org/T444804 (10CodeSparks45) 03NEW [13:54:23] (03PS2) 10Hashar: jjb: enable pcov by default in quibble-coverage jobs [integration/config] - 10https://gerrit.wikimedia.org/r/1356809 (https://phabricator.wikimedia.org/T420009) [13:54:23] (03PS1) 10Hashar: jjb: rm explicit pcov loading in phpunit coverage [integration/config] - 10https://gerrit.wikimedia.org/r/1369438 (https://phabricator.wikimedia.org/T420009) [13:57:04] (03CR) 10Hashar: "@daimona.wiki@gmail.com it took me a while to come back to this change." [integration/config] - 10https://gerrit.wikimedia.org/r/1356809 (https://phabricator.wikimedia.org/T420009) (owner: 10Hashar) [13:58:51] (03CR) 10Hashar: [C:03+2] dockerfiles: load PHP pcov but disable it by default [integration/config] - 10https://gerrit.wikimedia.org/r/1369431 (https://phabricator.wikimedia.org/T420009) (owner: 10Hashar) [13:59:09] (03CR) 10Hashar: [C:03+2] "I am building the images so we can have something to play with 😊" [integration/config] - 10https://gerrit.wikimedia.org/r/1369431 (https://phabricator.wikimedia.org/T420009) (owner: 10Hashar) [14:00:53] (03Merged) 10jenkins-bot: dockerfiles: load PHP pcov but disable it by default [integration/config] - 10https://gerrit.wikimedia.org/r/1369431 (https://phabricator.wikimedia.org/T420009) (owner: 10Hashar) [14:16:07] (03PS1) 10Hashar: jjb: update non coverage jobs for pcov.enabled=0 [integration/config] - 10https://gerrit.wikimedia.org/r/1369442 (https://phabricator.wikimedia.org/T420009) [14:17:40] (03PS2) 10Hashar: jjb: update non coverage jobs for pcov.enabled=0 [integration/config] - 10https://gerrit.wikimedia.org/r/1369442 (https://phabricator.wikimedia.org/T420009) [14:17:40] (03PS3) 10Hashar: jjb: enable pcov by default in quibble-coverage jobs [integration/config] - 10https://gerrit.wikimedia.org/r/1356809 (https://phabricator.wikimedia.org/T420009) [14:17:40] (03PS2) 10Hashar: jjb: rm explicit pcov loading in phpunit coverage [integration/config] - 10https://gerrit.wikimedia.org/r/1369438 (https://phabricator.wikimedia.org/T420009) [14:18:12] (03PS4) 10Hashar: jjb: enable pcov by default in quibble-coverage jobs [integration/config] - 10https://gerrit.wikimedia.org/r/1356809 (https://phabricator.wikimedia.org/T420009) [14:18:12] (03PS3) 10Hashar: jjb: rm explicit pcov loading in phpunit coverage [integration/config] - 10https://gerrit.wikimedia.org/r/1369438 (https://phabricator.wikimedia.org/T420009) [14:18:12] (03PS3) 10Hashar: jjb: update non coverage jobs for pcov.enabled=0 [integration/config] - 10https://gerrit.wikimedia.org/r/1369442 (https://phabricator.wikimedia.org/T420009) [14:18:23] bah dumb rebasing [14:48:29] 10Continuous-Integration-Infrastructure, 06Machine-Learning-Team (Q2 FY2026-27): Publish Pipeline Issue: publishing large images fails - https://phabricator.wikimedia.org/T444811#12555561 (10gkyziridis) [14:51:17] 10Gerrit, 06Collaboration-Services, 10SRE-SLO: Add a SSH probe to test a connection to Gerrit - https://phabricator.wikimedia.org/T444800#12555580 (10ABran-WMF) [14:51:27] 10Gerrit, 06Collaboration-Services, 10SRE-SLO: Add a SSH probe to test a connection to Gerrit - https://phabricator.wikimedia.org/T444800#12555583 (10ABran-WMF) p:05Triage→03Medium [15:28:06] (03CR) 10Hashar: [C:03+2] "Verified with MediaWiki and VisualEditor:" [integration/config] - 10https://gerrit.wikimedia.org/r/1356809 (https://phabricator.wikimedia.org/T420009) (owner: 10Hashar) [15:29:55] (03Merged) 10jenkins-bot: jjb: enable pcov by default in quibble-coverage jobs [integration/config] - 10https://gerrit.wikimedia.org/r/1356809 (https://phabricator.wikimedia.org/T420009) (owner: 10Hashar) [15:30:14] (03CR) 10Hashar: [C:03+2] "Verified on https://doc.wikimedia.org/cover/mediawiki-libs-IPAValidator/ 😊" [integration/config] - 10https://gerrit.wikimedia.org/r/1369438 (https://phabricator.wikimedia.org/T420009) (owner: 10Hashar) [15:30:29] (03CR) 10Hashar: [C:03+2] jjb: update non coverage jobs for pcov.enabled=0 [integration/config] - 10https://gerrit.wikimedia.org/r/1369442 (https://phabricator.wikimedia.org/T420009) (owner: 10Hashar) [15:32:16] (03Merged) 10jenkins-bot: jjb: rm explicit pcov loading in phpunit coverage [integration/config] - 10https://gerrit.wikimedia.org/r/1369438 (https://phabricator.wikimedia.org/T420009) (owner: 10Hashar) [15:32:26] (03Merged) 10jenkins-bot: jjb: update non coverage jobs for pcov.enabled=0 [integration/config] - 10https://gerrit.wikimedia.org/r/1369442 (https://phabricator.wikimedia.org/T420009) (owner: 10Hashar) [15:35:40] (03CR) 10Hashar: [C:03+2] "Done! :) I posted a summary on T420009#12555844 for public visibility / ease of discovery." [integration/config] - 10https://gerrit.wikimedia.org/r/1356809 (https://phabricator.wikimedia.org/T420009) (owner: 10Hashar) [15:36:41] (03CR) 10Hashar: [C:03+2] fresh-install: factor out a verbose() function [fresh] - 10https://gerrit.wikimedia.org/r/1369133 (owner: 10Krinkle) [15:42:20] (03Merged) 10jenkins-bot: fresh-install: factor out a verbose() function [fresh] - 10https://gerrit.wikimedia.org/r/1369133 (owner: 10Krinkle) [16:32:54] !log Creating integration-agent-docker-1119 (T439808) [16:32:57] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [16:32:57] T439808: Add more CPUs to quibble jobs - https://phabricator.wikimedia.org/T439808 [16:40:43] (03PS1) 10Vaughn Walters: jjb: [catalyst-daily-Score] Add Score job [integration/config] - 10https://gerrit.wikimedia.org/r/1369487 (https://phabricator.wikimedia.org/T444712) [16:41:04] (03CR) 10Vaughn Walters: [C:03+2] "https://integration.wikimedia.org/ci/view/selenium-daily/job/catalyst-daily-Score/1/console job is updated and first run passes, merging." [integration/config] - 10https://gerrit.wikimedia.org/r/1369487 (https://phabricator.wikimedia.org/T444712) (owner: 10Vaughn Walters) [16:43:07] (03Merged) 10jenkins-bot: jjb: [catalyst-daily-Score] Add Score job [integration/config] - 10https://gerrit.wikimedia.org/r/1369487 (https://phabricator.wikimedia.org/T444712) (owner: 10Vaughn Walters) [17:05:35] (03CR) 10Subramanya Sastry: Set up user-agent with email id to ensure we aren't throttled (031 comment) [integration/visualdiff] - 10https://gerrit.wikimedia.org/r/1356957 (owner: 10Subramanya Sastry) [17:09:00] (03update) 10project_16_bot_622d7b6d682aa66907ad1bffedf5b9e6: build(deps): bump golang.org/x/term from 0.47.0 to 0.48.0 [repos/releng/cli] - 10https://gitlab.wikimedia.org/repos/releng/cli/-/merge_requests/812 [17:18:25] (03PS1) 10Subramanya Sastry: Update CTT email to CPT email [integration/visualdiff] - 10https://gerrit.wikimedia.org/r/1369491 [17:29:50] !log Registered integration-agent-docker-1119 with Jenkins (T439808) [17:29:52] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [17:29:53] T439808: Add more CPUs to quibble jobs - https://phabricator.wikimedia.org/T439808 [17:39:11] (03CR) 10Isabelle Hurbain-Palatin: [C:03+2] Update CTT email to CPT email [integration/visualdiff] - 10https://gerrit.wikimedia.org/r/1369491 (owner: 10Subramanya Sastry) [17:39:37] (03Merged) 10jenkins-bot: Update CTT email to CPT email [integration/visualdiff] - 10https://gerrit.wikimedia.org/r/1369491 (owner: 10Subramanya Sastry) [17:53:56] 06Release-Engineering-Team (Seen), 10phan, 06Security-Team, 07Documentation, 07Wikimedia-extension-review-queue: Document that Phan is required for WMF deployed and MW bundled extensions - https://phabricator.wikimedia.org/T250038#12556371 (10Daimona) Assuming this is about the SecurityCheck plugin, I am... [17:57:49] 10Continuous-Integration-Infrastructure, 06Release-Engineering-Team, 06Machine-Learning-Team (Q2 FY2026-27): Publish Pipeline Issue: publishing large images fails - https://phabricator.wikimedia.org/T444811#12556378 (10dduvall) @gkyziridis this seems to be an edge case with very large SBOMs. I will investiga... [18:09:18] (03CR) 10Jforrester: dockerfiles: load PHP pcov but disable it by default (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/1369431 (https://phabricator.wikimedia.org/T420009) (owner: 10Hashar) [18:11:08] hashar: Tsk, your new images for PHP 8.5 were broken. Fixing. [18:11:56] (03CR) 10Jforrester: dockerfiles: load PHP pcov but disable it by default (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/1369431 (https://phabricator.wikimedia.org/T420009) (owner: 10Hashar) [18:20:05] (03PS1) 10Jforrester: dockerfiles: Fix pcov.ini path in PHP 8.5 images [integration/config] - 10https://gerrit.wikimedia.org/r/1369505 (https://phabricator.wikimedia.org/T420009) [18:20:15] (03CR) 10Jforrester: [C:03+2] dockerfiles: Fix pcov.ini path in PHP 8.5 images [integration/config] - 10https://gerrit.wikimedia.org/r/1369505 (https://phabricator.wikimedia.org/T420009) (owner: 10Jforrester) [18:21:37] (03CR) 10CI reject: [V:04-1] dockerfiles: Fix pcov.ini path in PHP 8.5 images [integration/config] - 10https://gerrit.wikimedia.org/r/1369505 (https://phabricator.wikimedia.org/T420009) (owner: 10Jforrester) [18:22:42] (03PS2) 10Jforrester: dockerfiles: Fix pcov.ini path in PHP 8.5 images [integration/config] - 10https://gerrit.wikimedia.org/r/1369505 (https://phabricator.wikimedia.org/T420009) [18:22:44] (03CR) 10Jforrester: "…" [integration/config] - 10https://gerrit.wikimedia.org/r/1369505 (https://phabricator.wikimedia.org/T420009) (owner: 10Jforrester) [18:24:31] (03Merged) 10jenkins-bot: dockerfiles: Fix pcov.ini path in PHP 8.5 images [integration/config] - 10https://gerrit.wikimedia.org/r/1369505 (https://phabricator.wikimedia.org/T420009) (owner: 10Jforrester) [18:25:01] !log Docker: Fix pcov.ini path in PHP 8.5 images [18:25:02] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [18:29:07] (03CR) 10Jforrester: [C:03+2] "Successfully published image docker-registry.discovery.wmnet/releng/quibble-bookworm-php85:1.22.0-s12" [integration/config] - 10https://gerrit.wikimedia.org/r/1369505 (https://phabricator.wikimedia.org/T420009) (owner: 10Jforrester) [19:15:41] (03PS1) 10Ahmon Dancy: build: Disable SBOM attestations by default [integration/pipelinelib] - 10https://gerrit.wikimedia.org/r/1369513 (https://phabricator.wikimedia.org/T444811) [19:16:42] (03PS2) 10Ahmon Dancy: build: Disable SBOM attestations by default [integration/pipelinelib] - 10https://gerrit.wikimedia.org/r/1369513 (https://phabricator.wikimedia.org/T444811) [19:17:52] (03open) 10dancy: Release 4.314.0 [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/1434 [19:18:14] (03CR) 10Ahmon Dancy: [C:03+2] build: Disable SBOM attestations by default [integration/pipelinelib] - 10https://gerrit.wikimedia.org/r/1369513 (https://phabricator.wikimedia.org/T444811) (owner: 10Ahmon Dancy) [19:18:45] (03Merged) 10jenkins-bot: build: Disable SBOM attestations by default [integration/pipelinelib] - 10https://gerrit.wikimedia.org/r/1369513 (https://phabricator.wikimedia.org/T444811) (owner: 10Ahmon Dancy) [19:20:15] (03merge) 10dancy: Release 4.314.0 [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/1434 [19:50:55] 10Continuous-Integration-Infrastructure, 06Release-Engineering-Team, 06Machine-Learning-Team (Q2 FY2026-27): Publish Pipeline Issue: publishing large images fails - https://phabricator.wikimedia.org/T444811#12556625 (10dancy) After disabling SBOM by default, I reran the 5 failed jobs and they're happy now: h... [20:00:12] 10Continuous-Integration-Infrastructure, 06Release-Engineering-Team, 06Test Platform, 06tools-infrastructure-team: Add more CPUs to quibble jobs - https://phabricator.wikimedia.org/T439808#12556647 (10pwangai) a:05Peter→03pwangai [20:00:28] !log Creating integration-agent-docker-{1120,1121,1122,1123} (T439808) [20:00:31] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [20:00:31] T439808: Add more CPUs to quibble jobs - https://phabricator.wikimedia.org/T439808 [20:05:09] FIRING: [3x] PuppetAgentFailure: Puppet agent failure detected on instance deployment-cp-text09 in project deployment-prep - https://prometheus-alerts.wmcloud.org/?q=alertname%3DPuppetAgentFailure [20:18:22] (03CR) 10Ahmon Dancy: jjb: point Composer at integration-cache-proxy when Zuul asks (033 comments) [integration/config] - 10https://gerrit.wikimedia.org/r/1369164 (https://phabricator.wikimedia.org/T444738) (owner: 10Mhurd) [20:31:59] (03update) 10dancy: scap: Record more deployment metrics [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/1366 [20:32:04] (03update) 10dancy: scap: Record more deployment metrics [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/1366 [20:38:29] (03update) 10dancy: scap: Record more deployment metrics [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/1366 [20:46:11] 10GitLab (CI & Job Runners): Upgrade gitlab-cloud-runners kubernetes - https://phabricator.wikimedia.org/T443969#12556756 (10dancy) 05Open→03Resolved p:05Triage→03Medium [20:46:13] !log Registered integration-agent-docker-{1120,1121,1122,1123} with Jenkins (T439808) [20:46:16] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [20:46:16] T439808: Add more CPUs to quibble jobs - https://phabricator.wikimedia.org/T439808 [20:46:30] 10GitLab (CI & Job Runners): Upgrade gitlab-cloud-runners kubernetes to 1.37.0-do.3 - https://phabricator.wikimedia.org/T443969#12556759 (10dancy) [20:56:09] (03open) 10dancy: exp: Fetch Gerrit plugin jars with curl instead of git-lfs [repos/releng/train-dev] - 10https://gitlab.wikimedia.org/repos/releng/train-dev/-/merge_requests/213 (https://phabricator.wikimedia.org/T443677) [20:57:36] (03merge) 10dancy: exp: Fetch Gerrit plugin jars with curl instead of git-lfs [repos/releng/train-dev] - 10https://gitlab.wikimedia.org/repos/releng/train-dev/-/merge_requests/213 (https://phabricator.wikimedia.org/T443677) [21:06:35] (03update) 10dancy: docs: Add section on image layer and cache efficiency [repos/releng/blubber] - 10https://gitlab.wikimedia.org/repos/releng/blubber/-/merge_requests/189 (https://phabricator.wikimedia.org/T268780) (owner: 10shivnagi) [21:23:06] FIRING: PuppetAgentStaleLastRun: Last Puppet run was over 24 hours ago on instance deployment-webperf31 in project deployment-prep - https://prometheus-alerts.wmcloud.org/?q=alertname%3DPuppetAgentStaleLastRun [21:28:31] (03merge) 10addshore: build(deps): bump golang.org/x/term from 0.47.0 to 0.48.0 [repos/releng/cli] - 10https://gitlab.wikimedia.org/repos/releng/cli/-/merge_requests/812 (owner: 10project_16_bot_622d7b6d682aa66907ad1bffedf5b9e6) [21:40:03] (03PS1) 10Vaughn Walters: jjb: [catalyst-daily] Email Wikidata when Wikibase jobs fail [integration/config] - 10https://gerrit.wikimedia.org/r/1369519 (https://phabricator.wikimedia.org/T444390) [21:41:00] (03CR) 10Vaughn Walters: [C:03+2] "Jobs are updated, and green on first pass after update. Merging" [integration/config] - 10https://gerrit.wikimedia.org/r/1369519 (https://phabricator.wikimedia.org/T444390) (owner: 10Vaughn Walters) [21:41:48] (03Merged) 10jenkins-bot: jjb: [catalyst-daily] Email Wikidata when Wikibase jobs fail [integration/config] - 10https://gerrit.wikimedia.org/r/1369519 (https://phabricator.wikimedia.org/T444390) (owner: 10Vaughn Walters) [22:04:06] FIRING: PuppetAgentNoResources: No Puppet resources found on instance deployment-webperf31 on project deployment-prep - https://prometheus-alerts.wmcloud.org/?q=alertname%3DPuppetAgentNoResources [22:51:09] FIRING: PuppetStaleCertificates: Found non-revoked Puppet certificates for 1 deleted instances on deployment-puppetserver-1 - https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/PuppetStaleCertificates - https://prometheus-alerts.wmcloud.org/?q=alertname%3DPuppetStaleCertificates [23:18:21] (03CR) 10Daimona Eaytoy: "Woooo nice, thank you :)" [integration/config] - 10https://gerrit.wikimedia.org/r/1356809 (https://phabricator.wikimedia.org/T420009) (owner: 10Hashar)