[03:34:47] Project beta-code-update-eqiad build #541513: 04FAILURE in 1 min 46 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/541513/ [03:45:06] Yippee, build fixed! [03:45:06] Project beta-code-update-eqiad build #541514: 09FIXED in 2 min 5 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/541514/ [08:24:02] !log T389971: shutting down deployment-elastic* VMs in deployment-prep [08:24:04] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [08:24:05] T389971: Migrate deployment-prep elasticsearch cluster to opensearch - https://phabricator.wikimedia.org/T389971 [08:46:08] (03PS1) 10Krinkle: zuul: Remove uncontrolled recursion in extra deps in MW jobs (take 2) [integration/config] - 10https://gerrit.wikimedia.org/r/1132543 (https://phabricator.wikimedia.org/T389998) [08:48:26] hashar: can you think of a way to simulate ^ without merging it? E.g. can we tell a local Quibble to use this for its dependency map somehow instead of the normal way and check e.g. that at least core + stuff in the gate is passing? (i.e. in case there's another case like CentralAuth's unintended hard dependency on MobileFrontend, which are bad and should be fixed, but we can find out offline rather than by breaking CI for people). [08:48:56] In practice, its comes from env variables so it kinda assumes it is already set. maybe by hand but I'd rather not :) [08:49:23] the alternative is to do it next friday evening and use the weekend to shake anything out by re-checking repos [11:08:10] !log T389971: deleting deployment-elastic* VMs in deployment-prep [11:08:11] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [11:08:12] T389971: Migrate deployment-prep elasticsearch cluster to opensearch - https://phabricator.wikimedia.org/T389971 [11:37:31] 06Release-Engineering-Team, 06serviceops, 06SRE-OnFire, 10Sustainability (Incident Followup): Should scap be able to update helmfile-defaults when -Dbuild_mw_container_image:False ? - https://phabricator.wikimedia.org/T390531 (10jijiki) 03NEW [11:38:22] 06Release-Engineering-Team, 06serviceops, 06SRE-OnFire, 10Sustainability (Incident Followup): Should scap be able to update helmfile-defaults when -Dbuild_mw_container_image:False ? - https://phabricator.wikimedia.org/T390531#10693275 (10jijiki) [12:14:43] 10Gerrit: bc1qpgfvw9208g2n6thm4w2twrzgypk397du00rzez - https://phabricator.wikimedia.org/T390538 (10Mahmoudmrdom) 03NEW [12:21:22] 10GitLab (Pipeline Services Migration🐤), 06collaboration-services, 10Wikidata, 10Wikidata Query UI, and 2 others: move query.wikidata.org to kubernetes - https://phabricator.wikimedia.org/T350793#10693429 (10karapayneWMDE) Hey @Jelto , EM for wikidata here. Things are good on our side. Feel free to make th... [12:58:54] (03PS1) 10Jforrester: Zuul: [mediawiki/extensions/EmailAuth] Mark as in Wikimedia production, move up [integration/config] - 10https://gerrit.wikimedia.org/r/1132631 (https://phabricator.wikimedia.org/T390437) [13:18:07] 10Release-Engineering-Team (Radar), 10Scap (SpiderPig 🕸️), 06Infrastructure-Foundations, 07LDAP: Create 'spiderpig-users' ldap group - https://phabricator.wikimedia.org/T390338#10693587 (10MoritzMuehlenhoff) p:05Triage→03Medium a:03MoritzMuehlenhoff For consistency with other groups we'd use spiderpi... [13:58:48] (03CR) 10Hashar: "To test it, we could trigger the jobs manually against each the extensions & skins and set `EXT_DEPENDENCIES` as set by this pending chang" [integration/config] - 10https://gerrit.wikimedia.org/r/1132543 (https://phabricator.wikimedia.org/T389998) (owner: 10Krinkle) [13:59:00] (03PS2) 10Hashar: zuul: Remove uncontrolled recursion in extra deps in MW jobs (take 2) [integration/config] - 10https://gerrit.wikimedia.org/r/1132543 (https://phabricator.wikimedia.org/T389998) (owner: 10Krinkle) [13:59:00] (03PS1) 10Hashar: utils: script to manually launch jobs [integration/config] - 10https://gerrit.wikimedia.org/r/1132644 (https://phabricator.wikimedia.org/T389998) [14:05:34] (03CR) 10Hashar: "That should let us test https://gerrit.wikimedia.org/r/c/integration/config/+/1132543 and I should probably write doc?" [integration/config] - 10https://gerrit.wikimedia.org/r/1132644 (https://phabricator.wikimedia.org/T389998) (owner: 10Hashar) [14:06:15] Krinkle: when moving to quibble, I went to run it against every single extensions/skins to ensure it worked [14:06:19] or that the repos worked [14:06:39] we still have an `extension-broken` template in Zuul which is a remnant from that large run [14:06:45] https://gerrit.wikimedia.org/r/c/integration/config/+/1132644 [14:07:49] that reads the projects in zuul, apply the `set_parameters` from zuul/parameters_function.py [14:08:16] if there is any EXT_DEPENDENCIES, trigger quibble-vendor-mysql-php81-noselenium & quibble-vendor-mysql-php74-selenium over the Gearman protocol [14:08:36] wait for the job to complete and then logs success/failure with the job url [14:08:46] I gave it a try locally with a dummy Jenkins and that seems to more or less work [14:23:24] (03merge) 10thcipriani: settings.yaml: Add EmailAuth to wmf deployed extensions [repos/releng/release] - 10https://gitlab.wikimedia.org/repos/releng/release/-/merge_requests/157 (https://phabricator.wikimedia.org/T390437) (owner: 10reedy) [14:37:46] (03CR) 10Hashar: [C:03+2] Zuul: [mediawiki/extensions/MetricsPlatform]: Updated CI dependencies [integration/config] - 10https://gerrit.wikimedia.org/r/1131988 (https://phabricator.wikimedia.org/T390303) (owner: 10Santiago Faci) [14:39:29] (03Merged) 10jenkins-bot: Zuul: [mediawiki/extensions/MetricsPlatform]: Updated CI dependencies [integration/config] - 10https://gerrit.wikimedia.org/r/1131988 (https://phabricator.wikimedia.org/T390303) (owner: 10Santiago Faci) [14:40:39] (03CR) 10Hashar: "I have deployed the change today 😎" [integration/config] - 10https://gerrit.wikimedia.org/r/1132037 (owner: 10Krinkle) [14:44:04] Project beta-scap-sync-world build #200246: 04FAILURE in 2 min 2 sec: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/200246/ [14:45:53] 10Release-Engineering-Team (Radar), 10Scap (SpiderPig 🕸️), 06Infrastructure-Foundations, 07LDAP: Create 'spiderpig-access' ldap group - https://phabricator.wikimedia.org/T390338#10694140 (10thcipriani) [14:46:25] that sync failure seems like a reale issue, i will make a task [14:47:47] Project beta-scap-sync-world build #200247: 04STILL FAILING in 1 min 36 sec: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/200247/ [14:48:58] T390571 [14:48:59] T390571: ArgumentCountError: Too few arguments to function MediaWiki\Extension\CommunityConfiguration\Validation\JsonSchemaValidator::__construct(), 2 passed in /srv/mediawiki/php-master/extensions/ReportIncident/src/Config/ReportIncidentConfigValidator.php on line 45 and exactly 3 expected - https://phabricator.wikimedia.org/T390571 [14:49:20] 10Release-Engineering-Team (Radar), 10Scap (SpiderPig 🕸️), 06Infrastructure-Foundations, 07LDAP: Create 'spiderpig-access' ldap group - https://phabricator.wikimedia.org/T390338#10694162 (10thcipriani) >>! In T390338#10693587, @MoritzMuehlenhoff wrote: > For consistency with other groups we'd use spiderpig... [14:56:40] 10Gerrit, 06Release-Engineering-Team, 06collaboration-services: Enable browser notifications system in Gerrit - https://phabricator.wikimedia.org/T389327#10694208 (10hashar) @Quiddity Oops sorry for the noise, my intent was indeed to solely notify wikitech-l and the internal Slack channel. I have added t... [14:56:47] Project beta-scap-sync-world build #200248: 04STILL FAILING in 1 min 36 sec: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/200248/ [15:00:28] (03open) 10dancy: Release 4.148.0 [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/732 [15:02:25] (03merge) 10dancy: Release 4.148.0 [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/732 [15:06:42] Project beta-scap-sync-world build #200249: 04STILL FAILING in 1 min 33 sec: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/200249/ [15:14:37] 06Release-Engineering-Team, 06serviceops, 06SRE-OnFire, 10Sustainability (Incident Followup): Should scap be able to update helmfile-defaults when -Dbuild_mw_container_image:False ? - https://phabricator.wikimedia.org/T390531#10694284 (10jijiki) [15:15:22] (03CR) 10Jforrester: [C:03+2] Zuul: [mediawiki/extensions/EmailAuth] Mark as in Wikimedia production, move up [integration/config] - 10https://gerrit.wikimedia.org/r/1132631 (https://phabricator.wikimedia.org/T390437) (owner: 10Jforrester) [15:16:41] Project beta-scap-sync-world build #200250: 04STILL FAILING in 1 min 33 sec: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/200250/ [15:17:11] (03Merged) 10jenkins-bot: Zuul: [mediawiki/extensions/EmailAuth] Mark as in Wikimedia production, move up [integration/config] - 10https://gerrit.wikimedia.org/r/1132631 (https://phabricator.wikimedia.org/T390437) (owner: 10Jforrester) [15:20:21] 10Beta-Cluster-Infrastructure, 10MediaWiki-extensions-CentralAuth, 10WMF-JobQueue, 05Account-Vanishing, and 4 others: "JobQueueError: Could not enqueue jobs" when trying to request a global vanish on Beta Cluster - https://phabricator.wikimedia.org/T389585#10694298 (10Dreamy_Jazz) 05Open→03Resolved [15:20:36] !log Zuul: [mediawiki/extensions/EmailAuth] Mark as in Wikimedia production, move up, for T390437 [15:20:38] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [15:20:38] T390437: Deploy Extension:EmailAuth - https://phabricator.wikimedia.org/T390437 [15:23:40] 10GitLab (Account Approval), 06Release-Engineering-Team: Requesting GitLab account activation for Danyya - https://phabricator.wikimedia.org/T390574 (10Danya) 03NEW [15:25:40] 10GitLab (Account Approval), 06Release-Engineering-Team: Requesting GitLab account activation for Danyya - https://phabricator.wikimedia.org/T390574#10694324 (10bd808) 05Open→03Resolved a:03glaab https://wikitech.wikimedia.org/w/index.php?title=Tool:Gitlab-account-approval/Log&diff=prev&oldid=2288459 [15:26:46] Project beta-scap-sync-world build #200251: 04STILL FAILING in 1 min 35 sec: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/200251/ [15:30:00] 10Continuous-Integration-Infrastructure, 10Testing Support, 10ci-test-error (WMF-deployed Build Failure), 10MW-1.44-notes (1.44.0-wmf.23; 2025-04-01), and 2 others: Selenium timeouts can cause the job to remain stuck until the build times out - https://phabricator.wikimedia.org/T389536#10694340 (10Daimona)... [15:42:44] Project beta-scap-sync-world build #200252: 04STILL FAILING in 7 min 34 sec: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/200252/ [15:47:30] Project beta-scap-sync-world build #200253: 04STILL FAILING in 1 min 39 sec: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/200253/ [15:56:41] Project beta-scap-sync-world build #200254: 04STILL FAILING in 1 min 34 sec: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/200254/ [16:01:13] * hashar sighs [16:01:20] what is up beta [16:01:40] 15:56:41 15:56:41 Logstash checker Counted 23 error(s) in the last 20 seconds. The threshold is 10. [16:01:40] 15:56:41 [23 hits] ArgumentCountError: Too few arguments to function MediaWiki\Extension\CommunityConfiguration\Validation\JsonSchemaValidator::__construct(), 2 passed in /srv/mediawiki/php-master/extensions/ReportIncident/src/Config/ReportIncide [16:01:41] ah [16:02:06] hashar: T390571 [16:02:06] T390571: ArgumentCountError: Too few arguments to function MediaWiki\Extension\CommunityConfiguration\Validation\JsonSchemaValidator::__construct(), 2 passed in /srv/mediawiki/php-master/extensions/ReportIncident/src/Config/ReportIncidentConfigValidator.php on line 45 and exactly 3 expected - https://phabricator.wikimedia.org/T390571 [16:02:28] :) [16:03:01] It looks like the revert has merged. Hopefully that will make the next run work [16:03:10] yeah [16:03:30] thank you! [16:03:48] t.aavi filed the bug :) [16:12:04] Yippee, build fixed! [16:12:04] Project beta-scap-sync-world build #200255: 09FIXED in 6 min 55 sec: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/200255/ [16:14:07] that fixed it! [16:48:41] (03PS1) 10Kosta Harlan: zuul: Update WikimediaEvents dependencies [integration/config] - 10https://gerrit.wikimedia.org/r/1132688 (https://phabricator.wikimedia.org/T390437) [16:57:27] (03CR) 10Krinkle: utils: script to manually launch jobs (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/1132644 (https://phabricator.wikimedia.org/T389998) (owner: 10Hashar) [18:24:19] (03CR) 10Ahmon Dancy: [C:03+2] zuul: Update WikimediaEvents dependencies [integration/config] - 10https://gerrit.wikimedia.org/r/1132688 (https://phabricator.wikimedia.org/T390437) (owner: 10Kosta Harlan) [18:25:33] (03Merged) 10jenkins-bot: zuul: Update WikimediaEvents dependencies [integration/config] - 10https://gerrit.wikimedia.org/r/1132688 (https://phabricator.wikimedia.org/T390437) (owner: 10Kosta Harlan) [18:26:14] !log Reloading Zuul for https://gerrit.wikimedia.org/r/c/integration/config/+/1132688 [18:26:15] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [18:53:27] 10Phabricator, 10Release-Engineering-Team (Priority Backlog 📥): Update to Phorge upstream 2024.35 release - https://phabricator.wikimedia.org/T370266#10695356 (10brennen) > if there's a general need for this in the long term, budget can be requested for next FY Might be worth talking about, but yeah, for the... [19:11:15] (03open) 10dancy: spiderpig: Add