[07:00:12] 10Phabricator (phabricator-next), 10Wikimedia-Phabricator-Extensions: Literal newlines on displayed text - https://phabricator.wikimedia.org/T389024#10640363 (10Aklapper) [09:56:42] Project beta-scap-sync-world build #198208: 04FAILURE in 1 min 38 sec: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/198208/ [10:06:58] Yippee, build fixed! [10:06:58] Project beta-scap-sync-world build #198209: 09FIXED in 1 min 48 sec: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/198209/ [10:16:50] Project beta-scap-sync-world build #198210: 04FAILURE in 1 min 41 sec: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/198210/ [10:27:01] Yippee, build fixed! [10:27:01] Project beta-scap-sync-world build #198211: 09FIXED in 1 min 52 sec: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/198211/ [10:50:02] maintenance-disconnect-full-disks build 684837 integration-agent-docker-1047 (/: 25%, /srv: 95%, /var/lib/docker: 23%): OFFLINE due to disk space [10:55:02] maintenance-disconnect-full-disks build 684838 integration-agent-docker-1047 (/: 25%, /srv: 58%, /var/lib/docker: 22%): RECOVERY disk space OK [11:04:03] Project beta-scap-sync-world build #198214: 04FAILURE in 2 min 1 sec: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/198214/ [11:07:54] (03update) 10oblivian: Allow multiple kubernetes clusters to be used [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/681 (https://phabricator.wikimedia.org/T388761) [11:08:09] Yippee, build fixed! [11:08:10] Project beta-scap-sync-world build #198215: 09FIXED in 2 min 1 sec: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/198215/ [11:08:40] (03update) 10oblivian: Allow multiple kubernetes clusters to be used [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/681 (https://phabricator.wikimedia.org/T388761) [11:16:46] Project beta-scap-sync-world build #198216: 04FAILURE in 1 min 36 sec: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/198216/ [11:38:29] Yippee, build fixed! [11:38:29] Project beta-scap-sync-world build #198217: 09FIXED in 13 min: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/198217/ [11:49:38] (03PS2) 10Arthur taylor: Update list of phpunit config files to copy to log directory [integration/quibble] - 10https://gerrit.wikimedia.org/r/1113983 (https://phabricator.wikimedia.org/T378797) [11:58:10] (03open) 10aklapper: Draft: Remove "Burnup Graph" project menu item code [repos/phabricator/extensions] (wmf/stable) - 10https://gitlab.wikimedia.org/repos/phabricator/extensions/-/merge_requests/53 (https://phabricator.wikimedia.org/T388664) [12:06:39] Project beta-scap-sync-world build #198221: 04FAILURE in 1 min 35 sec: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/198221/ [12:06:44] (03CR) 10CI reject: [V:04-1] Update list of phpunit config files to copy to log directory [integration/quibble] - 10https://gerrit.wikimedia.org/r/1113983 (https://phabricator.wikimedia.org/T378797) (owner: 10Arthur taylor) [12:16:48] Project beta-scap-sync-world build #198222: 04STILL FAILING in 1 min 40 sec: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/198222/ [12:18:56] who broke it [12:19:07] >12:16:48 [11 hits] TypeError: MediaWiki\Extension\CentralAuth\CentralDomainUtils::getWikiPageUrl(): Argument #1 ($wikiId) must be of type string, null given, called in /srv/mediawiki/php-master/extensions/CentralAuth/includes/CentralDomainUtils.p [12:19:26] tgr_: ^^ [12:38:10] Yippee, build fixed! [12:38:11] Project beta-scap-sync-world build #198223: 09FIXED in 13 min: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/198223/ [13:35:02] (03merge) 10thcipriani: spiderpig: Revise regular and admin user access control [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/680 (https://phabricator.wikimedia.org/T383947) (owner: 10dancy) [13:36:31] Project beta-scap-sync-world build #198230: 04FAILURE in 1 min 26 sec: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/198230/ [13:40:02] maintenance-disconnect-full-disks build 684871 integration-agent-docker-1050 (/: 25%, /srv: 96%, /var/lib/docker: 31%): OFFLINE due to disk space [13:42:41] 10Gerrit, 06collaboration-services: Investigate missing commit from old changes - https://phabricator.wikimedia.org/T388507#10641707 (10ABran-WMF) I started digging a bit around this issue, I've tried to run old Gerrit directories with our current `.war` file: it was not possible so I had to dig which version... [13:45:02] maintenance-disconnect-full-disks build 684872 integration-agent-docker-1050 (/: 25%, /srv: 46%, /var/lib/docker: 28%): RECOVERY disk space OK [13:46:49] Yippee, build fixed! [13:46:49] Project beta-scap-sync-world build #198231: 09FIXED in 1 min 48 sec: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/198231/ [13:55:05] 10Gerrit, 06collaboration-services: Investigate missing commit from old changes - https://phabricator.wikimedia.org/T388507#10641769 (10ABran-WMF) p:05Triage→03Low [14:04:54] Project beta-code-update-eqiad build #539562: 04FAILURE in 1 min 54 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/539562/ [14:15:07] Yippee, build fixed! [14:15:07] Project beta-code-update-eqiad build #539563: 09FIXED in 2 min 6 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/539563/ [14:41:26] 10WikimediaDebug, 06MediaWiki-Platform-Team, 10Observability-Tracing: Add support for request tracing to WikimediaDebug browser extension - https://phabricator.wikimedia.org/T340573#10642011 (10pmiazga) a:05pmiazga→03None Removing myself as I'm not actively working on it. [14:53:12] (03CR) 10Lucas Werkmeister (WMDE): Update list of phpunit config files to copy to log directory (032 comments) [integration/quibble] - 10https://gerrit.wikimedia.org/r/1113983 (https://phabricator.wikimedia.org/T378797) (owner: 10Arthur taylor) [15:27:00] 10Phabricator, 10Bitu, 10CAS-SSO, 06Infrastructure-Foundations, 10Striker: Inconsistent mapping of Developer accounts and SUL accounts across Phabricator, Bitu, and Striker - https://phabricator.wikimedia.org/T388498#10642294 (10SLyngshede-WMF) p:05Triage→03Low [15:32:28] (03update) 10dancy: kubernetes: avoid KeyError when build_mw_container_image is False [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/683 (owner: 10swfrench) [15:33:31] (03approved) 10dancy: kubernetes: avoid KeyError when build_mw_container_image is False [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/683 (owner: 10swfrench) [15:34:32] (03merge) 10dancy: kubernetes: avoid KeyError when build_mw_container_image is False [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/683 (owner: 10swfrench) [15:36:32] Project beta-scap-sync-world build #198241: 04FAILURE in 1 min 24 sec: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/198241/ [15:46:35] Project beta-scap-sync-world build #198242: 04STILL FAILING in 1 min 32 sec: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/198242/ [15:56:59] 10Continuous-Integration-Config, 10Continuous-Integration-Infrastructure, 10ci-test-error (WMF-deployed Build Failure): CI jobs failing with various timeouts (March 2025) - https://phabricator.wikimedia.org/T388416#10642436 (10Daimona) 2025-03-17 14:45:29Z: [[https://gerrit.wikimedia.org/r/c/mediawiki/extens... [15:57:01] Yippee, build fixed! [15:57:01] Project beta-scap-sync-world build #198243: 09FIXED in 1 min 51 sec: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/198243/ [15:57:38] Hmmmm have we got an undetected CentralAuth production error, judging from the above? [15:59:22] Okay I see it's known T388218 [15:59:23] T388218: TypeError: Argument 1 passed to MediaWiki\Extension\CentralAuth\CentralDomainUtils::getWikiPageUrl() must be of the type string, null given - https://phabricator.wikimedia.org/T388218 [16:11:20] (03merge) 10dancy: Add the bzip2 package to the mediawiki-debug image for legacy dumps [repos/releng/release] - 10https://gitlab.wikimedia.org/repos/releng/release/-/merge_requests/153 (https://phabricator.wikimedia.org/T352650 https://phabricator.wikimedia.org/T381473) (owner: 10btullis) [16:26:39] Project beta-scap-sync-world build #198246: 04FAILURE in 1 min 33 sec: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/198246/ [16:36:50] Yippee, build fixed! [16:36:50] Project beta-scap-sync-world build #198247: 09FIXED in 1 min 43 sec: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/198247/ [17:20:00] Project beta-update-databases-eqiad build #83324: 04FAILURE in 0.53 sec: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/83324/ [17:30:57] * bd808 looks at beta-update-databases-eqiad error [17:32:08] `Error: your composer.lock file is not up to date. Run "composer update --no-dev" to install newer dependencies` specifically it is complaining that wikimedia/parsoid: 0.21.0-a21 is installed and 0.21.0-a20 is required. [17:37:02] that error smells like a race between https://gerrit.wikimedia.org/r/c/mediawiki/vendor/+/1128442 and https://gerrit.wikimedia.org/r/c/mediawiki/core/+/1128443 [17:37:40] it looks like the mw/vendor.git change landed but the related mw/core.git change had not yet [17:38:17] * bd808 triggers a rebuild of beta-update-databases-eqiad [17:43:56] Project beta-scap-sync-world build #198253: 04FAILURE in 1 min 54 sec: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/198253/ [17:48:06] Yippee, build fixed! [17:48:06] Project beta-scap-sync-world build #198254: 09FIXED in 2 min 1 sec: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/198254/ [17:49:45] Yippee, build fixed! [17:49:45] Project beta-update-databases-eqiad build #83325: 09FIXED in 11 min: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/83325/ [17:51:14] (03open) 10dancy: Release 4.141.0 [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/684 [17:53:18] (03merge) 10dancy: Release 4.141.0 [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/684 [18:02:20] (03open) 10dancy: Add local-dev/restart-apiserver [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/685 [18:02:23] (03update) 10dancy: Add local-dev/restart-apiserver [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/685 [18:02:54] (03update) 10dancy: Add local-dev/restart-apiserver [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/685 [18:10:35] (03merge) 10dancy: Add local-dev/restart-apiserver [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/685 [18:35:02] maintenance-disconnect-full-disks build 684930 integration-agent-docker-1041 (/: 26%, /srv: 96%, /var/lib/docker: 30%): OFFLINE due to disk space [18:38:51] (03open) 10dancy: spiderpig/model.py: Set pid to None to clear [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/686 [18:38:55] (03update) 10dancy: spiderpig/model.py: Set pid to None to clear [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/686 [18:40:02] maintenance-disconnect-full-disks build 684931 integration-agent-docker-1041 (/: 26%, /srv: 31%, /var/lib/docker: 28%): RECOVERY disk space OK [18:40:12] (03merge) 10dancy: spiderpig/model.py: Set pid to None to clear [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/686 [18:40:51] (03open) 10dancy: Release 4.141.1 [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/687 [18:42:18] (03merge) 10dancy: Release 4.141.1 [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/687 [18:53:05] 10Phabricator (2025-03-11): Banner Tool: Unable to Save Custom Banner Settings - https://phabricator.wikimedia.org/T389112 (10Addobentil) 03NEW [19:47:07] (03open) 10dancy: JobHistory.vue: Add "Load more history" button [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/688 [19:47:09] (03update) 10dancy: JobHistory.vue: Add "Load more history" button [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/688 [19:49:11] (03merge) 10dancy: JobHistory.vue: Add "Load more history" button [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/688 [19:56:36] 10Phabricator, 10Bitu, 10CAS-SSO, 06Infrastructure-Foundations, 13Patch-Needs-Improvement: Phabricator should use IDP for developer account logins - https://phabricator.wikimedia.org/T377061#10643719 (10Aklapper) [20:08:20] 10Phabricator (phabricator-next): Uninstall Phlux (Phabricator application) - https://phabricator.wikimedia.org/T389117 (10Aklapper) 03NEW p:05Triage→03Low [20:09:06] 10Phabricator (phabricator-next), 10Release-Engineering-Team (Doing 😎): Uninstall Phlux (Phabricator application) - https://phabricator.wikimedia.org/T389117#10643792 (10Aklapper) [21:30:54] 10WikimediaDebug: Increase WikimediaDebug session length - https://phabricator.wikimedia.org/T389129 (10Tgr) 03NEW [21:38:59] 10WikimediaDebug: Increase WikimediaDebug session length - https://phabricator.wikimedia.org/T389129#10644195 (10Reedy) >I understand wanting to prevent someone accidentally leaving the flag on and polluting logs, but something like an hour would be a more reasonable expiry. Also matching with usual backport an... [23:22:06] 06Release-Engineering-Team, 06collaboration-services: Create test Gerrit instance - https://phabricator.wikimedia.org/T363196#10644649 (10Dzahn) a:05Dzahn→03None unassigning for now per @Aklapper-Guidelines. :) (it's up for grabs but I will also get back to it at some point)