[01:06:35] 10Gerrit, 10Wikimedia-GitHub: gittles and github disagree on blame... - https://phabricator.wikimedia.org/T388752 (10Reedy) 03NEW [01:25:27] 10Gerrit, 10Wikimedia-GitHub: gittles and github disagree on blame... - https://phabricator.wikimedia.org/T388752#10631410 (10Dylsss) GitHub is confused... on purpose... https://github.com/wikimedia/mediawiki/blob/master/.git-blame-ignore-revs do we really need this though? [06:27:22] 10Gerrit, 10Wikimedia-GitHub: gittles and github disagree on blame... - https://phabricator.wikimedia.org/T388752#10631597 (10hashar) That was introduced by @tgr with f495269f74ac790ad43a19e47603082240b2f697 . There is short doc at https://gist.github.com/kateinoigakukun/b0bc920e587851bfffa98b9e279175f2 > Git... [07:15:13] 06Release-Engineering-Team, 10Scap, 10Dumps-Generation: scap needs to be k8s-cluster aware - https://phabricator.wikimedia.org/T388761 (10Joe) 03NEW [07:57:11] 10Phabricator, 10Release-Engineering-Team (Priority Backlog 📥), 10Wikimedia-Phabricator-Extensions, 07Technical-Debt: Remove "Burnup Graph" project menu item and custom ProjectBurnupGraphProfileMenuItem code - https://phabricator.wikimedia.org/T388664#10631660 (10Aklapper) Renamed the project menu item fro... [08:04:12] 10Phabricator, 06Security-Team: Remove the "Burnup Graph" project menu item from #Security-Team - https://phabricator.wikimedia.org/T388764 (10Aklapper) 03NEW [08:04:14] 10Phabricator: Remove the "Burnup Graph" project menu item from #User-MarcoAurelio - https://phabricator.wikimedia.org/T388765 (10Aklapper) 03NEW [08:06:53] 10Phabricator, 10Release-Engineering-Team (Doing 😎), 10Wikimedia-Phabricator-Extensions, 07Technical-Debt: Remove "Burnup Graph" project menu item and custom ProjectBurnupGraphProfileMenuItem code - https://phabricator.wikimedia.org/T388664#10631706 (10Aklapper) 05Open→03Stalled a:03Aklapper Stalled... [08:13:18] (03open) 10aklapper: Disallow adding Burnup Graph project menu item [repos/phabricator/extensions] (wmf/stable) - 10https://gitlab.wikimedia.org/repos/phabricator/extensions/-/merge_requests/52 (https://phabricator.wikimedia.org/T388664) [09:04:38] 10Continuous-Integration-Infrastructure, 10Quibble, 13Patch-For-Review: EarlyWarningBot comments are unreadable when the output includes ANSI colors - https://phabricator.wikimedia.org/T386773#10631812 (10kostajh) LGTM, thanks very much @matmarex! [09:04:43] 10Continuous-Integration-Infrastructure, 10Quibble, 13Patch-For-Review: EarlyWarningBot comments are unreadable when the output includes ANSI colors - https://phabricator.wikimedia.org/T386773#10631813 (10kostajh) 05Open→03Resolved [09:26:50] (03PS1) 10QChris: Allow “Gerrit Managers” to import history [extensions/DisableSpecialPages] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/1127469 [09:26:50] (03CR) 10QChris: [V:03+2 C:03+2] Allow “Gerrit Managers” to import history [extensions/DisableSpecialPages] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/1127469 (owner: 10QChris) [09:26:52] (03PS1) 10QChris: Import done. Revoke import grants [extensions/DisableSpecialPages] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/1127470 [09:26:52] (03CR) 10QChris: [V:03+2 C:03+2] Import done. Revoke import grants [extensions/DisableSpecialPages] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/1127470 (owner: 10QChris) [10:20:19] 06Release-Engineering-Team, 10Scap, 10Dumps-Generation: scap needs to be k8s-cluster aware - https://phabricator.wikimedia.org/T388761#10631976 (10BTullis) [10:20:28] 06Release-Engineering-Team, 10Data-Engineering-Roadmap, 06Data-Platform-SRE, 10Dumps-Generation, and 3 others: WE 5.4 KR - Hypothesis 5.4.4 - Q3 FY24/25 - Migrate current-generation dumps to run on kubernetes - https://phabricator.wikimedia.org/T352650#10631977 (10BTullis) [10:21:36] (03open) 10oblivian: Allow multiple kubernetes clusters to be used [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/681 (https://phabricator.wikimedia.org/T388761) [10:27:41] 06Project-Admins, 06Brickimedia, 06Diffusion-Repository-Administrators, 10Projects-Cleanup, 10Wikimedia-GitHub: Archive the GlobalContribs extension - https://phabricator.wikimedia.org/T157240#10631989 (10kostajh) Thanks, everyone. [11:52:10] 10Phabricator: "Call to phutil_nonempty_string() expected null or a string, got: bool" rendering alt text of image file - https://phabricator.wikimedia.org/T352170#10632183 (10Aklapper) 05Declined→03Stalled Happened again on 2025-03-06 for `PHID-FILE-6sky7buyii3gsmlasjck` which is `F58617593`, according to A... [12:36:26] (03update) 10aklapper: Remove unused code for $forced_policies [repos/phabricator/extensions] (wmf/stable) - 10https://gitlab.wikimedia.org/repos/phabricator/extensions/-/merge_requests/50 (https://phabricator.wikimedia.org/T385872) [12:37:33] (03merge) 10aklapper: Remove unused code for $forced_policies [repos/phabricator/extensions] (wmf/stable) - 10https://gitlab.wikimedia.org/repos/phabricator/extensions/-/merge_requests/50 (https://phabricator.wikimedia.org/T385872) [12:38:13] 10Phabricator (phabricator-next), 10Release-Engineering-Team (Doing 😎), 10Wikimedia-Phabricator-Extensions, 07Technical-Debt: SecurityPolicyEnforcerAction: !empty($forced_policies) is always falsy - https://phabricator.wikimedia.org/T385872#10632437 (10Aklapper) [13:00:55] PROBLEM - SSH on gerrit2003 is CRITICAL: CRITICAL - Socket timeout after 10 seconds https://wikitech.wikimedia.org/wiki/SSH/monitoring [13:05:42] 10Gerrit, 06collaboration-services: SSH on gerrit2003 is CRITICAL: CRITICAL - https://phabricator.wikimedia.org/T388785 (10Marostegui) 03NEW [13:08:45] RECOVERY - SSH on gerrit2003 is OK: SSH OK - OpenSSH_9.2p1 Debian-2+deb12u5 (protocol 2.0) https://wikitech.wikimedia.org/wiki/SSH/monitoring [13:14:15] 10Gerrit, 06collaboration-services: SSH on gerrit2003 is CRITICAL: CRITICAL - https://phabricator.wikimedia.org/T388785#10632625 (10Marostegui) 05Open→03Resolved a:03Marostegui Seems to have recovered ` [14:08:45] <+icinga-wm> RECOVERY - SSH on gerrit2003 is OK: SSH OK - OpenSSH_9.2p1 Debian-2+deb12... [13:45:02] maintenance-disconnect-full-disks build 683720 integration-agent-docker-1042 (/: 25%, /srv: 96%, /var/lib/docker: 38%): OFFLINE due to disk space [13:50:02] maintenance-disconnect-full-disks build 683721 integration-agent-docker-1042 (/: 25%, /srv: 57%, /var/lib/docker: 37%): RECOVERY disk space OK [14:27:03] 10Gerrit, 06Release-Engineering-Team, 06Security-Team, 07SecTeam-Processed, 07Security: Develop a means for preventing developers from accidentally pushing embargoed security patches to gerrit - https://phabricator.wikimedia.org/T388247#10633020 (10hashar) Gerrit has private changes which are described a... [14:50:28] 10Release-Engineering-Team (Doing 😎), 05Release, 05Train Deployments: 1.44.0-wmf.20 deployment blockers - https://phabricator.wikimedia.org/T386215#10633179 (10DLynch) [15:23:14] (03update) 10dancy: spiderpig: Revise regular and admin user access control [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/680 (https://phabricator.wikimedia.org/T383947) [15:25:14] (03open) 10btullis: Add the bzip2 package to the mediawiki-debug image for legacy dumps [repos/releng/release] - 10https://gitlab.wikimedia.org/repos/releng/release/-/merge_requests/153 (https://phabricator.wikimedia.org/T352650 https://phabricator.wikimedia.org/T381473) [15:26:33] 10GitLab (Account Approval), 06Release-Engineering-Team: Requesting GitLab account activation for [jlam] - https://phabricator.wikimedia.org/T388806 (10JLam-WMF) 03NEW [15:28:54] 10GitLab (Account Approval), 06Release-Engineering-Team: Requesting GitLab account activation for [jlam] - https://phabricator.wikimedia.org/T388806#10633405 (10taavi) Hey. This form (and the entire #GitLab project here) is about the instance at https://gitlab.wikimedia.org, not whatever instance other instanc... [15:32:50] 06Release-Engineering-Team, 10Scap, 10Dumps-Generation, 13Patch-For-Review: scap needs to be k8s-cluster aware - https://phabricator.wikimedia.org/T388761#10633451 (10bd808) It is looking like the Pretrain project will need this too so it can target the staging cluster with scap managed deployments. [15:52:42] 10Gerrit, 10Wikimedia-GitHub: gerrit's gittles does not follow .git-blame-ignore-revs, but GitHub does, leading to disagreements on git blame - https://phabricator.wikimedia.org/T388752#10633562 (10Jdforrester-WMF) [15:54:18] 10Gerrit, 10Wikimedia-GitHub: gerrit's gittles does not follow .git-blame-ignore-revs, but GitHub does, leading to disagreements on git blame - https://phabricator.wikimedia.org/T388752#10633568 (10Jdforrester-WMF) I'm a little surprised your local `git blame` says Tim; is yours really old? Locally I've got `g... [15:59:19] 10Gerrit, 10Wikimedia-GitHub: gerrit's gittles does not follow .git-blame-ignore-revs, but GitHub does, leading to disagreements on git blame - https://phabricator.wikimedia.org/T388752#10633582 (10Reedy) `git version 2.43.0` ` b73c0c4d3fc9 includes/htmlform/fields/HTMLUserTextField.php (Florian Schmidt 20... [16:00:15] 10Gerrit, 10Wikimedia-GitHub: gerrit's gittles does not follow .git-blame-ignore-revs, but GitHub does, leading to disagreements on git blame - https://phabricator.wikimedia.org/T388752#10633587 (10bd808) Related: * `git blame --ignore-revs-file .git-blame-ignore-revs ...` https://git-scm.com/docs/git-blame#Do... [16:17:37] 10Gerrit, 10Wikimedia-GitHub: gerrit's gittles does not follow .git-blame-ignore-revs, but GitHub does, leading to disagreements on git blame - https://phabricator.wikimedia.org/T388752#10633675 (10Jdforrester-WMF) > Feels config-y, rather than necessarily git version... Hmm, I thought `git config --global bl... [16:29:45] 10GitLab (Account Approval), 06Release-Engineering-Team: Requesting GitLab account activation for [jlam] - https://phabricator.wikimedia.org/T388806#10633770 (10JLam-WMF) Thanks, taavi. [16:33:32] 10GitLab (Account Approval), 06Release-Engineering-Team: Requesting GitLab account activation for Austin Varshney - https://phabricator.wikimedia.org/T383205#10633797 (10bd808) [16:45:14] 10GitLab (Account Approval), 06Release-Engineering-Team: Requesting GitLab account activation for [jlam] - https://phabricator.wikimedia.org/T388806#10633884 (10bd808) 05Open→03Invalid [16:57:32] 10Continuous-Integration-Config, 10Wikimedia-Site-requests, 07Logos, 13Patch-For-Review: CI on mediawiki-config should assert that the logos.php is generated by logos/manage.py - https://phabricator.wikimedia.org/T341412#10633954 (10hashar) Some tox.ini refactoring patches got fixed. @Pppery has sent two... [17:06:45] (03open) 10dancy: spiderpig: Ensure proper file/directory permissions [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/682 [17:06:48] (03update) 10dancy: spiderpig: Ensure proper file/directory permissions [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/682 [17:09:44] (03merge) 10dancy: spiderpig: Ensure proper file/directory permissions [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/682 [17:56:21] (03update) 10dancy: spiderpig: Revise regular and admin user access control [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/680 (https://phabricator.wikimedia.org/T383947) [17:58:09] (03update) 10dancy: spiderpig: Revise regular and admin user access control [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/680 (https://phabricator.wikimedia.org/T383947) [19:23:32] 10GitLab (CI & Job Runners): Upgrade gitlab-cloud-runner kubernetes clusters to version 1.29.13-do.0 - https://phabricator.wikimedia.org/T388836 (10dancy) 03NEW [19:26:42] !log Starting gitlab cloud runners k8s staging cluster upgrade (T388836) [19:26:43] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [19:26:44] T388836: Upgrade gitlab-cloud-runner kubernetes clusters to version 1.29.13-do.0 - https://phabricator.wikimedia.org/T388836 [19:58:42] (03open) 10dancy: README.md: Simplify terraform state unlock instructions [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/453 (https://phabricator.wikimedia.org/T372568) [19:58:43] (03update) 10dancy: README.md: Simplify terraform state unlock instructions [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/453 (https://phabricator.wikimedia.org/T372568) [19:59:34] (03update) 10dancy: README.md: Simplify terraform state unlock instructions [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/453 (https://phabricator.wikimedia.org/T372568) [20:05:52] 10GitLab (CI & Job Runners): Upgrade gitlab-cloud-runner kubernetes clusters to version 1.30.10-do.0 - https://phabricator.wikimedia.org/T388836#10634606 (10dancy) 05Open→03In progress p:05Triage→03Medium [20:09:16] !log Starting gitlab cloud runners k8s production cluster upgrade (T388836) [20:09:18] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [20:09:18] T388836: Upgrade gitlab-cloud-runner kubernetes clusters to version 1.30.10-do.0 - https://phabricator.wikimedia.org/T388836 [20:35:03] (03open) 10dancy: staging.tfvars: Set kubernetes_version to 1.30.10-do.0 [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/454 (https://phabricator.wikimedia.org/T388836) [20:35:04] (03update) 10dancy: staging.tfvars: Set kubernetes_version to 1.30.10-do.0 [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/454 (https://phabricator.wikimedia.org/T388836) [20:35:59] (03merge) 10dancy: staging.tfvars: Set kubernetes_version to 1.30.10-do.0 [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/454 (https://phabricator.wikimedia.org/T388836) [20:39:11] 10Continuous-Integration-Config, 10Wikimedia-Site-requests, 07Logos: CI on mediawiki-config should assert that the logos.php is generated by logos/manage.py - https://phabricator.wikimedia.org/T341412#10634661 (10Pppery) 05Open→03Resolved [20:40:15] 10Continuous-Integration-Config, 10Wikimedia-Site-requests, 07Logos: CI on mediawiki-config should assert that the logos.php is generated by logos/manage.py - https://phabricator.wikimedia.org/T341412#10634663 (10Pppery) Note that this task only asserts that the php file structure is consistent with the... [20:40:42] 10Continuous-Integration-Config, 06Release-Engineering-Team, 10Wikimedia-Site-requests, 07Logos: CI on mediawiki-config should assert that the logos.php is generated by logos/manage.py - https://phabricator.wikimedia.org/T341412#10634664 (10hashar) CI now generates `wmf-config/logs.php` and would bail... [20:42:58] !log Finished gitlab cloud runners k8s staging cluster upgrade (T388836) [20:43:00] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [20:43:00] T388836: Upgrade gitlab-cloud-runner kubernetes clusters to version 1.30.10-do.0 - https://phabricator.wikimedia.org/T388836 [21:09:04] 10Gerrit, 10Wikimedia-GitHub: gerrit's gitiles does not follow .git-blame-ignore-revs, but GitHub does, leading to disagreements on git blame - https://phabricator.wikimedia.org/T388752#10634716 (10Aklapper) [21:28:10] (03open) 10dancy: prod.tfvars: Set kubernetes_version to 1.30.10-do.0 [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/455 (https://phabricator.wikimedia.org/T388836) [21:28:12] (03update) 10dancy: prod.tfvars: Set kubernetes_version to 1.30.10-do.0 [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/455 (https://phabricator.wikimedia.org/T388836) [21:29:22] (03merge) 10dancy: prod.tfvars: Set kubernetes_version to 1.30.10-do.0 [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/455 (https://phabricator.wikimedia.org/T388836) [21:29:31] !log Finished gitlab cloud runners k8s production cluster upgrade (T388836) [21:29:33] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [21:29:34] T388836: Upgrade gitlab-cloud-runner kubernetes clusters to version 1.30.10-do.0 - https://phabricator.wikimedia.org/T388836 [21:36:23] 10GitLab (CI & Job Runners): Upgrade gitlab-cloud-runner kubernetes clusters to version 1.30.10-do.0 - https://phabricator.wikimedia.org/T388836#10634847 (10dancy) 05In progress→03Resolved [21:51:47] (03open) 10dancy: Revised scripts/tf-staging.py to scripts/tf.py [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/456 [21:51:49] (03update) 10dancy: Revised scripts/tf-staging.py to scripts/tf.py [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/456 [23:15:45] 10Release-Engineering-Team (Doing 😎), 05Release, 05Train Deployments: 1.44.0-wmf.20 deployment blockers - https://phabricator.wikimedia.org/T386215#10635102 (10thcipriani) 05Open→03Resolved [23:29:37] (03update) 10dancy: Revised scripts/tf-staging.py to scripts/tf.py [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/456 [23:30:04] (03update) 10dancy: Revised scripts/tf-staging.py to scripts/tf.py [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/456