[09:34:25] GitLab needs a short maintenance break in around 30 minutes [10:13:44] Done [12:15:58] 10GitLab: The developer account named I can't log in to gitlab.wikimedia.org because its username is too short - https://phabricator.wikimedia.org/T329728 (10I) [12:20:20] 10GitLab: The developer account named I can't log in to gitlab.wikimedia.org because its username is too short - https://phabricator.wikimedia.org/T329728 (10I) p:05Triage→03Unbreak! We haven't found this problem before, because our user names are long enough, and I happen to be a special case, it stopped wo... [12:21:04] 10GitLab: The developer account named I can't log in to gitlab.wikimedia.org because its username is too short - https://phabricator.wikimedia.org/T329728 (10taavi) p:05Unbreak!→03Triage [13:07:32] 10GitLab (CI & Job Runners), 10Release-Engineering-Team (GitLab V: Event Horizon 🌄): Disallow direct access to the docker.io registry from gitlab runners - https://phabricator.wikimedia.org/T329679 (10Addshore) In practice I have never used `gitlab's registry proxy feature.`, and it appears that you may need t... [13:26:49] 10GitLab: The developer account named I can't log in to gitlab.wikimedia.org because its username is too short - https://phabricator.wikimedia.org/T329728 (10Aklapper) @I: Please do not set any task priorities, per https://www.mediawiki.org/wiki/Phabricator/Project_management#Setting_task_priorities . Thanks. [13:38:28] 10GitLab: Cannot log into gitlab.wikimedia.org with LDAP username which has only one character - https://phabricator.wikimedia.org/T329728 (10Aklapper) [14:15:37] 10GitLab (Infrastructure), 10serviceops-collab, 10Patch-For-Review: Align and refactor GitLab restore scripts - https://phabricator.wikimedia.org/T326315 (10Jelto) a:03Jelto [16:13:54] 10GitLab (Auth & Access): Cannot log into gitlab.wikimedia.org with LDAP username which has only one character - https://phabricator.wikimedia.org/T329728 (10brennen) [16:17:04] 10GitLab (Auth & Access), 10Release-Engineering-Team, 10Upstream: Cannot log into gitlab.wikimedia.org with LDAP username which has only one character - https://phabricator.wikimedia.org/T329728 (10brennen) 05Open→03Stalled I agree that this is an unfortunate limitation. It looks like an upstream issue:... [16:19:20] 10GitLab (Infrastructure), 10serviceops-collab: Investigate incremental backups for GitLab - https://phabricator.wikimedia.org/T324506 (10brennen) [16:19:30] 10GitLab (Project Migration), 10Release-Engineering-Team (GitLab V: Event Horizon 🌄): Make a tool to convert .pipeline/config.yaml to .gitlab-ci.yaml - https://phabricator.wikimedia.org/T327332 (10brennen) [16:19:35] 10GitLab (Auth & Access): Updating Wikimedia Developer Account email does not propagate to Gitlab - https://phabricator.wikimedia.org/T323880 (10brennen) [16:39:07] 10GitLab (CI & Job Runners), 10Release-Engineering-Team (GitLab V: Event Horizon 🌄): Mitigate thundering herd on GitLab runners - https://phabricator.wikimedia.org/T327416 (10dduvall) Summary of our current solution: 1. We've installed Istio's service mesh for the purpose of managing traffic to buildkitd and... [16:47:36] 10GitLab (CI & Job Runners), 10Release-Engineering-Team (GitLab V: Event Horizon 🌄): buildkitd: Require use of the blubber frontend when running on trusted runners. - https://phabricator.wikimedia.org/T329220 (10brennen) [16:48:04] 10GitLab (CI & Job Runners), 10Release-Engineering-Team (GitLab V: Event Horizon 🌄): Increase poll_timeout on kubernetes gitlab runners - https://phabricator.wikimedia.org/T329196 (10brennen) [16:48:12] 10GitLab (Infrastructure), 10serviceops-collab: automatically check for new gitlab releases and send notifications - https://phabricator.wikimedia.org/T323932 (10brennen) [16:54:03] 10GitLab (Infrastructure), 10MediaWiki-extensions-Gadgets, 10Release-Engineering-Team, 10Security-Team, 10Security: Allow Javascript files from Wikimedia GitLab to be loaded as scripts in Wikimedia wikis - https://phabricator.wikimedia.org/T321458 (10brennen) [17:24:10] 10GitLab (Auth & Access), 10Infrastructure-Foundations, 10SRE, 10serviceops-collab, and 3 others: migrate gitlab away from the CAS protocol - https://phabricator.wikimedia.org/T320390 (10brennen) [17:24:24] 10GitLab (Auth & Access), 10Infrastructure-Foundations, 10SRE, 10serviceops-collab, and 3 others: migrate gitlab away from the CAS protocol - https://phabricator.wikimedia.org/T320390 (10demon) [17:27:30] 10GitLab (Project Migration), 10Release-Engineering-Team (GitLab V: Event Horizon 🌄), 10User-brennen: Rename mainline branch from "master" to "main" in GitLab:repos/releng/release - https://phabricator.wikimedia.org/T329770 (10thcipriani) [17:30:25] 10GitLab (Project Migration), 10Release-Engineering-Team (GitLab V: Event Horizon 🌄), 10User-brennen: Rename mainline branch from "master" to "main" in GitLab:repos/releng/release - https://phabricator.wikimedia.org/T329770 (10thcipriani) Steps for future migrations: 1. Delete master branch in Gerrit 2. Arc... [17:31:58] 10GitLab (CI & Job Runners), 10Release-Engineering-Team (GitLab V: Event Horizon 🌄): Increase poll_timeout on kubernetes gitlab runners - https://phabricator.wikimedia.org/T329196 (10thcipriani) 05In progress→03Resolved [17:42:41] 10GitLab (Project Migration), 10Release-Engineering-Team (GitLab V: Event Horizon 🌄), 10User-brennen: Rename mainline branch from "master" to "main" in GitLab:repos/releng/release - https://phabricator.wikimedia.org/T329770 (10thcipriani) [17:44:39] 10GitLab (Auth & Access), 10Infrastructure-Foundations, 10SRE, 10serviceops-collab, and 3 others: migrate gitlab away from the CAS protocol - https://phabricator.wikimedia.org/T320390 (10thcipriani) @demon looking into what's need on the GitLab side; maybe "just" configuration 😂 [20:19:05] 10GitLab (Integrations), 10Phabricator, 10Release-Engineering-Team, 10User-brennen: gitlab-phabricator may be missing posts for merge request changes - https://phabricator.wikimedia.org/T329793 (10brennen) [20:19:15] 10GitLab (Integrations), 10Phabricator, 10Release-Engineering-Team, 10User-brennen: gitlab-phabricator may be missing posts for merge request changes - https://phabricator.wikimedia.org/T329793 (10brennen) a:03brennen [20:19:28] 10GitLab (Integrations), 10Phabricator, 10Release-Engineering-Team (GitLab V: Event Horizon 🌄), 10User-brennen: gitlab-phabricator may be missing posts for merge request changes - https://phabricator.wikimedia.org/T329793 (10brennen) [20:52:37] 10GitLab (CI & Job Runners), 10Release-Engineering-Team (GitLab V: Event Horizon 🌄): Disallow direct access to the docker.io registry from gitlab runners - https://phabricator.wikimedia.org/T329679 (10bd808) This is pretty much the same problem as {T254319} was. Can we instead/also setup default credentials li... [21:18:28] 10GitLab (CI & Job Runners), 10Release-Engineering-Team (GitLab V: Event Horizon 🌄): Disallow direct access to the docker.io registry from gitlab runners - https://phabricator.wikimedia.org/T329679 (10bd808) I have a Public Repo Read-only token for use with `docker login` that I would like to share as soon as... [21:21:00] 10GitLab (CI & Job Runners), 10Release-Engineering-Team, 10mwbot-rs, 10mwcli: GitLab CI jobs failing with "You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit" - https://phabricator.wikimedia.org/T329216 (10bd808) I m... [21:41:56] 10GitLab (CI & Job Runners): Secret storage for CI jobs - https://phabricator.wikimedia.org/T329798 (10bd808) [22:13:48] 10GitLab (Infrastructure), 10serviceops-collab, 10Patch-For-Review: automatically check for new gitlab releases and send notifications - https://phabricator.wikimedia.org/T323932 (10Dzahn) proof of concept / WIP: ` #!/usr/bin/python3 # check the version string of the latest gitlab security release # compare... [22:18:12] 10GitLab (Infrastructure), 10serviceops-collab, 10Patch-For-Review: automatically check for new gitlab releases and send notifications - https://phabricator.wikimedia.org/T323932 (10Legoktm) Why not use LibUp's upstream release monitoring? See https://www.mediawiki.org/wiki/Libraryupgrader [22:26:16] 10GitLab (Infrastructure), 10serviceops-collab, 10Patch-For-Review: automatically check for new gitlab releases and send notifications - https://phabricator.wikimedia.org/T323932 (10Dzahn) Thanks for the suggestion! I guess because upstream already provides a feed for us specifically for security releases... [22:47:28] 10GitLab (CI & Job Runners), 10Release-Engineering-Team, 10mwbot-rs, 10mwcli: GitLab CI jobs failing with "You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit" - https://phabricator.wikimedia.org/T329216 (10bd808) htt... [23:53:25] 10GitLab (CI & Job Runners), 10Release-Engineering-Team, 10mwbot-rs, 10mwcli: GitLab CI jobs failing with "You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit" - https://phabricator.wikimedia.org/T329216 (10bd808) >>!...