[00:11:52] Project mediawiki-core-doxygen-docker build #42090: 04STILL FAILING in 7 min 26 sec: https://integration.wikimedia.org/ci/job/mediawiki-core-doxygen-docker/42090/ [01:12:06] Project mediawiki-core-doxygen-docker build #42091: 04STILL FAILING in 7 min 40 sec: https://integration.wikimedia.org/ci/job/mediawiki-core-doxygen-docker/42091/ [01:50:18] 10Release-Engineering-Team (Seen), 10MW-on-K8s, 10SRE, 10Traffic, and 2 others: Serve production traffic via Kubernetes - https://phabricator.wikimedia.org/T290536 (10Quiddity) [02:11:25] Project mediawiki-core-doxygen-docker build #42092: 04STILL FAILING in 6 min 59 sec: https://integration.wikimedia.org/ci/job/mediawiki-core-doxygen-docker/42092/ [03:11:54] Project mediawiki-core-doxygen-docker build #42093: 04STILL FAILING in 7 min 28 sec: https://integration.wikimedia.org/ci/job/mediawiki-core-doxygen-docker/42093/ [03:22:58] Project mwcore-phpunit-coverage-master build #2766: 04FAILURE in 22 min: https://integration.wikimedia.org/ci/job/mwcore-phpunit-coverage-master/2766/ [03:52:42] Project mediawiki-core-phpmetrics-docker build #1574: 04FAILURE in 3 min 41 sec: https://integration.wikimedia.org/ci/job/mediawiki-core-phpmetrics-docker/1574/ [04:04:54] 10GitLab (Administration, Settings & Policy), 10Release-Engineering-Team (Priority Backlog 📥), 10Privacy Engineering, 10Product-Analytics, and 2 others: Request for Private repos to be enabled - https://phabricator.wikimedia.org/T305082 (10Legoktm) >>! In T305082#8731667, @thcipriani wrote: > There are a l... [04:11:45] Project mediawiki-core-doxygen-docker build #42094: 04STILL FAILING in 7 min 19 sec: https://integration.wikimedia.org/ci/job/mediawiki-core-doxygen-docker/42094/ [05:12:15] Project mediawiki-core-doxygen-docker build #42095: 04STILL FAILING in 7 min 49 sec: https://integration.wikimedia.org/ci/job/mediawiki-core-doxygen-docker/42095/ [06:11:58] Project mediawiki-core-doxygen-docker build #42096: 04STILL FAILING in 7 min 32 sec: https://integration.wikimedia.org/ci/job/mediawiki-core-doxygen-docker/42096/ [06:36:49] (03PS1) 10Krinkle: zuul: Enable CI jobs for node-cssjanus [integration/config] - 10https://gerrit.wikimedia.org/r/903539 [06:46:46] 10GitLab (Administration, Settings & Policy), 10Release-Engineering-Team (Priority Backlog 📥), 10Privacy Engineering, 10Product-Analytics, and 2 others: Request for Private repos to be enabled - https://phabricator.wikimedia.org/T305082 (10Bawolff) Maybe I'm a bit naive - but what precisely is the space of... [06:58:21] 10Release-Engineering-Team (GitLab V: Event Horizon 🌄), 10Patch-For-Review, 10Release, 10Train Deployments: 1.41.0-wmf.2 deployment blockers - https://phabricator.wikimedia.org/T330208 (10Jdforrester-WMF) [07:12:32] Project mediawiki-core-doxygen-docker build #42097: 04STILL FAILING in 8 min 6 sec: https://integration.wikimedia.org/ci/job/mediawiki-core-doxygen-docker/42097/ [07:57:42] (03CR) 10Hashar: [C: 03+2] "Maybe we can standardize upon invoking `npm run coverage` on all repositories and add that script entry point to all repos. Some others h" [integration/config] - 10https://gerrit.wikimedia.org/r/903539 (owner: 10Krinkle) [07:58:56] (03Merged) 10jenkins-bot: zuul: Enable CI jobs for node-cssjanus [integration/config] - 10https://gerrit.wikimedia.org/r/903539 (owner: 10Krinkle) [08:00:39] Project Wikibase-phpmetrics-docker build #831: 04FAILURE in 37 sec: https://integration.wikimedia.org/ci/job/Wikibase-phpmetrics-docker/831/ [08:06:16] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team, 10MediaWiki-Documentation: MediaWiki periodic Doxygen Jenkins job fails to publish - https://phabricator.wikimedia.org/T333294 (10hashar) [08:12:34] Project mediawiki-core-doxygen-docker build #42098: 04STILL FAILING in 8 min 8 sec: https://integration.wikimedia.org/ci/job/mediawiki-core-doxygen-docker/42098/ [08:17:13] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team, 10MediaWiki-Documentation: MediaWiki periodic Doxygen Jenkins job fails to publish - https://phabricator.wikimedia.org/T333294 (10hashar) I am pretty sure that is due to fb0b73e29f06b2a5b4089f09a6de77806308d3ec for T319477. It sets the `doc... [08:23:50] 10Continuous-Integration-Infrastructure, 10serviceops-collab, 10Patch-For-Review: Migrate doc hosts to Bullseye - https://phabricator.wikimedia.org/T319477 (10hashar) [08:23:52] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team, 10MediaWiki-Documentation, 10serviceops: MediaWiki periodic Doxygen Jenkins job fails to publish - https://phabricator.wikimedia.org/T333294 (10hashar) [08:23:56] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team, 10MediaWiki-Documentation, 10serviceops: MediaWiki periodic Doxygen Jenkins job fails to publish - https://phabricator.wikimedia.org/T333294 (10hashar) Checking on the server, there is a mixup with recently uploaded documentation owned by... [08:25:57] 10Continuous-Integration-Infrastructure, 10serviceops-collab, 10Patch-For-Review: Migrate doc hosts to Bullseye - https://phabricator.wikimedia.org/T319477 (10hashar) >>! In T319477#8731480, @gerritbot wrote: > Change 903319 **merged** by Andrea Denisse: > %%%[operations/puppet@production] doc: Reserve UID/G... [08:35:10] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team, 10MediaWiki-Documentation, 10serviceops: MediaWiki periodic Doxygen Jenkins job fails to publish - https://phabricator.wikimedia.org/T333294 (10Clement_Goubert) ` cgoubert@cumin1001:~$ sudo cumin 'P:doc' 'chown -R doc-uploader:doc-uploade... [08:39:55] 10GitLab (Infrastructure), 10ops-codfw, 10serviceops-collab: Install additional SSDs on gitlab2003.wikimedia.org (B5) - https://phabricator.wikimedia.org/T333304 (10Jelto) [08:43:15] Yippee, build fixed! [08:43:15] Project mediawiki-core-doxygen-docker build #42099: 09FIXED in 7 min 34 sec: https://integration.wikimedia.org/ci/job/mediawiki-core-doxygen-docker/42099/ [08:44:42] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team, 10MediaWiki-Documentation, 10serviceops: MediaWiki periodic Doxygen Jenkins job fails to publish - https://phabricator.wikimedia.org/T333294 (10hashar) 05Open→03Resolved a:03hashar That has fixed the publishing of the MediaWiki docu... [08:44:48] 10Continuous-Integration-Infrastructure, 10serviceops-collab, 10Patch-For-Review: Migrate doc hosts to Bullseye - https://phabricator.wikimedia.org/T319477 (10hashar) [08:44:51] claime: fix confirmed. Merci beaucoup! [08:44:56] err wrong channel [08:46:37] 10Continuous-Integration-Infrastructure, 10serviceops-collab, 10Patch-For-Review: Migrate doc hosts to Bullseye - https://phabricator.wikimedia.org/T319477 (10hashar) >>! In T319477#8732649, @hashar wrote: > I do not know why that was made, but that broke the documentation publishing since files under `/srv/... [10:28:56] 10Continuous-Integration-Infrastructure, 10Wikidata, 10wdwb-tech: Wikibase phpmetrics CI job fails - https://phabricator.wikimedia.org/T333329 (10Michael) [10:29:54] 10Continuous-Integration-Infrastructure, 10Wikidata, 10wdwb-tech: Wikibase phpmetrics CI job fails due to missing permissions - https://phabricator.wikimedia.org/T333329 (10Michael) [10:30:45] 10Continuous-Integration-Infrastructure, 10Wikidata, 10wdwb-tech: Wikibase phpmetrics CI job fails due to missing permissions on doc.discovery.wmnet/doc - https://phabricator.wikimedia.org/T333329 (10Michael) [10:47:48] <_joe_> hi there! I wanted to ask - I want to deploy an application to k8s, and use the deployment pipeline for that. Should I stick to gerrit for now? [10:53:33] _joe_: I think you can. The deployment pipeline was implemented in Groovy ( integration/pipelinelib ) on top of Jenkins [10:53:57] <_joe_> hashar: I was asking if the version for gitlab is ready or not :) [10:54:02] that got ported to python as Kokkuri ( https://gitlab.wikimedia.org/repos/releng/kokkuri ) [10:54:18] <_joe_> if it is, I'd rather use gitlab directly so that I save myself a migration later :) [10:54:18] and https://phabricator.wikimedia.org/T332953 is about migrating the repositories to the new system [10:55:04] well worse case, you gotta migrate :] [10:55:08] <_joe_> hashar: so I can use gitlab and publish an image via the pipeline? [10:57:02] of course that is the point [10:57:16] example in the gitlab ci file https://gitlab.wikimedia.org/repos/releng/kokkuri/-/blob/main/.gitlab-ci.yml#L138-147 [10:59:02] and when that repo got a v1.5.0 tag that triggered https://gitlab.wikimedia.org/repos/releng/kokkuri/-/pipelines/14497 [10:59:15] #24 pushing manifest for docker-registry.discovery.wmnet/repos/releng/kokkuri:v1.5.0@sha256:9978087c3c2446204fea8ef048550d5a474b983e4bb020d7587aaceb82b56c5c 0.5s done [10:59:29] there might be a tutorial somewhere [11:03:06] Yippee, build fixed! [11:03:06] Project Wikibase-phpmetrics-docker build #832: 09FIXED in 35 sec: https://integration.wikimedia.org/ci/job/Wikibase-phpmetrics-docker/832/ [11:03:56] 10Continuous-Integration-Infrastructure, 10Wikidata, 10wdwb-tech: Wikibase phpmetrics CI job fails due to missing permissions on doc.discovery.wmnet/doc - https://phabricator.wikimedia.org/T333329 (10hashar) Indeed! I have noticed the issue this morning when the MediaWiki core Doxygen job started failing T3... [11:04:06] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team, 10MediaWiki-Documentation, 10serviceops: MediaWiki periodic Doxygen Jenkins job fails to publish - https://phabricator.wikimedia.org/T333294 (10hashar) [11:04:15] 10Continuous-Integration-Infrastructure, 10Wikidata, 10wdwb-tech: Wikibase phpmetrics CI job fails due to missing permissions on doc.discovery.wmnet/doc - https://phabricator.wikimedia.org/T333329 (10hashar) [11:09:00] Yippee, build fixed! [11:09:01] Project mediawiki-core-phpmetrics-docker build #1575: 09FIXED in 5 min 45 sec: https://integration.wikimedia.org/ci/job/mediawiki-core-phpmetrics-docker/1575/ [12:09:37] 10Phabricator, 10serviceops-collab: create aphlict2001 (Phabricator realtime notifications codfw) - https://phabricator.wikimedia.org/T322369 (10ops-monitoring-bot) Cookbook cookbooks.sre.ganeti.reimage was started by eoghan@cumin1001 for host aphlict1002.eqiad.wmnet with OS bullseye [12:23:14] 10Phabricator, 10serviceops-collab: Phabricator's access log may have some problems in log rotation - https://phabricator.wikimedia.org/T332869 (10elukey) @LSobanski Hi! I think that we should prioritize this, something is not right and if it re-happens again we may not be able to inspect phabricator logs when... [12:36:33] 10Phabricator, 10serviceops-collab: create aphlict2001 (Phabricator realtime notifications codfw) - https://phabricator.wikimedia.org/T322369 (10ops-monitoring-bot) Cookbook cookbooks.sre.ganeti.reimage started by eoghan@cumin1001 for host aphlict1002.eqiad.wmnet with OS bullseye completed: - aphlict1002 (**PA... [12:42:43] 10Scap, 10Machine-Learning-Team, 10ORES: Scap deploy for ORES reports success even when uwsgi fails to start up - https://phabricator.wikimedia.org/T280998 (10elukey) 05Open→03Declined Ores is going to be replaced soon by Lift Wing. [12:44:02] 10GitLab (Infrastructure), 10serviceops-collab: Investigate incremental backups for GitLab - https://phabricator.wikimedia.org/T324506 (10Jelto) Thanks @Arnoldokoth for the tests. Yes it seems the "incremental" backup is significantly smaller and faster than a full backup. But it's not fully clear to me what's... [12:53:51] (03PS1) 10Hashar: wm-checks-api: parse PCC full message [software/gerrit] (deploy/wmf/stable-3.5) - 10https://gerrit.wikimedia.org/r/903643 [12:59:53] 10Continuous-Integration-Infrastructure, 10Wikidata, 10wdwb-tech: Wikibase phpmetrics CI job fails due to missing permissions on doc.discovery.wmnet/doc - https://phabricator.wikimedia.org/T333329 (10Michael) Thank you! 🙏 [13:06:09] 10Continuous-Integration-Infrastructure, 10OOUI, 10Patch-For-Review, 10Regression: OOUI PHP demos page is broken (again) - https://phabricator.wikimedia.org/T322357 (10hashar) >>! In T322357#8468528, @Krinkle wrote: > @hashar Do we have enabled and access to some kind of error_log for the doc1002 php-fpm i... [13:15:45] 10GitLab, 10Phabricator: Phabicator task gives "Invalid argument supplied for foreach()" - https://phabricator.wikimedia.org/T333347 (10hashar) [13:16:15] 10GitLab (Integrations), 10Phabricator: Phabicator task gives "Invalid argument supplied for foreach()" - https://phabricator.wikimedia.org/T333347 (10hashar) [13:26:02] 10GitLab (Integrations), 10Phabricator: Phabricator task gives "Invalid argument supplied for foreach()" - https://phabricator.wikimedia.org/T333347 (10hashar) [13:47:44] just a small reminder: contint1002 will be down during the switch maintenance T330165 starting in 15 minutes. [13:47:50] T330165: eqiad row B switches upgrade - https://phabricator.wikimedia.org/T330165 [14:00:32] 10Phabricator, 10serviceops-collab: Phabricator's access log may have some problems in log rotation - https://phabricator.wikimedia.org/T332869 (10Jelto) p:05Triage→03High a:03Jelto I can confirm log rotate failed 4 days ago. It seems to be stuck (`inactive (dead)`): ` systemctl list-timers | grep logro... [14:14:18] Gerrit as well :/ [14:15:06] hashar: do we know why Gerrit is down? I'm told it isn't in row B [14:15:11] Project beta-code-update-eqiad build #436939: 04FAILURE in 2 min 11 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/436939/ [14:15:24] I am not sure whether Zuul will catch up once the switch maintenance is done, we might have to restart it [14:15:41] cdanis: cause it has no network I guess . CI is broken as well (machines are not reachable) [14:15:50] I will check them once the switches are back :] [14:19:56] 10Scap: scap backport applied +2 to wrong changeset when run shortly after a rebase and hung waiting for merge - https://phabricator.wikimedia.org/T333241 (10SDunlap) That may have been indeed what happened. I can't recall at the point. [14:20:12] ahh, apparently it *is* in row B but didn't make the list of hosts on the maintenance task for some reason [14:20:16] anyway it's back now :) [14:22:12] \o/ [14:22:29] and Zuul apparently magically recovered [14:24:12] happy to hear that [14:24:55] Yippee, build fixed! [14:24:56] Project beta-code-update-eqiad build #436940: 09FIXED in 1 min 54 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/436940/ [14:36:59] I am taking a break. I will surely come back later this evening to update some Gerrit javascript plugins [14:46:02] 10GitLab (Administration, Settings & Policy), 10Release-Engineering-Team (Priority Backlog 📥), 10Privacy Engineering, 10Product-Analytics, and 2 others: Request for Private repos to be enabled - https://phabricator.wikimedia.org/T305082 (10mpopov) > The most obvious is that Wikimedia development defaults t... [14:56:42] 10GitLab (Administration, Settings & Policy), 10Release-Engineering-Team (Priority Backlog 📥), 10Privacy Engineering, 10Product-Analytics, and 2 others: Request for Private repos to be enabled - https://phabricator.wikimedia.org/T305082 (10mpopov) Thank you for your detailed and well-thought-out response,... [15:01:18] 10Release-Engineering-Team (GitLab V: Event Horizon 🌄), 10Patch-For-Review, 10Release, 10Train Deployments: 1.41.0-wmf.2 deployment blockers - https://phabricator.wikimedia.org/T330208 (10Jdforrester-WMF) OK, branch creation is merged, but the pre-deploy will have to be triggered manually. Over to @dduvall. [15:01:36] 10Release-Engineering-Team (GitLab V: Event Horizon 🌄), 10Patch-For-Review, 10Release, 10Train Deployments: 1.41.0-wmf.2 deployment blockers - https://phabricator.wikimedia.org/T330208 (10Jdforrester-WMF) [15:26:14] Yippee, build fixed! [15:26:15] Project mwcore-phpunit-coverage-master build #2767: 09FIXED in 26 min: https://integration.wikimedia.org/ci/job/mwcore-phpunit-coverage-master/2767/ [15:54:39] 10Phabricator, 10serviceops-collab: Phabricator's access log may have some problems in log rotation - https://phabricator.wikimedia.org/T332869 (10Jelto) thanks to @eoghan for pointing me to a patch which disabled logrotate on phabricator hosts: https://gerrit.wikimedia.org/r/c/operations/puppet/+/902396/8/mod... [16:08:40] 10GitLab (Administration, Settings & Policy), 10Release-Engineering-Team (Priority Backlog 📥), 10Privacy Engineering, 10Product-Analytics, and 2 others: Request for Private repos to be enabled - https://phabricator.wikimedia.org/T305082 (10brennen) > (Side question: Are there GitLab admins who are voluntee... [16:35:18] 10Scap, 10MW-on-K8s, 10serviceops: Error: failed to download "wmf-stable/mediawiki" when deploying to MW-on-K8s - https://phabricator.wikimedia.org/T333382 (10jnuche) In case it's useful, list of arguments helmfile was called with: ` 1: diff (4 bytes) 2: upgrade (7 bytes) 3: --reset-values (14 bytes)... [17:04:35] (Queue (Jenkins jobs + Zuul functions) alert) firing: - https://alerts.wikimedia.org/?q=alertname%3DQueue+%28Jenkins+jobs+%2B+Zuul+functions%29+alert [17:09:35] (Queue (Jenkins jobs + Zuul functions) alert) resolved: - https://alerts.wikimedia.org/?q=alertname%3DQueue+%28Jenkins+jobs+%2B+Zuul+functions%29+alert [17:10:44] 10Scap, 10MW-on-K8s, 10serviceops: Error: failed to download "wmf-stable/mediawiki" when deploying to MW-on-K8s - https://phabricator.wikimedia.org/T333382 (10dancy) The error message means that accessing https://helm-charts.wikimedia.org/stable/.... failed. [17:14:11] 10GitLab (Administration, Settings & Policy), 10Release-Engineering-Team (Priority Backlog 📥), 10Privacy Engineering, 10Product-Analytics, and 2 others: Request for Private repos to be enabled - https://phabricator.wikimedia.org/T305082 (10Legoktm) >>! In T305082#8735063, @mpopov wrote: >> The most obvious... [17:18:26] 10GitLab: Onboard non-WMF staff as GitLab admins - https://phabricator.wikimedia.org/T333386 (10Legoktm) [17:19:16] 10GitLab (Administration, Settings & Policy), 10Release-Engineering-Team (Priority Backlog 📥), 10Privacy Engineering, 10Product-Analytics, and 2 others: Request for Private repos to be enabled - https://phabricator.wikimedia.org/T305082 (10Legoktm) >>! In T305082#8735485, @brennen wrote: > There are not.... [17:36:02] 10GitLab (Administration, Settings & Policy), 10Release-Engineering-Team (Priority Backlog 📥), 10Privacy Engineering, 10Product-Analytics, and 2 others: Request for Private repos to be enabled - https://phabricator.wikimedia.org/T305082 (10Dzahn) > my best path right now is to download that notebook from t... [17:39:46] 10GitLab (Administration, Settings & Policy), 10Release-Engineering-Team, 10User-brennen: Onboard non-WMF staff as GitLab admins - https://phabricator.wikimedia.org/T333386 (10brennen) [18:33:04] 10Continuous-Integration-Infrastructure, 10serviceops-collab, 10Patch-For-Review: Migrate doc hosts to Bullseye - https://phabricator.wikimedia.org/T319477 (10andrea.denisse) Hi @hashar , I explained the rationale for changing the UID/GID (patch #903319) in the task: > As of now, we don't have standardized... [18:33:31] 10Continuous-Integration-Infrastructure, 10serviceops-collab, 10Patch-For-Review: Migrate doc hosts to Bullseye - https://phabricator.wikimedia.org/T319477 (10andrea.denisse) [18:34:25] 10Continuous-Integration-Infrastructure, 10serviceops-collab, 10Patch-For-Review: Migrate doc hosts to Bullseye - https://phabricator.wikimedia.org/T319477 (10andrea.denisse) [19:43:40] 10Continuous-Integration-Infrastructure, 10serviceops-collab, 10Patch-For-Review: Migrate doc hosts to Bullseye - https://phabricator.wikimedia.org/T319477 (10hashar) Thanks for the detailed explanation. Indeed the uid mismatch is a mess. Although rsync (running as root) is able to do the uid translation be... [20:38:05] 10Release-Engineering-Team, 10Observability-Logging, 10SRE, 10Wikimedia-Logstash, 10SRE Observability (FY2022/2023-Q3): mediawiki-errors logstash dashboard's "errors over time" panel broken - https://phabricator.wikimedia.org/T332273 (10lmata) thanks @colewhite! [20:59:37] 10GitLab (Project Migration), 10Release-Engineering-Team (Priority Backlog 📥): Migrate PipelineLib repos to GitLab - https://phabricator.wikimedia.org/T332953 (10thcipriani) [21:37:53] 10MediaWiki-Releasing, 10AntiSpoof: Bundle AntiSpoof extension with MediaWiki - https://phabricator.wikimedia.org/T191736 (10Jdforrester-WMF) [21:37:59] 10MediaWiki-Releasing, 10MediaWiki-extensions-OATHAuth: Bundle WebAuthn extension with MediaWiki - https://phabricator.wikimedia.org/T258007 (10Jdforrester-WMF) [21:38:04] 10MediaWiki-Releasing, 10TemplateStyles: Bundle Extension:TemplateStyles with MediaWiki core - https://phabricator.wikimedia.org/T327006 (10Jdforrester-WMF) [21:38:16] 10MediaWiki-Releasing, 10Reference Previews: Bundle Popups extension with MediaWiki - https://phabricator.wikimedia.org/T231797 (10Jdforrester-WMF) [21:38:29] 10MediaWiki-Releasing, 10MobileFrontend (Tracking): Bundle MobileFrontend extension with MediaWiki - https://phabricator.wikimedia.org/T191734 (10Jdforrester-WMF) [21:39:44] 10MediaWiki-Releasing, 10MediaWiki-Installer, 10MediaWiki-Stakeholders-Group, 10Epic: Expand the set of bundled extensions and skins in MediaWiki 1.41 - https://phabricator.wikimedia.org/T333405 (10Jdforrester-WMF) [21:40:18] 10MediaWiki-Releasing, 10MediaWiki-Installer, 10MediaWiki-Stakeholders-Group, 10Epic, 10MW-1.40-release: Expand the set of bundled extensions and skins in MediaWiki 1.40 - https://phabricator.wikimedia.org/T317146 (10Jdforrester-WMF) 05Open→03Resolved [21:43:10] 10Release-Engineering-Team (Priority Backlog 📥), 10serviceops, 10Release Pipeline (Blubber): Buildkit erroring with "cannot reuse body, request must be retried" upon multi-platform push - https://phabricator.wikimedia.org/T322453 (10dduvall) Thank you, @JMeybohm. That's very helpful. It does seem like the `... [22:46:16] 10GitLab (Project Migration), 10Release-Engineering-Team (Priority Backlog 📥): Migrate PipelineLib repos to GitLab - https://phabricator.wikimedia.org/T332953 (10Legoktm) [22:53:46] 10GitLab (Project Migration), 10Release-Engineering-Team (Priority Backlog 📥): Migrate PipelineLib repos to GitLab - https://phabricator.wikimedia.org/T332953 (10Legoktm)