[14:13:53] 10GitLab (Pipeline Services Migration🐤), 06collaboration-services: move os-reports.wikimedia.org to kubernetes - https://phabricator.wikimedia.org/T350794#10938485 (10Arnoldokoth) This is fully running on the aux cluster but the last update that allowed the rsync to run daily broke the CSS. Working on a fix fo... [15:54:00] some of the runners seem to have gone out of spacae https://gitlab.wikimedia.org/repos/cloud/toolforge/tofu-provisioning/-/jobs/544395 [15:54:03] *space [15:54:08] 10GitLab (CI & Job Runners), 06collaboration-services: Persistent puppet failure on gitlab-runner-1008.devtools.eqiad1.wikimedia.cloud - https://phabricator.wikimedia.org/T397641 (10dancy) 03NEW [15:54:18] 10GitLab (CI & Job Runners), 06collaboration-services: Persistent puppet failure on gitlab-runner-1008.devtools.eqiad1.wikimedia.cloud - https://phabricator.wikimedia.org/T397641#10938957 (10dancy) @jelto Pinging you about this first. [15:55:28] is there anything I can do to trigger some cleanup or something? [15:55:39] dcaro: Taking a look [15:55:45] ack thanks! [15:55:55] 10GitLab (CI & Job Runners), 06collaboration-services: Persistent puppet failure on gitlab-runner-1008.devtools.eqiad1.wikimedia.cloud - https://phabricator.wikimedia.org/T397641#10938971 (10Jelto) This is because of the missing test instance {T396622} which is stalled because of {T396739}. I'll take care of t... [15:56:17] 10GitLab (CI & Job Runners), 06collaboration-services: Persistent puppet failure on gitlab-runner-1008.devtools.eqiad1.wikimedia.cloud - https://phabricator.wikimedia.org/T397641#10938974 (10Jelto) [15:56:19] 10GitLab (Infrastructure), 06collaboration-services, 06Release-Engineering-Team: Re-create GitLab test instance - https://phabricator.wikimedia.org/T396622#10938975 (10Jelto) [16:05:01] !log Ran `docker run --rm -it --network gitlab-runner --entrypoint buildctl docker-registry.wikimedia.org/repos/releng/buildkit:wmf-v0.22.0 --addr buildkitd:1234 prune` on `runner-1025.gitlab-runners.eqiad1.wikimedia.cloud` [16:05:01] dancy: Not expecting to hear !log here [16:05:23] dcaro: Cleaned [16:05:51] thanks! 🚀 [17:47:19] 10GitLab (CI & Job Runners), 10Beta-Cluster-Infrastructure, 10m3api: Unable to connect to Beta Cluster from WMCS GitLab CI runners - https://phabricator.wikimedia.org/T397591#10939598 (10LucasWerkmeister) > (FTR, trying to use non-WMCS runners [fails with a different error](https://gitlab.wikimedia.org/repos...