[12:31:59] Have we enabled/found out how to build images on gitlab-ci? I ask because I want to test https://gitlab.wikimedia.org/repos/cloud/toolforge/alerts/-/merge_requests/2 the same as the ops/alerts gerrit one, but that one uses blubber to build the image on the fly [12:32:41] I'm interested also if it's possible to just build and push images (to our own harbor repository for toolforge) [12:36:11] dcaro: you can use kokurri for building images with blubber files https://gitlab.wikimedia.org/repos/releng/kokkuri/-/blob/main/README.md#examples. RelEng build some abstraction for that use case [12:37:04] that's pretty cool [12:39:12] that solves one of the issues :) [12:39:12] For the other, can I build not blubber-based images too? (and push them to other repos like tools-harbor.wmcloud.org?) [12:40:32] I don't see any issues with converting our Dockerfiles to blubber :P but yes, the other registry question is more important [12:41:17] that'd be interesting too yes [12:41:22] (the conversion I mean) [12:41:56] 10GitLab (Project Migration), 10API Platform, 10Anti-Harassment, 10Cloud-Services, and 19 others: Migrate PipelineLib repos to GitLab - https://phabricator.wikimedia.org/T332953 (10BTullis) [13:08:32] 10GitLab (Project Migration), 10API Platform, 10Anti-Harassment, 10Cloud-Services, and 19 others: Migrate PipelineLib repos to GitLab - https://phabricator.wikimedia.org/T332953 (10BTullis) I've confirmed information related to [[https://gerrit.wikimedia.org/g/analytics/datahub|analytics/datahub]] above. W... [13:10:32] 10GitLab (Project Migration), 10Release-Engineering-Team: Create new GitLab project group: Technical documentation - https://phabricator.wikimedia.org/T336058 (10KBach) [13:35:35] Hmm, the first run was able to get running the tests, but now it's failing with "Cannot initiate the connection to mirrors.wikimedia.org:80 (2620:0:861:2:208:80:154:139). - connect (101: Network is unreachable)" while building the image (installing packages) [13:39:07] retrying worked now (runner-1024.gitlab-runners.eqiad1.wikimedia.cloud runner failed, 1030 worked) [13:42:10] dcaro: we have some firewallrules in place which limit access to certain wikimedia.org domains. I don't fully understand why it works on 1030. Let use know if you see issues with mirrors.wm.o in the future [13:43:04] I think it might be ip4/ip6 issue, sshing to the failing runner a ping/curl with ip4 works, ip6 does not (not sure why it apt chose ip6 though) [13:43:43] https://www.irccloud.com/pastebin/cIqbiYS6/ [13:51:05] both runners should not be able to connecct over ip6 because they run in WMCS without ipv6 support [13:55:07] that makes sense xd, weird that it tried then, fallback of apt maybe? [13:55:21] anyhow, did not happen again :) [14:42:40] dcaro: I'm online now. Lemme know if you need assistance. [14:43:40] I'm looking at https://gitlab.wikimedia.org/repos/cloud/toolforge/alerts/-/merge_requests/2 now [14:44:40] it passed :) [14:44:56] as in it worked yes [14:45:32] there's still the question on how to push to other repos (and maybe use docker instead of blubber, though that's not a big issue) [14:51:11] Try something like this: [14:51:14] https://www.irccloud.com/pastebin/PllJI3mH/ [14:54:38] You can also add PUBLISH_IMAGE_NAME to set the image path within the registry (defaults to the GitLab repo path) [14:55:33] How do I pass the credentials? [14:55:37] (awesome btw.) [14:56:29] hmm.. good question.. we automatically set up JWT auth but you'll presumably need something else for the other registry.. Lemme dig. [14:57:57] Looks like we'll need to do some coding to support alternate auth mechanisms. [15:12:10] Alternative: Use the kokuri image, but run the following in the script section: [15:12:13] https://www.irccloud.com/pastebin/3nGzEEtI/ [15:12:22] (untested) [15:12:40] Before that, add stuff to populate ~/.docker/config.json with auth info [15:15:08] can/should we do that on the shared runners or should we set up our own runners for that? [15:15:17] That will work on shared runners. [15:16:20] btw, when running buildctl manually, you can supply any frontend (e.g, the dockerfile frontend), so you're not locked to using blubber files. [15:17:52] To do that, use `--frontend=dockerfile.v0` (and exclude --opt source=...) [15:21:56] and point `--opt filename=` to the Dockerfile [15:34:22] 10GitLab (Project Migration), 10API Platform, 10Anti-Harassment, 10Cloud-Services, and 19 others: Migrate PipelineLib repos to GitLab - https://phabricator.wikimedia.org/T332953 (10isarantopoulos) Wow, sorry for the noise by referencing wrong ticket :) [15:43:35] 10GitLab (Infrastructure), 10serviceops-collab, 10Patch-For-Review: Cookbook sre.gitlab.upgrade fails when unpausing runners - https://phabricator.wikimedia.org/T335855 (10eoghan) 05Open→03In progress a:03eoghan [15:59:20] I'll save that answer to try it out :), thanks a lot! [17:57:17] 10GitLab (Project Migration), 10Abstract Wikipedia team, 10function-evaluator, 10Release-Engineering-Team (Priority Backlog 📥): Move the mediawiki/services/function-evaluator repo from gerrit+pipeline to GitLab - https://phabricator.wikimedia.org/T334398 (10SDunlap) [17:57:24] 10GitLab (Project Migration), 10Abstract Wikipedia team, 10function-orchestrator, 10Patch-For-Review, 10Release-Engineering-Team (Priority Backlog 📥): Move the mediawiki/services/function-orchestrator repo from gerrit+pipeline to GitLab - https://phabricator.wikimedia.org/T334397 (10SDunlap) [17:57:59] 10GitLab (Project Migration), 10Abstract Wikipedia team, 10function-evaluator, 10Release-Engineering-Team (Priority Backlog 📥): Move the mediawiki/services/function-evaluator repo from gerrit+pipeline to GitLab - https://phabricator.wikimedia.org/T334398 (10SDunlap) 05Open→03Resolved [17:58:31] 10GitLab (Project Migration), 10API Platform, 10Anti-Harassment, 10Cloud-Services, and 19 others: Migrate PipelineLib repos to GitLab - https://phabricator.wikimedia.org/T332953 (10SDunlap) [19:50:54] 10GitLab (Project Migration), 10Abstract Wikipedia team, 10function-evaluator, 10Release-Engineering-Team (Priority Backlog 📥): Move the mediawiki/services/function-evaluator repo from gerrit+pipeline to GitLab - https://phabricator.wikimedia.org/T334398 (10SDunlap) [20:32:36] 10GitLab (Auth & Access), 10Release-Engineering-Team: Provide Access Token to allow SonarQube to access GitLab - https://phabricator.wikimedia.org/T336014 (10thcipriani)