[07:24:30] 10GitLab, 06Collaboration-Services, 13Patch-For-Review, 06Release-Engineering-Team (Radar): gitlab behind CDN - https://phabricator.wikimedia.org/T425441#12284248 (10ABran-WMF) [08:05:33] 10GitLab: kokkuri:setup-variables failing for repos/releng/release!268 (due to being a fork?) - https://phabricator.wikimedia.org/T436899 (10Jdforrester-WMF) 03NEW [08:28:57] Gitlab.wmo ssh is down for me (accessing from the WMDE office) [08:33:57] (please ignore—I am late to the migration) [08:37:21] If anyone else has issue with gitlab ssh, see https://lists.wikimedia.org/hyperkitty/list/wikitech-l@lists.wikimedia.org/message/IVJLPKCNNVD423WJBUQDMVFLWOXNI3PL/ and https://wikitech.wikimedia.org/wiki/GitLab/Migration [08:40:44] +1 the git config line was easy and effective, fwiw [09:13:14] 10GitLab, 06Collaboration-Services, 13Patch-For-Review, 06Release-Engineering-Team (Radar): gitlab behind CDN - https://phabricator.wikimedia.org/T425441#12284509 (10jnuche) hi there, our GitLab agents are failing to connect for the last hour or so, https://gitlab.wikimedia.org/repos/test-platform/catalyst... [09:20:04] 👋 hi, ^^ is blocking Catalyst deployment. Would anyone be able to help? [09:20:07] 10GitLab, 06Release-Engineering-Team: kokkuri:setup-variables failing for repos/releng/release!268 (due to being a fork?) - https://phabricator.wikimedia.org/T436899#12284530 (10Jdforrester-WMF) [09:39:05] 10GitLab, 06Release-Engineering-Team, 10Catalyst (Luka Ijo Pimeja Jan), 07Essential-Work: GitLab agents failing to connect - https://phabricator.wikimedia.org/T436902#12284691 (10jnuche) [10:00:28] jnuche: where are those clusters running? Are you able to use the internal discovery record of GitLab or https? [10:03:43] The discovery record is gitlab.discovery.wmnet [10:15:24] https://www.irccloud.com/pastebin/YzxYR9rN/ [10:16:11] jelto: they are running on Cloud VPS, I can't reach that host from the instances: [10:16:18] https://www.irccloud.com/pastebin/0BFviiBL/ [10:25:03] yes the discovery record is not accessible from Cloud VPS. Then I think we have to reach out to traffic and check if web sockets and long-lived web socket connections is possible with the CDN [10:33:56] hum, I think the agent only supports web sockets or grpc. If that's not supported by the CDN then we effectively can't deploy Patchdemo and Catalyst [11:02:45] We have other services working with web sockets (phabricator and etherpad). Let's see what's needed to get web socket support for GitLab [11:08:07] jelto: phew, thanks [12:17:24] 10GitLab, 06Release-Engineering-Team, 10Catalyst (Luka Ijo Pimeja Jan), 07Essential-Work, 13Patch-For-Review: GitLab agents failing to connect - https://phabricator.wikimedia.org/T436902#12285449 (10ABran-WMF) [12:17:27] 10GitLab, 06Collaboration-Services, 13Patch-For-Review, 06Release-Engineering-Team (Radar): gitlab behind CDN - https://phabricator.wikimedia.org/T425441#12285450 (10ABran-WMF) [12:19:03] 10GitLab, 06Collaboration-Services, 13Patch-For-Review, 06Release-Engineering-Team (Radar): gitlab behind CDN - https://phabricator.wikimedia.org/T425441#12285456 (10ABran-WMF) thanks for mentioning it @jnuche I sent 2 patches, one that will enable websockets on [[ https://gerrit.wikimedia.org/r/1334854 |... [13:08:09] 10GitLab, 06Collaboration-Services, 13Patch-For-Review, 06Release-Engineering-Team (Radar): gitlab behind CDN - https://phabricator.wikimedia.org/T425441#12285756 (10ABran-WMF) Another issue was [[ https://wikimedia.slack.com/archives/C05H0JYT85V/p1788437724411059 | mentioned ]] by @trueg. As discussed in... [14:21:01] 10GitLab, 06Collaboration-Services, 13Patch-For-Review, 06Release-Engineering-Team (Radar): gitlab behind CDN - https://phabricator.wikimedia.org/T425441#12286140 (10ABran-WMF) Gitlab primary instance is back to where it was this morning to simplify debugging the missing user-agent issue.