[07:46:31] 10GitLab (Project Migration), 10Machine-Learning-Team, 10ORES: Migrate ORES/Revscoring/etc. repos to Gitlab or Gerrit - https://phabricator.wikimedia.org/T264651 (10Aklapper) [08:46:52] 10GitLab (CI & Job Runners), 10serviceops, 10serviceops-collab: DNS/networking not working on Trusted Runners - https://phabricator.wikimedia.org/T311241 (10Aklapper) [15:15:53] 10GitLab (Project Migration), 10Data-Engineering-Kanban, 10Product-Analytics, 10wmfdata-python, 10Data Engineering Planning: Move Wmfdata-Python from Github to Gitlab - https://phabricator.wikimedia.org/T304544 (10JArguello-WMF) [15:34:19] 10GitLab (Project Migration), 10Data-Engineering-Kanban, 10Product-Analytics, 10wmfdata-python, 10Data Engineering Planning (Sprint 01): Move Wmfdata-Python from Github to Gitlab - https://phabricator.wikimedia.org/T304544 (10JArguello-WMF) [16:05:42] brennen: no rush but at some point today perhaps we can troubleshoot the trusted runner [16:06:23] i'll try to summarize in our standup thread :) [16:07:42] ack [16:26:57] 10GitLab (CI & Job Runners), 10Security Team AppSec, 10Security-Team, 10Security: Create osv.dev ci includes - https://phabricator.wikimedia.org/T307514 (10mmartorana) 05In progress→03Resolved [16:27:03] 10GitLab (CI & Job Runners), 10Security Team AppSec, 10Security-Team, 10Security: Design and Build Application Security Pipeline Components for Gitlab - https://phabricator.wikimedia.org/T289290 (10mmartorana) [16:28:48] copying my notes here too for better visibility than slack: [16:28:53] https://www.irccloud.com/pastebin/oG8BcV8l/ [16:32:22] 10GitLab, 10Release-Engineering-Team: Changes to modules/gitlab_runner/templates/config-template.toml.erb have no effect on existing runners - https://phabricator.wikimedia.org/T311746 (10dduvall) [16:33:39] 10GitLab, 10Release-Engineering-Team: Changes to modules/gitlab_runner/templates/config-template.toml.erb have no effect on existing runners - https://phabricator.wikimedia.org/T311746 (10dduvall) @Dzahn helped troubleshoot this issue yesterday so CC'ing. @Jelto and @brennen too. [16:34:00] 10GitLab, 10Release-Engineering-Team: Changes to modules/gitlab_runner/templates/config-template.toml.erb have no effect on existing runners - https://phabricator.wikimedia.org/T311746 (10dduvall) [16:34:38] thanks dduvall [16:56:27] 10GitLab, 10Release-Engineering-Team: Changes to modules/gitlab_runner/templates/config-template.toml.erb have no effect on existing runners - https://phabricator.wikimedia.org/T311746 (10dduvall) Refactoring this will be tricky I think. Runners store their unique token in the configuration after the registrat... [17:11:26] 10GitLab (Project Migration), 10Data-Engineering-Kanban, 10Product-Analytics, 10wmfdata-python: Move Wmfdata-Python from Github to Gitlab - https://phabricator.wikimedia.org/T304544 (10EChetty) [18:35:59] 10GitLab, 10Release-Engineering-Team: Changes to modules/gitlab_runner/templates/config-template.toml.erb have no effect on existing runners - https://phabricator.wikimedia.org/T311746 (10Dzahn) Or we could also say that it's unlikely we will often make changes to the config after the initial setup and for whe... [19:09:18] 10GitLab (CI & Job Runners), 10serviceops, 10serviceops-collab: DNS/networking not working on Trusted Runners - https://phabricator.wikimedia.org/T311241 (10Dzahn) currently the issue here is not DNS anymore. but it is now: 'This job is stuck because you don't have any active runners online or available wi... [19:13:18] 10GitLab (Infrastructure), 10Release-Engineering-Team, 10serviceops, 10serviceops-collab, 10User-brennen: GitLab major release: 15.x - https://phabricator.wikimedia.org/T309062 (10Dzahn) [19:48:38] 10GitLab (CI & Job Runners): DNS/networking not working on Trusted Runners - https://phabricator.wikimedia.org/T311241 (10Dzahn) [19:49:09] 10GitLab (CI & Job Runners), 10serviceops, 10serviceops-collab: DNS/networking not working on Trusted Runners - https://phabricator.wikimedia.org/T311241 (10Dzahn) [20:56:20] 10GitLab, 10Release-Engineering-Team: Changes to modules/gitlab_runner/templates/config-template.toml.erb have no effect on existing runners - https://phabricator.wikimedia.org/T311746 (10dduvall) >>! In T311746#8042025, @Dzahn wrote: > Or we could also say that it's unlikely we will often make changes to the... [21:03:07] 10GitLab, 10Release-Engineering-Team: Changes to modules/gitlab_runner/templates/config-template.toml.erb have no effect on existing runners - https://phabricator.wikimedia.org/T311746 (10Dzahn) puppet already does the register command. It also is prepared to do the unregister command. It would do that if you... [21:07:28] 10GitLab, 10Release-Engineering-Team: Changes to modules/gitlab_runner/templates/config-template.toml.erb have no effect on existing runners - https://phabricator.wikimedia.org/T311746 (10dduvall) Or move the (de/re)-registration to the systemd service definition for restarts file and let puppet notify the ser... [21:16:09] 10GitLab, 10Release-Engineering-Team: Changes to modules/gitlab_runner/templates/config-template.toml.erb have no effect on existing runners - https://phabricator.wikimedia.org/T311746 (10dduvall) If we rely on a manual process, I think we're going to be dealing with consistency issues in our pool of runners q... [21:41:16] 10GitLab, 10Release-Engineering-Team: Changes to modules/gitlab_runner/templates/config-template.toml.erb have no effect on existing runners - https://phabricator.wikimedia.org/T311746 (10dduvall) Interestingly, the `gitlab_ci_runner` module from puppet forge does the weird token grabbing dance. See https://gi... [21:47:13] 10GitLab, 10Release-Engineering-Team: Changes to modules/gitlab_runner/templates/config-template.toml.erb have no effect on existing runners - https://phabricator.wikimedia.org/T311746 (10brennen) I do think we wind up tweaking runner config more often than I would have expected at first, so this will likely k... [22:03:59] 10GitLab, 10Release-Engineering-Team, 10serviceops, 10serviceops-collab: Changes to modules/gitlab_runner/templates/config-template.toml.erb have no effect on existing runners - https://phabricator.wikimedia.org/T311746 (10Dzahn)