[08:00:28] Cteam: welcome to today 🦄! Don’t forget to post your update in thread. [08:00:28] Feel free to include: [08:00:28] 1. 🕫 Anything you'd like to share about your work [08:00:28] 2. ☏ Anything you'd like to get help with [08:00:28] 3. ⚠ Anything you're currently blocked on [08:00:28] (this message is from a toolforge job under the admin project) [09:19:58] Done: [09:19:58] * Still catching up [09:19:58] Doing: [09:19:58] * Moved another one of the repos to gitlab flows (registry-admission) (T341084) [09:19:58] * Will start with reviews [09:19:58] T341084: [toolforge] Move all the components to the gitlab ci/cd flow - https://phabricator.wikimedia.org/T341084 [09:19:59] Blockers: [09:19:59] * None [10:17:16] Working on: checking what is left before T319401 can be resolved. Opening some new phabs as a follow-up. [10:17:17] T319401: Improve how we run WMCS cookbooks - https://phabricator.wikimedia.org/T319401 [13:23:49] yesterday: Very long, fruitless debug session trying to figure out what's happening with leaked cinder-backup snapshots. I see the rpc call to delete being sent but the volume service never seems to get them. [13:26:12] http? [13:44:50] A certain set of snaps are 'cursed' and the volume service never hears about them. If I create a /new/ snapshot the whole process works fine. So it's not a network connectivity issue. Something in between my loglines (don't know if client or server) must be deciding that these particular snaps can't be deleted and is ignoring the call [14:18:54] oh, that sounds like an unhandled exception being silently ignored or similar in the code