[00:13:05] <wm-bot>	 !log tools.fedi-share <anticomposite> Deploy 52376119
[00:13:08] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.fedi-share/SAL
[00:15:29] <AntiComposite>	 huh, I guess SAL's commit links don't work for gitlab yet.
[00:16:24] <AntiComposite>	 not sure if there's a good way to do that automagically.
[00:33:20] <wm-bb>	 <lucaswerkmeister> gitlab would need to have a feature to search for a commit hash across all repos
[00:33:37] <wm-bb>	 <lucaswerkmeister> (or a toolforge tool would have to maintain that index separately and then we could link to it and have it redirect, I suppose)
[07:21:12] <godog>	 hi, I just launched a bookworm instance and it is not letting me access, from the console logs I don't see the puppet run logs I was expected, am I missing something? https://horizon.wikimedia.org/project/instances/a5796de3-47e7-4880-9ec3-8105e276b90c/console
[07:21:34] <godog>	 I'll let the reader fix my morning english
[07:24:31] <taavi>	 godog: hi, which project is that in?
[07:25:37] <godog>	 taavi: hi, 'monitoring'
[07:26:02] <godog>	 this guy https://horizon.wikimedia.org/project/instances/a5796de3-47e7-4880-9ec3-8105e276b90c/
[07:29:30] <taavi>	 it seems like the metadata service (responsible for telling the instance what to do on first boot) is having some trouble. I restarted it, mind re-creating the instance?
[07:30:07] <godog>	 sure, will do
[07:30:16] <godog>	 with a different hostname I take it taavi ?
[07:30:48] <taavi>	 in theory everything should be fine with the same, but using a different one is always safer
[07:31:19] <godog>	 ok I'll go with a different one, thank you
[07:32:23] <godog>	 959b05e2-d983-47f9-b7b5-9fc41eb8cdac is just spawning now FWIW
[07:33:05] <taavi>	 yeah, this one looks much better
[07:33:06] <godog>	 yeah I think we're on
[07:33:09] <godog>	 indeed
[13:13:31] <taavi>	 !log tools wiping data directory from tools-prometheus-7 so we have least one working server T350227
[13:13:35] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL
[13:13:36] <stashbot>	 T350227: toolforge prometheus servers OOMing - https://phabricator.wikimedia.org/T350227
[17:25:59] <wm-bot>	 !log tools.stewardbots <superpes> Restarted SULWatcher on Toolforge after receiving Unknown internal error: (0, ''); traceback in console on IRC
[17:26:02] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.stewardbots/SAL
[17:32:06] <taavi>	 !log admin merged cloudcontrol firewall cleanup patch https://gerrit.wikimedia.org/r/c/operations/puppet/+/971211
[17:32:10] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL
[18:40:06] <kostajh>	 If anyone has ideas about T350432, I'd be happy to hear them
[18:40:07] <stashbot>	 T350432: File system access is very slow - https://phabricator.wikimedia.org/T350432
[19:40:44] <wm-bot>	 !log tools.fedi-share <anticomposite> Deploy https://gitlab.wikimedia.org/toolforge-repos/fedi-share/-/commit/deeb2c38ca0389bb17aa9a21580903543a0bbd56
[19:40:46] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.fedi-share/SAL