[06:28:50] given the notable lack of bot disconnections I think T400223 is done, I'll open a followup to audit and fix all other VMs [06:28:51] T400223: Investigate daily disconnections of IRC bots hosted in Toolforge - https://phabricator.wikimedia.org/T400223 [07:49:18] \o/ [07:49:34] morning! [08:07:47] \o/ indeed, and good morning [08:10:35] I also have this sneaky suspicion (and no proof) that nfs workers locking in D state might have sth to do with the fix, we'll see [08:12:49] Ooohhh, that would be awesome [08:22:14] yeah! on Mon I'll start fixing all VMs in T401880 [08:22:15] T401880: Ensure unique machine-id across Cloud VPS VMs - https://phabricator.wikimedia.org/T401880 [14:36:44] * taavi removes the word 'topic' from the start of the channel topic [14:42:06] andrewbogott: https://gerrit.wikimedia.org/r/c/operations/puppet/+/1178873 [14:43:34] my recollection is that the package naming varies by distro... [14:43:53] oh, I see, you're expecting us to never build another bullseye base image :) [14:44:38] hm, we can have it switch on distro for the scripted part but not for the cloud-init module [14:46:24] Considering how many hours I've lost to "we don't need to support new bullseye ceph nodes in partman" this week I'm reluctant to break that [14:46:56] it should even work with Bullseye, the package in use there is also named puppet-agent: https://debmonitor.wikimedia.org/packages/puppet-agent [14:48:13] moritzm: I am relying on my notes from last week on https://gerrit.wikimedia.org/r/c/operations/puppet/+/1176911 [14:48:17] but I can re-check [14:48:47] taavi: I'll do some tests and report back on the patch. [14:49:38] that's for stock bullseye, but on Bullseye we also use a Puppet 7 backport of the agent (and it' named puppet-agent) [14:49:58] likewise for trixie, where we use a forward port of the Puppet 7 agent [14:50:09] but for standard Debian your notes are 100% correct [14:52:07] * andrewbogott trying to figure out cloud-init module order [14:53:16] ok, in theory 'apt' happens before 'puppet' so we should be good [14:53:22] I will test it in codfw1dev [14:53:32] after breakfast + meeting (or possibly during meeting) [17:39:40] * dcaro off [17:39:41] cya! [17:40:27] have a good weekend!