[08:00:33] Cteam: welcome to today 🦄! Don’t forget to post your update in thread. [08:00:33] Feel free to include: [08:00:33] 1. 🕫 Anything you'd like to share about your work [08:00:33] 2. ☏ Anything you'd like to get help with [08:00:33] 3. ⚠ Anything you're currently blocked on [08:00:33] (this message is from a toolforge job under the admin project) [08:17:59] Done: [08:17:59] * [toolforge,replica_cnf] Adapted code to work with the latest envvars-api changes (tools in the path, message-wrapped responses, ...) [08:17:59] * [toolforge,envvars-api] Deployed 0.0.50, any new deployments are now unblocked \o/ [08:17:59] * [ceph,reimage] got cloudcephosd1008 reimaged and brought back in the pool [08:17:59] Doing: [08:17:59] * [ceph,upgrade to bullseye] will reimage cloudcephosd1009, got some things to try to get the reimage unstuck https://phabricator.wikimedia.org/T369026 [08:17:59] * [ceph,disks] Doing load tests on the cluster, there might be a slight hiccup at some point, so far the cluster is behaving nicely, though we are hitting the network saturation limits on the router sides (packages getting dropped), might not be able to see the drives misbehave [08:18:00] * [toolforge,auth] Continue with oidc diagram/tests, we had a nice chat yesterday [08:18:00] * [1st of the month upgrades] continue with reviewing, merging and deploying the lib upgrades for toolforge projects [08:18:01] * [puppet] got a patch that enables cloud.yaml missing hiera vars checks to fail the tests, that would help us avoid the alert floods that happen from time to time when someone breaks them, but might be too annoying for other sres, will try to ask around/test https://gerrit.wikimedia.org/r/c/operations/puppet/+/1051332 [08:18:01] Blockers: [08:18:02] * None [13:41:11] Done: [13:41:11] • Replaced toolforge elasticsearch servers with new Bullseye instances [13:41:11] • (almost) upgraded deployment-prep memc servers with Bookworm (because I'm sick of the lack of deployment-prep progress) [13:41:11] Doing: [13:41:11] • Sorting out this machine ID bug (which probably involves building new glance images) T351507