[08:00:24] <wm-bot2>	 Cteam: welcome to today 🦄! Don’t forget to post your update in thread.
[08:00:24] <wm-bot2>	 Feel free to include:
[08:00:24] <wm-bot2>	 1. 🕫 Anything you'd like to share about your work
[08:00:24] <wm-bot2>	 2. ☏ Anything you'd like to get help with
[08:00:24] <wm-bot2>	 3. ⚠ Anything you're currently blocked on
[08:00:24] <wm-bot2>	 (this message is from a toolforge job under the admin project)
[08:19:18] <taavi>	 done:
[08:19:19] <taavi>	 * trying to get cadvisor to work with containerd
[08:19:19] <taavi>	 * reimaged cloudvirt-wdqs1001 into the new network layout after it was moved
[08:19:19] <taavi>	 doing:
[08:19:19] <taavi>	 * reimaging cloudmetrics hosts as spares until we're sure we don't need them
[08:19:19] <taavi>	 * trying to schedule a canary VM on cloudvirt-wqds1001
[08:19:19] <taavi>	 * will get back to containerd stuff if I have time
[08:19:20] <taavi>	 blockers:
[08:19:20] <taavi>	 * none
[08:19:29] <dcaro>	 Done:
[08:19:29] <dcaro>	 * Drained a couple cloudcephosd hosts to upgrade the firmware
[08:19:29] <dcaro>	 Doing:
[08:19:29] <dcaro>	 * Draining cloudcephosd hosts little by little so we can upgrade firmwares everywhere
[08:19:29] <dcaro>	 * Review as many patches as I can to unblock people
[08:19:29] <dcaro>	 * Still a bit "hangover" from yesterday migraine, will take it slow
[08:19:29] <dcaro>	 Blockers:
[08:19:30] <dcaro>	 * Nothing
[14:10:48] <andrewbogott>	 Wednesdsay + Yesterday:
[14:10:48] <andrewbogott>	 • Updated my cumin patch that handles openstack domains. It's now -1 due to a problem with the linter
[14:10:48] <andrewbogott>	 • More unproductive poking at Trove/Swift/self-serve backups
[14:10:48] <andrewbogott>	 Today:
[14:10:48] <andrewbogott>	 • Still working short days
[14:10:48] <andrewbogott>	 • Sorting out surge in disk usage on cloudbackups2001
[14:10:48] <andrewbogott>	 • Hopefully a few alerting/metrics things I've been planning to do all week
[15:33:08] <dcaro>	 I'm about to log out, there's some undraining + draining hapenning on the ceph cluster (we upgraded 2 hosts firmware already), I'll be keeping an eye during the weekend but feel free to reach me on telegram/page if needed (note that there's two 'david' in telegram, as I lost my old spanish number)
[17:16:05] <dhinus>	 This week I've worked on the following tasks:
[17:16:07] <dhinus>	 * (done) T348894 increased quotas for Montage tool
[17:16:08] <stashbot>	 T348894: Request increased quota for Montage Toolforge tool - https://phabricator.wikimedia.org/T348894
[17:16:09] <dhinus>	 * T349695 MariaDB crashes: created runbook, root cause still unclear
[17:16:10] <stashbot>	 T349695: [toolsdb] MariaDB process is killed by OOM killer (October 2023) - https://phabricator.wikimedia.org/T349695
[17:16:11] <dhinus>	 * T341285 Openstack upgrade: codfw is looking fine, will start with eqiad next week
[17:16:12] <stashbot>	 T341285: Upgrade cloud-vps openstack to version 'Antelope' - https://phabricator.wikimedia.org/T341285
[17:16:13] <dhinus>	 * T346453 Cumin OpenStack issues: I discussed this in detail with volans and agreed on a plan to be implemented next week
[17:16:14] <stashbot>	 T346453: [cumin] [openstack] Openstack backend fails when project is not set - https://phabricator.wikimedia.org/T346453
[17:16:15] <dhinus>	 Blockers:
[17:16:17] <dhinus>	 * none