[08:00:12] Cteam: welcome to today 🦄! Don’t forget to post your update in thread. [08:00:12] Feel free to include: [08:00:12] 1. 🕫 Anything you'd like to share about your work [08:00:12] 2. ☏ Anything you'd like to get help with [08:00:12] 3. ⚠ Anything you're currently blocked on [08:00:12] (this message is from a toolforge job under the admin project) [10:48:47] Done: [10:48:49] * T379759 investigated a security issue, doesn't look serious [10:48:51] Working on: [10:48:53] * T352206 ToolsDB upgrade [10:48:55] * T379378 Kernel alerts [10:48:57] * T379570 vm_console cookbook not working [10:48:59] * clinic duty [15:06:11] Working on: [15:06:11] * Still reading through phab tasks and hardware things [15:06:11] * Trying to think about correct sizing of our compute capacity, which led me to fixating on some missing data on https://grafana.wikimedia.org/d/000000579/wmcs-openstack-eqiad-summary?orgId=1 [15:06:11] Just in case someone already knows where the CPU/Mem stats from the openstack exporter went, please let me know! [15:19:40] looks like the underlying metric openstack_placement_resource_usage is no longer present [15:28:59] yep. I think we might just need to pass some --also-include-this flags to the collector [15:29:58] haven't gotten that far yet though. I started to look at openstack-exporter last night before bed but discovered that all I have is a compiled go binary so stopped for the night [18:13:14] Done: [18:13:14] * [jobs-emailer] added it to lima-kilo and all the scripts around (versions, toolforge_deploy, ... let me know if you find any that is missing) [18:13:14] * [tools-webservice] Fix for service.template files where the `type` is not the last entry (deployed) [18:13:14] Doing: [18:13:14] * [jobs-emailer] Adding a basic /metrics endpoint for monitoring [18:13:14] * [tools-webservice] working on adding a bastion-like container to unblock the move to the bookworm bastion [18:13:14] Blockers: [18:13:15] * [jobs-emailer] Adopt the common project tooling (latest python, mypy...) https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/600 [18:13:15] * [envvars-admission] allow configuring global envvars to be set to all pods https://gitlab.wikimedia.org/repos/cloud/toolforge/envvars-admission/-/merge_requests/15 [18:13:16] * [toolforge-weld] load the toolforge api url from the env too (pairs with the envvars-admission one of setting it everywhere) https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-weld/-/merge_requests/66 [18:13:16] * [toolforge-deploy,jobs-emailer] set the pullImage policy to always in lima-kilo for fast dev iteration (https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/600)