[10:26:06] <arturo>	 ceph is in HEALTH_WARN status
[10:26:46] <arturo>	 it has noin,norebalance flag(s) set
[10:29:54] <arturo>	 I see all osd as in, so I'll remove both flags
[10:33:44] <arturo>	 ceph is back into HEALTH_OK status, all osds and pgs look fine
[10:48:04] <blancadesal>	 arturo: when bumping i.e. the kube-state-metrics version, how do we make sure we have the new image?
[11:01:48] <arturo>	 blancadesal: we have https://docker-registry.toolforge.org/
[11:01:57] <arturo>	 which you can use to explore what we currently have in the registry
[11:02:25] <arturo>	 for metrics-server in particular
[11:02:31] <arturo>	 latest version is v0.6.2
[11:02:35] <arturo>	 https://docker-registry.toolforge.org/#!/taglist/metrics-server
[11:02:41] <arturo>	 so we need to cache the newer one
[11:03:13] <blancadesal>	 thanks
[11:03:14] <blancadesal>	 it
[11:03:38] <blancadesal>	 it's kube-state-metrics that needs upgrading from 2.6.0 to 2.7.0
[11:03:38] <arturo>	 we have a function in the cookbooks lib to do all the steps
[11:03:47] <arturo>	 ok!
[11:04:22] <arturo>	 we have a function in the cookbooks, but I don't think we expose it via a separate cookbook
[11:06:21] <arturo>	 we have wmcs_libs/k8s/images.py
[11:07:40] <blancadesal>	 where is this? I'm not seeing anything when doing `sudo cookbook --list`
[11:08:04] <arturo>	 is just the function, we don't have a cookbook to expose it directly, let me create one real quick
[11:13:46] <blancadesal>	 thanks!
[11:18:18] <arturo>	 blancadesal: https://gerrit.wikimedia.org/r/c/cloud/wmcs-cookbooks/+/1052286
[12:07:53] <arturo>	 blancadesal Raymond_Ndibe https://gitlab.wikimedia.org/repos/cloud/toolforge/lima-kilo/-/merge_requests/162
[14:46:00] <arturo>	 blancadesal: I have created T369363 and T369364
[14:46:01] <stashbot>	 T369363: toolforge: get a working setup for ingress-nginx and webservices in lima-kilo - https://phabricator.wikimedia.org/T369363
[14:46:02] <stashbot>	 T369364: toolforge: integrate fourohfour as a custom component, rather than a normal tool - https://phabricator.wikimedia.org/T369364
[14:49:12] <blancadesal>	 arturo: 👍
[15:02:02] <blancadesal>	 have a good weekend, see you on monday!
[15:02:08] <arturo>	 o/
[16:10:32] * arturo offline