[10:03:42] I'm trying to apply a k8s quota change (https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/728) [10:04:11] I did run the cookbook but the quota hasn't changed (checking with "toolforge jobs quota") [10:04:21] what am I doing wrong? :) [10:04:50] ok now it changed! it just took a while apparently! [10:05:56] I just had to wait for the cronjob to run [11:30:35] it changes via maintain-kubeusers, so it can be a few moments before it detects the new quota and updates it [11:30:38] * arturo is on PTO today [16:39:59] some D procs and nfs errors in tools-k8s-worker-nfs-21, I'll restart it [16:44:06] for the record, tool-fezcollector and tool-steve-adder have stuck pods that are failing to drain, and will be terminated shortly [17:44:06] thx dhinus, I was pondering rebooting it but didn't get around to it :) [19:29:34] topranks or dcaro, when around can you please respond about networking for new ceph osd? I don't quite follow the question https://phabricator.wikimedia.org/T378828 [19:38:38] andrewbogott: np responded there [19:38:56] thanks! especially because I just remember that David is out for two weeks [20:14:10] thanks!