[07:02:50] <akosiaris>	 reading backlog, the change was a noop, just a chart-bump for calico from 0.3.0 to 0.3.1. 
[07:05:00] <akosiaris>	 as to why it is failing, apparently calico-kube-controllers failing readiness probe, /me investigating
[07:07:04] <jynus>	 thanks, Alex
[07:07:39] <akosiaris>	 this is weird, this has worked just fine in staging-codfw
[07:11:37] <akosiaris>	 ok, found it
[07:12:12] <akosiaris>	 I was messing a bit yesterday with globalnetworkpolicies to verify the MTU change was ok and apparently I interfered with calico-kube-controllers ?
[08:47:50] <akosiaris>	 writeup in https://phabricator.wikimedia.org/T352956#10851490
[09:32:47] <btullis>	 Thanks also, and nice writeup.
[11:09:55] <vgutierrez>	 I'm staring at FixedRandomDelay= systemd.timer(5)  option
[11:10:28] <vgutierrez>	 it seems a nice|native replacement of fqdn_rand() for systemd timers
[11:10:47] <vgutierrez>	 and it should be available on >=bullseye
[11:46:49] <jynus>	 could you help me with something? where are the thanos-sourced alerts defined? I was unable to grep them on puppet
[11:48:15] <claime>	 jynus: https://gerrit.wikimedia.org/r/c/operations/alerts/ ?
[11:48:31] <claime>	 https://gerrit.wikimedia.org/r/q/project:operations/alerts sorry
[11:48:51] <jynus>	 thanks I searched on codeseach and got no answers
[13:43:01] <inflatador>	 jynus we were looking at the same thing the other day, at least I think we were? Related to SLO stuff. one sec...
[13:45:03] <inflatador>	 T393966 has a couple of Puppet PRs that might be useful (not 100% sure on that, though). There's also https://thanos.wikimedia.org/rule/alerts which shows the alerts we were trying to change
[13:45:04] <stashbot>	 T393966: Update WDQS SLO lag queries to reflect graph split changes - https://phabricator.wikimedia.org/T393966
[13:46:03] <jynus>	 not sure if we means I or obs team, but this was for a separate ticket
[13:47:05] <inflatador>	 Sorry, "we" as in DPE SRE. Our SLO alerts are defined in Thanos as well
[13:47:12] <jynus>	 ah, I get it now
[13:47:20] <jynus>	 sorry, had other things in minde
[13:48:08] <jynus>	 I sent an email to obs team, hopefully they can design an global approach for non SRE-alerts
[13:48:19] <jynus>	 but I need to run
[13:48:30] <jynus>	 have a nice day
[13:48:34] <inflatador>	 .o/