[12:31:27] herron: o/ [12:32:32] random thought/question for the slo dashboards - after a chat with rz*l the other day it seems clear that we'll need to use fixed time windows for the SLO dashboards. For example, the "current" one would be 2023-09-01 00:00:00 to 2023-11-31 23:59:59 [12:33:03] in grizzly we define "last 90d" and we use [90d] of time range in the various prom query configs [12:33:10] so I am wondering - what if we: [12:33:30] 1) use $__interval in the [] ranges rather than 90d (IIUC it shoud pick up the range specified in grafana) [12:34:01] 2) set the fixed time range in the grizzly repo (instead of last 90 days) and change it every three months with a single commit (rather than all people changing the dashboards) [12:34:29] am I totally crazy? [12:59:44] also, https://github.com/grafana/grafonnet-lib/blob/master/docs/examples.md shows "This repository has been archived by the owner on Jun 26, 2023. It is now read-only." [13:11:25] (maybe 1) is not needed) [13:16:35] yeah https://gerrit.wikimedia.org/r/c/operations/grafana-grizzly/+/956878 does the trick :) [13:18:12] elukey: yeah 1 not needed and also its good to use recording rules when we can for those 90d queries [13:20:04] hard coding the time seems fine to me for now, but we'll probably want to revisit that as SLOs become more operational in nature, i.e. burn alerting as opposed to quarterly reviews/reports [13:20:40] in any event we shuld document the rationale/duscisson in a task and link it [13:22:11] herron: yeah we can revisit down the line, but IIUC we'll always keep those ranges even when we'll have burn alerting etc.. [13:22:30] I can open a task adding people to it :) [13:22:51] I wanted to use the cr to discuss the change, but phab is good as well [13:23:04] thanks sounds good, yeah maybe there would be additional dashboards too. but if you got an alert that the budget will exhaust in 1 hour a 90 day graph isn't super useful [13:23:17] something to figure out/tune for sure [13:24:33] ahhh right yes yes, we'll probably need drill down dashboards [13:24:54] what I have in mind, for the moment, is just to have a way to know how your quarter is going basically [13:28:32] I think its a good idea yeah lets give it a try [13:29:49] created https://phabricator.wikimedia.org/T346144 [13:30:04] nice, thank you [13:30:06] let's see if others agree or if I get a lot of "boooo" [13:30:09] :) [13:30:14] * claime boos on principle [13:30:17] ha sounds like a plan [13:30:55] claime: it is always a pleasure to count on your support [13:33:38] elukey: very welcome, please ask again if you need nothing :p [13:36:24] claime: you can pair up with Manuel, he encourgages my ideas and work the same as you do :D [13:36:32] claime: https://youtu.be/Jmb0IbuBowI [19:08:01] herron: thanks for the comments and offer to help on the rsyslog/pki chnages. however im going to have to delay again :/ ..., i decided to take a few extra days vacation so im going to be off now untill the 21st. [19:08:24] do avoid doing things at the end of the week would it be cool to pick this up again on the 25th/26th? [19:08:50] jbond: ah! for sure just shoot me a ping when back and ready to give it a try, enjoy the time off! [19:09:05] awesome thanks <3 and will do :)