[08:14:33] o/ dcausse: Would you know where glent is supposed to be released/deployed to? Central has version 0.3.2, archiva has version 0.3.3 both from March ‘23 [08:35:40] pfischer: I think glent should go to gitlab [09:28:54] errand+lunch [13:17:09] o/ [13:50:24] o/ [14:04:20] inflatador: sorry for the late notice but have to skip pairing today [14:25:29] dcausse np, I lost track of time myself :( [15:05:25] will be a bit late for the wed meeting... [16:39:32] back [16:44:34] dinner [17:39:05] ryankemper et al, quick CR for row D: https://gerrit.wikimedia.org/r/c/operations/puppet/+/1148922 . PCC is a no-op since we don't have any masters to change this time [17:43:46] lunch, back in ~40 [17:58:08] inflatador: +1'd [18:14:38] ryankemper thanks, merging now [18:19:14] looks like we had a couple of WDQS alerts [19:05:34] My bouncer is not cooperating. Maybe I should take this opportunity to move over to IRC cloud [19:45:05] ryankemper looks like we have another one of those SLO Metric alerts. I don't see that alert in the alerts repo, any idea where it comes from? [20:01:02] Will take a look [20:11:01] inflatador: https://codesearch.wmcloud.org/search/?q=wdqs-update-lag&files=&excludeFiles=&repos= [20:11:19] I see entries in thanos recording rules and pyrra slos [20:11:25] taking dog out real quick, back in 10 [20:12:31] ryankemper ACK, thanks. I guess those are different repos? Maybe Puppet? [20:20:50] quick break, back in ~20 [20:28:04] yeah both files are in puppet [20:29:47] I'm actually a little confused why it's firing since we still have the wdqs public cluster, just downsized a bunch [20:32:30] inflatador: ah, there's a slack thread about some airflow problems that we should prioritize investigating. looks like it's impacting dpe pretty significantly [20:33:10] might be ceph related [20:44:52] ryankemper ACK, just got back to desk [20:45:48] inflatador: let's hop in the meet a bit early (I'll be there in a few mins, just need to get the dog some water). i've been doing some initial digging but there's a whole lot of context in https://phabricator.wikimedia.org/T394459 that I'm still catching up on [20:53:01] inflatador: alright, in https://meet.google.com/fde-tbpf-wqh (no rush)