[17:09:11] hi o11y i wonder if anyone is around to help with some PromQL [17:19:47] this is sort of what id like to do https://w.wiki/7uhB, but i would like it so that docker-reporter-k8s-images.service only appears with team serviceops (from the first join) [20:14:32] jbond: I played around with the query a bit. I do not know the purpose of this query, but eliminating everything past the "or" reduced the result to just team=serviceops and name=docker-reporter-k8s-images.service: `instance_name:node_systemd_unit_state_failed:count1 * on (instance,name) group_left(team) systemd_unit_owner` [20:20:31] cwhite: thanks for taking a look at this. the idea here is that we now have some systemd units that create the systemd_unit_owner metric. i want a way to say.. [20:21:21] if a a failed node_systemd_unit_state_failed has a systemd_unit_owner metric it can join with then use the team value from that. if not use the team value from role_owner [20:21:53] as an alternative aproach we could just creaye a systemd_unit_owner for every systemd unit (https://gerrit.wikimedia.org/r/c/operations/puppet/+/969177) but that might be overkill [20:50:17] jbond: I'm not sure there's a way to get there from here, but you might try asking Filippo. I can get role_owner to override systemd_unit_owner but not the other way around. There's a chance that this is an open feature request upstream too. [20:57:59] cwhite: ack thanks ill wait to see if filippo has any magic up his sleave :). [20:58:26] if you could also comment on the task above with suggestions of wether thats a good/bad idea that would be great [21:02:18] cwhite: curious whats the query to do "I can get role_owner to override systemd_unit_owner"? [21:15:49] `instance_name:node_systemd_unit_state_failed:count1 * on (instance, name) group_left(team) (systemd_unit_owner * on (instance) group_left(team) role_owner)`