[08:54:38] godog: hey o/ do you have a minute by chance to look at https://gerrit.wikimedia.org/r/c/operations/puppet/+/1032394 ? [08:55:08] jayme: for sure, I'll take a look later today [08:55:26] cool, thank you! [11:53:42] thanks g.odog - I'll merge carfully [12:00:42] messed up tls verification... :/ https://gerrit.wikimedia.org/r/c/operations/puppet/+/1032453 [12:04:14] ack jayme, +1'd [12:05:02] thanks [12:06:49] godog: interestingly I don't see any alerts firing. Is that because I only broke the targets on one of the codfw prometheus servers? [12:18:03] all good, re-enabling puppet on all prometheus [12:26:41] jayme: yeah I think that's why [12:26:58] i.e. the job on the other host was healthy [12:27:14] okay, cool! [12:28:13] actually alerts did fire [12:28:15] 12:03 -jinxer-wm:#wikimedia-operations- FIRING: [2x] JobUnavailable: Reduced availability for job etcd in ops@codfw [12:29:20] oh, oops