[15:35:31] godog: I'm guessing in this order 1. https://gerrit.wikimedia.org/r/c/operations/alerts/+/720063 2. https://gerrit.wikimedia.org/r/c/operations/alerts/+/720063 then 3. https://gerrit.wikimedia.org/r/c/operations/puppet/+/720093 sound reasonable? [15:35:51] sorry, 2 = https://gerrit.wikimedia.org/r/c/operations/alerts/+/720079 [15:36:03] cwhite: yeah totally, +1 [15:36:31] ok, rolling [15:41:17] godog: do I need to wait for jenkins to submit or is that something I am supposed to do? [15:43:16] cwhite: you'll have to submit yourself [15:44:27] ok, done. is there a command I need to run to deploy it? [15:46:03] mmh yes and no, running puppet agent will deploy [15:46:31] * cwhite runs puppet [15:56:20] godog: ok, anything else to check before moving on? [15:56:46] cwhite: no after puppet has ran alerts are live [15:57:06] has ran on alert hosts, that is [15:58:04] ah, so first puppet should run on prometheus hosts, then alert hosts? [15:58:36] sorry, that was confusing! on prometheus hosts [15:58:46] or thanos-fe hosts for global alerts [15:59:00] ok [15:59:36] revert is the same procedure in case it is needed [16:01:55] I assume the check it won't show up in Karma until it's triggered? [16:02:59] that's correct yeah, you can check (ha ha) though from prometheus' web interface, on the 'alerts' tab [16:03:47] I want to get unblocked on reverse-proxying the prometheus web interface too, in addition to thanos, FWIW [16:04:46] sweet, I see it! [16:05:01] proceeding with the removal of old icinga checks [16:07:23] +1 [16:09:56] godog: That went smoothly. Thanks for the help! [16:10:28] I'm glad and you're welcome cwhite