[11:29:46] rolling out a new prometheus alert for redis in a few minutes - it just mimics the existing behaviour we have in nrpe checks so nothing new, shouldn't make noise but if it does that's me (cc claime, arnoldokoth) [11:30:22] hnowlan: Ack. Ty. [11:43:26] codfw rack A6 switch maintainance is starting in ~15min - https://phabricator.wikimedia.org/T429812 [11:54:09] Did we start early? I was still in my deploy window and was like what's happening haha. I assume that's it. [11:54:30] or is something unrelated happening. [11:59:55] Mvolz: ? [12:01:06] XioNoX: chat in #operations but citoid is failing and I was looking into the other channels to see if anything could have caused it [12:01:44] ah ok, unrelated to my maintenance afaik [12:04:08] Yes I believe so [12:04:12] sorry for the false alarm [12:06:07] no pb! better false than true :) [12:18:09] all hosts depooled, rebooting the switch [12:30:37] switch back up [12:30:55] waiting for the interfaces [12:32:32] hosts back up [12:33:51] repooling the hosts [18:20:09] FYI, I'll be applying some latent admin_ng changes to wikikube clusters shortly. they're all purely additive (and thus safe). [18:20:53] Raine: ah, it looks like you are doing so? :) [18:27:07] * swfrench-wmf is hands off until we can coordinate [18:37:15] swfrench-wmf: I cancelled when you said you'd do it [18:37:25] sorry [18:38:09] ah, got it. alright, I'll proceed shortly, then! [18:42:19] thank you