[00:38:50] <wikibugs>	 10Mail, 10Infrastructure-Foundations, 10Znuny, 10vrts: Not receiving VRT notification emails - https://phabricator.wikimedia.org/T302139 (10GeneralNotability)
[11:28:18] <volans>	 updating it here for XioNoX, topranks for later
[11:28:41] <volans>	 as requested I've downtimed all drmrs-related stuff on icinga until Monday ~11UTC
[11:29:28] <volans>	 AFAICT cr2-drmrs is unreachable (I've tried both the wikimedia.org and mgmt records)
[11:31:04] <volans>	 and cr1 sais et-0/0/0, Enabled, Physical link is Down
[11:31:17] <volans>	 so I'm wondering if it died instead of being a link issue
[11:32:15] <XioNoX>	 volans: thanks a lot, I'll have a look later today, on my phone right now
[11:32:24] <XioNoX>	 nothing is live there so no worries
[11:32:29] <volans>	 ack, thx!
[12:41:13] <XioNoX>	 console is dead, so looks like the device is offline or badly crashed
[12:41:47] <volans>	 will need remote hands at this point I guess
[12:41:54] <XioNoX>	 cr2 only have 1 power cord, so maybe it went bad too
[12:41:58] <XioNoX>	 volans: yeah exactly
[12:43:10] <volans>	 ah... and why is that?
[12:43:15] <volans>	 seems an unwise choice :)
[12:44:02] <topranks>	 I'm assuming it was an oversight, we didn't choose to run on one supply
[12:44:15] <topranks>	 i.e. remote hands had forgot one side
[12:45:57] <topranks>	 thanks for taking care of Icinga :)
[12:48:44] <XioNoX>	 there was no long enough cable...
[12:49:07] <XioNoX>	 but yeah it's on the todo for remote hands to fix
[12:49:27] <volans>	 k
[13:52:38] <lmata>	 Thanks for working on this
[18:00:22] <wikibugs>	 10Mail, 10Infrastructure-Foundations, 10Znuny, 10vrts: Not receiving VRT notification emails - https://phabricator.wikimedia.org/T302139 (10Risker) Confirming that this has been identified by myself and several other users of oversight-en and checkuser-en queues (at minimum).  Concur with the timeline iden...