[11:08:57] 10SRE-tools, 10Infrastructure-Foundations, 10Spicerack, 10Patch-For-Review: IcingaHosts.wait_for_downtimed() does not honor dry_run - https://phabricator.wikimedia.org/T315537 (10SLyngshede-WMF) 05Open→03In progress Missing the two last bulletpoints: - check if there are other uses of @retry across... [12:48:45] 10SRE-tools, 10Infrastructure-Foundations, 10Release-Engineering-Team: Investigate sharing releng common python code to pywmflib - https://phabricator.wikimedia.org/T316757 (10Volans) @hashar thanks for the comprehensive summary of our IRC chat. I don't mind either direction, create a separate library for y... [13:29:54] is it an okayish time to reboot the netbox* and netboxdb* hosts now? [13:31:08] 10netbox, 10netops, 10Infrastructure-Foundations, 10SRE, 10Patch-For-Review: Represent sub-interface and bridge device assocations in Netbox - https://phabricator.wikimedia.org/T296832 (10Volans) >>! In T296832#8143427, @cmooney wrote: > For a bit of context the above patch will augment the existing vars... [13:32:34] moritzm: I'm not doing anything, if netops and dcops are ok with that go ahead. Also I don't see currently any related cookbook running [13:32:55] ^ XioNoX, topranks [13:33:29] moritzm: ok with me, Arzhel is off today also [13:33:51] ack, I gave a quick ping to DC ops, and otherwise I start in 5m [13:34:05] +1 [13:54:49] moritzm: what failed in the reboot of netbox1002? [13:55:05] need a had/ [13:55:12] *hand? [13:56:50] no, all fine. the usual "Netbox report account" alerts lead to the icinga state not being fully restored [13:56:59] everyone else is fine and I'm proceeding with the DBs currently [13:57:32] we should probably find a different way to notify about these errors (like sending a mail), these reports are almost continuously in a failed state [13:59:39] there is a tracking task... but yeah :( [14:04:23] all done (instances and DBs) and Netbox is all fine [14:05:55] and going for a puppetboard reboot in 5m [14:17:59] great, thanks! [15:15:35] 10SRE-tools, 10Infrastructure-Foundations, 10Spicerack: spicerack.dnsdisc.Discovery should not allow pooling active/passive services in both datacenters - https://phabricator.wikimedia.org/T315560 (10Volans) I had a chat with @JMeybohm on IRC and we went over some of the options/possibilities that we have he... [19:23:56] 10Mail, 10Infrastructure-Foundations, 10SRE, 10SRE-Access-Requests: DMarc Email Address for Wikimedia.org - https://phabricator.wikimedia.org/T316899 (10Reedy) [23:24:19] 10Mail, 10Infrastructure-Foundations, 10SRE, 10SRE-Access-Requests: DMarc Email Address for Wikimedia.org - https://phabricator.wikimedia.org/T316899 (10Reedy)