[06:52:49] <Amir1>	 marostegui: a tiny thing to review for auto_schema https://gerrit.wikimedia.org/r/c/operations/software/+/791297
[06:52:57] <Amir1>	 being able to run them on master of eqiad
[06:53:30] <marostegui>	 I will take a look
[06:53:39] <Amir1>	 Thanks
[08:06:00] <godog>	 jynus: re: backupmon, sure that's fine too. To clarify: I don't mind co-hosting stuff on alerting_host, especially if it is simple
[08:06:21] <godog>	 as opposed to the work/overhead more hosts/vms
[08:06:37] <jynus>	 yeah, the point is it is no longer going to be simple- so I think it fits better now on a "dedicated service"
[08:07:48] <jynus>	 see: https://gerrit.wikimedia.org/r/c/operations/puppet/+/791414 for a draft of what I want to do
[08:09:04] <godog>	 I see, yeah that's fair!
[08:09:49] <jynus>	 so this is not a snap reaction to your comment, it was planned for long :-)
[08:11:01] <jynus>	 any suggestion regarding redundancy- from a monitoring point of view. Is setting up a pasive backupmon2001 a good idea?
[08:11:32] <jynus>	 (the intention is to use ganeti for this, as it will be a small web with low traffic)
[08:12:13] <godog>	 yeah a codfw VMs sounds good to me, and you have the state replicated on the databases correct ?
[08:12:38] <jynus>	 yes, the state is purely on m1 misc database, it is generated on each backup
[08:13:01] <jynus>	 and m1 is on both dcs too
[09:24:42] <Amir1>	 marostegui: FYI, I'm deleting millions of rows in x1 (T308084)
[09:24:43] <stashbot>	 T308084: Reduce DB space used by Echo notifications - https://phabricator.wikimedia.org/T308084
[09:26:48] <marostegui>	 today?
[09:27:23] <Amir1>	 yeah
[09:27:29] <Amir1>	 not that many right now
[09:28:24] <marostegui>	 ok, just keep in mind it is Friday :)
[09:30:09] <moritzm>	 hi, quick question: I'm currently looking at the capex for Infrastructure Foundations hosts for next FY. cumin1001 is up for refresh and currently has a 1G NIC. Is there anything in cookbooks/spicerack related to database maintenance or backups which would benefit from it having 10G? (for shuffling data around with a cookbook or so)
[09:32:59] <jynus>	 moritzm: re- backups, nothing of data goes through cumin- it is only used for orchestration
[09:41:11] <moritzm>	 ack
[09:58:22] <Amir1>	 marostegui: don't worry, it's quite safe, just don't worry if you see a lot of writes or reads
[09:58:42] <marostegui>	 got it
[09:58:57] <akosiaris>	 famous last words
[09:59:04] <marostegui>	 haha
[09:59:25] <Amir1>	 :D
[09:59:26] <marostegui>	 Amir1 is on-call and I'm off on Monday so.....his problem!
[10:11:21] <jynus>	 I just added this: https://wikitech.wikimedia.org/wiki/MariaDB/Multiinstance#Cleaning_up_a_removed_section_from_a_multiinstance_host
[10:11:39] <jynus>	 it is not the right way to do it, but better reflected somewhere than nowhere