[09:41:47] <marostegui>	 I am going to switchover es1 master (should be a NOOP) as they are RO hosts
[09:43:38] <kormat>	 what does "master" mean in this context? or, i guess, switchover?
[09:44:16] <marostegui>	 basically what dbctl sees as master
[09:44:24] <marostegui>	 as dbctl do not handle standalone hosts
[09:44:26] <kormat>	 aah ok. just lies then.
[09:44:40] <marostegui>	 I need to depool that host, but you cannot depool the master, so I need to switch it over
[09:44:52] <kormat>	 gotcha
[09:49:20] <marostegui>	 btw db2086 idrac has been flapping during the weekend, I have created: https://phabricator.wikimedia.org/T299882
[09:53:31] <kormat>	 marostegui: wmfmariadbpy 0.8.1 is now fully deployed. its db-switchover no longer cares (or knows) about tendril
[09:54:31] <marostegui>	 sweet
[09:54:33] <marostegui>	 thanks
[09:54:41] <marostegui>	 I will be using the script for thursday's switchover for m1
[09:57:32] <marostegui>	 kormat: do you want me to create a task for the dc switch cookbook update or you are ok using https://phabricator.wikimedia.org/T297605 for it?
[09:58:13] <kormat>	 oh damn, i'd forgotten about that part. i'll create a subtask for it, and sadly assign it to myself
[09:59:06] <marostegui>	 thanks
[10:14:47] <Amir1>	 marostegui: for when you have time https://phabricator.wikimedia.org/T298587#7637752, I really don't know what to do with those
[10:15:11] <marostegui>	 Amir1: I will check
[10:22:09] <Amir1>	 Thanks
[10:22:18] <Amir1>	 the actor migration for s3 is 90% done now
[10:28:10] <kormat>	 marostegui: switchdc cookbook change is in. it ended up being simple enough i didn't bother with a subtask.
[10:28:50] <marostegui>	 nice!
[17:40:16] <jinxer-wm>	 (PrometheusMysqldExporterFailed) firing: Prometheus-mysqld-exporter failed (an-test-coord1001:13306)  - https://grafana.wikimedia.org/d/000000278/mysql-aggregated - https://alerts.wikimedia.org
[17:49:59] <jynus>	 ^ btullis worrying, or expected? If a test host, I am guessing not important?
[17:50:52] <Emperor>	 Amir1: nice talk :)
[17:51:35] <btullis>	 Hmm. Interesting, but not too worrying at the moment, thanks. Will check it out now. We're actively working on this server, but I wouldn't expect the mysql prometheus exporter to have failed.
[17:51:53] <Amir1>	 Thanks ^^
[19:55:16] <jinxer-wm>	 (PrometheusMysqldExporterFailed) resolved: Prometheus-mysqld-exporter failed (an-test-coord1001:13306)  - https://grafana.wikimedia.org/d/000000278/mysql-aggregated - https://alerts.wikimedia.org
[21:16:14] <btullis>	 To follow up on this alert, one of m'colleagues mistakenly reduced the size of a logical volume without having first resized its file system. All fine now and luckily it was not very important data.