[07:19:31] <jynus>	 only m2 backup is ongoing and should finish soon
[07:19:58] <marostegui>	 excellent
[07:20:37] <marostegui>	 jynus: I want to do the switch back on thursday at the same time, does that work for you?
[07:21:37] <jynus>	 let me double check when snapshots finish
[07:22:49] <jynus>	 snapshots sometimes finish later, s3 finishes at 10:05 UTC
[07:23:08] <marostegui>	 no problem, we can do it maybe at 12 UTC
[07:24:01] <jynus>	 11:30 or 12 should be ok
[07:24:11] <marostegui>	 ok, I will plan for 12, thanks :)
[07:24:17] <jynus>	 sorry, I meant
[07:24:26] <jynus>	 10:30 or 11 UTC
[07:24:44] <marostegui>	 ok, 11 UTC it is! We can delay if needed on thursday :)
[07:25:22] <jynus>	 do you remember what service(s) usually requires reload for m1?
[07:25:32] <marostegui>	 sometimes etherpad
[07:25:34] <marostegui>	 but not always
[07:26:26] <jynus>	 I have a meeting at that time, I will reschedule it
[07:26:37] <marostegui>	 I can move the switchover if that's easier
[07:27:17] <jynus>	 let's try to do 10:30 if we can?
[07:27:23] <marostegui>	 sure
[07:28:25] <jynus>	 bacula is also fine
[07:28:49] <jynus>	 I will stop it out of precaution
[07:29:02] <marostegui>	 great
[07:43:26] <jynus>	 m2 dump is now starting to finish and writing the metadata to m1:dbbackups
[07:46:18] <marostegui>	 ok!
[07:59:35] <marostegui>	 ok, I am going to start, I will move to wikimedia-operations 
[07:59:38] <marostegui>	 jynus: ^
[07:59:58] <jynus>	 one sec manuel
[08:00:02] <marostegui>	 sure
[08:00:10] <jynus>	 codfw is finishing now
[08:00:15] <marostegui>	 np
[08:00:15] <jynus>	 but hasn't yet
[08:00:41] <jynus>	 should do it any time now
[08:00:56] <marostegui>	 no problem, just let me know
[08:04:28] <jynus>	 finished, marostegui
[08:04:34] <marostegui>	 \o/
[08:04:35] <jynus>	 all backups done
[08:04:40] <marostegui>	 Starting
[08:30:14] <jynus>	 BTW, moritz told me how to use TLS with dbbackups, so if I modify the config, https://gerrit.wikimedia.org/r/c/operations/puppet/+/973804 may not be needed soon
[08:30:36] <jynus>	 TLS with the wrong certs, I mean
[08:58:22] <marostegui>	 Can I get a check on these IPs: https://gerrit.wikimedia.org/r/c/operations/mediawiki-config/+/974106/? thanks
[09:03:11] <marostegui>	 thanks jaime <3
[09:03:55] <jynus>	 going now to programming focus mode, ping me if you need any help
[09:04:02] <marostegui>	 wilco thanks
[09:21:04] <marostegui>	 pc3 eqiad switched over and then switched back
[09:32:16] <marostegui>	 going for pc3 codfw
[14:33:53] <urandom>	 btullis: any objections to resuming the aqs cluster upgrades (bullseye)?
[14:40:33] <btullis>	 urandom: No objection from me. Fire away!
[14:40:54] <urandom>	 I'm going to try it without the fire, actually :)
[14:41:09] <urandom>	 ...for a change
[14:41:18] <btullis>	 Just a bit of magic smoke then :-)
[17:05:23] <jynus>	 thank you, Amir1 the debug thing is what certainly was having the larger impact- the volumen was just too big as it was now!
[17:06:22] <Amir1>	 Thanks. I hope it'd be easy to implement it, fingers crossed