[06:03:27] <arnaudb>	 i'll start ES7 switchover T368020
[06:03:28] <stashbot>	 T368020: Switchover es7 master (es1035 -> es1039) - https://phabricator.wikimedia.org/T368020
[07:17:23] <moritzm>	 ok to reboot dborch1001 now? 
[07:20:38] <marostegui>	 fine by me
[07:20:55] <arnaudb>	 ok for me as well
[07:32:40] <moritzm>	 ok, rebooting now
[07:36:18] <moritzm>	 it's back
[07:36:53] <arnaudb>	 orchestrator seems to be running properly
[07:38:27] <marostegui>	 \o/
[08:16:31] <jynus>	 can I depool es2022, es2025 (or either) for T363812 ?
[08:16:32] <stashbot>	 T363812: Setup backups for es6, es7 and archive old read only backups - https://phabricator.wikimedia.org/T363812
[08:19:31] <arnaudb>	 no issue for me
[08:19:50] <marostegui>	 no problem from my side
[08:50:25] <jynus>	 dumps are running on codfw now
[08:50:47] <marostegui>	 jynus: I lost track of the possible puppet issue + backups
[08:50:50] <marostegui>	 what is the status of that=
[08:50:52] <marostegui>	 ?
[08:51:17] <jynus>	 we'll see with this. No errors since, but they didn't always happen
[08:51:56] <jynus>	 T367882
[08:51:57] <stashbot>	 T367882: Possible weird interaction between es backups and puppet runs leading to failures - https://phabricator.wikimedia.org/T367882
[08:52:17] <jynus>	 let's see if they run, and how long and then please let's try to schedule eqiad ones
[08:52:26] <marostegui>	 sure :)
[08:52:27] <marostegui>	 thanks
[08:52:33] <marostegui>	 I forgot I was subscribed to that task :)
[09:32:54] <marostegui>	 jynus: when would it be a good moment to stop db1217:m2
[09:34:45] <jynus>	 m2 backup just finished
[09:34:57] <jynus>	 so any time in the next 6 days
[09:35:04] <marostegui>	 ah great!
[10:56:16] <jynus>	 o/
[11:00:08] <jynus>	 marostegui: re: T365995 I am not too worried- in some cases I may even prefer if errors happen for a while, as specially the db metadata ones will be self-healing
[11:00:08] <stashbot>	 T365995: Upgrade EVPN switches Eqiad row E-F to JunOS 22.2 - lsw1-e3-eqiad - https://phabricator.wikimedia.org/T365995
[11:03:43] <marostegui>	 Sure, but it would still be good to get some notes just in case
[14:07:34] <jynus>	 x1 dumps: warning: -11.4 % 	The previous backup had a size of 62.7 GB, a change larger than 5.0%. 
[14:11:17] <Emperor>	 https://phabricator.wikimedia.org/P65412 <-- it lives!
[14:55:24] <Amir1>	 jynus: that'd be me: https://sal.toolforge.org/log/AGI8NZABGiVuUzOdSXkx
[14:56:38] <jynus>	 nice!
[15:33:04] <jynus>	 we are more than halfway the codfw es dumps