[05:34:45] will start T368401 in about 25min [05:34:46] T368401: Switchover es6 master (es1037 -> es1038) - https://phabricator.wikimedia.org/T368401 [05:40:04] cool [05:59:36] starting at the top of the hour [06:00:46] Ok [07:10:08] the es5 backup on eqiad failed :-( [07:13:59] :-( was there any specific reason? [07:18:56] 2024-06-26 17:07:31 [ERROR] - Could not read data from enwiki.blobs_cluster27: Lost connection to MySQL server during query [07:19:14] same issue as T367882 [07:19:15] T367882: Possible weird interaction between es backups and puppet runs leading to failures - https://phabricator.wikimedia.org/T367882 [07:20:24] ack, thanks [07:20:59] however, this time it didn't match a puppet run [07:44:33] repooling es1022 [07:46:15] I will repool es1025 too and we retry on monday, what do you think, arnaudb? [07:49:13] lgtm jynus! its going to be too short for today anyway [08:13:54] both repooled, I will now archive the backups that were successful and will depool and retry es1025 on monday [08:16:15] thanks jynus