[07:41:30] Emperor: o/ [07:41:32] https://phabricator.wikimedia.org/T384003#10724716 - lol [07:42:36] that was without any controller restart [07:45:21] elukey: that was "stop initialization" and then "set jbod"? Huh. [07:45:36] yep.. [07:46:31] nice of Supermicro to suggest we try that. Oh, wait... [07:46:50] elukey: next step of putting an 8T drive back in seems sensible at this point :) [07:47:38] Emperor: Supermicro told me that they already sent the passthrough controller to test, but they sent it to eqiad :D [07:48:04] so I'll ask to John and Valerie if they can set it up on the ms-be eqiad test node [07:48:13] and we'll retest in there [07:48:13] 🤦 [07:48:17] yeah [07:48:26] thanks! [10:52:17] msX is running 10.11 everywhere [10:59:10] I've deleted a lot of really old binlogs (10-20TB at least). Details are in https://phabricator.wikimedia.org/T391344#10725420 it really shouldn't break anything but if you see anything, please let me know [11:00:03] there is still around 30TB too old binlog left (> 1 year), will get there eventually