[10:38:52] Could I get a +1 on two CRs for a swift account removal, please? https://gerrit.wikimedia.org/r/c/operations/puppet/+/935710 and https://gerrit.wikimedia.org/r/c/labs/private/+/935709 [10:39:05] Then I can do the actually-private change and roll-restart the swift proxies [10:43:55] Thanks :) [10:44:03] check beta how it is [10:44:13] it may need some manual work? [10:44:24] (maybe you already did) [10:45:13] I think beta has different accounts [10:47:35] just a friendly warning I didn't check those [10:57:59] yeah, beta doesn't have that swift account at all [11:09:12] alerts are because puppet doesn't know how to clean up stats_account service and timer for deleted accounts; I'll try and tidy up [15:19:42] backups are every day more and more reliable with every small improvement, but they take each time more time :-( [15:21:22] So we should delete a bunch of stuff so you have less to back up? :) [15:21:38] or, hear me out, we backup to /dev/null [15:22:30] jokes aside, I was sending Amir some info about how each dataset should be breakable into 256GB pieces or less [15:22:47] but right now we have 2TB monoliths [15:23:10] (the 256GB comes from being able to recover in less than 30 minutes at 1Gbps) [15:27:14] parallelization is love, parallelization is life