[04:48:44] This is kind of interesting, [[File:OBR_Hannvoer_2024.webm]] has a different SHA-1, last modify date, and file size then what MW thinks the file should be. I think when the user tried to upload a new version, it failed part way through, and MW had a rollback but swift did not [04:52:10] whole bunch of failed sync check in the log for that file [05:02:33] And its actual length seems different then what a HEAD request says for content-length [07:10:28] weird [07:59:11] worrisome [08:01:46] presumably it will cause an error for media backups? https://phabricator.wikimedia.org/T262668 [08:49:02] There's further context about the image on my commons talk page. But yeah definitely weird how this didn't exactly fail safe [08:49:54] Or fail atomicly i guess i should say. The failure mode does seem safe [08:50:50] I added more debugging to chunked upload which should go live on wed... maybe that will reveal what is going on with this person's attempted large uploads [09:15:03] bawolff: broken images in swift? never! [09:15:37] lol [09:16:50] bawolff: T153565 is the generic task [09:16:51] T153565: MediaWiki file operations are fragile, causing occasional data loss - https://phabricator.wikimedia.org/T153565 [09:17:28] FileBackend had some (untested) journaling functionality for a while, but it never got enabled on Wikimedia wikis and was eventually removed, IIRC