[01:08:18] PROBLEM - MariaDB sustained replica lag on m1 on db1217 is CRITICAL: 7.6 ge 2 https://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting%23Replication_lag https://grafana.wikimedia.org/d/000000273/mysql?orgId=1&var-server=db1217&var-port=13321 [01:09:46] RECOVERY - MariaDB sustained replica lag on m1 on db1217 is OK: (C)2 ge (W)1 ge 0 https://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting%23Replication_lag https://grafana.wikimedia.org/d/000000273/mysql?orgId=1&var-server=db1217&var-port=13321 [09:34:53] How does one move a ticket to be a "this is a MW bug" ticket? T348586 is a failure of MW to write an object to both swift clusters (it only PUT to codfw) [09:34:53] T348586: File not found: /v1/AUTH_mw/wikipedia-commons-local-public.7e/7/7e/EC02-0162-69_l_%2824374651802%29.jpg - https://phabricator.wikimedia.org/T348586 [10:12:54] I mean, Monday's rclone job will tidy that up, but it might be worth checking further up as to why only one write attempt was made rather than 2... [15:11:10] Emperor: Tag it "mediawiki-file-management" probably [15:16:22] I'll give that a go, thanks