[01:09:49] <icinga-wm>	 PROBLEM - MariaDB sustained replica lag on m1 on db2160 is CRITICAL: 22.4 ge 2 https://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting%23Replication_lag https://grafana.wikimedia.org/d/000000273/mysql?orgId=1&var-server=db2160&var-port=13321
[01:11:39] <icinga-wm>	 RECOVERY - MariaDB sustained replica lag on m1 on db2160 is OK: (C)2 ge (W)1 ge 0 https://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting%23Replication_lag https://grafana.wikimedia.org/d/000000273/mysql?orgId=1&var-server=db2160&var-port=13321
[17:29:33] <Emperor>	 ms-be2040 is unhappy - disk failed, and swift seems a bit counfused. I've commented out the relevant entry in fstab and reloaded systemd
[17:31:05] <Emperor>	 2 disks failed, even. Le sigh
[17:42:54] <Emperor>	 right, that's stopped the 5-minutely cron mails, I'll file the disk swap tickets on Monday
[17:50:56] <kwakuofori>	 hmm. please mark as urgent. Willy asked that we do that so it's treated with priority