[01:08:53] PROBLEM - MariaDB sustained replica lag on m1 on db1217 is CRITICAL: 4.6 ge 2 https://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting%23Replication_lag https://grafana.wikimedia.org/d/000000273/mysql?orgId=1&var-server=db1217&var-port=13321 [01:10:19] RECOVERY - MariaDB sustained replica lag on m1 on db1217 is OK: (C)2 ge (W)1 ge 0 https://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting%23Replication_lag https://grafana.wikimedia.org/d/000000273/mysql?orgId=1&var-server=db1217&var-port=13321 [09:17:29] I am going to truncate a table in m1 for https://phabricator.wikimedia.org/T349362, there will be lag, but not a problem, and I will silence it anyways [10:28:18] the ES refactor, by impact is also making me so much agile, as other things are also much faster (bacula, etc)! 🫶 [12:14:40] arnaudb: I am going to cleanup the recovery file leftovers from dbprov1001 if that's ok for you [12:14:55] oh yeah sure! thanks! [14:00:51] marostegui: sent this after our convo https://gerrit.wikimedia.org/r/c/operations/puppet/+/969122 [14:01:21] i will check [14:01:58] ah pretty straightforward to review! [14:01:58] +1ed, thanks! [14:20:41] I hope that will help reducing alert spamming