[00:50:32] (MysqlReplicationLag) firing: MySQL instance db2100:13318 has too large replication lag (1h 24m 30s) - https://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting#Depooling_a_replica - https://grafana.wikimedia.org/d/000000273/mysql?orgId=1&refresh=1m&var-job=All&var-server=db2100&var-port=13318 - https://alerts.wikimedia.org/?q=alertname%3DMysqlReplicationLag [00:55:32] (MysqlReplicationLag) resolved: MySQL instance db2100:13318 has too large replication lag (33m 12s) - https://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting#Depooling_a_replica - https://grafana.wikimedia.org/d/000000273/mysql?orgId=1&refresh=1m&var-job=All&var-server=db2100&var-port=13318 - https://alerts.wikimedia.org/?q=alertname%3DMysqlReplicationLag [03:56:32] (MysqlReplicationLag) firing: MySQL instance db1145:13313 has too large replication lag (19m 49s) - https://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting#Depooling_a_replica - https://grafana.wikimedia.org/d/000000273/mysql?orgId=1&refresh=1m&var-job=All&var-server=db1145&var-port=13313 - https://alerts.wikimedia.org/?q=alertname%3DMysqlReplicationLag [04:01:32] (MysqlReplicationLag) resolved: (2) MySQL instance db1145:13313 has too large replication lag (19m 49s) - https://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting#Depooling_a_replica - https://alerts.wikimedia.org/?q=alertname%3DMysqlReplicationLag [07:25:37] I'm assuming we're not having a team meeting this afternoon since you're all doing stuff in Prague :) [07:35:52] Emperor: it's also a bank holiday for the uk [07:43:17] * Emperor is working today, will take it another day [22:08:32] (MysqlReplicationLag) firing: MySQL instance db2100:13317 has too large replication lag (2d 16h 6m 32s) - https://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting#Depooling_a_replica - https://grafana.wikimedia.org/d/000000273/mysql?orgId=1&refresh=1m&var-job=All&var-server=db2100&var-port=13317 - https://alerts.wikimedia.org/?q=alertname%3DMysqlReplicationLag [22:09:14] that's me, although I am not sure this alert is too useful with so much spam...