[21:01:32] (MysqlReplicationLag) firing: MySQL instance db1139:13311 has too large replication lag (1h 49m 34s) - https://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting#Depooling_a_replica - https://grafana.wikimedia.org/d/000000273/mysql?orgId=1&refresh=1m&var-job=All&var-server=db1139&var-port=13311 - https://alerts.wikimedia.org/?q=alertname%3DMysqlReplicationLag [21:06:32] (MysqlReplicationLag) firing: (2) MySQL instance db1139:13311 has too large replication lag (46m 44s) - https://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting#Depooling_a_replica - https://alerts.wikimedia.org/?q=alertname%3DMysqlReplicationLag [21:11:32] (MysqlReplicationLag) firing: (2) MySQL instance db1139:13311 has too large replication lag (18m 38s) - https://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting#Depooling_a_replica - https://alerts.wikimedia.org/?q=alertname%3DMysqlReplicationLag [21:16:32] (MysqlReplicationLag) resolved: (2) MySQL instance db1139:13311 has too large replication lag (6m 24s) - https://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting#Depooling_a_replica - https://alerts.wikimedia.org/?q=alertname%3DMysqlReplicationLag [21:23:02] (MysqlReplicationLag) firing: (3) MySQL instance db1139:13311 has too large replication lag (6m 24s) - https://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting#Depooling_a_replica - https://alerts.wikimedia.org/?q=alertname%3DMysqlReplicationLag [21:28:02] (MysqlReplicationLag) resolved: (2) MySQL instance db2139:13314 has too large replication lag (10m 27s) - https://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting#Depooling_a_replica - https://alerts.wikimedia.org/?q=alertname%3DMysqlReplicationLag [21:29:17] (MysqlReplicationLag) firing: (2) MySQL instance db1150:13314 has too large replication lag (1h 58m 3s) - https://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting#Depooling_a_replica - https://alerts.wikimedia.org/?q=alertname%3DMysqlReplicationLag [21:39:02] (MysqlReplicationLag) resolved: (2) MySQL instance db1150:13314 has too large replication lag (16m 33s) - https://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting#Depooling_a_replica - https://alerts.wikimedia.org/?q=alertname%3DMysqlReplicationLag [21:45:17] (MysqlReplicationLag) firing: (2) MySQL instance db1150:13314 has too large replication lag (26m 46s) - https://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting#Depooling_a_replica - https://alerts.wikimedia.org/?q=alertname%3DMysqlReplicationLag [21:49:02] (MysqlReplicationLag) resolved: (2) MySQL instance db1150:13314 has too large replication lag (16m 33s) - https://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting#Depooling_a_replica - https://alerts.wikimedia.org/?q=alertname%3DMysqlReplicationLag