[06:22:48] <jinxer-wm>	 FIRING: [2x] MysqlReplicationLagPtHeartbeat: MySQL instance db1248:9104 has too large replication lag (10h 44m 9s) - https://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting#Depooling_a_replica - https://grafana.wikimedia.org/d/000000273/mysql?orgId=1&refresh=1m&var-job=All&var-server=db1248&var-port=9104 - https://alerts.wikimedia.org/?q=alertname%3DMysqlReplicationLagPtHeartbeat
[06:30:48] <jinxer-wm>	 FIRING: MysqlReplicationLag: MySQL instance db1248:9104@s4 has too large replication lag (10h 45m 24s). Its replication source is db1244.eqiad.wmnet. - https://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting#Depooling_a_replica - https://grafana.wikimedia.org/d/000000273/mysql?orgId=1&refresh=1m&var-job=All&var-server=db1248&var-port=9104 - https://alerts.wikimedia.org/?q=alertname%3DMysqlReplicationLag
[08:25:33] <Emperor>	 ^-- are these expected?
[08:27:05] <jynus>	 yeah, T273054
[08:27:06] <stashbot>	 T273054: Investigate using PMM (Percona Monitoring and Management) for slow-query analysis - https://phabricator.wikimedia.org/T273054
[08:27:27] <jynus>	 wrong ticket, T388837
[08:27:28] <stashbot>	 T388837: db1248 crash - https://phabricator.wikimedia.org/T388837
[10:22:48] <jinxer-wm>	 FIRING: [2x] MysqlReplicationLagPtHeartbeat: MySQL instance db1248:9104 has too large replication lag (1h 19m 0s) - https://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting#Depooling_a_replica - https://grafana.wikimedia.org/d/000000273/mysql?orgId=1&refresh=1m&var-job=All&var-server=db1248&var-port=9104 - https://alerts.wikimedia.org/?q=alertname%3DMysqlReplicationLagPtHeartbeat
[10:30:48] <jinxer-wm>	 FIRING: MysqlReplicationLag: MySQL instance db1248:9104@s4 has too large replication lag (57m 38s). Its replication source is db1244.eqiad.wmnet. - https://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting#Depooling_a_replica - https://grafana.wikimedia.org/d/000000273/mysql?orgId=1&refresh=1m&var-job=All&var-server=db1248&var-port=9104 - https://alerts.wikimedia.org/?q=alertname%3DMysqlReplicationLag
[10:50:48] <jinxer-wm>	 RESOLVED: MysqlReplicationLag: MySQL instance db1248:9104@s4 has too large replication lag (1m 3s). Its replication source is db1244.eqiad.wmnet. - https://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting#Depooling_a_replica - https://grafana.wikimedia.org/d/000000273/mysql?orgId=1&refresh=1m&var-job=All&var-server=db1248&var-port=9104 - https://alerts.wikimedia.org/?q=alertname%3DMysqlReplicationLag
[10:52:48] <jinxer-wm>	 RESOLVED: [2x] MysqlReplicationLagPtHeartbeat: MySQL instance db1248:9104 has too large replication lag (1m 39s) - https://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting#Depooling_a_replica - https://grafana.wikimedia.org/d/000000273/mysql?orgId=1&refresh=1m&var-job=All&var-server=db1248&var-port=9104 - https://alerts.wikimedia.org/?q=alertname%3DMysqlReplicationLagPtHeartbeat
[16:15:11] <hnowlan>	 o/ just checking in, is there anything you need from the serviceops end as regards the switchover? I saw the tickets as regards scheduling circular replication 
[16:40:05] <marostegui>	 hnowlan: I think we are good for now, thank you
[16:40:13] <hnowlan>	 great, thanks! <3
[16:40:18] <marostegui>	 :*