[02:22:02] PROBLEM - MariaDB sustained replica lag on m1 on db2160 is CRITICAL: 5.6 ge 2 https://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting%23Replication_lag https://grafana.wikimedia.org/d/000000273/mysql?orgId=1&var-server=db2160&var-port=13321 [02:23:38] RECOVERY - MariaDB sustained replica lag on m1 on db2160 is OK: (C)2 ge (W)1 ge 0 https://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting%23Replication_lag https://grafana.wikimedia.org/d/000000273/mysql?orgId=1&var-server=db2160&var-port=13321 [08:14:41] I want to change x1 to statement for a little while: https://gerrit.wikimedia.org/r/c/operations/puppet/+/874776/ [10:42:20] happy new year guys! [10:43:05] happy new year :) [10:58:51] HNY :) [11:13:28] PROBLEM - MariaDB sustained replica lag on m1 on db1117 is CRITICAL: 37.2 ge 2 https://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting%23Replication_lag https://grafana.wikimedia.org/d/000000273/mysql?orgId=1&var-server=db1117&var-port=13321 [11:14:54] PROBLEM - MariaDB sustained replica lag on m1 on db2160 is CRITICAL: 49.6 ge 2 https://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting%23Replication_lag https://grafana.wikimedia.org/d/000000273/mysql?orgId=1&var-server=db2160&var-port=13321 [11:15:02] RECOVERY - MariaDB sustained replica lag on m1 on db1117 is OK: (C)2 ge (W)1 ge 0 https://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting%23Replication_lag https://grafana.wikimedia.org/d/000000273/mysql?orgId=1&var-server=db1117&var-port=13321 [11:16:28] RECOVERY - MariaDB sustained replica lag on m1 on db2160 is OK: (C)2 ge (W)1 ge 0 https://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting%23Replication_lag https://grafana.wikimedia.org/d/000000273/mysql?orgId=1&var-server=db2160&var-port=13321 [12:00:36] marostegui: okay if I schedule two eqiad switchovers for next week (s5 and s6) [12:00:48] Amir1: Sure, I won't be available though .) [12:01:25] no worries, I have done this on my own a lot ^_^ [12:01:28] have fun