[01:09:26] <icinga-wm>	 PROBLEM - MariaDB sustained replica lag on m1 on db2160 is CRITICAL: 18.4 ge 2 https://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting%23Replication_lag https://grafana.wikimedia.org/d/000000273/mysql?orgId=1&var-server=db2160&var-port=13321
[01:09:46] <icinga-wm>	 PROBLEM - MariaDB sustained replica lag on m1 on db1117 is CRITICAL: 23.2 ge 2 https://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting%23Replication_lag https://grafana.wikimedia.org/d/000000273/mysql?orgId=1&var-server=db1117&var-port=13321
[01:11:36] <icinga-wm>	 RECOVERY - MariaDB sustained replica lag on m1 on db1117 is OK: (C)2 ge (W)1 ge 0 https://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting%23Replication_lag https://grafana.wikimedia.org/d/000000273/mysql?orgId=1&var-server=db1117&var-port=13321
[01:13:02] <icinga-wm>	 RECOVERY - MariaDB sustained replica lag on m1 on db2160 is OK: (C)2 ge (W)1 ge 0 https://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting%23Replication_lag https://grafana.wikimedia.org/d/000000273/mysql?orgId=1&var-server=db2160&var-port=13321
[10:31:11] <jynus>	 Amir1: I am ready for m1, I stopped already bacula 
[10:34:33] <Emperor>	 [aside: am I the only one who keeps thinking of vampires when someone says bacula?]
[10:35:22] <Amir1>	 jynus: thanks
[10:35:27] <Amir1>	 Emperor: same :D
[10:35:35] <Amir1>	 I'm waking up slowly
[10:35:54] <jynus>	 Emperor: https://web.archive.org/web/20040701011419/http://www.bacula.org/
[10:36:13] <Emperor>	 lol
[10:49:20] <icinga-wm>	 PROBLEM - pt-heartbeat-wikimedia service on db1101 is CRITICAL: CRITICAL - Expecting active but unit pt-heartbeat-wikimedia is inactive https://wikitech.wikimedia.org/wiki/MariaDB/pt-heartbeat
[10:50:52] <icinga-wm>	 RECOVERY - pt-heartbeat-wikimedia service on db1101 is OK: OK - pt-heartbeat-wikimedia is inactive https://wikitech.wikimedia.org/wiki/MariaDB/pt-heartbeat
[11:06:52] <jynus>	 bacula looking good: https://grafana.wikimedia.org/goto/1it_tqfVk?orgId=1
[11:07:55] <jynus>	 waiting for x1 eqiad snapshot to finish and we can close the ticket
[11:25:20] <Amir1>	 awesome
[11:25:21] <Amir1>	 thanks
[13:20:27] <jynus>	 db backups confirmed good, will let you close T333123 when you want
[13:20:27] <stashbot>	 T333123: Switchover m1 master (db1101 -> db1164) - https://phabricator.wikimedia.org/T333123
[13:42:31] <Amir1>	 Thanks