[01:07:32] PROBLEM - MariaDB sustained replica lag on m1 on db1117 is CRITICAL: 28.4 ge 2 https://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting%23Replication_lag https://grafana.wikimedia.org/d/000000273/mysql?orgId=1&var-server=db1117&var-port=13321 [01:12:04] RECOVERY - MariaDB sustained replica lag on m1 on db1117 is OK: (C)2 ge (W)1 ge 0 https://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting%23Replication_lag https://grafana.wikimedia.org/d/000000273/mysql?orgId=1&var-server=db1117&var-port=13321 [02:21:09] Amir1: do you ever sleep? [05:30:50] urandom: db maintenance is scripted now [09:14:14] urandom: haha. Sometimes 😅😅 [09:25:53] [citation needed] [09:34:17] :D [10:08:26] jynus: I am actually thinking that I can already change hieradata/role/common/prometheus.yaml to point to the new zarcillo host, as the prometheus exporter won't be making any writes, right? [10:08:59] yeah, assuming grants are there and replication works, it should just work [10:09:07] yeah, they are all the same [10:09:14] I am going to change it now and see what happens [10:10:55] https://gerrit.wikimedia.org/r/c/operations/puppet/+/909972/ [10:28:12] gerrit down for me right now [10:28:38] working for me [10:28:44] yeah, back [10:28:52] something weird happened with my browser [10:30:08] or gerrit itself, but got a weird redirection [10:40:43] so far so good with the change