[01:08:05] PROBLEM - MariaDB sustained replica lag on m1 on db2160 is CRITICAL: 3.4 ge 2 https://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting%23Replication_lag https://grafana.wikimedia.org/d/000000273/mysql?orgId=1&var-server=db2160&var-port=13321 [01:09:33] RECOVERY - MariaDB sustained replica lag on m1 on db2160 is OK: (C)2 ge (W)1 ge 0 https://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting%23Replication_lag https://grafana.wikimedia.org/d/000000273/mysql?orgId=1&var-server=db2160&var-port=13321 [09:51:53] Amir1: did the schema change complete? am I good to reboot cumin1001? [09:52:10] yup, give me a sec to check screens but it should be done now [09:52:51] moritzm: yup, all done [09:53:01] thx, I'll go prod some people with live tmuxes/screens and then proceed when all cleared [09:53:43] thanks. Let me know once rebooted, wanna continue running the schema changes 😢 [09:54:29] sure thing, should be ready in 15-30 mins [10:07:17] Amir1: you can resume [10:07:28] wohoo [10:08:03] Berlin is now having constant rain and storm 😭 for weeks now [10:36:04] don't forget the thunderstorms!