[10:24:26] Amir1: cumin aliases may need clean up too (see root email) [12:32:48] PROBLEM - MariaDB sustained replica lag on s4 on db1121 is CRITICAL: 2 ge 2 https://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting%23Replication_lag https://grafana.wikimedia.org/d/000000273/mysql?orgId=1&var-server=db1121&var-port=9104 [12:33:52] RECOVERY - MariaDB sustained replica lag on s4 on db1121 is OK: (C)2 ge (W)1 ge 0 https://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting%23Replication_lag https://grafana.wikimedia.org/d/000000273/mysql?orgId=1&var-server=db1121&var-port=9104 [12:52:29] jynus: I will [12:53:12] marostegui: are you running schema change on s5? [12:53:25] https://orchestrator.wikimedia.org/web/cluster/alias/s5 [12:53:44] yes [12:53:54] it will take days [12:54:37] wow [13:06:15] afk for a bit [14:06:52] back, cleaning up tendril [14:06:54] wohooo [14:07:10] hehe we've merged so many patches in the last 24h XD [14:07:48] I also puppet-merged it in puppetmaster :P [14:25:32] marostegui: only MOTD changed [14:25:42] cool [14:26:10] the puppet board keeps looking fine after all the merges [14:27:57] yeah [17:02:50] ugh, swift-ring-builder will exit WARNING rather than ERROR if it can't actually write ring files :( [17:08:15] I think this is Monday's problem... [22:36:37] https://review.opendev.org/c/openstack/swift/+/826947 <-- the swift-recon -d fix got into 2.29 release (and we now have a second @wm.org email in contributors :)