[01:08:59] <icinga-wm>	 PROBLEM - MariaDB sustained replica lag on m1 on db1217 is CRITICAL: 13.4 ge 2 https://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting%23Replication_lag https://grafana.wikimedia.org/d/000000273/mysql?orgId=1&var-server=db1217&var-port=13321
[01:09:07] <icinga-wm>	 PROBLEM - MariaDB sustained replica lag on m1 on db2132 is CRITICAL: 7.2 ge 2 https://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting%23Replication_lag https://grafana.wikimedia.org/d/000000273/mysql?orgId=1&var-server=db2132&var-port=9104
[01:10:23] <icinga-wm>	 RECOVERY - MariaDB sustained replica lag on m1 on db1217 is OK: (C)2 ge (W)1 ge 0 https://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting%23Replication_lag https://grafana.wikimedia.org/d/000000273/mysql?orgId=1&var-server=db1217&var-port=13321
[01:10:31] <icinga-wm>	 RECOVERY - MariaDB sustained replica lag on m1 on db2132 is OK: (C)2 ge (W)1 ge 0 https://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting%23Replication_lag https://grafana.wikimedia.org/d/000000273/mysql?orgId=1&var-server=db2132&var-port=9104
[10:04:23] <jynus>	 The monitoring for ES will be impacted for a bit (it says it grew +228.0 %) as it is the second time it is has been running
[11:13:56] <jynus>	 Spirit, ghost replacement for lockless schema changes: https://code.cash.app/introducing-spirit
[13:32:15] <jbond>	 marostegui: when yuo have some spare time can you take a look at the patch set starting https://gerrit.wikimedia.org/r/c/operations/puppet/+/961829.  
[13:32:28] <marostegui>	 i will yes
[13:32:29] <jbond>	 all the poatches do the same thing update the ssl-ca parameter n my.cnf
[13:32:48] <jbond>	 i tried to break them down into some logic sets but let me know if some other break down makes more senses
[13:32:50] <marostegui>	 jbond: For the wikireplicas want you might want to talk to either wmcs or data engineering
[13:32:51] <jbond>	 thanks
[13:32:53] <marostegui>	 I can review the other one
[13:33:19] <jbond>	 marostegui: first of i think we just need to knoiw that this is a good , safe and logic mariadb CR
[13:33:40] <marostegui>	 Ok, I will try to check probably next week
[13:33:41] <jbond>	 i'll loop in the specific teams once i have a genral ok
[13:33:45] <jbond>	 ack thanks