[00:13:32] <jinxer-wm>	 (MysqlReplicationLag) resolved: MySQL instance db2100:13317 has too large replication lag (18m 50s) - https://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting#Depooling_a_replica - https://grafana.wikimedia.org/d/000000273/mysql?orgId=1&refresh=1m&var-job=All&var-server=db2100&var-port=13317 - https://alerts.wikimedia.org/?q=alertname%3DMysqlReplicationLag
[01:21:32] <jinxer-wm>	 (MysqlReplicationLag) firing: MySQL instance db2139:13313 has too large replication lag (6m 10s) - https://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting#Depooling_a_replica - https://grafana.wikimedia.org/d/000000273/mysql?orgId=1&refresh=1m&var-job=All&var-server=db2139&var-port=13313 - https://alerts.wikimedia.org/?q=alertname%3DMysqlReplicationLag
[02:26:32] <jinxer-wm>	 (MysqlReplicationLag) firing: (2) MySQL instance db1145:13313 has too large replication lag (6m 45s) - https://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting#Depooling_a_replica  - https://alerts.wikimedia.org/?q=alertname%3DMysqlReplicationLag
[03:46:32] <jinxer-wm>	 (MysqlReplicationLag) firing: (2) MySQL instance db1145:13313 has too large replication lag (1h 26m 45s) - https://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting#Depooling_a_replica  - https://alerts.wikimedia.org/?q=alertname%3DMysqlReplicationLag
[03:56:32] <jinxer-wm>	 (MysqlReplicationLag) resolved: (2) MySQL instance db1145:13313 has too large replication lag (15m 51s) - https://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting#Depooling_a_replica  - https://alerts.wikimedia.org/?q=alertname%3DMysqlReplicationLag
[12:47:03] <Emperor>	 if someone could send me the right google meet link for the data-persistence breakout, that'd be good :)
[13:43:18] <urbanecm>	 Hello, what is up with db1189  please? Lately, I've been seeing a lot of "Connection refused" errors. AFAICS, db1189  is pooled, but MariaDB is unreachable there. 
[13:46:33] <urbanecm>	 Amir1: marostegui: ^^
[13:48:08] <Amir1>	 urbanecm: we are in a meeting. How urgent it is? 
[13:50:11] <Amir1>	 urbanecm: depooled
[13:55:01] <marostegui>	 memory issues again
[13:55:15] <jynus>	 :-(
[13:55:15] <Amir1>	 😭😭😭😭😭
[13:55:21] <urbanecm>	 Thanks for depooling. 
[14:46:21] <jynus>	 btullis: I think this is to be expected, but FYI "Last dump for matomo at eqiad (db1108) taken on 2022-09-20 02:57:27 is 551 MiB, but the previous one was 231 MiB, a change of +138.8 %"
[21:03:32] <jinxer-wm>	 (MysqlReplicationLag) firing: MySQL instance db1139:13311 has too large replication lag (1h 25m 43s) - https://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting#Depooling_a_replica - https://grafana.wikimedia.org/d/000000273/mysql?orgId=1&refresh=1m&var-job=All&var-server=db1139&var-port=13311 - https://alerts.wikimedia.org/?q=alertname%3DMysqlReplicationLag
[21:08:32] <jinxer-wm>	 (MysqlReplicationLag) firing: (2) MySQL instance db1139:13311 has too large replication lag (5m 51s) - https://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting#Depooling_a_replica  - https://alerts.wikimedia.org/?q=alertname%3DMysqlReplicationLag
[21:13:32] <jinxer-wm>	 (MysqlReplicationLag) resolved: (2) MySQL instance db1139:13311 has too large replication lag (20m 51s) - https://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting#Depooling_a_replica  - https://alerts.wikimedia.org/?q=alertname%3DMysqlReplicationLag
[21:24:02] <jinxer-wm>	 (MysqlReplicationLag) firing: (4) MySQL instance db1139:13311 has too large replication lag (5m 51s) - https://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting#Depooling_a_replica  - https://alerts.wikimedia.org/?q=alertname%3DMysqlReplicationLag
[21:29:02] <jinxer-wm>	 (MysqlReplicationLag) resolved: (3) MySQL instance db1150:13314 has too large replication lag (14m 24s) - https://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting#Depooling_a_replica  - https://alerts.wikimedia.org/?q=alertname%3DMysqlReplicationLag
[21:48:32] <jinxer-wm>	 (MysqlReplicationLag) firing: MySQL instance db1171:13318 has too large replication lag (2h 7m 23s) - https://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting#Depooling_a_replica - https://grafana.wikimedia.org/d/000000273/mysql?orgId=1&refresh=1m&var-job=All&var-server=db1171&var-port=13318 - https://alerts.wikimedia.org/?q=alertname%3DMysqlReplicationLag
[21:53:32] <jinxer-wm>	 (MysqlReplicationLag) firing: (2) MySQL instance db1171:13318 has too large replication lag (18m 18s) - https://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting#Depooling_a_replica  - https://alerts.wikimedia.org/?q=alertname%3DMysqlReplicationLag
[21:58:32] <jinxer-wm>	 (MysqlReplicationLag) resolved: (2) MySQL instance db1171:13318 has too large replication lag (31m 40s) - https://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting#Depooling_a_replica  - https://alerts.wikimedia.org/?q=alertname%3DMysqlReplicationLag