[06:15:04] <icinga-wm>	 PROBLEM - MariaDB sustained replica lag on s4 on db1238 is CRITICAL: 2.4 ge 2 https://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting%23Replication_lag https://grafana.wikimedia.org/d/000000273/mysql?orgId=1&var-server=db1238&var-port=9104
[06:21:04] <icinga-wm>	 RECOVERY - MariaDB sustained replica lag on s4 on db1238 is OK: (C)2 ge (W)1 ge 0.4 https://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting%23Replication_lag https://grafana.wikimedia.org/d/000000273/mysql?orgId=1&var-server=db1238&var-port=9104
[07:51:59] <jinxer-wm>	 (SystemdUnitFailed) firing: export_smart_data_dump.service on dbprov1003:9100 - https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state - https://grafana.wikimedia.org/d/g-AaZRFWk/systemd-status - https://alerts.wikimedia.org/?q=alertname%3DSystemdUnitFailed
[08:46:59] <jinxer-wm>	 (SystemdUnitFailed) resolved: export_smart_data_dump.service on dbprov1003:9100 - https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state - https://grafana.wikimedia.org/d/g-AaZRFWk/systemd-status - https://alerts.wikimedia.org/?q=alertname%3DSystemdUnitFailed
[09:40:43] <jynus>	 I will update some db lines in netboot.cfg, may ask for a review to make sure the db parts are as intended (even if I don't plan to reimage any dbs)
[10:29:00] <jynus>	 interesting, es4 grew +4.9 % but es5 did +5.1 %. Where they depooled in the last week?
[10:29:19] <jynus>	 The size seems to be almost the same
[10:36:19] <arnaudb>	 they were not depooled afaik 
[10:41:22] <jynus>	 Maybe there is a bias on the sharding
[11:51:05] <Amir1>	 afk for a bit