[08:57:51] <tappof>	 &away
[12:22:06] <jinxer-wm>	 FIRING: SystemdUnitFailed: arclamp_compress_logs.service on arclamp2001:9100 - https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state - https://grafana.wikimedia.org/d/g-AaZRFWk/systemd-status - https://alerts.wikimedia.org/?q=alertname%3DSystemdUnitFailed
[12:24:11] <jinxer-wm>	 FIRING: [2x] SystemdUnitFailed: arclamp_compress_logs.service on arclamp2001:9100 - https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state - https://grafana.wikimedia.org/d/g-AaZRFWk/systemd-status - https://alerts.wikimedia.org/?q=alertname%3DSystemdUnitFailed
[12:32:06] <jinxer-wm>	 FIRING: [2x] SystemdUnitFailed: arclamp_compress_logs.service on arclamp2001:9100 - https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state - https://grafana.wikimedia.org/d/g-AaZRFWk/systemd-status - https://alerts.wikimedia.org/?q=alertname%3DSystemdUnitFailed
[13:19:11] <jinxer-wm>	 RESOLVED: [2x] SystemdUnitFailed: arclamp_compress_logs.service on arclamp2001:9100 - https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state - https://grafana.wikimedia.org/d/g-AaZRFWk/systemd-status - https://alerts.wikimedia.org/?q=alertname%3DSystemdUnitFailed
[13:26:05] <Emperor>	 Just to note that thanos nodes are warning on disk space again; but we are now gradually bringing the new hardware into the rings, so I'm _hoping_ we don't need any further deletions...
[14:24:46] <tappof>	 ack Emperor, thank you
[19:14:11] <jinxer-wm>	 FIRING: SystemdUnitFailed: arclamp_generate_svgs.service on arclamp2001:9100 - https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state - https://grafana.wikimedia.org/d/g-AaZRFWk/systemd-status - https://alerts.wikimedia.org/?q=alertname%3DSystemdUnitFailed
[19:17:06] <jinxer-wm>	 RESOLVED: SystemdUnitFailed: arclamp_generate_svgs.service on arclamp2001:9100 - https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state - https://grafana.wikimedia.org/d/g-AaZRFWk/systemd-status - https://alerts.wikimedia.org/?q=alertname%3DSystemdUnitFailed
[19:37:48] <inflatador>	 herron we're finished removing the graphite metrics from https://grafana.wikimedia.org/goto/bf6KnLnHR?orgId=1 ....I didn't want to mess up your deprecation library panel though. Is it safe to unlink and then remove it from our dashboard?
[20:01:32] <cwhite>	 inflatador: should be ok to remove deprecation panel
[21:07:55] <herron>	 inflatador: nice!  yes that'd be perfect thanks
[21:37:15] <inflatador>	 cwhite herron thanks, I just removed it