[00:47:25] (SystemdUnitFailed) firing: curator_actions_cluster_wide.service on logstash2026:9100 - https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state - https://grafana.wikimedia.org/d/g-AaZRFWk/systemd-status - https://alerts.wikimedia.org/?q=alertname%3DSystemdUnitFailed [04:46:29] mutante: 0,$ can be shortened to % [04:46:39] %s/^-//g [04:47:08] and the expression delimiter can be any character Iiic so I tend to reuse the precentage sign as well [04:47:15] %s%^-%%g [04:47:25] (SystemdUnitFailed) firing: curator_actions_cluster_wide.service on logstash2026:9100 - https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state - https://grafana.wikimedia.org/d/g-AaZRFWk/systemd-status - https://alerts.wikimedia.org/?q=alertname%3DSystemdUnitFailed [04:47:50] ( pretty sure I have learned that via https://www.vimgolf.com/ ) [06:17:25] (SystemdUnitFailed) firing: (2) rsync-loki-data.service on grafana2001:9100 - https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state - https://grafana.wikimedia.org/d/g-AaZRFWk/systemd-status - https://alerts.wikimedia.org/?q=alertname%3DSystemdUnitFailed [06:22:25] (SystemdUnitFailed) firing: (2) rsync-loki-data.service on grafana2001:9100 - https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state - https://grafana.wikimedia.org/d/g-AaZRFWk/systemd-status - https://alerts.wikimedia.org/?q=alertname%3DSystemdUnitFailed [10:22:25] (SystemdUnitFailed) firing: curator_actions_cluster_wide.service on logstash2026:9100 - https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state - https://grafana.wikimedia.org/d/g-AaZRFWk/systemd-status - https://alerts.wikimedia.org/?q=alertname%3DSystemdUnitFailed [13:00:23] the curator failure is T348508 [13:00:24] T348508: Curator failed to delete indices in codfw - https://phabricator.wikimedia.org/T348508