[05:40:25] (SystemdUnitFailed) firing: burrow-jumbo-eqiad.service on kafkamon1003:9100 - https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state - https://grafana.wikimedia.org/d/g-AaZRFWk/systemd-status - https://alerts.wikimedia.org/?q=alertname%3DSystemdUnitFailed [05:55:25] (SystemdUnitFailed) resolved: burrow-jumbo-eqiad.service on kafkamon1003:9100 - https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state - https://grafana.wikimedia.org/d/g-AaZRFWk/systemd-status - https://alerts.wikimedia.org/?q=alertname%3DSystemdUnitFailed [06:31:43] FYI, merged https://gerrit.wikimedia.org/r/c/operations/puppet/+/1024539/1 to fix the vopsbot issue on secondary alert host [14:29:00] Thank you moritzm ! [15:31:36] mutante herron: I've tested Gerrit patch https://gerrit.wikimedia.org/r/c/operations/puppet/+/1023917 on prometheus6002 and it generated a valid Envoy configuration. :) [15:31:59] It seems like sni-support 'strict' was the culprit generating invalid envoy configs. [15:32:21] denisse: glad to hear! [15:32:26] I've disabled Puppet on the other PoP hosts, please let me know if you consider it okay for me to proceed applying the change in the other hosts. :) [15:32:41] +1 [15:32:58] go for it [15:33:57] Thanks, I'll do. [15:34:07] Also, thanks both for the guidance! ^^ [15:53:01] All of the Prometheus PoP instances look healthy from Thanos side. [19:12:04] denisse: glad to hear that :) gj [19:12:29] Thanks!! ^^