[07:04:48] FIRING: PuppetFailure: Puppet has failed on logging-hd2005:9100 - https://puppetboard.wikimedia.org/nodes?status=failed - https://grafana.wikimedia.org/d/yOxVDGvWk/puppet - https://alerts.wikimedia.org/?q=alertname%3DPuppetFailure [07:14:48] RESOLVED: PuppetFailure: Puppet has failed on logging-hd2005:9100 - https://puppetboard.wikimedia.org/nodes?status=failed - https://grafana.wikimedia.org/d/yOxVDGvWk/puppet - https://alerts.wikimedia.org/?q=alertname%3DPuppetFailure [10:21:44] the logstash graph is gone again 😔 https://logstash.wikimedia.org/goto/2759366c4103edb0e41171adc43ac1ee [13:33:46] Hi folks! [13:34:03] Not sure if you've seen https://alerts.wikimedia.org/?q=%40state%3Dactive&q=%40cluster%3Dwikimedia.org&q=alertname%3DKafka%20broker%20TLS%20certificate%20validity but some kafka-logging brokers need to be restarted to pick up the new TLS certs [13:56:13] thanks for the heads-up elukey! we'll get that sorted [17:00:33] I am interested in testing out this dmarc parser in combination with Grafana or Opensearch, any suggestions on the easiest why to demo it, without making a production setup? https://github.com/domainaware/parsedmarc/tree/master [17:08:40] jhathaway we have an opensearch docker image now if that helps: https://docker-registry.wikimedia.org/repos/data-engineering/opensearch/tags [17:09:35] inflatador: thanks it might, I may try cobbling something together with docker compose [17:10:38] yeah I'd say that's probably the quickest way, just stand up a self hosted stack with docker-compose or a quick VM [17:11:25] ok, will do, thanks folks