[06:46:30] <hashar>	 godog: good morning. That has happened again over night with a notification for a firing alarm at 00:01:34   and resolved at 00:11:34  (10 minutes, I guess that is the retry/poll interval or whatever)
[06:49:50] <godog>	 hashar: good morning, thank you! Cole mentioned this problem is related to https://phabricator.wikimedia.org/T344961 and a solution is in the works, specifically to get jinxer to emit more useful messages in such cases
[07:01:55] <hashar>	 godog: great to know Cole has a root cause :]
[09:07:28] <hashar>	 godog: those alarms send emails to the releng mailling list AND to sre-observability  / wikimedia.org , so you should have them as well with all the details
[09:08:50] <godog>	 hashar: indeed, the alerts are complete and they are not formatted as expected on irc due to the way grafana sends them, should be fixable on irc though
[09:09:38] <hashar>	 at least the link to the alert manager dashboard works and we can find the details there
[09:12:08] <godog>	 indeed
[09:12:34] <godog>	 for context: jinxer expect the alert to contain an annotation named "summary" which grafana doesn't send in some cases
[09:12:47] <godog>	 we can make jinxer fall back to sth else though