[11:59:56] <volans>	 I've question, we had a page, and I see that on IRC we're getting again teh same alert multiple times but is not paging and on VO there are 2 active incidents, both acked
[12:00:02] <volans>	 is that expected?
[12:53:43] <godog>	 volans: what are the alerts/pages involved? do you have the log snippet handy?
[12:57:16] <volans>	 godog: (ProbeDown) firing: (2) Service restbase-https:7443 has failed probes (http_restbase-https_ip4) fired both at 2023-09-14 11:42:07 and 2023-09-14 11:57:07. The others I think fired because the number in the first parenthes changed
[12:57:24] <volans>	 see https://wm-bot.wmcloud.org/browser/index.php?start=09%2F14%2F2023&end=09%2F14%2F2023&display=%23wikimedia-operations
[12:59:18] <godog>	 checking
[13:00:15] <volans>	 maybe it's configured like that, but it was weird to see multiple page notificaion on IRC not matching an actual page on VO
[13:00:56] <volans>	 I understand that some of the repetition is because "firing: (2)" become "firing: (5)" for example, but it still felt weird :)
[13:03:13] <godog>	 yes in that case expected in the sense that more alerts of the same group firing for existing incident won't open a new incident on the VO side
[13:03:33] <godog>	 you can see the "2x" update in the incident timeline https://portal.victorops.com/ui/wikimedia/incident/4043/timeline
[13:06:19] <volans>	 yes, I'm not sure that's desirable as a behaviour but I get is the expected one right now. What about the one with (2) in both cases?
[13:07:20] <volans>	 AFAICT it didn't change from (2) to anything else between the 2 alerts
[13:10:20] <godog>	 that's to signal that in this case two alerts of the same group are firing
[13:11:57] <volans>	 I know
[13:12:19] <volans>	 I meant we got the same exact message of 2 alerts at 11:42:07 and 11:57:07
[13:12:33] <volans>	 what can explain that? that the 2 alerts were not the same? changed but were still 2?
[13:13:07] <volans>	 how can a user getting that message understand if it's a new alert, a previous one that just modified the alerts in the group, etc..?
[13:15:27] <godog>	 I'm checking the logs
[13:16:52] <volans>	 hanks
[13:16:55] <volans>	 *thanks
[13:19:03] <godog>	 ok so in this case it was eqiad/codfw both firing ProbeDown, a new alert within the same group will increase the count
[13:19:19] <godog>	 alerts.w.o will always show the full story though
[13:19:42] <godog>	 probedown for restbase that is
[13:20:06] <volans>	 but the message didn't change, what am I missing?
[13:21:50] <godog>	 yeah the formatted message doesn't necessarily show all labels for the alert, some were removed as deemed confusing
[13:23:47] <volans>	 ok