[11:03:42] you can maybe use amtool to create a fake alert [11:05:16] yeah that would work I think, I'll add instructions to wikitech on how to do that later today [11:05:54] the other way would be to block probes from prometheus hosts only if you don't want to take the service down [14:32:52] https://wikitech.wikimedia.org/wiki/Alertmanager#Fire_a_test_alert_via_CLI [14:43:40] \o/ [14:46:37] with great power etc etc, pls alert responsibly [14:51:45] lol [20:29:54] thanks for the suggestions and new docs!:)) [20:30:30] exactly what I needed to be able to close a couple tickets [22:13:43] I succesfully used amtool to create a test alert.. as in "I see it in alerts.wikimedia.org".. but the part that doesn't happen is the phab ticket creation. I copied the "webhook_configs" section from something existing and used the same Phab workboard URL.. so.. that remains to be debugged [22:14:14] it's cool to have this tool [22:17:07] ah, I think I found it. I am lacking a "route" that matches my new severity level to my new receiver. makes sense