[08:09:56] <dcaro>	 Hi! apergos seems to be unable to  see the dashboard https://grafana-rw.wikimedia.org/d/000000568/wmcs-dumps-general-view?orgId=1&from=now-90d&to=now, even if when logging in, an error saying that you don't have enough permissions shows instead. I see that error sometimes (I think when my session expires), and logging in works for me, any ideas? (afaik the dashboard has no special setup/permissions)
[08:19:07] <godog>	 I'll take a look
[08:23:13] <godog>	 I don't know how it happened but viewer and editor role permissions were missing
[08:23:16] <godog>	 I added them back
[08:23:22] <godog>	 compare https://grafana-rw.wikimedia.org/d/000000568/wmcs-dumps-general-view?from=now-90d&orgId=1&to=now&editview=permissions
[08:23:29] <godog>	 and https://grafana-rw.wikimedia.org/d/eea-9_sik/alertmanager?orgId=1&refresh=5m&forceLogin&editview=permissions
[08:28:42] <dcaro>	 ooohhh, interesting
[08:28:47] <dcaro>	 thanks!
[08:28:51] <godog>	 sure np
[08:41:23] <dcaro>	 it worked, thanks! :)
[08:42:16] <dcaro>	 about https://gerrit.wikimedia.org/r/c/operations/puppet/+/916158, I merged and ran puppet on alert1001 (and puppet both changed the config and reloaded the icinga service), but icinga seem not to have picked up the change: https://icinga.wikimedia.org/cgi-bin/icinga/config.cgi?type=services&item_name=clouddumps1001^Persistent+high+iowait
[08:43:04] <dcaro>	 (still has !5!10 for the limits, it should be !5!10000)
[08:43:18] <dcaro>	 hmm, now that I check, it only seemed to update clouddumps1002, not 1001 on the config, looking
[08:43:33] <godog>	 dcaro: puppet needs to run on clouddumps hosts first and then icinga
[08:43:39] <dcaro>	 exported stuff?
[08:43:39] <godog>	 because exported resources
[08:43:39] <dcaro>	 yep
[08:43:40] <dcaro>	 :)
[08:44:27] <godog>	 I'll sounds like a broken record, though *please* move to alerts.git :) (I've seen the patch, thank you for starting it)
[08:44:30] <dcaro>	 hmm... given that it's already doing a prometheus query... it should be quite easy to move to alert.git xd, might do that today
[08:44:38] <dcaro>	 ack
[08:45:36] <godog>	 yes that's what https://phabricator.wikimedia.org/T309011 is about, i.e. the straightforward migration of check_prometheus to alerts.git
[08:45:47] <godog>	 thank you, feel free to send patches my way too