[01:16:45] * bd808 off [04:50:39] um, how do I undisable a tool? [04:54:20] ok, I guess the tool hasn't been disabled, just the webservice [04:56:25] starting the webservice didn't work so I guess it's something else [04:56:53] trying to help with https://phabricator.wikimedia.org/T320041#9420512 now that someone (deadbeef) has stepped up to work on it [09:11:03] legoktm: did you figure it out already? the isntructions are in a cloud-admin email sent earlier this week [16:35:24] taavi: [16:35:33] https://www.irccloud.com/pastebin/cKNCu7Wz/ [16:52:19] taavi andrewbogott the alerts are gone :) [16:52:27] great! [16:54:25] does anybody know what happened to toolsbeta-bastion-6? should I try rebooting it? [16:54:38] (alert: Project toolsbeta instance toolsbeta-bastion-6 is down) [16:54:42] I don't know but it should be harmless to reboot [16:58:20] rebooting cleared the alert [17:05:01] there are still 2 NeutronAgentDown alerts for cloudvirt1063, the metric "openstack_neutron_agent_state" still exists, I assume generated by a cloudcontrol [17:10:48] https://phabricator.wikimedia.org/P54509 [17:13:22] yes, I can probably clear those [17:14:03] well, one of them at least [17:14:56] I'm reading you can do both "agent delete" and "agent set --disable" [17:15:08] I guess "delete" makes sense here as the host is gone? [17:16:03] yes, the metric has stopped now [17:16:49] the alert will take a little bit longer as it's computed on min_over_time[20m] [17:18:34] if you want one more challenge before the holidays, the alerts on tf-infra-test are back :) I'm having a look [19:19:19] * bd808 lunch [23:24:38] * taavi wonders why mediawiki rollback confirmation is not enabled by default [23:25:50] slows down spam reversion!!!! [23:28:49] yeah but I'm pretty sure this was not the first time I was trying to close a NavPops popup on a touchscreen and ended up accidentally hitting rollback instead [23:45:02] Hmmm.. that's a good question taavi. I thought Aaron had squashed all "write on GET" actions to make multi-dc actually work.