[00:08:51] !log admin "systemctl reset-failed cloud-final.service" on all VMs for T287309 [00:08:55] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL [00:08:55] T287309: Some systemd services appear to be broken on all VMs - https://phabricator.wikimedia.org/T287309 [00:10:12] !log admin "systemctl reset-failed cloud-init.service" on all VMs for T287309 [00:10:15] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL [00:33:16] I have killed globalsearch https://global-search.toolforge.org it is all timed out [00:33:33] ping musikanimal ^^ [00:34:02] oh, now it is back 4 minutes later [00:34:12] always the way [00:38:35] <bstorm18> I'd rather not blow away 100G of possible data without a persistent record at least :) HUGS for your consideration and thinking :-)