[00:59:21] Seems like openstack-browser may need its web service restarted as I can’t seem to access it [13:59:24] !log admin rebooting every VM in codfw1dev [13:59:27] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL [15:42:43] !log tools deploy builds-api 0.3.2 (T337025) [15:42:46] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [15:42:46] T337025: Unknown error when trying to delete a Toolforge build - https://phabricator.wikimedia.org/T337025 [20:17:21] Can somebody please restart the webservice for the openstack-browser tool? Seems unresponsive. [20:25:21] Nvm loaded now [20:25:38] Actually no still needs restart [20:48:57] I've never found it particularly responsive [21:32:07] MacFan4000: restarting it almost always makes it worse. the general issue is that the landing page and a few others make a lot of OpenStack API calls and those quite often end up timing out these days. [21:32:46] https://openstack-browser.toolforge.org/project/ is generally responsive as are most project specific pages [21:38:25] I should just remove the cute "here's all the high level stats" stuff from the landing page I guess. [22:28:19] !log tools.openstack-browser Updated to 2aecd1b2 (T337265) [22:28:23] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.openstack-browser/SAL [22:42:48] https://openstack-browser.toolforge.org/project/ hmm, no projects are listed now [22:44:01] MacFan4000: yeah, https://gerrit.wikimedia.org/r/c/operations/puppet/+/932516 [22:44:26] that config file has apparently been broken since the 16th and nobody noticed [22:44:48] when I restarted osb it picked up the new, broken config [23:21:01] MacFan4000: I hacked it back to life [23:22:23] !log tools.openstack-browser Updated to 4ef5c87 to work around /etc/novaobserver.yaml bug [23:22:26] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.openstack-browser/SAL