[01:12:54] !log tools.krinklebot Disable Grid cronjob (T319848) [01:12:57] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.krinklebot/SAL [01:15:19] !log tools.krinklebot Deploy 0eca3be, 2a7149e (T319848) [01:15:21] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.krinklebot/SAL [02:17:56] https://openstack-browser.toolforge.org/project/codesearch [02:17:57] > Unknown project 'codesearch'. Are you just guessing? [02:18:09] something seems not quite right [02:18:13] https://openstack-browser.toolforge.org/project/admin-monitoring [02:18:17] same here too [02:19:45] works for me? [03:59:12] still the same error for me [14:31:30] Krinkle: there is a prometheus alert about codesearch-backend, though codesearch seems to be working fine [14:32:29] I checked the VM and there are 2 failing systemd units, do you know more about it? [15:45:06] dhinus: I'm talking about the openstack browser not able to see anything in the system. The instances are fine indeed [15:45:46] It's showing now but yesterday for many hours wasn't. Maybe it's spotty [15:46:23] The error is confusing though. It doesn't say it failed to perform a lookup or anything, it confidently stated the project doesn't exist [15:58:22] I checked from my phone when I saw the message and it worked at that time for me, flakiness might be an issue yep [18:54:53] !log admin depooling clouddb1019 to let it recover from high memory use. T346826 [18:54:59] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL [18:55:00] T346826: clouddb1019 memory alert - https://phabricator.wikimedia.org/T346826