[10:25:55] !log admin adding back cloudcephosd1034 to the pool after doing the performance tests (T348643) [10:26:00] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL [10:26:01] T348643: cloudcephosd1021-1034: hard drive sector errors increasing - https://phabricator.wikimedia.org/T348643 [11:43:58] !log tools restarted sssd on tools-prometheus-6 as it was stopped (error) [11:44:00] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [12:51:21] !log taavi@tools-bastion-12 tools.wikibugs toolforge jobs restart irc [12:51:24] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.wikibugs/SAL [12:55:21] I can't build my tool on the new bastion, the compilation of my source files just hangs now. Is there some limitation or known problem on NFS access or something similar? [13:47:17] don-vip: how do you compile your tool? using a toolforge job? or using the build service? [15:28:35] !log anticomposite@tools-sgebastion-10 tools.stewardbots SULWatcher/manage.sh restart # SULWatchers disconnected [15:28:37] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.stewardbots/SAL [15:29:17] !log anticomposite@tools-sgebastion-10 tools.stewardbots ./stewardbots/StewardBot/manage.sh restart # RC reader not reading RC [15:29:18] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.stewardbots/SAL [15:50:58] is there a recipe for migrating cinder volumes? [15:53:34] should i just copy over the fstab line (in addition to reattaching the volume to the new instance)? [15:53:55] @dcaro I build my tool by compiling java sources directly on bastion, it was the fastest way to do it until the recent change (build framework is too slow for java applications because of lack of artifacts caching) [15:56:44] don-vip: you have `jdk17` as a toolforge jobs image you can use [15:58:50] don-vip: also note I filed https://phabricator.wikimedia.org/T360768 about your tool [16:01:39] ok I'll try with a toolforge job [16:04:11] ah yes thank you taavi for the ticket [16:26:51] my volume taxonkatbot was doubly attached to the instance taxonkatbot, i detached it, now i can neither reattach it, nor remove the remaining attachment, nor delete it [16:51:53] gifti: that doesn't sound good. :(( andrewbogott can you try to help gifti with some cinder volume problems? [16:52:30] hm, that's scary, I'll have a look. [16:52:53] gifti: I assume both the volume and the instance need to be preserved? [16:53:10] i have deleted the instance in the meantime [16:53:25] ah, ok. That makes things easier I think. What project is this in? [16:53:26] and i believe nothing of importance is left on the volume, but i can't check [16:53:35] the project is dwl [16:54:18] ok, yeah, I see it mounted on a fictional VM [16:54:27] that's the deleted vm [16:54:29] I think I've seen this before, let's see if I remember how to fix it [16:57:59] gifti: I think you're liberated. I just looked up the attachment ID on the cli and then did 'openstack volume attachment delete' [16:58:03] all better from your end? [16:58:55] thank you! looks fine now [17:30:46] dhinus, I was showing off your game again https://whopaintedthis.toolforge.org. I had to guess the url, I need to bookmark it! [17:33:35] balloons: you can always search for it on https://toolhub.wikimedia.org too ;) [17:47:25] !log tools.wikibugs Installed async-timeout-4.0.3 & redis-5.0.3 in venv as prep for landing MR!15 [17:47:27] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.wikibugs/SAL [17:52:02] bd808, that's actually how I found it.. https://toolhub.wikimedia.org/search?q=paint [17:52:56] I was going to poke you and then remembered.. Hey, there IS a way to search for tools rather than guessing the subdomain [17:53:34] heh :) [17:55:54] !log bd808@tools-bastion-12 tools.wikibugs Restarted irc task to pick up 3069193 (T359982, T360074) [17:55:58] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.wikibugs/SAL [17:59:09] taavi: the wikibugs changes I just deployed ran overnight on two consecutive test days without becoming detached from irc or redis. Let's hope this makes restarts even less necessary. :) [18:07:48] Hey taavi, when I tried to create a wildcard domain on Horizon, I got the error "Error: Unable to create proxy: {"error":"Can't use domain *.catalyst.wmcloud.org"} Details [18:07:50] Unrecognized schema in response body. (HTTP 403) [18:08:00] https://tilde.town/~kindrobot/s/wildcard_error.png [18:09:51] when i delete and recreate a vm with the same name, should i wait before i create it or wait after i create until i can access it? [18:14:32] kindrobot: hrm, the duplicate checking logic clearly needs some work: `Rejecting can_use_hostname (catalyst *.catalyst.wmcloud.org.), found existing records: helloworld.catalyst.wmcloud.org.` [18:14:43] I think for now if you delete the helloworld proxy it should work :-) [19:14:34] Ok, I'll try Monday. Thanks <3 [19:42:51] * bd808 sees the Wikitech user that seemed to be preparing to vandalize things finally got around to doing that [19:43:12] thanks as always for patrolling JJMC89 :)