[11:40:32] If I have a few largeish (O(3G)) files I want to copy from some prod hosts to a cumin host (so I can do a few comparison things on them), is there a simple way to do this without scp -3 [which would drag them up and down my wet-string internet]? [11:42:24] Emperor: yes, scp with the cumin's key [11:43:27] SSH_AUTH_SOCK=/run/keyholder/proxy.sock scp ... run on the cumin host either to copy locally or to copoy to another host with -3 (for not too large files) [11:43:42] thanks :) [11:47:13] that's just the ticket, I'll try not to leave 9G of mangled sqlite on cumin2002 forever [11:47:42] Emperor: transfer.py ? [11:48:17] I've used that in cookbooks, but this is a one-off ad-hoc sort of thing [11:48:20] 9GB is not that big, there is plenty of space, in particular on cumin2002 [13:01:08] I'm having issues with install-console, ssh fails to authenticate on the host that is stuck reimaging (`root@cloudcephosd1012: Permission denied (publickey).`), anyone has any hints on how to debug? (I'll try rerunning the reimage cookbook if I can't figure it out) [13:45:23] dcaro: o/ have you tried to connect to the mgmt console and see where it is stuck at? [13:47:36] hey, I get a user prompt, to which I have no password [13:54:26] dcaro: I just tried there the system is up and online for an hour or so from what I can tell [13:54:54] I can ssh from my laptop fine from here to cloudcephosd1012.eqiad.wmnet via bast1003 [13:55:24] dcaro: the user prompt is usually root + the root password stored in pwstore [13:55:40] let me retry [13:56:37] but as topranks said, I can ssh to it directly [13:56:40] hmm. I can log in also, I think it might not have booted the installer [13:57:15] that's a possibility alright [13:57:50] okok, thanks! I'll debug and let you know :) [15:12:00] o/ quick check - if I remove the existence of a feature flag in an extension, i can remove it from InitialiseSettings.php *after* I remove it from the extension, correct? (that is: there's no check that the values in InitialiseSettings actually correspond to something defined somewhere else?) [15:12:44] ihurbain: and the new version of the extension has been shipped to all prod? [15:14:04] this is a follow-up to https://gerrit.wikimedia.org/r/c/operations/mediawiki-config/+/1100850 - the flag is now set to true on all wikis since tuesday [15:14:11] so... "yes?" :D [15:15:23] I think so yes [15:15:42] ihurbain: yes, defining variables in IS.php that don't exist is not a problem [15:15:47] thank you :) [21:10:43] inflatador: I changed the status of cloudelastic1011 to 'active', want me to do the same for 1012? [21:12:03] andrewbogott I think 1012 is already active, but will check [21:12:22] up, confirmed [21:12:36] I bet you can also change that status yourself, unless I have some triple-secret status on netbox that I didn't ask for [21:13:13] I can, I just wanted to make sure I wasn't gonna break anything [21:13:47] oh! I had no such concern [21:14:18] I guess we could try to reimage it and make sure it's clean, but if it's working for you it's probably working [21:15:49] Nah, it definitely works. Thanks for your help! [21:16:55] * andrewbogott may have harmed but definitely didn't help [21:19:25] This was our first Supermicro and first EFI host, so I expected a few bumps. It's actually gone quite well (mostly due to IF/DC Ops' hard work) [21:41:17] hmm, same error. Guessing I need to run the `sre.puppet.sync-netbox-hiera` cook-book [21:45:02] yeah, I see a diff there...rerunning PCC, but I'm guessing that fixed it [23:01:51] Nope, PCC still unhappy. C'est la vie...will look at it tomorrow