[12:17:58] !log wikidata-dev wikidata-misc deleted wdq-ui.wmflabs.org proxy, I suspect it’s been broken since at least October 2019 [12:18:00] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Wikidata-dev/SAL [12:26:37] Toolforge question: got to move an old python2 tool to the Buster grid. Need to recreate a venv (old one is nuked already). Docs specifically say to create the venv from a k8s shell but `virtualenv` command is not available there. Any options besides doing the unrecommended thing and create the venv from the bastion? [12:26:37] (and yes, I know that py2 is EOL and no, I’m not going to upgrade that tool now). [12:27:35] if you’re targeting the grid then AFAIK you should create the venv on the bastion anyways, not on k8s [12:27:42] since the bastion and grid would have the same Python version [12:28:13] Using the same venv for grid jobs and a k8s-backed webservice [12:28:20] D: [12:28:40] not sure that’s a supported combination tbh [12:30:13] Not the first time this caused me headaches indeed (T257942) (re @lucaswerkmeister: not sure that’s a supported combination tbh) [12:32:39] So okay, let’s say I do two venvs again. I can recreate the py2 venv for the grid jobs from the bastion ; how could I create a venv from the k8s `python2` shell ? [12:32:40] `python -m virtualenv` looks like it might work in a python2 k8s shell? [12:32:51] hmmm, checking that (re @lucaswerkmeister: python -m virtualenv looks like it might work in a python2 k8s shell?) [12:33:12] (or at least I seem to get some meaningful output with --help) [12:38:26] The good news: I could create the venv fine & the webservice is back online. [12:38:27] The bad news: grid jobs still fail with a joyful `ImportError: cannot import name _remove_dead_weakref` [12:46:08] I have now created a second virtualenv from the bastion, and switched the grid jobs to use it : same error [12:55:00] (Hum, I guess I was on the wrong bastion node. One sec) [13:01:38] !log paws remove db-proxy #166 T309794 643e112be91c355b8769caeab9e814dea9172b7d [13:01:42] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Paws/SAL [13:01:42] T309794: Remove db-proxy - https://phabricator.wikimedia.org/T309794 [13:05:57] !log tools.wikiloves Recreated two virtual envs for T310059 [13:05:59] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.wikiloves/SAL [13:19:06] Thanks for the help @lucaswerkmeister ! Solved it (tentative summary of steps at https://phabricator.wikimedia.org/T310059#7985909) (re @lucaswerkmeister: python -m virtualenv looks like it might work in a python2 k8s shell?) [14:02:02] Hello, just checking something: Within Horizon I'm not permitted to create snapshots of VMs. I get a 403 error. Is this expected behaviour? [14:23:40] @JeanFred using dev.toolforge.org and https://wikitech.wikimedia.org/wiki/Help:Toolforge/Pywikibot#Setup_a_Python_virtual_environment_for_library_dependencies worked for me [15:20:10] !log tools.stewardbots restart StewardBot, timed out [15:20:32] it would help if stashbot was not also timed out. [15:26:42] bd808: ^ (stashbot quit, and it isn't rejoining) [16:37:35] bd808 is traveling for a couple of weeks [16:37:44] btullis: yes, snapshots aren't supported currently [16:37:53] I'm surprised that the UI gives you the menu [16:43:52] is stashbot back? T123456 [16:43:53] T123456: Special:CentralAuth reports account attachment, which - being standalone - is confusing, report accout creation as well - https://phabricator.wikimedia.org/T123456 [16:43:55] whee [16:44:02] thanks to whoever restarted it [20:32:06] andrewbogott: thanks for the confirmation.