[00:25:59] On tools-sgebastion-11, when I run "webservice --backend=kubernetes python3.11 shell", I get: [00:26:10] Traceback (most recent call last): [00:26:11] File "/usr/local/bin/webservice", line 11, in [00:26:11] load_entry_point('toolforge-webservice==0.1', 'console_scripts', 'webservice')() [00:26:11] File "/usr/lib/python3/dist-packages/toolsws/cli/webservice.py", line 195, in main [00:26:11] KubernetesBackend.get_types(), [00:26:11] File "/usr/lib/python3/dist-packages/toolsws/backends/kubernetes.py", line 291, in get_types [00:26:12] kubeconfig=Kubeconfig.load(), user_agent="webservice" [00:26:12] File "/usr/lib/python3/dist-packages/toolforge_weld/kubernetes_config.py", line 98, in load [00:26:12] raise KubernetesConfigFileNotFoundException(str(path.resolve())) [00:26:13] toolforge_weld.kubernetes_config.KubernetesConfigFileNotFoundException: /mnt/nfs/labstore-secondary-tools-home/roysmith/.kube/config [00:27:12] you forgot to `become` your tool account, and apparently the error message for that scenario is bugged [01:09:21] got it, thanks [03:56:31] what would it take if I wanted to run my own instance of elasticsearch on a VPS instance? [03:56:39] Is that something that needs to get installed via puppet? [08:44:40] Hi there, and sorry if this is the wrong channel for this. I noticed that Wikimedia Meet* is down. Can that be fixed, or should I be asking elsewhere? * https://meta.m.wikimedia.org/wiki/Wikimedia_Meet [08:49:26] https://lists.wikimedia.org/hyperkitty/list/cloud@lists.wikimedia.org/message/SW6WVPGKOV5CRRIRCZXNKEU6QJ7ML2UX/ (re @marcosmarado: Hi there, and sorry if this is the wrong channel for this. I noticed that Wikimedia Meet* is down. Can that be fixed, or should ...) [08:52:45] Thanks! (re @JeanFred: https://lists.wikimedia.org/hyperkitty/list/cloud@lists.wikimedia.org/message/SW6WVPGKOV5CRRIRCZXNKEU6QJ7ML2UX/) [12:45:29] https://w.wiki/_zNvb [15:25:34] Hey everyone! While searching for my pywikibot's name on Google I randomly found an open ticket about it in Phab about needing it to migrate on Kubernetes. I am aware of the migration process happening but I had always assumed that it wouldn't require manual work from the tool maintainers (most of the time). Apparently I was wrong. Now I'm trying to migrate my tool there but I'm [15:25:35] a bit unsure of what I should do to consider the migration successful. Should I only change the crontab command and restart my webservice? (Also some change to the venv...) These are the three resources mentioned in the said task (T320048). I would appreciate any guidance. [15:29:47] Klein it looks like your webservice is already running on kubernetes, so turning the crontab commands into `toolforge jobs` should be the main thing, I think [15:31:38] Thank you for your fast answer! What about the recreation of the virtual environment? I'm not sure how much you can help in that because it can be different for each account I suppose but... (re @lucaswerkmeister: Klein it looks like your webservice is already running on kubernetes, so turning the crontab commands into toolforge jobs should...) [15:32:11] ah, I see, the cronjobs use python… [15:32:28] if you use a Python image with the same version as on the grid engine, using the same venv might work [15:32:45] but it’s probably easier to just make a new one and reinstall the dependencies there [15:33:31] you can use `webservice python3.11 shell` to get an interactive shell with Python 3.11, and set up the new venv in there [15:33:41] and then use the `python3.11` image when running the jobs [15:34:02] (I don’t remember which Python version the grid has but it’s definitely an older one, maybe 3.7 if I had to guess) [15:34:50] alternatively, https://wikitech.wikimedia.org/wiki/Help:Toolforge/Python#Jobs has another set of instructions to set up a new venv [15:39:05] Hmm... I see. Well, I'm doing the easy stuff by updating the crontab. Then I'll try to better understand how to deal with the Python version upgrade using the information you just gave to me. One last newbish question: Let's say I don't change anything beside the crontab, what happens? My script fails to activate on the given date and thus I understand that I need to deal with ve [15:39:06] nv as well to make it work? Can I do that even beyond the deprecation date referencing the 2024 January? [15:40:09] I think your scripts will just stop running [15:40:17] starting the new jobs to replace them should be possible at any point [15:40:32] I’m not sure if the old crontab will remain available… maybe run `crontab -l > crontab-backup.txt` now just in case ;) [15:43:02] Okay. Thank you very much for your concise information! Sorry in advance if I come up again here soon asking for help getting unstuck in any of the steps. Haha [15:44:19] ok, sure ^^ [15:44:45] I have a question of my own, actually… is there any size limit on toolforge build pack container images? [15:44:58] I got “ERROR: failed to export: failed to write image to the following tags … unexpected status code 413 Request Entity Too Large” from the build command [15:45:21] (lucaswerkmeister-test tool, but using the wd-shex-infer tool repo, k8s ref) [15:47:04] trying again now after deleting some old builds, maybe that helps [16:03:32] still failed :( [16:05:36] o_O apparently the image… exists, it just couldn’t be tagged as `latest`? https://tools-harbor.wmcloud.org/harbor/projects/21347/repositories/tool-lucaswerkmeister-test/artifacts-tab/artifacts/sha256:77584ae6cb7f56db39f4bbfa1f1e91a32032a0b51b0086c95ae059b3c5d5be9f?publicAndNotLogged=yes [16:16:54] meh, can’t get it to work with `toolforge jobs run` though [16:58:59] @lucaswerkmeister, I tried updating my crontab but when saving the new info, it was automatically converted to use jsub again (as the hatnote says it would). Clearly I'm misunderstanding something. [17:00:19] Toolforge jobs has its own system [17:00:29] You don't need to add it through crontab [17:03:59] Hmm... So do I need to do anything in regard to the kubernetes migration process? I thought I needed to upgrade my crontab as with the kubernetes equivalent as shown in the Phab task associated link. :/ [17:07:33] https://wikitech.wikimedia.org/wiki/Help:Toolforge/Jobs_framework#Creating_scheduled_jobs_(cron_jobs) [17:07:46] Once you've added the job with a schedule [17:07:54] You can delete it from your crontab [17:10:21] Oh, so I create a "schedule" and that's it, right? (Also empty my crontab.) [17:12:50] Yes [17:19:44] Thank you! [17:19:45] [17:19:47] In my case I have some jobs that follow this format: [17:19:48] [17:19:50] [17:19:51] 0 13 1 * * /usr/bin/jsub -N Smallem-Transclusion -once ~/venv/bin/python3 ~/Smallem-Transclusion.sh sq wikipedia Aktivizimi mujor i Smallem-it për numërimin e përdorimit të stampave [17:19:53] (copied from my crontab) [17:19:54] [17:19:56] Would it be possible to provide me a working example how would I schedule this job in Kubernetes? I can follow with other cases myself after that I believe. [17:23:24] It's cron syntax [17:23:36] So you can still copy '0 13 1 * *' [17:25:44] Yes but what about the path part + jsub? Should I use something like /usr/bin/Toolforge... Etc? [17:31:34] You don't need jsub [17:31:51] Or to put anything in a crontab [17:35:49] 0 13 1 * * /usr/bin/toolforge jobs run myjob --command -N Smallem-Transclusion -once ~/venv/bin/python3 ~/Smallem-Transclusion.sh sq wikipedia Aktivizimi mujor i Smallem-it për numërimin e përdorimit të stampave --image bullseye [17:35:50] [17:35:51] So is this correct? Or should I read more? :P Sorry, I'm not very good on such technicalities. [17:36:06] You should read more [17:36:59] "toolforge jobs run mycronjob --command ./daily.sh --image bullseye --schedule "@daily" " is the example it gives to set it up [17:37:27] Blank your crontab and then run that with daily.sh changed to your command and @daily to the schedule [17:38:47] So toolforge jobs run Smallem-Transclusion --command "~/venv/bin/python3 ~/Smallem-Transclusion.sh sq Wikipedia ....." --image bullseye --schedule "0 13 1 * *" [17:39:42] Thank you very much! I will try it. [17:40:09] I was following the example that I found in the Phab task link. [17:40:30] https://wikitech.wikimedia.org/wiki/Help:Toolforge/Jobs_framework#Grid_Engine_migration [17:41:53] I was made to believe from that table that there I needed to switch "jsub" to "Toolforge jobs..." and add "-- image bullseye" in the end while keeping everything unchanged. [17:43:08] But apparently that is a wrong interpretation. Thought I'd say anyway because it can be interesting to know how such documentation pages may get (wrongly) interpretated by non-so-tech folks. [17:45:07] It's the cron bit that makes it more complex [18:19:58] I'm trying to follow the instructions at https://wikitech.wikimedia.org/wiki/Help:Puppet, but the screenshots and instructions don't match what I'm seeing in horizon [18:20:29] There are not "project", "common" or "all" buttons [18:48:02] !log tools.lexeme-forms deployed 7611d4e980 (l10n updates: ia, krc, sv) [18:48:06] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.lexeme-forms/SAL