[13:28:57] !log h2o@tools-sgebastion-10 tools.stewardbots ./stewardbots/StewardBot/manage.sh restart # RC reader not reading RC [13:29:00] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.stewardbots/SAL [13:34:26] !log lucaswerkmeister@tools-sgebastion-10 tools.bridgebot Double IRC messages to other bridges [13:34:29] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.bridgebot/SAL [13:48:39] Hi everyone! I'm following the tutorial page for https://wikitech.wikimedia.org/wiki/Help:Toolforge/My_first_PHP_tool and I think there might be a typo in a code example for a command. Under the paragraph "Start the webservice" the code example reads: [13:48:39] "tools.sample-php-buildpack-app@tools-sgebastion-10$ toolforge webservice buildservice --mount=none start [13:48:40] Starting webservice." [13:48:40] But when I run this I get: [13:48:41] "usage: toolforge webservice [-h] [--template TEMPLATE_FILE] [13:48:41]                             [--backend {gridengine,kubernetes}] [13:48:42]                             [--release {buster}] [-m MEMORY] [-c CPU] [13:48:42]                             [-r REPLICAS] [13:48:43]                             [--buildservice-image BUILDSERVICE_IMAGE] [13:48:43]                             [--mount {all,none}] [-f] [-l LAST] [13:48:44]                             [TYPE] ACTION [... [... ...]] [13:48:44] toolforge webservice: error: argument ACTION: invalid choice: 'buildservice' (choose from 'start', 'stop', 'status', 'restart', 'shell', 'logs')" [13:55:12] !pastebin [13:56:43] ppenloglou: the command in https://wikitech.wikimedia.org/wiki/Help:Toolforge/Build_Service#Webservice has a --backend=kubernetes, which is necessary for the buildservice. Try that command [14:01:21] Worked like a charm, thank you so much! [14:45:39] I don't think you should need that.. unless you have a service.template with `backend: gridengine` still on it? [15:19:00] !log h2o@tools-sgebastion-10 tools.stewardbots ./stewardbots/StewardBot/manage.sh restart # RC reader not reading RC [15:19:03] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.stewardbots/SAL [15:22:29] Is there a mechanism to run a script to restart a continous job every hour or so ? [15:24:27] Context, I'm running a celery job in link-dispenser, but it seems that the redis connection is very flaky causing celery to error out every 2-3 hours [15:46:57] @wm-bb you're not the only one who's experienced redis problems. See https://phabricator.wikimedia.org/T318479 [17:21:44] Is there a way I can check a tools last restart/activity ? [20:17:29] Hi, it seems wikibugs> has stopped reporting since this morning around 6am (uk time) [22:05:58] !log bd808@tools-sgebastion-11 tools.wikibugs toolforge jobs restart redis2irc [22:06:02] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.wikibugs/SAL [22:19:01] @sohom_datta: the most native Kubernetes fix for that redis issue in your continuious job would be to let the worker exit and then be restarted by the scheduler. With something like celery that may be difficult or impossible to configure. The Kubernetes native fix for that is a "liveness check". There is some recent work on that in T341919 for webservice. [22:19:02] T341919: Support probes in kubernetes webservices - https://phabricator.wikimedia.org/T341919 [22:19:41] Once it is available for webservice it would be reasonable to see it added to the jobs system as well. That would be T335592 [22:19:42] T335592: Toolforge jobs: consider having a way for jobs to report their liveness status to kubernetes - https://phabricator.wikimedia.org/T335592 [22:19:56] thanks bd808! [22:20:41] paladox: is it working yet? I haven't seen the bot actually announce anything myself since restart. [22:21:02] Yup! It's working in -dev [22:22:07] cool. I'm working on setting up a bouncer for it today actually as part of T357729 [22:22:08] T357729: wikibugs having a hard time staying connected to libera.chat IRC network - https://phabricator.wikimedia.org/T357729 [22:22:31] oh, nice! [22:26:33] Makes sense, I'll wait until that gets implemented [22:29:18] I have been wondering if a "local" redis container would be helpful for some tools too. [22:31:46] It would be helpful for link-dispenser to have a local redis container :) [23:38:47] !log wikisource on wsexport-prod02 migrated to php-fpm [23:38:51] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Wikisource/SAL