[08:51:03] (InstanceDown) firing: Project tools instance tools-harbor-1 is down - https://prometheus-alerts.wmcloud.org/?q=alertname%3DInstanceDown [08:56:03] (InstanceDown) resolved: Project tools instance tools-harbor-1 is down - https://prometheus-alerts.wmcloud.org/?q=alertname%3DInstanceDown [12:02:38] (CephSlowOps) firing: Ceph cluster in eqiad has 33 slow ops - https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/CephSlowOps - https://grafana.wikimedia.org/d/P1tFnn3Mk/wmcs-ceph-eqiad-health?orgId=1&search=open&tag=ceph&tag=health&tag=WMCS - https://alerts.wikimedia.org/?q=alertname%3DCephSlowOps [12:02:43] 10cloud-services-team: CephSlowOps Ceph cluster in eqiad has slow ops, which might be blocking some writes - https://phabricator.wikimedia.org/T352570 (10phaultfinder) [12:07:37] (CephSlowOps) resolved: Ceph cluster in eqiad has 33 slow ops - https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/CephSlowOps - https://grafana.wikimedia.org/d/P1tFnn3Mk/wmcs-ceph-eqiad-health?orgId=1&search=open&tag=ceph&tag=health&tag=WMCS - https://alerts.wikimedia.org/?q=alertname%3DCephSlowOps [12:30:29] (03CR) 10CI reject: [V: 04-1] Localisation updates from https://translatewiki.net. [labs/tools/commons-mass-description] - 10https://gerrit.wikimedia.org/r/985635 (owner: 10L10n-bot) [12:30:32] (03CR) 10CI reject: [V: 04-1] Localisation updates from https://translatewiki.net. [labs/tools/watch-translations] - 10https://gerrit.wikimedia.org/r/985641 (owner: 10L10n-bot) [14:35:39] 10Grid-Engine-to-K8s-Migration: Migrate cdrbot from Toolforge GridEngine to Toolforge Kubernetes - https://phabricator.wikimedia.org/T319620 (10Muhammed4IT) Hi @Kizule. I'm working to migrate to Kubernetes, I performed this command in my tool, it worked. ` tools.cdrbot@tools-sgebastion-10:~$ pyvenv/bin/python s... [14:39:55] 10Grid-Engine-to-K8s-Migration: Migrate cdrbot from Toolforge GridEngine to Toolforge Kubernetes - https://phabricator.wikimedia.org/T319620 (10taavi) >>! In T319620#9425347, @Muhammed4IT wrote: > Its error log said **`/bin/sh: 1: pyvenv/bin/python: not found`**. How can I solve it? Hi, please see https://wikit... [14:58:12] 10Grid-Engine-to-K8s-Migration: Migrate cdrbot from Toolforge GridEngine to Toolforge Kubernetes - https://phabricator.wikimedia.org/T319620 (10Muhammed4IT) >>! In T319620#9425349, @taavi wrote: >>>! In T319620#9425347, @Muhammed4IT wrote: >> Its error log said **`/bin/sh: 1: pyvenv/bin/python: not found`**. How... [15:08:15] 10Grid-Engine-to-K8s-Migration: Migrate cdrbot from Toolforge GridEngine to Toolforge Kubernetes - https://phabricator.wikimedia.org/T319620 (10taavi) You also need to run the jobs using the same `python3.X` image that was used to create the venv. `--image bullseye` definitely won't work. [16:09:33] 10Grid-Engine-to-K8s-Migration: Migrate cdrbot from Toolforge GridEngine to Toolforge Kubernetes - https://phabricator.wikimedia.org/T319620 (10Muhammed4IT) >>! In T319620#9425352, @taavi wrote: > You also need to run the jobs using the same `python3.X` image that was used to create the venv. `--image bullseye`... [16:44:09] 10Grid-Engine-to-K8s-Migration: Migrate cdrbot from Toolforge GridEngine to Toolforge Kubernetes - https://phabricator.wikimedia.org/T319620 (10JJMC89) Using the shared pywikibot scripts is not supported in k8s. See [[ https://wikitech.wikimedia.org/wiki/Help:Toolforge/Running_Pywikibot_scripts | Help:Toolforge/... [16:46:15] (03CR) 10Nikerabbit: [V: 03+2] Localisation updates from https://translatewiki.net. [labs/tools/watch-translations] - 10https://gerrit.wikimedia.org/r/985641 (owner: 10L10n-bot) [16:46:30] (03CR) 10Nikerabbit: [V: 03+2] Localisation updates from https://translatewiki.net. [labs/tools/commons-mass-description] - 10https://gerrit.wikimedia.org/r/985635 (owner: 10L10n-bot) [16:48:51] (03Abandoned) 10Nikerabbit: Localisation updates from https://translatewiki.net. [labs/tools/commons-mass-description] - 10https://gerrit.wikimedia.org/r/984832 (owner: 10L10n-bot) [17:09:00] (NodeTextfileStale) firing: Stale textfile for cloudcontrol2004-dev:9100 - https://wikitech.wikimedia.org/wiki/Prometheus#Stale_file_for_node-exporter_textfile - https://grafana.wikimedia.org/d/knkl4dCWz/node-exporter-textfile - https://alerts.wikimedia.org/?q=alertname%3DNodeTextfileStale [18:03:48] 10Grid-Engine-to-K8s-Migration: Migrate cdrbot from Toolforge GridEngine to Toolforge Kubernetes - https://phabricator.wikimedia.org/T319620 (10Muhammed4IT) 05Open→03In progress >>! In T319620#9425376, @JJMC89 wrote: > Using the shared pywikibot scripts is not supported in k8s. See [[ https://wikitech.wikime... [21:09:00] (NodeTextfileStale) firing: Stale textfile for cloudcontrol2004-dev:9100 - https://wikitech.wikimedia.org/wiki/Prometheus#Stale_file_for_node-exporter_textfile - https://grafana.wikimedia.org/d/knkl4dCWz/node-exporter-textfile - https://alerts.wikimedia.org/?q=alertname%3DNodeTextfileStale [23:05:19] (HAProxyBackendUnavailable) firing: HAProxy service neutron-api_backend backend cloudcontrol1007.private.eqiad.wikimedia.cloud is down - https://wikitech.wikimedia.org/wiki/HAProxy - TODO - https://alerts.wikimedia.org/?q=alertname%3DHAProxyBackendUnavailable [23:10:19] (HAProxyBackendUnavailable) resolved: HAProxy service neutron-api_backend backend cloudcontrol1007.private.eqiad.wikimedia.cloud is down - https://wikitech.wikimedia.org/wiki/HAProxy - TODO - https://alerts.wikimedia.org/?q=alertname%3DHAProxyBackendUnavailable [23:16:27] 10Grid-Engine-to-K8s-Migration: Migrate botomatik from Toolforge GridEngine to Toolforge Kubernetes - https://phabricator.wikimedia.org/T319603 (10Automatik) 05Open→03Resolved a:03Automatik [23:17:39] 10Grid-Engine-to-K8s-Migration: Migrate botomatik from Toolforge GridEngine to Toolforge Kubernetes - https://phabricator.wikimedia.org/T319603 (10Automatik) I hadn't noticed this task until now (via a "TOOL_DISABLED" file in my tool's root directory). The migration is already done, I closed the task.