[00:10:03] (TfInfraTestApplyFailed) firing: Terraform failed to apply/create the resounces on tf-bastion - https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/TfInfraTestApplyFailed - https://prometheus-alerts.wmcloud.org/?q=alertname%3DTfInfraTestApplyFailed [00:10:07] 10Cloud-VPS, 10Community-Tech, 10WS Export: ssh: Connection closed by UNKNOWN port 65535 - https://phabricator.wikimedia.org/T353999 (10Samwilson) 05Open→03Invalid Ah, understood. Thanks! Nothing to worry about then (we are taking action to reduce the peak loads). It's just that this wasn't happening wit... [00:15:03] (InstanceDown) firing: Project tf-infra-test instance tf-infra-test is down - https://prometheus-alerts.wmcloud.org/?q=alertname%3DInstanceDown [00:20:03] (InstanceDown) resolved: Project tf-infra-test instance tf-infra-test is down - https://prometheus-alerts.wmcloud.org/?q=alertname%3DInstanceDown [01:48:09] 10Grid-Engine-to-K8s-Migration: Migrate mdwiki from Toolforge GridEngine to Toolforge Kubernetes - https://phabricator.wikimedia.org/T319887 (10komla) >>! In T319887#9422578, @Mr.Ibrahem wrote: > We used "jsub" command to start some tasks and now we are using "toolforge-jobs" instead, and it didn't work through... [01:49:35] 10Grid-Engine-to-K8s-Migration: Migrate mathis-bot from Toolforge GridEngine to Toolforge Kubernetes - https://phabricator.wikimedia.org/T319880 (10komla) Thanks! [01:54:34] 10Grid-Engine-to-K8s-Migration: Migrate booster from Toolforge GridEngine to Toolforge Kubernetes - https://phabricator.wikimedia.org/T319600 (10komla) @Edgars2007 if your tool is disabled, it can be enabled by cloud admins. Do you want me to enable it? [01:57:12] 10Grid-Engine-to-K8s-Migration: Migrate dawikitool from Toolforge GridEngine to Toolforge Kubernetes - https://phabricator.wikimedia.org/T319662 (10komla) @Steenth should I go ahead and enable this tool. Please le me know. [02:01:59] 10Grid-Engine-to-K8s-Migration: Migrate unpatrollededitstats from Toolforge GridEngine to Toolforge Kubernetes - https://phabricator.wikimedia.org/T320105 (10komla) @Stang are you still pursuing this adoption? If yes, are there any blockers? [02:07:00] 10Grid-Engine-to-K8s-Migration: Migrate dibot from Toolforge GridEngine to Toolforge Kubernetes - https://phabricator.wikimedia.org/T319676 (10komla) @MBH request to adopt this tool by filing a task using this [[ https://phabricator.wikimedia.org/maniphest/task/edit/form/1/?projects=toolforge-standards-committee... [02:09:32] 10Grid-Engine-to-K8s-Migration: Migrate cdrbot from Toolforge GridEngine to Toolforge Kubernetes - https://phabricator.wikimedia.org/T319620 (10komla) @Muhammed4IT if this issue resolved, mark this ticket as 'resolved'. [02:31:19] 10Toolforge-standards-committee: Adoption request for unpatrollededitstats - https://phabricator.wikimedia.org/T314167 (10Stang) 05Open→03Declined Per comments above, I'm not gonna continue this adoption request. Thanks for the help [02:32:04] 10Grid-Engine-to-K8s-Migration: Migrate unpatrollededitstats from Toolforge GridEngine to Toolforge Kubernetes - https://phabricator.wikimedia.org/T320105 (10Stang) @komla Not running the adoption now, sorry. [02:34:19] (HAProxyBackendUnavailable) firing: HAProxy service neutron-api_backend backend cloudcontrol1007.private.eqiad.wikimedia.cloud is down - https://wikitech.wikimedia.org/wiki/HAProxy - TODO - https://alerts.wikimedia.org/?q=alertname%3DHAProxyBackendUnavailable [02:39:19] (HAProxyBackendUnavailable) resolved: HAProxy service neutron-api_backend backend cloudcontrol1007.private.eqiad.wikimedia.cloud is down - https://wikitech.wikimedia.org/wiki/HAProxy - TODO - https://alerts.wikimedia.org/?q=alertname%3DHAProxyBackendUnavailable [03:10:03] (TfInfraTestApplyFailed) firing: Terraform failed to apply/create the resounces on tf-bastion - https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/TfInfraTestApplyFailed - https://prometheus-alerts.wmcloud.org/?q=alertname%3DTfInfraTestApplyFailed [03:45:43] 10Grid-Engine-to-K8s-Migration, 10User-Huji: Migrate huji from Toolforge GridEngine to Toolforge Kubernetes - https://phabricator.wikimedia.org/T319800 (10Huji) 05In progress→03Resolved [06:10:03] (TfInfraTestApplyFailed) firing: Terraform failed to apply/create the resounces on tf-bastion - https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/TfInfraTestApplyFailed - https://prometheus-alerts.wmcloud.org/?q=alertname%3DTfInfraTestApplyFailed [06:28:29] (03PS1) 10Gergő Tisza: Clean up .gitignore [labs/tools/extjsonuploader] - 10https://gerrit.wikimedia.org/r/986182 [06:43:49] 10Cloud-VPS: Bullseye Cloud VPS hosts show "Your environment specifies an invalid locale." error - https://phabricator.wikimedia.org/T354044 (10Tgr) [08:52:03] (InstanceDown) firing: Project tools instance tools-harbor-1 is down - https://prometheus-alerts.wmcloud.org/?q=alertname%3DInstanceDown [08:57:03] (InstanceDown) resolved: Project tools instance tools-harbor-1 is down - https://prometheus-alerts.wmcloud.org/?q=alertname%3DInstanceDown [09:10:03] (TfInfraTestApplyFailed) firing: Terraform failed to apply/create the resounces on tf-bastion - https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/TfInfraTestApplyFailed - https://prometheus-alerts.wmcloud.org/?q=alertname%3DTfInfraTestApplyFailed [09:28:14] 10Grid-Engine-to-K8s-Migration: Migrate wahrani from Toolforge GridEngine to Toolforge Kubernetes - https://phabricator.wikimedia.org/T320133 (10wahrani) @fnegri yes Kubernetes jobs are active but the tool is disabled from december 20th (TOOL_DISABLED file is present on the tool root directory). When I attempt... [09:46:03] (03CR) 10Samwilson: [C: 03+2] Clean up .gitignore [labs/tools/extjsonuploader] - 10https://gerrit.wikimedia.org/r/986182 (owner: 10Gergő Tisza) [09:46:42] (03Merged) 10jenkins-bot: Clean up .gitignore [labs/tools/extjsonuploader] - 10https://gerrit.wikimedia.org/r/986182 (owner: 10Gergő Tisza) [10:50:04] 10Grid-Engine-to-K8s-Migration: Migrate cdrbot from Toolforge GridEngine to Toolforge Kubernetes - https://phabricator.wikimedia.org/T319620 (10Muhammed4IT) >>! In T319620#9426010, @komla wrote: > @Muhammed4IT if this issue resolved, mark this ticket as 'resolved'. @komla, I schedule jobs with `python3.7`, whic... [12:06:50] 10Grid-Engine-to-K8s-Migration: Migrate cdrbot from Toolforge GridEngine to Toolforge Kubernetes - https://phabricator.wikimedia.org/T319620 (10taavi) >>! In T319620#9426260, @Muhammed4IT wrote: >>>! In T319620#9426010, @komla wrote: >> @Muhammed4IT if this issue resolved, mark this ticket as 'resolved'. > > @k... [12:10:03] (TfInfraTestApplyFailed) firing: Terraform failed to apply/create the resounces on tf-bastion - https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/TfInfraTestApplyFailed - https://prometheus-alerts.wmcloud.org/?q=alertname%3DTfInfraTestApplyFailed [12:12:11] 10Toolforge-standards-committee: Adoption request for kmlexport - https://phabricator.wikimedia.org/T353609 (10DB111) So another 10 days are over, Para has vanished for 3.5 years, no reaction on Dvorapa's home wiki for three weeks, neither on wikitech. [14:48:14] 10PAWS, 10Pywikibot, 10Documentation, 10Pywikibot-Documentation, 10good first task: Move Pywikibot PAWS tutorial out of Jupyter notebook onto wiki - https://phabricator.wikimedia.org/T342397 (10Xqt) Should we merge this with https://www.mediawiki.org/wiki/Manual:Pywikibot/PAWS? [15:09:55] 10Toolforge Build Service: `build delete` gives a confusing error message on a non-existent build - https://phabricator.wikimedia.org/T353583 (10taavi) 05Open→03Resolved a:03taavi [15:10:03] (TfInfraTestApplyFailed) firing: Terraform failed to apply/create the resounces on tf-bastion - https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/TfInfraTestApplyFailed - https://prometheus-alerts.wmcloud.org/?q=alertname%3DTfInfraTestApplyFailed [15:15:09] 10Toolforge (Toolforge iteration 02), 10Toolforge Jobs framework, 10Patch-For-Review: Allow using file logs with build service images - https://phabricator.wikimedia.org/T353537 (10CodeReviewBot) taavi opened https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-cli/-/merge_requests/8 Allow enabling filel... [16:21:47] 10PAWS, 10Pywikibot, 10Documentation, 10Pywikibot-Documentation, 10good first task: Move Pywikibot PAWS tutorial out of Jupyter notebook onto wiki - https://phabricator.wikimedia.org/T342397 (10rook) >>! In T342397#9425726, @Enag2000 wrote: > Moved page out of drafts. New link is [[ https://www.mediawiki... [16:55:24] 10Cloud-VPS (Quota-requests): Add DB quota for Wikiapiary - https://phabricator.wikimedia.org/T354060 (10MarkAHershberger) [18:10:03] (TfInfraTestApplyFailed) firing: Terraform failed to apply/create the resounces on tf-bastion - https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/TfInfraTestApplyFailed - https://prometheus-alerts.wmcloud.org/?q=alertname%3DTfInfraTestApplyFailed [21:10:03] (TfInfraTestApplyFailed) firing: Terraform failed to apply/create the resounces on tf-bastion - https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/TfInfraTestApplyFailed - https://prometheus-alerts.wmcloud.org/?q=alertname%3DTfInfraTestApplyFailed [21:26:27] (OpenstackAPIResponse) firing: Openstack API average response time is too high. - https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/OpenstackAPIResponse - https://grafana.wikimedia.org/d/UUmLqqX4k - https://alerts.wikimedia.org/?q=alertname%3DOpenstackAPIResponse