[00:01:49] (TfInfraTestApplyFailed) firing: Terraform failed to apply/create the resounces on tf-bastion - https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/TfInfraTestApplyFailed - https://prometheus-alerts.wmcloud.org/?q=alertname%3DTfInfraTestApplyFailed [00:11:49] (TfInfraTestApplyFailed) resolved: Terraform failed to apply/create the resounces on tf-bastion - https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/TfInfraTestApplyFailed - https://prometheus-alerts.wmcloud.org/?q=alertname%3DTfInfraTestApplyFailed [00:56:33] 10Toolforge Build Service, 10Documentation: [tbs] Improve Harbor quota handling and docs - https://phabricator.wikimedia.org/T351092 (10Raymond_Ndibe) [00:57:06] 10Toolforge (Toolforge iteration 04), 10Toolforge Build Service, 10User-Raymond_Ndibe: alert users when they are about to exceed their harbor quota - https://phabricator.wikimedia.org/T353535 (10Raymond_Ndibe) 05Stalled→03In progress [00:59:44] 10Toolforge (Toolforge iteration 04), 10Toolforge Build Service, 10User-Raymond_Ndibe: [builds-api] add quota information to NewBuild struct - https://phabricator.wikimedia.org/T356724 (10Raymond_Ndibe) [01:00:21] 10Toolforge (Toolforge iteration 04), 10Toolforge Build Service, 10User-Raymond_Ndibe: [builds-api] add quota information to NewBuild struct - https://phabricator.wikimedia.org/T356724 (10Raymond_Ndibe) @dcaro what's your opinion? anyone is fine by me [01:04:17] 10Toolforge (Toolforge iteration 04): [toolforge-cd] discuss the possibility of removing tests from merge request ci/cd pipelines - https://phabricator.wikimedia.org/T353740 (10Raymond_Ndibe) this seems like something that requires the opinion of everyone. Does this warrant a decision request or we can just disc... [01:11:17] (OpenstackAPIResponse) firing: Openstack API average response time is too high. - https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/OpenstackAPIResponse - https://grafana.wikimedia.org/d/UUmLqqX4k - https://alerts.wikimedia.org/?q=alertname%3DOpenstackAPIResponse [01:22:41] 10Grid-Engine-to-K8s-Migration: Migrate fpcstats from Toolforge GridEngine to Toolforge Kubernetes - https://phabricator.wikimedia.org/T319752 (10mdaniels5757) 05Open→03Resolved This tool doesn't do what I thought it did/what the name implies: it ran UserRightsBot (which I took over a while ago) and some sor... [02:09:15] !log andrew@cloudcumin1001 admin START - Cookbook wmcs.openstack.restart_openstack [02:09:17] !log andrew@cloudcumin1001 admin END (ERROR) - Cookbook wmcs.openstack.restart_openstack (exit_code=97) [02:09:22] !log andrew@cloudcumin1001 admin START - Cookbook wmcs.openstack.restart_openstack [02:11:38] !log andrew@cloudcumin1001 admin END (PASS) - Cookbook wmcs.openstack.restart_openstack (exit_code=0) [04:00:39] 10Toolforge (Toolforge iteration 04), 10Toolforge Build Service, 10User-Raymond_Ndibe: [tbs] Give a meaningful error message when a user exceeds their Harbor quota - https://phabricator.wikimedia.org/T351178 (10Raymond_Ndibe) @dcaro I investigated this task and a number of things came up that I need help mak... [04:35:56] (ProbeDown) firing: Service tools-k8s-haproxy-4:30000 has failed probes (http_admin_toolforge_org_ip4) - https://wikitech.wikimedia.org/wiki/Runbook#tools-k8s-haproxy-4:30000 - https://grafana.wikimedia.org/d/O0nHhdhnz/network-probes-overview?var-job=probes/custom&var-module=All - https://prometheus-alerts.wmcloud.org/?q=alertname%3DProbeDown [04:40:56] (ProbeDown) resolved: Service tools-k8s-haproxy-4:30000 has failed probes (http_admin_toolforge_org_ip4) - https://wikitech.wikimedia.org/wiki/Runbook#tools-k8s-haproxy-4:30000 - https://grafana.wikimedia.org/d/O0nHhdhnz/network-probes-overview?var-job=probes/custom&var-module=All - https://prometheus-alerts.wmcloud.org/?q=alertname%3DProbeDown [05:09:42] (03CR) 10Eugene233: [C: 03+2] Increase limit of new ISA Campaign title length [labs/tools/Isa] - 10https://gerrit.wikimedia.org/r/956462 (https://phabricator.wikimedia.org/T345142) (owner: 10Mh-3110) [05:10:10] (03Merged) 10jenkins-bot: Increase limit of new ISA Campaign title length [labs/tools/Isa] - 10https://gerrit.wikimedia.org/r/956462 (https://phabricator.wikimedia.org/T345142) (owner: 10Mh-3110) [05:11:17] (OpenstackAPIResponse) firing: Openstack API average response time is too high. - https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/OpenstackAPIResponse - https://grafana.wikimedia.org/d/UUmLqqX4k - https://alerts.wikimedia.org/?q=alertname%3DOpenstackAPIResponse [05:20:02] (03CR) 10Eugene233: "Thank you very much for submitting a change to address the footer issue. The change may be addressing some issues not related to the topic" [labs/tools/Isa] - 10https://gerrit.wikimedia.org/r/991815 (owner: 10Josefanthony) [05:21:22] (HAProxyBackendUnavailable) firing: HAProxy service neutron-api_backend backend cloudcontrol1006.private.eqiad.wikimedia.cloud is down - https://wikitech.wikimedia.org/wiki/HAProxy - TODO - https://alerts.wikimedia.org/?q=alertname%3DHAProxyBackendUnavailable [05:26:22] (HAProxyBackendUnavailable) resolved: HAProxy service neutron-api_backend backend cloudcontrol1006.private.eqiad.wikimedia.cloud is down - https://wikitech.wikimedia.org/wiki/HAProxy - TODO - https://alerts.wikimedia.org/?q=alertname%3DHAProxyBackendUnavailable [05:27:28] (03CR) 10Eugene233: "Thank you very much for submitting a fix. Please review the comments." [labs/tools/Isa] - 10https://gerrit.wikimedia.org/r/995348 (owner: 10AgnesAbah) [05:34:43] (03CR) 10Eugene233: "Thanks for submitting a change to fix this issue. Please see the comments." [labs/tools/Isa] - 10https://gerrit.wikimedia.org/r/994376 (owner: 10Josefanthony) [05:38:46] (03CR) 10Eugene233: "Does this change address the same issue as 995348" [labs/tools/Isa] - 10https://gerrit.wikimedia.org/r/991814 (owner: 10Josefanthony) [05:39:35] (03CR) 10Eugene233: "I meant https://gerrit.wikimedia.org/r/c/labs/tools/Isa/+/995348" [labs/tools/Isa] - 10https://gerrit.wikimedia.org/r/991814 (owner: 10Josefanthony) [06:44:56] (ProbeDown) firing: Service tools-k8s-haproxy-3:30000 has failed probes (http_admin_toolforge_org_ip4) - https://wikitech.wikimedia.org/wiki/Runbook#tools-k8s-haproxy-3:30000 - https://grafana.wikimedia.org/d/O0nHhdhnz/network-probes-overview?var-job=probes/custom&var-module=All - https://prometheus-alerts.wmcloud.org/?q=alertname%3DProbeDown [06:49:56] (ProbeDown) resolved: Service tools-k8s-haproxy-3:30000 has failed probes (http_admin_toolforge_org_ip4) - https://wikitech.wikimedia.org/wiki/Runbook#tools-k8s-haproxy-3:30000 - https://grafana.wikimedia.org/d/O0nHhdhnz/network-probes-overview?var-job=probes/custom&var-module=All - https://prometheus-alerts.wmcloud.org/?q=alertname%3DProbeDown [07:29:56] (ProbeDown) firing: Service tools-k8s-haproxy-3:30000 has failed probes (http_admin_toolforge_org_ip4) - https://wikitech.wikimedia.org/wiki/Runbook#tools-k8s-haproxy-3:30000 - https://grafana.wikimedia.org/d/O0nHhdhnz/network-probes-overview?var-job=probes/custom&var-module=All - https://prometheus-alerts.wmcloud.org/?q=alertname%3DProbeDown [07:34:56] (ProbeDown) resolved: Service tools-k8s-haproxy-3:30000 has failed probes (http_admin_toolforge_org_ip4) - https://wikitech.wikimedia.org/wiki/Runbook#tools-k8s-haproxy-3:30000 - https://grafana.wikimedia.org/d/O0nHhdhnz/network-probes-overview?var-job=probes/custom&var-module=All - https://prometheus-alerts.wmcloud.org/?q=alertname%3DProbeDown [07:58:56] (ProbeDown) firing: (2) Service tools-k8s-haproxy-3:30000 has failed probes (http_admin_toolforge_org_ip4) - https://grafana.wikimedia.org/d/O0nHhdhnz/network-probes-overview?var-job=probes/custom&var-module=All - https://prometheus-alerts.wmcloud.org/?q=alertname%3DProbeDown [08:03:56] (ProbeDown) resolved: (2) Service tools-k8s-haproxy-3:30000 has failed probes (http_admin_toolforge_org_ip4) - https://grafana.wikimedia.org/d/O0nHhdhnz/network-probes-overview?var-job=probes/custom&var-module=All - https://prometheus-alerts.wmcloud.org/?q=alertname%3DProbeDown [08:08:56] (ProbeDown) firing: Service tools-k8s-haproxy-3:30000 has failed probes (http_admin_toolforge_org_ip4) - https://wikitech.wikimedia.org/wiki/Runbook#tools-k8s-haproxy-3:30000 - https://grafana.wikimedia.org/d/O0nHhdhnz/network-probes-overview?var-job=probes/custom&var-module=All - https://prometheus-alerts.wmcloud.org/?q=alertname%3DProbeDown [08:13:56] (ProbeDown) resolved: Service tools-k8s-haproxy-3:30000 has failed probes (http_admin_toolforge_org_ip4) - https://wikitech.wikimedia.org/wiki/Runbook#tools-k8s-haproxy-3:30000 - https://grafana.wikimedia.org/d/O0nHhdhnz/network-probes-overview?var-job=probes/custom&var-module=All - https://prometheus-alerts.wmcloud.org/?q=alertname%3DProbeDown [08:13:58] 10Grid-Engine-to-K8s-Migration, 10Wiki-Loves-Monuments-Database: Migrate heritage from Toolforge GridEngine to Toolforge Kubernetes - https://phabricator.wikimedia.org/T319787 (10Lokal_Profil) >>! In T319787#9462161, @dcaro wrote: > As far as I can see it's jstop/jsub of that other job. > > I would recommend... [08:19:56] (ProbeDown) firing: Service tools-k8s-haproxy-4:30000 has failed probes (http_admin_toolforge_org_ip4) - https://wikitech.wikimedia.org/wiki/Runbook#tools-k8s-haproxy-4:30000 - https://grafana.wikimedia.org/d/O0nHhdhnz/network-probes-overview?var-job=probes/custom&var-module=All - https://prometheus-alerts.wmcloud.org/?q=alertname%3DProbeDown [08:24:56] (ProbeDown) resolved: Service tools-k8s-haproxy-4:30000 has failed probes (http_admin_toolforge_org_ip4) - https://wikitech.wikimedia.org/wiki/Runbook#tools-k8s-haproxy-4:30000 - https://grafana.wikimedia.org/d/O0nHhdhnz/network-probes-overview?var-job=probes/custom&var-module=All - https://prometheus-alerts.wmcloud.org/?q=alertname%3DProbeDown [08:57:56] (ProbeDown) firing: Service tools-k8s-haproxy-3:30000 has failed probes (http_admin_toolforge_org_ip4) - https://wikitech.wikimedia.org/wiki/Runbook#tools-k8s-haproxy-3:30000 - https://grafana.wikimedia.org/d/O0nHhdhnz/network-probes-overview?var-job=probes/custom&var-module=All - https://prometheus-alerts.wmcloud.org/?q=alertname%3DProbeDown [09:02:56] (ProbeDown) resolved: Service tools-k8s-haproxy-3:30000 has failed probes (http_admin_toolforge_org_ip4) - https://wikitech.wikimedia.org/wiki/Runbook#tools-k8s-haproxy-3:30000 - https://grafana.wikimedia.org/d/O0nHhdhnz/network-probes-overview?var-job=probes/custom&var-module=All - https://prometheus-alerts.wmcloud.org/?q=alertname%3DProbeDown [09:11:17] (OpenstackAPIResponse) firing: Openstack API average response time is too high. - https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/OpenstackAPIResponse - https://grafana.wikimedia.org/d/UUmLqqX4k - https://alerts.wikimedia.org/?q=alertname%3DOpenstackAPIResponse [10:21:06] 10Toolforge (Toolforge iteration 04), 10Toolforge Build Service, 10User-Raymond_Ndibe: [tbs] Give a meaningful error message when a user exceeds their Harbor quota - https://phabricator.wikimedia.org/T351178 (10dcaro) >>! In T351178#9515940, @Raymond_Ndibe wrote: > @dcaro I investigated this task and a numbe... [10:33:23] 10Toolforge (Toolforge iteration 04): [toolforge-cd] discuss the possibility of removing tests from merge request ci/cd pipelines - https://phabricator.wikimedia.org/T353740 (10dcaro) >>! In T353740#9515812, @Raymond_Ndibe wrote: > this seems like something that requires the opinion of everyone. Does this warran... [10:41:47] !log aborrero@cloudcumin1001 toolsbeta START - Cookbook wmcs.toolforge.k8s.reboot for all nodes (T356507) [10:50:38] (ProbeDown) firing: Service toolsbeta-test-k8s-haproxy-3:30000 has failed probes (http_this_tool_does_not_exist_beta_toolforge_org_ip4) - https://wikitech.wikimedia.org/wiki/Runbook#toolsbeta-test-k8s-haproxy-3:30000 - https://grafana.wikimedia.org/d/O0nHhdhnz/network-probes-overview?var-job=probes/custom&var-module=All - https://prometheus-alerts.wmcloud.org/?q=alertname%3DProbeDown [10:55:38] (ProbeDown) firing: (4) Service toolsbeta-test-k8s-haproxy-3:30000 has failed probes (http_admin_beta_toolforge_org_ip4) - https://grafana.wikimedia.org/d/O0nHhdhnz/network-probes-overview?var-job=probes/custom&var-module=All - https://prometheus-alerts.wmcloud.org/?q=alertname%3DProbeDown [10:57:33] 10Toolforge (Toolforge iteration 04), 10Toolforge Jobs framework, 10Patch-For-Review: [jobs-api] Migrate to Gunicorn - https://phabricator.wikimedia.org/T354752 (10CodeReviewBot) taavi merged https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-api/-/merge_requests/55 build: Use Gunicorn instead of uWSGI [10:58:58] !log aborrero@cloudcumin1001 toolsbeta END (PASS) - Cookbook wmcs.toolforge.k8s.reboot (exit_code=0) for all nodes (T356507) [10:59:56] 10Toolforge (Toolforge iteration 04), 10Toolforge Jobs framework, 10Patch-For-Review: [jobs-api] Migrate to Gunicorn - https://phabricator.wikimedia.org/T354752 (10CodeReviewBot) project_1317_bot_df3177307bed93c3f34e421e26c86e38 opened https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/mer... [11:00:11] 10Toolforge (Toolforge iteration 04), 10Toolforge Jobs framework: [jobs-api] Migrate to Poetry - https://phabricator.wikimedia.org/T354751 (10CodeReviewBot) taavi merged https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-api/-/merge_requests/53 build: Migrate to Poetry [11:00:38] (ProbeDown) resolved: (2) Service toolsbeta-test-k8s-haproxy-3:30000 has failed probes (http_admin_beta_toolforge_org_ip4) - https://grafana.wikimedia.org/d/O0nHhdhnz/network-probes-overview?var-job=probes/custom&var-module=All - https://prometheus-alerts.wmcloud.org/?q=alertname%3DProbeDown [11:03:19] (03CR) 10Ladsgroup: "Here or gitlab now?" [labs/libraryupgrader] - 10https://gerrit.wikimedia.org/r/997333 (https://phabricator.wikimedia.org/T356565) (owner: 10Ladsgroup) [11:08:01] 10Cloud-Services, 10cloud-services-team, 10GLAM, 10SDC General, 10Wikidata: Wikimedia Cloud Services support for contribution from the IGN to Structured Data on Commons - https://phabricator.wikimedia.org/T195121 (10Olea) The #Cloud-Services project tag is not intended to have any tasks. Please check the... [11:16:46] !log aborrero@cloudcumin1001 tools START - Cookbook wmcs.toolforge.k8s.reboot for all nodes (T356507) [11:23:28] (InstanceDown) firing: Project tools instance tools-k8s-worker-nfs-9 is down - https://prometheus-alerts.wmcloud.org/?q=alertname%3DInstanceDown [11:28:28] (InstanceDown) resolved: Project tools instance tools-k8s-worker-nfs-9 is down - https://prometheus-alerts.wmcloud.org/?q=alertname%3DInstanceDown [11:32:53] 10Toolforge (Toolforge iteration 04), 10Toolforge Build Service, 10User-Raymond_Ndibe: [builds-api] add quota information to NewBuild struct - https://phabricator.wikimedia.org/T356724 (10dcaro) Can you elaborate? What is the workflow that you imagine to alert users? I'm guessing something like show a warn... [11:43:10] 10Toolforge (Toolforge iteration 04), 10Toolforge Jobs framework: [jobs-api] Migrate to Poetry - https://phabricator.wikimedia.org/T354751 (10CodeReviewBot) taavi merged https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/188 jobs-api: bump to 0.0.260-20240206105734-0c0aa1f9 [11:43:16] 10Toolforge (Toolforge iteration 04), 10Toolforge Jobs framework, 10Patch-For-Review: [jobs-api] Migrate to Gunicorn - https://phabricator.wikimedia.org/T354752 (10CodeReviewBot) taavi merged https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/188 jobs-api: bump to 0.0.260-2... [11:43:33] !log taavi@cloudcumin1001 toolsbeta START - Cookbook wmcs.toolforge.k8s.component.deploy for component jobs-api [11:43:49] !log taavi@cloudcumin1001 toolsbeta END (PASS) - Cookbook wmcs.toolforge.k8s.component.deploy (exit_code=0) for component jobs-api [11:46:27] 10Grid-Engine-to-K8s-Migration, 10Wiki-Loves-Monuments-Database: Migrate heritage from Toolforge GridEngine to Toolforge Kubernetes - https://phabricator.wikimedia.org/T319787 (10dcaro) >>! In T319787#9516122, @Lokal_Profil wrote: >>>! In T319787#9462161, @dcaro wrote: >> As far as I can see it's jstop/jsub of... [11:50:00] !log taavi@cloudcumin1001 tools START - Cookbook wmcs.toolforge.k8s.component.deploy for component jobs-api [11:50:17] !log taavi@cloudcumin1001 tools END (PASS) - Cookbook wmcs.toolforge.k8s.component.deploy (exit_code=0) for component jobs-api [11:50:42] 10Toolforge (Toolforge iteration 04), 10Toolforge Jobs framework: [jobs-api] Migrate to Poetry - https://phabricator.wikimedia.org/T354751 (10taavi) 05Open→03Resolved [11:50:53] 10Toolforge (Toolforge iteration 04), 10Toolforge Jobs framework, 10Patch-For-Review: [jobs-api] Migrate to Gunicorn - https://phabricator.wikimedia.org/T354752 (10taavi) 05Open→03Resolved [11:54:17] 10Grid-Engine-to-K8s-Migration: Migrate huggle from Toolforge GridEngine to Toolforge Kubernetes - https://phabricator.wikimedia.org/T319797 (10Petrb) Hello, I would like to explain what is this being used for right now and confirm that shutdown of this service is not critical for Huggle operation: There are h... [11:55:18] 10Grid-Engine-to-K8s-Migration: Migrate krdbot from Toolforge GridEngine to Toolforge Kubernetes - https://phabricator.wikimedia.org/T319847 (10dcaro) >>! In T319847#9513361, @Krd wrote: > Feel free to look into my code, but I don't like to publish that. I understand if you are reticent to publish the code, but... [11:58:22] 10Grid-Engine-to-K8s-Migration: Migrate jembot from Toolforge GridEngine to Toolforge Kubernetes - https://phabricator.wikimedia.org/T319828 (10dcaro) No problem :) If you need specific packages installed that are not there in the pre-built images, you can use the build service image (https://wikitech.wikimedia... [12:01:48] 10Grid-Engine-to-K8s-Migration: Migrate huggle from Toolforge GridEngine to Toolforge Kubernetes - https://phabricator.wikimedia.org/T319797 (10Petrb) I found this related merge request in Huggle repo - https://github.com/huggle/huggle3-qt-lx/pull/351 where @Se4598 updated the updater URL from / to ` this->qDat... [12:08:53] 10Cloud-VPS, 10cloud-services-team (FY2023/2024-Q3-Q4), 10Cloud-Services-Origin-Alert, 10Cloud-Services-Worktype-Unplanned, and 2 others: [nova-api,cloudrabbit] Connectivity issues from all cloudcontrols to all cloudrabbit nodes - https://phabricator.wikimedia.org/T356621 (10taavi) [12:12:27] 10Grid-Engine-to-K8s-Migration: Migrate jembot from Toolforge GridEngine to Toolforge Kubernetes - https://phabricator.wikimedia.org/T319828 (10-jem-) Yes, I was told about that possibility in IRC, but if I remember well, it would require using Gitlab for the code and a deep change in my work dynamics, which I c... [13:00:22] 10PAWS: Backup prometheus - https://phabricator.wikimedia.org/T356769 (10rook) [13:06:56] (ProbeDown) firing: (2) Service tools-k8s-haproxy-3:30000 has failed probes (http_admin_toolforge_org_ip4) - https://grafana.wikimedia.org/d/O0nHhdhnz/network-probes-overview?var-job=probes/custom&var-module=All - https://prometheus-alerts.wmcloud.org/?q=alertname%3DProbeDown [13:08:40] !log aborrero@cloudcumin1001 tools END (PASS) - Cookbook wmcs.toolforge.k8s.reboot (exit_code=0) for all nodes (T356507) [13:11:17] (OpenstackAPIResponse) firing: Openstack API average response time is too high. - https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/OpenstackAPIResponse - https://grafana.wikimedia.org/d/UUmLqqX4k - https://alerts.wikimedia.org/?q=alertname%3DOpenstackAPIResponse [13:11:56] (ProbeDown) resolved: (4) Service tools-k8s-haproxy-3:30000 has failed probes (http_admin_toolforge_org_ip4) - https://grafana.wikimedia.org/d/O0nHhdhnz/network-probes-overview?var-job=probes/custom&var-module=All - https://prometheus-alerts.wmcloud.org/?q=alertname%3DProbeDown [13:27:39] 10cloud-services-team (FY2023/2024-Q3-Q4), 10Cloud-Services-Origin-Alert, 10Cloud-Services-Worktype-Unplanned, 10User-dcaro: [nova-api,cloudrabbit] Connectivity issues from all cloudcontrols to all cloudrabbit nodes - https://phabricator.wikimedia.org/T356621 (10dcaro) I think that the duplicated packages... [13:41:06] 10Toolforge (Toolforge iteration 04), 10Toolforge Build Service: [harbor] upgrade to 2.10.x - https://phabricator.wikimedia.org/T354507 (10dcaro) [13:51:11] 10Toolforge (Toolforge iteration 04), 10cloud-services-team, 10Kubernetes, 10Patch-For-Review: Create Bookworm-based standalone webservice image - https://phabricator.wikimedia.org/T355231 (10taavi) >>! In T355231#9493711, @fnegri wrote: > * Do we need both `bookworm-web` and `bookworm-standalone`? For whi... [13:52:12] 10Toolforge Jobs framework: Facilitate one-off execution of scheduled jobs - https://phabricator.wikimedia.org/T356580 (10taavi) `toolforge jobs restart` already does this, although that is not documented at the moment. [13:53:29] 10Toolforge Jobs framework: Add a new output format for toolforge jobs list command which returns the input command for scheduled jobs - https://phabricator.wikimedia.org/T356581 (10taavi) Would {T320575} be enough for this use case? I think we should encourage YAML+Git managed configurations instead of manual `... [13:53:51] 10Cloud-VPS, 10Toolforge (Toolforge iteration 04), 10cloud-services-team: Ensure Toolforge and Cloud VPS comply with Google's new email sender guidelines - https://phabricator.wikimedia.org/T354112 (10taavi) 05In progress→03Resolved [13:55:05] (03CR) 10Josefanthony: "yes, we are only testing our first commit to Gerrit" [labs/tools/Isa] - 10https://gerrit.wikimedia.org/r/991814 (owner: 10Josefanthony) [13:55:44] 10Toolforge (Toolforge iteration 04), 10Toolforge Jobs framework, 10Patch-For-Review: Allow using file logs with build service images - https://phabricator.wikimedia.org/T353537 (10taavi) a:05taavi→03None Not working on this ATM, feel free to take this. [13:59:21] 10Toolforge, 10cloud-services-team: Upgrade Toolforge mail server to Debian Bullseye or later - https://phabricator.wikimedia.org/T311910 (10taavi) 05Open→03Resolved [13:59:27] 10Cloud-VPS (Debian Buster Deprecation), 10Toolforge, 10cloud-services-team (FY2023/2024-Q3-Q4), 10Epic, 10Goal: Toolforge: migrate to Debian Bullseye or later - https://phabricator.wikimedia.org/T311897 (10taavi) [13:59:32] 10Toolforge (Toolforge iteration 04), 10cloud-services-team, 10Patch-For-Review: Enable ARC support in Toolforge - https://phabricator.wikimedia.org/T356171 (10taavi) [14:14:54] (03Abandoned) 10Jforrester: Always compress text blobs [labs/libraryupgrader] - 10https://gerrit.wikimedia.org/r/997333 (https://phabricator.wikimedia.org/T356565) (owner: 10Ladsgroup) [14:15:12] (03Abandoned) 10Jforrester: runner: Stop trying to migrate to es5 eslint profile [labs/libraryupgrader] - 10https://gerrit.wikimedia.org/r/997512 (https://phabricator.wikimedia.org/T356656) (owner: 10Majavah) [14:15:17] (03Abandoned) 10Jforrester: runner: Use pathlib in most places where possible [labs/libraryupgrader] - 10https://gerrit.wikimedia.org/r/759863 (owner: 10Legoktm) [14:15:21] (03Abandoned) 10Jforrester: Diff package-lock.json to get list of changes, but in Rust [labs/libraryupgrader] - 10https://gerrit.wikimedia.org/r/761579 (owner: 10Legoktm) [14:15:27] (03Abandoned) 10Jforrester: [WIP] Begin moving fixers to "tasks" [labs/libraryupgrader] - 10https://gerrit.wikimedia.org/r/687990 (owner: 10Legoktm) [14:15:31] (03Abandoned) 10Jforrester: [WIP] Tests for drop 'rules' definition from eslint and stylelint when empty [labs/libraryupgrader] - 10https://gerrit.wikimedia.org/r/644384 (owner: 10Legoktm) [14:15:37] (03Abandoned) 10Jforrester: Update Runner to Bookworm / Python 3.11 / Node 18 / Npm 9 [labs/libraryupgrader] - 10https://gerrit.wikimedia.org/r/997442 (https://phabricator.wikimedia.org/T356595) (owner: 10Majavah) [14:22:23] (03CR) 10Jforrester: "We made this repo RO yesterday, sorry; I've now abandoned all outstanding patches." [labs/libraryupgrader] - 10https://gerrit.wikimedia.org/r/997333 (https://phabricator.wikimedia.org/T356565) (owner: 10Ladsgroup) [14:38:05] 10Toolforge (Toolforge iteration 04), 10User-Raymond_Ndibe: [toolforge-cd] find out why we run two gitlab ci/cd pipelines after merge - https://phabricator.wikimedia.org/T353563 (10dcaro) The difference is in the trigger, one was triggered by the push to main, and the other by the tag creation (due to the rele... [14:40:19] 10Toolforge Jobs framework, 10Patch-For-Review: Allow using file logs with build service images - https://phabricator.wikimedia.org/T353537 (10dcaro) [14:42:53] 10Toolforge Build Service: [apt-buildpack] Installed python scripts with a hardcoded shebang to the python binary will not work when installing new pythons - https://phabricator.wikimedia.org/T356500 (10dcaro) [14:44:12] 10Toolforge (Toolforge iteration 04), 10User-aborrero: [toolforge API] Investigate ways to present our openapi definitions to users - https://phabricator.wikimedia.org/T354745 (10dcaro) p:05Triage→03High [14:49:33] 10Toolforge (Toolforge iteration 04), 10Toolforge Build Service: [tbs] Add dashboards with the new statistics - https://phabricator.wikimedia.org/T352764 (10dcaro) p:05Triage→03Medium [14:56:21] (03PS1) 10Josefanthony: worked on footer appears at the bottom [labs/tools/Isa] - 10https://gerrit.wikimedia.org/r/997831 [14:56:43] 10Toolforge (Toolforge iteration 04), 10Toolforge Build Service, 10cloud-services-team (FY2023/2024-Q3-Q4): [tbs] Add dashboards with the new statistics - https://phabricator.wikimedia.org/T352764 (10fnegri) a:03fnegri [14:58:05] 10Toolforge (Toolforge iteration 04), 10cloud-services-team (FY2023/2024-Q3-Q4), 10Cloud-Services-Origin-User, 10Cloud-Services-Worktype-Maintenance, 10User-dcaro: [webservice] Error shown when restarting buildpack-based tool - https://phabricator.wikimedia.org/T348312 (10dcaro) I'll try to reproduce, se... [15:06:39] 10Toolforge, 10cloud-services-team: Toolforge: Ensure long-running Kubernetes pods get container updates applied - https://phabricator.wikimedia.org/T314705 (10dcaro) I think we could try to define some policy here first, something along the lines: * If you opt-in, your application (ex. job/webservice) will b... [15:11:40] (03PS2) 10Josefanthony: worked on footer appears at the bottom [labs/tools/Isa] - 10https://gerrit.wikimedia.org/r/997831 [15:14:11] 10Toolforge: Tool (k8s-status or a new one) to display details about buildservice pipelines and Harbor images - https://phabricator.wikimedia.org/T336133 (10dcaro) p:05Triage→03Low [15:23:04] 10Toolforge: Create sqldump script for Toolforge shell - https://phabricator.wikimedia.org/T151680 (10dcaro) 05Open→03Declined Closing this task as the last comment is quite old and does not seem to be a subject that pops up often, if there's still interest in such a script, feel free to open a new one/reope... [15:24:32] 10Cloud-VPS, 10Toolforge: define a prebaked way to temporarily disable access for a user or Tool - https://phabricator.wikimedia.org/T147242 (10dcaro) @Andrew Does your script solve that issue? (or a slightly modified version of it) Maybe we just need to document it :) [15:30:14] 10Toolforge, 10cloud-services-team: [tools] Backup/provide HA for the puppetmaster private repo - https://phabricator.wikimedia.org/T145883 (10dcaro) [15:34:21] 10Toolforge, 10cloud-services-team, 10wikimedia-irc-libera: Libera Chat may throttle bot connections from tools - https://phabricator.wikimedia.org/T151704 (10dcaro) 05Open→03Resolved a:03dcaro I think we can close this in favor the one @bd808 mentioned ({T278584}), and continue the work there (no need... [15:38:58] 10Data-Services, 10Toolforge, 10Documentation: Document all tables missing in replicas - https://phabricator.wikimedia.org/T139289 (10dcaro) 05Open→03Resolved a:03dcaro Closing for now, there's no meaningful activity for the last few years, and there's some documented tables here https://wikitech.wikim... [15:39:04] 10Data-Services, 10DBA, 10Tracking-Neverending: Wikireplica service for tools and labs - issues and missing available views (tracking) - https://phabricator.wikimedia.org/T150767 (10dcaro) [15:57:59] 10Data-Services, 10cloud-services-team (FY2023/2024-Q3-Q4), 10Goal: [toolsdb] test creating a new replica host - https://phabricator.wikimedia.org/T344717 (10fnegri) I'm setting up `tools-db-3` to be a new replica, and improving the [wiki](https://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Toolsd... [16:26:26] (03CR) 10FNegri: [C: 03+1] Provide a standalone bookworm-web container [docker-images/toollabs-images] - 10https://gerrit.wikimedia.org/r/991595 (https://phabricator.wikimedia.org/T355231) (owner: 10Majavah) [16:37:52] 10Toolforge (Toolforge iteration 04), 10cloud-services-team, 10Kubernetes, 10Patch-For-Review: Create Bookworm-based standalone webservice image - https://phabricator.wikimedia.org/T355231 (10fnegri) Thanks for the clarification, I have +1'd the patch. It would be nice to document in wikitech the available... [17:11:17] (OpenstackAPIResponse) firing: Openstack API average response time is too high. - https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/OpenstackAPIResponse - https://grafana.wikimedia.org/d/UUmLqqX4k - https://alerts.wikimedia.org/?q=alertname%3DOpenstackAPIResponse [17:21:47] 10cloud-services-team (FY2023/2024-Q3-Q4), 10Cloud-Services-Origin-Alert, 10Cloud-Services-Worktype-Unplanned, 10Patch-For-Review, 10User-dcaro: [nova-api,cloudrabbit] Connectivity issues from all cloudcontrols to all cloudrabbit nodes - https://phabricator.wikimedia.org/T356621 (10dcaro) [17:38:23] (HAProxyBackendUnavailable) firing: (2) HAProxy service keystone-admin-api_backend backend cloudcontrol1005.private.eqiad.wikimedia.cloud is down - https://wikitech.wikimedia.org/wiki/HAProxy - TODO - https://alerts.wikimedia.org/?q=alertname%3DHAProxyBackendUnavailable [17:43:22] (HAProxyBackendUnavailable) resolved: (4) HAProxy service keystone-admin-api_backend backend cloudcontrol1005.private.eqiad.wikimedia.cloud is down - https://wikitech.wikimedia.org/wiki/HAProxy - TODO - https://alerts.wikimedia.org/?q=alertname%3DHAProxyBackendUnavailable [17:43:30] 10Toolforge (Toolforge iteration 05), 10Toolforge Build Service, 10User-Raymond_Ndibe: [builds-api] add quota information to NewBuild struct - https://phabricator.wikimedia.org/T356724 (10dcaro) [17:43:35] 10Toolforge (Toolforge iteration 05), 10Toolforge Jobs framework, 10User-aborrero: toolforge: introduce OpenAPI to jobs framework - https://phabricator.wikimedia.org/T356523 (10dcaro) [17:43:41] 10Toolforge (Toolforge iteration 05), 10User-aborrero: [toolforge] allow calling the different toolforge apis from within the containers - https://phabricator.wikimedia.org/T356377 (10dcaro) [17:43:47] 10Toolforge (Toolforge iteration 05), 10Epic: Consolidate the Toolforge CLIs - https://phabricator.wikimedia.org/T356262 (10dcaro) [17:43:52] 10Toolforge (Toolforge iteration 05): [Toolforge CLI consolidation] Explore OpenAPI tooling - https://phabricator.wikimedia.org/T356261 (10dcaro) [17:43:56] 10Toolforge (Toolforge iteration 05), 10User-aborrero: [toolforge API] Investigate ways to present our openapi definitions to users - https://phabricator.wikimedia.org/T354745 (10dcaro) [17:44:01] 10Toolforge (Toolforge iteration 05): [toolforge-cd] discuss the possibility of removing tests from merge request ci/cd pipelines - https://phabricator.wikimedia.org/T353740 (10dcaro) [17:44:07] 10Toolforge (Toolforge iteration 05), 10Toolforge Build Service, 10cloud-services-team (FY2023/2024-Q3-Q4): [tbs] Create a tutorial on how to deploy a Node.js app using Build Service - https://phabricator.wikimedia.org/T353313 (10dcaro) [17:44:12] 10Toolforge (Toolforge iteration 05), 10Toolforge Build Service: [maintain-harbor] Improvements to subcommands and config validation - https://phabricator.wikimedia.org/T353059 (10dcaro) [17:44:18] 10Toolforge (Toolforge iteration 05), 10Toolforge Build Service, 10cloud-services-team (FY2023/2024-Q3-Q4): [tbs] Add dashboards with the new statistics - https://phabricator.wikimedia.org/T352764 (10dcaro) [17:44:23] 10Toolforge (Toolforge iteration 05), 10Toolforge Build Service: [tbs] cleanup robot account related code - https://phabricator.wikimedia.org/T352763 (10dcaro) [17:44:28] 10Toolforge (Toolforge iteration 05), 10Toolforge Build Service, 10User-Raymond_Ndibe: [tbs] Give a meaningful error message when a user exceeds their Harbor quota - https://phabricator.wikimedia.org/T351178 (10dcaro) [17:44:34] 10Toolforge (Toolforge iteration 05), 10cloud-services-team (FY2023/2024-Q3-Q4), 10Cloud-Services-Origin-User, 10Cloud-Services-Worktype-Maintenance, 10User-dcaro: [webservice] Error shown when restarting buildpack-based tool - https://phabricator.wikimedia.org/T348312 (10dcaro) [17:45:22] 10Toolforge (Toolforge iteration 05), 10Toolforge Build Service, 10User-Raymond_Ndibe: alert users when they are about to exceed their harbor quota - https://phabricator.wikimedia.org/T353535 (10dcaro) [17:45:48] 10Toolforge (Toolforge iteration 05): [toolforge-cd] gitlab-ci refactor - https://phabricator.wikimedia.org/T353514 (10dcaro) [17:45:52] 10Toolforge (Toolforge iteration 05), 10User-Raymond_Ndibe: [toolforge-cd] find out why we run two gitlab ci/cd pipelines after merge - https://phabricator.wikimedia.org/T353563 (10dcaro) [17:46:01] 10Toolforge (Toolforge iteration 05), 10Toolforge Build Service: `build quota` fails if tool has no builds - https://phabricator.wikimedia.org/T353701 (10dcaro) [17:46:04] 10Toolforge (Toolforge iteration 05), 10User-aborrero: [toolforge] several tools get periods of connection refused (104) when connecting to wikis - https://phabricator.wikimedia.org/T356164 (10dcaro) [17:46:33] 10Toolforge (Toolforge iteration 05), 10Toolforge Build Service, 10Cloud-Services-Origin-Team, 10Cloud-Services-Worktype-Project, 10User-dcaro: [tbs.maintain-harbor] Document current setup and admin procedures - https://phabricator.wikimedia.org/T329176 (10dcaro) [17:46:42] 10Toolforge (Toolforge iteration 05), 10Toolforge Build Service: [harbor] upgrade to 2.10.x - https://phabricator.wikimedia.org/T354507 (10dcaro) [17:46:44] 10Toolforge (Toolforge iteration 05), 10Toolforge Build Service, 10Patch-For-Review, 10Upstream: [maintain-harbor] Manage project quotas via maintain-harbor - https://phabricator.wikimedia.org/T352417 (10dcaro) [17:46:53] 10Toolforge (Toolforge iteration 05), 10Toolforge Build Service, 10cloud-services-team, 10Cloud-Services-Origin-Team, and 2 others: [builds-api] Automatically deploy the webservice when the image is built - https://phabricator.wikimedia.org/T341065 (10dcaro) [17:47:00] 10Toolforge (Toolforge iteration 05), 10cloud-services-team, 10Kubernetes, 10Patch-For-Review: Toolforge k8s: Migrate workers to Containerd and Bookworm - https://phabricator.wikimedia.org/T284656 (10dcaro) [17:47:11] 10Toolforge (Toolforge iteration 05): Toolforge next user stories - 2024 version - https://phabricator.wikimedia.org/T352857 (10dcaro) [17:47:38] 10Toolforge (Toolforge iteration 05): Toolforge next user stories - 2024 version - https://phabricator.wikimedia.org/T352857 (10dcaro) 05In progress→03Resolved [17:48:22] 10Toolforge (Toolforge iteration 05), 10Toolforge Build Service, 10Patch-For-Review: [tbs][builds-api] Refactor `internal/builds.go` - https://phabricator.wikimedia.org/T352762 (10dcaro) [17:48:25] 10Toolforge (Toolforge iteration 05), 10cloud-services-team, 10Kubernetes, 10Patch-For-Review: Create Bookworm-based standalone webservice image - https://phabricator.wikimedia.org/T355231 (10dcaro) [19:11:10] (03PS1) 10Anne Tomasevich: releases: Bump Codex to 1.3.2 [labs/libraryupgrader/config] - 10https://gerrit.wikimedia.org/r/997946 [19:26:14] (03CR) 10Eric Gardner: [C: 03+2] releases: Bump Codex to 1.3.2 [labs/libraryupgrader/config] - 10https://gerrit.wikimedia.org/r/997946 (owner: 10Anne Tomasevich) [19:26:20] 10Grid-Engine-to-K8s-Migration, 10Growth-Team: Migrate ERANBOT project off of Grid Engine - https://phabricator.wikimedia.org/T306888 (10JJMC89) [19:28:53] (03Merged) 10jenkins-bot: releases: Bump Codex to 1.3.2 [labs/libraryupgrader/config] - 10https://gerrit.wikimedia.org/r/997946 (owner: 10Anne Tomasevich) [19:30:02] 10Grid-Engine-to-K8s-Migration, 10Growth-Team: Migrate ERANBOT project off of Grid Engine - https://phabricator.wikimedia.org/T306888 (10JJMC89) Please do not disable this tool on 2024-02-14. Migrating the remaining jobs is blocked on {T333724}. [19:31:34] !log andrew@cloudcumin1001 admin START - Cookbook wmcs.openstack.restart_openstack [19:31:46] !log andrew@cloudcumin1001 admin END (PASS) - Cookbook wmcs.openstack.restart_openstack (exit_code=0) [19:32:10] !log andrew@cloudcumin1001 admin START - Cookbook wmcs.openstack.restart_openstack [19:34:59] !log andrew@cloudcumin1001 admin END (PASS) - Cookbook wmcs.openstack.restart_openstack (exit_code=0) [19:36:12] !log andrew@cloudcumin1001 admin START - Cookbook wmcs.openstack.restart_openstack [19:38:00] !log andrew@cloudcumin1001 admin END (PASS) - Cookbook wmcs.openstack.restart_openstack (exit_code=0) [19:57:44] (03CR) 10Ladsgroup: Always compress text blobs (031 comment) [labs/libraryupgrader] - 10https://gerrit.wikimedia.org/r/997333 (https://phabricator.wikimedia.org/T356565) (owner: 10Ladsgroup) [20:01:51] !log andrew@cloudcumin1001 admin START - Cookbook wmcs.openstack.restart_openstack [20:03:58] !log andrew@cloudcumin1001 admin END (PASS) - Cookbook wmcs.openstack.restart_openstack (exit_code=0) [20:15:08] !log andrew@cloudcumin1001 admin START - Cookbook wmcs.openstack.restart_openstack [20:17:01] !log andrew@cloudcumin1001 admin END (PASS) - Cookbook wmcs.openstack.restart_openstack (exit_code=0) [21:02:39] (03CR) 10BryanDavis: [C: 04-1] "I will push a new patch set with the trivial fix needed." [labs/striker] - 10https://gerrit.wikimedia.org/r/992155 (owner: 10Majavah) [21:02:43] (03PS2) 10BryanDavis: repo: Offer to set SCM URL in toolinfo when making repo [labs/striker] - 10https://gerrit.wikimedia.org/r/992155 (owner: 10Majavah) [21:06:30] (03CR) 10BryanDavis: [C: 03+2] repo: Offer to set SCM URL in toolinfo when making repo [labs/striker] - 10https://gerrit.wikimedia.org/r/992155 (owner: 10Majavah) [21:08:09] (03Merged) 10jenkins-bot: repo: Offer to set SCM URL in toolinfo when making repo [labs/striker] - 10https://gerrit.wikimedia.org/r/992155 (owner: 10Majavah) [21:11:17] (OpenstackAPIResponse) firing: Openstack API average response time is too high. - https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/OpenstackAPIResponse - https://grafana.wikimedia.org/d/UUmLqqX4k - https://alerts.wikimedia.org/?q=alertname%3DOpenstackAPIResponse [21:49:12] (03CR) 10BryanDavis: [C: 04-1] "Core changes are solid. I have several small quibbles about message wording and and minor implementation issues that I will address in a f" [labs/striker] - 10https://gerrit.wikimedia.org/r/992146 (owner: 10Majavah) [21:59:14] 10Toolforge (Toolforge iteration 05), 10cloud-services-team, 10Kubernetes, 10Patch-For-Review: Create Bookworm-based standalone webservice image - https://phabricator.wikimedia.org/T355231 (10fnegri) > I remember a Phab task where the creation of the -standalone images was discussed, but I can't find it ri... [22:04:33] (03PS4) 10BryanDavis: phabricator: Offer to set issue tracker URL in toolinfo [labs/striker] - 10https://gerrit.wikimedia.org/r/992146 (owner: 10Majavah) [22:04:35] (03PS4) 10BryanDavis: dev(docker): Add repository url custom field to Phabricator [labs/striker] - 10https://gerrit.wikimedia.org/r/992156 (owner: 10Majavah) [22:04:37] (03PS6) 10BryanDavis: phabricator: Allow setting source repository project field [labs/striker] - 10https://gerrit.wikimedia.org/r/992157 (owner: 10Majavah) [22:29:26] 10Toolforge (Toolforge iteration 05), 10Toolforge Build Service, 10User-Raymond_Ndibe: [builds-api] add quota information to NewBuild struct - https://phabricator.wikimedia.org/T356724 (10Raymond_Ndibe) >>! In T356724#9516707, @dcaro wrote: > Can you elaborate? > > What is the workflow that you imagine to a... [23:16:04] (OpenstackAPIResponse) resolved: Openstack API average response time is too high. - https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/OpenstackAPIResponse - https://grafana.wikimedia.org/d/UUmLqqX4k - https://alerts.wikimedia.org/?q=alertname%3DOpenstackAPIResponse [23:31:08] 10Toolforge (Toolforge iteration 05): [toolforge-cd] discuss the possibility of removing tests from merge request ci/cd pipelines - https://phabricator.wikimedia.org/T353740 (10Raymond_Ndibe) [23:31:26] 10Toolforge (Toolforge iteration 05): [toolforge-cd] discuss the possibility of removing tests from merge request ci/cd pipelines - https://phabricator.wikimedia.org/T353740 (10Raymond_Ndibe) [23:31:45] 10Toolforge (Toolforge iteration 05): [toolforge-cd] discuss the possibility of removing tests from merge request ci/cd pipelines - https://phabricator.wikimedia.org/T353740 (10Raymond_Ndibe) [23:32:08] 10Toolforge (Toolforge iteration 05): [toolforge-cd] discuss the possibility of removing tests from merge request ci/cd pipelines - https://phabricator.wikimedia.org/T353740 (10Raymond_Ndibe) [23:36:42] 10Toolforge (Toolforge iteration 05): [toolforge-cd] discuss the possibility of removing tests from merge request ci/cd pipelines - https://phabricator.wikimedia.org/T353740 (10Raymond_Ndibe) [23:43:46] 10Toolforge (Toolforge iteration 05): [toolforge-cd] discuss the possibility of removing tests from merge request ci/cd pipelines - https://phabricator.wikimedia.org/T353740 (10Raymond_Ndibe) [23:52:19] (03CR) 10BryanDavis: [V: 03+1 C: 03+2] phabricator: Offer to set issue tracker URL in toolinfo (034 comments) [labs/striker] - 10https://gerrit.wikimedia.org/r/992146 (owner: 10Majavah) [23:52:22] 10Grid-Engine-to-K8s-Migration: Migrate glamify from Toolforge GridEngine to Toolforge Kubernetes - https://phabricator.wikimedia.org/T319772 (10Asaf) Thanks for the analysis! That is indeed what it would take, but I can't put in the time in the foreseeable future. The tool is not heavily used and should be i... [23:52:57] (03CR) 10BryanDavis: [C: 03+2] dev(docker): Add repository url custom field to Phabricator [labs/striker] - 10https://gerrit.wikimedia.org/r/992156 (owner: 10Majavah) [23:53:56] (03Merged) 10jenkins-bot: phabricator: Offer to set issue tracker URL in toolinfo [labs/striker] - 10https://gerrit.wikimedia.org/r/992146 (owner: 10Majavah) [23:56:26] (03Merged) 10jenkins-bot: dev(docker): Add repository url custom field to Phabricator [labs/striker] - 10https://gerrit.wikimedia.org/r/992156 (owner: 10Majavah)