[00:02:34] 10VPS-project-Wikistats, 13Patch-For-Review: Rename List of Wikia wikis to List of Fandom wikis - https://phabricator.wikimedia.org/T426760#12404298 (10Dzahn) 05Open→03Resolved a:03Dzahn - done and deployed (MRs 59 and 60). The page title, the main page and the largest wikis lists say Fandom now.... [00:32:30] 10Toolforge, 06tools-platform-team: webservice-cli: deepcopy KubernetesBackend.DEFAULT_RESOURCES before modification - https://phabricator.wikimedia.org/T440414 (10Raymond_Ndibe) 03NEW [00:34:38] 10Toolforge, 06tools-platform-team: webservice-cli: support the new image-config format - https://phabricator.wikimedia.org/T440415 (10Raymond_Ndibe) 03NEW [00:35:08] 10Toolforge, 06tools-platform-team: webservice-cli: deepcopy KubernetesBackend.DEFAULT_RESOURCES before modification - https://phabricator.wikimedia.org/T440414#12404349 (10Raymond_Ndibe) a:03Raymond_Ndibe [00:37:54] (03update) 10raymond-ndibe: add jobs-api backend to webservice-cli [repos/cloud/toolforge/webservice-cli] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/webservice-cli/-/merge_requests/95 (https://phabricator.wikimedia.org/T431421) [00:38:44] (03update) 10raymond-ndibe: add jobs-api backend to webservice-cli [repos/cloud/toolforge/webservice-cli] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/webservice-cli/-/merge_requests/95 (https://phabricator.wikimedia.org/T431421) [00:39:31] (03open) 10raymond-ndibe: kubernetes.py: deepcopy KubernetesBackend.DEFAULT_RESOURCES before modification [repos/cloud/toolforge/webservice-cli] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/webservice-cli/-/merge_requests/123 (https://phabricator.wikimedia.org/T440414) [00:39:57] (03open) 10raymond-ndibe: kubernetes.py: support the new image-config format [repos/cloud/toolforge/webservice-cli] (deepcopy_resources_dict) - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/webservice-cli/-/merge_requests/124 (https://phabricator.wikimedia.org/T440415) [00:40:12] (03update) 10raymond-ndibe: add jobs-api backend to webservice-cli [repos/cloud/toolforge/webservice-cli] (support_new_image_config_format) - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/webservice-cli/-/merge_requests/95 (https://phabricator.wikimedia.org/T431421) [00:41:01] (03update) 10raymond-ndibe: kubernetes.py: support the new image-config format [repos/cloud/toolforge/webservice-cli] (deepcopy_resources_dict) - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/webservice-cli/-/merge_requests/124 (https://phabricator.wikimedia.org/T440415) [00:41:59] (03update) 10raymond-ndibe: add jobs-api backend to webservice-cli [repos/cloud/toolforge/webservice-cli] (support_new_image_config_format) - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/webservice-cli/-/merge_requests/95 (https://phabricator.wikimedia.org/T431421) [00:46:30] 10Toolforge (Push-to-Deploy), 06tools-platform-team, 13Patch-For-Review: [jobs-api] support job stop/pause - https://phabricator.wikimedia.org/T436638#12404355 (10Raymond_Ndibe) 05In progress→03Declined [01:19:24] 10Toolforge, 06tools-platform-team, 13Patch-For-Review: webservice-cli: support the new image-config format - https://phabricator.wikimedia.org/T440415#12404376 (10Raymond_Ndibe) 05Open→03In progress [01:19:30] 10Toolforge, 06tools-platform-team, 13Patch-For-Review: webservice-cli: deepcopy KubernetesBackend.DEFAULT_RESOURCES before modification - https://phabricator.wikimedia.org/T440414#12404380 (10Raymond_Ndibe) 05Open→03In progress [03:11:18] 10Cloud-VPS, 06tools-infrastructure-team: Create a flavor with virtio multiqueue for integration-cache-proxy - https://phabricator.wikimedia.org/T440418 (10Mhurd) 03NEW [03:14:13] 10Cloud-VPS, 06tools-infrastructure-team, 06Test Platform (San Miguel de Allende 31): Create a flavor with virtio multiqueue for integration-cache-proxy - https://phabricator.wikimedia.org/T440418#12404506 (10Mhurd) [03:27:48] 10Tool-wikinewsie: Wikinewsie: Character limit issue on top story - https://phabricator.wikimedia.org/T440420 (10Wileycount) 03NEW [03:52:24] 10Cloud-VPS, 06tools-infrastructure-team, 06DC-Ops: Set cloudvirt fleet to 'performance' governor - https://phabricator.wikimedia.org/T439729#12404560 (10Mhurd) FYI, results from the CI side since this change: - **integration-cache-proxy:** about 40% more throughput on the same load test at the same time of... [05:22:49] 10Toolforge (Push-to-Deploy), 06tools-platform-team: Create code change and redeploy tutorial - https://phabricator.wikimedia.org/T437900#12404640 (10komla) [05:54:25] (03update) 10kavaljeetsingh: Fix iOS WebKit form resets under memory pressure (T434086) [toolforge-repos/clip2commons] - 10https://gitlab.wikimedia.org/toolforge-repos/clip2commons/-/merge_requests/12 [05:58:07] 10Tool-clip2commons: iOS WebKit form resets under memory pressure - https://phabricator.wikimedia.org/T434086#12404655 (10Kavaljeet_Singh) Thanks for catching that — my mistake during a manual edit, the license-remember watcher got replaced instead of placed alongside the new draft-save watcher. Fixed in the lat... [06:18:41] 10Toolforge (Push-to-Deploy), 06tools-platform-team: Create code change and redeploy tutorial - https://phabricator.wikimedia.org/T437900#12404670 (10komla) [06:24:54] (03merge) 10countcount: Update pnpm to v12.9.1 [toolforge-repos/wiki-mail-verify] - 10https://gitlab.wikimedia.org/toolforge-repos/wiki-mail-verify/-/merge_requests/48 (owner: 10renovatebot) [06:25:12] (03merge) 10countcount: Update pnpm to v12.9.1 [toolforge-repos/rangetree] - 10https://gitlab.wikimedia.org/toolforge-repos/rangetree/-/merge_requests/62 (owner: 10renovatebot) [06:25:16] (03merge) 10countcount: Update pnpm to v12.9.1 [toolforge-repos/checkusertools] - 10https://gitlab.wikimedia.org/toolforge-repos/checkusertools/-/merge_requests/30 (owner: 10renovatebot) [06:25:21] (03merge) 10countcount: Update pnpm to v12.9.1 [toolforge-repos/allblocksever] - 10https://gitlab.wikimedia.org/toolforge-repos/allblocksever/-/merge_requests/34 (owner: 10renovatebot) [06:25:25] (03merge) 10countcount: Update pnpm to v12.9.1 [toolforge-repos/namehistory] - 10https://gitlab.wikimedia.org/toolforge-repos/namehistory/-/merge_requests/23 (owner: 10renovatebot) [06:31:31] (03update) 10renovatebot: Lock file maintenance [toolforge-repos/namehistory] - 10https://gitlab.wikimedia.org/toolforge-repos/namehistory/-/merge_requests/24 [06:31:44] (03update) 10renovatebot: Lock file maintenance [toolforge-repos/allblocksever] - 10https://gitlab.wikimedia.org/toolforge-repos/allblocksever/-/merge_requests/35 [06:31:58] (03update) 10renovatebot: Lock file maintenance [toolforge-repos/checkusertools] - 10https://gitlab.wikimedia.org/toolforge-repos/checkusertools/-/merge_requests/31 [06:33:01] (03update) 10renovatebot: Lock file maintenance [toolforge-repos/rangetree] - 10https://gitlab.wikimedia.org/toolforge-repos/rangetree/-/merge_requests/63 [06:34:37] (03update) 10renovatebot: Lock file maintenance [toolforge-repos/wiki-mail-verify] - 10https://gitlab.wikimedia.org/toolforge-repos/wiki-mail-verify/-/merge_requests/49 [06:42:51] 10Toolforge (Push-to-Deploy), 06tools-platform-team: Create code change and redeploy tutorial - https://phabricator.wikimedia.org/T437900#12404689 (10komla) [07:05:37] 10Cloud-VPS, 06tools-infrastructure-team, 13Patch-For-Review: Consider updating the default CPU model for nova VMs - https://phabricator.wikimedia.org/T440400#12404742 (10fgiunchedi) Idea LGTM, though a few things/questions I couldn't find the answers to from wikitech: 1. how to determine the exact cpu mode... [07:28:06] 10Cloud-VPS, 06tools-infrastructure-team, 06Test Platform (San Miguel de Allende 31): Create a flavor with virtio multiqueue for integration-cache-proxy - https://phabricator.wikimedia.org/T440418#12404784 (10fgiunchedi) Thank you for reaching out @Mhurd and the detailed perf tests; from https://phabricator.... [08:37:32] 10Cloud-VPS, 06tools-infrastructure-team, 06DC-Ops: Set cloudvirt fleet to 'performance' governor - https://phabricator.wikimedia.org/T439729#12405006 (10fgiunchedi) Thank you @Mhurd ! I'm glad the change yielded real gains [08:39:13] 10Cloud-VPS, 06tools-infrastructure-team, 06DC-Ops: Set cloudvirt fleet to 'performance' governor - https://phabricator.wikimedia.org/T439729#12405008 (10fgiunchedi) >>! In T439729#12397559, @wiki_willy wrote: > Thanks for the heads up @fgiunchedi! If this helps performance and optimization, a half kW incre... [08:45:12] (03update) 10dcaro: package: move to poetry base [toolforge-repos/k8s-status] - 10https://gitlab.wikimedia.org/toolforge-repos/k8s-status/-/merge_requests/10 [08:47:15] (03update) 10dcaro: package: move to poetry base [toolforge-repos/k8s-status] - 10https://gitlab.wikimedia.org/toolforge-repos/k8s-status/-/merge_requests/10 [08:49:08] (03update) 10dcaro: package: move to poetry base [toolforge-repos/k8s-status] - 10https://gitlab.wikimedia.org/toolforge-repos/k8s-status/-/merge_requests/10 [08:51:34] (03update) 10dcaro: package: move to poetry base [toolforge-repos/k8s-status] - 10https://gitlab.wikimedia.org/toolforge-repos/k8s-status/-/merge_requests/10 [08:52:49] 10Cloud-VPS, 06tools-infrastructure-team, 07Grafana: CloudVPS project grafana dashboards are empty - https://phabricator.wikimedia.org/T440021#12405044 (10fgiunchedi) 05Open→03Resolved a:03fgiunchedi Thank you for the notice, it was indeed permissions problems following a grafana upgrades -- resolv... [08:52:50] (03close) 10dcaro: ci: use trixie [toolforge-repos/k8s-status] (move_to_poetry) - 10https://gitlab.wikimedia.org/toolforge-repos/k8s-status/-/merge_requests/8 [08:54:23] (03update) 10dcaro: package: move to poetry base [toolforge-repos/k8s-status] - 10https://gitlab.wikimedia.org/toolforge-repos/k8s-status/-/merge_requests/10 [08:55:36] 10Cloud-VPS, 06tools-infrastructure-team, 07Grafana: CloudVPS project grafana dashboards are empty - https://phabricator.wikimedia.org/T440021#12405068 (10Don-vip) @fgiunchedi I still see nothing (anonymously): {F106802610} [08:57:26] 10Cloud-VPS, 06tools-infrastructure-team: Review capacity projection setup for toolforge and cloud-vps - https://phabricator.wikimedia.org/T434128#12405075 (10fgiunchedi) I missed this task at the time, however while looking into something else I did craft an openstack capacity dashboard (https://grafana.wikim... [08:59:07] (03update) 10dcaro: package: move to poetry base [toolforge-repos/k8s-status] - 10https://gitlab.wikimedia.org/toolforge-repos/k8s-status/-/merge_requests/10 [09:01:05] (03update) 10dcaro: package: move to poetry base [toolforge-repos/k8s-status] - 10https://gitlab.wikimedia.org/toolforge-repos/k8s-status/-/merge_requests/10 [09:02:22] !log dcaro@cloudcumin1001 toolsbeta START - Cookbook wmcs.toolforge.component.deploy for component components-api [09:04:30] (03update) 10fnegri: package: move to poetry base [toolforge-repos/k8s-status] - 10https://gitlab.wikimedia.org/toolforge-repos/k8s-status/-/merge_requests/10 (owner: 10dcaro) [09:04:48] (03update) 10fnegri: package: move to poetry base [toolforge-repos/k8s-status] - 10https://gitlab.wikimedia.org/toolforge-repos/k8s-status/-/merge_requests/10 (owner: 10dcaro) [09:04:54] (03approved) 10fnegri: package: move to poetry base [toolforge-repos/k8s-status] - 10https://gitlab.wikimedia.org/toolforge-repos/k8s-status/-/merge_requests/10 (owner: 10dcaro) [09:05:39] !log dcaro@cloudcumin1001 toolsbeta END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component components-api [09:06:35] 06tools-infrastructure-team, 07Epic, 06Test Platform (Epics): Explore if there are ways to tune the underlying hardware and configuration for the CI agents - https://phabricator.wikimedia.org/T437407#12405153 (10fgiunchedi) With T439729 rolled out I am tempted to call this one done, what do you think ? [09:16:27] (03update) 10fnegri: Read from components-api which tools opted in [repos/cloud/toolforge/alerts-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/alerts-api/-/merge_requests/12 (https://phabricator.wikimedia.org/T439554) [09:17:51] (03update) 10dcaro: package: move to poetry base [toolforge-repos/k8s-status] - 10https://gitlab.wikimedia.org/toolforge-repos/k8s-status/-/merge_requests/10 [09:19:07] (03update) 10dcaro: package: move to poetry base [toolforge-repos/k8s-status] - 10https://gitlab.wikimedia.org/toolforge-repos/k8s-status/-/merge_requests/10 [09:27:40] (03update) 10dcaro: package: move to poetry base [toolforge-repos/k8s-status] - 10https://gitlab.wikimedia.org/toolforge-repos/k8s-status/-/merge_requests/10 [09:27:49] (03update) 10dcaro: package: move to poetry base [toolforge-repos/k8s-status] - 10https://gitlab.wikimedia.org/toolforge-repos/k8s-status/-/merge_requests/10 [09:28:06] (03merge) 10dcaro: package: move to poetry base [toolforge-repos/k8s-status] - 10https://gitlab.wikimedia.org/toolforge-repos/k8s-status/-/merge_requests/10 [09:30:03] !log dcaro@cloudcumin1001 tools START - Cookbook wmcs.toolforge.component.deploy for component components-api [09:30:34] FIRING: ToolsNfsAlmostFull: Toolforge NFS is almost full - https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/ToolsNfsAlmostFull - https://prometheus-alerts.wmcloud.org/?q=alertname%3DToolsNfsAlmostFull [09:30:34] 06tools-infrastructure-team, 07Epic, 06Test Platform (Epics): Explore if there are ways to tune the underlying hardware and configuration for the CI agents - https://phabricator.wikimedia.org/T437407#12405216 (10Peter) 05Open→03Resolved a:03Peter Yes thank you @fgiunchedi for all the help! [09:31:13] (03approved) 10dcaro: models: split filelog options from common run fields [repos/cloud/toolforge/components-api] (fix_component_type_discriminator) - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/components-api/-/merge_requests/198 (https://phabricator.wikimedia.org/T362077) (owner: 10raymond-ndibe) [09:31:51] (03update) 10dcaro: feat: add webservice component type support [repos/cloud/toolforge/components-api] (split_filelog_options_from_run_info_fields) - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/components-api/-/merge_requests/199 (https://phabricator.wikimedia.org/T362077) (owner: 10raymond-ndibe) [09:33:14] !log dcaro@cloudcumin1001 tools END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component components-api [09:33:22] (03open) 10rluts: Add internationalization support with translation catalogs [toolforge-repos/findsmith] - 10https://gitlab.wikimedia.org/toolforge-repos/findsmith/-/merge_requests/4 [09:35:30] (03merge) 10rluts: Add internationalization support with translation catalogs [toolforge-repos/findsmith] - 10https://gitlab.wikimedia.org/toolforge-repos/findsmith/-/merge_requests/4 [09:37:51] (03approved) 10dcaro: components-api: bump to 0.0.221-20261006140537-10ef2890 [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1451 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [09:37:54] (03update) 10dcaro: components-api: bump to 0.0.221-20261006140537-10ef2890 [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1451 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [09:37:58] (03update) 10dcaro: components-api: bump to 0.0.221-20261006140537-10ef2890 [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1451 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [09:38:15] (03update) 10dcaro: volume-admission: bump to 0.0.89-20261005123003-652db2ba [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1450 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [09:38:29] (03merge) 10dcaro: components-api: bump to 0.0.221-20261006140537-10ef2890 [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1451 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [09:38:41] (03update) 10dcaro: volume-admission: bump to 0.0.89-20261005123003-652db2ba [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1450 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [09:38:45] !log dcaro@cloudcumin1001 toolsbeta START - Cookbook wmcs.toolforge.component.deploy for component volume-admission [09:41:16] !log dcaro@cloudcumin1001 toolsbeta END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component volume-admission [09:41:21] !log dcaro@cloudcumin1001 tools START - Cookbook wmcs.toolforge.component.deploy for component volume-admission [09:42:39] (03update) 10dcaro: build: Upgrade pre-commit dependencies [repos/cloud/toolforge/jobs-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-api/-/merge_requests/381 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [09:42:46] (03update) 10dcaro: build: Upgrade pre-commit dependencies [repos/cloud/toolforge/jobs-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-api/-/merge_requests/381 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [09:43:35] !log dcaro@cloudcumin1001 tools END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component volume-admission [09:46:49] (03merge) 10dcaro: build: Upgrade pre-commit dependencies [repos/cloud/toolforge/jobs-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-api/-/merge_requests/381 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [09:47:25] (03approved) 10dcaro: volume-admission: bump to 0.0.89-20261005123003-652db2ba [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1450 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [09:47:28] (03merge) 10dcaro: volume-admission: bump to 0.0.89-20261005123003-652db2ba [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1450 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [09:47:42] (03update) 10dcaro: jobs-emailer: bump to 0.0.96-20261005123203-a8a31f7c [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1449 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [09:47:45] !log dcaro@cloudcumin1001 toolsbeta START - Cookbook wmcs.toolforge.component.deploy for component jobs-emailer [09:51:14] (03update) 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce: jobs-api: bump to 0.0.575-20261007094704-a8fc0459 [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1458 [09:51:21] (03open) 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce: jobs-api: bump to 0.0.575-20261007094704-a8fc0459 [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1458 [10:03:42] !log dcaro@cloudcumin1001 toolsbeta END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component jobs-emailer [10:04:04] !log dcaro@cloudcumin1001 tools START - Cookbook wmcs.toolforge.component.deploy for component jobs-emailer [10:14:39] (03update) 10dcaro: models.py: expose state and webservice_defaults in images endpoint [repos/cloud/toolforge/jobs-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-api/-/merge_requests/347 (https://phabricator.wikimedia.org/T431679) (owner: 10raymond-ndibe) [10:22:46] !log dcaro@cloudcumin1001 tools END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component jobs-emailer [10:29:17] (03open) 10dcaro: jobs: skip artifacts that don't exist on deletion [repos/cloud/toolforge/maintain-harbor] (delete_untagged) - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/maintain-harbor/-/merge_requests/76 (https://phabricator.wikimedia.org/T440343) [10:34:40] (03update) 10dcaro: jobs: skip artifacts that don't exist on deletion [repos/cloud/toolforge/maintain-harbor] (delete_untagged) - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/maintain-harbor/-/merge_requests/76 (https://phabricator.wikimedia.org/T440343) [10:47:30] (03update) 10fnegri: config: allow configs without components [repos/cloud/toolforge/components-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/components-api/-/merge_requests/200 (https://phabricator.wikimedia.org/T440326) [11:00:38] 10Cloud-VPS (Project-requests), 10Language-Diversity-Hub: Request creation of VPS project : LinguaData - https://phabricator.wikimedia.org/T440447 (10Yug) 03NEW [11:01:38] 10Cloud-VPS (Project-requests), 10Language-Diversity-Hub: Request creation of VPS project : LinguaData - https://phabricator.wikimedia.org/T440447#12405569 (10Yug) [11:02:57] 10Cloud-VPS (Project-requests), 10Language-Diversity-Hub: Request creation of VPS project : LinguaData - https://phabricator.wikimedia.org/T440447#12405570 (10Yug) [11:07:23] 10Cloud-VPS (Project-requests), 10Language-Diversity-Hub: Request creation of VPS project : LinguaData - https://phabricator.wikimedia.org/T440447#12405580 (10Yug) [11:08:01] (03approved) 10dcaro: jobs-emailer: bump to 0.0.96-20261005123203-a8a31f7c [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1449 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [11:08:07] (03merge) 10dcaro: jobs-emailer: bump to 0.0.96-20261005123203-a8a31f7c [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1449 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [11:08:10] (03update) 10dcaro: Draft: jobs: skip artifacts that don't exist on deletion [repos/cloud/toolforge/maintain-harbor] (delete_untagged) - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/maintain-harbor/-/merge_requests/76 (https://phabricator.wikimedia.org/T440343) [11:08:26] 10Cloud-VPS (Project-requests), 10Language-Diversity-Hub: Request creation of VPS project : LinguaData - https://phabricator.wikimedia.org/T440447#12405581 (10Yug) [11:09:09] 10Cloud-VPS (Project-requests), 10Language-Diversity-Hub: Request creation of VPS project : LinguaData - https://phabricator.wikimedia.org/T440447#12405584 (10Yug) [11:15:49] (03update) 10renovatebot: Lock file maintenance [toolforge-repos/namehistory] - 10https://gitlab.wikimedia.org/toolforge-repos/namehistory/-/merge_requests/24 [11:16:00] (03update) 10renovatebot: Lock file maintenance [toolforge-repos/allblocksever] - 10https://gitlab.wikimedia.org/toolforge-repos/allblocksever/-/merge_requests/35 [11:16:13] (03update) 10renovatebot: Lock file maintenance [toolforge-repos/checkusertools] - 10https://gitlab.wikimedia.org/toolforge-repos/checkusertools/-/merge_requests/31 [11:17:44] (03update) 10renovatebot: Lock file maintenance [toolforge-repos/rangetree] - 10https://gitlab.wikimedia.org/toolforge-repos/rangetree/-/merge_requests/63 [11:18:09] (03update) 10renovatebot: Lock file maintenance [toolforge-repos/multiuserinfo] - 10https://gitlab.wikimedia.org/toolforge-repos/multiuserinfo/-/merge_requests/84 [11:18:10] (03update) 10renovatebot: Lock file maintenance [toolforge-repos/multiuserinfo] - 10https://gitlab.wikimedia.org/toolforge-repos/multiuserinfo/-/merge_requests/84 [11:18:42] (03update) 10renovatebot: Lock file maintenance [toolforge-repos/wiki-mail-verify] - 10https://gitlab.wikimedia.org/toolforge-repos/wiki-mail-verify/-/merge_requests/49 [11:19:34] (03update) 10renovatebot: Lock file maintenance [toolforge-repos/dewiki-voterightsnotifier] - 10https://gitlab.wikimedia.org/toolforge-repos/dewiki-voterightsnotifier/-/merge_requests/45 [11:19:59] (03update) 10renovatebot: Lock file maintenance [toolforge-repos/dewiki-rangeblock] - 10https://gitlab.wikimedia.org/toolforge-repos/dewiki-rangeblock/-/merge_requests/30 [11:20:00] (03update) 10renovatebot: Lock file maintenance [toolforge-repos/dewiki-rangeblock] - 10https://gitlab.wikimedia.org/toolforge-repos/dewiki-rangeblock/-/merge_requests/30 [11:20:10] (03update) 10renovatebot: Lock file maintenance [toolforge-repos/flaggedrevspromotioncheck] - 10https://gitlab.wikimedia.org/toolforge-repos/flaggedrevspromotioncheck/-/merge_requests/34 [11:20:16] (03update) 10renovatebot: Lock file maintenance [toolforge-repos/dewikisignbot] - 10https://gitlab.wikimedia.org/toolforge-repos/dewikisignbot/-/merge_requests/35 [11:32:54] (03open) 10countcount: Fix audit advisory in source-map-js [toolforge-repos/wiki-mail-verify] - 10https://gitlab.wikimedia.org/toolforge-repos/wiki-mail-verify/-/merge_requests/50 [11:33:04] (03open) 10countcount: Fix pnpm audit advisory in source-map-js [toolforge-repos/allblocksever] - 10https://gitlab.wikimedia.org/toolforge-repos/allblocksever/-/merge_requests/36 [11:33:30] (03open) 10countcount: Fix dependency audit advisories [toolforge-repos/namehistory] - 10https://gitlab.wikimedia.org/toolforge-repos/namehistory/-/merge_requests/25 [11:33:38] (03open) 10countcount: Fix npm audit advisories [toolforge-repos/rangetree] - 10https://gitlab.wikimedia.org/toolforge-repos/rangetree/-/merge_requests/64 [11:33:38] (03open) 10countcount: Fix pnpm audit advisories [toolforge-repos/checkusertools] - 10https://gitlab.wikimedia.org/toolforge-repos/checkusertools/-/merge_requests/32 [11:36:12] (03update) 10countcount: Fix dependency audit advisories [toolforge-repos/namehistory] - 10https://gitlab.wikimedia.org/toolforge-repos/namehistory/-/merge_requests/25 [11:36:13] (03update) 10countcount: Fix dependency audit advisories [toolforge-repos/namehistory] - 10https://gitlab.wikimedia.org/toolforge-repos/namehistory/-/merge_requests/25 [11:38:05] 10Cloud-VPS (Project-requests), 10Language-Diversity-Hub: Request creation of VPS project : LinguaData - https://phabricator.wikimedia.org/T440447#12405693 (10Yug) [11:38:35] 10Cloud-VPS (Project-requests), 10Language-Diversity-Hub: Request creation of VPS project : LinguaData - https://phabricator.wikimedia.org/T440447#12405694 (10Yug) [11:43:58] (03merge) 10countcount: Fix dependency audit advisories [toolforge-repos/namehistory] - 10https://gitlab.wikimedia.org/toolforge-repos/namehistory/-/merge_requests/25 [11:44:15] (03merge) 10countcount: Fix pnpm audit advisories [toolforge-repos/checkusertools] - 10https://gitlab.wikimedia.org/toolforge-repos/checkusertools/-/merge_requests/32 [11:44:23] (03merge) 10countcount: Fix npm audit advisories [toolforge-repos/rangetree] - 10https://gitlab.wikimedia.org/toolforge-repos/rangetree/-/merge_requests/64 [11:44:24] (03merge) 10countcount: Fix pnpm audit advisory in source-map-js [toolforge-repos/allblocksever] - 10https://gitlab.wikimedia.org/toolforge-repos/allblocksever/-/merge_requests/36 [11:48:27] (03open) 10countcount: Include the toolchain version in the rust-tests cache key [toolforge-repos/wiki-mail-verify] - 10https://gitlab.wikimedia.org/toolforge-repos/wiki-mail-verify/-/merge_requests/51 [11:50:57] (03update) 10countcount: Include the toolchain version in the rust-tests cache key [toolforge-repos/wiki-mail-verify] - 10https://gitlab.wikimedia.org/toolforge-repos/wiki-mail-verify/-/merge_requests/51 [11:51:28] (03merge) 10countcount: Fix audit advisory in source-map-js [toolforge-repos/wiki-mail-verify] - 10https://gitlab.wikimedia.org/toolforge-repos/wiki-mail-verify/-/merge_requests/50 [11:51:42] (03update) 10countcount: Include the toolchain version in the rust-tests cache key [toolforge-repos/wiki-mail-verify] - 10https://gitlab.wikimedia.org/toolforge-repos/wiki-mail-verify/-/merge_requests/51 [11:52:38] (03update) 10countcount: Include the toolchain version in the rust-tests cache key [toolforge-repos/wiki-mail-verify] - 10https://gitlab.wikimedia.org/toolforge-repos/wiki-mail-verify/-/merge_requests/51 [11:52:40] (03update) 10countcount: Include the toolchain version in the rust-tests cache key [toolforge-repos/wiki-mail-verify] - 10https://gitlab.wikimedia.org/toolforge-repos/wiki-mail-verify/-/merge_requests/51 [11:52:47] (03update) 10countcount: Fix stale coverage profiles breaking the rust-tests report [toolforge-repos/wiki-mail-verify] - 10https://gitlab.wikimedia.org/toolforge-repos/wiki-mail-verify/-/merge_requests/51 [11:55:42] 10Toolforge, 06tools-platform-team: jobs-api: selectively return deprecated images in the images endpoint - https://phabricator.wikimedia.org/T440454 (10Raymond_Ndibe) 03NEW [11:55:46] (03merge) 10countcount: Fix stale coverage profiles breaking the rust-tests report [toolforge-repos/wiki-mail-verify] - 10https://gitlab.wikimedia.org/toolforge-repos/wiki-mail-verify/-/merge_requests/51 [11:57:29] (03update) 10renovatebot: Lock file maintenance [toolforge-repos/namehistory] - 10https://gitlab.wikimedia.org/toolforge-repos/namehistory/-/merge_requests/24 [11:57:35] (03update) 10renovatebot: Lock file maintenance [toolforge-repos/namehistory] - 10https://gitlab.wikimedia.org/toolforge-repos/namehistory/-/merge_requests/24 [11:57:43] (03update) 10renovatebot: Lock file maintenance [toolforge-repos/allblocksever] - 10https://gitlab.wikimedia.org/toolforge-repos/allblocksever/-/merge_requests/35 [11:57:51] (03update) 10renovatebot: Lock file maintenance [toolforge-repos/allblocksever] - 10https://gitlab.wikimedia.org/toolforge-repos/allblocksever/-/merge_requests/35 [11:57:57] (03update) 10renovatebot: Lock file maintenance [toolforge-repos/checkusertools] - 10https://gitlab.wikimedia.org/toolforge-repos/checkusertools/-/merge_requests/31 [11:58:06] (03update) 10renovatebot: Lock file maintenance [toolforge-repos/checkusertools] - 10https://gitlab.wikimedia.org/toolforge-repos/checkusertools/-/merge_requests/31 [11:58:32] (03open) 10raymond-ndibe: images: add include_deprecated query parameter [repos/cloud/toolforge/jobs-api] (expose_image_state_and_webservice_defaults) - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-api/-/merge_requests/383 (https://phabricator.wikimedia.org/T440454) [11:59:03] (03update) 10renovatebot: Lock file maintenance [toolforge-repos/rangetree] - 10https://gitlab.wikimedia.org/toolforge-repos/rangetree/-/merge_requests/63 [11:59:10] (03update) 10renovatebot: Lock file maintenance [toolforge-repos/rangetree] - 10https://gitlab.wikimedia.org/toolforge-repos/rangetree/-/merge_requests/63 [11:59:22] (03update) 10renovatebot: Lock file maintenance [toolforge-repos/multiuserinfo] - 10https://gitlab.wikimedia.org/toolforge-repos/multiuserinfo/-/merge_requests/84 [11:59:28] (03update) 10raymond-ndibe: models.py: expose state and webservice_defaults in images endpoint [repos/cloud/toolforge/jobs-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-api/-/merge_requests/347 (https://phabricator.wikimedia.org/T431679) [12:00:38] (03update) 10renovatebot: Lock file maintenance [toolforge-repos/wiki-mail-verify] - 10https://gitlab.wikimedia.org/toolforge-repos/wiki-mail-verify/-/merge_requests/49 [12:00:46] (03update) 10renovatebot: Lock file maintenance [toolforge-repos/wiki-mail-verify] - 10https://gitlab.wikimedia.org/toolforge-repos/wiki-mail-verify/-/merge_requests/49 [12:01:05] (03update) 10raymond-ndibe: images: add include_deprecated query parameter [repos/cloud/toolforge/jobs-api] (expose_image_state_and_webservice_defaults) - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-api/-/merge_requests/383 (https://phabricator.wikimedia.org/T440454) [12:01:16] (03update) 10renovatebot: Lock file maintenance [toolforge-repos/dewiki-voterightsnotifier] - 10https://gitlab.wikimedia.org/toolforge-repos/dewiki-voterightsnotifier/-/merge_requests/45 [12:01:31] (03update) 10renovatebot: Lock file maintenance [toolforge-repos/dewiki-rangeblock] - 10https://gitlab.wikimedia.org/toolforge-repos/dewiki-rangeblock/-/merge_requests/30 [12:01:37] (03update) 10renovatebot: Lock file maintenance [toolforge-repos/flaggedrevspromotioncheck] - 10https://gitlab.wikimedia.org/toolforge-repos/flaggedrevspromotioncheck/-/merge_requests/34 [12:01:42] (03update) 10renovatebot: Lock file maintenance [toolforge-repos/dewikisignbot] - 10https://gitlab.wikimedia.org/toolforge-repos/dewikisignbot/-/merge_requests/35 [12:01:53] (03update) 10raymond-ndibe: add jobs-api backend to webservice-cli [repos/cloud/toolforge/webservice-cli] (support_new_image_config_format) - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/webservice-cli/-/merge_requests/95 (https://phabricator.wikimedia.org/T431421) [12:03:00] (03update) 10raymond-ndibe: add jobs-api backend to webservice-cli [repos/cloud/toolforge/webservice-cli] (support_new_image_config_format) - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/webservice-cli/-/merge_requests/95 (https://phabricator.wikimedia.org/T431421) [12:03:37] (03update) 10raymond-ndibe: add jobs-api backend to webservice-cli [repos/cloud/toolforge/webservice-cli] (support_new_image_config_format) - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/webservice-cli/-/merge_requests/95 (https://phabricator.wikimedia.org/T431421) [12:11:42] (03update) 10dcaro: Draft: jobs: skip artifacts that don't exist on deletion [repos/cloud/toolforge/maintain-harbor] (delete_untagged) - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/maintain-harbor/-/merge_requests/76 (https://phabricator.wikimedia.org/T440343) [12:17:13] 10Toolforge, 06tools-platform-team: [toolsdb] 2026-09-18 Transaction History Length growing too much - https://phabricator.wikimedia.org/T438504#12405808 (10Pintoch) Thanks a lot @fnegri for the fix. @Arcstur I think this new index should be added to the models with a migration. The migration could then be... [12:19:42] (03update) 10dcaro: jobs-api: bump to 0.0.575-20261007094704-a8fc0459 [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1458 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [12:19:43] !log dcaro@cloudcumin1001 toolsbeta START - Cookbook wmcs.toolforge.component.deploy for component jobs-api [12:32:14] !log dcaro@cloudcumin1001 toolsbeta END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component jobs-api [12:32:52] !log dcaro@cloudcumin1001 tools START - Cookbook wmcs.toolforge.component.deploy for component jobs-api [12:35:49] !log dcaro@cloudcumin1001 tools END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component jobs-api [12:39:03] (03update) 10dcaro: add pagination [repos/cloud/toolforge/maintain-harbor] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/maintain-harbor/-/merge_requests/75 (https://phabricator.wikimedia.org/T440294) [12:39:39] (03update) 10dcaro: add noop [repos/cloud/toolforge/maintain-harbor] (add_pagination) - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/maintain-harbor/-/merge_requests/73 (https://phabricator.wikimedia.org/T440295) [12:41:19] (03update) 10dcaro: add pagination [repos/cloud/toolforge/maintain-harbor] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/maintain-harbor/-/merge_requests/75 (https://phabricator.wikimedia.org/T440294) [12:43:26] (03update) 10dcaro: jobs: delete also untagged artifacts [repos/cloud/toolforge/maintain-harbor] (add_noop) - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/maintain-harbor/-/merge_requests/74 (https://phabricator.wikimedia.org/T440343) [12:47:30] (03update) 10dcaro: add pagination [repos/cloud/toolforge/maintain-harbor] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/maintain-harbor/-/merge_requests/75 (https://phabricator.wikimedia.org/T440294) [12:47:52] (03update) 10dcaro: add noop [repos/cloud/toolforge/maintain-harbor] (add_pagination) - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/maintain-harbor/-/merge_requests/73 (https://phabricator.wikimedia.org/T440295) [12:48:30] (03update) 10dcaro: jobs: delete also untagged artifacts [repos/cloud/toolforge/maintain-harbor] (add_noop) - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/maintain-harbor/-/merge_requests/74 (https://phabricator.wikimedia.org/T440343) [12:48:55] (03update) 10dcaro: Draft: jobs: skip artifacts that don't exist on deletion [repos/cloud/toolforge/maintain-harbor] (delete_untagged) - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/maintain-harbor/-/merge_requests/76 (https://phabricator.wikimedia.org/T440343) [12:50:01] !log dcaro@cloudcumin1001 tools START - Cookbook wmcs.toolforge.component.deploy for component jobs-api [12:51:15] (03update) 10dcaro: jobs: skip artifacts that don't exist on deletion [repos/cloud/toolforge/maintain-harbor] (delete_untagged) - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/maintain-harbor/-/merge_requests/76 (https://phabricator.wikimedia.org/T440343) [12:55:34] (03update) 10dcaro: jobs: skip artifacts that don't exist on deletion [repos/cloud/toolforge/maintain-harbor] (delete_untagged) - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/maintain-harbor/-/merge_requests/76 (https://phabricator.wikimedia.org/T440343) [12:58:56] (03update) 10dcaro: models.py: expose state and webservice_defaults in images endpoint [repos/cloud/toolforge/jobs-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-api/-/merge_requests/347 (https://phabricator.wikimedia.org/T431679) (owner: 10raymond-ndibe) [12:59:52] (03approved) 10dcaro: models.py: expose state and webservice_defaults in images endpoint [repos/cloud/toolforge/jobs-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-api/-/merge_requests/347 (https://phabricator.wikimedia.org/T431679) (owner: 10raymond-ndibe) [13:00:29] 10Toolforge (Push-to-Deploy), 06tools-platform-team, 13Patch-For-Review: jobs-api: Expose state and webservice_defaults on /images endpoint - https://phabricator.wikimedia.org/T431679#12406014 (10dcaro) 05Open→03In progress [13:03:20] !log dcaro@cloudcumin1001 tools END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component jobs-api [13:03:52] 10Cloud-VPS, 06tools-infrastructure-team, 07Grafana: CloudVPS project grafana dashboards are empty - https://phabricator.wikimedia.org/T440021#12406024 (10fgiunchedi) 05Resolved→03Open My bad, you are correct. I'm not quite sure what's wrong with that dashboard to be honest, I can see others that use pro... [13:05:31] (03approved) 10dcaro: kubernetes.py: deepcopy KubernetesBackend.DEFAULT_RESOURCES before modification [repos/cloud/toolforge/webservice-cli] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/webservice-cli/-/merge_requests/123 (https://phabricator.wikimedia.org/T440414) (owner: 10raymond-ndibe) [13:06:14] 10Toolforge, 06tools-platform-team: [toolsdb] 2026-09-18 Transaction History Length growing too much - https://phabricator.wikimedia.org/T438504#12406029 (10Pintoch) Created a corresponding PR here: https://github.com/Wikidata/editgroups/pull/172 [13:07:32] (03approved) 10dcaro: jobs-api: bump to 0.0.575-20261007094704-a8fc0459 [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1458 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [13:07:38] (03merge) 10dcaro: jobs-api: bump to 0.0.575-20261007094704-a8fc0459 [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1458 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [13:07:47] (03update) 10dcaro: api-gateway: bump to 0.0.109-20261005123136-5bb89794 [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1448 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [13:07:54] !log dcaro@cloudcumin1001 toolsbeta START - Cookbook wmcs.toolforge.component.deploy for component api-gateway [13:10:59] !log dcaro@cloudcumin1001 toolsbeta END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component api-gateway [13:11:27] !log dcaro@cloudcumin1001 tools START - Cookbook wmcs.toolforge.component.deploy for component api-gateway [13:11:32] (03update) 10dcaro: jobs: skip artifacts that don't exist on deletion [repos/cloud/toolforge/maintain-harbor] (delete_untagged) - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/maintain-harbor/-/merge_requests/76 (https://phabricator.wikimedia.org/T440343) [13:12:51] (03update) 10dcaro: jobs: skip artifacts that don't exist on deletion [repos/cloud/toolforge/maintain-harbor] (delete_untagged) - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/maintain-harbor/-/merge_requests/76 (https://phabricator.wikimedia.org/T440343) [13:14:11] (03update) 10renovatebot: Lock file maintenance [toolforge-repos/namehistory] - 10https://gitlab.wikimedia.org/toolforge-repos/namehistory/-/merge_requests/24 [13:14:23] (03update) 10renovatebot: Lock file maintenance [toolforge-repos/allblocksever] - 10https://gitlab.wikimedia.org/toolforge-repos/allblocksever/-/merge_requests/35 [13:14:33] !log dcaro@cloudcumin1001 tools END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component api-gateway [13:14:37] (03update) 10renovatebot: Lock file maintenance [toolforge-repos/checkusertools] - 10https://gitlab.wikimedia.org/toolforge-repos/checkusertools/-/merge_requests/31 [13:15:42] (03approved) 10dcaro: api-gateway: bump to 0.0.109-20261005123136-5bb89794 [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1448 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [13:15:46] (03merge) 10dcaro: api-gateway: bump to 0.0.109-20261005123136-5bb89794 [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1448 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [13:16:15] (03update) 10renovatebot: Lock file maintenance [toolforge-repos/rangetree] - 10https://gitlab.wikimedia.org/toolforge-repos/rangetree/-/merge_requests/63 [13:16:20] 10Toolforge, 06tools-platform-team: [all] first of the month dependency upgrade MRs - https://phabricator.wikimedia.org/T440180#12406055 (10dcaro) 05In progress→03Resolved [13:16:40] (03update) 10renovatebot: Lock file maintenance [toolforge-repos/multiuserinfo] - 10https://gitlab.wikimedia.org/toolforge-repos/multiuserinfo/-/merge_requests/84 [13:17:18] (03update) 10renovatebot: Lock file maintenance [toolforge-repos/wiki-mail-verify] - 10https://gitlab.wikimedia.org/toolforge-repos/wiki-mail-verify/-/merge_requests/49 [13:18:16] (03update) 10renovatebot: Lock file maintenance [toolforge-repos/dewiki-voterightsnotifier] - 10https://gitlab.wikimedia.org/toolforge-repos/dewiki-voterightsnotifier/-/merge_requests/45 [13:18:43] (03update) 10renovatebot: Lock file maintenance [toolforge-repos/dewiki-rangeblock] - 10https://gitlab.wikimedia.org/toolforge-repos/dewiki-rangeblock/-/merge_requests/30 [13:18:55] (03update) 10renovatebot: Lock file maintenance [toolforge-repos/flaggedrevspromotioncheck] - 10https://gitlab.wikimedia.org/toolforge-repos/flaggedrevspromotioncheck/-/merge_requests/34 [13:19:04] (03update) 10renovatebot: Lock file maintenance [toolforge-repos/dewikisignbot] - 10https://gitlab.wikimedia.org/toolforge-repos/dewikisignbot/-/merge_requests/35 [13:19:51] 10Toolforge, 06tools-platform-team: [all] first of the month dependency upgrade MRs - https://phabricator.wikimedia.org/T440180#12406068 (10dcaro) 05Resolved→03In progress [13:20:09] 10Toolforge, 06tools-platform-team: [all] first of the month dependency upgrade MRs - https://phabricator.wikimedia.org/T440180#12406070 (10dcaro) All mrs are in, I'll update the ci images so they have the newer pre-commit versions and such [13:27:44] 10Toolforge (Push-to-Deploy), 06tools-platform-team: Create a list of candidate tools for Push-to-Deploy adoption - https://phabricator.wikimedia.org/T437257#12406127 (10waldyrious) Did the resolution of this task produce any public artifact that could be shared here? [13:29:00] 10Toolforge (Push-to-Deploy), 06tools-platform-team: Identify candidate tools for Push-to-Deploy - https://phabricator.wikimedia.org/T437897#12406130 (10waldyrious) Since this is marked as resolved, where are the candidate tools that were identified? [13:30:17] 10Toolforge (Push-to-Deploy), 06tools-platform-team: Identify candidate maintainers - https://phabricator.wikimedia.org/T437898#12406133 (10waldyrious) So... where is the resulting list of candidate maintainers? 🤔 [13:33:31] 10Toolforge, 06tools-platform-team: [all] first of the month dependency upgrade MRs - https://phabricator.wikimedia.org/T440180#12406157 (10dcaro) 05In progress→03Resolved [13:47:34] 10Toolforge (Push-to-Deploy), 06tools-platform-team, 13Patch-For-Review: [jobs-api] support job stop/pause - https://phabricator.wikimedia.org/T436638#12406212 (10Raymond_Ndibe) **Reason:** I created this because I read the results of `webservice-cli stop` wrongly and it appeared like `webservice-cli` wa... [13:48:20] 10Toolforge (Push-to-Deploy), 06tools-platform-team: [webservice-cli] use jobs-api to start the webservice - https://phabricator.wikimedia.org/T431421#12406215 (10dcaro) [13:53:38] (03update) 10fnegri: config: allow configs without components [repos/cloud/toolforge/components-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/components-api/-/merge_requests/200 (https://phabricator.wikimedia.org/T440326) [13:53:46] (03merge) 10fnegri: config: allow configs without components [repos/cloud/toolforge/components-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/components-api/-/merge_requests/200 (https://phabricator.wikimedia.org/T440326) [13:54:34] 10Cloud-VPS, 06tools-infrastructure-team: magnum-cluster-api: understand and back up tenant cluster state - https://phabricator.wikimedia.org/T440363#12406273 (10Andrew) ` andrewbogott__: people have been using velero backup for that ` [13:54:42] (03approved) 10dcaro: kubernetes.py: support the new image-config format [repos/cloud/toolforge/webservice-cli] (deepcopy_resources_dict) - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/webservice-cli/-/merge_requests/124 (https://phabricator.wikimedia.org/T440415) (owner: 10raymond-ndibe) [13:55:21] (03update) 10dcaro: images: add include_deprecated query parameter [repos/cloud/toolforge/jobs-api] (expose_image_state_and_webservice_defaults) - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-api/-/merge_requests/383 (https://phabricator.wikimedia.org/T440454) (owner: 10raymond-ndibe) [13:55:39] !log fnegri@cloudcumin1001 toolsbeta START - Cookbook wmcs.toolforge.component.deploy for component components-api (T440326) [13:55:43] !log fnegri@cloudcumin1001 toolsbeta END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component components-api (T440326) [13:55:44] T440326: [components-api] Allow configs without any component - https://phabricator.wikimedia.org/T440326 [13:57:17] (03open) 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce: components-api: bump to 0.0.222-20261007135404-955bfbed [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1459 (https://phabricator.wikimedia.org/T440326) [13:57:17] (03update) 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce: components-api: bump to 0.0.222-20261007135404-955bfbed [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1459 (https://phabricator.wikimedia.org/T440326) [13:59:42] !log fnegri@cloudcumin1001 toolsbeta START - Cookbook wmcs.toolforge.component.deploy for component components-api (T440326) [14:00:06] 10Cloud-VPS, 06tools-infrastructure-team, 07Grafana: CloudVPS project grafana dashboards are empty - https://phabricator.wikimedia.org/T440021#12406331 (10fgiunchedi) @Don-vip I was getting a 403 for "series query" variable type, whereas other working dashboards are using label value instead. I changed https... [14:01:14] 10Cloud-VPS, 06tools-infrastructure-team, 07Grafana: CloudVPS project grafana dashboards are empty - https://phabricator.wikimedia.org/T440021#12406338 (10Don-vip) Yay, it's working now :) Thanks a lot! [14:02:59] !log fnegri@cloudcumin1001 toolsbeta END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component components-api (T440326) [14:03:03] (03close) 10raymond-ndibe: cli: add stop command [repos/cloud/toolforge/jobs-cli] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-cli/-/merge_requests/179 (https://phabricator.wikimedia.org/T436638) [14:03:04] T440326: [components-api] Allow configs without any component - https://phabricator.wikimedia.org/T440326 [14:03:23] (03close) 10raymond-ndibe: core, api: add job stop support [repos/cloud/toolforge/jobs-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-api/-/merge_requests/377 (https://phabricator.wikimedia.org/T436638) [14:04:37] (03approved) 10dcaro: images: add include_deprecated query parameter [repos/cloud/toolforge/jobs-api] (expose_image_state_and_webservice_defaults) - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-api/-/merge_requests/383 (https://phabricator.wikimedia.org/T440454) (owner: 10raymond-ndibe) [14:04:58] 10Toolforge, 06tools-platform-team, 13Patch-For-Review: jobs-api: selectively return deprecated images in the images endpoint - https://phabricator.wikimedia.org/T440454#12406354 (10dcaro) 05Open→03In progress [14:18:10] 10Toolforge, 06tools-platform-team: [toolsdb] Upgrade to MariaDB 10.11 - https://phabricator.wikimedia.org/T434679#12406460 (10aputhin) p:05Triage→03Medium [14:19:51] 06cloud-services-team, 10Toolforge, 06tools-platform-team: [infra,k8s] Upgrade Toolforge Kubernetes to version 1.34 - https://phabricator.wikimedia.org/T414595#12406465 (10Andrew) [14:25:00] 10Cloud-VPS (Project-requests), 10Language-Diversity-Hub: Request creation of VPS project : LinguaData - https://phabricator.wikimedia.org/T440447#12406513 (10Andrew) Hello! You are welcome to use our resources for these projects. I have a couple of thoughts, though: 1) Most users get a better experience on... [14:25:38] 06cloud-services-team, 10Toolforge, 06tools-platform-team: [infra,k8s] Upgrade Toolforge Kubernetes to version 1.34 - https://phabricator.wikimedia.org/T414595#12406514 (10Andrew) a:03Andrew [14:27:20] 10Toolforge, 06tools-platform-team: New upstream release for Pywikibot - https://phabricator.wikimedia.org/T439635#12406530 (10aputhin) [14:30:04] 10Cloud-VPS, 06tools-infrastructure-team, 07Grafana: CloudVPS project grafana dashboards are empty - https://phabricator.wikimedia.org/T440021#12406555 (10fgiunchedi) 05Open→03Resolved You are welcome, I fixed the query type for other dashboards I found on grafana.wmcloud.org, resolving [14:31:50] 10Toolforge, 06tools-platform-team: New upstream release for Pywikibot - https://phabricator.wikimedia.org/T439635#12406582 (10aputhin) [14:36:01] 10Cloud-VPS, 06tools-infrastructure-team, 06DC-Ops, 13Patch-For-Review: Set cloudvirt fleet to 'performance' governor - https://phabricator.wikimedia.org/T439729#12406606 (10fgiunchedi) [14:40:55] 10Cloud-VPS, 06tools-infrastructure-team: Review capacity projection setup for toolforge and cloud-vps - https://phabricator.wikimedia.org/T434128#12406639 (10Andrew) I agree that we can probablhy bump overcommit from 2 to 3. Before we do that I'd like to get some visibility into when/if VMs are experiencing C... [15:00:16] 10Tool-wiktlexbot: Add ability to add new entries to existing pages whenever safe - https://phabricator.wikimedia.org/T440473 (10Redmin) 03NEW [15:00:42] 10Tool-wiktlexbot: Add ability to add new entries to existing pages whenever safe - https://phabricator.wikimedia.org/T440473#12406817 (10Redmin) p:05Triage→03High [15:06:45] 10Toolforge, 06tools-platform-team, 13Patch-For-Review: [maintain-harbor] delete untagged artifacts too - https://phabricator.wikimedia.org/T440343#12406889 (10dcaro) Ran this from my laptop on toolsbeta harbor, freed ~40G: {F106835038} [15:07:36] !log fnegri@cloudcumin1001 tools START - Cookbook wmcs.toolforge.component.deploy for component components-api (T440326) [15:07:41] T440326: [components-api] Allow configs without any component - https://phabricator.wikimedia.org/T440326 [15:10:59] !log fnegri@cloudcumin1001 tools END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component components-api (T440326) [15:13:54] (03update) 10renovatebot: Lock file maintenance [toolforge-repos/namehistory] - 10https://gitlab.wikimedia.org/toolforge-repos/namehistory/-/merge_requests/24 [15:14:01] (03update) 10renovatebot: Lock file maintenance [toolforge-repos/allblocksever] - 10https://gitlab.wikimedia.org/toolforge-repos/allblocksever/-/merge_requests/35 [15:14:08] (03update) 10renovatebot: Lock file maintenance [toolforge-repos/checkusertools] - 10https://gitlab.wikimedia.org/toolforge-repos/checkusertools/-/merge_requests/31 [15:15:02] (03update) 10renovatebot: Lock file maintenance [toolforge-repos/rangetree] - 10https://gitlab.wikimedia.org/toolforge-repos/rangetree/-/merge_requests/63 [15:15:22] (03update) 10renovatebot: Lock file maintenance [toolforge-repos/multiuserinfo] - 10https://gitlab.wikimedia.org/toolforge-repos/multiuserinfo/-/merge_requests/84 [15:15:41] (03update) 10renovatebot: Lock file maintenance [toolforge-repos/wiki-mail-verify] - 10https://gitlab.wikimedia.org/toolforge-repos/wiki-mail-verify/-/merge_requests/49 [15:15:52] (03update) 10fnegri: components-api: bump to 0.0.222-20261007135404-955bfbed [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1459 (https://phabricator.wikimedia.org/T440326) (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [15:15:53] (03approved) 10fnegri: components-api: bump to 0.0.222-20261007135404-955bfbed [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1459 (https://phabricator.wikimedia.org/T440326) (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [15:16:00] (03merge) 10fnegri: components-api: bump to 0.0.222-20261007135404-955bfbed [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1459 (https://phabricator.wikimedia.org/T440326) (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [15:16:14] (03update) 10renovatebot: Lock file maintenance [toolforge-repos/dewiki-voterightsnotifier] - 10https://gitlab.wikimedia.org/toolforge-repos/dewiki-voterightsnotifier/-/merge_requests/45 [15:16:16] 10Tool-spacemedia, 10Toolforge, 06tools-platform-team, 13Patch-For-Review: Update Toolforge Deploy to Heroku 24_0.21.20+ to get openjdk 27 support - https://phabricator.wikimedia.org/T439154#12406966 (10dcaro) [15:16:30] 10Toolforge, 06tools-platform-team, 07OKR-Work, 13Patch-For-Review: [components-api] Allow configs without any component - https://phabricator.wikimedia.org/T440326#12406968 (10fnegri) 05In progress→03Resolved [15:16:34] (03update) 10renovatebot: Lock file maintenance [toolforge-repos/dewiki-rangeblock] - 10https://gitlab.wikimedia.org/toolforge-repos/dewiki-rangeblock/-/merge_requests/30 [15:16:49] (03update) 10renovatebot: Lock file maintenance [toolforge-repos/flaggedrevspromotioncheck] - 10https://gitlab.wikimedia.org/toolforge-repos/flaggedrevspromotioncheck/-/merge_requests/34 [15:16:53] (03update) 10renovatebot: Lock file maintenance [toolforge-repos/dewikisignbot] - 10https://gitlab.wikimedia.org/toolforge-repos/dewikisignbot/-/merge_requests/35 [15:17:21] 06cloud-services-team, 10Toolforge, 06tools-platform-team: [builds-builder] Pull upstream heroku images weekly - https://phabricator.wikimedia.org/T431125#12406972 (10dcaro) [15:17:23] 10Cloud-VPS, 06tools-infrastructure-team: Review capacity projection setup for toolforge and cloud-vps - https://phabricator.wikimedia.org/T434128#12406974 (10fgiunchedi) >>! In T434128#12406639, @Andrew wrote: > I agree that we can probablhy bump overcommit from 2 to 3. Before we do that I'd like to get some... [15:17:26] 06cloud-services-team, 10Toolforge, 06tools-platform-team: [builds-builder] Update the "stable" image once a month - https://phabricator.wikimedia.org/T431126#12406977 (10dcaro) [15:20:33] 10Tool-spacemedia, 10Toolforge, 06tools-platform-team, 13Patch-For-Review: Update Toolforge Deploy to Heroku 24_0.21.20+ to get openjdk 27 support - https://phabricator.wikimedia.org/T439154#12407002 (10dcaro) [15:21:55] 10Tool-spacemedia, 10Toolforge, 06tools-platform-team, 13Patch-For-Review: Update Toolforge Deploy to Heroku 24_0.21.20+ to get openjdk 27 support - https://phabricator.wikimedia.org/T439154#12407018 (10dcaro) [15:34:34] 10Cloud-VPS, 06tools-infrastructure-team: Review capacity projection setup for toolforge and cloud-vps - https://phabricator.wikimedia.org/T434128#12407096 (10Andrew) btw I'm trying to provide a top-level dashboard with links here: https://grafana.wikimedia.org/d/anlf4hf/cloud-capacity-planning That links to... [15:48:11] 06tools-platform-team, 10Toolhub: [Toolhub] Remove the legacy CNAME endpoints for the URL downloaders - https://phabricator.wikimedia.org/T439732#12407311 (10fnegri) a:03fnegri [15:52:15] 06tools-platform-team, 10Toolhub: [Toolhub] Remove the legacy CNAME endpoints for the URL downloaders - https://phabricator.wikimedia.org/T439732#12407351 (10fnegri) 05Open→03In progress [15:59:48] 10Toolforge (Push-to-Deploy), 06tools-platform-team: Create a list of candidate tools for Push-to-Deploy adoption - https://phabricator.wikimedia.org/T437257#12407412 (10komla) [16:00:25] 10Toolforge (Push-to-Deploy), 06tools-platform-team: Create a list of candidate tools for Push-to-Deploy adoption - https://phabricator.wikimedia.org/T437257#12407415 (10komla) @waldyrious Task updated. Thanks! [16:01:28] 10Toolforge (Push-to-Deploy), 06tools-platform-team: Identify candidate tools for Push-to-Deploy - https://phabricator.wikimedia.org/T437897#12407427 (10komla) 05Resolved→03Invalid Marking this as invalid because it is a duplicate of T437257 [16:08:38] FIRING: ProbeDown: Service toolsbeta-test-k8s-haproxy-7:443 has failed probes (http_admin_beta_toolforge_org_ip4) - https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/k8s-haproxy - https://grafana.wikimedia.org/d/O0nHhdhnz/network-probes-overview?var-job=probes/custom&var-module=All - https://prometheus-alerts.wmcloud.org/?q=alertname%3DProbeDown [16:14:46] (03update) 10renovatebot: Update pnpm to v12.10.0 [toolforge-repos/namehistory] - 10https://gitlab.wikimedia.org/toolforge-repos/namehistory/-/merge_requests/26 [16:14:47] (03open) 10renovatebot: Update pnpm to v12.10.0 [toolforge-repos/namehistory] - 10https://gitlab.wikimedia.org/toolforge-repos/namehistory/-/merge_requests/26 [16:15:04] (03update) 10renovatebot: Update pnpm to v12.10.0 [toolforge-repos/allblocksever] - 10https://gitlab.wikimedia.org/toolforge-repos/allblocksever/-/merge_requests/37 [16:15:08] (03open) 10renovatebot: Update pnpm to v12.10.0 [toolforge-repos/allblocksever] - 10https://gitlab.wikimedia.org/toolforge-repos/allblocksever/-/merge_requests/37 [16:15:24] (03update) 10renovatebot: Update pnpm to v12.10.0 [toolforge-repos/checkusertools] - 10https://gitlab.wikimedia.org/toolforge-repos/checkusertools/-/merge_requests/33 [16:15:31] (03open) 10renovatebot: Update pnpm to v12.10.0 [toolforge-repos/checkusertools] - 10https://gitlab.wikimedia.org/toolforge-repos/checkusertools/-/merge_requests/33 [16:16:31] (03update) 10renovatebot: Update pnpm to v12.10.0 [toolforge-repos/rangetree] - 10https://gitlab.wikimedia.org/toolforge-repos/rangetree/-/merge_requests/65 [16:16:34] (03open) 10renovatebot: Update pnpm to v12.10.0 [toolforge-repos/rangetree] - 10https://gitlab.wikimedia.org/toolforge-repos/rangetree/-/merge_requests/65 [16:17:33] (03update) 10renovatebot: Update pnpm to v12.10.0 [toolforge-repos/wiki-mail-verify] - 10https://gitlab.wikimedia.org/toolforge-repos/wiki-mail-verify/-/merge_requests/52 [16:17:35] (03open) 10renovatebot: Update pnpm to v12.10.0 [toolforge-repos/wiki-mail-verify] - 10https://gitlab.wikimedia.org/toolforge-repos/wiki-mail-verify/-/merge_requests/52 [16:20:22] 10Toolforge, 06tools-platform-team, 07Epic, 07OKR-Work: Add a dedicated Toolforge alertmanager instance - https://phabricator.wikimedia.org/T435636#12407746 (10fnegri) 05Open→03Declined Closing as Declined as in the end we decided not to use Alertmanager at all (see discussion in {T432865}). [16:21:50] 10Toolforge, 06tools-platform-team, 07OKR-Work, 13Patch-For-Review: Read the opted-in tools from components-api - https://phabricator.wikimedia.org/T439554#12407760 (10fnegri) This is ready to be deployed, but we should deploy it at the same time of the announcement to users, draft is at https://etherpad.w... [16:22:09] 10Toolforge (Push-to-Deploy), 06tools-platform-team: Identify candidate maintainers - https://phabricator.wikimedia.org/T437898#12407773 (10komla) [16:23:25] 10Toolforge (Push-to-Deploy), 06tools-platform-team: Identify candidate maintainers - https://phabricator.wikimedia.org/T437898#12407797 (10komla) Updated! The list is expected to grow [16:28:38] RESOLVED: ProbeDown: Service toolsbeta-test-k8s-haproxy-7:443 has failed probes (http_admin_beta_toolforge_org_ip4) - https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/k8s-haproxy - https://grafana.wikimedia.org/d/O0nHhdhnz/network-probes-overview?var-job=probes/custom&var-module=All - https://prometheus-alerts.wmcloud.org/?q=alertname%3DProbeDown [16:34:07] 10Cloud-VPS, 06tools-infrastructure-team: Review capacity projection setup for toolforge and cloud-vps - https://phabricator.wikimedia.org/T434128#12407901 (10Andrew) >>! In T434128#12407096, @Andrew wrote: > https://grafana.wikimedia.org/d/anlf4hf/cloud-capacity-planning > ...and now I've added a bit of 'noi... [16:53:06] 10Tool-animanga-db-import-bot, 10Revision-Slider: Report bug - https://phabricator.wikimedia.org/T440497 (10Amirhosein74) 03NEW [16:57:39] 10Tool-animanga-db-import-bot, 10Revision-Slider: Report bug - https://phabricator.wikimedia.org/T440497#12408062 (10Amirhosein74) [17:04:15] 10Tool-animanga-db-import-bot, 10Revision-Slider: Report bug - https://phabricator.wikimedia.org/T440497#12408103 (10Amirhosein74) [17:06:40] 10Tool-animanga-db-import-bot, 10Revision-Slider: Report bug - https://phabricator.wikimedia.org/T440497#12408110 (10Amirhosein74) p:05Triage→03Unbreak! [17:09:38] FIRING: ProbeDown: Service toolsbeta-test-k8s-haproxy-7:443 has failed probes (http_admin_beta_toolforge_org_ip4) - https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/k8s-haproxy - https://grafana.wikimedia.org/d/O0nHhdhnz/network-probes-overview?var-job=probes/custom&var-module=All - https://prometheus-alerts.wmcloud.org/?q=alertname%3DProbeDown [17:14:38] RESOLVED: ProbeDown: Service toolsbeta-test-k8s-haproxy-7:443 has failed probes (http_admin_beta_toolforge_org_ip4) - https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/k8s-haproxy - https://grafana.wikimedia.org/d/O0nHhdhnz/network-probes-overview?var-job=probes/custom&var-module=All - https://prometheus-alerts.wmcloud.org/?q=alertname%3DProbeDown [18:00:08] 10Toolforge (Push-to-Deploy), 06tools-platform-team, 07Documentation: Write tutorial for migrating build service jobs to push-to-deploy - https://phabricator.wikimedia.org/T437477#12408432 (10dcaro) Did a pass and made some changes, you can check the diff here: https://wikitech.wikimedia.org/w/index.php?titl... [18:00:24] 10Toolforge (Push-to-Deploy), 06tools-platform-team, 07Documentation: Write tutorial for migrating build service jobs to push-to-deploy - https://phabricator.wikimedia.org/T437477#12408434 (10dcaro) [18:09:44] 10Toolforge (Push-to-Deploy), 06tools-platform-team: Identify candidate tools for Push-to-Deploy - https://phabricator.wikimedia.org/T437897#12408477 (10JJMC89) →14Duplicate dup:03T437257 [18:09:45] 10Toolforge (Push-to-Deploy), 06tools-platform-team: Create a list of candidate tools for Push-to-Deploy adoption - https://phabricator.wikimedia.org/T437257#12408479 (10JJMC89) [18:14:14] (03update) 10renovatebot: Update pnpm to v12.10.0 [toolforge-repos/namehistory] - 10https://gitlab.wikimedia.org/toolforge-repos/namehistory/-/merge_requests/26 [18:14:41] (03update) 10renovatebot: Update pnpm to v12.10.1 [toolforge-repos/namehistory] - 10https://gitlab.wikimedia.org/toolforge-repos/namehistory/-/merge_requests/26 [18:14:57] (03update) 10renovatebot: Update pnpm to v12.10.0 [toolforge-repos/allblocksever] - 10https://gitlab.wikimedia.org/toolforge-repos/allblocksever/-/merge_requests/37 [18:15:00] (03update) 10renovatebot: Update pnpm to v12.10.1 [toolforge-repos/allblocksever] - 10https://gitlab.wikimedia.org/toolforge-repos/allblocksever/-/merge_requests/37 [18:15:15] (03update) 10renovatebot: Update pnpm to v12.10.0 [toolforge-repos/checkusertools] - 10https://gitlab.wikimedia.org/toolforge-repos/checkusertools/-/merge_requests/33 [18:15:17] (03update) 10renovatebot: Update pnpm to v12.10.1 [toolforge-repos/checkusertools] - 10https://gitlab.wikimedia.org/toolforge-repos/checkusertools/-/merge_requests/33 [18:16:20] (03update) 10renovatebot: Update pnpm to v12.10.0 [toolforge-repos/rangetree] - 10https://gitlab.wikimedia.org/toolforge-repos/rangetree/-/merge_requests/65 [18:16:22] (03update) 10renovatebot: Update pnpm to v12.10.1 [toolforge-repos/rangetree] - 10https://gitlab.wikimedia.org/toolforge-repos/rangetree/-/merge_requests/65 [18:17:28] (03update) 10renovatebot: Update pnpm to v12.10.0 [toolforge-repos/wiki-mail-verify] - 10https://gitlab.wikimedia.org/toolforge-repos/wiki-mail-verify/-/merge_requests/52 [18:17:30] (03update) 10renovatebot: Update pnpm to v12.10.1 [toolforge-repos/wiki-mail-verify] - 10https://gitlab.wikimedia.org/toolforge-repos/wiki-mail-verify/-/merge_requests/52 [18:34:12] 10Tool-sentinel: Restrict admin approve/reject to valid status transitions - https://phabricator.wikimedia.org/T431893#12408566 (10EbenezerRao) Hey @Arian_Ar, Hope you're doing well! I wanted to follow up regarding this task. I’ve added the requested changes and addressed all the review comments you left on GitL... [19:15:49] (03update) 10renovatebot: Update pnpm to v12.10.1 [toolforge-repos/namehistory] - 10https://gitlab.wikimedia.org/toolforge-repos/namehistory/-/merge_requests/26 [19:16:01] (03update) 10renovatebot: Update pnpm to v12.10.1 [toolforge-repos/allblocksever] - 10https://gitlab.wikimedia.org/toolforge-repos/allblocksever/-/merge_requests/37 [19:16:12] (03update) 10renovatebot: Update pnpm to v12.10.1 [toolforge-repos/checkusertools] - 10https://gitlab.wikimedia.org/toolforge-repos/checkusertools/-/merge_requests/33 [19:18:16] (03update) 10renovatebot: Update pnpm to v12.10.1 [toolforge-repos/rangetree] - 10https://gitlab.wikimedia.org/toolforge-repos/rangetree/-/merge_requests/65 [19:19:28] (03update) 10renovatebot: Update pnpm to v12.10.1 [toolforge-repos/wiki-mail-verify] - 10https://gitlab.wikimedia.org/toolforge-repos/wiki-mail-verify/-/merge_requests/52 [19:36:17] FIRING: PrometheusRestarted: Prometheus instance tools-prometheus-9:9902 restarted - https://wikitech.wikimedia.org/wiki/Prometheus#Prometheus_was_restarted - https://prometheus-alerts.wmcloud.org/?q=alertname%3DPrometheusRestarted [19:40:05] 10Tool-wikinewsie: Wikinewsie elements fail to translate upon reload from language selector - https://phabricator.wikimedia.org/T439940#12408819 (10Pharos) [20:06:17] RESOLVED: PrometheusRestarted: Prometheus instance tools-prometheus-9:9902 restarted - https://wikitech.wikimedia.org/wiki/Prometheus#Prometheus_was_restarted - https://prometheus-alerts.wmcloud.org/?q=alertname%3DPrometheusRestarted [20:30:01] 10Cloud-VPS, 06tools-infrastructure-team, 06Test Platform (San Miguel de Allende 31): Create a flavor with virtio multiqueue for integration-cache-proxy - https://phabricator.wikimedia.org/T440418#12408984 (10Mhurd) @fgiunchedi > I am asking because I'd rather not go down the path of specialized flavors un... [20:39:52] 10Cloud-VPS, 06tools-infrastructure-team, 06Test Platform (San Miguel de Allende 31): Create a flavor with virtio multiqueue for integration-cache-proxy - https://phabricator.wikimedia.org/T440418#12409013 (10Mhurd) To your question: the synthetic load tests look good, but I wouldn't call the requirement met... [21:08:38] FIRING: ProbeDown: Service toolsbeta-test-k8s-haproxy-7:443 has failed probes (http_admin_beta_toolforge_org_ip4) - https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/k8s-haproxy - https://grafana.wikimedia.org/d/O0nHhdhnz/network-probes-overview?var-job=probes/custom&var-module=All - https://prometheus-alerts.wmcloud.org/?q=alertname%3DProbeDown [21:13:38] RESOLVED: ProbeDown: Service toolsbeta-test-k8s-haproxy-7:443 has failed probes (http_admin_beta_toolforge_org_ip4) - https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/k8s-haproxy - https://grafana.wikimedia.org/d/O0nHhdhnz/network-probes-overview?var-job=probes/custom&var-module=All - https://prometheus-alerts.wmcloud.org/?q=alertname%3DProbeDown [21:27:49] 10Cloud-VPS, 06tools-infrastructure-team, 13Patch-For-Review: cloudceph HEALTH_WARN, multiple OSD(s) experiencing slow operations in BlueStore - https://phabricator.wikimedia.org/T429387#12409135 (10Andrew) {F106869282} [21:28:39] 10Cloud-VPS, 06tools-infrastructure-team, 13Patch-For-Review: cloudceph HEALTH_WARN, multiple OSD(s) experiencing slow operations in BlueStore - https://phabricator.wikimedia.org/T429387#12409139 (10Andrew) 05Open→03Resolved Looking good. We need to not buy any more of these cursed drives, but in the... [21:30:10] (03PS1) 10NMW03: AppExtension: Break durations into at most two units of time [labs/xtools] - 10https://gerrit.wikimedia.org/r/1352637 (https://phabricator.wikimedia.org/T406182) [21:40:20] 10Toolforge, 06tools-platform-team: [maintain-harbor] add pagination when querying harbor - https://phabricator.wikimedia.org/T440294#12409183 (10Raymond_Ndibe) > Currently we use page_size=-1 but that does not give all the results, only 100 (according to the running version) I think this is not correct. To b... [21:53:09] 10Cloud-VPS, 06tools-infrastructure-team, 13Patch-For-Review: Consider updating the default CPU model for nova VMs - https://phabricator.wikimedia.org/T440400#12409205 (10Andrew) >>! In T440400#12404742, @fgiunchedi wrote: > Idea LGTM, though a few things/questions I couldn't find the answers to from wikite... [22:04:00] 10Cloud-VPS (Project-requests), 10Language-Diversity-Hub: Request creation of VPS project : LinguaData - https://phabricator.wikimedia.org/T440447#12409219 (10Yug) Hello @Andrew , thank for your feedback. I took a pause of a few hours to reply. **For Q1 - Toolforge or Wmcloud.** I'm familiar with both toolfo... [23:18:38] FIRING: ProbeDown: Service toolsbeta-test-k8s-haproxy-7:443 has failed probes (http_admin_beta_toolforge_org_ip4) - https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/k8s-haproxy - https://grafana.wikimedia.org/d/O0nHhdhnz/network-probes-overview?var-job=probes/custom&var-module=All - https://prometheus-alerts.wmcloud.org/?q=alertname%3DProbeDown [23:28:38] RESOLVED: ProbeDown: Service toolsbeta-test-k8s-haproxy-7:443 has failed probes (http_admin_beta_toolforge_org_ip4) - https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/k8s-haproxy - https://grafana.wikimedia.org/d/O0nHhdhnz/network-probes-overview?var-job=probes/custom&var-module=All - https://prometheus-alerts.wmcloud.org/?q=alertname%3DProbeDown