[06:19:21] 06Machine-Learning-Team, 10Add-Link-Structured-Task, 10Community Feedback (Growth), 06Growth-Team: AI/ML model update request: Named Entity Recognition for Add-a-Link - https://phabricator.wikimedia.org/T405185#12043761 (10Wellverywell) [07:24:07] 10Lift-Wing, 06Machine-Learning-Team (Q4 FY2025-26), 07Essential-Work: Rebuild vLLM base images to use deb.debian.org in apt sources - https://phabricator.wikimedia.org/T429667#12043846 (10kevinbazira) The vllm014 image has also been rebuilt and now uses `deb.debian.org` in apt sources: ` $ docker run --netw... [07:43:00] (03PS1) 10Kevin Bazira: pipeline: update LLM blubberfiles to use the rebuilt vllm014 base image (T429667#12043846) [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1305030 (https://phabricator.wikimedia.org/T429667) [08:10:42] (03PS3) 10Gkyziridis: qwen36: Retrigger CI/CD [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1304823 (https://phabricator.wikimedia.org/T425680) [08:27:50] (03PS4) 10Gkyziridis: qwen36: Retrigger CI/CD [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1304823 (https://phabricator.wikimedia.org/T425680) [08:35:11] (03PS1) 10Kevin Bazira: pipeline: update LLM blubberfiles to use the rebuilt vllm014 base image (T429667#12043846) [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1305030 (https://phabricator.wikimedia.org/T429667) [08:35:41] (03CR) 10Kevin Bazira: [C:03+1] qwen36: Retrigger CI/CD [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1304823 (https://phabricator.wikimedia.org/T425680) (owner: 10Gkyziridis) [08:41:28] (03CR) 10Gkyziridis: [C:03+1] pipeline: update LLM blubberfiles to use the rebuilt vllm014 base image (T429667#12043846) [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1305030 (https://phabricator.wikimedia.org/T429667) (owner: 10Kevin Bazira) [08:59:01] (03CR) 10Gkyziridis: [C:03+2] qwen36: Retrigger CI/CD [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1304823 (https://phabricator.wikimedia.org/T425680) (owner: 10Gkyziridis) [09:01:01] (03CR) 10Kevin Bazira: [C:03+2] pipeline: update LLM blubberfiles to use the rebuilt vllm014 base image (T429667#12043846) [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1305030 (https://phabricator.wikimedia.org/T429667) (owner: 10Kevin Bazira) [09:01:17] (03Merged) 10jenkins-bot: qwen36: Retrigger CI/CD [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1304823 (https://phabricator.wikimedia.org/T425680) (owner: 10Gkyziridis) [09:01:36] (03Merged) 10jenkins-bot: pipeline: update LLM blubberfiles to use the rebuilt vllm014 base image (T429667#12043846) [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1305030 (https://phabricator.wikimedia.org/T429667) (owner: 10Kevin Bazira) [09:24:24] 10Lift-Wing, 06Machine-Learning-Team (Q4 FY2025-26), 07Essential-Work, 13Patch-For-Review: Rebuild vLLM base images to use deb.debian.org in apt sources - https://phabricator.wikimedia.org/T429667#12044367 (10kevinbazira) Both vLLM base images have been rebuilt to use `deb.debian.org` in apt sources: -... [09:37:59] 10Lift-Wing, 06Machine-Learning-Team (Q4 FY2025-26), 13Patch-For-Review: Redeploy Liftwing pick up current mirror - https://phabricator.wikimedia.org/T429675#12044437 (10kevinbazira) >>! In T429675#12041104, @achou wrote: > The one I'm unsure about is the `embeddings` model server, which uses the vllm image... [09:41:57] (03CR) 10AikoChou: [C:03+2] blubber: bump base images to drop mirrors.wikimedia.org [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1304824 (https://phabricator.wikimedia.org/T429675) (owner: 10AikoChou) [09:43:19] (03Merged) 10jenkins-bot: blubber: bump base images to drop mirrors.wikimedia.org [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1304824 (https://phabricator.wikimedia.org/T429675) (owner: 10AikoChou) [11:54:35] 06Machine-Learning-Team (Q4 FY2025-26): Editing Suggestions - Increase/refresh LLM generated suggestions. - https://phabricator.wikimedia.org/T428882#12044952 (10OKarakaya-WMF) api is updated with the new suggestions shared with the team. https://wikimedia.slack.com/archives/C0B350MRBBM/p1782215632966339?thread_... [11:58:48] 06Machine-Learning-Team (Q4 FY2025-26): Editing Suggestions - Increase/refresh LLM generated suggestions. - https://phabricator.wikimedia.org/T428882#12044980 (10OKarakaya-WMF) You can find the full list of suggestions with the page names in the folder. We believe this should enable the phase1 tests in experime... [12:15:40] 06Machine-Learning-Team (Q4 FY2025-26), 10Liberica, 10Prod-Kubernetes, 06Traffic, and 2 others: Migrate ML k8s apiserver and services to IPIP - https://phabricator.wikimedia.org/T420438#12045079 (10ops-monitoring-bot) Roll-reboot of nodes in ml-staging-codfw cluster started by klausman: * ml-staging-ctrl[2... [12:30:30] 10Lift-Wing, 06Machine-Learning-Team (Q4 FY2025-26), 06ServiceOps new, 10ServiceOps-SharedInfra, and 2 others: Host Qwen 3.6-27B as an inference service - https://phabricator.wikimedia.org/T425680#12045125 (10isarantopoulos) Reporting back here after some slack conversations. The reported errors in the rel... [13:10:39] 06Machine-Learning-Team (Q4 FY2025-26), 13Patch-For-Review: Experiment with new kserve version on ml-staging-codfw - https://phabricator.wikimedia.org/T419722#12045335 (10DPogorzelski-WMF) 05Open→03Resolved [14:23:18] (03PS1) 10Kevin Bazira: qwen36: remove hipconfig shim as it's no longer needed [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1305142 (https://phabricator.wikimedia.org/T425680) [20:21:59] 06Machine-Learning-Team, 10VisualEditor Suggestion Mode, 06Editing-team (Editing-current-Q4-22Jun-3Jul-2026), 13Patch-For-Review: Build PoC for integrating initial set of MoS LLM-generated suggestions into Suggestion Mode as `experimental` - https://phabricator.wikimedia.org/T428641#12048070 (10VPuffetMiche...