[02:07:38] 06Machine-Learning-Team, 10Add-Link-Structured-Task, 10Community Feedback (Growth), 06Growth-Team: Introduce case sensitivity to Add-a-Link - https://phabricator.wikimedia.org/T434259#12200363 (10Sdkb) [02:07:39] 06Machine-Learning-Team, 10Community Feedback (Growth), 06Growth-Team, 07Epic: [EPIC] Add a Link: improvements requested by communities - https://phabricator.wikimedia.org/T434350#12200362 (10Sdkb) [02:07:43] 06Machine-Learning-Team, 10Add-Link-Structured-Task, 06Growth-Team: Explore retraining add-a-link model using first sentence after the lead - https://phabricator.wikimedia.org/T415623#12200365 (10Sdkb) [02:07:45] 06Machine-Learning-Team, 10Add-Link-Structured-Task, 06Growth-Team: Reduce tendency of Add a Link to suggest overlinks - https://phabricator.wikimedia.org/T415622#12200366 (10Sdkb) [02:07:46] 06Machine-Learning-Team, 10Add-Link-Structured-Task, 10Community Feedback (Growth), 06Growth-Team: Investigate strategies to reduce prevalence of erroneous add-a-link suggestions of proper noun homonyms - https://phabricator.wikimedia.org/T409138#12200367 (10Sdkb) [02:07:51] 06Machine-Learning-Team, 10Add-Link-Structured-Task, 10Community Feedback (Growth), 06Growth-Team: AI/ML model update request: Named Entity Recognition for Add-a-Link - https://phabricator.wikimedia.org/T405185#12200368 (10Sdkb) [04:43:31] 06Machine-Learning-Team (Q1 FY2026-27), 10VisualEditor, 10VisualEditor Suggestion Mode, 06Editing-team (FY2026-27 Q1 sprint 2): Editing Suggestions - Update static descriptions. - https://phabricator.wikimedia.org/T430030#12200459 (10ppelberg) [04:44:34] 06Machine-Learning-Team (Q1 FY2026-27), 10VisualEditor, 10VisualEditor Suggestion Mode, 06Editing-team (FY2026-27 Q1 sprint 2): Editing Suggestions - Update static descriptions. - https://phabricator.wikimedia.org/T430030#12200460 (10ppelberg) >>! In T430030#12197649, @DLynch wrote: > Sorry, I wasn't payin... [05:46:19] 06Machine-Learning-Team (Q1 FY2026-27), 05Goal, 07OKR-Work: Audio quality evaluation for TTS v1: ASR round-trip benchmark and resulting fixes - https://phabricator.wikimedia.org/T433923#12200467 (10kevinbazira) Standing benchmark baseline recorded. 30 articles / 436 sections across defect-prone content class... [05:46:48] 06Machine-Learning-Team (Q1 FY2026-27), 05Goal, 07OKR-Work: Audio quality evaluation for TTS v1: ASR round-trip benchmark and resulting fixes - https://phabricator.wikimedia.org/T433923#12200468 (10kevinbazira) [06:04:52] (03PS1) 10Kevin Bazira: tts-section-generator: pin the benchmark dataset; harden the eval harness [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1324199 (https://phabricator.wikimedia.org/T433923) [06:50:26] 06Machine-Learning-Team (Q1 FY2026-27), 06Data-Platform-SRE (2026-08-07 - 2026-08-28), 07sre-alert-triage: Alert in need of triage: SmartNotHealthy (instance ml-serve1001:9100) - https://phabricator.wikimedia.org/T414969#12200545 (10Gehel) [06:50:58] 06Machine-Learning-Team (Q1 FY2026-27), 06Data-Platform-SRE (2026-08-07 - 2026-08-28): Add the ML team to the POSIX group `docker` on `ml-build1001` - https://phabricator.wikimedia.org/T393566#12200561 (10Gehel) [06:51:20] 06Machine-Learning-Team (Q1 FY2026-27), 06Data-Platform-SRE (2026-08-07 - 2026-08-28), 07Essential-Work: Support GPU Partition specification in deployments - https://phabricator.wikimedia.org/T424923#12200571 (10Gehel) [06:57:32] 06Machine-Learning-Team (Q1 FY2026-27), 06Data-Platform-SRE (2026-08-07 - 2026-08-28): ml-serve: review documentation and apply AMD MI300X system-optimization settings to ml-serve1012-1015 - https://phabricator.wikimedia.org/T431553#12200697 (10Gehel) [06:58:20] 06Machine-Learning-Team (Q1 FY2026-27), 06Data-Platform-SRE (2026-08-07 - 2026-08-28): Pods evicted on ml-serve-eqiad due to disk pressure - https://phabricator.wikimedia.org/T431017#12200717 (10Gehel) [06:59:09] 06Machine-Learning-Team (Q1 FY2026-27), 06Data-Platform-SRE (2026-08-07 - 2026-08-28): Possibility to transition ml-serve[2001-2008] and and ml-staging[2001-2002] to 10G - https://phabricator.wikimedia.org/T378714#12200737 (10Gehel) [06:59:23] 06Machine-Learning-Team (Q1 FY2026-27), 10decommission-hardware, 06Data-Platform-SRE (2026-08-07 - 2026-08-28), 13Patch-For-Review: decommission ml-cache* - https://phabricator.wikimedia.org/T430654#12200739 (10Gehel) [07:27:26] (03CR) 10Bartosz Wójtowicz: [C:03+1] "LGTM, let's transform it into a regression test in the near future! ❤️" [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1324199 (https://phabricator.wikimedia.org/T433923) (owner: 10Kevin Bazira) [07:28:31] (03CR) 10Kevin Bazira: [C:03+2] tts-section-generator: pin the benchmark dataset; harden the eval harness [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1324199 (https://phabricator.wikimedia.org/T433923) (owner: 10Kevin Bazira) [07:35:57] (03Merged) 10jenkins-bot: tts-section-generator: pin the benchmark dataset; harden the eval harness [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1324199 (https://phabricator.wikimedia.org/T433923) (owner: 10Kevin Bazira) [08:31:34] 06Machine-Learning-Team (Q1 FY2026-27): Create dataset of article titles for TTS V1 - https://phabricator.wikimedia.org/T432128#12201063 (10BWojtowicz-WMF) Thank you for the review! Regarding removing the list pages - we can easily apply one set of filters to the full list and another one only to seeds - I'll r... [09:59:20] hihi, just waiting on getting my account approved on https://liftwing-studio.wmcloud.org (email has `theresnotime` in it) - anything more I need to do other than wait? [10:04:19] (03PS1) 10Kevin Bazira: tts-section-generator: arrow glyph fix and benchmark name respellings (ruleset 2026.08.10) [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1324273 (https://phabricator.wikimedia.org/T433923) [10:04:31] (03CR) 10CI reject: [V:04-1] tts-section-generator: arrow glyph fix and benchmark name respellings (ruleset 2026.08.10) [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1324273 (https://phabricator.wikimedia.org/T433923) (owner: 10Kevin Bazira) [10:28:40] TheresNoTime: thank you for reaching out. I've pinged the ML team manager and they are working on the approval [10:29:19] thanks! [10:30:29] (03CR) 10Kevin Bazira: "recheck" [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1324273 (https://phabricator.wikimedia.org/T433923) (owner: 10Kevin Bazira) [11:04:10] pinged releng as CI seems to be failing with a JDK spawn issue: https://integration.wikimedia.org/ci/job/inference-services-pipeline-pre-commit-check/887/console [11:06:14] TheresNoTime: your account should be approved [11:23:03] working, thank you [12:24:20] 06Machine-Learning-Team (Q1 FY2026-27), 06Data-Platform-SRE (2026-08-07 - 2026-08-28): Possibility to transition ml-serve[2001-2008] and and ml-staging[2001-2002] to 10G - https://phabricator.wikimedia.org/T378714#12202209 (10klausman) 05In progress→03Resolved As I understand it, this change is not som... [12:26:19] 06Machine-Learning-Team (Q1 FY2026-27), 06Data-Platform-SRE (2026-08-07 - 2026-08-28), 07sre-alert-triage: Alert in need of triage: SmartNotHealthy (instance ml-serve1001:9100) - https://phabricator.wikimedia.org/T414969#12202222 (10klausman) 05Open→03Resolved Disk situation has been resolved, see T4... [12:31:33] 06Machine-Learning-Team, 06Data-Platform-SRE: Decide on the future shape of ML/LW SLOs, and how they are monitored - https://phabricator.wikimedia.org/T434525 (10klausman) 03NEW [12:32:29] 06Machine-Learning-Team: Set SLO for the article-descriptions isvc hosted on LiftWing - https://phabricator.wikimedia.org/T358655#12202281 (10klausman) 05Open→03Declined I am closing this bug in favor of the admittedly broader task T434525 [12:51:30] 06Machine-Learning-Team (Q1 FY2026-27), 07Essential-Work: Set ephemeral-storage requests/limits on ML predictor containers to prevent node disk eviction - https://phabricator.wikimedia.org/T431089#12202383 (10BWojtowicz-WMF) I've also updated non-KServe deployments to include `ephemeral-storage` limits/request... [12:51:40] 06Machine-Learning-Team (Q1 FY2026-27), 07Essential-Work: Set ephemeral-storage requests/limits on ML predictor containers to prevent node disk eviction - https://phabricator.wikimedia.org/T431089#12202385 (10BWojtowicz-WMF) 05Open→03Resolved [12:51:56] 06Machine-Learning-Team (Q1 FY2026-27), 07Essential-Work: Set ephemeral-storage requests/limits on ML predictor containers to prevent node disk eviction - https://phabricator.wikimedia.org/T431089#12202390 (10BWojtowicz-WMF) a:03BWojtowicz-WMF [13:06:05] 06Machine-Learning-Team (Q1 FY2026-27): qwen36: Support thinking mode on the OpenAI-compatible endpoints - https://phabricator.wikimedia.org/T433569#12202459 (10kevinbazira) [13:09:02] 06Machine-Learning-Team (Q1 FY2026-27): Add ephemeral-storage to KServe sidecar containers and enforce it on the chart level - https://phabricator.wikimedia.org/T434534 (10BWojtowicz-WMF) 03NEW [13:38:52] 06Machine-Learning-Team (Q1 FY2026-27): Update Revise Tone pipelines to incorporate additional languages and update topic filters - https://phabricator.wikimedia.org/T433319#12202835 (10BWojtowicz-WMF) a:03BWojtowicz-WMF [14:14:43] 06Machine-Learning-Team (Q1 FY2026-27), 10VisualEditor, 10VisualEditor Suggestion Mode, 06Editing-team (FY2026-27 Q1 sprint 2): Editing Suggestions - Update static descriptions. - https://phabricator.wikimedia.org/T430030#12203189 (10achou) 05Open→03Resolved [14:14:54] 06Machine-Learning-Team (Q1 FY2026-27), 10VisualEditor, 10VisualEditor Suggestion Mode, 06Editing-team (FY2026-27 Q1 sprint 2): Editing Suggestions - Update static descriptions. - https://phabricator.wikimedia.org/T430030#12203194 (10achou) 05Resolved→03Open [14:15:32] (03CR) 10Kevin Bazira: "pinged releng as CI seems to be failing with a JDK spawn issue: https://integration.wikimedia.org/ci/job/inference-services-pipeline-pre-c" [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1324273 (https://phabricator.wikimedia.org/T433923) (owner: 10Kevin Bazira) [14:15:35] 06Machine-Learning-Team (Q1 FY2026-27), 06Data-Platform-SRE: Decide on the future shape of ML/LW SLOs, and how they are monitored - https://phabricator.wikimedia.org/T434525#12203200 (10isarantopoulos) [14:19:30] 06Machine-Learning-Team (Q1 FY2026-27): TTS batch generation pipeline for Featured Articles - https://phabricator.wikimedia.org/T428435#12203220 (10isarantopoulos) 05Open→03Resolved [14:42:06] 06Machine-Learning-Team (Q1 FY2026-27), 07Essential-Work: Add ephemeral-storage to KServe sidecar containers and enforce it on the chart level - https://phabricator.wikimedia.org/T434534#12203332 (10isarantopoulos) [14:48:37] 06Machine-Learning-Team (Q1 FY2026-27), 06Data-Platform-SRE (2026-08-07 - 2026-08-28): ml-serve: review documentation and apply AMD MI300X system-optimization settings to ml-serve1012-1015 - https://phabricator.wikimedia.org/T431553#12203368 (10klausman) (apologies in advance for a wall of text, but there is a... [14:48:49] 06Machine-Learning-Team (Q1 FY2026-27): Enable Structured Outputs for LLMs - https://phabricator.wikimedia.org/T434059#12203374 (10isarantopoulos) [15:02:45] (03PS1) 10Kevin Bazira: qwen36: support thinking_token_budget on :predict endpoint [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1324337 (https://phabricator.wikimedia.org/T433569) [15:02:53] (03CR) 10CI reject: [V:04-1] qwen36: support thinking_token_budget on :predict endpoint [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1324337 (https://phabricator.wikimedia.org/T433569) (owner: 10Kevin Bazira) [15:03:35] 06Machine-Learning-Team (Q1 FY2026-27), 13Patch-For-Review: qwen36: Support thinking mode on the OpenAI-compatible endpoints - https://phabricator.wikimedia.org/T433569#12203505 (10kevinbazira) a:03kevinbazira [15:25:53] (03CR) 10Kevin Bazira: "recheck" [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1324273 (https://phabricator.wikimedia.org/T433923) (owner: 10Kevin Bazira) [15:26:05] (03CR) 10Kevin Bazira: "recheck" [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1324337 (https://phabricator.wikimedia.org/T433569) (owner: 10Kevin Bazira) [15:32:00] 06Machine-Learning-Team, 06Editing-team, 10VisualEditor, 10VisualEditor Suggestion Mode, 07Epic: [Epic] Develop a framework for invalidating edit suggestions - https://phabricator.wikimedia.org/T429426#12203695 (10dchan) [17:42:59] 06Machine-Learning-Team (Q1 FY2026-27), 10VisualEditor, 10VisualEditor Suggestion Mode, 06Editing-team (FY2026-27 Q1 sprint 2): Editing Suggestions - Update static descriptions. - https://phabricator.wikimedia.org/T430030#12204446 (10DLynch) [17:43:23] 06Machine-Learning-Team (Q1 FY2026-27), 10VisualEditor, 10VisualEditor Suggestion Mode, 06Editing-team (FY2026-27 Q1 sprint 2): Editing Suggestions - Update static descriptions. - https://phabricator.wikimedia.org/T430030#12204450 (10DLynch) @ppelberg Those look correct, yes. I made a minor edit to the gra... [17:52:57] 06Machine-Learning-Team (Q1 FY2026-27), 10VisualEditor, 10VisualEditor Suggestion Mode, 06Editing-team (FY2026-27 Q1 sprint 2): Editing Suggestions - Update static descriptions. - https://phabricator.wikimedia.org/T430030#12204519 (10ppelberg) >>! In T430030#12204446, @DLynch wrote: > @ppelberg Those look... [17:55:56] 06Machine-Learning-Team (Q1 FY2026-27), 10VisualEditor, 10VisualEditor Suggestion Mode, 06Editing-team (FY2026-27 Q1 sprint 2): Editing Suggestions - Update static descriptions. - https://phabricator.wikimedia.org/T430030#12204530 (10ppelberg)