[04:39:12] 06Machine-Learning-Team (Q1 FY2026-27), 05Goal, 07OKR-Work: Implement TTS Section Generator Phase 1: API contract and core library (without transcoding, deployment, and the batch pilot) - https://phabricator.wikimedia.org/T432009#12122377 (10kevinbazira) [06:00:21] 06Machine-Learning-Team (Q1 FY2026-27), 05Goal, 07OKR-Work: Implement TTS Section Generator Phase 1: API contract and core library (without transcoding, deployment, and the batch pilot) - https://phabricator.wikimedia.org/T432009#12122403 (10kevinbazira) Here is a cross-revision comparison that demonstrates... [06:58:12] 06Machine-Learning-Team (Q1 FY2026-27), 05Goal, 07OKR-Work: TTS Section Generator Phase 2: delivery artifacts, deterministic transcoding, and error-taxonomy hardening - https://phabricator.wikimedia.org/T432198 (10kevinbazira) 03NEW [06:59:53] 06Machine-Learning-Team (Q1 FY2026-27), 05Goal, 07OKR-Work: TTS Section Generator Phase 1: API contract and core library (without transcoding, deployment, and the batch pilot) - https://phabricator.wikimedia.org/T432009#12122507 (10kevinbazira) Phase 1 is completed and we've moved to {T432198} [06:59:56] 06Machine-Learning-Team (Q1 FY2026-27), 05Goal, 07OKR-Work: TTS Section Generator Phase 1: API contract and core library (without transcoding, deployment, and the batch pilot) - https://phabricator.wikimedia.org/T432009#12122509 (10kevinbazira) 05Open→03Resolved [08:26:58] 06Machine-Learning-Team (Q1 FY2026-27), 06Data-Platform-SRE (2026-07-03 - 2026-07-31), 07sre-alert-triage: Alert in need of triage: SmartNotHealthy (instance ml-serve1001:9100) - https://phabricator.wikimedia.org/T414969#12122700 (10Gehel) [08:26:59] 06Machine-Learning-Team, 06Data-Platform-SRE, 06DC-Ops, 10ops-eqiad, 06SRE: hw troubleshooting: failing disk in ml-serve1001.eqiad.wmnet - https://phabricator.wikimedia.org/T432105#12122701 (10Gehel) [08:31:21] 06Machine-Learning-Team, 06Data-Platform-SRE, 07Essential-Work: Document procedure for updating the underlying distro for model servers (e.g. Bullseye -> Bookworm) - https://phabricator.wikimedia.org/T352189#12122710 (10Gehel) [08:47:19] 06Machine-Learning-Team (Q1 FY2026-27), 05Goal, 07OKR-Work: TTS Section Generator Phase 2: delivery artifacts, deterministic transcoding, and error-taxonomy hardening - https://phabricator.wikimedia.org/T432198#12122764 (10kevinbazira) Unit tests are passing for the phase 2 core library (v0 VTT/JSON formatti... [08:49:28] (03PS1) 10Kevin Bazira: tts_section_generator: Add Phase 2 delivery artifacts and hardening [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1310974 (https://phabricator.wikimedia.org/T432198) [09:26:37] 06Machine-Learning-Team (Q1 FY2026-27), 05Goal, 07OKR-Work, 13Patch-For-Review: TTS Section Generator Phase 2: delivery artifacts, deterministic transcoding, and error-taxonomy hardening - https://phabricator.wikimedia.org/T432198#12122967 (10kevinbazira) After starting the phase 2 section generator servic... [09:37:17] 06Machine-Learning-Team (Q1 FY2026-27), 10Wikidata, 06Wikidata-Omega (Triaging): Threshold analysis for WMDE use cases of Wikidata RR model - https://phabricator.wikimedia.org/T429049#12123019 (10karapayneWMDE) [10:01:33] 06Machine-Learning-Team, 13Patch-For-Review, 10Release Pipeline (Blubber): Adding uv as a package manager on Lift Wing/blubber - https://phabricator.wikimedia.org/T384584#12123161 (10santhosh) Hi @gkyziridis, I am planning to take up this. Hope you dont mind. I will work on top of your commits. @dduvall Cou... [10:03:08] 06Machine-Learning-Team (Q1 FY2026-27), 05Goal, 07OKR-Work, 13Patch-For-Review: TTS Section Generator Phase 2: delivery artifacts, deterministic transcoding, and error-taxonomy hardening - https://phabricator.wikimedia.org/T432198#12123167 (10kevinbazira) Transcode determinism: the same section generated t... [10:03:37] (03CR) 10Kevin Bazira: [C:03+2] tts_section_generator: Add Phase 2 delivery artifacts and hardening [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1310974 (https://phabricator.wikimedia.org/T432198) (owner: 10Kevin Bazira) [10:05:04] (03Merged) 10jenkins-bot: tts_section_generator: Add Phase 2 delivery artifacts and hardening [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1310974 (https://phabricator.wikimedia.org/T432198) (owner: 10Kevin Bazira) [10:34:10] 06Machine-Learning-Team (Q1 FY2026-27), 05Goal, 07OKR-Work: TTS Section Generator Phase 2: delivery artifacts, deterministic transcoding, and error-taxonomy hardening - https://phabricator.wikimedia.org/T432198#12123295 (10kevinbazira) Request shaping: audio-only requests ride the alignment-free path (`times... [11:04:59] 06Machine-Learning-Team (Q1 FY2026-27), 05Goal, 07OKR-Work: TTS Section Generator Phase 2: delivery artifacts, deterministic transcoding, and error-taxonomy hardening - https://phabricator.wikimedia.org/T432198#12123420 (10kevinbazira) Error taxonomy: Phase 2's deterministic 4xx codes, plus phase 1 regressio... [13:02:08] 06Machine-Learning-Team, 10Cloud-VPS, 06collaboration-services, 06Data-Persistence, and 8 others: codfw: rack B5 maintenance - https://phabricator.wikimedia.org/T430918#12124086 (10cmooney) 05Open→03Resolved [14:27:17] 06Machine-Learning-Team, 06cloud-services-team, 06Data-Persistence, 06Infrastructure-Foundations, and 4 others: codfw: rack B7 maintenance - https://phabricator.wikimedia.org/T430928#12124571 (10hnowlan) [14:28:38] 06Machine-Learning-Team, 06cloud-services-team, 06Data-Persistence, 06Infrastructure-Foundations, and 4 others: codfw: rack B7 maintenance - https://phabricator.wikimedia.org/T430928#12124577 (10hnowlan) alert2002 *shouldn't* cause many problems as all clients are aware of both alert hosts. However, this *... [14:46:41] 06Machine-Learning-Team, 06cloud-services-team, 06Data-Persistence, 06Infrastructure-Foundations, and 4 others: codfw: rack B7 maintenance - https://phabricator.wikimedia.org/T430928#12124681 (10hnowlan) [15:01:52] 06Machine-Learning-Team (Q1 FY2026-27), 06Infrastructure-Foundations: Move all Machine Learning Docker images under the /ml prefix in the Docker Registry - https://phabricator.wikimedia.org/T428022#12124802 (10elukey) Today I tried the `skopeo` tool on registry1004, that seems really nice: ` elukey@registry10... [17:12:27] 06Machine-Learning-Team (Q1 FY2026-27), 13Patch-For-Review: Add Wikidata RevertRisk predictions to mediawiki.page_revert_risk_prediction_change - https://phabricator.wikimedia.org/T420883#12125396 (10achou) **Update** The revertrisk-wikidata prediction stream is now live in production and available via EventS... [17:25:43] 06Machine-Learning-Team (Q1 FY2026-27): Wikidata RevertRisk: 500 error from fetch_labels_from_api() on some property lookups - https://phabricator.wikimedia.org/T432269 (10achou) 03NEW [23:43:56] 06Machine-Learning-Team (Q1 FY2026-27), 05Goal, 07OKR-Work: TTS Section Generator Phase 3: containerization with baked NeMo cache, staging deployment, and the timeout and blob-write de-risking spikes - https://phabricator.wikimedia.org/T432308 (10kevinbazira) 03NEW [23:46:00] 06Machine-Learning-Team (Q1 FY2026-27), 05Goal, 07OKR-Work: TTS Section Generator Phase 2: delivery artifacts, deterministic transcoding, and error-taxonomy hardening - https://phabricator.wikimedia.org/T432198#12126500 (10kevinbazira) 05Open→03Resolved Phase 2 is completed and we've moved to {T432308}