[06:17:59] <wikibugs>	 (03PS1) 10Bartosz Wójtowicz: outlink-topic-model: Sanitize output from V2 endpoint. [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1295361 (https://phabricator.wikimedia.org/T418493)
[06:20:24] <wikibugs>	 (03CR) 10CI reject: [V:04-1] outlink-topic-model: Sanitize output from V2 endpoint. [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1295361 (https://phabricator.wikimedia.org/T418493) (owner: 10Bartosz Wójtowicz)
[06:27:24] <wikibugs>	 (03PS2) 10Bartosz Wójtowicz: outlink-topic-model: Sanitize output from V2 endpoint. [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1295361 (https://phabricator.wikimedia.org/T418493)
[06:42:26] <wikibugs>	 06Machine-Learning-Team (Q4 FY2025-26), 05Goal, 07OKR-Work: Q1 FY2025-26 Goal: Make article topic data available at scale and within SLOs for Year in Review - https://phabricator.wikimedia.org/T392833#11966130 (10BWojtowicz-WMF) **Status Update**  We established Hoarde and Article Topic integration on stagin...
[07:06:22] <wikibugs>	 06Machine-Learning-Team (Q4 FY2025-26): Add word-level timestamps in TTS prototype - https://phabricator.wikimedia.org/T427488#11966153 (10kevinbazira)
[07:48:06] <wikibugs>	 06Machine-Learning-Team, 10VisualEditor, 13Patch-For-Review: Integrating real time edit checks in Visual Editor using ML - https://phabricator.wikimedia.org/T393301#11966214 (10PatchDemoBot) Test wiki **created** on [[ https://patchdemo.wmcloud.org | Patch demo ]] by ISarantopoulos-WMF using patch(es) linked...
[10:46:02] <wikibugs>	 06Machine-Learning-Team (Q4 FY2025-26): Fix text normalization edge cases in TTS prototype - https://phabricator.wikimedia.org/T426756#11966668 (10kevinbazira) We found another text normalization edge case while working on {T427488}.  This can be reproduced by visiting the Earth article and looking at the [S...
[10:48:02] <wikibugs>	 06Machine-Learning-Team (Q4 FY2025-26): Fix text normalization edge cases in TTS prototype - https://phabricator.wikimedia.org/T426756#11966672 (10kevinbazira)
[11:17:00] <wikibugs>	 06Machine-Learning-Team (Q4 FY2025-26), 06Research, 05Goal, 13Patch-For-Review: Q4 FY2025-26 Goal: Text-to-Speech - https://phabricator.wikimedia.org/T419288#11966787 (10kevinbazira) **Weekly Update:**  * Continued iterating on the feedback provided to fix issues reported in the TTS prototype  ** Added sec...
[11:52:59] <wikibugs>	 (03CR) 10Gkyziridis: [C:03+1] "Thnx for working on this!" [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1293768 (https://phabricator.wikimedia.org/T419455) (owner: 10Alex Paskulin)
[12:11:49] <jinxer-wm>	 FIRING: KubernetesDeploymentUnavailableReplicas: ...
[12:11:49] <jinxer-wm>	 Deployment recommendation-api-ng-main in recommendation-api-ng at eqiad has persistently unavailable replicas - https://wikitech.wikimedia.org/wiki/Kubernetes/Troubleshooting#Troubleshooting_a_deployment - https://grafana.wikimedia.org/d/a260da06-259a-4ee4-9540-5cab01a246c8/kubernetes-deployment-details?var-site=eqiad&var-cluster=k8s-mlserve&var-namespace=recommendation-api-ng&var-deployment=recommendation-api-ng-main - ...
[12:11:49] <jinxer-wm>	 https://alerts.wikimedia.org/?q=alertname%3DKubernetesDeploymentUnavailableReplicas
[12:21:49] <jinxer-wm>	 RESOLVED: KubernetesDeploymentUnavailableReplicas: ...
[12:21:49] <jinxer-wm>	 Deployment recommendation-api-ng-main in recommendation-api-ng at eqiad has persistently unavailable replicas - https://wikitech.wikimedia.org/wiki/Kubernetes/Troubleshooting#Troubleshooting_a_deployment - https://grafana.wikimedia.org/d/a260da06-259a-4ee4-9540-5cab01a246c8/kubernetes-deployment-details?var-site=eqiad&var-cluster=k8s-mlserve&var-namespace=recommendation-api-ng&var-deployment=recommendation-api-ng-main - ...
[12:21:49] <jinxer-wm>	 https://alerts.wikimedia.org/?q=alertname%3DKubernetesDeploymentUnavailableReplicas
[17:26:30] <wikibugs>	 (03CR) 10Alex Paskulin: "Sounds good! Thanks for the review!" [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1293768 (https://phabricator.wikimedia.org/T419455) (owner: 10Alex Paskulin)
[18:56:49] <jinxer-wm>	 FIRING: KubernetesDeploymentUnavailableReplicas: ...
[18:56:49] <jinxer-wm>	 Deployment recommendation-api-ng-main in recommendation-api-ng at eqiad has persistently unavailable replicas - https://wikitech.wikimedia.org/wiki/Kubernetes/Troubleshooting#Troubleshooting_a_deployment - https://grafana.wikimedia.org/d/a260da06-259a-4ee4-9540-5cab01a246c8/kubernetes-deployment-details?var-site=eqiad&var-cluster=k8s-mlserve&var-namespace=recommendation-api-ng&var-deployment=recommendation-api-ng-main - ...
[18:56:49] <jinxer-wm>	 https://alerts.wikimedia.org/?q=alertname%3DKubernetesDeploymentUnavailableReplicas
[19:16:49] <jinxer-wm>	 RESOLVED: KubernetesDeploymentUnavailableReplicas: ...
[19:16:49] <jinxer-wm>	 Deployment recommendation-api-ng-main in recommendation-api-ng at eqiad has persistently unavailable replicas - https://wikitech.wikimedia.org/wiki/Kubernetes/Troubleshooting#Troubleshooting_a_deployment - https://grafana.wikimedia.org/d/a260da06-259a-4ee4-9540-5cab01a246c8/kubernetes-deployment-details?var-site=eqiad&var-cluster=k8s-mlserve&var-namespace=recommendation-api-ng&var-deployment=recommendation-api-ng-main - ...
[19:16:49] <jinxer-wm>	 https://alerts.wikimedia.org/?q=alertname%3DKubernetesDeploymentUnavailableReplicas