[10:53:09] * klausman lunch
[11:15:10] <wikibugs>	 06Machine-Learning-Team, 13Patch-For-Review: Allow calling revertrisk language agnostic and revert risk multilingual APIs in a pre-save context - https://phabricator.wikimedia.org/T356102#10105957 (10achou) The new revertrisk inference services have been deployed to production.  Example usage: ` $ curl "https:...
[13:30:21] <chrisalbon>	 Good morning all
[13:56:11] <klausman>	 morning Chris
[14:36:48] <aiko>	 o/
[16:47:24] <wikibugs>	 06Machine-Learning-Team, 10Automoderator, 10Moderator-Tools-Team (Kanban): [SPIKE]Perform a load test for Multilingual Revert Risk on LiftWing[4H] - https://phabricator.wikimedia.org/T372298#10106808 (10jsn.sherman) some updated numbers that the moderator tools engineers looked at today. Again, out ~52000 re...
[17:56:59] <jinxer-wm>	 FIRING: LiftWingServiceErrorRate: ...
[17:56:59] <jinxer-wm>	 LiftWing service has a high rate of non 2/3/400 error code responses - https://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing/Alerts#LiftWingServiceErrorRate - https://grafana.wikimedia.org/d/G7yj84Vnk/istio?orgId=1&refresh=30s&var-cluster=codfw%20prometheus/k8s-mlserve&var-namespace=revertrisk&var-backend=revertrisk-multilingual-predictor-default.%2A - https://alerts.wikimedia.org/?q=alertname%3DLiftWingServiceErrorRate
[19:06:59] <jinxer-wm>	 RESOLVED: LiftWingServiceErrorRate: ...
[19:06:59] <jinxer-wm>	 LiftWing service has a high rate of non 2/3/400 error code responses - https://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing/Alerts#LiftWingServiceErrorRate - https://grafana.wikimedia.org/d/G7yj84Vnk/istio?orgId=1&refresh=30s&var-cluster=codfw%20prometheus/k8s-mlserve&var-namespace=revertrisk&var-backend=revertrisk-multilingual-predictor-default.%2A - https://alerts.wikimedia.org/?q=alertname%3DLiftWingServiceErrorRate