[07:00:36] <wikibugs>	 (03CR) 10Kevin Bazira: [C: 03+1] revertrisk-batch: async fetching data and batch prediction [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/985350 (https://phabricator.wikimedia.org/T352987) (owner: 10AikoChou)
[07:37:55] <wikibugs>	 10Machine-Learning-Team: Create external endpoint for recommendation-api-ng hosted on LiftWing - https://phabricator.wikimedia.org/T347263 (10kevinbazira)
[07:38:15] <wikibugs>	 10Machine-Learning-Team: Fix rec-api-ng relative paths handling - https://phabricator.wikimedia.org/T354601 (10kevinbazira) 05Open→03Resolved p:05Triage→03Medium
[08:34:58] <wikibugs>	 10Machine-Learning-Team: Refactor wrk load tests to make them DRY - https://phabricator.wikimedia.org/T354722 (10kevinbazira)
[09:02:34] <isaranto>	 Hey!
[10:03:54] <klausman>	 Morning :)
[10:08:05] <isaranto>	 \o
[10:08:32] <wikibugs>	 (03CR) 10Ilias Sarantopoulos: [C: 03+1] revert-risk: add missing force_http arg in batch model [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/985347 (https://phabricator.wikimedia.org/T353622) (owner: 10AikoChou)
[10:10:09] <wikibugs>	 (03CR) 10Klausman: Add Makefile for local-run (032 comments) [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/988666 (https://phabricator.wikimedia.org/T352689) (owner: 10AikoChou)
[10:50:24] <wikibugs>	 (03CR) 10Ilias Sarantopoulos: [C: 03+1] revert-risk: refactor checking empty result for wikidata model [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/985349 (owner: 10AikoChou)
[11:21:39] * klausman lunch
[11:43:08] * isaranto lunch
[11:54:16] <chrisalbon>	 Gooooood morning all
[12:18:32] <isaranto>	 morning Chris!
[14:13:48] <chrisalbon>	 Quiet today
[14:22:15] <wikibugs>	 10Machine-Learning-Team, 10SRE Observability (FY2023/2024-Q2): Gap in metrics rendered from Thanos Rules - https://phabricator.wikimedia.org/T352756 (10klausman) a:05elukey→03klausman
[14:22:55] <klausman>	 Yeah, I am staring into an abyss of Promtheus logs and timeseries regarding the above bug. So far, I've found nothing that would explain the gaps.
[15:02:13] <klausman>	 Rebooting ml-staging2001 since the GPU is in a weird state
[16:02:01] <isaranto>	 klausman: you joining?
[16:02:08] <klausman>	 in a sec
[16:02:14] <isaranto>	 ok!
[17:19:48] <isaranto>	 heading out folks, cu tomorrow!
[17:28:39] <klausman>	 \o
[17:48:17] <klausman>	 I'm heading out as well, see y'all tomorrow
[18:02:41] <chrisalbon>	 night klausman