[07:14:35] 10Machine-Learning-Team, 10Wikipedia-Android-App-Backlog (Android Release - FY2023-24): Migrate Machine-generated Article Descriptions from toolforge to liftwing. - https://phabricator.wikimedia.org/T343123 (10kevinbazira) Hi @Isaac and @Seddon, while working on the migration of the article-descriptions model... [08:15:31] (03PS1) 10Kevin Bazira: article-descriptions: add article-descriptions model server [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/970831 (https://phabricator.wikimedia.org/T343123) [08:18:43] (03CR) 10Kevin Bazira: "For more context, this model-server was based off the machine-generated article descriptions api currently hosted on toolforge using this " [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/970831 (https://phabricator.wikimedia.org/T343123) (owner: 10Kevin Bazira) [09:00:26] good morning! [11:14:56] 10Machine-Learning-Team, 10serviceops: Multiple images fail to build from sources - https://phabricator.wikimedia.org/T350366 (10Joe) [11:15:08] 10Machine-Learning-Team, 10serviceops: Multiple images fail to build from sources - https://phabricator.wikimedia.org/T350366 (10Joe) p:05Triage→03High [11:15:21] 10Machine-Learning-Team, 10serviceops: Multiple images fail to build from sources - https://phabricator.wikimedia.org/T350366 (10Joe) a:03Joe [11:53:42] 10Machine-Learning-Team, 10serviceops: Multiple images fail to build from sources - https://phabricator.wikimedia.org/T350366 (10Joe) [11:57:13] * elukey lunch! [12:00:24] 10Machine-Learning-Team, 10serviceops: Multiple images fail to build from sources - https://phabricator.wikimedia.org/T350366 (10Joe) The error in the loki build is due to its dependency on the fact it depends on golang-1.13 which has been dismissed years ago. @colewhite do you think we can just remove the lok... [14:06:59] (03CR) 10Elukey: "First pass, I hope it makes sense, please follow up on IRC if you have any doubt :)" [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/970831 (https://phabricator.wikimedia.org/T343123) (owner: 10Kevin Bazira) [14:17:32] 10Machine-Learning-Team, 10Research: Upgrade xgboost in knowledge_integrity - https://phabricator.wikimedia.org/T350389 (10elukey) [14:18:55] 10Machine-Learning-Team, 10Patch-For-Review: Upgrade Revert Risk Language-agnostic docker images to KServe 0.11 - https://phabricator.wikimedia.org/T347550 (10elukey) Opened T350389 for the KI's xgboost upgrade. [14:19:29] 10Machine-Learning-Team, 10Research: Upgrade xgboost in knowledge_integrity - https://phabricator.wikimedia.org/T350389 (10elukey) Ilias is working in T349844 on a proposal for the upgrade, but if anybody from Research could do it beforehand we'd be grateful :) [15:10:25] 10Machine-Learning-Team, 10serviceops: Multiple images fail to build from sources - https://phabricator.wikimedia.org/T350366 (10Joe) [15:27:39] Hi folks! [15:37:16] o/ [15:53:27] 10Machine-Learning-Team, 10serviceops: Multiple images fail to build from sources - https://phabricator.wikimedia.org/T350366 (10Joe) [15:59:17] kevinbazira: @kevinbazira regarding the model server dependencies: I think the easiest (and safe) thing to do at the moment would be to create a fork of the Descartes repo and use that one. We solve the repo ownership issue but on the other hand we won't get any updates [16:00:21] But we can update something ourselves if it is needed. I'm not sure what the best option is but happy to discuss it further [16:25:00] * elukey afk! [16:25:05] have a nice rest of the day folks [16:36:35] enjoy your evening elukey o/ [16:37:19] isaranto: thank you for the suggestion, creating a fork is definitely an option. [16:37:19] I reached out to Isaac and Seddon in T343123#9300593 and waiting for their response. [16:37:19] But in the meantime, I pushed a patch for the article-descriptions kserve model-server and will tag folks for a review after they've come back from the offsite. [16:49:49] I can take a look before that it is ok. Thanks! [16:51:58] I had wanted you guys to enjoy yourselves though. I can wait for when you're back no worries :) [17:26:21] 10Machine-Learning-Team, 10Discovery-Search: Create Model Card for Search MLR - https://phabricator.wikimedia.org/T323794 (10calbon) p:05Low→03Triage [17:42:37] 10Machine-Learning-Team, 10Patch-For-Review, 10Wikipedia-Android-App-Backlog (Android Release - FY2023-24): Migrate Machine-generated Article Descriptions from toolforge to liftwing. - https://phabricator.wikimedia.org/T343123 (10Isaac) Hey @kevinbazira - glad to see you're picking this up! > while working... [18:36:51] 10Machine-Learning-Team, 10Patch-For-Review: Upgrade Revert Risk Language-agnostic docker images to KServe 0.11 - https://phabricator.wikimedia.org/T347550 (10calbon) p:05Triage→03Medium [18:38:24] 10Machine-Learning-Team, 10Patch-For-Review: Upgrade Revert Risk Language-agnostic docker images to KServe 0.11 - https://phabricator.wikimedia.org/T347550 (10calbon) [18:57:22] 10Machine-Learning-Team, 10Patch-For-Review: Upgrade Revert Risk Language-agnostic docker images to KServe 0.11 - https://phabricator.wikimedia.org/T347550 (10calbon) [18:58:59] 10Machine-Learning-Team: Upgrade outlink docker images to KServe 0.11 - https://phabricator.wikimedia.org/T347549 (10calbon) [18:59:44] 10Machine-Learning-Team: Test the kserve batcher for Revert Risk multilingual isvc - https://phabricator.wikimedia.org/T348536 (10calbon) [19:00:32] 10Machine-Learning-Team, 10Patch-For-Review: Outlink returns 500 when EventGate returns 503 Service Unavailable - https://phabricator.wikimedia.org/T346136 (10calbon) [19:01:55] 10Machine-Learning-Team: Upgrade the readability model server to KServe 0.11.1 - https://phabricator.wikimedia.org/T348664 (10calbon) [19:02:45] 10Machine-Learning-Team, 10ORES: Feature injection does not appear to work in ores-legacy - https://phabricator.wikimedia.org/T347194 (10calbon) [19:03:35] 10Machine-Learning-Team, 10MediaWiki-extensions-ORES, 10Documentation: Update docs for ORES Extension - https://phabricator.wikimedia.org/T346761 (10calbon) [19:03:45] 10Machine-Learning-Team, 10Patch-For-Review: Outlink returns 500 when EventGate returns 503 Service Unavailable - https://phabricator.wikimedia.org/T346136 (10Ottomata) Why is eventgate 503ing?! Is it because of {T349823} ? [19:06:06] 10Machine-Learning-Team, 10Observability-Alerting, 10Patch-For-Review: Lift Wing alerting - https://phabricator.wikimedia.org/T346151 (10calbon) [19:07:17] 10Machine-Learning-Team: Upgrade Revert Risk Multilingual docker images to KServe 0.11 - https://phabricator.wikimedia.org/T347551 (10calbon) [19:10:34] 10Machine-Learning-Team: Set SLO for the recommendation-api-ng service hosted on LiftWing - https://phabricator.wikimedia.org/T347262 (10calbon) [19:11:36] 10Machine-Learning-Team: Create external endpoint for recommendation-api-ng hosted on LiftWing - https://phabricator.wikimedia.org/T347263 (10calbon) [19:12:42] 10Machine-Learning-Team: Update to KServe 0.11 - https://phabricator.wikimedia.org/T337213 (10calbon) [19:13:44] 10Machine-Learning-Team: Decommission ORES configurations and servers - https://phabricator.wikimedia.org/T347278 (10calbon) [19:24:08] 10Machine-Learning-Team, 10Patch-For-Review: Outlink returns 500 when EventGate returns 503 Service Unavailable - https://phabricator.wikimedia.org/T346136 (10achou) p:05Triage→03Low [19:25:24] 10Machine-Learning-Team: Containerize Content Translation Recommendation API - https://phabricator.wikimedia.org/T338805 (10calbon) p:05Triage→03Medium [19:25:44] 10Machine-Learning-Team: Update to KServe 0.11 - https://phabricator.wikimedia.org/T337213 (10calbon) p:05Triage→03Medium [19:25:48] 10Machine-Learning-Team: Configure envoy settings to enable rec-api-ng container to access endpoints external to k8s/LiftWing - https://phabricator.wikimedia.org/T348607 (10calbon) p:05Triage→03Medium [19:25:50] 10Machine-Learning-Team: Investigate recommendation-api-ng internal endpoint failure - https://phabricator.wikimedia.org/T347475 (10calbon) p:05Triage→03Medium [19:25:56] 10Machine-Learning-Team: Test the kserve batcher for Revert Risk multilingual isvc - https://phabricator.wikimedia.org/T348536 (10calbon) p:05Triage→03Medium [19:25:58] 10Machine-Learning-Team, 10Patch-For-Review: [CI] Update pre-commit versions in inf-services repo - https://phabricator.wikimedia.org/T349382 (10calbon) p:05Triage→03Medium [19:26:00] 10Machine-Learning-Team, 10Observability-Alerting, 10Patch-For-Review: Lift Wing alerting - https://phabricator.wikimedia.org/T346151 (10calbon) p:05Triage→03Medium [19:26:21] 10Machine-Learning-Team, 10Patch-For-Review: Host the recommendation-api container on LiftWing - https://phabricator.wikimedia.org/T339890 (10calbon) p:05Triage→03Medium [19:27:09] 10Machine-Learning-Team, 10ORES: Feature injection does not appear to work in ores-legacy - https://phabricator.wikimedia.org/T347194 (10calbon) p:05Triage→03Medium [19:27:21] 10Machine-Learning-Team: Test the kserve batcher for Revert Risk multilingual isvc - https://phabricator.wikimedia.org/T348536 (10achou) p:05Medium→03High [19:27:46] 10Machine-Learning-Team, 10MediaWiki-extensions-ORES, 10Documentation: Update docs for ORES Extension - https://phabricator.wikimedia.org/T346761 (10calbon) p:05Triage→03Medium [19:27:55] 10Machine-Learning-Team: Upgrade outlink docker images to KServe 0.11 - https://phabricator.wikimedia.org/T347549 (10achou) p:05Triage→03Medium [19:28:02] 10Machine-Learning-Team: Upgrade the readability model server to KServe 0.11.1 - https://phabricator.wikimedia.org/T348664 (10achou) p:05Triage→03Medium [19:28:15] 10Machine-Learning-Team: Set SLO for the recommendation-api-ng service hosted on LiftWing - https://phabricator.wikimedia.org/T347262 (10achou) p:05Triage→03Medium [19:28:34] 10Machine-Learning-Team: Decommission ORES configurations and servers - https://phabricator.wikimedia.org/T347278 (10achou) p:05Triage→03Medium [19:28:50] 10Machine-Learning-Team: Create external endpoint for recommendation-api-ng hosted on LiftWing - https://phabricator.wikimedia.org/T347263 (10achou) p:05Triage→03Medium [19:29:42] 10Machine-Learning-Team: Upgrade Revert Risk Multilingual docker images to KServe 0.11 - https://phabricator.wikimedia.org/T347551 (10achou) p:05Triage→03Medium [19:30:56] 10Machine-Learning-Team, 10Epic, 10Patch-For-Review: Add meaningful access logs to KServe's pods - https://phabricator.wikimedia.org/T333804 (10achou) p:05Triage→03Medium [21:10:29] Quite some movement on the board --^ :) [22:53:13] 10Lift-Wing, 10Machine-Learning-Team, 10I18n, 10NewFunctionality-Worktype, 10Patch-For-Review: Create a language detection service in LiftWing - https://phabricator.wikimedia.org/T340507 (10isarantopoulos) 05Open→03Resolved