[06:07:44] (03PS1) 10Kevin Bazira: docker-compose: add embeddings config [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1220050 (https://phabricator.wikimedia.org/T412338) [06:09:42] (03CR) 10Kevin Bazira: [C:03+2] embeddings: containerize model-server (031 comment) [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1219537 (https://phabricator.wikimedia.org/T412338) (owner: 10Kevin Bazira) [08:03:08] (03CR) 10Ozge: [C:03+2] docker-compose: add embeddings config [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1220050 (https://phabricator.wikimedia.org/T412338) (owner: 10Kevin Bazira) [08:03:37] (03Merged) 10jenkins-bot: docker-compose: add embeddings config [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1220050 (https://phabricator.wikimedia.org/T412338) (owner: 10Kevin Bazira) [10:47:21] 06Machine-Learning-Team, 10Semantic Search: Semantic Search - Embeddings Service for MVP - https://phabricator.wikimedia.org/T412338#11480675 (10OKarakaya-WMF) [10:57:17] 06Machine-Learning-Team, 10Semantic Search: Semantic Search - Embeddings Service for MVP - https://phabricator.wikimedia.org/T412338#11480689 (10OKarakaya-WMF) [11:39:53] 06Machine-Learning-Team, 10Semantic Search, 13Patch-For-Review: Semantic Search - Embeddings Service for MVP - https://phabricator.wikimedia.org/T412338#11480732 (10OKarakaya-WMF) performance test results in local: Scenario1: question_length count 4510.000000 mean 74.141463 std 22.81... [12:29:45] 06Machine-Learning-Team, 10Semantic Search, 13Patch-For-Review: Semantic Search - Embeddings Service for MVP - https://phabricator.wikimedia.org/T412338#11480777 (10OKarakaya-WMF) results with a new set up from local. ` (myenv3112) ozge@wmf3658 locust % MODEL=embeddings locust Min length: 10, Max length: 3... [12:41:26] 06Machine-Learning-Team, 10Semantic Search, 13Patch-For-Review: Semantic Search - Embeddings Service for MVP - https://phabricator.wikimedia.org/T412338#11480803 (10kevinbazira) The embeddings model-server has been deployed in the LiftWing experimental namespace. It is currently available through an internal... [12:43:16] (03PS1) 10Ozge: ml-services: embeddings locust tests [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1220335 [12:44:15] (03PS2) 10Ozge: ml-services: embeddings locust tests [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1220335 (https://phabricator.wikimedia.org/T412338) [13:08:55] (03PS3) 10Ozge: ml-services: embeddings locust tests [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1220335 (https://phabricator.wikimedia.org/T412338) [13:22:15] (03CR) 10Kevin Bazira: [C:03+1] "LGTM!" [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1220335 (https://phabricator.wikimedia.org/T412338) (owner: 10Ozge) [13:27:48] 06Machine-Learning-Team, 10Semantic Search, 13Patch-For-Review: Semantic Search - Embeddings Service for MVP - https://phabricator.wikimedia.org/T412338#11480856 (10OKarakaya-WMF) Staging results. ` (venv) ozge@stat1010:~/repos/wiki/gerrit/inference-services/test/locust$ MODEL=embeddings locust Min length:... [13:42:47] (03CR) 10Ozge: [C:03+2] ml-services: embeddings locust tests [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1220335 (https://phabricator.wikimedia.org/T412338) (owner: 10Ozge) [13:43:09] (03CR) 10Ozge: [V:03+2 C:03+2] ml-services: embeddings locust tests [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1220335 (https://phabricator.wikimedia.org/T412338) (owner: 10Ozge) [13:43:15] (03Merged) 10jenkins-bot: ml-services: embeddings locust tests [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1220335 (https://phabricator.wikimedia.org/T412338) (owner: 10Ozge) [13:47:48] 06Machine-Learning-Team, 10Semantic Search, 13Patch-For-Review: Semantic Search - Embeddings Service for MVP - https://phabricator.wikimedia.org/T412338#11480874 (10OKarakaya-WMF) ` (venv) ozge@stat1010:~/repos/wiki/gerrit/inference-services/test/locust$ export MAX_LENGTH=350 (venv) ozge@stat1010:~/repos/wi... [13:48:18] 06Machine-Learning-Team, 10Semantic Search, 13Patch-For-Review: Semantic Search - Embeddings Service for MVP - https://phabricator.wikimedia.org/T412338#11480875 (10OKarakaya-WMF) [14:01:48] 06Machine-Learning-Team, 10Semantic Search, 13Patch-For-Review: Semantic Search - Embeddings Service for MVP - https://phabricator.wikimedia.org/T412338#11480909 (10OKarakaya-WMF) ` (venv) ozge@stat1010:~/repos/wiki/gerrit/inference-services/test/locust$ MODEL=embeddings locust Min length: 250, Max length:... [15:38:05] 06Machine-Learning-Team, 10EditCheck, 06Growth-Team, 10Revise-Tone-Structured-Task, 07OKR-Work: Revise Tone: Exclude direct quotes from Tone Recommendations - https://phabricator.wikimedia.org/T411892#11481085 (10achou) I parsed all the examples labeled "**Tone issue in direct quote**" from the spreadshe... [15:50:32] 06Machine-Learning-Team, 06Growth-Team, 10Revise-Tone-Structured-Task, 07OKR-Work: Revise Tone: Exclude certain sections from Tone Recommendations - https://phabricator.wikimedia.org/T411897#11481148 (10achou) By using the HTML parser's plaintext functionality and [[ https://gitlab.wikimedia.org/repos/rese... [16:49:46] 06Machine-Learning-Team, 06Growth-Team, 10Revise-Tone-Structured-Task: Use HTML instead of wikitext for Revise Tone Task Generator in LiftWing - https://phabricator.wikimedia.org/T412210#11481426 (10achou) For the issues we want to address with the HTML parser, #####Exclude direct quotes I've added an upda... [16:55:01] 06Machine-Learning-Team, 06Growth-Team, 10Revise-Tone-Structured-Task: Use HTML instead of wikitext for Revise Tone Task Generator in LiftWing - https://phabricator.wikimedia.org/T412210#11481457 (10achou) a:03achou [20:15:01] 06Machine-Learning-Team, 06Growth-Team, 10Revise-Tone-Structured-Task: Use HTML instead of wikitext for Revise Tone Task Generator in LiftWing - https://phabricator.wikimedia.org/T412210#11481979 (10Isaac) > In the section “Pietermaritzburg Treason Trial” of the article "John_Milne_(judge)", the content insi... [20:41:54] 06Machine-Learning-Team, 06Growth-Team, 10Revise-Tone-Structured-Task: Use HTML instead of wikitext for Revise Tone Task Generator in LiftWing - https://phabricator.wikimedia.org/T412210#11482083 (10Sucheta-Salgaonkar-WMF) > @KStoller-WMF, regarding the timeline, I'd like to confirm whether these results me... [21:15:02] 06Machine-Learning-Team, 10Semantic Search: Semantic Search - Embeddings Service for MVP - https://phabricator.wikimedia.org/T412338#11482301 (10dcausse) @kevinbazira @OKarakaya-WMF thanks! is there a way to call this API in a way that is compatible with the [[https://platform.openai.com/docs/guides/embeddings...