[07:03:02] Good morning o/ [07:25:44] TIL https://bash.toolforge.org/random [09:47:53] o/ [09:48:44] \o [10:26:31] 10Machine-Learning-Team, 10Wikipedia-Android-App-Backlog (Android Release - FY2023-24): Investigate increased preprocessing latencies on LW of article-descriptions model - https://phabricator.wikimedia.org/T358195#9566846 (10isarantopoulos) [10:27:03] I opened the task we discussed yesterday cause I want to attach a patch to it for more logging [10:30:43] (03PS1) 10Ilias Sarantopoulos: article-descriptions: add more logging for preprocess requests [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1005720 (https://phabricator.wikimedia.org/T358195) [10:31:19] plz add more info to the task if I missed anything [10:55:42] 10Machine-Learning-Team, 10Patch-For-Review, 10Wikipedia-Android-App-Backlog (Android Release - FY2023-24): Investigate increased preprocessing latencies on LW of article-descriptions model - https://phabricator.wikimedia.org/T358195#9566989 (10kevinbazira) In yesterday's meeting IIRC @klausman mentioned te... [10:59:51] (03CR) 10Kevin Bazira: [C: 03+1] article-descriptions: add more logging for preprocess requests [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1005720 (https://phabricator.wikimedia.org/T358195) (owner: 10Ilias Sarantopoulos) [11:00:42] isaranto: o/ [11:00:43] ^-- I shared API calls we could use to test rest gateway vs rest api [11:00:43] the logging patch LGTM. I've +1'd [11:01:33] ο/ kevinbazira thanks for the review. I'm just checking if we should add anything else for logging. If not I'll merge and deploy it [11:01:51] ok ok ... [11:03:15] 10Machine-Learning-Team, 10Patch-For-Review, 10Wikipedia-Android-App-Backlog (Android Release - FY2023-24): Investigate increased preprocessing latencies on LW of article-descriptions model - https://phabricator.wikimedia.org/T358195#9567034 (10klausman) This is run from within the container `article-descrip... [11:07:56] 10Machine-Learning-Team, 10Patch-For-Review, 10Wikipedia-Android-App-Backlog (Android Release - FY2023-24): Investigate increased preprocessing latencies on LW of article-descriptions model - https://phabricator.wikimedia.org/T358195#9567036 (10klausman) Testing with an assortment of endpoints: `lang=python... [11:10:06] 10Machine-Learning-Team, 10Patch-For-Review, 10Wikipedia-Android-App-Backlog (Android Release - FY2023-24): Investigate increased preprocessing latencies on LW of article-descriptions model - https://phabricator.wikimedia.org/T358195#9567044 (10klausman) And with a variety of pages requested: `lang=python >... [11:11:31] 10Machine-Learning-Team, 10Patch-For-Review, 10Wikipedia-Android-App-Backlog (Android Release - FY2023-24): Investigate increased preprocessing latencies on LW of article-descriptions model - https://phabricator.wikimedia.org/T358195#9567045 (10klausman) Note the wide variety of latencies, spanning fromn 118... [11:12:25] 10Machine-Learning-Team, 10Patch-For-Review, 10Wikipedia-Android-App-Backlog (Android Release - FY2023-24): Investigate increased preprocessing latencies on LW of article-descriptions model - https://phabricator.wikimedia.org/T358195#9567046 (10kevinbazira) I have run the second API call using the same Local... [11:31:52] * klausman lunch [12:13:32] 10Machine-Learning-Team, 10Patch-For-Review, 10Wikipedia-Android-App-Backlog (Android Release - FY2023-24): Investigate increased preprocessing latencies on LW of article-descriptions model - https://phabricator.wikimedia.org/T358195#9567309 (10klausman) Another option is using something like `https://mobile... [13:22:34] (03CR) 10Ilias Sarantopoulos: [C: 03+2] article-descriptions: add more logging for preprocess requests [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1005720 (https://phabricator.wikimedia.org/T358195) (owner: 10Ilias Sarantopoulos) [13:47:53] pff building the image for the above patch failed https://integration.wikimedia.org/ci/job/inference-services-pipeline-article-descriptions-publish/22/console [13:48:06] `Error response from daemon: No such image: sha256:71c417d18fb264caae65d0589e3edbe48e20ce1781296e2d49bfd39b85d7b40a` [13:52:18] I'm trying to rerun the Jenkins pipeline now. However what is weird is that I see a new image in the registry https://docker-registry.wikimedia.org/wikimedia/machinelearning-liftwing-inference-services-article-descriptions/tags/ [14:08:29] 10Machine-Learning-Team, 10Wikipedia-Android-App-Backlog (Android Release - FY2023-24): Investigate increased preprocessing latencies on LW of article-descriptions model - https://phabricator.wikimedia.org/T358195#9567724 (10isarantopoulos) I added some more logging so that we can get a better break down of wh... [14:35:55] 10Machine-Learning-Team, 10Wikipedia-Android-App-Backlog (Android Release - FY2023-24): Investigate increased preprocessing latencies on LW of article-descriptions model - https://phabricator.wikimedia.org/T358195#9567864 (10hnowlan) >>! In T358195#9567724, @isarantopoulos wrote: > I added some more logging so... [16:00:35] perhaps I'm ignorant, but I'm wondering if we can just make the request for the language we want and skip the rest [16:00:55] I dont remember how the model works so I'll take a look at the paper first [16:01:03] tried to do sth but failed horribly [16:09:16] jumping in a meeting, will check afterwards [17:37:09] oh yeah nevermind what I mentioned previously makes no sense. the model requires all descriptions and first paragraphs from every language the article is available [17:38:34] logging off folks, more tomorrow! have a nice evening [17:59:20] night, Ilias