[06:13:56] 10Lift-Wing, 10Machine-Learning-Team, 10I18n, 10NewFunctionality-Worktype, 10Patch-For-Review: Create a language detection service in LiftWing - https://phabricator.wikimedia.org/T340507 (10santhosh) Thanks @isarantopoulos . The language codes returned by the service is not in the format we usually use... [08:57:32] 10Machine-Learning-Team: Revert Risk multi-lingual model performance and reliability may need a review - https://phabricator.wikimedia.org/T340822 (10Trokhymovych) I have reviewed the [[ https://pastebin.com/3jj5FZxk | logs ]] with errors from the multilingual model, and it seems to be a problem with resources.... [09:40:42] (03CR) 10Ilias Sarantopoulos: fix: corrent config variable access (031 comment) [extensions/ORES] - 10https://gerrit.wikimedia.org/r/932289 (https://phabricator.wikimedia.org/T319170) (owner: 10Ilias Sarantopoulos) [09:40:53] (03PS29) 10Ilias Sarantopoulos: fix: corrent config variable access [extensions/ORES] - 10https://gerrit.wikimedia.org/r/932289 (https://phabricator.wikimedia.org/T319170) [09:46:41] (03CR) 10Ladsgroup: [C: 03+2] fix: corrent config variable access (033 comments) [extensions/ORES] - 10https://gerrit.wikimedia.org/r/932289 (https://phabricator.wikimedia.org/T319170) (owner: 10Ilias Sarantopoulos) [09:49:19] (03Merged) 10jenkins-bot: fix: corrent config variable access [extensions/ORES] - 10https://gerrit.wikimedia.org/r/932289 (https://phabricator.wikimedia.org/T319170) (owner: 10Ilias Sarantopoulos) [10:21:46] * elukey lunhc! [10:39:56] ores filters now work on Beta https://en.wikipedia.beta.wmflabs.org/wiki/Main_Page \o/ now I am investigating why we dont have any predictions :) [10:42:52] 10Machine-Learning-Team, 10MediaWiki-extensions-ORES, 10MW-1.41-notes (1.41.0-wmf.16; 2023-07-04), 10Patch-For-Review: Move backend of ORES MediaWiki extension to Lift Wing - https://phabricator.wikimedia.org/T319170 (10isarantopoulos) Ores filters now appear on [[ https://en.wikipedia.beta.wmflabs.org/wik... [10:43:51] isaranto: Where would ORES be visible on beta? [10:45:04] sry didnt provide the complete link. on recent changes filter. https://en.wikipedia.beta.wmflabs.org/wiki/Special:RecentChanges?hidebots=1&hidecategorization=1&hideWikibase=1&limit=50&days=7&urlversion=2 [10:45:04] The filters in the first two sections refer to goodfaith and damaging models [10:45:18] ah, ty! [10:53:37] * klausman lunch [11:06:59] 10Machine-Learning-Team, 10ContentTranslation, 10Epic: Verify if the Python recommendation API can support the use cases of the nodejs one - https://phabricator.wikimedia.org/T340854 (10Nikerabbit) [11:41:28] 10Machine-Learning-Team, 10ContentTranslation, 10Epic: Verify if the Python recommendation API can support the use cases of the nodejs one - https://phabricator.wikimedia.org/T340854 (10elukey) @Isaac if you have time and patience, do you mind to have a chat about this task? [12:10:42] * isaranto lunch [12:11:28] opened https://gerrit.wikimedia.org/r/c/labs/tools/wikibugs2/+/935042 to send gerrit notifications about the recommendation-api repo [12:11:32] in here [12:12:37] 10Machine-Learning-Team: Timeout for be-x-old and not support be-tarask in revertrisk language-agnostic - https://phabricator.wikimedia.org/T340830 (10elukey) 05Open→03Resolved a:03elukey Great work Aiko! [12:13:06] 10Lift-Wing, 10Machine-Learning-Team: Deploy Revert-risk wikidata model to ml-staging - https://phabricator.wikimedia.org/T333125 (10elukey) 05Open→03Resolved [12:13:15] 10Machine-Learning-Team, 10Epic: Lift Wing improvements to get out of MVP state - https://phabricator.wikimedia.org/T333453 (10elukey) [12:13:17] 10Lift-Wing, 10Machine-Learning-Team: Move Revert-risk multilingual model from staging to production - https://phabricator.wikimedia.org/T333124 (10elukey) 05Open→03Resolved [12:13:24] 10Lift-Wing, 10Machine-Learning-Team: Move Revert-risk language agnostic model from staging to production - https://phabricator.wikimedia.org/T332998 (10elukey) 05Open→03Resolved [12:13:26] 10Machine-Learning-Team, 10Epic: Lift Wing improvements to get out of MVP state - https://phabricator.wikimedia.org/T333453 (10elukey) [12:13:32] 10Lift-Wing, 10Machine-Learning-Team: Move model binaries hosted on Lift Wing to Analytics published space - https://phabricator.wikimedia.org/T334111 (10elukey) 05Open→03Resolved [12:13:40] 10Machine-Learning-Team, 10Epic: WikiGPT Experiment - https://phabricator.wikimedia.org/T328494 (10elukey) 05Open→03Resolved [12:14:19] Iluvatar: o/ how are things going with Lift Wing? [12:15:24] Hi, just see error log (weekend and Monday morning). https://pastebin.com/nmfBUV6H [12:16:42] thanks! [12:16:55] have the timeouts improved? Still around 8/10%? [12:21:52] less than before. But still a lot of errors. [12:22:43] okok, I have been talking with the Research team, and they said: [12:23:20] The Multilingual (RRML) is better for anonymous users, however it still has some performance issues (as you reported). The Language Agnostic (RRLA) one is faster. I'll change the recommendation for the model card, explaining these caveats. The recommendation now would be: use the RRLA for registered users, and use the RRML for IP edits. [12:23:55] not sure if changes anything to your setup, but the model card will be changed accordingly soon [12:27:09] (03CR) 10Kevin Bazira: Set up production and test images for the recommendation-api migration (035 comments) [research/recommendation-api] - 10https://gerrit.wikimedia.org/r/932810 (https://phabricator.wikimedia.org/T339890) (owner: 10Kevin Bazira) [12:27:22] works! [12:29:13] Thanks, I will change the source code according to the new recommendation. [12:29:38] (03CR) 10Elukey: Set up production and test images for the recommendation-api migration (031 comment) [research/recommendation-api] - 10https://gerrit.wikimedia.org/r/932810 (https://phabricator.wikimedia.org/T339890) (owner: 10Kevin Bazira) [12:29:45] Iluvatar: thanks! [12:46:56] 10Machine-Learning-Team, 10serviceops, 10Platform Team Initiatives (API Gateway): Review LiftWing's usage of the API Gateway - https://phabricator.wikimedia.org/T340982 (10elukey) [12:47:06] this is my proposal for lift wing --^ [12:47:53] I see no point (sadly) to use OAuth at the moment [12:48:14] given that we have tools like https://wikitech.wikimedia.org/wiki/Requestctl [12:48:38] ack, Im reviewing now. THanks for putting this together [12:48:49] having higher anonymous limits would ease a lot our transition [12:48:56] isaranto: thanks :) [12:49:04] I can give more details if needed [13:16:35] 10Machine-Learning-Team: Revert Risk multi-lingual model performance and reliability may need a review - https://phabricator.wikimedia.org/T340822 (10klausman) https://grafana.wikimedia.org/d/zsdYRV7Vk/istio-sidecar?orgId=1&var-cluster=eqiad%20prometheus%2Fk8s-mlserve&var-namespace=revertrisk&var-backend=api-ro.... [13:22:54] I reviewed the ticket above. TIL about requestctl, checking it now [13:24:39] only SREs can use it [13:24:57] it is basically a way to add settings to the Varnish's VCL [13:25:14] to rate limit or block traffic based on certain criteria (IP, UA, headers, etc..) [13:26:12] * elukey brb [13:51:40] (03PS1) 10AikoChou: readability: add nltk tokenizers download to blubber's builder [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/935068 (https://phabricator.wikimedia.org/T334182) [14:01:22] (03PS2) 10AikoChou: readability: add nltk tokenizers download to blubber's builder [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/935068 (https://phabricator.wikimedia.org/T334182) [14:12:04] (03CR) 10Elukey: readability: add nltk tokenizers download to blubber's builder (031 comment) [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/935068 (https://phabricator.wikimedia.org/T334182) (owner: 10AikoChou) [14:13:43] (03PS13) 10Kevin Bazira: Set up production and test images for the recommendation-api migration [research/recommendation-api] - 10https://gerrit.wikimedia.org/r/932810 (https://phabricator.wikimedia.org/T339890) [14:20:47] (03CR) 10Kevin Bazira: Set up production and test images for the recommendation-api migration (032 comments) [research/recommendation-api] - 10https://gerrit.wikimedia.org/r/932810 (https://phabricator.wikimedia.org/T339890) (owner: 10Kevin Bazira) [14:23:59] kevinbazira_: o/ [14:24:43] (03CR) 10Elukey: Set up production and test images for the recommendation-api migration (031 comment) [research/recommendation-api] - 10https://gerrit.wikimedia.org/r/932810 (https://phabricator.wikimedia.org/T339890) (owner: 10Kevin Bazira) [14:29:09] (03CR) 10AikoChou: readability: add nltk tokenizers download to blubber's builder (031 comment) [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/935068 (https://phabricator.wikimedia.org/T334182) (owner: 10AikoChou) [14:30:37] (03CR) 10Elukey: Set up production and test images for the recommendation-api migration (032 comments) [research/recommendation-api] - 10https://gerrit.wikimedia.org/r/932810 (https://phabricator.wikimedia.org/T339890) (owner: 10Kevin Bazira) [14:39:06] (03CR) 10Elukey: [C: 03+1] readability: add nltk tokenizers download to blubber's builder (031 comment) [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/935068 (https://phabricator.wikimedia.org/T334182) (owner: 10AikoChou) [15:05:35] (03CR) 10Ilias Sarantopoulos: "Nice work! I have a couple of final points before we give this a go." [research/recommendation-api] - 10https://gerrit.wikimedia.org/r/932810 (https://phabricator.wikimedia.org/T339890) (owner: 10Kevin Bazira) [15:07:38] 10Machine-Learning-Team, 10Research: FeatureNotFound exception in revertrisk multi-lingual - https://phabricator.wikimedia.org/T340812 (10elukey) [15:07:57] 10Machine-Learning-Team, 10Research: Pop index out of range exception in revertrisk multi lingual - https://phabricator.wikimedia.org/T340813 (10elukey) [15:08:05] 10Machine-Learning-Team, 10Research: Index out of range in revert risk multi-lingual - https://phabricator.wikimedia.org/T340811 (10elukey) [15:12:40] 10Machine-Learning-Team, 10ContentTranslation, 10Research, 10Epic: Verify if the Python recommendation API can support the use cases of the nodejs one - https://phabricator.wikimedia.org/T340854 (10elukey) [15:19:51] 10Machine-Learning-Team: Verify the feasibility of RevertRisk meta model - https://phabricator.wikimedia.org/T340998 (10achou) [15:49:44] going afk folks! [15:49:48] have a nice rest of the day [15:50:25] ciao! [16:45:11] (03PS14) 10Kevin Bazira: Set up production and test images for the recommendation-api migration [research/recommendation-api] - 10https://gerrit.wikimedia.org/r/932810 (https://phabricator.wikimedia.org/T339890) [17:12:19] (03PS15) 10Kevin Bazira: Set up production and test images for the recommendation-api migration [research/recommendation-api] - 10https://gerrit.wikimedia.org/r/932810 (https://phabricator.wikimedia.org/T339890) [17:13:49] (03PS16) 10Kevin Bazira: Set up production and test images for the recommendation-api migration [research/recommendation-api] - 10https://gerrit.wikimedia.org/r/932810 (https://phabricator.wikimedia.org/T339890) [17:16:19] (03CR) 10Kevin Bazira: Set up production and test images for the recommendation-api migration (035 comments) [research/recommendation-api] - 10https://gerrit.wikimedia.org/r/932810 (https://phabricator.wikimedia.org/T339890) (owner: 10Kevin Bazira) [20:01:52] 10Machine-Learning-Team: Fix UnboundLocalError in revert risk models - https://phabricator.wikimedia.org/T341008 (10achou) [20:07:28] (03PS1) 10AikoChou: revert-risk: fix UnboundLocalError for var wiki_db and rev_id [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/935159 (https://phabricator.wikimedia.org/T341008)