[05:00:00] 10Machine-Learning-Team, 10Foundational Technology Requests: Content Translation Recommendations API - https://phabricator.wikimedia.org/T293648 (10santhosh) >>! In T293648#8949413, @elukey wrote: > 1) Is https://en.wikipedia.org/api/rest_v1/#/ a possible replacement for https://recommend.wmflabs.org/ for Cont... [05:13:08] 10Machine-Learning-Team, 10Foundational Technology Requests: Content Translation Recommendations API - https://phabricator.wikimedia.org/T293648 (10santhosh) Note that we have not tested it recently to see if those issues are resolved now. We can do an evaluation if that helps. But restbase APIs are going to b... [06:12:17] 10Machine-Learning-Team, 10Foundational Technology Requests: Content Translation Recommendations API - https://phabricator.wikimedia.org/T293648 (10elukey) >>! In T293648#8954712, @santhosh wrote: >>>! In T293648#8949413, @elukey wrote: >> 1) Is https://en.wikipedia.org/api/rest_v1/#/ a possible replacement fo... [06:14:36] 10Machine-Learning-Team, 10Foundational Technology Requests: Content Translation Recommendations API - https://phabricator.wikimedia.org/T293648 (10elukey) >>! In T293648#8954740, @santhosh wrote: > Note that we have not tested it recently to see if those issues are resolved now. We can do an evaluation if tha... [06:36:38] 10Machine-Learning-Team, 10Foundational Technology Requests: Content Translation Recommendations API - https://phabricator.wikimedia.org/T293648 (10santhosh) * The REST API does not accept multiple seed articles. This is important for CX. CX require previously translated/edited titles to be used as seed for ne... [07:05:46] 10Machine-Learning-Team, 10Foundational Technology Requests: Content Translation Recommendations API - https://phabricator.wikimedia.org/T293648 (10elukey) @santhosh thanks a lot, and I agree that both services (rest/nodejs and python/cloud) have not been updated in ages, so something will need to be done (the... [08:12:39] 10Machine-Learning-Team, 10Foundational Technology Requests: Content Translation Recommendations API - https://phabricator.wikimedia.org/T293648 (10santhosh) Yes, The python based service is supposed to be the right(latest) one if my memory is correct. - The system behind recommend.wmflabs.org. If that can be... [08:25:43] 10Machine-Learning-Team, 10Foundational Technology Requests: Content Translation Recommendations API - https://phabricator.wikimedia.org/T293648 (10elukey) Perfect let's keep our teams in sync with this issue and the future steps, I agree that the service needs some serious attention. [08:29:19] hello folks [08:29:32] I am online for a bit before another errand :) [08:34:24] hello! [08:39:33] kalimera :) [08:41:32] so the recommendation-api saga has new info, namely that Content Translation prefers the python api [08:41:47] and I think it is probably better for us to concentrate on it, and deprecate the nodejs one [08:41:52] does it make sense? [08:42:12] then we expose it to the api-gateway, since Content Translation needs to be accessible from outside [08:42:30] 10Machine-Learning-Team, 10Foundational Technology Requests: Content Translation Recommendations API - https://phabricator.wikimedia.org/T293648 (10Pginer-WMF) Regarding the support for more recent news, these are described [in the product requirements document](https://docs.google.com/document/d/1j2U_rx99q2tK... [08:45:44] 10Machine-Learning-Team, 10Foundational Technology Requests: Content Translation Recommendations API - https://phabricator.wikimedia.org/T293648 (10elukey) @Pginer-WMF thanks! So the main issue currently is that the restbase/nodejs version of the recommendation-api is used by the Android team, meanwhile Conten... [08:53:06] yes it makes sense, and it is preferable [08:53:11] 10Machine-Learning-Team, 10Foundational Technology Requests: Content Translation Recommendations API - https://phabricator.wikimedia.org/T293648 (10Pginer-WMF) >>! In T293648#8955031, @elukey wrote: > @Pginer-WMF thanks! So the main issue currently is that the restbase/nodejs version of the recommendation-api... [08:53:19] I mean python over nodejs [08:54:22] then we can ask to who manages the Android app to move away from Restbase, and use the Python api [08:54:32] and finally decom that service [08:54:48] I'll write on slack so the whole team sees it [09:04:42] +1 [09:12:24] * elukey afk again! bbl [09:12:28] elukey: I noticed that in the version of transformers if we want to load in 8bit we need to specify device_map to auto. Upgrading to 4.30.1 makes this go away [09:13:01] I'm going to create and merge a patch to fix this. probably may require more. we'll see [09:13:36] otherwise in this version we need to do sth like `device_map="auto" if self.quantized else None` which is a bit hacky [09:13:40] cu l8er! [09:18:28] (03PS1) 10Ilias Sarantopoulos: llm: add scipy and upgrade transformers [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/932182 (https://phabricator.wikimedia.org/T334583) [09:33:10] morning :) [09:35:00] Hi Aiko! [09:35:16] (03CR) 10Ilias Sarantopoulos: [C: 03+2] llm: add scipy and upgrade transformers [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/932182 (https://phabricator.wikimedia.org/T334583) (owner: 10Ilias Sarantopoulos) [09:36:18] (03Merged) 10jenkins-bot: llm: add scipy and upgrade transformers [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/932182 (https://phabricator.wikimedia.org/T334583) (owner: 10Ilias Sarantopoulos) [10:43:36] (03PS1) 10AikoChou: outlink: add logging of input page_change event [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/932201 (https://phabricator.wikimedia.org/T328899) [10:48:49] aaand crashing container! to be continued after lunch [10:49:55] (I'm referring to llm on gpu, nothing to worry about) [11:24:54] (03CR) 10Elukey: outlink: add logging of input page_change event (031 comment) [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/932201 (https://phabricator.wikimedia.org/T328899) (owner: 10AikoChou) [11:45:35] 10Machine-Learning-Team, 10Spike: [Spike] Run models and frameworks on AMD GPU and identify challenges - https://phabricator.wikimedia.org/T334583 (10isarantopoulos) While trying to load models on GPU with weights as 8bit integers I have encountered the following stack trace: ` /opt/lib/python/site-packages/... [11:51:15] isaranto: sigh --^ [11:53:09] ¯\_(ツ)_/¯ [11:56:26] the good thing is that more and more people are asking for rocm support [11:56:31] so it is getting some user base [11:56:47] in my opinion part of our role is to push for these upstream changes [11:57:05] but I am really against nvidia, so heavily biased :) [11:57:20] * elukey commutes to the office [11:59:16] yes, the issue is that it requires support in multiple fronts [12:00:56] (03PS2) 10AikoChou: outlink: add logging of input page_change event [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/932201 (https://phabricator.wikimedia.org/T328899) [12:02:31] (03CR) 10AikoChou: outlink: add logging of input page_change event (031 comment) [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/932201 (https://phabricator.wikimedia.org/T328899) (owner: 10AikoChou) [12:12:11] 10Machine-Learning-Team, 10Spike: [Spike] Run models and frameworks on AMD GPU and identify challenges - https://phabricator.wikimedia.org/T334583 (10isarantopoulos) The effort to load a model using 8bit integers has been successful in [[ https://colab.research.google.com/drive/1e9m4-3Hlniy1sgU2nK0yfWO1lY9OVML... [12:25:39] (03PS1) 10Ilias Sarantopoulos: llm: test bitsandbytes-rocm package [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/932227 (https://phabricator.wikimedia.org/T334583) [12:26:30] (03CR) 10Ilias Sarantopoulos: [C: 03+1] outlink: add logging of input page_change event [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/932201 (https://phabricator.wikimedia.org/T328899) (owner: 10AikoChou) [12:27:37] (03CR) 10CI reject: [V: 04-1] llm: test bitsandbytes-rocm package [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/932227 (https://phabricator.wikimedia.org/T334583) (owner: 10Ilias Sarantopoulos) [12:29:15] (03CR) 10Elukey: outlink: add logging of input page_change event (031 comment) [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/932201 (https://phabricator.wikimedia.org/T328899) (owner: 10AikoChou) [12:31:40] (03CR) 10Ilias Sarantopoulos: "recheck" [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/932227 (https://phabricator.wikimedia.org/T334583) (owner: 10Ilias Sarantopoulos) [13:26:30] 10Machine-Learning-Team, 10Foundational Technology Requests: Content Translation Recommendations API - https://phabricator.wikimedia.org/T293648 (10Isaac) > The REST API does not accept multiple seed articles. Chiming in -- looks like the restbase/nodejs version does accept multiple seed articles, it's just no... [13:56:09] (03PS3) 10AikoChou: outlink: add logging of input page_change event [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/932201 (https://phabricator.wikimedia.org/T328899) [13:57:03] (03CR) 10AikoChou: [C: 03+2] "Thanks for the review :)" [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/932201 (https://phabricator.wikimedia.org/T328899) (owner: 10AikoChou) [13:58:09] (03Merged) 10jenkins-bot: outlink: add logging of input page_change event [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/932201 (https://phabricator.wikimedia.org/T328899) (owner: 10AikoChou) [15:04:12] 10Machine-Learning-Team, 10MediaWiki-extensions-ORES, 10MW-1.41-notes (1.41.0-wmf.15; 2023-06-27), 10Patch-For-Review: Move backend of ORES MediaWiki extension to Lift Wing - https://phabricator.wikimedia.org/T319170 (10isarantopoulos) Lift Wing has been enabled in the beta cluster but at the moment seems... [15:39:59] 10Machine-Learning-Team, 10Foundational Technology Requests: Content Translation Recommendations API - https://phabricator.wikimedia.org/T293648 (10Isaac) And also adding this in reference to the original request around e.g., adding topic functionality. Currently my understanding is that these endpoints are ma... [15:52:49] (03PS1) 10Ilias Sarantopoulos: fix: corrent config variable access [extensions/ORES] - 10https://gerrit.wikimedia.org/r/932289 (https://phabricator.wikimedia.org/T319170) [15:53:32] I'm logging off folks, I'll continue tomorrow breaking more stuff! [15:54:02] same! [15:54:34] lol have a nice evening folks :)