[08:48:31] hola! [08:58:36] (03PS1) 10AikoChou: reference-quality: log revision object size [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1113747 [09:01:47] isaranto: Γειά σου! [09:02:32] good morning folks o/ [09:03:26] :D [09:09:16] isaranto: o/ I tried building a wheel for the GPTQModel package and it looks like it's support for ROCm 6.1 is not verified: https://phabricator.wikimedia.org/P72236#289708 [09:09:56] I know, this is what I mentioned yesterday https://phabricator.wikimedia.org/T377848#10483583 [09:13:01] there is sth going on with the cuda param that seems to be required [09:17:04] okok. after running into OOM issues: https://phabricator.wikimedia.org/P72238 [09:17:04] I finally quantized the `aya-expanse-32b` model using AutoGPTQ. the model can be found here: https://huggingface.co/kevinbazira/aya-expanse-32b-gptq-4bit [09:17:19] nice kevin! [09:35:40] 10Lift-Wing, 06Machine-Learning-Team: Add locust load tests for articletopic-outlink - https://phabricator.wikimedia.org/T384276#10487916 (10isarantopoulos) 05Open→03Resolved [10:07:00] (03PS1) 10AikoChou: locust: add util for fetching recent change revisions [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1113755 [10:10:02] * isaranto lunch + errand [10:10:19] (03CR) 10AikoChou: "Code modified from https://gitlab.wikimedia.org/repos/machine-learning/edit-review/-/blob/main/src/revisions.py?ref_type=heads#L35-62 :)" [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1113755 (owner: 10AikoChou) [10:14:07] (03CR) 10Kevin Bazira: [C:03+1] "LGTM! tested in: https://phabricator.wikimedia.org/P72245" [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1113747 (owner: 10AikoChou) [11:06:10] (03CR) 10Gkyziridis: [C:03+1] "LGTM!" [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1113747 (owner: 10AikoChou) [11:10:36] 06Machine-Learning-Team: Research on UV python manager. - https://phabricator.wikimedia.org/T384584 (10gkyziridis) 03NEW [13:03:15] (03CR) 10AikoChou: [C:03+2] reference-quality: log revision object size [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1113747 (owner: 10AikoChou) [13:04:02] (03Merged) 10jenkins-bot: reference-quality: log revision object size [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1113747 (owner: 10AikoChou) [13:46:22] o/ if anyone has time: https://gerrit.wikimedia.org/r/c/operations/deployment-charts/+/1113742 [14:00:15] (03CR) 10Kevin Bazira: "I tested this on the statbox: `utils.get_recent_revision_info()` runs fine, and the load tests run too with a few fails: https://phabricat" [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1113755 (owner: 10AikoChou) [14:02:09] aiko: o/ I've +1'd [14:30:42] thanks Kevin! :) [14:39:52] (03PS2) 10AikoChou: locust: add util for fetching recent change revisions [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1113755 [14:40:10] (03CR) 10AikoChou: "Thanks for testing! Yes, the 500 errors are the ones I addressed in https://gerrit.wikimedia.org/r/c/machinelearning/liftwing/inference-se" [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1113755 (owner: 10AikoChou) [14:40:23] (03CR) 10Sbisson: [C:04-1] "-1 for visibility but I'm not requesting specific code changes, more like conversation on the feature." [research/recommendation-api] - 10https://gerrit.wikimedia.org/r/1113513 (https://phabricator.wikimedia.org/T384485) (owner: 10Nik Gkountas) [14:43:09] (03CR) 10Kevin Bazira: [C:03+1] "okok, lgtm!" [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1113755 (owner: 10AikoChou) [16:09:48] 06Machine-Learning-Team: Research on UV python manager. - https://phabricator.wikimedia.org/T384584#10489457 (10isarantopoulos) [16:10:27] 06Machine-Learning-Team: Adding uv as a package manage on Lift Wing/blubber - https://phabricator.wikimedia.org/T384584#10489459 (10isarantopoulos) [16:14:24] 06Machine-Learning-Team: Adding uv as a package manage on Lift Wing/blubber - https://phabricator.wikimedia.org/T384584#10489492 (10isarantopoulos) @dduvall Hi! Just wanted to get your thought on this: - is this something that you have explored already? - have other users requested uv as a package manager?... [16:14:50] georgekyz: --^ I update the task and pinged Dan who has done a ton of work on blubber [17:26:04] 10Lift-Wing, 06Machine-Learning-Team, 07OKR-Work, 13Patch-For-Review: Create event stream for article-country model-server hosted on LiftWing - https://phabricator.wikimedia.org/T382295#10489856 (10isarantopoulos) After a discussion we had with the Search team on the topic, our team will need to do the fol... [18:44:27] * isaranto afk [20:34:56] 06Machine-Learning-Team, 10EditCheck, 06Editing-team, 10VisualEditor: Evaluate efficacy of Peacock Check model output - https://phabricator.wikimedia.org/T384651 (10ppelberg) 03NEW [23:15:45] 10Lift-Wing, 06Machine-Learning-Team, 07OKR-Work, 13Patch-For-Review: Create event stream for article-country model-server hosted on LiftWing - https://phabricator.wikimedia.org/T382295#10490807 (10Isaac) Thanks all for working this out! I know a lot of moving parts here so I appreciate the work to figure...