[07:19:15] Good morning folks! [07:38:34] (03CR) 10Kevin Bazira: [C: 03+1] "Nice! LGTM based on the docs: https://huggingface.co/docs/transformers/main/en/quantization#autogptq" [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1003488 (https://phabricator.wikimedia.org/T354870) (owner: 10Ilias Sarantopoulos) [09:56:49] morning! [10:00:29] aiko: o/ I've read about some interesting explainability tools [10:00:31] https://github.com/jessevig/bertvi [10:00:41] https://github.com/shap/shap [10:00:59] https://github.com/marcotcr/lime [10:01:10] https://github.com/pytorch/captum [10:01:41] (all in https://www.turingpost.com/p/explainableai but I have the full article and I don't know how to share it) [10:05:13] Morning aiko and elukey ! [10:06:11] thanks for the links Luca! [10:06:16] Morning! [10:06:38] o/ Tobias [10:06:39] hiii elukey :D thanks for sharing. going to read them! [10:07:06] hi Ilias and Tobias o/ [10:07:51] from the above I vouch for shap as it heavily used (and mature) [10:08:05] Following Chris's question/suggestion on Slack, I switched my Cass POC to using RRLA (instead of ML). It was quite easy, but highlighted a few code smells (hardcoded stuff, mostly). [10:08:07] TIL about the others [11:12:36] * klausman lunch [11:41:06] ditto [12:44:45] I'm still testing the above patch (quantization on GPU) locally. Will either update the patch or merge it once done [12:45:46] images take a while to build, one of the following days I'll prioritize building a base image with pytorch as we discussed yesterday [13:54:21] 10Machine-Learning-Team, 10ORES, 10Technical-Debt: Replace usage of wfGetDB() in ORES before the 1.42 cut so it can be hard-deprecated - https://phabricator.wikimedia.org/T357654 (10Jdforrester-WMF) [14:09:52] Good morning all [14:10:57] Morning elukey [14:14:38] Heyo Chris [14:48:09] (03CR) 10Kevin Bazira: [C: 03+1] "Great! Starting with validating the idea sounds good." [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1003488 (https://phabricator.wikimedia.org/T354870) (owner: 10Ilias Sarantopoulos) [15:34:44] Hey Chris o/ [15:36:52] hello [15:39:47] heads up: ml-staging2001 (the only GPU machine in staging will have a super short network flip-flop around the hour). I will drain it beforehand and undrain right after. [15:47:52] ack! [16:07:42] and we're back [17:11:38] going afk for the evening folks, cu tomorrow o/ [17:16:01] \o [18:16:34] night all [20:01:56] 10Machine-Learning-Team, 10Research: Explore using revertrisk language agnostic API in a pre-save context - https://phabricator.wikimedia.org/T356102 (10XiaoXiao-WMF) @kostajh to follow up on this - the ML team do not intend to do any work on this, and from our side the language agnostic model is capable to be... [20:53:29] 10Machine-Learning-Team, 10Research: Explore using revertrisk language agnostic API in a pre-save context - https://phabricator.wikimedia.org/T356102 (10kostajh) >>! In T356102#9548565, @XiaoXiao-WMF wrote: > [...] from our side the language agnostic model is capable to be invoked in either situation. To clar... [22:47:34] 10Machine-Learning-Team, 10Research: Explore using revertrisk language agnostic API in a pre-save context - https://phabricator.wikimedia.org/T356102 (10XiaoXiao-WMF) thanks for the clarification @kostajh. It sounds to me that this is to be discussed with the ML team - it is more about when to invoke the rever...