[07:30:16] Hi folks! [07:30:20] going to run some errands [07:30:25] will be back in ~1h [09:16:27] o/ [09:20:42] o/ [09:21:33] 10Machine-Learning-Team: Lift Wing Python package - https://phabricator.wikimedia.org/T345136 (10isarantopoulos) [09:21:47] I opened the ticket above [09:22:50] I'm not sure it is the best idea in general but at least for the migration it seems to me much better than throwing the same python code all over the place [09:23:39] what code do you mean? The http calls that all bots make etc..? [09:25:37] my 2c: it seems a good idea but it will be more code/things to maintain on our side [09:26:09] so far the main pain point is to engage bot owners to change their code, once we get their attention the code changes are quick (and mostly done on their side) [09:26:16] plus there are special use cases etc.. [09:26:31] I just fear that a simple wrapper becomes a big thing [09:28:28] isaranto: this is not a -2, just my own's thoughts, if the team wants to do it (or you feel strongly about it) you have my complete support :) [09:30:29] I'm having the exact same thoughts that's why I wanted to discuss it. The idea of "just a simple wrapper" can easily become a beast especially if it is adopted [09:31:05] * elukey nods [09:31:09] I think I would just leave it as is then for now and discuss it again if needed [09:31:32] or now that I think about it again ores-legacy does just that so... [09:36:30] for the moment forcing people to use the HTTP interface may be enough, we can keep the idea in the backlog and develop it further during the next quarters [10:32:14] FYI, ml-etcd2001 will briefly go down for a Ganeti node reboot [10:42:32] it's back [10:44:42] ack! [10:44:44] * elukey lunhc! [10:44:47] * elukey lunch :) [12:03:54] 10Lift-Wing, 10Machine-Learning-Team, 10Research (FY2022-23-Research-January-March): Create a language agnostic model to predict reverts on Wikipedia - https://phabricator.wikimedia.org/T314385 (10kostajh) >>! In T314385#8496547, @diego wrote: > For the records here a snippet (by @achou) to try this model: >... [12:11:49] FYI, ml-etcd1002 will briefly go down for a Ganeti node reboot [12:47:17] 10Machine-Learning-Team, 10Add-Link, 10Growth-Team, 10Patch-For-Review: Investigate why the add-a-link training pipeline concludes with missing datasets - https://phabricator.wikimedia.org/T344832 (10kevinbazira) Following T345091#9124589, we learned that the `sqlitedict` package was using pickle protocol... [12:52:34] FYI, ml-etcd1001 will briefly go down for a Ganeti node reboot [12:58:35] 10Lift-Wing, 10Machine-Learning-Team, 10Research (FY2022-23-Research-January-March): Create a language agnostic model to predict reverts on Wikipedia - https://phabricator.wikimedia.org/T314385 (10achou) Hi @kostajh, there is an updated URL as the model server has been moved to Lift Wing production. ` curl "... [13:49:16] 10Machine-Learning-Team, 10Patch-For-Review: fiwiki RC filters classify all edits as 'very likely bad faith' - https://phabricator.wikimedia.org/T343308 (10isarantopoulos) The above [[ https://gerrit.wikimedia.org/r/c/operations/mediawiki-config/+/953259 | patch ]] is a subset of the previous patch but just fo... [14:14:14] FYI, I rolled out new OpenSSL security updates on ores*, but there's no restart necessary, since those will be rebooted anyway for T344671 [14:15:05] ack! [14:19:11] 10Machine-Learning-Team, 10Patch-For-Review: use wikiID in inference name on LW for revscoring models - https://phabricator.wikimedia.org/T342266 (10isarantopoulos) [14:20:16] 10Machine-Learning-Team: Migrate ORES clients to LiftWing - https://phabricator.wikimedia.org/T312518 (10calbon) [14:23:24] 10Machine-Learning-Team, 10Goal: Content Recommendation API migration completed - https://phabricator.wikimedia.org/T341704 (10calbon) a:03kevinbazira [14:24:09] 10Machine-Learning-Team, 10Goal: Order 2-4 GPU for Lift Wing and Statbox - https://phabricator.wikimedia.org/T341699 (10calbon) a:03calbon [14:24:27] 10Machine-Learning-Team, 10Goal: Support WME migration to Lift Wing - https://phabricator.wikimedia.org/T341698 (10calbon) a:03elukey [14:38:17] 10Machine-Learning-Team, 10Add-Link, 10Growth-Team (Current Sprint), 10Patch-For-Review, 10User-notice: Deploy "add a link" to 13th round of wikis - https://phabricator.wikimedia.org/T308138 (10Sgs) >>! In T308138#9124406, @Trizek-WMF wrote: > Let's go then. > can we schedule a deployment for Sept 6th?... [14:49:42] 10Machine-Learning-Team: Fast Vandalism Detection - https://phabricator.wikimedia.org/T344537 (10calbon) 05Open→03Declined [14:50:08] 10Machine-Learning-Team: Tune LiftWing autoscaling settings for Knative - https://phabricator.wikimedia.org/T344058 (10calbon) a:03elukey [14:55:32] 10Machine-Learning-Team: Discuss potential migration - https://phabricator.wikimedia.org/T344010 (10calbon) a:03calbon [15:01:06] 10Machine-Learning-Team: Future support for ores scores in RC API - https://phabricator.wikimedia.org/T343813 (10calbon) a:03calbon [15:34:17] 10Machine-Learning-Team, 10Add-Link, 10Growth-Team, 10Serbian-Sites, and 3 others: Deploy "add a link" to 16th round of wikis - https://phabricator.wikimedia.org/T308142 (10Trizek-WMF) [15:36:56] 10Machine-Learning-Team, 10Add-Link, 10Growth-Team, 10Serbian-Sites, and 3 others: Deploy "add a link" to 16th round of wikis - https://phabricator.wikimedia.org/T308142 (10Trizek-WMF) I moved Swahili Wikipedia (sw) to an earlier group. [15:41:30] 10Machine-Learning-Team, 10Add-Link, 10Growth-Team, 10Chinese-Sites, 10User-notice: Deploy "add a link" to 14th round of wikis - https://phabricator.wikimedia.org/T308139 (10Trizek-WMF) a:05kostajh→03None [15:41:45] 10Machine-Learning-Team, 10Add-Link, 10Growth-Team, 10Chinese-Sites, 10User-notice: Deploy "add a link" to 14th round of wikis - https://phabricator.wikimedia.org/T308139 (10Trizek-WMF) I moved Swahili Wikipedia from a later group as we plan to collaborate with them. [15:42:05] 10Machine-Learning-Team, 10Add-Link, 10Growth-Team (Current Sprint), 10Patch-For-Review, 10User-notice: Deploy "add a link" to 13th round of wikis - https://phabricator.wikimedia.org/T308138 (10Trizek-WMF) Let's do this! [15:42:21] 10Machine-Learning-Team, 10Add-Link, 10Growth-Team (Current Sprint), 10Malayalam-Sites, and 2 others: Deploy "add a link" to 12th round of wikis - https://phabricator.wikimedia.org/T308137 (10Trizek-WMF) [15:42:40] 10Machine-Learning-Team, 10Add-Link, 10Growth-Team (Current Sprint), 10Patch-For-Review, 10User-notice: Deploy "add a link" to 13th round of wikis - https://phabricator.wikimedia.org/T308138 (10Trizek-WMF) [15:44:06] 10Machine-Learning-Team, 10Add-Link, 10Growth-Team (Current Sprint), 10Malayalam-Sites, and 2 others: Deploy "add a link" to 12th round of wikis - https://phabricator.wikimedia.org/T308137 (10Trizek-WMF) [15:45:47] 10Machine-Learning-Team, 10Add-Link, 10Growth-Team (Current Sprint), 10Malayalam-Sites, and 2 others: Deploy "add a link" to 12th round of wikis - https://phabricator.wikimedia.org/T308137 (10Trizek-WMF) >>! In T308137#9086803, @Sgs wrote: > Status update, as per today all wikis have produced results excep... [15:56:12] btw, we can check the thresholds in https://en.wikipedia.org/wiki/Special:ORESModels [15:56:24] isaranto: aiko ^ [15:59:05] ack! [16:08:57] Amir1: TIL and this is super helpful. would have saved me lots of time. I am seeing differences in thresholds compared to the patches we have [16:09:18] the special page might be broken as well :D [16:09:35] This also exists https://es.wikibooks.org/w/api.php?action=query&meta=ores [16:14:02] nevermind probably nothing is different. I saw that we have max value 0.854 in itwiki damaging for likelygood while in the UI I saw 0.146 but it is because it is 1-0.854. I am verifying now by checking code to see it is correct [16:15:39] cool it is exactly that! [16:15:49] isaranto: it's deployed \o/ #testinginproduction [16:19:55] thanks Amir! from a first look the special page is broken now https://it.wikipedia.org/wiki/Speciale:ORESModels [16:21:25] Amir1: can you revert it so we take a look? [16:21:54] that special page is not that important, if the filters are down, that's a different story [16:30:11] I agree yes [16:30:11] trying to debug it, the api doesnt return thresholds other than damaging https://it.wikipedia.org/w/api.php?action=query&meta=ores. But this happens for all wikis not only the ones we just deployed e.g. https://en.wikipedia.org/w/api.php?action=query&meta=ores [16:32:51] yeah, the API was like this [16:32:59] I guess no one got around to add other models [16:35:22] going afk folks! Have a nice rest of the day! [16:35:25] thanks as always Amir1 [16:35:27] <3 [16:35:39] ciao Luca have a nice evening [16:36:19] you too! [16:38:58] <3 [16:42:19] Amir1: any other way to check? as there are no thresholds in the database. One thing I could do is debug by running the functions. Other ideas welcome [16:56:36] going afk for 20' will come back to check [18:59:23] thresholds seem to be ok. I can access them through mwmaint via `var_dump(ORES\Services\ORESServices::getThresholdLookup()->getThresholds( 'damaging' ));` [18:59:34] logging off, more tomorrow o/