[03:07:47] 10Machine-Learning-Team, 10Add-Link, 10Growth-Team, 10User-notice: Deploy "add a link" to 13th round of wikis - https://phabricator.wikimedia.org/T308138 (10kevinbazira) [03:12:07] 10Machine-Learning-Team, 10Add-Link, 10Growth-Team, 10User-notice: Deploy "add a link" to 13th round of wikis - https://phabricator.wikimedia.org/T308138 (10kevinbazira) @kostajh, we published datasets for all 23/24 models that passed the evaluation in this round. [03:15:30] 10Machine-Learning-Team, 10Add-Link, 10Growth-Team, 10User-notice: Deploy "add a link" to 13th round of wikis - https://phabricator.wikimedia.org/T308138 (10kevinbazira) [08:18:24] 10Machine-Learning-Team, 10Language-Team, 10Epic: Migrate Content Translation Recommendation API to Lift Wing - https://phabricator.wikimedia.org/T308164 (10santhosh) [09:31:54] 10Machine-Learning-Team, 10API-Portal: Add documentation about LiftWing to the API Portal - https://phabricator.wikimedia.org/T325759 (10elukey) >>! In T325759#8711938, @apaskulin wrote: > 🎉 Nice work! I fixed up the navigation so the pages appear correctly in the sidebar. (For pages to appear in the sidebar,... [09:39:41] 10Lift-Wing, 10Machine-Learning-Team: Create Draft Documentation For Moving Models Into Lift Wing - https://phabricator.wikimedia.org/T269169 (10Aklapper) a:05calbon→03None @calbon: Removing task assignee as this open task has been assigned for more than two years - See the email sent to task assignee on F... [09:47:13] 10Machine-Learning-Team, 10DBA, 10Data Pipelines, 10Data-Engineering-Planning, and 10 others: eqiad row B switches upgrade - https://phabricator.wikimedia.org/T330165 (10cmooney) [11:10:09] * elukey lunch! [11:39:48] 10Lift-Wing, 10Machine-Learning-Team: Update revert-risk multilingual model - https://phabricator.wikimedia.org/T332392 (10achou) The model inference service has been deployed to staging. Make a prediction: ` aikochou@deploy2002:~$ time curl "https://inference-staging.svc.codfw.wmnet:30443/v1/models/revertri... [11:50:34] 10Lift-Wing, 10Machine-Learning-Team: Update revert-risk multilingual model - https://phabricator.wikimedia.org/T332392 (10achou) [13:06:20] 10Machine-Learning-Team, 10Add-Link, 10Growth-Team, 10User-notice: Deploy "add a link" to 13th round of wikis - https://phabricator.wikimedia.org/T308138 (10kostajh) >>! In T308138#8712538, @kevinbazira wrote: > @kostajh, we published datasets for all 23/24 models that passed the evaluation in this round.... [14:20:34] 10Machine-Learning-Team: Investigate if/how to enable the swagger UI for InferenceService resources - https://phabricator.wikimedia.org/T332602 (10calbon) a:03elukey [14:28:33] 10Machine-Learning-Team, 10artificial-intelligence, 10SRE, 10serviceops-radar: New Service Request 'open_nsfw' - https://phabricator.wikimedia.org/T250110 (10calbon) 05Open→03Resolved [14:28:37] 10artificial-intelligence, 10WMF-Inspiration-Week-2022-ML-Collab: Deploy Image content filtration model for Wikimedia Commons - https://phabricator.wikimedia.org/T279416 (10calbon) [14:28:47] 10Machine-Learning-Team, 10artificial-intelligence, 10SRE, 10serviceops-radar: New Service Request 'open_nsfw' - https://phabricator.wikimedia.org/T250110 (10calbon) This work is superceded by the NSFW model made by @Htriedman and deployed by @AikoChou to experiment model server. Closing ticket. [14:36:16] 10Machine-Learning-Team, 10Add-Link, 10Growth-Team: Define SLIs/SLOs for link recommendation service - https://phabricator.wikimedia.org/T278083 (10elukey) @akosiaris getting back to this task after some time to set up expectations - is link recommendation handled/owned by service ops, or should the ML team... [14:43:25] 10Machine-Learning-Team: create checklist before adding models to api gateway/prod - https://phabricator.wikimedia.org/T332711 (10calbon) [16:46:18] aiko: o/ I opened https://gerrit.wikimedia.org/r/c/operations/deployment-charts/+/901671, should be enough for the change-prop stream (changeprop is capped at max 5 rps so we should be good) [16:46:31] I'll deploy it tomorrow if I don't see objections/suggestions/etc.. [16:46:53] (just before enabling changeprop to hit the drafttopic pods with requests) [16:56:28] aiko: re: item(quality|topic) - I created https://gerrit.wikimedia.org/r/c/operations/deployment-charts/+/901675 since you are right, we cannot address those model servers via api-gateway.. [16:58:25] for example, this works: [16:58:26] curl "https://inference.discovery.wmnet:30443/v1/models/wikidatawiki-itemquality:predict" -X POST -d @input.json -i -H "Host: wikidatawiki-itemquality.revscoring-articlequality.wikimedia.org" --http1.1 [16:58:57] so yeah we need to keep the namespace as "articlequality" but since the isvc's model name change, we have to adapt the api gateway's config as well [16:59:11] klausman: --^ (for review etc.. in case I wrote something completely off) [16:59:45] ah no wait it doesn't work as it is [16:59:45] sigh [17:00:28] now it should [17:01:01] what did you change? [17:02:29] the \2 in the host header [17:02:39] without it doesn't work [17:02:52] Ah, right [17:03:33] it may be a bit tricky to render in the docs [17:03:56] but separating those pods into different namespaces feels overkill [17:04:02] let's see how it goes, thanks for the review :) [17:04:07] np :) [17:04:10] I'll wait for Hugh's approval before merging [17:04:28] all right, logging off for today folks! Have a nice rest of the day [17:04:30] I agree that the namespacing/URLs/host-headers are a bit messy, but partially, that's due to how ORES grew [17:04:32] \o [17:05:00] hopefully the newer ones will follow a brighter path :)