[06:30:07] Good morning! [07:49:20] (03CR) 10Ilias Sarantopoulos: [V:03+2 C:03+1] locust: entry for readability model [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1062680 (https://phabricator.wikimedia.org/T369712) (owner: 10AikoChou) [07:49:49] (03PS10) 10Ilias Sarantopoulos: locust: add articlequality model [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1062049 (https://phabricator.wikimedia.org/T360455) [07:50:08] (03CR) 10Ilias Sarantopoulos: [V:03+2 C:03+2] locust: add articlequality model (031 comment) [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1062049 (https://phabricator.wikimedia.org/T360455) (owner: 10Ilias Sarantopoulos) [08:38:35] (03PS1) 10Kevin Bazira: huggingface: migrate to src dir [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1063152 (https://phabricator.wikimedia.org/T369344) [08:43:03] (03PS2) 10Kevin Bazira: huggingface: migrate to src dir [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1063152 (https://phabricator.wikimedia.org/T369344) [08:44:14] isaranto: sorry for not getting to the NS change yesterday, will cover that today [08:45:09] hey Tobias, no worries [08:45:26] all the other stuff are more important anyway! [09:00:32] Ok, private bits done, and +1'd your change, you're good to go [09:14:13] Danke! [09:28:07] klausman: I merged the dep-charts change, could you deploy it when you have some time? [09:28:18] sure, will do in a sec [09:30:31] pushed to staging, looks good [09:31:00] I see a readability-predictor crahslooping, but that looks like it has been going on for a while [09:39:52] thanks, I'm going to check the readability thingy [09:43:19] I'll also push the new NS to the two prod clusters [10:30:46] * isaranto lunch [11:45:06] * klausman lunch [12:20:16] (03CR) 10Ilias Sarantopoulos: [C:03+1] huggingface: migrate to src dir [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1063152 (https://phabricator.wikimedia.org/T369344) (owner: 10Kevin Bazira) [12:20:41] I added a patch for the deployment in the new ns https://gerrit.wikimedia.org/r/c/operations/deployment-charts/+/1063182 [12:22:03] is there anything else I need to add for kube_env to work with the new article-models ns? [12:24:44] aa yes probably the puppet things are missing for permissions [12:28:09] I think it is this thingy missing https://gerrit.wikimedia.org/r/c/operations/puppet/+/1063183 [13:07:44] (03CR) 10Kevin Bazira: [C:03+2] huggingface: migrate to src dir [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1063152 (https://phabricator.wikimedia.org/T369344) (owner: 10Kevin Bazira) [13:08:28] (03Merged) 10jenkins-bot: huggingface: migrate to src dir [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1063152 (https://phabricator.wikimedia.org/T369344) (owner: 10Kevin Bazira) [13:12:35] 06Machine-Learning-Team, 10ORES, 06Discovery-Search, 06Growth-Team: Investigate what would be required to include countries in ORES and accessible via a search keyword - https://phabricator.wikimedia.org/T301671#10069400 (10Isaac) @EBernhardson thanks for all these notes! Sounds like no major blockers then... [13:53:08] Morning all [13:55:10] morning Chris! [14:00:39] (03PS11) 10Ilias Sarantopoulos: locust: add articlequality model [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1062049 (https://phabricator.wikimedia.org/T360455) [14:00:47] (03CR) 10Ilias Sarantopoulos: [V:03+2 C:03+2] locust: add articlequality model [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1062049 (https://phabricator.wikimedia.org/T360455) (owner: 10Ilias Sarantopoulos) [14:18:26] argh, misclicked +2... [14:18:43] Let's si what the CI actually does :D [14:18:59] see* [14:20:11] Phew, it didn't merge it :) [14:23:54] cool cool, I want to merge it anyway :) [14:25:34] the new kube_env works fine. thanks for all the review [14:25:38] *reviews [14:29:51] np! [14:30:18] * klausman afk for a quick errand [14:30:45] with all the other stuff I've fallen behind in the llm work for flash attention :( [14:30:56] I'm gonna add also an httpbb test for articlequality [15:04:33] the model is now deployed in prod in the new ns! [15:04:46] I'm going to add the relevant api-gateway entries [15:58:45] I added the httpbb tests and the apigw entry https://gerrit.wikimedia.org/r/c/operations/deployment-charts/+/1063225 [16:05:22] 06Machine-Learning-Team, 06Content-Transform-Team, 06Research, 13Patch-For-Review: Add Article Quality Model to LiftWing - https://phabricator.wikimedia.org/T360455#10069903 (10isarantopoulos) The model has been deployed to production! At the moment only the internal endpoint is available but we're also wo... [16:05:35] the only thing left would be the api documentation page [16:08:12] :+1: [16:27:36] (03PS3) 10Kevin Bazira: llm: remove model-server [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1062700 (https://phabricator.wikimedia.org/T369344) [16:35:15] going afk folks, have a nice weekend o/ [16:37:24] \o [16:49:38] 06Machine-Learning-Team, 10Wikilabels, 10Cloud-VPS (Debian Buster Deprecation): Cloud VPS "wikilabels" project Buster deprecation - https://phabricator.wikimedia.org/T367562#10070111 (10Andrew) emailed today: > Hello! > > Your cloud-vps project 'wikilabels' is currently under multiple threats. > > I...