[06:40:54] Hi folks! 👋 [06:43:40] 10Machine-Learning-Team, 10Add-Link, 10Growth-Team, 10User-notice: Deploy "add a link" to 15th round of wikis - https://phabricator.wikimedia.org/T308141 (10kevinbazira) [06:44:19] 10Machine-Learning-Team, 10Add-Link, 10Growth-Team, 10User-notice: Deploy "add a link" to 15th round of wikis - https://phabricator.wikimedia.org/T308141 (10kevinbazira) 22/22 models were trained successfully in the 15th round of wikis. [07:32:25] hello folks :) [07:39:09] 10Machine-Learning-Team, 10Anti-Harassment, 10Cloud-Services, 10Content-Transform-Team, and 17 others: Migrate PipelineLib repos to GitLab - https://phabricator.wikimedia.org/T332953 (10elukey) [07:39:58] 10Machine-Learning-Team, 10Anti-Harassment, 10Cloud-Services, 10Content-Transform-Team, and 17 others: Migrate PipelineLib repos to GitLab - https://phabricator.wikimedia.org/T332953 (10elukey) [07:57:36] 10Machine-Learning-Team, 10Data-Engineering, 10Research, 10Event-Platform Value Stream (Sprint 11), 10Patch-For-Review: Design event schema for ML scores/recommendations on current page state - https://phabricator.wikimedia.org/T331401 (10dcausse) >>! In T331401#8765288, @Isaac wrote: >> Q: Will it be us... [09:12:16] wow the access log change for kserve is taking more time that anticipated :( [09:12:47] anyway, while checking things I noticed [09:12:48] https://kserve.github.io/website/0.10/modelserving/data_plane/v2_protocol/ [09:13:23] so https://kserve.github.io/website/0.10/modelserving/data_plane/v1_protocol/#api-definitions suggests to migrate to v2 [09:13:31] but in v2 they say that explain is not supported [09:13:45] "V2 protocol does not currently support the explain endpoint like V1 protocol does. If this is a feature you wish to have in the V2 protocol, please submit a github issue. " [09:13:50] cc: aiko: --^ [09:13:53] really weird [09:14:45] at some point we'll have to for sure [09:15:04] but I don't get why the don't support explain [09:15:07] v2 is a convention [09:15:31] ¯\_(ツ)_/¯ [09:17:15] I'll add the info in T330131 [09:18:21] one more project migrated to poetry [09:18:32] oh well seems like I'll start using poetry then as well [09:18:45] yeah that's weird they don't support explain in v2 :/ [09:19:11] 10Lift-Wing, 10Machine-Learning-Team: Investigate Explainer for Revert-Risk model - https://phabricator.wikimedia.org/T330131 (10elukey) I've read the following doc: https://kserve.github.io/website/0.10/modelserving/data_plane/v2_protocol/ It seems that upstream suggest to migrate to v2 from v1, but they als... [09:19:19] maybe they want to know who uses explain among the community [09:20:47] isaranto: poetry is not that bad, but it is definitely confusing at first, it resembles npm in a lot of thigns [09:20:53] like that poetry.lock horror [09:21:10] v2 is considered sth like an inference standard so that maybe the reasoning behind this.. [09:21:24] but I was able to specify that asgi-logger needs py38 without changing the py37 global requirement, so seems good on that side [09:21:31] elukey: I know, but... with M1 I couldn't get around some stuff [09:21:44] ah snap :( [09:21:58] ah if we change to v2 we'll also have to change the apigateway config [09:22:05] just to add more fun [09:50:16] * isaranto afk for approx 1-1.5h - running an errand + lunch [09:56:07] 10Machine-Learning-Team, 10SRE: Migrate ml-cache to Bullseye - https://phabricator.wikimedia.org/T331712 (10elukey) Needs `profile::base::remove_python2_on_bullseye: false` in hiera to be deployed before reimaging, then we should be good to go! Todo: check if the /srv partition content is preserved by partman... [10:16:44] 10Machine-Learning-Team, 10ORES, 10Wikimedia Enterprise: Investigate tools that use ORES - https://phabricator.wikimedia.org/T330854 (10elukey) @prabhat we created https://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing/Usage#External_endpoints with some Info about how to query Lift Wing (that is curre... [10:21:55] I think that https://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing is good enough for people to check [10:22:31] one doc to add is an end-to-end use case to migrate a bot from ores to lift wing, but in theory there is already a ton of info [10:22:49] maybe a section "differences with ORES" etc.. [10:22:53] mmm yes I'll add it [10:22:59] lemme know if you feel that more is needed [10:23:13] * elukey lunch [11:43:19] elukey: very nice! It feels more like public-facing documentation now :) [12:03:28] 10Machine-Learning-Team, 10SRE: Migrate ml-cache to Bullseye - https://phabricator.wikimedia.org/T331712 (10MoritzMuehlenhoff) >>! In T331712#8770704, @elukey wrote: > Todo: check if the /srv partition content is preserved by partman or not. We have an existing reuse-raid1-2dev.cfg Partman recipe, that should... [12:03:40] nice work! [13:28:28] thanks! [13:57:48] 10Machine-Learning-Team, 10Anti-Harassment, 10Cloud-Services, 10Content-Transform-Team, and 17 others: Migrate PipelineLib repos to GitLab - https://phabricator.wikimedia.org/T332953 (10Tchanders) [14:58:05] 10Machine-Learning-Team, 10SRE, 10serviceops: Import and deploy istio 1.15.7 - https://phabricator.wikimedia.org/T334068 (10elukey) a:03elukey [14:58:43] 10Machine-Learning-Team: [WikiGPT] Improve search results of WikiGPT - https://phabricator.wikimedia.org/T329016 (10isarantopoulos) 05Open→03Resolved [14:58:46] 10Machine-Learning-Team, 10Epic: WikiGPT Experiment - https://phabricator.wikimedia.org/T328494 (10isarantopoulos) [15:40:52] 10Machine-Learning-Team, 10DBA, 10Data-Engineering, 10Infrastructure-Foundations, and 8 others: eqiad row D switches upgrade - https://phabricator.wikimedia.org/T333377 (10LSobanski) [15:49:51] 10Machine-Learning-Team: GPT-4 in WikiGPT - https://phabricator.wikimedia.org/T333854 (10isarantopoulos) 05Open→03Resolved [15:49:53] 10Machine-Learning-Team, 10Epic: WikiGPT Experiment - https://phabricator.wikimedia.org/T328494 (10isarantopoulos) [16:00:03] 10Machine-Learning-Team, 10DBA, 10Data-Engineering, 10Infrastructure-Foundations, and 8 others: eqiad row D switches upgrade - https://phabricator.wikimedia.org/T333377 (10LSobanski) p:05Triage→03Medium [16:08:07] 10Machine-Learning-Team, 10DBA, 10Data-Engineering, 10Infrastructure-Foundations, and 8 others: eqiad row D switches upgrade - https://phabricator.wikimedia.org/T333377 (10Jelto) [16:18:03] going afk, have a nice rest of the day folks! [16:26:26] ciao Luca, logging off as well, cu tomorrow! [16:28:23] see you! [16:29:52] 10Machine-Learning-Team, 10Data-Engineering, 10Research, 10Event-Platform Value Stream (Sprint 11), 10Patch-For-Review: Design event schema for ML scores/recommendations on current page state - https://phabricator.wikimedia.org/T331401 (10Ottomata) Okay, thanks all. No `prior_state` for now then. We ca... [16:38:26] (03PS1) 10AikoChou: WIP - events: add code to generate predicted_classification events [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/907923 (https://phabricator.wikimedia.org/T331401) [16:41:16] ---^ not yet tested! will test it tomorrow [18:00:59] 10Machine-Learning-Team, 10Anti-Harassment, 10Cloud-Services, 10Content-Transform-Team, and 17 others: Migrate PipelineLib repos to GitLab - https://phabricator.wikimedia.org/T332953 (10leila) [20:24:23] 10Machine-Learning-Team, 10ORES, 10Wikimedia Enterprise: Investigate tools that use ORES - https://phabricator.wikimedia.org/T330854 (10prabhat) @elukey Just tried out the endpoints quickly. Seems like LiftWing APIs are taking 7x longer to return, as compared to the corresponding ORES endpoints. For 60 call... [23:01:04] 10Machine-Learning-Team, 10Anti-Harassment, 10Cloud-Services, 10Content-Transform-Team, and 16 others: Migrate PipelineLib repos to GitLab - https://phabricator.wikimedia.org/T332953 (10leila) [23:03:09] 10Machine-Learning-Team, 10Anti-Harassment, 10Cloud-Services, 10Content-Transform-Team, and 16 others: Migrate PipelineLib repos to GitLab - https://phabricator.wikimedia.org/T332953 (10leila) removed #Research tag, added T334511 as a subtask for us to take care of one item we should help you all with. I'm...