[07:49:48] 10Lift-Wing, 10serviceops, 10Kubernetes, 10Machine-Learning-Team (Active Tasks): Discussion: dedicated directory in the deployment-chart repository for ML services - https://phabricator.wikimedia.org/T286791 (10elukey) >>! In T286791#7218022, @ACraze wrote: >> We should probably create a separate `ml-servi... [07:56:59] 10Lift-Wing, 10serviceops, 10Kubernetes, 10Machine-Learning-Team (Active Tasks): Discussion: dedicated directory in the deployment-chart repository for ML services - https://phabricator.wikimedia.org/T286791 (10Joe) I think having a separate directory is the way to go. I'll leave to you to actually pick a... [08:37:59] 10Lift-Wing, 10serviceops, 10Kubernetes, 10Machine-Learning-Team (Active Tasks): Discussion: dedicated directory in the deployment-chart repository for ML services - https://phabricator.wikimedia.org/T286791 (10JMeybohm) >>! In T286791#7220181, @Joe wrote: > I think having a separate directory is the way t... [10:26:37] * elukey lunch! [16:54:18] hey folks, I may have found a way to put the InferenceService configs into the kfserving chart [16:54:32] the idea is to have a template that is controlled by the values.yaml settings [16:55:03] and in the ml-equivalent of the "services" directory, we'll just have a yaml file with a list of inference service settings [16:55:13] elukey: oh that's pretty interesting! [16:55:17] so it will be sufficient to helmfile sync and that's it [16:56:14] the assumption is that the InferenceService config is more or less almost the same, what changes are the env values etc.. [16:56:28] that could actually reduce a bunch of clutter, i was starting to think we'd need a chart for each service which was going to get messy [16:57:16] accraze: I'll try the solution + tests on minikube, and in case it works I'll send you the code review [16:57:22] so you'll tell me how crazy it is [16:57:31] the difference between most inference services (besides base image) is only 2-3 environment variables so I think this could work [16:57:40] go for it elukey! [16:59:04] perfect :)