[08:28:52] 10Lift-Wing, 10artificial-intelligence, 10articlequality-modeling, 10revscoring, 10Machine-Learning-Team (Active Tasks): Create a KFServing model server for articlequality models - https://phabricator.wikimedia.org/T284678 (10kevinbazira) @ACraze thank you for suggesting that we use a KFServing transform... [14:31:29] I finally found a way to circumvent the TLS problem, and now the istiod pod runs. BUT [14:31:33] validationController Not ready to switch validation to fail-closed: dummy invalid rejected for the wrong reason: Timeout: request did not complete within requested timeout 30s [14:31:39] and this prevents the ingress controller to come up [14:35:08] my take is that istiod tries to use the validation webhook (that sits in front of the kube api) to see if a dummy config gets rejected, but a timeout occurs [14:35:33] the main ? is to understand more details about the timeout, but I can't find a good way [15:53:09] TIL about how to find say what ports are bound on a container: https://wikitech.wikimedia.org/wiki/User:Elukey/MachineLearning/kfserving#General_Debugging [16:05:08] o/ [16:05:50] great notes elukey [16:06:04] are you getting the timeout error with istio or knative? [16:07:36] hello! [16:07:39] good morning :) [16:07:59] it is only istio for the moment, istiod tries to create a wrong gateway config from what I can see from the code, and it gets a timeout [16:08:24] but the istio gateway pod is not yet up since istioctl gets stuck with istiod [16:08:27] and in get events I see [16:08:28] 4m44s Warning FailedGetResourceMetric horizontalpodautoscaler/istiod unable to get metrics for resource cpu: unable to fetch metrics from resource metrics API: the server could not find the requested resource (get pods.metrics.k8s.io) [16:08:34] so I am wondering if this is the real issue [16:08:42] trying to check a few things [16:39:59] so now the new mistery is to find how to enable HPA properly [16:40:58] 10Lift-Wing, 10ORES, 10drafttopic-modeling, 10Machine-Learning-Team (Active Tasks): Create a KFServing model server for drafttopic models - https://phabricator.wikimedia.org/T285883 (10ACraze) [16:46:36] oh noes https://phabricator.wikimedia.org/T249929 [16:48:49] so we may be the first ones using HPA [16:49:57] * elukey cries in a corner [16:53:19] ok yes confirmed that we are the first ones [16:53:36] this is a little problem :D [16:58:38] uh oh... lol [18:36:17] Hey everyone , I posted a query regarding getting an error over difference of text while considering revision ids [18:43:19] Can someone help? [19:55:26] hey anubhav_sharma: can you share the error that you are getting? [22:38:13] 10Lift-Wing, 10artificial-intelligence, 10editquality-modeling, 10revscoring, 10Machine-Learning-Team (Active Tasks): Create migration plan for editquality models from ORES to Lift Wing - https://phabricator.wikimedia.org/T284689 (10ACraze) [22:38:17] 10Lift-Wing, 10Machine-Learning-Team (Active Tasks), 10Patch-For-Review: Production images for ORES/revscoring models - https://phabricator.wikimedia.org/T279004 (10ACraze) [22:53:13] 10Lift-Wing, 10ORES, 10articlequality-modeling, 10Machine-Learning-Team (Active Tasks): Create a Transformer for revscoring inference services - https://phabricator.wikimedia.org/T285909 (10ACraze)