[07:46:53] <elukey>	 accraze: o/
[07:47:04] <elukey>	 I modified your test.sh script with
[07:47:05] <elukey>	 SERVICE_HOSTNAME="enwiki-goodfaith-predictor-default.kserve-test.example.com"
[07:47:10] <elukey>	 and the test works
[07:48:08] <elukey>	 I checked on the eqiad stack and the isvc command to get the URL seems not right anymore;
[07:48:11] <elukey>	 elukey@ml-serve-ctrl1001:~$ kubectl get isvc enwiki-goodfaith -n revscoring-editquality 
[07:48:14] <elukey>	 NAME               URL   READY   PREV   LATEST   PREVROLLEDOUTREVISION   LATESTREADYREVISION   AGE
[07:48:17] <elukey>	 enwiki-goodfaith                                                                               41d
[07:49:24] <elukey>	 the logs about ingress config are weird
[07:50:20] <elukey>	 and we have them in prod too /o\
[08:00:08] <elukey>	 Unable to parse ingress config json: invalid character '\"' after object key:value pair
[08:10:33] <elukey>	 ok following the go code, it seems that i tried to fetch the ingress config contained in
[08:10:36] <elukey>	 kubectl get configmap inferenceservice-config -n kserve -oyaml
[08:10:38] <elukey>	 and indeed there is a typo
[08:13:51] <elukey>	 precisely https://gerrit.wikimedia.org/r/c/operations/deployment-charts/+/741844/
[08:13:58] <elukey>	 added by yours truly
[08:17:51] <elukey>	 anyway, sandbox fixed :)
[08:22:53] <elukey>	 and prod should be fixed too now
[08:23:20] <elukey>	 kevinbazira: o/ I think that the sandbox should be ready for some  tests if you want
[11:28:04] * elukey lunch!
[15:21:38] <wikibugs>	 10Lift-Wing, 10Machine-Learning-Team, 10Patch-For-Review: Create a LB service for inference.discovery.wmnet - https://phabricator.wikimedia.org/T289835 (10klausman) ` $ sudo confctl select 'cluster=ml_serve,service=kubesvc' set/pooled=yes:weight=1 The selector you chose has selected the following objects: {"...
[16:34:34] <wikibugs>	 10Machine-Learning-Team, 10Patch-For-Review, 10Platform Team Initiatives (API Gateway), 10Platform Team Workboards (Platform Engineering Reliability): Proposal: add a per-service rate limit setting to API Gateway - https://phabricator.wikimedia.org/T295956 (10hnowlan)
[17:19:54] <elukey>	 klausman: o/ I tried to add the discovery service but we need to move inference's status away from lvs_setup (to something that is monitored and pages for example)
[17:20:34] <elukey>	 in case we can do it tomorrow or later on
[17:20:48] <klausman>	 I'd prefer tomorrow
[17:20:50] <elukey>	 I think that we can close the task for the codfw cluster
[17:20:59] <elukey>	 and keep open only the LVS one
[17:21:03] <klausman>	 sgtm
[17:21:07] <elukey>	 super
[18:27:30] * elukey afk!