[08:07:21] <_joe_> jelto / jayme: I want to deploy apple-search to staging, and I adopted helm3 aiui [08:07:25] <_joe_> but tiller is still running there [08:08:38] <_joe_> should I just delete the pod? [08:10:20] <_joe_> and the rolebinding [08:39:52] joe: cleanup steps (removing tiller, rolebidings, kube configs and so on) are planned when all environments are deployed with helm3. So we planned to keep tiller running until we are finished with the migration of all environments [08:43:47] <_joe_> ack thanks [08:53:25] <_joe_> who worked on the image-suggestion-api ? [08:54:00] <_joe_> as in, is it deployed? because I found a mistake in the helmfile that would make it unable to access any secrets [08:59:12] joe: I touched it in the bulk change for all helmfiles (see https://gerrit.wikimedia.org/r/c/operations/deployment-charts/+/735979/3/helmfile.d/services/image-suggestion-api/helmfile.yaml). Apart from that, I whould have to look in the git history. And no it's currently not deployed as far as I can tell [09:17:04] <_joe_> yeah it wouldn't work otherwise [09:17:19] <_joe_> I was just wondering who had followed it and why it's not deployed [11:59:35] 10serviceops, 10SRE, 10Kubernetes, 10Patch-For-Review: Migrate to helm v3 - https://phabricator.wikimedia.org/T251305 (10Jelto) [12:00:26] 10serviceops, 10SRE, 10Kubernetes, 10Patch-For-Review: Migrate to helm v3 - https://phabricator.wikimedia.org/T251305 (10Jelto) [13:23:55] _joe_: I merged the original patch, but it has never been deployed [13:24:08] they are working on the datastore last I heard [13:38:58] 10serviceops, 10SRE, 10ops-codfw: decom mw2280 (was: mw2280 unresponsive to powercycle and hardreset) - https://phabricator.wikimedia.org/T290708 (10akosiaris) We 've discussed this in last week's meeting. For now, it looks like we will not be replacing this hardware as it is not worth it. We will need howev... [14:36:27] akosiaris: do you know why statsdclient for one request is taking 13MB? https://performance.wikimedia.org/xhgui/run/symbol?id=619ba8d32d10f4d5dc6308de&symbol=Liuggio%5CStatsdClient%5CStatsdClient%3A%3AdoReduce it's consistently high https://performance.wikimedia.org/xhgui/run/symbol?id=619ba8d32d10f4d5dc6308de&symbol=Liuggio%5CStatsdClient%5CStatsdClient%3A%3AdoReduce [14:36:46] Amir1: no idea [14:37:02] it's third party code, making it even more fun to debug and fix [15:59:41] <_joe_> akosiaris: the meet url doesn't work [15:59:45] +1 [16:00:07] <_joe_> I would suggest editing the event [16:00:26] yup. experiencing the same here. [16:00:38] and I get a random new one when clicking the event on the google meet landing page. That's convenient :D [16:00:50] <_joe_> jayme: yeah... [16:01:05] well...now it's static [16:01:56] <_joe_> let's talk in #private [16:30:39] 10serviceops, 10Wikidata-Query-Service, 10Discovery-Search (Current work): Additional capacity on the k8s Flink cluster for WCQS updater - https://phabricator.wikimedia.org/T280485 (10Gehel) Let's go with a single cluster at least for the start. If we hit any real life issue, we can revisit this solution. [19:14:25] 10serviceops, 10SRE, 10ops-codfw: decom mw2280 (was: mw2280 unresponsive to powercycle and hardreset) - https://phabricator.wikimedia.org/T290708 (10Papaul) 05Open→03Resolved Decommission compete [19:15:11] 10serviceops, 10SRE, 10decommission-hardware, 10ops-codfw: decommission thumbor200[12].codfw.wmnet - https://phabricator.wikimedia.org/T273141 (10Papaul) [19:15:35] 10serviceops, 10SRE, 10decommission-hardware, 10ops-codfw: decommission thumbor200[12].codfw.wmnet - https://phabricator.wikimedia.org/T273141 (10Papaul) 05Open→03Resolved complete