[06:50:02] 10serviceops, 10Release-Engineering-Team, 10Scap: Deploy Scap version 4.5.0 - https://phabricator.wikimedia.org/T304134 (10JMeybohm) 05Openโ†’03Resolved [06:59:55] 10serviceops, 10Infrastructure-Foundations, 10SRE, 10SRE-Access-Requests, 10Release-Engineering-Team (๐Ÿš‚๐Ÿงช Trainsperiment Week): Need a service account on deploy servers - https://phabricator.wikimedia.org/T303857 (10Joe) p:05Triageโ†’03High a:05Joeโ†’03None >>! In T303857#7811250, @herron wrote: > Rem... [07:03:12] 10serviceops, 10Prod-Kubernetes, 10Kubernetes, 10Patch-For-Review: Move kubernetes workers to bullseye and docker to overlayfs - https://phabricator.wikimedia.org/T300744 (10JMeybohm) [07:04:37] 10serviceops, 10Prod-Kubernetes, 10Kubernetes, 10Patch-For-Review: Move kubernetes workers to bullseye and docker to overlayfs - https://phabricator.wikimedia.org/T300744 (10JMeybohm) 05Openโ†’03Resolved a:03JMeybohm I think the SRE part of this is all done. Thanks everyone! โค [07:05:53] 10serviceops, 10Infrastructure-Foundations, 10SRE, 10SRE-Access-Requests, 10Release-Engineering-Team (๐Ÿš‚๐Ÿงช Trainsperiment Week): Need a service account on deploy servers - https://phabricator.wikimedia.org/T303857 (10Joe) [07:51:54] 10serviceops, 10Release-Engineering-Team, 10Scap: Deploy Scap version 4.5.0 - https://phabricator.wikimedia.org/T304134 (10jnuche) @JMeybohm thank you! [08:00:14] hi folks, I am trying to expand profile::calico::kubernetes with the istio-cni settings in https://gerrit.wikimedia.org/r/c/operations/puppet/+/774424 [08:00:44] the current solution is not ideal but works, and puppet can clean-up / absent if needed [08:00:50] but not in the best way possible probably [08:01:12] after a chat with Janis we were thinking to reach out to the broader team for some feedback [08:01:45] I didn't create a separate profile since istio-cni is and will be tightly coupled with calico, but I have no strong opinions :) [08:01:53] any feedback would be really appreciated [08:19:06] LGTM [08:20:12] <_joe_> elukey: I'll take a look today [08:20:27] <_joe_> I did promise I would, but I'm lagging a bit [08:21:12] <_joe_> uh I think it was another patch, sorry [09:05:49] 10serviceops, 10Infrastructure-Foundations, 10SRE, 10SRE-Access-Requests, 10Release-Engineering-Team (๐Ÿš‚๐Ÿงช Trainsperiment Week): Need a service account on deploy servers - https://phabricator.wikimedia.org/T303857 (10Joe) a:03Joe Unassigned by mistake, apologies. @dancy can you confirm my understanding... [09:12:32] _joe_ yes it is :) [09:34:43] <_joe_> akosiaris: wait wmfjson output will go to the same log as the main output? [09:35:13] <_joe_> ah no ok [09:37:25] <_joe_> akosiaris: I was wondering, if we have json-formatted logs, we don't want to use mtail [09:37:47] <_joe_> but I have no idea of what to use instead to generate a prometheus exporter for this [09:41:09] _joe_: https://github.com/fstab/grok_exporter ? [09:41:57] has a mention to mtail as well at the end of the README [09:49:53] <_joe_> akosiaris: AIUI it uses regexes [09:50:03] <_joe_> while I wanted something that would just parse json [09:52:48] <_joe_> https://github.com/ashwinikd/json-log-exporter does that, but... [10:10:17] thanks for the reviews <3 [15:27:39] 10serviceops, 10Generated Data Platform, 10SRE, 10Service-deployment-requests: New Service Request Generated Datasets: Image Suggestions Service - https://phabricator.wikimedia.org/T304891 (10herron) p:05Triageโ†’03Medium [15:41:40] 10serviceops, 10Infrastructure-Foundations, 10SRE, 10SRE-Access-Requests, 10Release-Engineering-Team (๐Ÿš‚๐Ÿงช Trainsperiment Week): Need a service account on deploy servers - https://phabricator.wikimedia.org/T303857 (10dancy) [15:42:14] 10serviceops, 10Infrastructure-Foundations, 10SRE, 10SRE-Access-Requests, 10Release-Engineering-Team (๐Ÿš‚๐Ÿงช Trainsperiment Week): Need a service account on deploy servers - https://phabricator.wikimedia.org/T303857 (10dancy) I have confirmed that being in the `deployment` group will allow sudo to `www-data`... [16:07:26] 10serviceops, 10Infrastructure-Foundations, 10Pybal, 10SRE, and 2 others: Applications and scripts need to be able to understand the pooled status of servers in our load balancers. - https://phabricator.wikimedia.org/T239392 (10Lydia_Pintscher) [17:05:20] 10serviceops, 10GitLab (Infrastructure): GitLab minor version upgrade: 14.9.x - https://phabricator.wikimedia.org/T304622 (10Jelto) 05Openโ†’03Resolved a:03Jelto @Arnoldokoth and I updated production instance `gitlab1001` and gitlab-runners successfully. We encountered some //unexpected behavior// for the...