[06:09:57] 10serviceops, 10SRE, 10Developer Productivity, 10Performance-Team (Radar), 10Release-Engineering-Team (Radar): Debug hosts sometimes Fatal error: "The UdpSocket to 127.0.0.1:10514 has been closed" - https://phabricator.wikimedia.org/T214734 (10fgiunchedi) [07:06:43] volans: sorry, I totally forgot about it. Thanks for taking care of that! [07:30:20] 10serviceops, 10Prod-Kubernetes, 10Kubernetes: Draft a plan for upgrading kubernetes machines to buster - https://phabricator.wikimedia.org/T245272 (10JMeybohm) 05Open→03Resolved We skipped buster with T300744 [07:32:19] jayme: no prob ;) [07:48:28] 10serviceops, 10Release-Engineering-Team, 10Scap: Deploy Scap version 4.6.0 - https://phabricator.wikimedia.org/T305250 (10JMeybohm) a:03JMeybohm [07:53:27] good morning, I have a Puppet patch to tweak the rsync command between the deployment hosts, namely to pass `rsync --new-compress` which we already do in `scap` itself, but the scap-master-sync script is in Puppet for some reason. If one may please puppet-merge it that would be nice https://gerrit.wikimedia.org/r/c/operations/puppet/+/774824 ;] [08:02:36] 10serviceops, 10Release-Engineering-Team, 10Scap: Deploy Scap version 4.6.0 - https://phabricator.wikimedia.org/T305250 (10JMeybohm) Basic checks on mwdebug and restbase reploy looking fine. Will roll out to fleet wide tomorrow [09:24:13] jayme, _joe_: is today a good day for the new spicerack release with the k8s support? would you be able to test it once deployed? [09:24:28] <_joe_> volans: yes [09:25:23] ack [09:50:35] 10serviceops, 10Prod-Kubernetes, 10Kubernetes, 10Patch-For-Review: Implement POC for istio ingress - https://phabricator.wikimedia.org/T290966 (10JMeybohm) [09:51:24] 10serviceops, 10Prod-Kubernetes, 10Kubernetes, 10Patch-For-Review: Provide a convenient way to connect to services in kubernetes staging clusters - https://phabricator.wikimedia.org/T300740 (10JMeybohm) 05Open→03Resolved Something like `curl -I https://miscweb.k8s-staging.discovery.wmnet:30443` now wor... [10:00:33] 10serviceops, 10Prod-Kubernetes, 10Traffic, 10Kubernetes: service:.catalog entries and dnsdisc for Kubernetes sevrices under Ingress - https://phabricator.wikimedia.org/T305358 (10JMeybohm) [10:03:12] 10serviceops, 10Prod-Kubernetes, 10Traffic, 10Kubernetes: service:.catalog entries and dnsdisc for Kubernetes sevrices under Ingress - https://phabricator.wikimedia.org/T305358 (10JMeybohm) p:05Triage→03High [10:47:42] 10serviceops, 10Data-Persistence-Backup, 10GitLab (Infrastructure), 10Patch-For-Review, 10User-brennen: Backups for GitLab - https://phabricator.wikimedia.org/T274463 (10Jelto) >>! In T274463#7823634, @Dzahn wrote: > @Jelto @Arnoldokoth See above. I added a new disk to gitlab2001 and gitlab1001. On gitla... [16:13:21] jayme, _joe_ : sorry for the delay, got sidetracked. The new spicerack release is on APT, but I didn't yet pulled it on any of the cumin hosts. Given the meeting and time it might be wiser to postpone to tomorrow [16:13:25] thoughts? [16:13:49] <_joe_> +1 [16:13:52] <_joe_> no rush [18:49:35] 10serviceops, 10Generated Data Platform, 10Image-Suggestions, 10SRE, and 2 others: New Service Request Generated Datasets: Image Suggestions Service - https://phabricator.wikimedia.org/T304891 (10CBogen) [19:06:08] 10serviceops, 10Generated Data Platform, 10Image-Suggestions, 10SRE, 10Service-deployment-requests: Setup Initial Image Suggestion Service CI and k8s params/stubs - https://phabricator.wikimedia.org/T305154 (10CBogen) [19:06:41] 10serviceops, 10Generated Data Platform, 10Image-Suggestions, 10SRE, and 2 others: Blubber setup for Image Suggestions Service - https://phabricator.wikimedia.org/T305155 (10CBogen) [19:15:58] 10serviceops, 10MW-on-K8s, 10Release-Engineering-Team (Done by Feb 23 🧟): Make scap deploy to kubernetes together with the legacy systems - https://phabricator.wikimedia.org/T299648 (10dancy) Proposal for preparing for a transitiom from the [[ https://gerrit.wikimedia.org/r/plugins/gitiles/operations/puppet/... [20:59:41] 10serviceops, 10Infrastructure-Foundations, 10SRE, 10SRE-Access-Requests, 10Release-Engineering-Team (Radar): Need a service account on deploy servers - https://phabricator.wikimedia.org/T303857 (10thcipriani) [23:53:51] 10serviceops, 10GitLab (CI & Job Runners), 10Patch-For-Review: upgrade gitlab-runners to bullseye - https://phabricator.wikimedia.org/T297659 (10Dzahn)