[06:45:49] 06serviceops, 06collaboration-services, 06Infrastructure-Foundations, 10Puppet-Core, and 5 others: Migrate roles to puppet7 - https://phabricator.wikimedia.org/T349619#9709114 (10MoritzMuehlenhoff) [07:26:53] 06serviceops, 10Observability-Logging, 10Prod-Kubernetes, 07Kubernetes, 13Patch-For-Review: Evaluate and enable audit logging for kube-apiserver - https://phabricator.wikimedia.org/T290020#9709155 (10JMeybohm) Thanks! Elastic does maintain a audit_log integration at https://github.com/elastic/integration... [07:32:49] 06serviceops, 06Data-Platform-SRE, 10Prod-Kubernetes, 07Kubernetes, 13Patch-For-Review: Migrate charts to Calico Network Policies - https://phabricator.wikimedia.org/T359423#9709161 (10JMeybohm) [07:55:17] 06serviceops, 10Observability-Logging, 10Prod-Kubernetes, 07Kubernetes, 13Patch-For-Review: Evaluate and enable audit logging for kube-apiserver - https://phabricator.wikimedia.org/T290020#9709188 (10JMeybohm) I've merged the attached patch and the logs are ingested into the `logstash-k8s-` index. Unfort... [09:08:04] 06serviceops, 10Deployments, 06Release-Engineering-Team: 14MediaWiki deploy servers should not be mediawiki installation targets - 14https://phabricator.wikimedia.org/T329857#9709305 (10Clement_Goubert) 14>>! In T329857#9708545, @dancy wrote: > @Clement_Goubert I noticed the `/srv/mediawiki.old.20230424... [10:58:12] 06serviceops, 10envoy: Using port in Host header for thanos-swift / thanos-query breaks vhost selection - https://phabricator.wikimedia.org/T300119#9709563 (10Aklapper) [12:11:25] 06serviceops, 10Observability-Logging, 13Patch-For-Review: Logs from containers sometimes not visible in logstash - https://phabricator.wikimedia.org/T357616#9709704 (10fgiunchedi) I've chatted with @JMeybohm about this, and since for example a seemingly-related fix (https://github.com/rsyslog/rsyslog/pull/5... [12:35:02] 06serviceops, 10Wikidata, 06Wikidata Dev Team, 10Wikidata-Termbox, 10wmde-wikidata-tech: [SW] [GENERAL] Simplify Termbox SSR test release - https://phabricator.wikimedia.org/T355955#9709761 (10Lucas_Werkmeister_WMDE) [12:36:55] 06serviceops, 10Wikidata, 06Wikidata Dev Team, 10Wikidata-Termbox, 10wmde-wikidata-tech: [SW] [GENERAL] Simplify Termbox SSR test release - https://phabricator.wikimedia.org/T355955#9709763 (10Lucas_Werkmeister_WMDE) [13:44:20] 06serviceops, 10Prod-Kubernetes, 07Kubernetes: Migration to containerd and away from docker - https://phabricator.wikimedia.org/T362408 (10akosiaris) 03NEW [14:56:39] 06serviceops, 10Observability-Logging, 10Prod-Kubernetes, 07Kubernetes, 13Patch-For-Review: Evaluate and enable audit logging for kube-apiserver - https://phabricator.wikimedia.org/T290020#9710264 (10colewhite) >>! In T290020#9709155, @JMeybohm wrote: > Thanks! Elastic does maintain a audit_log integrati... [15:40:33] 06serviceops, 10Observability-Logging, 10Prod-Kubernetes, 07Kubernetes, 13Patch-For-Review: Evaluate and enable audit logging for kube-apiserver - https://phabricator.wikimedia.org/T290020#9710391 (10JMeybohm) >>! In T290020#9710264, @colewhite wrote: > Elastic Integrations aren't available to us in an O... [15:58:56] 06serviceops, 06Machine-Learning-Team, 10MW-on-K8s, 06SRE, 13Patch-For-Review: Migrate ml-services to mw-api-int - https://phabricator.wikimedia.org/T362316#9710449 (10elukey) Current status: * all services deployed in ml-staging, need to double check that all the pods are running but so far I didn't no... [15:59:09] 06serviceops, 06Machine-Learning-Team, 10MW-on-K8s, 06SRE, 13Patch-For-Review: Migrate ml-services to mw-api-int - https://phabricator.wikimedia.org/T362316#9710450 (10elukey) a:05Clement_Goubert→03None [16:04:40] claime: o/ ml-staging is now hitting mw-api-int-ro, I'll do the validations on monday and then prep for prod [17:48:21] 06serviceops, 10Prod-Kubernetes, 13Patch-For-Review: PodSecurityPolicies will be deprecated with Kubernetes 1.21 - https://phabricator.wikimedia.org/T273507#9710781 (10JMeybohm) I've added a more comprehensive list of @elukey's test at https://wikitech.wikimedia.org/wiki/User:JMeybohm/PSP_Replacement#Violati... [19:39:41] 06serviceops, 10Observability-Logging, 10Prod-Kubernetes, 07Kubernetes, 13Patch-For-Review: Enable audit logging for kube-apiserver - https://phabricator.wikimedia.org/T290020#9710865 (10JMeybohm) [19:42:52] 06serviceops, 10Prod-Kubernetes, 13Patch-For-Review: PodSecurityPolicies will be deprecated with Kubernetes 1.21 - https://phabricator.wikimedia.org/T273507#9710876 (10JMeybohm) [19:43:40] 06serviceops, 10Prod-Kubernetes, 13Patch-For-Review: PodSecurityPolicies will be deprecated with Kubernetes 1.21 - https://phabricator.wikimedia.org/T273507#9710877 (10JMeybohm) [19:44:01] 06serviceops, 10Prod-Kubernetes, 13Patch-For-Review: PodSecurityPolicies will be deprecated with Kubernetes 1.21 - https://phabricator.wikimedia.org/T273507#9710873 (10JMeybohm) [19:46:19] 06serviceops, 10Prod-Kubernetes, 13Patch-For-Review: PodSecurityPolicies will be deprecated with Kubernetes 1.21 - https://phabricator.wikimedia.org/T273507#9710878 (10JMeybohm)