[08:48:46] 10serviceops, 10Prod-Kubernetes, 10Kubernetes, 10Patch-For-Review: kube-apiserver need to reach webhooks running inside of the cluster - https://phabricator.wikimedia.org/T290967 (10JMeybohm) [10:23:24] FYI, the k8s etcd nodes in eqiad have been moved to Ganeti nodes which have been reimaged to Buster (or were newly added with Buster) and have been converted away from DRBD, so those latency alerts should no longer happen [10:23:46] the kubestaging ones will happen when the complete migration is over [10:23:47] \o/ thanks moritzm! [10:24:40] kubestage is not an issue, we have way less traffic there ususally and ofc. it's not affecting live applications [10:28:27] <_joe_> etcd is highly sensitive to i/o issues btw [13:44:21] 10serviceops, 10Prod-Kubernetes, 10Kubernetes, 10Patch-For-Review: kube-apiserver need to reach webhooks running inside of the cluster - https://phabricator.wikimedia.org/T290967 (10JMeybohm) [13:57:14] 10serviceops, 10Prod-Kubernetes, 10Kubernetes, 10Patch-For-Review: Implement POC for istio ingress - https://phabricator.wikimedia.org/T290966 (10JMeybohm) [22:09:34] 10serviceops, 10GitLab: upgrade gitlab-runners to bullseye - https://phabricator.wikimedia.org/T297659 (10Dzahn) [22:09:38] 10serviceops, 10GitLab (Infrastructure), 10Patch-For-Review: Migrate gitlab-test instance to puppet - https://phabricator.wikimedia.org/T297411 (10Dzahn) [22:17:23] 10serviceops, 10GitLab: upgrade gitlab-runners to bullseye - https://phabricator.wikimedia.org/T297659 (10hashar) For the `integration` project, the instances will be migrated to Bullseye using the flavor requested at T299704: `g3.cores8.ram24.disk20.ephemeral60.4xiops` The important bits being: - enough di... [22:19:11] 10serviceops, 10GitLab (Infrastructure), 10Patch-For-Review: Migrate gitlab-test instance to puppet - https://phabricator.wikimedia.org/T297411 (10Dzahn) 05Stalled→03In progress [22:21:28] 10serviceops, 10GitLab (Infrastructure), 10Patch-For-Review: Migrate gitlab-test instance to puppet - https://phabricator.wikimedia.org/T297411 (10Dzahn) a:05Dzahn→03None current status here: We now have the new instance `gitlab-prod-1001`. It has 2 CPUs and 4GB RAM. When applying the prod puppet role... [23:24:13] 10serviceops, 10GitLab (Infrastructure), 10Patch-For-Review: Migrate gitlab-test instance to puppet - https://phabricator.wikimedia.org/T297411 (10Dzahn) btw, you can see here in Phabricator when someone changes roles on cloud VPS instances. example: https://phabricator.wikimedia.org/rCLIP864817a030ae844bcb...