[00:13:34] 10serviceops, 10GitLab (Infrastructure), 10Patch-For-Review, 10Release-Engineering-Team (GitLab-a-thon 🦊), 10cloud-services-team (Kanban): Assess GitLab-provided docker container registry as a default for docker-in-docker build processes - https://phabricator.wikimedia.org/T307537 (10brennen) > For "dock... [08:45:21] 10serviceops, 10MW-on-K8s, 10Kubernetes, 10Patch-For-Review, 10Release-Engineering-Team (Radar): Kubernetes credentials on deployment servers should be available to deployers, not all users - https://phabricator.wikimedia.org/T305729 (10elukey) I confirm from Aiko's tests that HELM_CACHE_HOME is the prob... [08:52:42] 10serviceops, 10MW-on-K8s, 10Kubernetes, 10Patch-For-Review, 10Release-Engineering-Team (Radar): Kubernetes credentials on deployment servers should be available to deployers, not all users - https://phabricator.wikimedia.org/T305729 (10akosiaris) Just to note a semantic thing here: > I am trying to fig... [09:05:47] 10serviceops, 10MW-on-K8s, 10Kubernetes, 10Patch-For-Review, 10Release-Engineering-Team (Radar): Kubernetes credentials on deployment servers should be available to deployers, not all users - https://phabricator.wikimedia.org/T305729 (10Joe) >>! In T305729#7920053, @akosiaris wrote: > Just to note a sema... [13:17:25] 10serviceops, 10Prod-Kubernetes, 10Kubernetes: Update Kubernets clusters to v1.23 - https://phabricator.wikimedia.org/T307943 (10JMeybohm) [14:45:18] 10serviceops, 10SRE: Service Ops SRE support for iOS notifications update - https://phabricator.wikimedia.org/T306397 (10Tsevener) Hi folks - automatic updates are going out at 100% now. Hopefully the load is looking okay on your end. Thanks! [16:23:45] 10serviceops, 10SRE: Service Ops SRE support for iOS notifications update - https://phabricator.wikimedia.org/T306397 (10akosiaris) Thanks for the update. Load has somewhat increased on our side, albeit minimally. [17:41:49] 10serviceops, 10Continuous-Integration-Infrastructure, 10SRE: contint/releases/hosts with helm installed: puppet - Could not find group deployment - https://phabricator.wikimedia.org/T307740 (10Dzahn) This contributes to: ` 17:36 <+icinga-wm> PROBLEM - Ensure hosts are not performing a change on every pupp... [18:36:29] 10serviceops, 10SRE, 10ops-eqiad: mw1415 (canary appserver) is down, incl. mgmt - https://phabricator.wikimedia.org/T307755 (10Cmjohnson) @Dzahn The server is dead, it will not power on, I attempted to get to basic start-up, 1 DIMM, 1 CPU, and still will not power on, Historically a main board swap is requi... [22:19:38] 10serviceops, 10Patch-For-Review: move micro sites from ganeti to kubernetes - https://phabricator.wikimedia.org/T300171 (10Dzahn) drop staging variant: https://gerrit.wikimedia.org/r/c/operations/container/miscweb/+/791071 create separate variant for 15.wikipedia.org https://gerrit.wikimedia.org/r/c/operati... [23:31:07] 10serviceops, 10GitLab (Infrastructure), 10Patch-For-Review, 10Release-Engineering-Team (GitLab-a-thon 🦊), 10cloud-services-team (Kanban): Assess GitLab Container Registry as a default for container build processes - https://phabricator.wikimedia.org/T307537 (10brennen) [23:35:10] 10serviceops, 10GitLab (Infrastructure), 10Patch-For-Review, 10Release-Engineering-Team (GitLab-a-thon 🦊), 10cloud-services-team (Kanban): Assess GitLab Container Registry as a default for container build processes - https://phabricator.wikimedia.org/T307537 (10brennen) 05In progress→03Stalled We ena...