[00:53:52] 06serviceops, 06DC-Ops, 10ops-eqiad, 10Prod-Kubernetes, and 2 others: Relabel eqiad kubernetes nodes - https://phabricator.wikimedia.org/T383213#10451876 (10VRiley-WMF) 05Open→03Resolved [09:27:14] 06serviceops, 10MW-on-K8s, 10Observability-Metrics, 07Grafana, 10SRE Observability (FY2024/2025-Q2): Gaps in Grafana graphs using Thanos - https://phabricator.wikimedia.org/T371885#10452203 (10fgiunchedi) 05Open→03Resolved a:03fgiunchedi This is effectively done -- see T371102 for followups [09:51:35] 06serviceops, 06collaboration-services, 10Prod-Kubernetes, 07Kubernetes, 13Patch-For-Review: Migrate wikikube-codfw to containerd - https://phabricator.wikimedia.org/T377877#10452328 (10ops-monitoring-bot) depool host kubernetes[2042-2044].codfw.wmnet by jelto@cumin1002 with reason: Renaming nodes [09:56:03] 06serviceops, 06collaboration-services, 10Prod-Kubernetes, 07Kubernetes, 13Patch-For-Review: Migrate wikikube-codfw to containerd - https://phabricator.wikimedia.org/T377877#10452366 (10ops-monitoring-bot) Cookbook cookbooks.sre.k8s.pool-depool-node started by jelto@cumin1002 depool for host kubernetes[2... [10:05:26] 06serviceops, 06collaboration-services, 10Prod-Kubernetes, 07Kubernetes, 13Patch-For-Review: Migrate wikikube-codfw to containerd - https://phabricator.wikimedia.org/T377877#10452408 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.rename started by jelto@cumin1002 from kubernetes2042 to wikikube-work... [10:11:37] 06serviceops, 06Growth-Team, 10Notifications, 10wikitech.wikimedia.org, and 2 others: Wikitech notifications failing to load cross-wiki - https://phabricator.wikimedia.org/T376305#10452427 (10Ladsgroup) 05Open→03Resolved a:03Ladsgroup [10:14:12] 06serviceops, 06collaboration-services, 10Prod-Kubernetes, 07Kubernetes, 13Patch-For-Review: Migrate wikikube-codfw to containerd - https://phabricator.wikimedia.org/T377877#10452439 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.rename started by jelto@cumin1002 from kubernetes2043 to wikikube-work... [10:25:23] 06serviceops, 06collaboration-services, 10Prod-Kubernetes, 07Kubernetes, 13Patch-For-Review: Migrate wikikube-codfw to containerd - https://phabricator.wikimedia.org/T377877#10452479 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.rename started by jelto@cumin1002 from kubernetes2044 to wikikube-work... [10:41:24] 06serviceops, 06collaboration-services, 10Prod-Kubernetes, 07Kubernetes: Migrate wikikube-codfw to containerd - https://phabricator.wikimedia.org/T377877#10452583 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage was started by jelto@cumin1002 for host wikikube-worker2203.codfw.wmnet with OS book... [10:47:43] 06serviceops, 07Kubernetes: cert-manager-cainjector got stuck in staging-codfw - https://phabricator.wikimedia.org/T383551 (10JMeybohm) 03NEW [10:48:18] 06serviceops, 07Kubernetes: cert-manager-cainjector got stuck in staging-codfw - https://phabricator.wikimedia.org/T383551#10452637 (10JMeybohm) [10:57:54] 06serviceops, 06collaboration-services, 10Prod-Kubernetes, 07Kubernetes: Migrate wikikube-codfw to containerd - https://phabricator.wikimedia.org/T377877#10452679 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage was started by jelto@cumin1002 for host wikikube-worker2204.codfw.wmnet with OS book... [11:00:48] 06serviceops, 10Observability-Logging, 06SRE, 10WMF-General-or-Unknown: Re-consider ` >/dev/null 2>&1` as output of many cron'd MW maintenance scripts - https://phabricator.wikimedia.org/T187078#10452687 (10Clement_Goubert) >>! In T187078#10446147, @andrea.denisse wrote: > I think that having a list of the... [11:03:19] 06serviceops, 06collaboration-services, 10Prod-Kubernetes, 07Kubernetes: Migrate wikikube-codfw to containerd - https://phabricator.wikimedia.org/T377877#10452703 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage was started by jelto@cumin1002 for host wikikube-worker2205.codfw.wmnet with OS book... [11:16:20] 06serviceops, 06collaboration-services, 06Data-Platform-SRE, 10Prod-Kubernetes, 07Kubernetes: Set cert-manager leader election namespace to cert-manager - https://phabricator.wikimedia.org/T383553 (10JMeybohm) 03NEW [11:26:35] 06serviceops, 06collaboration-services, 10Prod-Kubernetes, 07Kubernetes: Migrate wikikube-codfw to containerd - https://phabricator.wikimedia.org/T377877#10452841 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage started by jelto@cumin1002 for host wikikube-worker2203.codfw.wmnet with OS bookworm... [11:36:55] 06serviceops, 07Kubernetes: cert-manager-cainjector got stuck in staging-codfw - https://phabricator.wikimedia.org/T383551#10452893 (10JMeybohm) 05Open→03Resolved We're going to update cert-manager to 1.16+ during {T341984} which will support proper JSON logging (eliminating the date issue and hopefull... [11:43:57] 06serviceops, 06collaboration-services, 10Prod-Kubernetes, 07Kubernetes: Migrate wikikube-codfw to containerd - https://phabricator.wikimedia.org/T377877#10452934 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage started by jelto@cumin1002 for host wikikube-worker2204.codfw.wmnet with OS bookworm... [11:50:45] 06serviceops, 06collaboration-services, 10Prod-Kubernetes, 07Kubernetes: Migrate wikikube-codfw to containerd - https://phabricator.wikimedia.org/T377877#10452946 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage started by jelto@cumin1002 for host wikikube-worker2205.codfw.wmnet with OS bookworm... [11:58:19] 06serviceops, 06collaboration-services, 10Prod-Kubernetes, 07Kubernetes: Migrate wikikube-codfw to containerd - https://phabricator.wikimedia.org/T377877#10452965 (10ops-monitoring-bot) pool host wikikube-worker[2203-2205].codfw.wmnet by jelto@cumin1002 with reason: None [11:58:23] 06serviceops, 06collaboration-services, 10Prod-Kubernetes, 07Kubernetes: Migrate wikikube-codfw to containerd - https://phabricator.wikimedia.org/T377877#10452966 (10ops-monitoring-bot) Cookbook cookbooks.sre.k8s.pool-depool-node started by jelto@cumin1002 pool for host wikikube-worker[2203-2205].codfw.wmn... [12:00:58] 06serviceops, 06DC-Ops, 10ops-codfw, 10Prod-Kubernetes, and 2 others: Relabel codfw kubernetes nodes - https://phabricator.wikimedia.org/T383341#10452988 (10Jelto) [12:17:58] 06serviceops, 06DC-Ops, 10decommission-hardware, 10ops-eqiad, and 2 others: decommission mw[1349-1413] - https://phabricator.wikimedia.org/T375842#10453015 (10ops-monitoring-bot) depool host wikikube-worker[1008-1010,1013-1014,1017-1018].eqiad.wmnet by kamila@cumin1002 with reason: Decommissioning nodes [12:21:54] 06serviceops, 06DC-Ops, 10decommission-hardware, 10ops-eqiad, and 2 others: decommission mw[1349-1413] - https://phabricator.wikimedia.org/T375842#10453027 (10ops-monitoring-bot) Cookbook cookbooks.sre.k8s.pool-depool-node started by kamila@cumin1002 depool for host wikikube-worker[1008-1010,1013-1014,101... [13:18:52] 06serviceops, 06DC-Ops, 10decommission-hardware, 10ops-eqiad, and 2 others: decommission mw[1349-1413] - https://phabricator.wikimedia.org/T375842#10453142 (10ops-monitoring-bot) cookbooks.sre.hosts.decommission executed by kamila@cumin1002 for hosts: `wikikube-worker[1008-1010].eqiad.wmnet` - wikikube-wo... [13:48:58] 06serviceops, 06DC-Ops, 10decommission-hardware, 10ops-eqiad, 06SRE: decommission mw[1349-1413] - https://phabricator.wikimedia.org/T375842#10453228 (10ops-monitoring-bot) cookbooks.sre.hosts.decommission executed by kamila@cumin1002 for hosts: `wikikube-worker[1013-1014,1017-1018].eqiad.wmnet` - wikiku... [14:03:11] 06serviceops, 06collaboration-services, 10Prod-Kubernetes, 07Kubernetes, 13Patch-For-Review: Migrate wikikube-codfw to containerd - https://phabricator.wikimedia.org/T377877#10453265 (10ops-monitoring-bot) depool host kubernetes[2040-2041].codfw.wmnet by jelto@cumin1002 with reason: Renaming nodes [14:06:58] 06serviceops, 06collaboration-services, 10Prod-Kubernetes, 07Kubernetes, 13Patch-For-Review: Migrate wikikube-codfw to containerd - https://phabricator.wikimedia.org/T377877#10453267 (10ops-monitoring-bot) Cookbook cookbooks.sre.k8s.pool-depool-node started by jelto@cumin1002 depool for host kubernetes[2... [14:19:11] 06serviceops, 06collaboration-services, 10Prod-Kubernetes, 07Kubernetes, 13Patch-For-Review: Migrate wikikube-codfw to containerd - https://phabricator.wikimedia.org/T377877#10453309 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.rename started by jelto@cumin1002 from kubernetes2040 to wikikube-work... [14:22:56] 06serviceops, 06collaboration-services, 10Prod-Kubernetes, 07Kubernetes, 13Patch-For-Review: Migrate wikikube-codfw to containerd - https://phabricator.wikimedia.org/T377877#10453321 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.rename started by jelto@cumin1002 from kubernetes2041 to wikikube-work... [14:37:28] 06serviceops, 06collaboration-services, 10Prod-Kubernetes, 07Kubernetes: Migrate wikikube-codfw to containerd - https://phabricator.wikimedia.org/T377877#10453415 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage was started by jelto@cumin1002 for host wikikube-worker2206.codfw.wmnet with OS book... [14:37:29] 06serviceops, 06collaboration-services, 10Prod-Kubernetes, 07Kubernetes: Migrate wikikube-codfw to containerd - https://phabricator.wikimedia.org/T377877#10453416 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage was started by jelto@cumin1002 for host wikikube-worker2207.codfw.wmnet with OS book... [14:50:14] 06serviceops, 06collaboration-services, 06Data-Platform-SRE, 10Prod-Kubernetes, and 2 others: Remove the kubelet readOnlyPort - https://phabricator.wikimedia.org/T383413#10453486 (10JMeybohm) 05Open→03Resolved This last unauthenticated access to k8s components should be gone in the next 30' [15:01:15] 06serviceops, 10Observability-Metrics, 13Patch-For-Review, 07Wikimedia-Performance-recommendation: Enable mediawiki appserver metrics for jobrunner hosts - https://phabricator.wikimedia.org/T293943#10453541 (10Clement_Goubert) While investigating if this task could be closed, I realized we were not logging... [15:23:35] 06serviceops, 06collaboration-services, 10Prod-Kubernetes, 07Kubernetes: Migrate wikikube-codfw to containerd - https://phabricator.wikimedia.org/T377877#10453670 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage started by jelto@cumin1002 for host wikikube-worker2206.codfw.wmnet with OS bookworm... [15:23:39] 06serviceops, 10Observability-Metrics, 13Patch-For-Review, 07Wikimedia-Performance-recommendation: Enable mediawiki appserver metrics for jobrunner hosts - https://phabricator.wikimedia.org/T293943#10453671 (10Clement_Goubert) 05Open→03Resolved a:03Clement_Goubert Logs are now appearing in logsta... [15:28:57] 06serviceops, 06collaboration-services, 10Prod-Kubernetes, 07Kubernetes: Migrate wikikube-codfw to containerd - https://phabricator.wikimedia.org/T377877#10453703 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage started by jelto@cumin1002 for host wikikube-worker2207.codfw.wmnet with OS bookworm... [15:33:08] 06serviceops, 06collaboration-services, 10Prod-Kubernetes, 07Kubernetes: Migrate wikikube-codfw to containerd - https://phabricator.wikimedia.org/T377877#10453754 (10ops-monitoring-bot) pool host wikikube-worker[2206-2207].codfw.wmnet by jelto@cumin1002 with reason: None [15:33:15] 06serviceops, 06collaboration-services, 10Prod-Kubernetes, 07Kubernetes: Migrate wikikube-codfw to containerd - https://phabricator.wikimedia.org/T377877#10453755 (10ops-monitoring-bot) Cookbook cookbooks.sre.k8s.pool-depool-node started by jelto@cumin1002 pool for host wikikube-worker[2206-2207].codfw.wmn... [15:33:46] 06serviceops, 06DC-Ops, 10ops-codfw, 10Prod-Kubernetes, and 2 others: Relabel codfw kubernetes nodes - https://phabricator.wikimedia.org/T383341#10453759 (10Jelto) [15:36:21] 06serviceops: Measure segfaults in mediawiki and parsoid servers - https://phabricator.wikimedia.org/T246470#10453768 (10fgiunchedi) The task will definitely need to be revisited in a mw-on-k8s world, I'm untagging o11y for now though please reach out when the time comes! [15:47:17] 06serviceops, 06collaboration-services, 10Prod-Kubernetes, 07Kubernetes, 13Patch-For-Review: Migrate wikikube-codfw to containerd - https://phabricator.wikimedia.org/T377877#10453871 (10ops-monitoring-bot) depool host mw[2416-2419].codfw.wmnet by jelto@cumin1002 with reason: Renaming nodes [15:52:18] 06serviceops, 06collaboration-services, 10Prod-Kubernetes, 07Kubernetes, 13Patch-For-Review: Migrate wikikube-codfw to containerd - https://phabricator.wikimedia.org/T377877#10453922 (10ops-monitoring-bot) Cookbook cookbooks.sre.k8s.pool-depool-node started by jelto@cumin1002 depool for host mw[2416-2419... [16:00:37] 06serviceops, 06collaboration-services, 10Prod-Kubernetes, 07Kubernetes, 13Patch-For-Review: Migrate wikikube-codfw to containerd - https://phabricator.wikimedia.org/T377877#10454006 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.rename started by jelto@cumin1002 from mw2416 to wikikube-worker2208 c... [16:06:15] 06serviceops, 06collaboration-services, 10Prod-Kubernetes, 07Kubernetes, 13Patch-For-Review: Migrate wikikube-codfw to containerd - https://phabricator.wikimedia.org/T377877#10454039 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.rename started by jelto@cumin1002 from mw2417 to wikikube-worker2209 c... [16:14:17] 06serviceops, 06collaboration-services, 10Prod-Kubernetes, 07Kubernetes, 13Patch-For-Review: Migrate wikikube-codfw to containerd - https://phabricator.wikimedia.org/T377877#10454083 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.rename started by jelto@cumin1002 from mw2418 to wikikube-worker2210 c... [16:20:17] 06serviceops, 06collaboration-services, 10Prod-Kubernetes, 07Kubernetes, 13Patch-For-Review: Migrate wikikube-codfw to containerd - https://phabricator.wikimedia.org/T377877#10454099 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.rename started by jelto@cumin1002 from mw2419 to wikikube-worker2211 c... [16:23:46] 06serviceops, 06collaboration-services, 10Prod-Kubernetes, 07Kubernetes, 13Patch-For-Review: Migrate wikikube-codfw to containerd - https://phabricator.wikimedia.org/T377877#10454125 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage was started by jelto@cumin1002 for host wikikube-worker2208.co... [16:32:37] 06serviceops, 06collaboration-services, 10Prod-Kubernetes, 07Kubernetes: Migrate wikikube-codfw to containerd - https://phabricator.wikimedia.org/T377877#10454217 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage was started by jelto@cumin1002 for host wikikube-worker2209.codfw.wmnet with OS book... [16:38:42] 06serviceops, 06collaboration-services, 10Prod-Kubernetes, 07Kubernetes: Migrate wikikube-codfw to containerd - https://phabricator.wikimedia.org/T377877#10454240 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage was started by jelto@cumin1002 for host wikikube-worker2210.codfw.wmnet with OS book... [16:42:44] 06serviceops, 06DC-Ops, 10ops-codfw, 10Prod-Kubernetes, and 2 others: Relabel codfw kubernetes nodes - https://phabricator.wikimedia.org/T383341#10454264 (10Jhancock.wm) 05Open→03Resolved [16:54:06] 06serviceops, 06collaboration-services, 10Prod-Kubernetes, 07Kubernetes: Migrate wikikube-codfw to containerd - https://phabricator.wikimedia.org/T377877#10454338 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage was started by jelto@cumin1002 for host wikikube-worker2211.codfw.wmnet with OS book... [17:08:51] 06serviceops, 06collaboration-services, 10Prod-Kubernetes, 07Kubernetes: Migrate wikikube-codfw to containerd - https://phabricator.wikimedia.org/T377877#10454436 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage started by jelto@cumin1002 for host wikikube-worker2208.codfw.wmnet with OS bookworm... [17:15:59] 06serviceops, 06collaboration-services, 10Prod-Kubernetes, 07Kubernetes: Migrate wikikube-codfw to containerd - https://phabricator.wikimedia.org/T377877#10454457 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage started by jelto@cumin1002 for host wikikube-worker2209.codfw.wmnet with OS bookworm... [17:26:32] 06serviceops, 06collaboration-services, 10Prod-Kubernetes, 07Kubernetes: Migrate wikikube-codfw to containerd - https://phabricator.wikimedia.org/T377877#10454550 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage started by jelto@cumin1002 for host wikikube-worker2210.codfw.wmnet with OS bookworm... [17:40:43] 06serviceops, 06collaboration-services, 10Prod-Kubernetes, 07Kubernetes: Migrate wikikube-codfw to containerd - https://phabricator.wikimedia.org/T377877#10454647 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage started by jelto@cumin1002 for host wikikube-worker2211.codfw.wmnet with OS bookworm... [17:47:00] 06serviceops, 06collaboration-services, 10Prod-Kubernetes, 07Kubernetes: Migrate wikikube-codfw to containerd - https://phabricator.wikimedia.org/T377877#10454719 (10ops-monitoring-bot) pool host wikikube-worker[2208-2211].codfw.wmnet by jelto@cumin1002 with reason: None [17:47:05] 06serviceops, 06collaboration-services, 10Prod-Kubernetes, 07Kubernetes: Migrate wikikube-codfw to containerd - https://phabricator.wikimedia.org/T377877#10454722 (10ops-monitoring-bot) Cookbook cookbooks.sre.k8s.pool-depool-node started by jelto@cumin1002 pool for host wikikube-worker[2208-2211].codfw.wmn... [17:47:37] 06serviceops, 06DC-Ops, 10ops-codfw, 10Prod-Kubernetes, 07Kubernetes: Relabel codfw kubernetes nodes - https://phabricator.wikimedia.org/T383595 (10Jelto) 03NEW [18:10:23] 06serviceops, 10MW-on-K8s, 06SRE, 13Patch-For-Review: Reclaim jobrunner hardware for k8s - https://phabricator.wikimedia.org/T354791#10454956 (10kamila) [18:17:03] 06serviceops, 06SRE, 10WMF-General-or-Unknown: Re-consider ` >/dev/null 2>&1` as output of many cron'd MW maintenance scripts - https://phabricator.wikimedia.org/T187078#10455000 (10andrea.denisse) [18:17:15] 06serviceops, 06SRE, 10WMF-General-or-Unknown: Re-consider ` >/dev/null 2>&1` as output of many cron'd MW maintenance scripts - https://phabricator.wikimedia.org/T187078#10455002 (10andrea.denisse) [18:17:18] 06serviceops, 10MW-on-K8s, 13Patch-For-Review: Allow running periodic jobs for mw on k8s - https://phabricator.wikimedia.org/T341555#10455003 (10andrea.denisse) [18:21:27] 06serviceops, 06SRE, 10WMF-General-or-Unknown: Re-consider ` >/dev/null 2>&1` as output of many cron'd MW maintenance scripts - https://phabricator.wikimedia.org/T187078#10455034 (10andrea.denisse) a:03Clement_Goubert Thanks Claime, I'm removing the o11y tag and assigning this to you as you currently have... [18:23:54] 06serviceops, 10MW-on-K8s, 06SRE, 13Patch-For-Review: Reclaim jobrunner hardware for k8s - https://phabricator.wikimedia.org/T354791#10455039 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.rename started by kamila@cumin1002 from mw1445 to wikikube-worker1096 completed: - mw1445 (**PASS**) - ✔️ Downt... [18:26:59] 06serviceops, 10MW-on-K8s, 06SRE, 13Patch-For-Review: Reclaim jobrunner hardware for k8s - https://phabricator.wikimedia.org/T354791#10455061 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.rename started by kamila@cumin1002 from mw1446 to wikikube-worker1097 completed: - mw1446 (**PASS**) - ✔️ Downt... [18:28:03] 06serviceops, 10MW-on-K8s, 06SRE, 13Patch-For-Review: Reclaim jobrunner hardware for k8s - https://phabricator.wikimedia.org/T354791#10455070 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage was started by kamila@cumin1002 for host wikikube-worker1096.eqiad.wmnet with OS bookworm [18:28:15] 06serviceops, 10MW-on-K8s, 06SRE, 13Patch-For-Review: Reclaim jobrunner hardware for k8s - https://phabricator.wikimedia.org/T354791#10455071 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage was started by kamila@cumin1002 for host wikikube-worker1097.eqiad.wmnet with OS bookworm [18:30:19] 06serviceops, 10decommission-hardware: decommission mw135[8-9], mw136[4-6], mw137[2-3], mw140[0-4], mw1406, mw14[11-13] - https://phabricator.wikimedia.org/T383227#10455085 (10kamila) [19:03:18] 06serviceops, 13Patch-For-Review: Migrate production Shellbox variants to PHP 8.1 - https://phabricator.wikimedia.org/T377038#10455194 (10Scott_French) [19:04:53] 06serviceops, 10MW-on-K8s, 06SRE, 13Patch-For-Review: Reclaim jobrunner hardware for k8s - https://phabricator.wikimedia.org/T354791#10455197 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage started by kamila@cumin1002 for host wikikube-worker1096.eqiad.wmnet with OS bookworm completed: - wikiku... [19:09:09] 06serviceops, 10MW-on-K8s, 06SRE, 13Patch-For-Review: Reclaim jobrunner hardware for k8s - https://phabricator.wikimedia.org/T354791#10455203 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage started by kamila@cumin1002 for host wikikube-worker1097.eqiad.wmnet with OS bookworm completed: - wikiku... [20:05:53] 06serviceops, 10MW-on-K8s, 06SRE, 13Patch-For-Review: Reclaim jobrunner hardware for k8s - https://phabricator.wikimedia.org/T354791#10455510 (10ops-monitoring-bot) pool host wikikube-worker[1096-1097].eqiad.wmnet by kamila@cumin1002 with reason: None [20:05:56] 06serviceops, 10MW-on-K8s, 06SRE, 13Patch-For-Review: Reclaim jobrunner hardware for k8s - https://phabricator.wikimedia.org/T354791#10455511 (10ops-monitoring-bot) Cookbook cookbooks.sre.k8s.pool-depool-node started by kamila@cumin1002 pool for host wikikube-worker[1096-1097].eqiad.wmnet completed: - wiki... [20:07:33] 06serviceops, 06DC-Ops, 10ops-eqiad, 10Prod-Kubernetes, 07Kubernetes: Relabel eqiad kubernetes nodes - https://phabricator.wikimedia.org/T383620 (10kamila) 03NEW [21:44:41] 06serviceops, 10Observability-Metrics, 07Grafana, 07Kubernetes, 13Patch-For-Review: High cardinality metrics break queries/dashboards (envoy, istio, ...) - https://phabricator.wikimedia.org/T369607#10456096 (10andrea.denisse) p:05Triage→03Medium [22:20:43] 06serviceops, 06Content-Transform-Team, 06MediaWiki-Engineering, 06MW-Interfaces-Team, and 3 others: Testing and verification of MediaWiki on PHP 8.1 in mwdebug-next - https://phabricator.wikimedia.org/T379986#10456219 (10Tgr)