[08:13:28] 10serviceops, 10MW-on-K8s: Coordinate testing of testwiki on kubernetes - https://phabricator.wikimedia.org/T337489 (10Clement_Goubert) Provisional dates would be either week 25 (starting 19th June) or week 2. [08:17:27] 10serviceops: operations/docker-images/production-images contains references to non-existent image python3 - https://phabricator.wikimedia.org/T336682 (10hashar) There are some repositories referring to those images base on [[ https://codesearch.wmcloud.org/search/?q=docker-registry.wikimedia.org%2Fpython3%28-bu... [08:36:32] 10serviceops, 10DC-Ops, 10SRE, 10ops-eqiad: mw1492.eqiad.wmnet is down - https://phabricator.wikimedia.org/T338566 (10Clement_Goubert) p:05Triage→03Medium a:03Jclark-ctr [12:22:55] 10serviceops, 10Arc-Lamp, 10Performance-Team, 10WikimediaDebug, 10Performance-Team-publish: Add per-request flamegraph option to WikimediaDebug - https://phabricator.wikimedia.org/T291015 (10Krinkle) 05Open→03Resolved 📝 **Flame graphs arrive in WikimediaDebug**. — https://techblog.wikimedia.org/2023... [12:22:59] 10serviceops, 10Arc-Lamp, 10Performance-Team, 10WikimediaDebug, 10Performance-Team-publish: Add per-request flamegraph option to WikimediaDebug - https://phabricator.wikimedia.org/T291015 (10Krinkle) [12:47:55] 10serviceops, 10DC-Ops, 10SRE, 10ops-eqiad: mw1492.eqiad.wmnet is down - https://phabricator.wikimedia.org/T338566 (10Jclark-ctr) Server will not boot Unable to pull tsr report. Troubleshooted steps already perfromed Flea power Drain Minimum configuration diabling power button. led light status on ma... [16:59:11] 10serviceops, 10Traffic, 10Datacenter-Switchover, 10Patch-For-Review: Figure out what changes are needed in the traffic layer for having codfw be the r/w DC for half a year - https://phabricator.wikimedia.org/T337535 (10BBlack) The more I've thought about this issue, I think we should probably stick with t... [17:35:44] 10serviceops, 10Wikimedia-Developer-Portal, 10Kubernetes: Deployment of developer-portal into 'staging' k8s cluster failing due to insufficient cpu and node taints - https://phabricator.wikimedia.org/T338493 (10akosiaris) This is related to T337836#8923306. TL;DR is that one of the nodes was non-functional a... [18:55:10] 10serviceops, 10DC-Ops, 10SRE, 10ops-eqiad: mw1492.eqiad.wmnet is down - https://phabricator.wikimedia.org/T338566 (10Jclark-ctr) The Engineer is expected to arrive on 06/13/2023 09:00 AM to 06:00 PM [21:25:57] 10serviceops, 10Wikimedia-Developer-Portal, 10Kubernetes: Deployment of developer-portal into 'staging' k8s cluster failing due to insufficient cpu and node taints - https://phabricator.wikimedia.org/T338493 (10bd808) 05Open→03Resolved a:03akosiaris >>! In T338493#8924281, @akosiaris wrote: > This is r...