[08:38:16] 10netops, 10Infrastructure-Foundations, 10SRE: Firewall filter blocking traceroute in underlay QFX5120 EVPN - https://phabricator.wikimedia.org/T348120 (10ayounsi) Thinking a bit more about that, as the loopback is already on a private IP it can't be targeted directly, and packets with TTL=1 being sent to th... [10:33:49] 10netops, 10Infrastructure-Foundations, 10Prod-Kubernetes, 10SRE, and 2 others: Update puppet's topology.kubernetes.io/zone logic to take into account the new setup - https://phabricator.wikimedia.org/T352893 (10Clement_Goubert) 05Open→03Resolved >>! In T352893#9471788, @ayounsi wrote: > Nice !! > > T... [10:33:57] 10netops, 10Infrastructure-Foundations, 10SRE: Re-IP hosts on codfw row A and B to new per-rack vlans/subnets - https://phabricator.wikimedia.org/T354869 (10Clement_Goubert) [10:34:07] 10netops, 10Infrastructure-Foundations, 10Prod-Kubernetes, 10SRE, 10serviceops: Test IP-renumbering on kubestage2002.codfw.wmnet - https://phabricator.wikimedia.org/T352883 (10Clement_Goubert) 05In progress→03Resolved [10:34:15] 10netops, 10Infrastructure-Foundations, 10SRE: Re-IP hosts on codfw row A and B to new per-rack vlans/subnets - https://phabricator.wikimedia.org/T354869 (10Clement_Goubert) [10:48:07] 10Traffic, 10Patch-For-Review, 10Upstream: HAProxy 2.6.16 CPU spikes on cp3066 - https://phabricator.wikimedia.org/T354424 (10Vgutierrez) as suggested by Willy Tarreau on https://github.com/haproxy/haproxy/issues/2403#issuecomment-1900111538 this issue could be easier to debug on HAProxy 2.8 [12:47:25] 10Traffic, 10MW-on-K8s, 10SRE, 10serviceops, 10Release-Engineering-Team (Seen): Move 40% of mediawiki external requests to mw on k8s - https://phabricator.wikimedia.org/T355532 (10Clement_Goubert) [12:48:42] 10Traffic, 10MW-on-K8s, 10SRE, 10serviceops, 10Release-Engineering-Team (Seen): Move 40% of mediawiki external requests to mw on k8s - https://phabricator.wikimedia.org/T355532 (10Clement_Goubert) p:05Triage→03High [14:22:51] 10netops, 10Infrastructure-Foundations, 10SRE, 10ops-codfw: Migrate hosts from codfw row A/B ASW to new LSW devices - https://phabricator.wikimedia.org/T355544 (10cmooney) p:05Triage→03Medium [14:46:43] 10netops, 10Infrastructure-Foundations, 10SRE, 10ops-codfw: Migrate servers in codfw rack B5 from asw-b5-codfw to lsw1-b5-codfw - https://phabricator.wikimedia.org/T355549 (10cmooney) p:05Triage→03Medium [14:49:53] 10netops, 10Infrastructure-Foundations, 10SRE, 10ops-codfw: Migrate servers in codfw rack B5 from asw-b5-codfw to lsw1-b5-codfw - https://phabricator.wikimedia.org/T355549 (10cmooney) [14:50:01] 10netops, 10Infrastructure-Foundations, 10SRE, 10ops-codfw: Migrate hosts from codfw row A/B ASW to new LSW devices - https://phabricator.wikimedia.org/T355544 (10cmooney) [15:35:45] 10netops, 10Infrastructure-Foundations, 10SRE, 10ops-codfw: Migrate hosts from codfw row A/B ASW to new LSW devices - https://phabricator.wikimedia.org/T355544 (10Jhancock.wm) @cmooney I think that's doable. I'll block out my schedule for it. [15:56:57] 10Traffic, 10Infrastructure-Foundations, 10SRE, 10Patch-For-Review: GeoIP mapping experiments - https://phabricator.wikimedia.org/T332024 (10CDanis) [15:57:03] 10Traffic, 10Infrastructure-Foundations, 10SRE: Mapping Client IPs to Resolver IPs - https://phabricator.wikimedia.org/T336947 (10CDanis) 05Open→03Declined Probably the "best" way to solve this is via the Alt-Svc mechanism, which Traffic means to experiment with at some point ({T208242}). That's somethi... [16:11:29] 10Traffic, 10Infrastructure-Foundations, 10SRE: decide on an aggregation function to combine multiple probes into a single measurement - https://phabricator.wikimedia.org/T337318 (10CDanis) 05Open→03Resolved a:03CDanis [16:11:36] 10Traffic, 10Infrastructure-Foundations, 10SRE, 10Patch-For-Review: GeoIP mapping experiments - https://phabricator.wikimedia.org/T332024 (10CDanis) [17:10:01] 10Traffic, 10Data Products, 10Data-Engineering, 10Observability-Logging, 10Patch-For-Review: Move analytics log from Varnish to HAProxy - https://phabricator.wikimedia.org/T351117 (10VirginiaPoundstone) [23:46:42] 10netops, 10Infrastructure-Foundations, 10SRE, 10ops-codfw: Connect two hosts in codfw row A/B for switch migration testing - https://phabricator.wikimedia.org/T345803 (10Papaul) @cmooney can we get those 2 hosts back in decom? Thanks [23:54:22] 10Traffic: Q1:unified decommission task for old esams hosts (knams migration) - https://phabricator.wikimedia.org/T344363 (10Papaul) @ssingh can we close this task?