[07:37:07] vgutierrez: brainstorming on the same topic, ICMP mtr is fine all the way to the LVS, but the TCP/443 mtr shows an increase of latency on that last hop (text-lb.esams) at ~200ms, packet capture show the same ~200ms between the initial syn and the syn-ack reply. I tried a packet capture on a CP host but couldn't catch the issue in an obvious way at least [08:14:18] XioNoX: so apparently the issue is between the lvs and cp boxes over IPv6? interesting [08:15:59] vgutierrez: not sure, no. To be fully sure we would need to run the same packet capture on the client and the CP to capture both sides [08:17:23] I'm wondering if there is anything else we can look at [08:19:06] IPv6 requests from lvs3005 to a cp node look healthy as well [11:14:20] 10Traffic, 10MW-on-K8s, 10SRE, 10serviceops, and 2 others: Serve production traffic via Kubernetes - https://phabricator.wikimedia.org/T290536 (10Clement_Goubert) [11:15:03] 10Traffic, 10MW-on-K8s, 10SRE, 10serviceops, and 3 others: Migrate group0 to Kubernetes - https://phabricator.wikimedia.org/T337490 (10Clement_Goubert) 05Open→03Stalled Blocked by {T331609} [12:56:16] 10netops, 10Infrastructure-Foundations: Users management on SONiC - https://phabricator.wikimedia.org/T338028 (10ayounsi) [13:01:33] 10netops, 10Infrastructure-Foundations: Users management on SONiC - https://phabricator.wikimedia.org/T338028 (10ayounsi) [13:03:03] 10netops, 10Infrastructure-Foundations: Users management on SONiC - https://phabricator.wikimedia.org/T338028 (10ayounsi) [13:34:57] 10Traffic, 10Infrastructure-Foundations, 10SRE, 10ops-codfw: Reimaging lvs2012 fails as the host is unreachable from cumin2002 - https://phabricator.wikimedia.org/T336428 (10Papaul) @Southparkfan are still have issue here or we can close this task? [13:36:40] 10Traffic, 10Infrastructure-Foundations, 10SRE, 10ops-codfw: Reimaging lvs2012 fails as the host is unreachable from cumin2002 - https://phabricator.wikimedia.org/T336428 (10ssingh) Hi @Papaul: I plan to come back to this once we do the LVS next week and see if we have the same issue, otherwise I will clos... [13:37:35] 10Traffic, 10Infrastructure-Foundations, 10SRE: Reimaging lvs2012 fails as the host is unreachable from cumin2002 - https://phabricator.wikimedia.org/T336428 (10ssingh) [13:43:53] 10netops, 10Infrastructure-Foundations, 10SRE, 10ops-codfw: Codfw:row A/B: rack/cable new switches - https://phabricator.wikimedia.org/T332180 (10Papaul) [14:09:07] 10Traffic, 10DC-Ops, 10SRE, 10ops-eqiad: Q4:rack/setup/install dns100[345] - https://phabricator.wikimedia.org/T326685 (10ssingh) [14:09:27] 10Traffic, 10DC-Ops, 10SRE, 10ops-eqiad: Q4:rack/setup/install dns100[456] - https://phabricator.wikimedia.org/T326685 (10ssingh) [15:19:12] 10netops, 10Cloud-VPS, 10Infrastructure-Foundations, 10SRE, and 2 others: cloudservices[2004/2005]-dev & cloudweb2002-dev: connect them to cloudsw so they can have cloud-private vlan - https://phabricator.wikimedia.org/T336587 (10aborrero) >>! In T336587#8897657, @Andrew wrote: > I haven't dug much, but de... [16:27:24] 10netops, 10Cloud-VPS, 10Infrastructure-Foundations, 10SRE, and 2 others: Move cloud vps ns-recursor IPs to host/row-independent addressing - https://phabricator.wikimedia.org/T307357 (10aborrero) [16:27:59] 10netops, 10Cloud-VPS, 10Infrastructure-Foundations, 10SRE, and 2 others: Move cloud vps ns-recursor IPs to host/row-independent addressing - https://phabricator.wikimedia.org/T307357 (10aborrero) [18:06:44] 10netops, 10Infrastructure-Foundations, 10SRE, 10SRE-tools: Setup zero touch provisioning (ZTP) for network devices - https://phabricator.wikimedia.org/T336485 (10Papaul) @Volans i tested the cookbook today on ssw1-a1 the switch did recevied dhcp but was not able to fetch the config file from the tftp serv...