[00:26:30] 10netops, 10Infrastructure-Foundations, 10SRE, 10ops-codfw: Codfw:row A/B: rack/cable new switches - https://phabricator.wikimedia.org/T332180 (10Papaul) [00:27:01] 10netops, 10Infrastructure-Foundations, 10SRE, 10ops-codfw: Codfw:row A/B: rack/cable new switches - https://phabricator.wikimedia.org/T332180 (10Papaul) [00:28:53] 10netops, 10Infrastructure-Foundations, 10SRE, 10ops-codfw: Codfw:row A/B: rack/cable new switches - https://phabricator.wikimedia.org/T332180 (10Papaul) [00:36:10] 10netops, 10Infrastructure-Foundations, 10SRE: Plan codfw row A/B top-of-rack switch refresh - https://phabricator.wikimedia.org/T327938 (10Papaul) [00:36:19] 10netops, 10Infrastructure-Foundations, 10SRE, 10ops-codfw: Codfw:row A/B: rack/cable new switches - https://phabricator.wikimedia.org/T332180 (10Papaul) 05Open→03Resolved @cmooney @ayounsi the cabling is done.I am using port 55 on each leaf to connect to ssw1-a1 and pot 54 to connect to ssw1-a8. the l... [01:42:20] 10netops, 10Infrastructure-Foundations, 10SRE, 10ops-codfw: codfw:basic spines/leaves configuration using ZTP - https://phabricator.wikimedia.org/T339315 (10Papaul) [01:47:43] 10netops, 10Infrastructure-Foundations, 10SRE, 10ops-codfw: codfw:basic spines/leaves configuration using ZTP - https://phabricator.wikimedia.org/T339315 (10Papaul) 05Open→03Resolved @cmooney @ayounsi the basic config is done on all the switches using ZTP. so when added to devices.yaml you should be go... [05:53:01] 10netops, 10Infrastructure-Foundations, 10SRE: IC-307235 down yet again - https://phabricator.wikimedia.org/T339289 (10ayounsi) 05Open→03Resolved a:03ayounsi Thanks, looks like it's back up and they sent an RFO. This circuit will be upgraded to 100G soon-ish, so probably no need for specific follow up... [08:55:25] 10netops, 10Infrastructure-Foundations, 10SRE, 10ops-codfw: Codfw:row A/B: rack/cable new switches - https://phabricator.wikimedia.org/T332180 (10cmooney) Thanks @papaul great work! So it seems I was wrong we can run homer on these without having to add anything to devices.yaml for now. Just need to set... [09:12:48] 10netops, 10Infrastructure-Foundations, 10SRE, 10SRE-tools: Setup zero touch provisioning (ZTP) for network devices - https://phabricator.wikimedia.org/T336485 (10cmooney) ZTP via TFTP now tested and working fully in codfw :) [09:15:04] 10netops, 10Infrastructure-Foundations, 10SRE, 10ops-codfw: codfw:basic spines/leaves configuration using ZTP - https://phabricator.wikimedia.org/T339315 (10cmooney) Thanks @papaul! I commented back on the other task, seems I was wrong about the requirement for devices.yaml: T332180#8937991 [11:41:33] 10netops, 10Cloud-VPS, 10Infrastructure-Foundations, 10SRE, and 3 others: Move cloud vps ns-recursor IPs to host/row-independent addressing - https://phabricator.wikimedia.org/T307357 (10aborrero) [11:46:35] 10netops, 10Cloud-VPS, 10Infrastructure-Foundations, 10SRE, and 3 others: cloudservices2004-dev: reimage into new network setup - https://phabricator.wikimedia.org/T338778 (10aborrero) new `pools.yaml` file: ` - also_notifies: [] attributes: {} description: Pool for pdns backing designate id: 794ccc... [11:50:14] 10netops, 10Cloud-VPS, 10Infrastructure-Foundations, 10SRE, and 3 others: Move cloud vps ns-recursor IPs to host/row-independent addressing - https://phabricator.wikimedia.org/T307357 (10aborrero) I just deleted netbox objects for IPv6: * 2620:0:860:2:208:80:153:47 * 2620:0:860:2:208:80:153:50 [14:54:42] 10netops, 10Cloud-VPS, 10Infrastructure-Foundations, 10SRE, and 3 others: Move cloud vps ns-recursor IPs to host/row-independent addressing - https://phabricator.wikimedia.org/T307357 (10aborrero) Deleting DNS name from the IPv6: * 2620:0:861:2:208:80:154:148/64 https://netbox.wikimedia.org/ipam/ip-address... [15:09:57] 10netops, 10Cloud-VPS, 10Infrastructure-Foundations, 10SRE, and 3 others: Move cloud vps ns-recursor IPs to host/row-independent addressing - https://phabricator.wikimedia.org/T307357 (10aborrero) Deleting DNS entries for: * 208.80.153.47/32 https://netbox.wikimedia.org/ipam/ip-addresses/10716/ (ns-recurso... [15:49:35] 10netops, 10Cloud-VPS, 10Infrastructure-Foundations, 10SRE, and 3 others: cloudservices2004-dev: reimage into new network setup - https://phabricator.wikimedia.org/T338778 (10aborrero) Updating the poo yields: ` Updating Pools Configuration **************************** An error has occurred: Traceback (mo... [17:08:28] 10netops, 10Cloud-VPS, 10Infrastructure-Foundations, 10SRE, and 3 others: cloudservices2004-dev: reimage into new network setup - https://phabricator.wikimedia.org/T338778 (10aborrero) After many changes, it still shows memcached problems. [18:34:41] 10netops, 10Cloud-VPS, 10Infrastructure-Foundations, 10SRE, and 3 others: cloudservices2004-dev: reimage into new network setup - https://phabricator.wikimedia.org/T338778 (10rook) [19:28:27] 10Traffic, 10WMF-Legal, 10Patch-For-Review, 10Performance-Team (Radar), 10Privacy: Add no-transform to Cache-Control header - https://phabricator.wikimedia.org/T218618 (10BCornwall) @Vgutierrez, @ssingh any thoughts on whether you'd like this added to the header?