[08:14:44] 10netops, 06Infrastructure-Foundations: Arelion IPv6 transit renumbering - https://phabricator.wikimedia.org/T365697#10232660 (10cmooney) >>! In T365697#10231895, @Papaul wrote: > @ayounsi I double check again that all the old IPV6 were removed. But we have the old IPV6 that were still in cache so here ar... [13:14:08] 10netops, 06Infrastructure-Foundations: Arelion IPv6 transit renumbering - https://phabricator.wikimedia.org/T365697#10233442 (10Papaul) @cmooney the only issue was Arelion sent us 2 emails saying : "We still see IPV6 neighbor solicitation for the old IPV6 addresses operating in parallel with the new" and... [13:16:37] 10netops, 06DC-Ops, 10fundraising-tech-ops, 06Infrastructure-Foundations, and 2 others: codfw:frack pfw3 and old fasw decommission - https://phabricator.wikimedia.org/T377254#10233448 (10Papaul) [14:06:43] volans: now that the uefi functions have been merged in, what is the process for cutting a new spicerack release? [14:08:34] in general ping me or luca [14:08:46] done ;) [14:09:19] but I'm supposedly not here too :D so not sure what's the protocol for me :-P [14:10:02] * jhathaway searches for volan's doppelganger [14:16:45] jhathaway: I gather that I'd need to cut a new spicerack release :D [14:17:02] if it is not urgent we can wait a few days to see if anything else is merged in [14:17:09] then I'll create one [14:17:41] not urgent, but the rest of the efi patches can't be merged and tested until the spicerack release, https://gerrit.wikimedia.org/r/q/hashtag:%22efiboot%22+(status:open%20OR%20status:merged) [14:28:04] 10netops, 06DC-Ops, 06Infrastructure-Foundations, 10ops-eqiad, 06SRE: cr1-eqiad: disk failure - https://phabricator.wikimedia.org/T372781#10233790 (10VRiley-WMF) Just wanted to ask, if the disk is showing that it's back, should we still keep this ticket open? Or, is it safe to close? [14:35:25] jhathaway: definitely yes, I have another patch lined up for the provision cookbook (to refactor it a bit) and then I'll adapt the uefi patch to it as well [14:35:44] great thanks [14:53:28] 10netops, 06cloud-services-team, 10Cloud-VPS, 06Infrastructure-Foundations, 06SRE: cloudgw: add support and enable IPv6 - https://phabricator.wikimedia.org/T374716#10233918 (10aborrero) 05Open→03Resolved We got it all working on 2024-10-11. [15:09:50] 10netops, 06cloud-services-team, 10Cloud-VPS, 06Infrastructure-Foundations, 06SRE: CloudVPS: IPv6 in codfw1dev - https://phabricator.wikimedia.org/T245495#10234047 (10aborrero) [15:56:04] 10netops, 06cloud-services-team, 10Cloud-VPS, 06Infrastructure-Foundations, 06SRE: dns: integrate PTR support for 2a02:ec80:a100::/48 - https://phabricator.wikimedia.org/T376462#10234300 (10cmooney) [15:56:11] 10netops, 06cloud-services-team, 10Cloud-VPS, 06Infrastructure-Foundations, 06SRE: openstack: work out IPv6 and designate integration - https://phabricator.wikimedia.org/T374715#10234301 (10cmooney) [17:08:48] 10CAS-SSO, 06Infrastructure-Foundations: Document how to authenticate a bot account through CAS-SSO - https://phabricator.wikimedia.org/T377372 (10bd808) 03NEW [17:12:25] 10CAS-SSO, 06Infrastructure-Foundations, 06SRE Observability: Document how to authenticate a bot account through CAS-SSO - https://phabricator.wikimedia.org/T377372#10234916 (10bd808) Adding #sre-observability to the tagged projects here in case those fine folks have this problem all figured out already for... [17:58:34] 10netops, 06Infrastructure-Foundations, 06SRE: Re-IP hosts on codfw row A and B to new per-rack vlans/subnets - https://phabricator.wikimedia.org/T354869#10235144 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage was started by dzahn@cumin2002 for host phab2002.codfw.wmnet with OS bullseye [18:46:36] 10Mail, 06Infrastructure-Foundations, 06SRE: Remove Exim based MTAs - https://phabricator.wikimedia.org/T325409#10235387 (10ops-monitoring-bot) cookbooks.sre.hosts.decommission executed by jhathaway@cumin1002 for hosts: `mx2001.wikimedia.org` - mx2001.wikimedia.org (**PASS**) - Downtimed host on Icinga/Ale... [18:56:32] 10netops, 06DC-Ops, 10fundraising-tech-ops, 06Infrastructure-Foundations, and 2 others: eqiad:frack network design, installation and configuration - https://phabricator.wikimedia.org/T377381 (10cmooney) 03NEW p:05Triage→03Medium [18:56:45] 10netops, 06DC-Ops, 10fundraising-tech-ops, 06Infrastructure-Foundations, and 2 others: eqiad:frack network design, installation and configuration - https://phabricator.wikimedia.org/T377381#10235421 (10cmooney) [18:56:46] 10netops, 06DC-Ops, 10fundraising-tech-ops, 06Infrastructure-Foundations, and 2 others: Q1:eqiad:frack network upgrade tracking task - https://phabricator.wikimedia.org/T371435#10235422 (10cmooney) [19:44:20] 10Mail, 06Infrastructure-Foundations, 06SRE: Remove Exim based MTAs - https://phabricator.wikimedia.org/T325409#10235508 (10ops-monitoring-bot) cookbooks.sre.hosts.decommission executed by jhathaway@cumin1002 for hosts: `mx1001.wikimedia.org` - mx1001.wikimedia.org (**PASS**) - Downtimed host on Icinga/Ale... [19:49:38] 10netops, 06DC-Ops, 10fundraising-tech-ops, 06Infrastructure-Foundations, and 2 others: Frack eqiad network upgrade: design, installation and configuration - https://phabricator.wikimedia.org/T377381#10235538 (10cmooney) [19:54:23] 10netops, 06DC-Ops, 10fundraising-tech-ops, 06Infrastructure-Foundations, and 2 others: Frack eqiad network upgrade: design, installation and configuration - https://phabricator.wikimedia.org/T377381#10235556 (10cmooney) @jclark-ctr I think existing stock was used for the 100G links between the switches in... [19:57:26] 10netops, 06DC-Ops, 10fundraising-tech-ops, 06Infrastructure-Foundations, and 2 others: Frack eqiad network upgrade: design, installation and configuration - https://phabricator.wikimedia.org/T377381#10235573 (10cmooney) [20:02:44] 10netops, 06DC-Ops, 10fundraising-tech-ops, 06Infrastructure-Foundations, and 2 others: Frack eqiad network upgrade: design, installation and configuration - https://phabricator.wikimedia.org/T377381#10235582 (10cmooney) [21:57:50] 10netops, 06DC-Ops, 10fundraising-tech-ops, 06Infrastructure-Foundations, and 2 others: Frack eqiad network upgrade: design, installation and configuration - https://phabricator.wikimedia.org/T377381#10236007 (10cmooney) We should also use SFP28 modules for the 'fabric-link' between the two pfw's if possib... [23:12:30] 10netops, 06DC-Ops, 10fundraising-tech-ops, 06Infrastructure-Foundations, and 2 others: Frack eqiad network upgrade: design, installation and configuration - https://phabricator.wikimedia.org/T377381#10236211 (10cmooney) @RobH so looking at the options after discussion I think we need to do an fs.com (or a...