[00:19:04] 10netops, 06Infrastructure-Foundations: Set MTU on mr1 interfaces - https://phabricator.wikimedia.org/T359320#10240572 (10Papaul) [00:19:25] 10netops, 06Infrastructure-Foundations: Set MTU on mr1 interfaces - https://phabricator.wikimedia.org/T359320#10240573 (10Papaul) 05Open→03Resolved This is complete [00:31:26] 10netops, 06DC-Ops, 10fundraising-tech-ops, 06Infrastructure-Foundations, and 2 others: codfw:frack:servers migration task - https://phabricator.wikimedia.org/T375151#10240602 (10Papaul) All the servers are now running on the new switches We did 2 fail over tests today each did last about 5 minutes and ha... [00:47:54] 10netops, 06DC-Ops, 10fundraising-tech-ops, 06Infrastructure-Foundations, and 2 others: codfw:frack pfw3 and old fasw decommission - https://phabricator.wikimedia.org/T377254#10240609 (10Papaul) [01:28:21] 10netops, 06Infrastructure-Foundations, 06Traffic: Prepare/deploy new IPs for codfw cp nodes - https://phabricator.wikimedia.org/T377534 (10BCornwall) 03NEW [01:29:07] 10netops, 06Infrastructure-Foundations, 06Traffic: Prepare/deploy new IPs for codfw cp nodes - https://phabricator.wikimedia.org/T377534#10240649 (10BCornwall) p:05Triage→03Low [06:41:42] 10netops, 06DC-Ops, 10fundraising-tech-ops, 06Infrastructure-Foundations, and 2 others: Frack eqiad network upgrade: design, installation and configuration - https://phabricator.wikimedia.org/T377381#10240798 (10ayounsi) Nicely written plan !! > Fmsw connects directly to firewalls We need to do the same i... [06:47:28] 10netops, 06Infrastructure-Foundations, 06Traffic: Prepare/deploy new IPs for codfw cp nodes - https://phabricator.wikimedia.org/T377534#10240807 (10ayounsi) > We can work through those nodes as reimages (slowly), but it would be nice(r) if we could know all the new IPs up front and add them all to that set... [07:00:43] 10netops, 06Infrastructure-Foundations, 06Traffic: Prepare/deploy new IPs for codfw cp nodes - https://phabricator.wikimedia.org/T377534#10240809 (10Volans) This seems a perfect opportunity to re-evaluate why we're hardcoding those values in Puppet's hiera and evaluate if that can be avoided. Some possible o... [10:55:13] 10CAS-SSO, 06Data-Engineering, 10Data-Engineering-Jupyter, 07Epic: Improve the JupyterHub services and use CAS/SSO - https://phabricator.wikimedia.org/T260386#10241444 (10BTullis) [10:55:51] 10CAS-SSO, 06Data-Engineering, 10Data-Engineering-Jupyter, 06Data-Platform-SRE, 07Epic: Improve the JupyterHub services and use CAS/SSO - https://phabricator.wikimedia.org/T260386#10241446 (10BTullis) [13:34:32] 10netops, 06DC-Ops, 10fundraising-tech-ops, 06Infrastructure-Foundations, and 2 others: codfw:frack pfw3 and old fasw decommission - https://phabricator.wikimedia.org/T377254#10241928 (10Papaul) [13:34:53] 10netops, 06DC-Ops, 10fundraising-tech-ops, 06Infrastructure-Foundations, and 2 others: codfw:frack pfw3 and old fasw decommission - https://phabricator.wikimedia.org/T377254#10241929 (10Papaul) 05Open→03Resolved This is complete [13:55:18] 10netops, 06DC-Ops, 10fundraising-tech-ops, 06Infrastructure-Foundations, and 2 others: Frack eqiad network upgrade: design, installation and configuration - https://phabricator.wikimedia.org/T377381#10242011 (10cmooney) >>! In T377381#10240797, @ayounsi wrote: >> Fmsw connects directly to firewalls > We n... [13:59:43] 10netops, 06DC-Ops, 10fundraising-tech-ops, 06Infrastructure-Foundations, and 2 others: Frack eqiad network upgrade: design, installation and configuration - https://phabricator.wikimedia.org/T377381#10242019 (10cmooney) [14:09:17] 10netops, 06DC-Ops, 10fundraising-tech-ops, 06Infrastructure-Foundations, and 2 others: Frack eqiad network upgrade: design, installation and configuration - https://phabricator.wikimedia.org/T377381#10242050 (10Papaul) >>! In T377381#10242011, @cmooney wrote: >>>! In T377381#10240797, @ayounsi wrote: >>>... [16:15:38] 10netops, 06DC-Ops, 10fundraising-tech-ops, 06Infrastructure-Foundations, and 2 others: Frack eqiad network upgrade: design, installation and configuration - https://phabricator.wikimedia.org/T377381#10242702 (10cmooney) >>! In T377381#10242050, @Papaul wrote: > TIP: first i count the number of servers wit... [16:45:31] 10netops, 06DC-Ops, 10fundraising-tech-ops, 06Infrastructure-Foundations, and 2 others: Frack eqiad network upgrade: design, installation and configuration - https://phabricator.wikimedia.org/T377381#10242797 (10cmooney) I spoke to @Jgreen earlier about the setup and I think the above plan should be workab... [16:47:45] 10netops, 06DC-Ops, 10fundraising-tech-ops, 06Infrastructure-Foundations, and 2 others: Frack eqiad network upgrade: design, installation and configuration - https://phabricator.wikimedia.org/T377381#10242802 (10cmooney)