[06:22:11] 10SRE-tools, 10Infrastructure-Foundations, 10Wikimedia-Mailing-lists, 10serviceops: Support services VIPs with not marked as VIP in Netbox - https://phabricator.wikimedia.org/T295793 (10ayounsi) [06:25:10] 10netops, 10Infrastructure-Foundations, 10SRE, 10ops-eqiad: eqiad: Move links to new MPC7E linecard - https://phabricator.wikimedia.org/T304712 (10ayounsi) [06:36:32] 10SRE-tools, 10Cloud-Services, 10Infrastructure-Foundations, 10SRE: WMCS VIPs: Netbox netmask inconsistencies - https://phabricator.wikimedia.org/T295774 (10ayounsi) [07:23:39] 10SRE-tools, 10Infrastructure-Foundations, 10Wikimedia-Mailing-lists, 10serviceops: Support services VIPs with not marked as VIP in Netbox - https://phabricator.wikimedia.org/T295793 (10Jelto) `gitlab1001` and `gitlab2001` will be decommissioned soon in T307142. So regarding GitLab this should be resolved... [07:56:35] 10netbox, 10Infrastructure-Foundations, 10IPv6, 10User-jbond: Some clusters do not have DNS for IPv6 addresses (TRACKING TASK) - https://phabricator.wikimedia.org/T253173 (10Volans) [07:56:53] 10SRE-tools, 10Infrastructure-Foundations, 10SRE, 10IPv6, 10User-jbond: Some Foundation clusters do not appear to support IPv6 - https://phabricator.wikimedia.org/T271136 (10Volans) 05Resolved→03Open As part of a recent refactor of the [[ https://netbox.wikimedia.org/extras/reports/network.Network/ |... [08:18:25] moritzm, XioNoX: so I've tested the rename of the ganeti group for the test cluster from 'row_A-test' to 'A-test'. For how the sync script is done it actually requires a manual rename on netbox ( https://netbox.wikimedia.org/extras/changelog/90657/ ) before the timer fires again to be a full noop. Unless you have any concerns I'll rename all the remaining groups to remove the 'row_' [08:18:31] prefix everywhere. [08:18:59] [for context, if the rename in netbox is not done the script works fine, just deletes the VMs from the "old" group and creates new ones, that is sub-optimal] [08:19:49] sounds good to me! [08:20:38] I want to kick off the update to Ganeti 3.0 for the codfw cluster later the day, best to get your rename deployed before that happens (so they don't overlap), so please ping when once codfw is done [08:21:53] moritzm: ack, I can do all of them now~ish [08:25:46] 10netops, 10Infrastructure-Foundations, 10SRE, 10Patch-For-Review: Finalise design extension of WMCS networks to new cloudsw in Eqiad rows E/F - https://phabricator.wikimedia.org/T304989 (10cmooney) @nskaggs I updated the instructions on the wikitech page [[https://wikitech.wikimedia.org/wiki/Network_desig... [08:30:22] volans: sgtm! [08:31:07] thx [08:53:54] moritzm: all done, clusters now have lost their 'row_' prefix in https://netbox.wikimedia.org/virtualization/clusters/ [08:54:19] with low-prio I'll look to have the cookbooks allow to skip the group name if there is only one in that cluster [08:55:11] ack, thanks! [08:56:35] 10SRE-tools, 10netops, 10Infrastructure-Foundations, 10SRE, 10Spicerack: Spicerack: add network devices support - https://phabricator.wikimedia.org/T306552 (10ayounsi) Step 1 is done, `sre.network.configure-switch-interfaces` cookbook is ready for prime time. [08:57:09] much better, thanks! [09:04:04] 10netops, 10Infrastructure-Foundations, 10SRE, 10Patch-For-Review, 10Sustainability (Incident Followup): Use next-hop-self for iBGP sessions - https://phabricator.wikimedia.org/T295672 (10cmooney) 05In progress→03Resolved Closing this task. Setup in general needs to be considered under T297355 [09:05:15] 10Puppet, 10Infrastructure-Foundations, 10SRE, 10observability, and 2 others: Puppet: get data (row, rack, site, and other information) from Netbox - https://phabricator.wikimedia.org/T229397 (10Volans) [09:05:17] 10netbox, 10Infrastructure-Foundations, 10Patch-For-Review: Import row information into Netbox for Ganeti instances - https://phabricator.wikimedia.org/T262446 (10Volans) 05In progress→03Resolved a:03Volans We've solved the issue using the Cluster Groups in Netbox for Ganeti Clusters, the Clusters in N... [09:19:35] 10SRE-tools, 10Infrastructure-Foundations, 10SRE, 10IPv6, 10User-jbond: Some Foundation clusters do not appear to support IPv6 - https://phabricator.wikimedia.org/T271136 (10Volans) a:05elukey→03MoritzMuehlenhoff [09:36:00] ahh seems like its making another set of rounds :(. As to groceries, unfortunatly we dont know a lot of people, one of the benefits of the way we live mean that we re quite well stocked and we do know a few people that live near by if we run out :) [09:36:04] ahh seems like its making another set of rounds :(. As to groceries, unfortunatly we dont know a lot of people, one of the benefits of the way we live mean that we re quite well stocked and we do know a few people that live near by if we run out :) [09:36:40] opps wrong channle :/ [10:55:04] 10SRE-tools, 10Infrastructure-Foundations, 10Wikimedia-Mailing-lists, 10serviceops: Support services VIPs with not marked as VIP in Netbox - https://phabricator.wikimedia.org/T295793 (10Ladsgroup) Regarding mailman, yes, Kunal and I didn't touch those settings [1] (I couldn't as I didn't have access to net... [13:20:33] 10SRE-tools, 10Infrastructure-Foundations, 10Wikimedia-Mailing-lists, 10serviceops: Support services VIPs with not marked as VIP in Netbox - https://phabricator.wikimedia.org/T295793 (10akosiaris) Didn't need a reboot after all. I fixed /etc/network/interfaces configuration and issued a `systemctl restart... [14:30:07] hey all, happy to be back from vacation! Please let me know if there is anyting I need to attend to, I'm on clinic duty this week with denisse [14:31:26] welcome back! [14:32:58] thanks! [15:17:47] 10netops, 10Infrastructure-Foundations, 10SRE, 10Patch-For-Review: Configure cloudsw1-e4-eqiad and cloudsw1-f4-eqiad - https://phabricator.wikimedia.org/T304936 (10cmooney)