[09:23:32] 10SRE-tools, 10Infrastructure-Foundations, 10Patch-For-Review: Prevent re-using network ports when provisioning hosts in Netbox - https://phabricator.wikimedia.org/T272068 (10ayounsi) a:03ayounsi [09:33:43] 10netbox, 10Infrastructure-Foundations, 10SRE: Evaluate Nautobot fork of Netbox and decide whether to use. - https://phabricator.wikimedia.org/T288515 (10cmooney) 05Open→03Resolved a:03cmooney Should have updated this previously, the discussion and decision-making moved to live meetings / irc, but I ne... [09:35:37] 10netbox, 10Infrastructure-Foundations: Make more extensive use of Netbox custom fields - https://phabricator.wikimedia.org/T305126 (10cmooney) > One other thing we might want here is a var for IPv6 RAs After some analysis we concluded the existing logic for identifying which interfaces need to send RAs in ou... [09:46:08] 10netbox, 10Infrastructure-Foundations: Netbox: Add rack/U and asset tag fields to AssignIP script - https://phabricator.wikimedia.org/T267219 (10ayounsi) @wiki_willy what do you think of the suggestion in the task description? [10:04:30] 10netbox, 10Infrastructure-Foundations: Netbox: define strategy to track standard server configurations - https://phabricator.wikimedia.org/T284614 (10ayounsi) I think we're close to being able to mark this as resolved. @wiki_willy Should we have any kind of reports to prevent entry mistakes? What would be th... [14:20:39] 10SRE-tools, 10netbox, 10Infrastructure-Foundations, 10Patch-For-Review: Move device attributes - https://phabricator.wikimedia.org/T259166 (10ayounsi) a:03ayounsi [14:32:25] 10netbox, 10Infrastructure-Foundations: Improve Netbox PuppetDB import script to set switch trunk port Vlans as needed - https://phabricator.wikimedia.org/T297784 (10ayounsi) In the current state of our infra I don't think that part should be dynamic. Switch ports are configured by DCops (or service owners wh... [15:05:03] 10netops, 10Infrastructure-Foundations, 10SRE: Represent sub-interface and bridge device assocations in Netbox - https://phabricator.wikimedia.org/T296832 (10ayounsi) [15:05:07] 10netbox, 10Infrastructure-Foundations: Upgrade Netbox to 3.2 - https://phabricator.wikimedia.org/T296452 (10ayounsi) [18:18:50] 10netbox, 10Infrastructure-Foundations: Netbox: Add rack/U and asset tag fields to AssignIP script - https://phabricator.wikimedia.org/T267219 (10wiki_willy) Adding @Papaul, @Jclark-ctr, @RobH, and @Cmjohnson - do you guys have any preferences or strong opinions on this proposal? Thanks, Willy [18:35:31] 10netbox, 10Infrastructure-Foundations: Netbox: define strategy to track standard server configurations - https://phabricator.wikimedia.org/T284614 (10wiki_willy) Thanks for checking @ayounsi. Just to confirm, will the previous Netbox alert error that Riccardo had fixed, continue checking for any configuratio... [20:27:39] 10Puppet, 10Infrastructure-Foundations, 10SRE, 10Patch-For-Review, 10User-jbond: replace all puppet crons with systemd timers - https://phabricator.wikimedia.org/T273673 (10dpifke) systemd in bullseye (and up?) appears to object if `User=nobody`, see: https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=969... [20:29:54] 10netops, 10Infrastructure-Foundations, 10ops-eqiad: 2M 25G DAC testing - https://phabricator.wikimedia.org/T306220 (10RobH) p:05Triage→03Medium [20:30:07] 10netops, 10Infrastructure-Foundations, 10ops-eqiad: 2M 25G DAC testing - https://phabricator.wikimedia.org/T306220 (10RobH) [20:31:07] 10netops, 10Infrastructure-Foundations, 10ops-eqiad: 2M 25G DAC testing - https://phabricator.wikimedia.org/T306220 (10RobH) [20:32:08] 10netops, 10Infrastructure-Foundations, 10ops-eqiad: 2M 25G DAC testing - https://phabricator.wikimedia.org/T306220 (10RobH) This was detailed on the procurement task, and I've migrated the testing to this onsite related task. [20:47:41] 10Puppet, 10Infrastructure-Foundations, 10SRE: Validate all yaml files in puppet.git - https://phabricator.wikimedia.org/T305676 (10jhathaway) I think having a syntax validity check would be a great first start. I think using yamllint, a ruby script or a short python script would work well: ` $ yamllint -d... [20:51:14] 10netops, 10Infrastructure-Foundations, 10SRE: Cannot verify NTP status asw1-b12-drmrs - https://phabricator.wikimedia.org/T305840 (10cmooney) I've opened a case with Juniper, let's see what they say. [21:02:38] 10SRE-tools, 10Infrastructure-Foundations, 10SRE, 10tox-wikimedia, and 2 others: Introduce Python code formatters usage - https://phabricator.wikimedia.org/T211750 (10jhathaway) >>! In T211750#7853874, @Volans wrote: > Although there are no doubt that an automatic formatter is of great help, there are also... [21:08:26] 10netops, 10Infrastructure-Foundations, 10SRE, 10Patch-For-Review: Agree how to handle port-block speeds for QFX5120-48Y - https://phabricator.wikimedia.org/T303529 (10cmooney) So I've been able to check the options here on the QFX5120 platform. It is **not** possible to mix 10G and 25G SFP modules in the... [21:10:26] 10netops, 10Infrastructure-Foundations, 10ops-eqiad: 2M 25G DAC testing - https://phabricator.wikimedia.org/T306220 (10cmooney) 05Open→03Resolved Thanks for the help on this one @Jclark-ctr. All done with the testing you can remove those cables and leave them with our others. thanks! [21:20:38] 10netops, 10Infrastructure-Foundations, 10SRE, 10ops-eqiad: Test port-block constraints on QFX5120 devices - https://phabricator.wikimedia.org/T304934 (10wiki_willy) a:03Jclark-ctr [21:27:19] 10netbox, 10netops, 10DC-Ops, 10Infrastructure-Foundations: Avoid ghost hosts on the network - https://phabricator.wikimedia.org/T306007 (10wiki_willy) Hi @ayounsi - can you provide a few recent examples of when this has triggered alerts? We're trying to align and find some patterns, to tweak things proce... [21:29:06] 10netops, 10Infrastructure-Foundations, 10SRE, 10Patch-For-Review: Agree how to handle port-block speeds for QFX5120-48Y - https://phabricator.wikimedia.org/T303529 (10cmooney) Actually I should clarify, it *may* be possible to use the channel-speed syntax to configure the switch in blocks of 2, it allows... [21:38:21] 10netops, 10Infrastructure-Foundations, 10SRE, 10ops-eqiad: Test port-block constraints on QFX5120 devices - https://phabricator.wikimedia.org/T304934 (10cmooney) 05Open→03Resolved Closing ticket, duplicate. Results detailed in https://phabricator.wikimedia.org/T303529#7856797 [21:38:29] 10netops, 10Infrastructure-Foundations, 10SRE, 10Patch-For-Review: Agree how to handle port-block speeds for QFX5120-48Y - https://phabricator.wikimedia.org/T303529 (10cmooney) [21:39:08] 10netops, 10Infrastructure-Foundations, 10SRE, 10ops-eqiad: 2M 25G DAC testing - https://phabricator.wikimedia.org/T306220 (10cmooney) 05Resolved→03Open Actually I spoke too soon, there is one other combination I want to check. @Jclark-ctr could you move the 10G cable in port xe-0/0/1 to port xe-0/0/2... [22:40:25] 10SRE-tools, 10Infrastructure-Foundations, 10SRE, 10tox-wikimedia, and 2 others: Introduce Python code formatters usage - https://phabricator.wikimedia.org/T211750 (10Volans) >>! In T211750#7856763, @jhathaway wrote: > Thanks for the detailed write up of all the issues. It would be great at some point to c...