[00:17:30] 10netops, 10Infrastructure-Foundations, 10SRE, 10ops-eqiad: Link from lsw1-e1-eqiad to lsw1-f2-eqiad down - https://phabricator.wikimedia.org/T315052 (10cmooney) p:05Triage→03High [00:21:36] 10netops, 10Infrastructure-Foundations, 10SRE: Enable OSPF Icinga check for EVPN based switches - https://phabricator.wikimedia.org/T315053 (10cmooney) p:05Triage→03Medium [01:35:44] 10netops, 10Infrastructure-Foundations, 10SRE, 10Discovery-Search (Current work): Possible problem communicating between eqiad elastic hosts in racks F2 and F3 - https://phabricator.wikimedia.org/T315038 (10cmooney) a:03cmooney Thanks @ayounsi > One surprising point though is that the path through the... [01:35:56] 10netops, 10Infrastructure-Foundations, 10SRE, 10Discovery-Search (Current work): Overlay VRF / VXLAN traffic failure between lsw1-f2-eqiad and lsw1-f3-eqiad - https://phabricator.wikimedia.org/T315038 (10cmooney) [02:36:49] 10netops, 10Infrastructure-Foundations, 10SRE, 10Discovery-Search (Current work): Overlay VRF / VXLAN traffic failure between lsw1-f2-eqiad and lsw1-f3-eqiad - https://phabricator.wikimedia.org/T315038 (10cmooney) I ended up issuing this command: ` request app-engine service restart packet-forwarding-engin... [05:59:58] 10netops, 10Infrastructure-Foundations, 10SRE, 10Discovery-Search (Current work): Overlay VRF / VXLAN traffic failure between lsw1-f2-eqiad and lsw1-f3-eqiad - https://phabricator.wikimedia.org/T315038 (10RKemper) (Following is just related to bringing these hosts back into service) Pooled the hosts: ` r... [10:09:42] 10netbox, 10netops, 10Infrastructure-Foundations, 10SRE, 10Patch-For-Review: Represent sub-interface and bridge device assocations in Netbox - https://phabricator.wikimedia.org/T296832 (10cmooney) > Netbox drives the infrastructure, and not the other way around. Fully agree that's best. But unfortunate... [10:12:27] 10netops, 10Infrastructure-Foundations, 10SRE: Enable OSPF Icinga check for EVPN based switches - https://phabricator.wikimedia.org/T315053 (10cmooney) Having thought about it in more detail I think it's best to keep the multihop for the iBGP EVPN sessions. Reason being that even if a Leaf loses a Spine lin... [10:13:26] 10netops, 10Infrastructure-Foundations, 10SRE: Enable OSPF Icinga check for EVPN based switches - https://phabricator.wikimedia.org/T315053 (10cmooney) @ayounsi be interested if you've any thoughts on that. [12:18:01] 10netops, 10Infrastructure-Foundations, 10SRE: Enable OSPF Icinga check for EVPN based switches - https://phabricator.wikimedia.org/T315053 (10ayounsi) yeah I agree +1 on having a stable iBGP capable of handling link failure. The OSPF adjacency check should be used but IIRC it assumes there are as many v4 s... [12:30:23] 10netbox, 10netops, 10Infrastructure-Foundations, 10SRE, 10Patch-For-Review: Represent sub-interface and bridge device assocations in Netbox - https://phabricator.wikimedia.org/T296832 (10ayounsi) > Would a cookbook be an idea possibly? That we could run ourselves to update a specific network port to mat... [13:15:59] topranks, jbond: I boldly added https://wikitech.wikimedia.org/wiki/Netbox#Netbox_(and_source_of_truth)_principles curious to know what you think! [13:21:07] XioNoX: look good to me [13:32:55] The first point is a bit sneaky for cases where we have multiple sources of truths (eg. Netbox + Puppet) [13:39:57] jbond: looks good! [13:41:07] On the first point I’d say the purpose of importing to Netbox is to document what’s out there, in cases where netbox isn’t driving the config of elements it models [13:41:15] Or “isn’t yet” [14:11:09] XioNoX: im not sure the first point is really in conflict. puppet+hiera like netbox describes the "desired" state, the data that gets synced to puppetdb (mostly from facter in the netbox case) is the "realaized" state [15:36:39] 10Puppet, 10Infrastructure-Foundations, 10SRE, 10Wikimedia-Mailing-lists: Unable to clone "operations/puppet" repo successfully on Windows (mailman3 template names use colon in file names) - https://phabricator.wikimedia.org/T314698 (10jhathaway) As background we don't use the upstream templates because th... [16:04:51] 10netops, 10Infrastructure-Foundations, 10SRE, 10Traffic, 10Patch-For-Review: drmrs: initial geodns configuration - https://phabricator.wikimedia.org/T304089 (10BCornwall)