[08:33:06] 10Mail, 10Data-Engineering-Operations, 10Data-Engineering-Planning, 10SRE, 10Patch-For-Review: Change the analytics-alerts email alias to a mailman distribution list - https://phabricator.wikimedia.org/T315486 (10BTullis) So far, all of the inbound messages to this mailing list have been held for moderat... [09:16:13] 10netbox, 10Infrastructure-Foundations, 10Patch-For-Review: Reduce the count of Netbox devices with incorrect status - https://phabricator.wikimedia.org/T320696 (10ayounsi) From the feedback here and in the email thread there the trend is to go with the simplest option and not track the service status, only... [09:30:36] 10Mail, 10Data-Engineering-Operations, 10Data-Engineering-Planning, 10SRE, 10Patch-For-Review: Change the analytics-alerts email alias to a mailman distribution list - https://phabricator.wikimedia.org/T315486 (10BTullis) @Dzahn - would it be acceptable for us to use the exim aliases file to forward the... [10:01:28] 10netops, 10Infrastructure-Foundations, 10Traffic: lvs500[1-3] are unable to establish BGP sessions with cr3-eqsin.wikimedia.org - https://phabricator.wikimedia.org/T321545 (10Vgutierrez) [10:01:57] 10netops, 10Infrastructure-Foundations, 10Traffic: lvs500[1-3] are unable to establish BGP sessions with cr3-eqsin.wikimedia.org - https://phabricator.wikimedia.org/T321545 (10Vgutierrez) p:05Triage→03Medium [10:08:52] 10netops, 10Infrastructure-Foundations, 10Traffic: lvs500[1-3] are unable to establish BGP sessions with cr3-eqsin.wikimedia.org - https://phabricator.wikimedia.org/T321545 (10Volans) [10:18:11] 10netops, 10Infrastructure-Foundations, 10Traffic: lvs500[1-3] are unable to establish BGP sessions with cr3-eqsin.wikimedia.org - https://phabricator.wikimedia.org/T321545 (10cmooney) 05Open→03Resolved a:03cmooney Ugh. So this is rather embarrassing but it seems the PyBal group was manually de-activa... [11:16:39] 10Mail, 10Data-Engineering-Operations, 10Data-Engineering-Planning, 10SRE, 10Patch-For-Review: Change the analytics-alerts email alias to a mailman distribution list - https://phabricator.wikimedia.org/T315486 (10Ladsgroup) What you did for accepting non-members looks good to me. I haven't seen any held... [14:05:22] 10netops, 10Infrastructure-Foundations, 10SRE, 10Sustainability (Incident Followup): Cr1-eqiad comms problem when moving to 40G row D handoff - https://phabricator.wikimedia.org/T320566 (10ayounsi) As data point I tried: `asw2-d-eqiad# run request virtual-chassis vc-port set pic-slot 0 member 2 port 49` th... [14:35:13] 10netops, 10Infrastructure-Foundations, 10SRE, 10Sustainability (Incident Followup): Cr1-eqiad comms problem when moving to 40G row D handoff - https://phabricator.wikimedia.org/T320566 (10cmooney) Thanks @ayounsi, was worth a shot :) I'm thinking we probably proceed as follows: 1. Perform master switch... [14:37:19] 10netops, 10Infrastructure-Foundations, 10SRE, 10Sustainability (Incident Followup): Cr1-eqiad comms problem when moving to 40G row D handoff - https://phabricator.wikimedia.org/T320566 (10cmooney) Just a note that I should have added previously that Juniper wouldn't provide support due to JunOS 14.1 being... [15:48:38] 10netops, 10Infrastructure-Foundations, 10SRE, 10Sustainability (Incident Followup): Cr1-eqiad comms problem when moving to 40G row D handoff - https://phabricator.wikimedia.org/T320566 (10ayounsi) I don't remember the impact of a switchover (eg. if it's none or tiny). So to be done carefully. At least the... [17:02:07] 10netops, 10Infrastructure-Foundations, 10SRE, 10ops-eqiad: eqiad: Move links to new MPC7E linecard - https://phabricator.wikimedia.org/T304712 (10Papaul) sub-ports are ready for cr2-eqiad ` papaul@re0.cr2-eqiad# run show interfaces terse | match xe-1/0/* xe-1/0/1:0 down down xe-1/0/1:1... [23:57:23] 10Mail, 10Data-Engineering-Operations, 10Data-Engineering-Planning, 10SRE, 10Patch-For-Review: Change the analytics-alerts email alias to a mailman distribution list - https://phabricator.wikimedia.org/T315486 (10Dzahn) @BTullis Yea, that is accetable. It's still progress over managing the group members...