[04:45:55] 10SRE-tools, 10Infrastructure-Foundations, 10SRE: Pairing tool for new SREs using sudo under supervision - https://phabricator.wikimedia.org/T299989 (10RLazarus) Thanks for checking it out! Even if sudo_pair were only available in bullseye at first, that would be a huge step forward, because we'd be able to... [16:02:17] 10netops, 10DC-Ops, 10Infrastructure-Foundations, 10SRE, 10ops-eqiad: Q2:(Need By: TBD) Rows E/F network racking task - https://phabricator.wikimedia.org/T292095 (10Cmjohnson) @cmooney I went through all the cabling and confirmed the correct patches. the connections at the demarc are pretty foolproof wit... [16:05:13] 10netops, 10DC-Ops, 10Infrastructure-Foundations, 10SRE, 10ops-eqiad: Q2:(Need By: TBD) Rows E/F network racking task - https://phabricator.wikimedia.org/T292095 (10Cmjohnson) @cmooney it appears to be disabled cmjohnson@re0.cr1-eqiad> show interfaces descriptions Interface Admin Link Description... [16:32:42] 10netops, 10DC-Ops, 10Infrastructure-Foundations, 10SRE, 10ops-eqiad: Q2:(Need By: TBD) Rows E/F network racking task - https://phabricator.wikimedia.org/T292095 (10cmooney) @Cmjohnson thanks. The interfaces on the CR are down by default. Not sure if you changed anything but there is no improvement rig... [16:44:22] 10netops, 10DC-Ops, 10Infrastructure-Foundations, 10SRE, 10ops-eqiad: Q2:(Need By: TBD) Rows E/F network racking task - https://phabricator.wikimedia.org/T292095 (10Cmjohnson) @cmooney, I have a light meter and I see light from lsw-f and lsw-e to the demarc, and then I see light to cr1 and cr2 from old c... [16:48:11] 10netops, 10DC-Ops, 10Infrastructure-Foundations, 10SRE, 10ops-eqiad: Q2:(Need By: TBD) Rows E/F network racking task - https://phabricator.wikimedia.org/T292095 (10cmooney) @Cmjohnson thanks ok. yeah it is odd. All the switch->switch links have come up ok (using the same CWDM4 optics), so it'd be unus... [17:47:14] godog: FYI jhathaway and I just sent https://gerrit.wikimedia.org/r/c/operations/alerts/+/757489 as a draft for T294564. There are some questions for you in there, and any feedback is welcome ;) [17:47:15] T294564: Migrate Foundations Prometheus alerts to AlertManager - https://phabricator.wikimedia.org/T294564 [18:09:54] 10netops, 10DC-Ops, 10Infrastructure-Foundations, 10SRE, 10ops-eqiad: Q2:(Need By: TBD) Rows E/F network racking task - https://phabricator.wikimedia.org/T292095 (10cmooney) @Cmjohnson reversed the fibers and we got the links up: ` cmooney@re0.cr1-eqiad> show interfaces diagnostics optics et-1/0/2 | mat...