[05:34:00] <wikibugs>	 10netops, 10DC-Ops, 10SRE, 10SRE-tools, 10Patch-For-Review: Allow idrac tftp fetching of firmware updates (either to existing tftp or new solution) - https://phabricator.wikimedia.org/T283771 (10Papaul) With the same lab environment, the same command will upgrade the BIOS just by changing the file. ` sud...
[07:36:05] <wikibugs>	 10Traffic, 10DNS, 10SRE, 10Wikimedia-GitHub, 10Release-Engineering-Team (Kanban): Github: add verified domain - https://phabricator.wikimedia.org/T207364 (10hashar) That last change ( https://gerrit.wikimedia.org/r/661180 ) was required since we changed the GitHub organization page from https://www.wikim...
[08:42:48] <wikibugs>	 10netops, 10DC-Ops, 10SRE, 10SRE-tools, 10Patch-For-Review: Allow idrac tftp fetching of firmware updates (either to existing tftp or new solution) - https://phabricator.wikimedia.org/T283771 (10jbond) >  could be run from cumin servers which already have access to the mgmt network so that seems a good o...
[09:22:27] <wikibugs>	 10netops, 10Continuous-Integration-Infrastructure, 10DC-Ops, 10serviceops: Flapping codfw management alarm ( contint2001.mgmt/SSH is CRITICAL ) - https://phabricator.wikimedia.org/T283582 (10hashar) Looking at the alarm history since midnight UTC at https://icinga.wikimedia.org/cgi-bin/icinga/history.cgi?h...
[11:36:10] <wikibugs>	 10Traffic, 10netops, 10SRE: BGP Policy on aggregate routes prevents them being created in some circumstances. - https://phabricator.wikimedia.org/T283163 (10cmooney) This configuration has been rolled out now across all CR routers.  All looks ok, some slight increase in traffic in via eqord, and slight decre...
[12:55:20] <wikibugs>	 10netops, 10SRE, 10Patch-For-Review, 10Sustainability (Incident Followup): ospf link-protection - https://phabricator.wikimedia.org/T167306 (10ayounsi) Deployed to cr3 and cr4-ulsfo. Some interesting (and expected) finding:  No brainer, backup from cr3-ulsfo to mr1-ulsfo is cr4-ulsfo `name=mr1-ulsfo cr3-ul...
[13:08:04] <wikibugs>	 10netops, 10DC-Ops, 10SRE, 10SRE-tools, 10Patch-For-Review: Allow idrac tftp fetching of firmware updates (either to existing tftp or new solution) - https://phabricator.wikimedia.org/T283771 (10Papaul) @jbond Yes uploading to IDRAC interfaces is very slow.