[07:14:09] <wikibugs>	 10netops, 10Infrastructure-Foundations, 10SRE, 10ops-eqiad: [eqiad] faulty VC optics - https://phabricator.wikimedia.org/T325803 (10ayounsi) Unfortunately that didn't solve it for all switches:  asw2-c-eqiad is all good, but A and B are still showing errors.  asw2-a-eqiad: fpc1:port: 1/1 - CRC alignment er...
[11:18:20] <wikibugs>	 10netops, 10Infrastructure-Foundations, 10SRE, 10SRE-OnFire, 10Sustainability (Incident Followup): Upgrade POPs asw to Junos 21 - https://phabricator.wikimedia.org/T316532 (10ayounsi) I didn't proceed with the upgrade as there was errors. I opened a JTAC case 2023-0109-616616 with:  > Hi, > I'm trying to...
[11:51:47] <wikibugs>	 10netops, 10Infrastructure-Foundations, 10SRE, 10SRE-OnFire, 10Sustainability (Incident Followup): Upgrade POPs asw to Junos 21 - https://phabricator.wikimedia.org/T316532 (10ayounsi) JTAC replied with (I cherry picked the useful info): > As JTAC we would suggest that you perform a step upgrade in your c...
[14:33:05] <wikibugs>	 10Puppet, 10Infrastructure-Foundations, 10SRE: Knock down puppet 4 deprecation warnings - https://phabricator.wikimedia.org/T193664 (10hashar) 05Open→03Resolved This has most probably been entirely fixed. [[ https://gerrit.wikimedia.org/r/c/operations/puppet/+/333012 | Gerrit 333012 - test: puppet-syntax...
[14:59:50] <wikibugs>	 10netops, 10Infrastructure-Foundations, 10ops-codfw: codfw: Relocate servers racked in U27 in all racks in rowA and rowB - https://phabricator.wikimedia.org/T326564 (10Papaul)
[16:19:24] <wikibugs>	 10netops, 10Infrastructure-Foundations, 10SRE, 10ops-eqiad: [eqiad] faulty VC optics - https://phabricator.wikimedia.org/T325803 (10ayounsi) Replaced and counters cleared. Let's check in a couple days.
[16:22:32] <wikibugs>	 10netops, 10Infrastructure-Foundations, 10SRE, 10SRE-OnFire, 10Sustainability (Incident Followup): Upgrade POPs asw to Junos 21 - https://phabricator.wikimedia.org/T316532 (10ayounsi)
[19:54:46] <wikibugs>	 10netops, 10Data-Services, 10Infrastructure-Foundations, 10Wikidata, and 5 others: Do not rate limit dumps from internal network - https://phabricator.wikimedia.org/T222349 (10Hokwelum) >>! In T222349#8485437, @bking wrote: > Per above patches and discussion with @akosiaris , we are going to try using the...