[06:52:51] 10netops, 10Infrastructure-Foundations: Lumen link between cr2-eqiad and cr2-esams down - July 2022 - https://phabricator.wikimedia.org/T313783 (10ayounsi) [06:57:37] 10netops, 10Infrastructure-Foundations: Lumen link between cr2-eqiad and cr2-esams down - July 2022 - https://phabricator.wikimedia.org/T313783 (10ayounsi) From Lumen diagonstic tool: > SERVICE ALARMS - NEEDS ATTENTION - We have detected equipment alarms. Further Investigation is required. Opened Repair Ticke... [08:12:17] 10Traffic, 10Performance-Team, 10SRE, 10SRE-swift-storage, 10Patch-For-Review: Automatically clean up unused thumbnails in Swift - https://phabricator.wikimedia.org/T211661 (10fgiunchedi) >>! In T211661#8102237, @ori wrote: > I see! Do we need to employ any of these strategies, then? What (if anything) s... [08:43:32] 10netops, 10Infrastructure-Foundations, 10SRE, 10cloud-services-team (Kanban): asw2-c5-eqiad crash - https://phabricator.wikimedia.org/T313382 (10Marostegui) [08:45:31] 10netops, 10Infrastructure-Foundations, 10SRE, 10cloud-services-team (Kanban): asw2-c5-eqiad crash - https://phabricator.wikimedia.org/T313382 (10Marostegui) pc1013 is no longer a master in pc3. All the tasks owned by #dba team have been completed. Though, we'd appreciate a heads up before the maintenace t... [13:48:15] 10netops, 10Infrastructure-Foundations: Add descriptions to BGP peers - https://phabricator.wikimedia.org/T313805 (10ayounsi) p:05Triage→03Low [14:53:27] 10Traffic, 10SRE, 10Patch-For-Review: Package and deploy ATS 9.1.2 - https://phabricator.wikimedia.org/T309651 (10ssingh) [15:08:06] <_joe_> hi, I'm about to deploy a change to the low-traffic LVSes [15:08:12] <_joe_> any reason not to? [15:14:14] <_joe_> ok, I'll proceed then [15:52:20] bblack: https://gerrit.wikimedia.org/r/c/operations/puppet/+/816206 should be good to go if you're in a varnishy mood :) [15:53:59] bblack is OoO till Thursday IIRC [15:55:08] wow.. T138093 is from 2016 [15:55:09] T138093: Investigate query parameter normalization for MW/services - https://phabricator.wikimedia.org/T138093 [15:55:20] * vgutierrez needs a DeLorean [16:13:45] 10Domains, 10SRE: domain name Wikkipedia.be - https://phabricator.wikimedia.org/T313823 (10Walter) [17:22:54] 10Traffic, 10SRE: Test ESI feasibility with current Varnish installation - https://phabricator.wikimedia.org/T308799 (10AndyRussG) Wooohoooo, many congrats on this merge @BBlack and @Vgutierrez!!!!! Also many thanks for the explanation and many apologies for the long delay in replying @Vgutierrez!! Just addin... [17:43:49] 10netops, 10Infrastructure-Foundations, 10SRE: Lumen link between cr2-eqiad and cr2-esams down - July 2022 - https://phabricator.wikimedia.org/T313783 (10ayounsi) Circuit back up as of 2022-07-26 12:18:32 UTC (05:19:01 ago). Lumen got back to me saying it's working as expected for them. I asked for an RFO a... [18:20:01] 10netops, 10Infrastructure-Foundations, 10SRE: Lumen link between cr2-eqiad and cr2-esams down - July 2022 - https://phabricator.wikimedia.org/T313783 (10Volans) p:05Triage→03Medium [19:40:41] vgutierrez: ack, you can also review/merge if you insist ;) [19:41:26] I'll take a look tomorrow EU morning [19:42:56] cool, thanks