[09:06:20] 10netops, 10DC-Ops, 10Infrastructure-Foundations, 10SRE: Collect and archive KML/KMZ fiber path files for new and existing network circuits - https://phabricator.wikimedia.org/T285136 (10ayounsi) Added Singtel and part of Telxius. Reached out to Zayo, Telia, Leaseweb, Relined, CyrusOne. @wiki_willy could... [09:28:18] 10Traffic, 10SRE, 10vm-requests: Please create two Ganeti VMs for Wikidough in eqsin - https://phabricator.wikimedia.org/T284246 (10Dzahn) @ssingh Should we keep this ticket open and make a new one "get a free IP in eqsin"? [09:38:29] 10Traffic, 10SRE, 10vm-requests: Please create two Ganeti VMs for Wikidough in eqsin - https://phabricator.wikimedia.org/T284246 (10ayounsi) @MoritzMuehlenhoff is it possible to decom bast5001 ? or at least move it to the private vlan? @ssingh otherwise you can use 103.102.166.5 so we don't block you [09:42:14] 10Traffic, 10SRE, 10vm-requests: Please create two Ganeti VMs for Wikidough in eqsin - https://phabricator.wikimedia.org/T284246 (10Dzahn) @ayounsi I don't know how we could use that IP for a VM. When running the cookbook to create a VM it simply fails to get a free IP and there is no option or expectation... [09:42:20] 10Traffic, 10SRE, 10vm-requests: Please create two Ganeti VMs for Wikidough in eqsin - https://phabricator.wikimedia.org/T284246 (10MoritzMuehlenhoff) I think we can simply decom bast5001 for now (it can still be reinstalled under a new name later), but let's hear if @BBlack has some objection. [09:45:34] 10Traffic, 10SRE, 10vm-requests: Please create two Ganeti VMs for Wikidough in eqsin - https://phabricator.wikimedia.org/T284246 (10ayounsi) >>! In T284246#7180178, @Dzahn wrote: > @ayounsi I don't know how we could use that IP for a VM. When running the cookbook to create a VM it simply fails to get a free... [09:49:10] 10Traffic, 10SRE, 10vm-requests: Please create two Ganeti VMs for Wikidough in eqsin - https://phabricator.wikimedia.org/T284246 (10Dzahn) Ah, gotcha! Yes, thank you for moving this forward. [10:24:50] 10Traffic, 10netops, 10Infrastructure-Foundations, 10SRE, 10User-jbond: varnish filtering: should we automatically update public_cloud_nets - https://phabricator.wikimedia.org/T270391 (10ayounsi) https://github.com/andrenth/drib seems like a took made exactly for that purpose. [11:32:12] 10Traffic, 10SRE, 10Security: Backport ATS 8.1.2 security fixes to our in-house ATS 8.0.8 - https://phabricator.wikimedia.org/T285535 (10ema) [11:32:20] 10Traffic, 10SRE, 10Security: Backport ATS 8.1.2 security fixes to our in-house ATS 8.0.8 - https://phabricator.wikimedia.org/T285535 (10ema) [15:51:57] (VarnishTrafficDrop) firing: 58% GET drop in text@ during the past 30 minutes - https://grafana.wikimedia.org/d/000000180/varnish-http-requests?viewPanel=6 - https://alerts.wikimedia.org [15:53:05] ^^ expected (see -operations) [15:56:56] (VarnishTrafficDrop) firing: (2) 22% GET drop in text@eqiad during the past 30 minutes - https://grafana.wikimedia.org/d/000000180/varnish-http-requests?viewPanel=6 - https://alerts.wikimedia.org [16:51:57] (VarnishTrafficDrop) resolved: (2) 67% GET drop in text@eqiad during the past 30 minutes - https://grafana.wikimedia.org/d/000000180/varnish-http-requests?viewPanel=6 - https://alerts.wikimedia.org [19:20:08] 10netops, 10DC-Ops, 10Infrastructure-Foundations, 10SRE: Collect and archive KML/KMZ fiber path files for new and existing network circuits - https://phabricator.wikimedia.org/T285136 (10wiki_willy) Hi @ayounsi - I reached out to Telxius for the kmz file. For Lumen, I think the new customer success manage... [21:57:43] 10netops, 10DC-Ops, 10Infrastructure-Foundations, 10SRE: Collect and archive KML/KMZ fiber path files for new and existing network circuits - https://phabricator.wikimedia.org/T285136 (10faidon) For Lumen we have a very long ongoing thread for our eqiad-esams relocation, so let's make sure we wrap this one...