[00:16:05] 10netops, 10Infrastructure-Foundations, 10SRE, 10Patch-For-Review, 10Sustainability (Incident Followup): Use next-hop-self for iBGP sessions - https://phabricator.wikimedia.org/T295672 (10Krinkle) [00:17:03] 10netops, 10Infrastructure-Foundations, 10SRE, 10Sustainability (Incident Followup): Optimise WMF WAN Network Configuration - https://phabricator.wikimedia.org/T297355 (10Krinkle) [00:55:57] (HAProxyEdgeTrafficDrop) firing: 69% request drop in text@drmrs during the past 30 minutes - https://wikitech.wikimedia.org/wiki/Monitoring/EdgeTrafficDrop - https://grafana.wikimedia.org/d/000000479/frontend-traffic?viewPanel=12&orgId=1&from=now-24h&to=now&var-site=drmrs&var-cache_type=text - https://alerts.wikimedia.org/?q=alertname%3DHAProxyEdgeTrafficDrop [01:00:57] (HAProxyEdgeTrafficDrop) resolved: 69% request drop in text@drmrs during the past 30 minutes - https://wikitech.wikimedia.org/wiki/Monitoring/EdgeTrafficDrop - https://grafana.wikimedia.org/d/000000479/frontend-traffic?viewPanel=12&orgId=1&from=now-24h&to=now&var-site=drmrs&var-cache_type=text - https://alerts.wikimedia.org/?q=alertname%3DHAProxyEdgeTrafficDrop [14:11:09] 10netops, 10Infrastructure-Foundations, 10SRE, 10cloud-services-team (Kanban): More public IPs for codfw1dev - https://phabricator.wikimedia.org/T313977 (10rook) I think the problem might be with the gateway_ip, it is set to none. Or perhaps it is the allocation pool starts at 17 rather than 18, and if we... [14:13:30] 10Traffic, 10SRE, 10Patch-For-Review: Test ESI feasibility with current Varnish installation - https://phabricator.wikimedia.org/T308799 (10BBlack) Sorry for all the delays on my end as well, but we're getting somewhere. On the earlier points about attachment via varnish vs ats-be: For now, it's just simpl... [17:52:00] 10Traffic, 10Data-Persistence (Consultation), 10MediaWiki-Action-API, 10SRE, and 2 others: API not responding (overflow) - https://phabricator.wikimedia.org/T313986 (10Dzahn) 05Open→03Resolved a:03Dzahn This was caused by an incident but the incident is over. There will be a report in the future. [18:00:12] 10netops, 10Infrastructure-Foundations, 10SRE, 10cloud-services-team (Kanban): More public IPs for codfw1dev - https://phabricator.wikimedia.org/T313977 (10rook) The subnet is updated but seeing the same kinds of results: ` openstack subnet show a9439c35-f465-475c-85a0-8e0f0f41ac4d +----------------------... [20:40:27] 10netops, 10Infrastructure-Foundations, 10netbox: Netbox: Allocation of .0 and .255 IP address form 10.65.3.0/16 and 10.65.2.0/16 network - https://phabricator.wikimedia.org/T314183 (10Papaul) [23:01:45] 10Traffic, 10Privacy Engineering: Error with Permissions-Policy header: Origin trial controlled feature not enabled: 'interest cohort' - https://phabricator.wikimedia.org/T312823 (10Krinkle) p:05Triage→03Low This is not related to the Content-Security-Policy (CSP) header. This is afaik not related to an A... [23:02:04] 10Traffic, 10Privacy Engineering: Remove obsolete "Permissions-Policy: interest-cohort: header - https://phabricator.wikimedia.org/T312823 (10Krinkle) [23:02:10] 10Traffic, 10Privacy Engineering: Remove obsolete "Permissions-Policy: interest-cohort" header - https://phabricator.wikimedia.org/T312823 (10Krinkle)