[00:27:02] 10netops, 10Infrastructure-Foundations, 10SRE, 10observability, 10Sustainability (Incident Followup): Alert that should have paged did not reach VictorOps because of partial networking outage - https://phabricator.wikimedia.org/T294166 (10Legoktm) [08:54:56] (VarnishTrafficDrop) firing: 63% GET drop in text@esams during the past 30 minutes - https://wikitech.wikimedia.org/wiki/Monitoring/VarnishTrafficDrop - https://grafana.wikimedia.org/d/000000541/varnish-caching-last-week-comparison?viewPanel=5&var-cluster=text&var-site=esams - https://alerts.wikimedia.org [09:04:57] (VarnishTrafficDrop) resolved: 68% GET drop in text@esams during the past 30 minutes - https://wikitech.wikimedia.org/wiki/Monitoring/VarnishTrafficDrop - https://grafana.wikimedia.org/d/000000541/varnish-caching-last-week-comparison?viewPanel=5&var-cluster=text&var-site=esams - https://alerts.wikimedia.org [11:47:56] 10netops, 10Infrastructure-Foundations, 10SRE: TATA SKY Broadband (AS134674) issues with connecting to upload.wikimedia.org - https://phabricator.wikimedia.org/T275234 (10Perryprog) >>! In T275234#7361977, @Perryprog wrote: > This issue has been reported on Znuny on Ticket#2021091710000804, so it's safe to a... [14:44:10] 10netops, 10Infrastructure-Foundations, 10SRE: TATA SKY Broadband (AS134674) issues with connecting to upload.wikimedia.org - https://phabricator.wikimedia.org/T275234 (10CDanis) Per NEL data it looks like that this issue was fixed on Sept 17th! {F34707922} These are the reported TCP resets for Tata Sky Br... [20:55:56] (VarnishTrafficDrop) firing: 69% GET drop in text@esams during the past 30 minutes - https://wikitech.wikimedia.org/wiki/Monitoring/VarnishTrafficDrop - https://grafana.wikimedia.org/d/000000541/varnish-caching-last-week-comparison?viewPanel=5&var-cluster=text&var-site=esams - https://alerts.wikimedia.org [21:00:56] (VarnishTrafficDrop) resolved: 69% GET drop in text@esams during the past 30 minutes - https://wikitech.wikimedia.org/wiki/Monitoring/VarnishTrafficDrop - https://grafana.wikimedia.org/d/000000541/varnish-caching-last-week-comparison?viewPanel=5&var-cluster=text&var-site=esams - https://alerts.wikimedia.org