[07:39:52] (HighATSrequests) firing: (5) High number of ATS requests on cp5018:0 - https://wikitech.wikimedia.org/wiki/Apache_Traffic_Server - https://alerts.wikimedia.org/?q=alertname%3DHighATSrequests [07:43:41] (PurgedHighEventLag) firing: (9) High event process lag with purged on cp5017:2112 - https://wikitech.wikimedia.org/wiki/Purged#Alerts - https://alerts.wikimedia.org/?q=alertname%3DPurgedHighEventLag [07:45:07] (HighATSrequests) firing: (8) High number of ATS requests on cp5017:0 - https://wikitech.wikimedia.org/wiki/Apache_Traffic_Server - https://alerts.wikimedia.org/?q=alertname%3DHighATSrequests [07:49:58] (PurgedHighEventLag) firing: (16) High event process lag with purged on cp5017:2112 - https://wikitech.wikimedia.org/wiki/Purged#Alerts - https://alerts.wikimedia.org/?q=alertname%3DPurgedHighEventLag [07:50:57] (HighATSrequests) resolved: (16) High number of ATS requests on cp5017:0 - https://wikitech.wikimedia.org/wiki/Apache_Traffic_Server - https://alerts.wikimedia.org/?q=alertname%3DHighATSrequests [07:54:42] (PurgedHighEventLag) firing: (31) High event process lag with purged on cp5017:2112 - https://wikitech.wikimedia.org/wiki/Purged#Alerts - https://alerts.wikimedia.org/?q=alertname%3DPurgedHighEventLag [09:01:15] 10Traffic, 10Performance-Team, 10SRE, 10Performance Issue, 10Wikimedia-Incident: en.wiki slow to respond when editing, and occasionally throws an error with Chrome search shortcuts, or blocked because missing HTTPS - https://phabricator.wikimedia.org/T326496 (10RhinosF1) [09:05:14] 10Traffic, 10Performance-Team, 10SRE, 10Performance Issue: en.wiki slow to respond when editing, and occasionally throws an error with Chrome search shortcuts, or blocked because missing HTTPS - https://phabricator.wikimedia.org/T326496 (10Joe) p:05Unbreak!→03Low This task reports continuing issues for... [09:15:05] 10Traffic, 10SRE, 10Chinese-Sites, 10Wikimedia-Incident: zhwiki met a problem with access - https://phabricator.wikimedia.org/T326495 (10RhinosF1) 05duplicate→03Resolved p:05Triage→03Unbreak! This was resolved, SRE are aware of an issue around this time. The previously linked task was unrelated. [09:15:28] 10Traffic, 10SRE, 10Chinese-Sites, 10Wikimedia-Incident: zhwiki met a problem with access - https://phabricator.wikimedia.org/T326495 (10RhinosF1) >>! In T326495#8507147, @SD_hehua wrote: > Emmm not a duplicate? Yep, 2 issues with slowness around the same time. Wasn’t connected though. [09:16:00] 10Traffic, 10SRE, 10Chinese-Sites, 10Wikimedia-Incident: 2023-01-08 Wikimedia Connectivity Issues - https://phabricator.wikimedia.org/T326495 (10RhinosF1) [11:53:41] (PurgedHighEventLag) firing: High event process lag with purged on cp5025:2112 - https://wikitech.wikimedia.org/wiki/Purged#Alerts - https://grafana.wikimedia.org/d/RvscY1CZk/purged?var-datasource=eqsin%20prometheus/ops&var-instance=cp5025 - https://alerts.wikimedia.org/?q=alertname%3DPurgedHighEventLag [15:53:41] (PurgedHighEventLag) firing: High event process lag with purged on cp5025:2112 - https://wikitech.wikimedia.org/wiki/Purged#Alerts - https://grafana.wikimedia.org/d/RvscY1CZk/purged?var-datasource=eqsin%20prometheus/ops&var-instance=cp5025 - https://alerts.wikimedia.org/?q=alertname%3DPurgedHighEventLag [19:53:41] (PurgedHighEventLag) firing: High event process lag with purged on cp5025:2112 - https://wikitech.wikimedia.org/wiki/Purged#Alerts - https://grafana.wikimedia.org/d/RvscY1CZk/purged?var-datasource=eqsin%20prometheus/ops&var-instance=cp5025 - https://alerts.wikimedia.org/?q=alertname%3DPurgedHighEventLag [20:35:50] (HighATSrequests) firing: High number of ATS requests on cp5018:0 - https://wikitech.wikimedia.org/wiki/Apache_Traffic_Server - https://grafana.wikimedia.org/d/6uhkG6OZk/ats-instance-drilldown?orgId=1&var-site=eqsin&var-instance=cp5018 - https://alerts.wikimedia.org/?q=alertname%3DHighATSrequests [20:40:50] (HighATSrequests) firing: (9) High number of ATS requests on cp5017:0 - https://wikitech.wikimedia.org/wiki/Apache_Traffic_Server - https://alerts.wikimedia.org/?q=alertname%3DHighATSrequests [20:45:31] (PurgedHighEventLag) firing: (16) High event process lag with purged on cp5017:2112 - https://wikitech.wikimedia.org/wiki/Purged#Alerts - https://alerts.wikimedia.org/?q=alertname%3DPurgedHighEventLag [20:47:40] (HighATSrequests) firing: (13) High number of ATS requests on cp5017:0 - https://wikitech.wikimedia.org/wiki/Apache_Traffic_Server - https://alerts.wikimedia.org/?q=alertname%3DHighATSrequests [20:50:56] (PurgedHighEventLag) firing: (31) High event process lag with purged on cp5017:2112 - https://wikitech.wikimedia.org/wiki/Purged#Alerts - https://alerts.wikimedia.org/?q=alertname%3DPurgedHighEventLag [20:52:13] (HighATSrequests) resolved: (16) High number of ATS requests on cp5017:0 - https://wikitech.wikimedia.org/wiki/Apache_Traffic_Server - https://alerts.wikimedia.org/?q=alertname%3DHighATSrequests