[02:03:25] FIRING: [3x] SystemdUnitFailed: varnishmtail@internal.service on cp3070:9100 - https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state - https://grafana.wikimedia.org/d/g-AaZRFWk/systemd-status - https://alerts.wikimedia.org/?q=alertname%3DSystemdUnitFailed [02:08:25] FIRING: [3x] SystemdUnitFailed: varnishmtail@internal.service on cp3070:9100 - https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state - https://grafana.wikimedia.org/d/g-AaZRFWk/systemd-status - https://alerts.wikimedia.org/?q=alertname%3DSystemdUnitFailed [02:13:25] RESOLVED: [3x] SystemdUnitFailed: varnishmtail@internal.service on cp3070:9100 - https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state - https://grafana.wikimedia.org/d/g-AaZRFWk/systemd-status - https://alerts.wikimedia.org/?q=alertname%3DSystemdUnitFailed [09:50:10] 06Traffic: Upgrade haproxy to 2.8.13 on cp hosts - https://phabricator.wikimedia.org/T383111#10461359 (10Vgutierrez) [11:59:49] 10netops, 06Infrastructure-Foundations, 06SRE: WMF RIPE Atlas probe in Eqiad offline - https://phabricator.wikimedia.org/T382518#10461757 (10cmooney) >>! In T382518#10455949, @VRiley-WMF wrote: > This has been rebooted > > @cmooney would you be able to check this when you have a chance? Thanks for doing th... [14:47:44] 06Traffic, 10MW-on-K8s, 06serviceops, 13Patch-For-Review: Some sites try and fail to serve favicon.ico - https://phabricator.wikimedia.org/T374997#10462412 (10matmarex) While testing the changes, we realized that the icons were previously also accessible under URLs like https://meta.wikimedia.org/w/favicon... [14:49:31] 06Traffic, 10MW-on-K8s, 06serviceops: Some sites try and fail to serve favicon.ico - https://phabricator.wikimedia.org/T374997#10462447 (10matmarex) 05Open→03Resolved a:05akosiaris→03matmarex URLs in the task description now work correctly. [18:27:08] 06Traffic, 06Infrastructure-Foundations, 06serviceops: Ownership of the sre.deploy.hiddenparma cookbook - https://phabricator.wikimedia.org/T383809 (10Volans) 03NEW [21:18:14] 06Traffic, 06SRE: Define a schema for analytics pipeline ingestion - https://phabricator.wikimedia.org/T383392#10464483 (10Ottomata) [21:18:19] 06Traffic, 06SRE: Define a schema for analytics pipeline ingestion - https://phabricator.wikimedia.org/T383392#10464485 (10Ottomata) [22:43:23] FIRING: SLOMetricAbsent: - https://alerts.wikimedia.org/?q=alertname%3DSLOMetricAbsent [22:43:32] FIRING: [2x] SLOMetricAbsent: - https://alerts.wikimedia.org/?q=alertname%3DSLOMetricAbsent [22:43:53] FIRING: [2x] SLOMetricAbsent: - https://alerts.wikimedia.org/?q=alertname%3DSLOMetricAbsent [22:43:53] FIRING: [4x] SLOMetricAbsent: - https://alerts.wikimedia.org/?q=alertname%3DSLOMetricAbsent [22:48:26] RESOLVED: [2x] SLOMetricAbsent: - https://alerts.wikimedia.org/?q=alertname%3DSLOMetricAbsent [22:48:29] RESOLVED: [2x] SLOMetricAbsent: - https://alerts.wikimedia.org/?q=alertname%3DSLOMetricAbsent [22:48:53] RESOLVED: [4x] SLOMetricAbsent: - https://alerts.wikimedia.org/?q=alertname%3DSLOMetricAbsent