[00:04:52] RECOVERY - Check unit status of drop_event on an-launcher1002 is OK: OK: Status of the systemd unit drop_event https://wikitech.wikimedia.org/wiki/Analytics/Systems/Managing_systemd_timers [00:45:14] RECOVERY - Check unit status of drop-features-actor-rollup-hourly on an-launcher1002 is OK: OK: Status of the systemd unit drop-features-actor-rollup-hourly https://wikitech.wikimedia.org/wiki/Analytics/Systems/Managing_systemd_timers [00:58:48] PROBLEM - Check unit status of drop-features-actor-rollup-hourly on an-launcher1002 is CRITICAL: CRITICAL: Status of the systemd unit drop-features-actor-rollup-hourly https://wikitech.wikimedia.org/wiki/Analytics/Systems/Managing_systemd_timers [01:48:52] PROBLEM - Check unit status of drop_event on an-launcher1002 is CRITICAL: CRITICAL: Status of the systemd unit drop_event https://wikitech.wikimedia.org/wiki/Analytics/Systems/Managing_systemd_timers [08:50:02] RECOVERY - Check unit status of drop-predictions-actor_label-hourly on an-launcher1002 is OK: OK: Status of the systemd unit drop-predictions-actor_label-hourly https://wikitech.wikimedia.org/wiki/Analytics/Systems/Managing_systemd_timers [09:03:42] PROBLEM - Check unit status of drop-predictions-actor_label-hourly on an-launcher1002 is CRITICAL: CRITICAL: Status of the systemd unit drop-predictions-actor_label-hourly https://wikitech.wikimedia.org/wiki/Analytics/Systems/Managing_systemd_timers [15:40:13] (VarnishkafkaNoMessages) firing: varnishkafka on cp5014 is not sending enough cache_upload requests - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Varnishkafka - https://grafana.wikimedia.org/d/000000253/varnishkafka?orgId=1&var-datasource=eqsin%20prometheus/ops&var-cp_cluster=cache_upload&var-instance=cp5014%3A9132&viewPanel=14 - https://alerts.wikimedia.org/?q=alertname%3DVarnishkafkaNoMessages [15:45:13] (VarnishkafkaNoMessages) resolved: varnishkafka on cp5014 is not sending enough cache_upload requests - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Varnishkafka - https://grafana.wikimedia.org/d/000000253/varnishkafka?orgId=1&var-datasource=eqsin%20prometheus/ops&var-cp_cluster=cache_upload&var-instance=cp5014%3A9132&viewPanel=14 - https://alerts.wikimedia.org/?q=alertname%3DVarnishkafkaNoMessages [16:16:01] 10Data-Engineering-Radar, 10Metrics-Platform, 10MW-1.39-notes (1.39.0-wmf.12; 2022-05-16): TypeError: navigator.sendBeacon is not a function - https://phabricator.wikimedia.org/T308311 (10EChetty) 05Open→03Resolved [16:16:29] 10Data-Engineering, 10Anti-Harassment, 10Metrics-Platform, 10Privacy Engineering, and 3 others: Measure user-agent client hints already sent in browsers requests - https://phabricator.wikimedia.org/T299397 (10EChetty) [16:16:47] 10Data-Engineering, 10Metrics-Platform, 10SRE, 10Traffic: VarnishKafka to propagate user agent client hints headers to webrequest - https://phabricator.wikimedia.org/T299401 (10EChetty) 05Open→03Resolved a:03EChetty [16:19:42] 10Analytics, 10Data Engineering Planning, 10Product-Infrastructure-Team-Backlog, 10Epic, 10Metrics-Platform-Planning (Metrics-Platform-MVP-Release-1): Event Platform Client Libraries - https://phabricator.wikimedia.org/T228175 (10EChetty) [16:22:41] 10Analytics, 10Data Engineering Planning, 10Metrics Platform Icebox, 10Product-Infrastructure-Team-Backlog, 10Epic: Event Platform Client Libraries - https://phabricator.wikimedia.org/T228175 (10EChetty) [16:29:17] 10Data-Engineering, 10Metrics-Platform-Planning (Metrics Platform Kanban), 10Patch-For-Review: Incorporate librarized Metrics Platform PHP client into EventLogging - https://phabricator.wikimedia.org/T281762 (10EChetty) [16:29:29] 10Data-Engineering-Kanban, 10Data Engineering Planning, 10Event-Platform Value Stream, 10Metrics-Platform-Planning (Metrics Platform Kanban), 10Patch-For-Review: Remove StreamConfig::INTERNAL_SETTINGS logic from EventStreamConfig and do it in EventLogging client... - https://phabricator.wikimedia.org/T286344