[00:16:42] 10Data-Engineering (Q4 2024 April 1st - June 30th), 06Data Products, 13Patch-For-Review: Modify ClickStreamBuilder pipeline to cope with pagelinks schema changes - https://phabricator.wikimedia.org/T355588#9759972 (10CodeReviewBot) xcollazo merged https://gitlab.wikimedia.org/repos/data-engineering/airflow-d... [00:30:08] 10Data-Engineering (Q4 2024 April 1st - June 30th), 06Data Products, 13Patch-For-Review: Modify ClickStreamBuilder pipeline to cope with pagelinks schema changes - https://phabricator.wikimedia.org/T355588#9760002 (10xcollazo) Deployed to prod. As per recent runs, we'll know if the changes are good on the 3... [08:05:19] 06Data-Engineering, 06Data-Platform-SRE: db1208 prometheus exporter alert - https://phabricator.wikimedia.org/T363897 (10Marostegui) 03NEW [08:26:45] 06Data-Engineering, 10Data-Platform-SRE (2024.04.15 - 2024.05.05): db1208 prometheus exporter alert - https://phabricator.wikimedia.org/T363897#9760489 (10BTullis) p:05Triage→03High a:03BTullis [08:30:07] 06Data-Engineering, 10Data-Platform-SRE (2024.04.15 - 2024.05.05): db1208 prometheus exporter alert - https://phabricator.wikimedia.org/T363897#9760498 (10BTullis) Oh, sorry about this. I saw the failed systemd alert yesterday and ran. ` sudo systemctl mask prometheus-mysqld-exporter.service sudo systemctl re... [09:12:02] 06Data-Engineering, 10Data-Platform-SRE (2024.04.15 - 2024.05.05): db1208 prometheus exporter alert - https://phabricator.wikimedia.org/T363897#9760571 (10BTullis) 05Open→03Resolved I believe that this is fixed now. I was missing the `BINLOG_MONITOR` permission from the prometheus@localhost grant. [15:21:08] (03PS1) 10Xcollazo: Add project 'ms.wikisource' to pageview allowlist. [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1026163 [15:23:32] (03CR) 10Mforns: [C:03+2] Add project 'ms.wikisource' to pageview allowlist. [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1026163 (owner: 10Xcollazo) [15:25:12] (03CR) 10Xcollazo: [V:03+2] Add project 'ms.wikisource' to pageview allowlist. [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1026163 (owner: 10Xcollazo) [15:36:05] 10Data-Engineering (Q4 2024 April 1st - June 30th), 10Event-Platform, 07Spike: [SPIKE] Can we express Event Platform configs in Datasets Config? - https://phabricator.wikimedia.org/T361017#9761303 (10Ottomata) > we had programmatic ways to clean airflow (values?) caches. My understanding is that the current... [15:59:05] !log deploying airflow dags to play with mediawiki snapshot config cassandra loader job [15:59:06] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [16:46:04] 06Data-Engineering, 10FY2023-24-WE 2.1 Typography and palette customizations, 10Data Products (Data Products Sprint 12), 13Patch-For-Review, 10Web-Team-Backlog (FY2023-24 Q4 Sprint 2): Update Sample Rates for Metrics Platform Events - https://phabricator.wikimedia.org/T361962#9761513 (10KSarabia-WMF) a:... [22:17:10] 06Data-Engineering, 10FY2023-24-WE 2.1 Typography and palette customizations, 10Data Products (Data Products Sprint 13), 13Patch-For-Review, 10Web-Team-Backlog (FY2023-24 Q4 Sprint 2): Update Sample Rates for Metrics Platform Events - https://phabricator.wikimedia.org/T361962#9762343 (10VirginiaPoundstone) [22:42:31] 06Data-Engineering, 10Dumps-Generation, 06SRE, 10Data-Platform-SRE (2024.04.15 - 2024.05.05): Migrate Dumps Snapshot hosts from Buster to Bullseye - https://phabricator.wikimedia.org/T325228#9762512 (10Dzahn) >>! In T325228#9445729, @MoritzMuehlenhoff wrote: > .. The setup of the mw-cgroup (configured via... [22:51:13] 06Data-Engineering, 10Dumps-Generation, 06SRE, 10Data-Platform-SRE (2024.04.15 - 2024.05.05): Migrate Dumps Snapshot hosts from Buster to Bullseye - https://phabricator.wikimedia.org/T325228#9762527 (10Dzahn) update: rebooting the VM fixed the problem because then the grub config was applied: T363957#97625...