[04:35:14] So, the garage on the other side of my wall sort of burned out. Everyone is safe. I can predict that I’ll be out today. Will keep you posted. [05:55:22] I’ve been told my house is fine to come back to and didn’t suffer any damage. We’re trying to sort out child care atm [07:03:55] Sorry about that brouberol|ooo Hope you're able to get everything under control [07:33:18] It’s.. a process [08:33:45] (03CR) 10Gmodena: Upgrade MediawikiHistory Checker to use AWS Deequ. 1. Update User history checker 2. Update Page history checker 3. Update Denormalized hist (031 comment) [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1024423 (https://phabricator.wikimedia.org/T361016) (owner: 10Snwachukwu) [09:15:22] o/ Are any of the analytics team / superset pros at the hackathon? [09:15:59] addshore: I know that mforns will be there. [09:20:35] Amazing! TLDR; I made a dashboard some years ago showing data for this mwcli tool I made, I want to get the dashboard to the point wher eit can summarize a couple of years worth of data, but currently it times out :) [10:00:11] addshore: Sounds excellent. Maybe it's trying to pull too much data from HDFS to the presto workers when you run the query? In case it helps, you can use this dashboard to keep an eye in real-time on the combined amount of network traffic and CPU that the presto cluster is thrashing while you load a particular dashboard. https://grafana.wikimedia.org/d/000000006/presto-server-utilization-btullis?orgId=1&refresh=30s [10:01:03] But yes, I'm sure that you'll be in good hands at the hackathon too. Hope it goes well for you. [10:48:33] (03CR) 10Gmodena: Upgrade MediawikiHistory Checker to use AWS Deequ. 1. Update User history checker 2. Update Page history checker 3. Update Denormalized hist (031 comment) [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1024423 (https://phabricator.wikimedia.org/T361016) (owner: 10Snwachukwu) [11:54:25] btullis: many thanks [12:54:19] 06Data-Engineering: [Bug?] Can't find wikidatawiki on wmf.mediawiki_wikitext_history - https://phabricator.wikimedia.org/T364045#9767429 (10lbowmaker) @diego - we skipped loading wikidatawiki as part of this ticket: https://phabricator.wikimedia.org/T357859 Let us know if any issues with using the alternative. [13:36:49] 06Data-Engineering, 06Movement-Insights, 06Research-Freezer: Investigate relation of Prefetch feature to increase in automated traffic and impact on unique devices - https://phabricator.wikimedia.org/T336715#9767650 (10OSefu-WMF) [13:51:01] 06Data-Engineering: [Bug?] Can't find wikidatawiki on wmf.mediawiki_wikitext_history - https://phabricator.wikimedia.org/T364045#9767704 (10diego) @lbowmaker if understand correctly, there is no alternative for obtaining historical data for Wikidata edits? If this is the case, we can't keep the Wikidata Revert R... [14:47:45] 06Data-Engineering, 10Data-Engineering-Dashiki, 10Data Products (Data Products Sprint 13), 10MediaWiki-Platform-Team (Radar): Investigate surprising "10% Other" portion of Analytics Browsers report - https://phabricator.wikimedia.org/T342267#9767996 (10VirginiaPoundstone) @SNowick_WMF @nettrom_WMF @mpopov... [14:48:08] 06Data-Engineering, 10Data-Engineering-Dashiki, 10Data Products (Data Products Sprint 14), 10MediaWiki-Platform-Team (Radar): Investigate surprising "10% Other" portion of Analytics Browsers report - https://phabricator.wikimedia.org/T342267#9768004 (10VirginiaPoundstone) [14:51:27] 06Data-Engineering, 06Data Products, 10Observability-Logging, 06Traffic, 13Patch-For-Review: Move analytics log from Varnish to HAProxy - https://phabricator.wikimedia.org/T351117#9768016 (10VirginiaPoundstone) [15:02:39] 06Data-Engineering, 06Data Products: Past edits increase in wmf.edit_hourly with every new snapshot - https://phabricator.wikimedia.org/T355182#9768076 (10VirginiaPoundstone) This should be timeboxed to three hours of investigation and tackled after we unblock Temp Accounts work. [15:36:31] 06Data-Engineering: [Bug?] Can't find wikidatawiki on wmf.mediawiki_wikitext_history - https://phabricator.wikimedia.org/T364045#9768222 (10Lydia_Pintscher) I believe @AndrewTavis_WMDE was running into similar issues for T362849 and there is T363451. Does that help any? [15:39:57] 06Data-Engineering, 10Cassandra, 06Data-Persistence, 10Data-Platform-SRE (2024.05.06 - 2024.05.26): Encrypt Airflow connections to AQS Cassandra - https://phabricator.wikimedia.org/T362181#9768255 (10Gehel) [15:40:58] 06Data-Engineering, 10Dumps-Generation, 06SRE, 10Data-Platform-SRE (2024.05.06 - 2024.05.26): Migrate Dumps Snapshot hosts from Buster to Bullseye - https://phabricator.wikimedia.org/T325228#9768259 (10Gehel) [16:16:30] 06Data-Engineering, 10Cassandra, 06Data-Persistence, 10Data-Platform-SRE (2024.05.06 - 2024.05.26), 13Patch-For-Review: Encrypt Airflow connections to AQS Cassandra - https://phabricator.wikimedia.org/T362181#9768453 (10BTullis) I believe that this is ready to go. We will have deploy this https://gerrit.... [17:43:43] 06Data-Engineering, 10probenet, 10Event-Platform: Add isp_data to event_transforms refine - https://phabricator.wikimedia.org/T364166 (10CDanis) 03NEW