[00:18:35] 06Data-Engineering, 10MediaWiki-General, 10Event-Platform, 10MediaWiki-Platform-Team (Radar): Create legacy EventLogging proxy HTTP intake (for MediaWikiPingback) endpoint to EventGate - https://phabricator.wikimedia.org/T353817#9933188 (10Ottomata) Interesting, thank you. > If we wanted to get this task... [10:07:50] 06Data-Engineering, 06Product-Analytics, 10Data-Platform-SRE (2024.06.17 - 2024.07.07): Publishing conda environments with WMF Data Workflow Utils is broken - https://phabricator.wikimedia.org/T367848#9933740 (10Stevemunene) We recently deployed the conda-analytics v 0.0.32 upgrade which fixed the pytest bit... [12:51:52] 06Data-Engineering, 06DC-Ops, 10ops-eqiad, 06SRE: Q4:rack/setup/install an-conf100[4-6] - https://phabricator.wikimedia.org/T364429#9934251 (10Jclark-ctr) [13:19:43] 06Data-Engineering, 06Data Products, 06DBA, 07Schema-change: Design and merge the new tables of file tables - https://phabricator.wikimedia.org/T368113#9934333 (10Ladsgroup) I had to deprioritize this for a bit to deal with the aftermath of the outages. I will get back to it next week. [13:37:02] 06Data-Engineering, 06SRE, 10SRE-Access-Requests, 13Patch-For-Review: Requesting access to private data-based dashboards for Jsn.sherman - https://phabricator.wikimedia.org/T367295#9934379 (10Dzahn) 05In progress→03Resolved @jsn.sherman You have now been added to the group as requested. Feel free... [13:45:56] 10Data-Engineering (Q4 2024 April 1st - June 30th), 13Patch-For-Review: [Refine refactoring] Extract refine schema management into a dedicated tool - https://phabricator.wikimedia.org/T356762#9934452 (10Ahoelzl) [15:54:09] 06Data-Engineering, 06Data Products, 10Dumps 2.0, 10Event-Platform: Consider renaming columns and/or table to abide by the data modeling guidelines - https://phabricator.wikimedia.org/T366542#9935073 (10xcollazo) [16:03:05] 06Data-Engineering, 06Data-Platform-SRE: Design a suitable DAG deployment method - https://phabricator.wikimedia.org/T368033#9935112 (10BTullis) OK, do we have enough agreement to proceed along the lines of option 2? [[https://airflow.apache.org/docs/helm-chart/stable/manage-dags-files.html#using-git-sync|Use... [16:11:51] 06Data-Engineering, 10Pageviews-Anomaly, 07SecTeam-Processed, 07Security: Views data integrity compromised by entity running up fake views - https://phabricator.wikimedia.org/T366554#9935139 (10sbassett) [16:34:46] 06Data-Engineering, 10Dumps-Generation, 06SRE, 10Data Products (Data Products Sprint 15), and 2 others: Dumps generation without prefetch cause disruption to the production environment - https://phabricator.wikimedia.org/T368098#9935262 (10xcollazo) https://gerrit.wikimedia.org/r/1049617, which was pointed... [16:39:57] 14Analytics, 10AQS2.0, 06Tech-Docs-Team, 10Data Products (Epics Timeline), and 2 others: AQS 2.0 user documentation - https://phabricator.wikimedia.org/T288664#9935305 (10apaskulin) [17:09:00] 06Data-Engineering, 10Dumps-Generation, 06SRE, 10Data Products (Data Products Sprint 15), and 2 others: Dumps generation without prefetch cause disruption to the production environment - https://phabricator.wikimedia.org/T368098#9935383 (10Dzahn) As someone involved in disabling the dumps services and pupp... [18:34:47] 06Data-Engineering, 10Dumps-Generation, 06SRE, 10Data Products (Data Products Sprint 15), and 2 others: Dumps generation without prefetch cause disruption to the production environment - https://phabricator.wikimedia.org/T368098#9935618 (10Ladsgroup) I would like to monitor the databases when the dumps sta... [18:43:32] 06Data-Engineering, 10Dumps-Generation, 06SRE, 10Data Products (Data Products Sprint 15), and 2 others: Dumps generation without prefetch cause disruption to the production environment - https://phabricator.wikimedia.org/T368098#9935636 (10xcollazo) Great, tentatively I've scheduled time with @BTullis on W... [18:45:52] 06Data-Engineering, 10Dumps-Generation, 06SRE, 10Data Products (Data Products Sprint 15), and 2 others: Dumps generation without prefetch cause disruption to the production environment - https://phabricator.wikimedia.org/T368098#9935645 (10xcollazo) >>! In T368098#9935618, @Ladsgroup wrote: > I would like... [18:54:38] 06Data-Engineering, 06DC-Ops, 10ops-eqiad, 06SRE: Degraded RAID on aqs1013 - https://phabricator.wikimedia.org/T368564#9935682 (10Jclark-ctr) 05Open→03Resolved a:03Jclark-ctr duplicate T362033 [19:02:08] 06Data-Engineering, 06DC-Ops, 10ops-eqiad, 06SRE: Q4:rack/setup/install an-conf100[4-6] - https://phabricator.wikimedia.org/T364429#9935782 (10Jclark-ctr) a:03BTullis [21:27:23] (03CR) 10Bearloga: [C:04-1] "Thanks! A few additional notes:" [analytics/wmf-product/jobs] - 10https://gerrit.wikimedia.org/r/1049106 (https://phabricator.wikimedia.org/T362615) (owner: 10KCVelaga) [21:45:59] 06Data-Engineering: [Placeholder] Clean Up Corresponding Hive Tables After Deprecating Older Stream Configs - https://phabricator.wikimedia.org/T368800 (10KSarabia-WMF) 03NEW [21:46:56] 06Data-Engineering: [Placeholder] Clean Up Corresponding Hive Tables After Deprecating Older Stream Configs - https://phabricator.wikimedia.org/T368800#9936321 (10KSarabia-WMF)