[00:57:10] 10Analytics-Canonical-Data, 06Movement-Insights (FY26-27 H1): Upload canonical datasets to the Data Lake using Wmfdata's spark.upload_pandas - https://phabricator.wikimedia.org/T355847#12342943 (10nshahquinn-wmf) I got hung up by the `un_m49_code` field in the country dataset. It has null values and is current... [01:04:24] 06Data-Engineering, 10Dumps-Generation, 10Wikidata: Provide wikidata JSON dumps compressed with zstd - https://phabricator.wikimedia.org/T222985#12342945 (10connorshea) zstd would be wonderful to see supported. I'm currently working on an app in Toolforge that needs to pull data from the full Wikidata dump,... [05:50:03] 06Data-Engineering, 10DPE-MediaWiki-Incremental-History, 06MediaWiki-API-Platform-Team, 05MW-1.47-notes (1.47.0-wmf.18; 2026-09-01), 13Patch-For-Review: MediaWiki DomainEvents - Include LogEntry - https://phabricator.wikimedia.org/T427815#12343089 (10tchin) @daniel So I've been making a [[ https://gerrit... [07:37:38] 06Data-Engineering, 06Product-Analytics (Kanban): Update partitioning of api_requests_refined to use ts col - https://phabricator.wikimedia.org/T438655 (10KCVelaga_WMF) 03NEW [07:38:08] 06Data-Engineering, 06Product-Analytics (Kanban): Update partitioning of api_requests_refined to use ts col - https://phabricator.wikimedia.org/T438655#12343274 (10KCVelaga_WMF) a:05JAllemandou→03KCVelaga_WMF [07:38:35] 06Data-Engineering, 06Product-Analytics (Kanban): Update partitioning of api_requests_refined to use ts col - https://phabricator.wikimedia.org/T438655#12343280 (10KCVelaga_WMF) Thanks to @JAllemandou for flagging this redudancy. [08:34:58] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 05Metrics-Sprint-2026-2027: Backfill and update schedule of gcp_gsc_export.max_date_sitedata_daily_aggregate - https://phabricator.wikimedia.org/T436999#12343484 (10Antoine_Quhen) **Plan: productionize the `sitedata_daily_aggregate` dataset on the WMF... [08:56:34] 06Data-Engineering, 10DPE-MediaWiki-Incremental-History, 06MediaWiki-API-Platform-Team, 05MW-1.47-notes (1.47.0-wmf.18; 2026-09-01), 13Patch-For-Review: MediaWiki DomainEvents - Include LogEntry - https://phabricator.wikimedia.org/T427815#12343862 (10daniel) >>! In T427815#12343089, @tchin wrote: > @dani... [09:08:16] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 13Patch-For-Review: Fix iceberg table location in hive metastore - https://phabricator.wikimedia.org/T408939#12343987 (10JAllemandou) All "production" tables updated in the metastore/HDFS. Still one patch to be merged, waiting for review. [09:12:58] 06Data-Engineering, 06Data-Platform-SRE (2026-09-18 - 2026-10-09), 07Essential-Work: Allow unauthenticated access to the dse-k8s OIDC discovery and JWKS endpoints - https://phabricator.wikimedia.org/T435591#12344013 (10BTullis) p:05Triage→03High a:03BTullis [13:52:37] 06Data-Engineering, 06Movement-Insights: Replace dbt model JOINs on `event_user_text` with `event_user_central_id` - https://phabricator.wikimedia.org/T438573#12345366 (10CMyrick-WMF) [13:55:59] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 05Metrics-Sprint-2026-2027: Calculate active UWERs on a weekly cadence - https://phabricator.wikimedia.org/T437961#12345376 (10APizzata-WMF) The full snapshot of the `wmf_raw.mediawiki_actor` table weights roughly 6 Gb: ` hdfs dfs -du /wmf/data/raw/med... [13:56:12] 06Data-Engineering, 06Movement-Insights: Replace dbt model JOINs on `event_user_text` with `event_user_central_id` (movement-insights-contributors-metrics) - https://phabricator.wikimedia.org/T438573#12345380 (10CMyrick-WMF) [14:29:57] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10Data-Engineering-Roadmap, 07Epic: Write technical documentation for KAPOW - https://phabricator.wikimedia.org/T437332#12345571 (10mforns) Thank you @Novem_Linguae! Note that a good part of the technical documentation will go on a private document,... [14:42:23] 06Data-Engineering, 05Metrics-Sprint-2026-2027: Non-incremental active UWERs job has incorrect Airflow schedule and dependencies - https://phabricator.wikimedia.org/T438584#12345685 (10Ahoelzl) p:05Triage→03High a:05Ahoelzl→03amastilovic [14:43:09] 06Data-Engineering: Stop publishing _SUCCESS files for v2 dumps - https://phabricator.wikimedia.org/T438748 (10GGoncalves-WMF) 03NEW [14:43:31] 06Data-Engineering: Stop publishing _SUCCESS files for v2 dumps - https://phabricator.wikimedia.org/T438748#12345699 (10GGoncalves-WMF) [14:43:32] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 07Epic: XML Dumps v1 sunset - https://phabricator.wikimedia.org/T437518#12345700 (10GGoncalves-WMF) [14:43:48] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): Stop publishing _SUCCESS files for v2 dumps - https://phabricator.wikimedia.org/T438748#12345702 (10GGoncalves-WMF) [14:43:59] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): Stop publishing _SUCCESS files for v2 dumps - https://phabricator.wikimedia.org/T438748#12345703 (10GGoncalves-WMF) a:03xcollazo [14:57:30] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): Stop publishing _SUCCESS files for v2 dumps - https://phabricator.wikimedia.org/T438748#12345765 (10xcollazo) 05Open→03In progress [15:32:06] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10Event-Platform: Relative Trending - Adjust K8s resources in Production. - https://phabricator.wikimedia.org/T438460#12346036 (10JMonton-WMF) [15:34:26] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10DPE-MediaWiki-Incremental-History, 10Event-Platform, 13Patch-For-Review: Capture relevant mediawiki tags changes in event stream(s) - https://phabricator.wikimedia.org/T434143#12346049 (10Ahoelzl) [15:38:59] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): Create dashboard(s) - https://phabricator.wikimedia.org/T438755 (10AKhatun_WMF) 03NEW [16:01:39] (03PS1) 10Astein: make hour dynamic [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1343586 [16:03:31] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): Load Google Search Console AI impressions into the data lake - https://phabricator.wikimedia.org/T436573#12346236 (10Ahoelzl) 05Open→03Declined [16:03:55] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): Load Google Search Console AI impressions into the data lake - https://phabricator.wikimedia.org/T436573#12346239 (10Ahoelzl) Confirmed the data is not available separately. [16:15:18] (03PS2) 10Astein: make hour dynamic [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1343586 [16:21:13] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10AQS2.0, 10Data-Platform, 06Growth-Team, 07OKR-Work (DE1 FY2026-27): DE1.3.2: Implement "Sliding 30 Day Top-K Pages for Editor" - https://phabricator.wikimedia.org/T437710#12346310 (10Urbanecm_WMF) [17:02:05] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 13Patch-For-Review: Implement ArticleFeatureCounts Application - https://phabricator.wikimedia.org/T437000#12346563 (10AKhatun_WMF) [17:07:33] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 13Patch-For-Review: Implement ArticleFeatureCounts Application - https://phabricator.wikimedia.org/T437000#12346587 (10AKhatun_WMF) [17:08:29] (03CR) 10Joal: make hour dynamic (031 comment) [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1343586 (owner: 10Astein) [17:49:23] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): Define and document the earliest start_date for dbt DAGs - https://phabricator.wikimedia.org/T438276#12346883 (10nshahquinn-wmf) The data in `mediawiki_history` goes back to the first Wikipedia revisions in January 2001 (well, technically, there are some... [18:25:22] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): Define and document the earliest start_date for dbt DAGs - https://phabricator.wikimedia.org/T438276#12347095 (10amastilovic) @nshahquinn-wmf thanks for some context and real-world examples! Although this is not about the default `start_date` but the ear... [18:29:58] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 06RoadToWiki, 05Metrics-Sprint-2026-2027, 13Patch-For-Review: Mirror datasets used on the key metrics dashboard to Postgres - https://phabricator.wikimedia.org/T438586#12347101 (10Ahoelzl) p:05Triage→03High a:05Suraj_Seth→03Antoine_Quhen [18:30:15] (03PS1) 10Xcollazo: refinery-job-35: Let the recompressor own its output folder [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1343615 (https://phabricator.wikimedia.org/T437454) [19:01:06] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): Define and document the earliest start_date for dbt DAGs - https://phabricator.wikimedia.org/T438276#12347198 (10nshahquinn-wmf) @amastilovic I don't have a strong objection to the default being 2-3 years before the present, but it just doesn't seem very... [19:09:48] FIRING: EventgateLatency: Elevated latency for POST events on eventgate-logging-external in eqiad. - https://wikitech.wikimedia.org/wiki/Event_Platform/EventGate - https://grafana.wikimedia.org/d/ZB39Izmnz/eventgate?viewPanel=79&orgId=1&var-service=eventgate-logging-external - https://alerts.wikimedia.org/?q=alertname%3DEventgateLatency [19:39:05] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 06Collaboration-Services, 06Reader Growth Team, 07good first task: Structured Data packages size on GitLab - https://phabricator.wikimedia.org/T435199#12347323 (10KSarabia-WMF) Thank you for tagging this task with #good_first_task for Wikimedia new... [19:54:48] RESOLVED: EventgateLatency: Elevated latency for POST events on eventgate-logging-external in eqiad. - https://wikitech.wikimedia.org/wiki/Event_Platform/EventGate - https://grafana.wikimedia.org/d/ZB39Izmnz/eventgate?viewPanel=79&orgId=1&var-service=eventgate-logging-external - https://alerts.wikimedia.org/?q=alertname%3DEventgateLatency [20:10:48] FIRING: EventgateLatency: Elevated latency for POST events on eventgate-logging-external in eqiad. - https://wikitech.wikimedia.org/wiki/Event_Platform/EventGate - https://grafana.wikimedia.org/d/ZB39Izmnz/eventgate?viewPanel=79&orgId=1&var-service=eventgate-logging-external - https://alerts.wikimedia.org/?q=alertname%3DEventgateLatency [20:20:48] RESOLVED: EventgateLatency: Elevated latency for POST events on eventgate-logging-external in eqiad. - https://wikitech.wikimedia.org/wiki/Event_Platform/EventGate - https://grafana.wikimedia.org/d/ZB39Izmnz/eventgate?viewPanel=79&orgId=1&var-service=eventgate-logging-external - https://alerts.wikimedia.org/?q=alertname%3DEventgateLatency [20:44:55] 06Data-Engineering, 06Movement-Insights: dbt-jobs backfill: new reverted-edit models - https://phabricator.wikimedia.org/T438793 (10CMyrick-WMF) 03NEW [21:10:48] FIRING: EventgateLatency: Elevated latency for POST events on eventgate-logging-external in eqiad. - https://wikitech.wikimedia.org/wiki/Event_Platform/EventGate - https://grafana.wikimedia.org/d/ZB39Izmnz/eventgate?viewPanel=79&orgId=1&var-service=eventgate-logging-external - https://alerts.wikimedia.org/?q=alertname%3DEventgateLatency [21:21:17] 06Data-Engineering: dbt-jobs backfill: new reverted-edit models - https://phabricator.wikimedia.org/T438793#12347761 (10CMyrick-WMF) [21:40:48] RESOLVED: EventgateLatency: Elevated latency for POST events on eventgate-logging-external in eqiad. - https://wikitech.wikimedia.org/wiki/Event_Platform/EventGate - https://grafana.wikimedia.org/d/ZB39Izmnz/eventgate?viewPanel=79&orgId=1&var-service=eventgate-logging-external - https://alerts.wikimedia.org/?q=alertname%3DEventgateLatency [22:18:56] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): Dbt backfill: editor_month and base_account_registration - https://phabricator.wikimedia.org/T430602#12347851 (10Ahoelzl) 05Open→03Resolved [22:18:57] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10DPE-MediaWiki-Incremental-History: migrate dbt_jobs pipelines to use MWH incremental - https://phabricator.wikimedia.org/T429770#12347853 (10Ahoelzl) 05Open→03Resolved [22:18:58] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10Event-Platform: Relative Trending - Adjust K8s resources in Production. - https://phabricator.wikimedia.org/T438460#12347855 (10Ahoelzl) 05Open→03Resolved [22:19:01] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 07Documentation: Create Article Feature Counts Wikitech page - https://phabricator.wikimedia.org/T436653#12347857 (10Ahoelzl) 05Open→03Resolved [22:19:03] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): dbt: Change YAML group configuration keyword to "scheduling_group" - https://phabricator.wikimedia.org/T436559#12347860 (10Ahoelzl) 05Open→03Resolved [22:19:04] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): Update DBT Airflow operator's task notes only in case of failure - https://phabricator.wikimedia.org/T436410#12347859 (10Ahoelzl) 05Open→03Resolved [22:19:06] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 06Product-Analytics: dbt: Weekly scheduling dependency checks only check the first date of the week - https://phabricator.wikimedia.org/T436744#12347861 (10Ahoelzl) 05Open→03Resolved [22:19:07] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): Fix dataset.yaml entries for wmf_raw.mediawiki.* tables - https://phabricator.wikimedia.org/T436879#12347862 (10Ahoelzl) 05Open→03Resolved [22:19:11] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 06Product-Analytics, 06Product Safety and Integrity (Sprint Heather (Aug 31 - Sept 18)): Dbt backfill: signal_driven_handling_bad_faith_accounts - https://phabricator.wikimedia.org/T437095#12347863 (10Ahoelzl) 05Open→03Resolved [22:19:15] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): Set catchup=True as default in dbt scheduler YAML configuration - https://phabricator.wikimedia.org/T438275#12347865 (10Ahoelzl) 05Open→03Resolved [22:19:19] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): dbt standardized workflow and repository structure - https://phabricator.wikimedia.org/T430622#12347864 (10Ahoelzl) 05Open→03Resolved [22:19:23] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 06Java-Scala-Standardization, 07Essential-Work, 13Patch-For-Review: Decouple airflow-dags repository from Archiva - https://phabricator.wikimedia.org/T434160#12347867 (10Ahoelzl) 05Open→03Resolved [22:19:27] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): Re-establish rsync dumps access to PDApps mirror - https://phabricator.wikimedia.org/T437896#12347871 (10Ahoelzl) 05In progress→03Resolved [22:19:32] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 13Patch-For-Review: Move all Airflow artifacts away from Archiva - https://phabricator.wikimedia.org/T433434#12347870 (10Ahoelzl) 05Open→03Resolved [22:19:36] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): Fix iceberg table location in hive metastore - https://phabricator.wikimedia.org/T408939#12347872 (10Ahoelzl) 05Open→03Resolved [22:19:40] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): Spark queries of Google Search Console data fail due to Zstandard error - https://phabricator.wikimedia.org/T434625#12347873 (10Ahoelzl) 05Open→03Resolved [22:19:44] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 06Data-Platform-SRE, 06Traffic: Provide a scheduled data download service from Google Cloud Storage - https://phabricator.wikimedia.org/T427457#12347874 (10Ahoelzl) 05Open→03Resolved [22:19:52] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 13Patch-For-Review: SparkSubmitOperator: add spark_profile mechanism and fix Spark 3.5.8 SparkSqlOperator driver setup - https://phabricator.wikimedia.org/T435203#12347876 (10Ahoelzl) 05Open→03Resolved [22:19:58] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 06Data-Platform-SRE (2026-09-18 - 2026-10-09), 07Essential-Work, 05Metrics-Sprint-2026-2027: Metrics Superset dashboard access for all WMF - https://phabricator.wikimedia.org/T431697#12347877 (10Ahoelzl) 05Open→03Resolved [22:20:04] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): Remove `interlanguage` and `session_length` hive tables now that the iceberg versions are used - https://phabricator.wikimedia.org/T438021#12347878 (10Ahoelzl) 05Open→03Resolved [22:20:08] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): Drop `aqs_hourly` hive table now that the iceberg one works - https://phabricator.wikimedia.org/T437883#12347879 (10Ahoelzl) 05Open→03Resolved [22:20:12] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): Move webrequest sequence statistics to a dashboard - https://phabricator.wikimedia.org/T436700#12347882 (10Ahoelzl) 05Open→03Resolved [22:20:16] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10DPE-MediaWiki-Incremental-History: Backfill wmf_objective_metrics.heartbeat_active_editors_weekly - https://phabricator.wikimedia.org/T437118#12347880 (10Ahoelzl) 05Open→03Resolved [22:20:20] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): Add a new `is_api` field to webrequest_sampled in druid - https://phabricator.wikimedia.org/T437638#12347883 (10Ahoelzl) 05Open→03Resolved [22:20:24] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10Event-Platform: mediawiki-event-enrichment page_html_change job should use X-MediaWiki-Render-Id header instead of etag - https://phabricator.wikimedia.org/T420217#12347884 (10Ahoelzl) 05In progress→03Resolved [22:20:28] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 06Traffic, 13Patch-For-Review: Add X-Provenance to `wmf.webrequest` - https://phabricator.wikimedia.org/T431256#12347885 (10Ahoelzl) 05Open→03Resolved [22:20:34] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10DPE-MediaWiki-Incremental-History, 10Event-Platform: MediaWiki state change events - emit global edit count - https://phabricator.wikimedia.org/T430967#12347890 (10Ahoelzl) 05Open→03Resolved [22:20:38] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10Data-Engineering-Roadmap, 07Epic, 13Patch-For-Review: Create, orchestrate and backfill wmf.projectview_legacy_hourly table - https://phabricator.wikimedia.org/T437277#12347886 (10Ahoelzl) 05Open→03Resolved [22:20:42] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10Commons-Impact-Metrics, 10Commons-Impact-Metrics-Requests: Update Commons Impact Metrics allow-list August 2026 - https://phabricator.wikimedia.org/T436416#12347893 (10Ahoelzl) 05Open→03Resolved [22:20:51] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): Reload Google Search Console data for 13-17 August 2026 - https://phabricator.wikimedia.org/T436144#12347896 (10Ahoelzl) 05Open→03Resolved [22:20:55] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): Exclude %test% wikis from grouped_wikis.csv - https://phabricator.wikimedia.org/T436658#12347900 (10Ahoelzl) 05Open→03Resolved [22:20:59] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): dbt compilation error: day is out of range for month - https://phabricator.wikimedia.org/T436493#12347902 (10Ahoelzl) 05Open→03Resolved [22:21:03] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10Data-Engineering-Wikistats: The stat site show INVALID on Cantonese Wikipedia. - https://phabricator.wikimedia.org/T411938#12347898 (10Ahoelzl) 05Open→03Resolved [22:21:11] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 06Traffic: Turnilo: X-Is-Browser filter doesn't work (always HTTP 500) - https://phabricator.wikimedia.org/T435152#12347907 (10Ahoelzl) 05Open→03Resolved [22:21:17] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10Event-Platform, 13Patch-For-Review: Relative Trending - Fix records always trending. - https://phabricator.wikimedia.org/T435291#12347905 (10Ahoelzl) 05Open→03Resolved [22:21:21] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): Fix `mediawiki_history` duplicated revision failure and data dependency - https://phabricator.wikimedia.org/T434170#12347910 (10Ahoelzl) 05Open→03Resolved [22:21:25] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 05Metrics-Sprint-2026-2027: Backfills, Delayed runs, and Quality Checks - https://phabricator.wikimedia.org/T433110#12347908 (10Ahoelzl) 05Open→03Resolved [22:21:29] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 05Metrics-Sprint-2026-2027: Move all FY2026-2027 chart data to PostgreSQL - https://phabricator.wikimedia.org/T432017#12347909 (10Ahoelzl) 05Open→03Resolved [22:21:34] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 07Epic: [EPIC] Instrumentation for FY25/26 WE 5.3.4 "Qualified Traffic & Downstream Outcomes" - https://phabricator.wikimedia.org/T417049#12347914 (10Ahoelzl) 05Open→03Resolved [22:21:38] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 07Epic: Attribution Research: Instrument Donation Attempts - https://phabricator.wikimedia.org/T419569#12347913 (10Ahoelzl) 05Open→03Resolved [22:21:42] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 07Epic: Streaming job transforms and saves Experiment data - https://phabricator.wikimedia.org/T420428#12347916 (10Ahoelzl) 05Open→03Resolved [22:21:46] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): Polish signal_driven_handling_bad_faith_accounts.sql model - https://phabricator.wikimedia.org/T431331#12347922 (10Ahoelzl) 05Open→03Resolved [22:21:54] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): Feature request: Enable dbt jobs to be scheduled hourly - https://phabricator.wikimedia.org/T433509#12347921 (10Ahoelzl) 05Open→03Resolved [22:21:58] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10Event-Platform: Review "page_view" schema, definition and operations. - https://phabricator.wikimedia.org/T427901#12347919 (10Ahoelzl) 05Open→03Resolved [22:22:06] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): Add an option to define an alert email at the level of team YAML config dbt scheduler file - https://phabricator.wikimedia.org/T434001#12347924 (10Ahoelzl) 05Open→03Resolved [22:22:10] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): Add automated test run config option to dbt scheduler YAML - https://phabricator.wikimedia.org/T434000#12347923 (10Ahoelzl) 05Open→03Resolved [22:22:18] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): dbt on Airflow: Automatically determine memory for Skein driver, based on spark.driver.memory - https://phabricator.wikimedia.org/T434323#12347925 (10Ahoelzl) 05Open→03Resolved [22:22:22] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): Reinforce Blunderbuss to better respond to source server outages - https://phabricator.wikimedia.org/T434344#12347926 (10Ahoelzl) 05Open→03Resolved [23:01:41] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): Customizable dbt scheduled dependency sensors - https://phabricator.wikimedia.org/T430579#12348025 (10amastilovic) I think this can be achieved using the following Jinja template functions that are already provided in our Airflow deployment (`mwh_snapsho... [23:19:24] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): dbt_daily DAG exceeds its SLA - https://phabricator.wikimedia.org/T434307#12348051 (10amastilovic) > I guess we could: > Increment the SLA? We can do this, I'll submit an MR > Revise the heavy queries to either optimize them or adjust their cluster resou...