[00:20:10] 06Data-Engineering: Turnilo: X-Is-Browser filter doesn't work (always HTTP 500) - https://phabricator.wikimedia.org/T435152 (10Krinkle) 03NEW [06:56:00] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): Airflow dev instance install fails: extra_k8s_secrets not release-scoped, collides across dev instances in shared airflow-dev namespace - https://phabricator.wikimedia.org/T435160 (10Antoine_Quhen) 03NEW [07:24:37] 14Analytics-Radar, 06Data-Engineering, 10Kafka-Infrastructure, 06serviceops-radar, and 4 others: Configuration Management for Kafka settings - https://phabricator.wikimedia.org/T276088#12224954 (10RKemper) PoC is working end-to-end in pontoon. Working on documentation for spin-up instructions, but in meant... [08:54:47] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10Event-Platform: Rename streams, schemas and applications - https://phabricator.wikimedia.org/T430675#12225300 (10JMonton-WMF) 05Open→03Resolved [08:55:41] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10Event-Platform, 13Patch-For-Review: Relative Trending - Flink app for page_view - https://phabricator.wikimedia.org/T425624#12225303 (10JMonton-WMF) 05Open→03Resolved [08:55:48] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10Event-Platform: Enable `upsert-kafka` tables in `eventutilities-flink - https://phabricator.wikimedia.org/T430919#12225305 (10JMonton-WMF) 05Open→03Resolved [08:55:59] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10Event-Platform: Relative Trending - Milestone 3 - K8s resources - https://phabricator.wikimedia.org/T430136#12225308 (10JMonton-WMF) 05Open→03Resolved [08:56:19] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10Event-Platform, 13Patch-For-Review: Add "wiki_id" to Page View Stream - https://phabricator.wikimedia.org/T427925#12225310 (10JMonton-WMF) 05Open→03Resolved [08:56:23] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10Event-Platform: Relative Trending - Milestone 3 - Page Trending Flink app - https://phabricator.wikimedia.org/T430134#12225312 (10JMonton-WMF) 05Open→03Resolved [08:56:41] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10Event-Platform, 13Patch-For-Review: Review `pageview` and `pageview.trending.relative` Kafka topic sizes. - https://phabricator.wikimedia.org/T432204#12225314 (10JMonton-WMF) 05Open→03Resolved [08:57:36] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10Event-Platform: Relative Trending - MIlestone 2 - Schedule load into Kafka - https://phabricator.wikimedia.org/T428726#12225319 (10JMonton-WMF) 05Open→03Resolved [08:58:23] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 06Machine-Learning-Team, 10Event-Platform: `mediawiki.page_change.v1`: negative namespace_id schema validation errors - https://phabricator.wikimedia.org/T421237#12225322 (10JMonton-WMF) 05In progress→03Resolved [10:52:07] 06Data-Engineering, 06SRE, 10SRE-Access-Requests: Requesting access to Analytics Data Lake for mkrolik/mkrolik-wmf - https://phabricator.wikimedia.org/T434877#12225767 (10JMeybohm) 05Open→03Stalled [12:32:13] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10Data Pipelines, 07Essential-Work: Airflow dynamic task mapping logs mix up when, on rerun, an id is mapped to a different map_index_template - https://phabricator.wikimedia.org/T408802#12226129 (10Gehel) Removing #data-platform-sre for the moment,... [13:09:40] 06Data-Engineering, 10DPE-MediaWiki-Incremental-History, 06MediaWiki-API-Platform-Team, 10Event-Platform: MediaWiki DomainEvents - Create new User related DomainEvents - https://phabricator.wikimedia.org/T427817#12226236 (10Ottomata) @ArielGlenn checking in. How's it going? [13:10:09] 06Data-Engineering, 10DPE-MediaWiki-Incremental-History, 06MediaWiki-API-Platform-Team, 10Event-Platform: MediaWiki DomainEvents - Create new User related DomainEvents - https://phabricator.wikimedia.org/T427817#12226239 (10Ottomata) a:03ArielGlenn [13:11:17] 06Data-Engineering, 06Collaboration-Services, 06Reader Growth Team: Structured Data packages size on GitLab - https://phabricator.wikimedia.org/T435199 (10LSobanski) 03NEW [13:17:06] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10Data Pipelines, 07Essential-Work: Airflow dynamic task mapping logs mix up when, on rerun, an id is mapped to a different map_index_template - https://phabricator.wikimedia.org/T408802#12226275 (10xcollazo) 05Open→03Declined I am being bold... [13:35:14] 06Data-Engineering, 06Product-Analytics, 06Data-Platform-SRE (2026-08-07 - 2026-08-28), 13Patch-For-Review: Add cloudflare_radar API connection to Airflow analytics main instance - https://phabricator.wikimedia.org/T433982#12226320 (10CDanis) [13:46:47] 06Data-Engineering, 06Product-Analytics, 06Data-Platform-SRE (2026-08-07 - 2026-08-28), 13Patch-For-Review: Add cloudflare_radar API connection to Airflow analytics main instance - https://phabricator.wikimedia.org/T433982#12226352 (10CDanis) [13:48:05] 06Data-Engineering, 06Product-Analytics, 06Data-Platform-SRE (2026-08-07 - 2026-08-28), 13Patch-For-Review: Add cloudflare_radar API connection to Airflow analytics main instance - https://phabricator.wikimedia.org/T433982#12226358 (10CDanis) 05Open→03Resolved a:03CDanis This should be live now!... [14:07:39] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): SparkSubmitOperator: add spark_profile mechanism and fix Spark 3.5.8 SparkSqlOperator driver setup - https://phabricator.wikimedia.org/T435203 (10Antoine_Quhen) 03NEW [14:37:40] 06Data-Engineering, 10Test Kitchen, 06Data-Platform-SRE (2026-08-07 - 2026-08-28): Airflow instance for Experiment Platform - https://phabricator.wikimedia.org/T416709#12226798 (10atsuko) I'm taking it from here. [14:37:57] 06Data-Engineering, 10Test Kitchen, 06Data-Platform-SRE (2026-08-07 - 2026-08-28): Airflow instance for Experiment Platform - https://phabricator.wikimedia.org/T416709#12226800 (10atsuko) a:05brouberol→03atsuko [14:38:15] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10Event-Platform, 13Patch-For-Review: Flink - Test `zstd` compression - https://phabricator.wikimedia.org/T429456#12226804 (10JMonton-WMF) A staging application of `mw-page-html-feature-counts-change-enrich-next` has been deployed in Jumbo. After a w... [14:57:35] 06Data-Engineering, 06Collaboration-Services, 06Reader Growth Team: Structured Data packages size on GitLab - https://phabricator.wikimedia.org/T435199#12226909 (10LSobanski) p:05Triage→03Medium [14:58:01] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10Event-Platform, 13Patch-For-Review: Backfill commonswiki and enwiki HTML for latest HTML when non-existent in event.mediawiki_page_html_content_change_v1 - https://phabricator.wikimedia.org/T426347#12226915 (10Snwachukwu) @Ottomata I was thinking,... [15:30:57] 06Data-Engineering, 10WMDE Analytics: [Analytics] [Tech Debt] Script to maintain airflow-dags/config/datasets.yaml - https://phabricator.wikimedia.org/T435216 (10AndrewTavis_WMDE) 03NEW [17:28:29] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): Add clarity to dbt scheduler YAML config model - https://phabricator.wikimedia.org/T435235 (10amastilovic) 03NEW [17:29:01] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10Event-Platform, 13Patch-For-Review: Backfill commonswiki and enwiki HTML for latest HTML when non-existent in event.mediawiki_page_html_content_change_v1 - https://phabricator.wikimedia.org/T426347#12227738 (10Ottomata) > I was thinking, could bulk... [17:32:59] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10MediaWiki-extensions-Wikibase-Client, 10Wikidata: Data Lake - sqoop of wikidata_entity_usage needs to adapt to move to x1 MariaDB cluster - https://phabricator.wikimedia.org/T431477#12227759 (10Ottomata) [17:33:30] 06Data-Engineering, 13Patch-For-Review: please merge hql/fr_tech/banner_activity_minutely into refinery - https://phabricator.wikimedia.org/T431494#12227760 (10Ottomata) 05Open→03Resolved a:03Ottomata [17:35:29] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): Add a static dbt_hourly DAG feature to dbt_scheduler - https://phabricator.wikimedia.org/T433739#12227794 (10Ottomata) →14Duplicate dup:03T433509 [17:35:30] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): Feature request: Enable dbt jobs to be scheduled hourly - https://phabricator.wikimedia.org/T433509#12227796 (10Ottomata) [17:35:34] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): Feature request: Enable dbt jobs to be scheduled hourly - https://phabricator.wikimedia.org/T433509#12227800 (10Ottomata) [17:37:49] 06Data-Engineering, 10AQS2.0, 06Growth-Team, 05DE1.3.2 Impact + Dashboard, 07OKR-Work (DE1 FY2026-27): AQS - Add per wiki filtering to edits/v3/per_editor - https://phabricator.wikimedia.org/T434136#12227808 (10Ottomata) @Ahoelzl and @GGoncalves-WMF to prioritize and task. Moving to Needs Clarification. [17:39:43] 06Data-Engineering, 10DPE-MediaWiki-Incremental-History, 10Event-Platform: Create new mediawiki.tags_change event stream - https://phabricator.wikimedia.org/T434143#12227820 (10Ottomata) We need to be careful to not reintroduce {T432948}. Either by filtering out private tags from this stream, or by emitting... [17:40:26] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 06Java-Scala-Standardization, 07Essential-Work, 13Patch-For-Review: Decouple airflow-dags repository from Archiva - https://phabricator.wikimedia.org/T434160#12227830 (10Ottomata) [17:43:58] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10AQS2.0, 10Data-Platform, 06Growth-Team, and 2 others: top_pages_per_editor returns implausible data for metawiki:Steward requests/Global permissions - https://phabricator.wikimedia.org/T434113#12227853 (10Ottomata) p:05Triage→03High @Ahoelzl... [17:44:12] 06Data-Engineering: wmf_contributors.edit_per_editor_per_page_daily claims `Martin Urbanec` is a system user - https://phabricator.wikimedia.org/T434217#12227856 (10Ottomata) p:05Triage→03High a:03Ahoelzl @Ahoelzl this is a global editor metrics calculation bug. We should fix this. Bringing into sprint, as... [17:44:22] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): wmf_contributors.edit_per_editor_per_page_daily claims `Martin Urbanec` is a system user - https://phabricator.wikimedia.org/T434217#12227860 (10Ottomata) [17:45:18] 06Data-Engineering: dbt: delay job by arbitrary amounts of time - https://phabricator.wikimedia.org/T433976#12227864 (10Ottomata) a:03Milimetric [17:45:23] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): dbt: delay job by arbitrary amounts of time - https://phabricator.wikimedia.org/T433976#12227866 (10Ottomata) [17:46:10] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): dbt_daily DAG exceeds its SLA - https://phabricator.wikimedia.org/T434307#12227874 (10Ottomata) [17:48:46] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): Dbt dev runs break for users with dashes in their username - https://phabricator.wikimedia.org/T434459#12227887 (10Ottomata) [17:49:31] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): Dbt dev runs break for users with dashes in their username - https://phabricator.wikimedia.org/T434459#12227900 (10Milimetric) a:03nshahquinn-wmf @nshahquinn-wmf wow nice catch. You should feel free to fix stuff like this, I guess just do a replace -... [17:50:05] 06Data-Engineering: Dbt lint runs break if done by more than one user on a host - https://phabricator.wikimedia.org/T434460#12227908 (10Ottomata) a:03amastilovic [17:50:16] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): Dbt lint runs break if done by more than one user on a host - https://phabricator.wikimedia.org/T434460#12227922 (10Ottomata) [17:52:58] 06Data-Engineering, 06Traffic: Normalize URI host in Turnilo's webrequest_sampled_live - https://phabricator.wikimedia.org/T434766#12227945 (10Ottomata) [17:54:07] 06Data-Engineering, 06Traffic: Normalize URI host in Turnilo's webrequest_sampled_live - https://phabricator.wikimedia.org/T434766#12227948 (10Ottomata) Adding #traffic for benthos field addition request. If that is done, #data-platform-sre can likely update required druid/turnilo configs if needed. [17:54:17] 06Data-Engineering, 06Data-Engineering-Radar, 06Traffic: Normalize URI host in Turnilo's webrequest_sampled_live - https://phabricator.wikimedia.org/T434766#12227957 (10Ottomata) [17:55:28] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): Analyze and correctly classify iMessage User-Agent - https://phabricator.wikimedia.org/T435110#12227962 (10Ottomata) [17:56:03] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): Analyze and correctly classify iMessage User-Agent - https://phabricator.wikimedia.org/T435110#12227971 (10Ottomata) Since this is assigned, we decided to move it into the current sprint. Please punt it back if this was incorrect. [17:58:55] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 06Java-Scala-Standardization, 07Essential-Work, 13Patch-For-Review: Publish all wmf-sparksqlclidriver-*.jar versions to GitLab Package Registry - https://phabricator.wikimedia.org/T435126#12228012 (10Ottomata) [17:59:09] 06Data-Engineering, 06Data-Engineering-Radar, 06Discovery-Search, 06Java-Scala-Standardization, 07Essential-Work: Publish search instance artifact JARs to GitLab Package Registry - https://phabricator.wikimedia.org/T435141#12228017 (10Ottomata) [18:03:18] 06Data-Engineering, 06Traffic: Turnilo: X-Is-Browser filter doesn't work (always HTTP 500) - https://phabricator.wikimedia.org/T435152#12228038 (10Ottomata) Hm. @JAllemandou ? https://gerrit.wikimedia.org/r/plugins/gitiles/operations/deployment-charts/+blame/0fa2c5a03d925b49fad6c5c171408cafa4a8a08b/helmfile.... [18:06:30] 06Data-Engineering, 06Traffic: Turnilo: X-Is-Browser filter doesn't work (always HTTP 500) - https://phabricator.wikimedia.org/T435152#12228048 (10CDanis) Please see also https://gerrit.wikimedia.org/r/c/operations/deployment-charts/+/1305478 If there's a way we can get both split-by and filter-by to work (e... [19:33:51] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10Event-Platform, 13Patch-For-Review: Backfill commonswiki and enwiki HTML for latest HTML when non-existent in event.mediawiki_page_html_content_change_v1 - https://phabricator.wikimedia.org/T426347#12228346 (10Snwachukwu) oops... thats a mistake. I... [19:36:01] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10Data-Persistence-Design-Review, 10Event-Platform, 13Patch-For-Review: [Data Persistence Design Review] Relative trending pages - https://phabricator.wikimedia.org/T432352#12228352 (10Ottomata) [[ https://gerrit.wikimedia.org/r/c/mediawiki/extensi... [19:36:25] 06Data-Engineering, 06Data-Engineering-Radar, 06DBA: Move SpecialUnusedTemplates computation to Hadoop - https://phabricator.wikimedia.org/T422443#12228360 (10Zabe) @JAllemandou the DAG is failing, but only for commonswiki. Any idea why that is the case? [19:36:58] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10Event-Platform, 13Patch-For-Review: Backfill commonswiki and enwiki HTML for latest HTML when non-existent in event.mediawiki_page_html_content_change_v1 - https://phabricator.wikimedia.org/T426347#12228361 (10Snwachukwu) I think it's the external... [19:38:09] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10Event-Platform, 13Patch-For-Review: Backfill commonswiki and enwiki HTML for latest HTML when non-existent in event.mediawiki_page_html_content_change_v1 - https://phabricator.wikimedia.org/T426347#12228368 (10Ottomata) https://wikitech.wikimedia.o... [19:39:29] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10Event-Platform, 13Patch-For-Review: Backfill commonswiki and enwiki HTML for latest HTML when non-existent in event.mediawiki_page_html_content_change_v1 - https://phabricator.wikimedia.org/T426347#12228371 (10Ottomata) Actually: https://wikitech.w... [20:09:48] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10DPE-MediaWiki-Incremental-History, 10Event-Platform, 05MW-1.47-notes (1.47.0-wmf.15; 2026-08-11), 13Patch-For-Review: mediawiki.page_change.v1 events - add wikidata id for pages - https://phabricator.wikimedia.org/T428176#12228480 (10Ottomata)...