[03:18:34] 06Data-Engineering, 10Data Pipelines, 10Data-Catalog: Upgrade to Spark 3.2 to support Spark lineage for Iceberg tables - https://phabricator.wikimedia.org/T378899#12219609 (10nshahquinn-wmf) [03:18:36] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 06Data-Platform-SRE, 07Epic, 13Patch-For-Review: Upgrade to Spark 3.5 - https://phabricator.wikimedia.org/T338057#12219610 (10nshahquinn-wmf) [03:19:06] 06Data-Engineering, 10Data Pipelines, 10Data-Catalog: Upgrade to Spark 3.2 to support Spark lineage for Iceberg tables - https://phabricator.wikimedia.org/T378899#12219612 (10nshahquinn-wmf) →14Duplicate dup:03T338057 [03:19:11] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 06Data-Platform-SRE, 07Epic, 13Patch-For-Review: Upgrade to Spark 3.5 - https://phabricator.wikimedia.org/T338057#12219614 (10nshahquinn-wmf) [04:08:33] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): Spark queries of Google Search Console data fail due to Zstandard error - https://phabricator.wikimedia.org/T434625#12219619 (10nshahquinn-wmf) Ah, I see. I think it's okay If we're starting to build things that only work with Spark 3.5 as long as we mak... [04:44:33] 07Analytics-Data-Problem, 06Data-Engineering: Pageview data missing since 2026-08-14: AQS returns 404 and hourly pageviews dumps stopped mid-2026-08-15 - https://phabricator.wikimedia.org/T435038 (10mahmoud) 03NEW p:05Triage→03Medium [07:59:59] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 06Data-Platform-SRE (2026-08-07 - 2026-08-28), 05Metrics-Sprint-2026-2027: Metrics Superset dashboard access for all WMF - https://phabricator.wikimedia.org/T431697#12219924 (10Gehel) Moving to "waiting" as the work is being done by @Milimetric. Ping... [09:55:16] 06Data-Engineering, 06DBA, 07Schema-change-in-production: Drop two columns from transcode table - https://phabricator.wikimedia.org/T435064 (10Ladsgroup) 03NEW [10:01:07] 06Data-Engineering, 06DBA, 07Schema-change-in-production: Drop two columns from transcode table - https://phabricator.wikimedia.org/T435064#12220557 (10Marostegui) p:05Triage→03Medium [10:41:00] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10Event-Platform, 13Patch-For-Review: Relative Trending - Metrics & Monitoring - https://phabricator.wikimedia.org/T431536#12220757 (10JMonton-WMF) [12:10:56] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10Event-Platform: Flink - Test `zstd` compression - https://phabricator.wikimedia.org/T429456#12221225 (10JMonton-WMF) [13:20:01] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10DPE-MediaWiki-Incremental-History: Investigate oversized driver logs for `mediawiki_history_denormalize` - https://phabricator.wikimedia.org/T424358#12221625 (10APizzata-WMF) Here are the result of the most recent execution: ` sudo -u analytics kerb... [13:38:39] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10Event-Platform: Flink - Test `zstd` compression - https://phabricator.wikimedia.org/T429456#12221776 (10JMonton-WMF) Looking at how to enable this, the main blocker for it is Gobblin. Gobblin uses [[ https://gitlab.wikimedia.org/repos/data-engineerin... [13:50:16] 06Data-Engineering, 10Test Kitchen, 06Data-Platform-SRE (2026-08-07 - 2026-08-28): Airflow instance for Experiment Platform - https://phabricator.wikimedia.org/T416709#12221834 (10mpopov) >>! In T416709#11686299, @brouberol wrote: > @mpopov Who should be in the future `airflow-experiment-platform-ops` LDAP g... [14:08:14] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10DPE-MediaWiki-Incremental-History: Investigate oversized driver logs for `mediawiki_history_denormalize` - https://phabricator.wikimedia.org/T424358#12221956 (10xcollazo) Nice investigation, thanks for the fix! [14:08:49] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 06Data-Platform-SRE (2026-08-07 - 2026-08-28), 10Event-Platform, 13Patch-For-Review: Create `webrequest-pageview` K8s application. - https://phabricator.wikimedia.org/T433962#12221959 (10klausman) Above change has been merged, and I rang the admin-... [14:31:09] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10Data-Persistence-Design-Review, 10Event-Platform: [Data Persistence Design Review] Relative trending pages - https://phabricator.wikimedia.org/T432352#12222127 (10Ottomata) > I'm perfectly fine to remove "filtering pages by their trending status" B... [14:52:50] 06Data-Engineering, 06Product-Analytics, 06Data-Platform-SRE (2026-08-07 - 2026-08-28), 13Patch-For-Review: Add cloudflare_radar API connection to Airflow analytics main instance - https://phabricator.wikimedia.org/T433982#12222294 (10LSobanski) [14:55:37] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 06Data-Platform-SRE (2026-08-07 - 2026-08-28), 10Event-Platform: Create `webrequest-pageview` K8s application. - https://phabricator.wikimedia.org/T433962#12222349 (10JMonton-WMF) [15:05:20] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 13Patch-For-Review, 10Test Kitchen (Experiment Platform Sprint 28): Improve app instrument event data data lake management - https://phabricator.wikimedia.org/T434445#12222403 (10Antoine_Quhen) [15:05:50] 06Data-Engineering, 13Patch-For-Review, 10Test Kitchen (Experiment Platform Sprint 28): Improve app instrument event data data lake management - https://phabricator.wikimedia.org/T434445#12222405 (10Antoine_Quhen) [15:07:14] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 13Patch-For-Review, 10Test Kitchen (Experiment Platform Sprint 28): Improve app instrument event data data lake management - https://phabricator.wikimedia.org/T434445#12222421 (10Antoine_Quhen) [15:09:18] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 13Patch-For-Review: Audit and update data pipelines that extract thumbnail requests from webrequest_text - https://phabricator.wikimedia.org/T432735#12222450 (10Snwachukwu) @KCVelaga_WMF I just left a comment. Thanks a lot. [15:12:41] 06Data-Engineering: Classify - https://phabricator.wikimedia.org/T435110 (10GGoncalves-WMF) 03NEW [15:13:05] 06Data-Engineering: Analyze and correctly classify iMessage User-Agent - https://phabricator.wikimedia.org/T435110#12222490 (10GGoncalves-WMF) [15:13:16] 06Data-Engineering: dbt_daily DAG exceeds its SLA - https://phabricator.wikimedia.org/T434307#12222492 (10amastilovic) a:03amastilovic [15:15:49] 06Data-Engineering, 06Data-Engineering-Radar, 07Essential-Work, 10Event-Platform, and 2 others: [EventGate] Add configurable UA denylist - https://phabricator.wikimedia.org/T429898#12222508 (10JVanderhoop-WMF) 05Open→03Resolved [15:30:11] 06Data-Engineering, 06Data-Engineering-Radar, 07Essential-Work, 10Event-Platform, and 2 others: [EventGate] Record metrics for instruments and experiments - https://phabricator.wikimedia.org/T430322#12222584 (10phuedx) [16:29:44] 06Data-Engineering, 06Data-Engineering-Radar, 07Essential-Work, 10Event-Platform, and 2 others: [EventGate] Record metrics for instruments and experiments - https://phabricator.wikimedia.org/T430322#12223001 (10phuedx) [16:49:23] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10Dumps-Generation, 10Wikidata, 06Data-Platform-SRE (2026-08-07 - 2026-08-28): No new wikibase dump downloads being published. - https://phabricator.wikimedia.org/T433240#12223086 (10BTullis) 05Open→03Resolved Yes, I believe that things are... [17:19:16] 06Data-Engineering, 10observability, 10Observability-Metrics, 10Event-Platform: Enable querying operational (prometheus) metrics via the WMF Data Platform - https://phabricator.wikimedia.org/T390328#12223258 (10Ottomata) [17:26:24] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 13Patch-For-Review: [BUGFIX] DbtSkeinOperator doesn't handle list variables properly - https://phabricator.wikimedia.org/T433447#12223338 (10amastilovic) @cchen this issue is now fixed. [18:12:04] 06Data-Engineering, 06Java-Scala-Standardization, 07Essential-Work: Publish all wmf-sparksqlclidriver-*.jar versions to GitLab Package Registry - https://phabricator.wikimedia.org/T435126 (10amastilovic) 03NEW [18:13:38] 06Data-Engineering, 06Java-Scala-Standardization, 07Essential-Work, 13Patch-For-Review: Decouple airflow-dags repository from Archiva - https://phabricator.wikimedia.org/T434160#12223550 (10amastilovic) [21:08:39] 06Data-Engineering, 06Discovery-Search, 06Java-Scala-Standardization, 07Essential-Work: Publish search instance artifact JARs to GitLab Package Registry - https://phabricator.wikimedia.org/T435141 (10amastilovic) 03NEW [21:59:53] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10Commons-Impact-Metrics, 10Commons-Impact-Metrics-Requests: Update Commons Impact Metrics allow-list July 2026 - https://phabricator.wikimedia.org/T433437#12224318 (10GFontenelle_WMF) 05Open→03Resolved [22:44:25] 06Data-Engineering, 10ChangeProp, 10EventStreams, 06MediaWiki-Engineering, and 11 others: Migrate node-based services in production to node22 - https://phabricator.wikimedia.org/T393434#12224387 (10Jdforrester-WMF)