[01:49:57] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 13Patch-For-Review: Implement alerts and create runbooks - https://phabricator.wikimedia.org/T438384#12377595 (10AKhatun_WMF) Adding duplicate alerts for now. Will remove if you say so after discussion. CR: https://gerrit.wikimedia.org/r/c/operations/a... [02:31:22] 06Data-Engineering: Migrate etl producing wmf_readership.google_sitedata_daily_aggregate to dbt - https://phabricator.wikimedia.org/T439364#12377612 (10nshahquinn-wmf) @Ahoelzl pointed out that doing the ETL in Airflow makes it easy to trigger re-runs when there's a data correction, and that would probably be mu... [06:37:17] 06Data-Engineering, 06DBA, 07Schema-change-in-production: Apply ppv_package, pfn_name patches in production - https://phabricator.wikimedia.org/T439661 (10tstarling) 03NEW [08:33:12] 06Data-Engineering, 06MediaWiki-Media-Platform-Team, 06ServiceOps, 07Datacenter-Switchover, and 2 others: DC Switchover - MW requests to EventGate cause long queuing waiting time - https://phabricator.wikimedia.org/T439552#12378159 (10MLechvien-WMF) Thanks Andrew for updating Service Catalog. Do we consi... [08:43:41] (03CR) 10Joal: Add the mediawiki_private_actor_weekly table. It stores each weekly snapshot in a day partition under tables/weekly. (031 comment) [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1343956 (https://phabricator.wikimedia.org/T437961) (owner: 10A-pizzata) [09:40:04] (03PS2) 10A-pizzata: Add the mediawiki_private_actor_weekly table. It stores each weekly snapshot in a day partition under tables/weekly. [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1343956 (https://phabricator.wikimedia.org/T437961) [09:41:54] (03PS3) 10A-pizzata: Add weekly change_tag raw table creation HQL [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1345215 (https://phabricator.wikimedia.org/T437961) (owner: 10Aqu) [10:01:00] 06Data-Engineering: Implement default expiration for staging and intermediate dbt models - https://phabricator.wikimedia.org/T439690 (10GGoncalves-WMF) 03NEW [10:14:11] 06Data-Engineering: Apply Iceberg table maintenance to all dbt marts - https://phabricator.wikimedia.org/T439692 (10GGoncalves-WMF) 03NEW [10:17:24] 06Data-Engineering: Implement default expiration for staging and intermediate dbt models - https://phabricator.wikimedia.org/T439690#12378661 (10GGoncalves-WMF) [10:18:27] 10Data-Engineering-Roadmap, 07Epic: Epic: dbt Backlog - https://phabricator.wikimedia.org/T437619#12378663 (10GGoncalves-WMF) [10:18:28] 06Data-Engineering: Apply Iceberg table maintenance to all dbt marts - https://phabricator.wikimedia.org/T439692#12378662 (10GGoncalves-WMF) [10:18:33] 06Data-Engineering: Implement default expiration for staging and intermediate dbt models - https://phabricator.wikimedia.org/T439690#12378664 (10GGoncalves-WMF) [10:18:35] 10Data-Engineering-Roadmap, 07Epic: Epic: dbt Backlog - https://phabricator.wikimedia.org/T437619#12378665 (10GGoncalves-WMF) [10:21:35] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): dbt standardized workflow and repository structure - https://phabricator.wikimedia.org/T430622#12378676 (10GGoncalves-WMF) 05Resolved→03Open I think this is still missing the last part of the acceptance criteria, which we're pursuing next: > DE migr... [12:32:15] (03CR) 10Joal: [C:03+1] "LGTM!" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1343956 (https://phabricator.wikimedia.org/T437961) (owner: 10A-pizzata) [12:32:47] (03CR) 10Joal: [C:03+1] "LGTM!" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1345215 (https://phabricator.wikimedia.org/T437961) (owner: 10Aqu) [12:36:06] 06Data-Engineering, 10Event-Platform: [EventBus] Time EventGate requests - https://phabricator.wikimedia.org/T439714 (10phuedx) 03NEW [12:36:16] 06Data-Engineering, 10Event-Platform: [EventBus] Time EventGate requests - https://phabricator.wikimedia.org/T439714#12379236 (10phuedx) [12:36:21] 06Data-Engineering, 06MediaWiki-Media-Platform-Team, 06ServiceOps, 07Datacenter-Switchover, and 2 others: DC Switchover - MW requests to EventGate cause long queuing waiting time - https://phabricator.wikimedia.org/T439552#12379235 (10phuedx) [13:04:12] (03CR) 10A-pizzata: [V:03+2 C:03+2] Add the mediawiki_private_actor_weekly table. It stores each weekly snapshot in a day partition under tables/weekly. (031 comment) [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1343956 (https://phabricator.wikimedia.org/T437961) (owner: 10A-pizzata) [13:07:06] (03CR) 10A-pizzata: [C:03+2] Add weekly change_tag raw table creation HQL [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1345215 (https://phabricator.wikimedia.org/T437961) (owner: 10Aqu) [13:07:09] (03CR) 10A-pizzata: [V:03+2 C:03+2] Add weekly change_tag raw table creation HQL [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1345215 (https://phabricator.wikimedia.org/T437961) (owner: 10Aqu) [13:23:16] btullis, brouberol: by any chance is at least one of you two be able to join the WMCS ingress logs meeting in ~37 minutes? [/me just checking that we have quorum from all teams involved] [13:31:57] 06Data-Engineering, 10Event-Platform: [EventBus] Time EventGate requests - https://phabricator.wikimedia.org/T439714#12379605 (10Ottomata) Nice! Good idea. I wonder, `EventBus::send` is calling out to [[ https://github.com/wikimedia/mediawiki/blob/master/includes/libs/Http/MultiHttpClient.php | MultiHttpClie... [13:42:19] 06Data-Engineering: Apply Iceberg table maintenance to all dbt marts - https://phabricator.wikimedia.org/T439692#12379679 (10xcollazo) >We could require that marts be declared in datasets.yaml, but a more robust solution is probably to write some automation that detects every Iceberg table within our main produc... [14:21:15] 06Data-Engineering: MediaWiki Content File Exports: Consider storing the exports in Ceph instead of HDFS - https://phabricator.wikimedia.org/T439733 (10xcollazo) 03NEW [14:21:54] 06Data-Engineering: MediaWiki Content File Exports: Consider storing the exports in Ceph instead of HDFS - https://phabricator.wikimedia.org/T439733#12380030 (10xcollazo) [14:21:56] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 07Epic: XML Dumps v1 sunset - https://phabricator.wikimedia.org/T437518#12380031 (10xcollazo) [14:22:18] 06Data-Engineering: File Exports: Consider storing the exports in Ceph instead of HDFS - https://phabricator.wikimedia.org/T439733#12380032 (10xcollazo) [14:24:26] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 13Patch-For-Review: Include v2 dumps into mirrors rsync configuration - https://phabricator.wikimedia.org/T437463#12380050 (10xcollazo) **Update: v2 retention** Product approved the cutoff rule, the cutoff date 2026-11-01, and a longer v2 retention in... [14:44:26] 06Data-Engineering: File Exports: Consider storing the exports in Ceph instead of HDFS - https://phabricator.wikimedia.org/T439733#12380157 (10xcollazo) Here is a good Ceph use case. Let's get this to prod! CC @BTullis and @JAllemandou. [14:49:28] 06Data-Engineering: File Exports: Consider storing the exports in Ceph instead of HDFS - https://phabricator.wikimedia.org/T439733#12380184 (10JAllemandou) I like that! We could even think of an API layer to dowload the files directly from CephS3, bypassing the copy altogether (but this is very much scope creep :) [15:35:59] 06Data-Engineering, 06SRE, 10SRE-Access-Requests, 13Patch-For-Review: Grant access to analytics-privatedata-users for Eniroomand-WMF - https://phabricator.wikimedia.org/T439644#12380514 (10ayounsi) @eniroomand Please familiarize yourself with https://wikitech.wikimedia.org/wiki/Data_Platform/Data_access#Us... [16:06:27] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 13Patch-For-Review: User and team Hive database cleanup tracking for Sept 2026 - https://phabricator.wikimedia.org/T437733#12380684 (10APizzata-WMF) >>! In T437733#12364685, @xcollazo wrote: > @APizzata-WMF thanks for taking care of `/user/hive/warehou... [16:14:18] 06Data-Engineering: File Exports: Consider storing the exports in Ceph instead of HDFS - https://phabricator.wikimedia.org/T439733#12380760 (10BTullis) Just a point of note: > We should find out whether the Ceph cluster with the S3 gateway (`role::cephadm::rgw`) is a better place for them. The `role::cephadm::r... [16:15:26] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 13Patch-For-Review: Implement ArticleFeatureCounts Application - https://phabricator.wikimedia.org/T437000#12380783 (10Ottomata) Hm, @AKhatun_WMF I think there may be some differences in feature key names between [[ https://gitlab.wikimedia.org/repos/d... [16:31:42] 06Data-Engineering, 06Data-Engineering-Radar, 06MediaWiki-Media-Platform-Team, 06ServiceOps, and 3 others: DC Switchover - MW requests to EventGate cause long queuing waiting time - https://phabricator.wikimedia.org/T439552#12380919 (10Ottomata) [16:36:36] 06Data-Engineering, 10Event-Platform: [EventBus] Time EventGate requests - https://phabricator.wikimedia.org/T439714#12380974 (10GGoncalves-WMF) This will probably become a part of an upcoming Event Gate SLO, though we're unlikely to pursue this in Q2. [16:37:10] 06Data-Engineering, 06Data-Engineering-Radar, 06SRE, 10SRE-Access-Requests, 13Patch-For-Review: Grant access to analytics-privatedata-users for Eniroomand-WMF - https://phabricator.wikimedia.org/T439644#12380977 (10GGoncalves-WMF) [16:37:45] 06Data-Engineering: Apply Iceberg table maintenance to all dbt marts - https://phabricator.wikimedia.org/T439692#12380981 (10GGoncalves-WMF) a:03amastilovic [16:37:59] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): Apply Iceberg table maintenance to all dbt marts - https://phabricator.wikimedia.org/T439692#12380983 (10GGoncalves-WMF) [16:38:21] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): Implement default expiration for staging and intermediate dbt models - https://phabricator.wikimedia.org/T439690#12380985 (10GGoncalves-WMF) [16:38:54] 06Data-Engineering, 06Data-Engineering-Radar, 06DBA, 07Schema-change-in-production: Apply ppv_package, pfn_name patches in production - https://phabricator.wikimedia.org/T439661#12381000 (10GGoncalves-WMF) [16:39:57] 06Data-Engineering, 06Data-Engineering-Radar, 10Wmfdata-Python, 06Movement-Insights (FY26-27 H1): Release Wmfdata 3.0 - https://phabricator.wikimedia.org/T439613#12381002 (10GGoncalves-WMF) [16:42:50] 06Data-Engineering, 07Epic: EPIC: DYK Archive - https://phabricator.wikimedia.org/T430319#12381014 (10Ahoelzl) a:05Snwachukwu→03None [16:43:08] 06Data-Engineering, 07Epic: DYK Archive: Write Design Doc - https://phabricator.wikimedia.org/T431102#12381017 (10Ahoelzl) a:05Snwachukwu→03None [16:43:19] 06Data-Engineering, 07Epic: DYK Archive Backfill — Fetch Raw Archive Pages for all wikis - https://phabricator.wikimedia.org/T431103#12381019 (10Ahoelzl) a:05Snwachukwu→03None [16:43:21] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): article feature counts SLO setup - https://phabricator.wikimedia.org/T439066#12381021 (10GGoncalves-WMF) [16:43:25] 06Data-Engineering, 07Epic: [DYK Archive] Enrichment resolve & enrich linked pages - https://phabricator.wikimedia.org/T433984#12381023 (10Ahoelzl) a:05Snwachukwu→03None [16:43:29] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): Create article feature counts dashboard - https://phabricator.wikimedia.org/T439065#12381027 (10GGoncalves-WMF) [16:45:07] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10Commons-Impact-Metrics, 10Commons-Impact-Metrics-Requests: Update Commons Impact Metrics allow-list for September 2026 - https://phabricator.wikimedia.org/T439050#12381037 (10GGoncalves-WMF) [16:46:25] 06Data-Engineering, 06Data-Engineering-Radar, 06SRE, 10SRE-Access-Requests, 13Patch-For-Review: Grant access to analytics-privatedata-users for Eniroomand-WMF - https://phabricator.wikimedia.org/T439644#12381050 (10eniroomand) @ayounsi I confirm that I have read the guidelines on the responsibilities for... [16:49:59] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10Data-Platform, 10EditCheck, 10VisualEditor, and 3 others: Implement sampling requirements for Headless VE technical pilot - https://phabricator.wikimedia.org/T433024#12381075 (10DLynch) [16:50:02] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): Migrate etl producing wmf_readership.google_sitedata_daily_aggregate to dbt - https://phabricator.wikimedia.org/T439364#12381076 (10Ahoelzl) p:05Triage→03Medium a:03Antoine_Quhen [16:51:31] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): Apply Iceberg table maintenance to all dbt marts - https://phabricator.wikimedia.org/T439692#12381110 (10amastilovic) # Automated retention pruning for dbt staging/intermediate Iceberg tables ## Summary Add a new daily Airflow DAG that automatically di... [16:54:50] 06Data-Engineering, 10Data-release: Wikipedia Clickstream dataset. Programmatic Access - https://phabricator.wikimedia.org/T134231#12381144 (10Ottomata) @Soda, just checking, are you aware of the [[ https://dumps.wikimedia.org/other/clickstream/readme.html | clickstream dumps ]] that the toolforge tool is buil... [16:58:02] 07Analytics-Data-Problem, 06Data-Engineering, 06Data-Engineering-Radar, 06Wikimedia Enterprise, 13Patch-For-Review: Netherlands (NL) absent from country_project_page flat files since 2023-11-09 - https://phabricator.wikimedia.org/T426559#12381153 (10GGoncalves-WMF) [16:58:03] 06Data-Engineering, 06Data-Engineering-Radar, 10Datasets-General-or-Unknown, 06Wikimedia Enterprise: Missing DP files 2022-10-19.tsv, 2020-07-19.tsv, 2020-07-20.tsv - https://phabricator.wikimedia.org/T381057#12381155 (10GGoncalves-WMF) [17:04:03] 14Analytics, 07Analytics-Data-Problem, 06Data-Engineering, 10Data-Engineering-Wikistats: Wiki Stats: Problem Detecting (unique) Desktop Devices since August 2025? - https://phabricator.wikimedia.org/T425359#12381174 (10GGoncalves-WMF) This pattern seems to [[ https://stats.wikimedia.org/#/de.wikipedia.org/... [17:11:27] 06Data-Engineering: File Exports: Consider storing the exports in Ceph instead of HDFS - https://phabricator.wikimedia.org/T439733#12381202 (10xcollazo) >The role::cephadm::rgw is not the DPE Ceph cluster. > This refers to the apus cluster that is operated by Data Persistence. Please excuse the AI slop. I shoul... [17:11:50] (03CR) 10Zabe: [C:03+1] "@Joal I do not have +2 for this repo. Could you get this merged / someone to merge it?" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1345865 (https://phabricator.wikimedia.org/T422443) (owner: 10Joal) [17:12:05] 06Data-Engineering: File Exports: Consider storing the exports in Ceph instead of HDFS - https://phabricator.wikimedia.org/T439733#12381215 (10xcollazo) [17:20:34] 06Data-Engineering, 10Data-release: Wikipedia Clickstream dataset. Programmatic Access - https://phabricator.wikimedia.org/T134231#12381299 (10Isaac) > You could try ingesting it differently and building a different tool that is more efficient? @Soda should correct me if I'm wrong, but I don't think it's about... [17:26:06] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10Data-Platform, 10EditCheck, 10VisualEditor, and 3 others: Implement sampling requirements for Headless VE technical pilot - https://phabricator.wikimedia.org/T433024#12381352 (10ppelberg) a:05jhathaway→03DLynch [18:01:05] 06Data-Engineering: File Exports: Read one frozen Iceberg snapshot for each export run - https://phabricator.wikimedia.org/T439759 (10xcollazo) 03NEW [18:01:13] 06Data-Engineering: File Exports: Read one frozen Iceberg snapshot for each export run - https://phabricator.wikimedia.org/T439759#12381554 (10xcollazo) [18:01:17] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 07Epic: XML Dumps v1 sunset - https://phabricator.wikimedia.org/T437518#12381555 (10xcollazo) [18:23:41] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 06Product-Analytics: Dbt-jobs backfill: structured_edits_weekly - https://phabricator.wikimedia.org/T438196#12381613 (10MNeisler) 05Open→03Resolved Thank you @amastilovic. Everything looks good. [18:57:54] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 13Patch-For-Review: Include v2 dumps into mirrors rsync configuration - https://phabricator.wikimedia.org/T437463#12381727 (10xcollazo) **Update: v2 retention, second approach** After the review of the 170-day change (now abandoned), the extra v2 runs... [19:18:20] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 13Patch-For-Review: Implement ArticleFeatureCounts Application - https://phabricator.wikimedia.org/T437000#12381804 (10Ottomata) Another ask! We should add render_id and render_dt info from the html the lambda is fetching. Return `render_id` from x-m... [19:36:01] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 13Patch-For-Review: Implement ArticleFeatureCounts Application - https://phabricator.wikimedia.org/T437000#12381883 (10AKhatun_WMF) Ooohh yes. render_id! Doing that. Also apologies for the schema mismatch! [19:53:28] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 13Patch-For-Review: Implement ArticleFeatureCounts Application - https://phabricator.wikimedia.org/T437000#12381984 (10Ottomata) > schema mismatch Actually, I don't know which is better. I guess since we already have the delta counts published we shou... [20:00:42] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 13Patch-For-Review: Implement ArticleFeatureCounts Application - https://phabricator.wikimedia.org/T437000#12382076 (10AKhatun_WMF) Thats right. Better to match with delta counts. Not huge differences IMO. [20:22:20] 06Data-Engineering, 06Data-Engineering-Radar, 10EventStreams, 06Security-Team, and 3 others: CVE-2026-100241: Private change tags exposed to anonymous users via public EventStreams - https://phabricator.wikimedia.org/T432948#12382248 (10sbassett) p:05Triage→03Medium