[06:24:24] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10Event-Platform, 13Patch-For-Review: Relative Trending - Milestone 4 - Cassandra - https://phabricator.wikimedia.org/T431555#12200507 (10JMonton-WMF) Tables requested in this ticket: https://phabricator.wikimedia.org/T432352 [06:25:03] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10Event-Platform, 13Patch-For-Review: Relative Trending - Milestone 4 - Cassandra - https://phabricator.wikimedia.org/T431555#12200509 (10JMonton-WMF) [06:51:02] 06Data-Engineering, 06Data-Platform-SRE (2026-08-07 - 2026-08-28): Delete orphan EventLogging topic `eventlogging_HomepageModulet` - https://phabricator.wikimedia.org/T429017#12200565 (10Gehel) [06:51:31] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10Data Pipelines, 06Data-Platform-SRE (2026-08-07 - 2026-08-28), 07Essential-Work: Airflow dynamic task mapping logs mix up when, on rerun, an id is mapped to a different map_index_template - https://phabricator.wikimedia.org/T408802#12200575 (10Geh... [06:51:49] 06Data-Engineering, 10BetaFeatures, 06cloud-services-team, 10Data-Services, and 6 others: Create view for betafeatures_user_counts table in wiki replicas - https://phabricator.wikimedia.org/T402145#12200579 (10Gehel) [06:51:57] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 06Data-Platform-SRE (2026-08-07 - 2026-08-28), 13Patch-For-Review: [Infra] Add a presto query logger - https://phabricator.wikimedia.org/T269832#12200583 (10Gehel) [06:52:17] 06Data-Engineering, 06Data-Platform-SRE (2026-08-07 - 2026-08-28), 07Essential-Work: ERROR AsyncEventQueue: Listener DatahubSparkListener threw an exception - https://phabricator.wikimedia.org/T400207#12200595 (10Gehel) [06:53:04] 06Data-Engineering, 06Data-Engineering-Radar, 06Data-Platform-SRE (2026-08-07 - 2026-08-28), 07Essential-Work: Superset "track job" button leads to broken URL - https://phabricator.wikimedia.org/T410149#12200615 (10Gehel) [06:54:19] 06Data-Engineering, 06Data-Platform-SRE (2026-08-07 - 2026-08-28): Task Tries and Logs for Airflow DAGs sometimes unavailable - https://phabricator.wikimedia.org/T419162#12200649 (10Gehel) [06:57:56] 06Data-Engineering, 06Data-Engineering-Radar, 06Data-Platform-SRE (2026-08-07 - 2026-08-28): hive metastore was down - https://phabricator.wikimedia.org/T432507#12200709 (10Gehel) [06:58:24] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 06Data-Platform-SRE (2026-08-07 - 2026-08-28), 05Metrics-Sprint-2026-2027: Metrics Superset dashboard access for all WMF - https://phabricator.wikimedia.org/T431697#12200723 (10Gehel) [06:58:48] 14Analytics-Radar, 06Data-Engineering, 10Kafka-Infrastructure, 06serviceops-radar, and 4 others: Configuration Management for Kafka settings - https://phabricator.wikimedia.org/T276088#12200725 (10Gehel) [06:59:35] 06Data-Engineering, 10Test Kitchen, 06Data-Platform-SRE (2026-08-07 - 2026-08-28): Airflow instance for Experiment Platform - https://phabricator.wikimedia.org/T416709#12200753 (10Gehel) [06:59:41] 14Data-Engineering (Q4 FS25/26 April 1st - June 30st), 06Data-Platform-SRE (2026-08-07 - 2026-08-28): implement script to move data from P&T data lake to FR Tech data lake - https://phabricator.wikimedia.org/T425133#12200755 (10Gehel) [07:00:39] 06Data-Engineering, 06cloud-services-team, 06Data-Persistence, 10Data-Services, and 4 others: Set up x1 replication to Wiki Replicas - https://phabricator.wikimedia.org/T395881#12200775 (10Gehel) [07:00:58] 06Data-Engineering, 06Data-Engineering-Radar, 06Privacy Engineering, 06Security-Team, and 3 others: Privacy review of x1 tables in preparation of adding them to wikireplicas - https://phabricator.wikimedia.org/T415219#12200784 (10Gehel) [07:01:08] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 06Data-Platform-SRE (2026-08-07 - 2026-08-28), 07Essential-Work: [Infra] Carry out end-user testing of spark on kubernetes - https://phabricator.wikimedia.org/T412925#12200788 (10Gehel) [07:01:46] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 06Data-Platform-SRE (2026-08-07 - 2026-08-28): Optimize enqueueing of refine_webrequest_hourly pipeline - https://phabricator.wikimedia.org/T419050#12200806 (10Gehel) [07:01:53] 06Data-Engineering, 06Data-Engineering-Radar, 06cloud-services-team, 06Data-Persistence, and 4 others: Create wiki replicas views for globaljsonlinks tables - https://phabricator.wikimedia.org/T387419#12200801 (10Gehel) [07:02:03] 06Data-Engineering, 06Data-Platform-SRE (2026-08-07 - 2026-08-28): Enable Ceph S3 locations for Hive Metastore tables - https://phabricator.wikimedia.org/T425673#12200810 (10Gehel) [07:02:41] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 06Wikimedia Enterprise, 10Wikimedia Enterprise - Content Integrity, 06Data-Platform-SRE (2026-08-07 - 2026-08-28), and 2 others: Implement an Airflow operator for moving data from point A to B - https://phabricator.wikimedia.org/T405360#12200820 (10... [07:03:55] 06Data-Engineering: Feature request: Enable dbt jobs to be scheduled hourly - https://phabricator.wikimedia.org/T433509#12200836 (10KCVelaga_WMF) Thanks for enabling this feature, and supporting the transition. We have the first job with hourly schedule: https://airflow.wikimedia.org/dags/dbt_api_requests_hourly... [08:11:07] 06Data-Engineering, 10Test Kitchen, 07Essential-Work, 10Event-Platform: [EventGate] Perform GeoIP lookup at event ingestion time - https://phabricator.wikimedia.org/T434312#12200984 (10phuedx) [08:12:07] 06Data-Engineering, 06Data-Engineering-Radar, 10Test Kitchen, 07Essential-Work, 10Event-Platform: [EventGate] Reject events from inactive instruments and experiments - https://phabricator.wikimedia.org/T430541#12200986 (10phuedx) [08:12:08] 06Data-Engineering, 10Test Kitchen, 07Essential-Work, 10Event-Platform: [EventGate] Perform GeoIP lookup at event ingestion time - https://phabricator.wikimedia.org/T434312#12200985 (10phuedx) [08:13:58] 06Data-Engineering, 10Test Kitchen, 07Essential-Work, 10Event-Platform: [EventGate] Perform GeoIP lookup at event ingestion time - https://phabricator.wikimedia.org/T434312#12200997 (10phuedx) I've made this a parent task of T430541 as we will introduce a module to fetch instrument and experiment configs f... [09:07:39] 06Data-Engineering, 10Data-Platform, 06Data-Platform-SRE, 06Wikimedia Enterprise: Provide auth-less access to Enterprise APIs from WMF Analytics cluster - https://phabricator.wikimedia.org/T403298#12201372 (10awight) My monthly job died halfway through, > {:error, "Refresh tokens limit has been exceeded."}... [11:50:39] 06Data-Engineering: dbt: Jobs with associated data tests do not run the main job - https://phabricator.wikimedia.org/T434516 (10KCVelaga_WMF) 03NEW [11:50:51] 06Data-Engineering: dbt: Jobs with associated data tests do not run the main job - https://phabricator.wikimedia.org/T434516#12202089 (10KCVelaga_WMF) p:05Triage→03High [11:57:12] 06Data-Engineering: dbt: Jobs with associated data tests do not run the main job - https://phabricator.wikimedia.org/T434516#12202096 (10KCVelaga_WMF) [13:05:18] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10DPE-MediaWiki-Incremental-History, 10Event-Platform: Incremental MWH - MediaWiki event data source improvements - https://phabricator.wikimedia.org/T423935#12202457 (10Ottomata) [13:12:52] 06Data-Engineering, 10Test Kitchen, 07Essential-Work, 10Event-Platform: [EventGate] Perform GeoIP lookup at event ingestion time - https://phabricator.wikimedia.org/T434312#12202567 (10phuedx) [13:15:39] 06Data-Engineering, 10Test Kitchen, 07Essential-Work, 10Event-Platform: [EventGate] Perform GeoIP lookup at event ingestion time - https://phabricator.wikimedia.org/T434312#12202581 (10phuedx) [13:19:39] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 06cloud-services-team, 10Cloud-VPS (Debian Bullseye Deprecation), 10Event-Platform: Upgrade (replace) beta|deployment-prep event platform VPS instances - https://phabricator.wikimedia.org/T429497#12202616 (10Ottomata) > eventstreams beta (at https:... [13:27:08] 06Data-Engineering: dbt: Jobs with associated data tests do not run the main job - https://phabricator.wikimedia.org/T434516#12202678 (10GGoncalves-WMF) [13:27:09] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): dbt data tests validate production data - https://phabricator.wikimedia.org/T430786#12202679 (10GGoncalves-WMF) [14:15:24] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10Event-Platform, 13Patch-For-Review: Relative Trending - Milestone 4 - Cassandra - https://phabricator.wikimedia.org/T431555#12203199 (10JMonton-WMF) Ticket requesting Cassandra tables: https://phabricator.wikimedia.org/T432352 [14:34:03] 06Data-Engineering, 10DPE-MediaWiki-Incremental-History, 10Event-Platform: Create mediawiki.revision_change event stream ... maybe? - https://phabricator.wikimedia.org/T434237#12203285 (10Ottomata) [14:43:54] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): dbt: Jobs with associated data tests do not run the main job - https://phabricator.wikimedia.org/T434516#12203335 (10amastilovic) a:03amastilovic [14:44:24] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): dbt: Jobs with associated data tests do not run the main job - https://phabricator.wikimedia.org/T434516#12203338 (10amastilovic) Confirmed that this is a bug - the RUN operator is actually running the TEST command. Working on a fix. [14:55:55] 06Data-Engineering, 10Test Kitchen, 07Essential-Work, 10Event-Platform: [EventGate] Perform GeoIP lookup at event ingestion time - https://phabricator.wikimedia.org/T434312#12203450 (10phuedx) [15:19:44] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): Dbt backfill: editor_month and base_account_registration - https://phabricator.wikimedia.org/T430602#12203611 (10Ahoelzl) [15:20:06] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): Ops Week: Increase wait time of webrequest_actor_metrics_hourly sensor task before it fails - https://phabricator.wikimedia.org/T430247#12203612 (10Ahoelzl) a:03Ahoelzl [15:21:20] 06Data-Engineering: Make cusi_user and cusi_case table information available in the data lake - https://phabricator.wikimedia.org/T429703#12203626 (10Ahoelzl) [15:22:34] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): Update Blunderbuss wikitech documentation - https://phabricator.wikimedia.org/T402290#12203633 (10Ahoelzl) [15:22:48] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 07Essential-Work: Blunderbuss: Move Hadoop/HDFS XML configuration into Helm deployment chart - https://phabricator.wikimedia.org/T402323#12203637 (10Ahoelzl) [15:23:12] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): Do not set WMF-Last-Access cookie when Sec-Fetch-Dest is not 'document' - https://phabricator.wikimedia.org/T403897#12203640 (10Ahoelzl) a:05Ottomata→03Ahoelzl [15:26:01] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10Event-Platform, 13Patch-For-Review: Backfill commonswiki and enwiki HTML for latest HTML when non-existent in event.mediawiki_page_html_content_change_v1 - https://phabricator.wikimedia.org/T426347#12203664 (10Snwachukwu) Okay, we have data for enw... [15:28:11] 06Data-Engineering, 07Essential-Work: Refine generates very large XCOM values - https://phabricator.wikimedia.org/T414953#12203667 (10Ahoelzl) a:05Antoine_Quhen→03None [15:28:34] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 07OKR-Work (WE1 FY2025-26): [Spike] Adding access_method metadata to moderator action event streams - https://phabricator.wikimedia.org/T419019#12203670 (10Ahoelzl) [15:28:51] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): Create a custom DBT materialization macro - https://phabricator.wikimedia.org/T419310#12203673 (10Ahoelzl) [15:29:07] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 13Patch-For-Review: Improve the quality of Sqoop error logging - https://phabricator.wikimedia.org/T422412#12203676 (10Ahoelzl) [15:29:20] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): Add support for multiple teams email alerts on Airflow DBT DAG failures - https://phabricator.wikimedia.org/T429166#12203678 (10Ahoelzl) [15:32:32] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10MediaWiki-extensions-Wikibase-Client, 10Wikidata: Move the wbc_entity_usage table onto a dedicated DB shard - https://phabricator.wikimedia.org/T176273#12203702 (10Ahoelzl) [15:35:09] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 07Epic: Provide configurable, scheduled data platform data import / export capabilities - https://phabricator.wikimedia.org/T428511#12203712 (10Ahoelzl) [15:35:21] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 06Wikimedia Enterprise: WME Pageviews DAG for HDFS to S3 Transfer - https://phabricator.wikimedia.org/T426017#12203714 (10Ahoelzl) [15:35:30] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 06Data-Platform-SRE (2026-08-07 - 2026-08-28): implement script to move data from P&T data lake to FR Tech data lake - https://phabricator.wikimedia.org/T425133#12203715 (10Ahoelzl) [15:36:08] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): [Refine Simplification] Remove Schema Merging in Refine Process by Enforcing Backward Compatibility - https://phabricator.wikimedia.org/T381072#12203716 (10Ahoelzl) a:05Antoine_Quhen→03Ahoelzl [15:36:29] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10DPE-Mediawiki-Content: Bug: fix page_id for redirect_page_link - https://phabricator.wikimedia.org/T429457#12203718 (10Ahoelzl) [15:37:18] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): Delete `wmf_raw.mediawiki_content` table after a few months - https://phabricator.wikimedia.org/T427441#12203729 (10Ahoelzl) [15:37:29] 14Data-Engineering (Q4 FS25/26 April 1st - June 30st): Secret management on airflow for the automated transfer of (public) datasets from stats infra --> WME AWS - https://phabricator.wikimedia.org/T415208#12203730 (10Snwachukwu) @Htriedman thanks for the response. Closing the ticket. [15:38:07] 14Data-Engineering (Q4 FS25/26 April 1st - June 30st): Secret management on airflow for the automated transfer of (public) datasets from stats infra --> WME AWS - https://phabricator.wikimedia.org/T415208#12203731 (10Snwachukwu) 05Open→03Invalid [15:38:18] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 07Epic: Attribution Research: Instrument Donation Attempts - https://phabricator.wikimedia.org/T419569#12203732 (10Ahoelzl) [15:38:27] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): haproxykafka and varnishkafka sent different uri_paths - https://phabricator.wikimedia.org/T418767#12203733 (10Ahoelzl) [15:38:41] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 07Epic: Attribution Research: Instrument pageviews - https://phabricator.wikimedia.org/T417050#12203734 (10Ahoelzl) [15:38:42] 14Data-Engineering (Q4 FS25/26 April 1st - June 30st): Move_to_archive task fails without logs - https://phabricator.wikimedia.org/T430248#12203735 (10Snwachukwu) a:03Snwachukwu [15:38:59] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 06Product Safety and Integrity, 06Product-Analytics (Kanban): Add mediawiki_product_metrics_incident_reporting_system_interaction to the sanitization allowlist - https://phabricator.wikimedia.org/T384650#12203736 (10Ahoelzl) [15:39:22] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 13Patch-For-Review: Sqoop globalimagelinks and filerevision - https://phabricator.wikimedia.org/T427532#12203739 (10Ahoelzl) a:05dr0ptp4kt→03Ahoelzl [15:39:45] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10Wikidata, 10WMDE Analytics: WMF Data Engineering Request: Additional Columns to Geoeditors Tables - https://phabricator.wikimedia.org/T428888#12203754 (10Ahoelzl) [15:45:15] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): Move_to_archive task fails without logs - https://phabricator.wikimedia.org/T430248#12203784 (10Snwachukwu) [15:48:05] 06Data-Engineering, 10Event-Platform: Edit type enrichment: Add timeout - https://phabricator.wikimedia.org/T424547#12203798 (10AKhatun_WMF) [15:49:08] 06Data-Engineering, 10Event-Platform: Edit type enrichment: Add timeout - https://phabricator.wikimedia.org/T424547#12203805 (10AKhatun_WMF) a:05AKhatun_WMF→03None [16:20:33] 06Data-Engineering, 10Test Kitchen, 07Essential-Work, 10Event-Platform: [EventGate] Perform GeoIP lookup at event ingestion time - https://phabricator.wikimedia.org/T434312#12203980 (10JVanderhoop-WMF) p:05Triage→03Medium [16:42:06] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 07Epic: Attribution Research: Instrument pageviews - https://phabricator.wikimedia.org/T417050#12204140 (10Ahoelzl) 05Open→03Resolved [17:03:38] 06Data-Engineering, 06Data-Engineering-Icebox: Create a data product of IP range to owner/provenance label - https://phabricator.wikimedia.org/T418466#12204287 (10GGoncalves-WMF) [17:55:44] 06Data-Engineering, 06Data-Engineering-Radar, 06Privacy Engineering, 06Security-Team, and 4 others: Privacy review of x1 tables in preparation of adding them to wikireplicas - https://phabricator.wikimedia.org/T415219#12204526 (10Ladsgroup) Hi, Let me know if I can help on anything to move this forward. [17:55:59] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): dbt: Jobs with associated data tests do not run the main job - https://phabricator.wikimedia.org/T434516#12204531 (10amastilovic) This has now been fixed, I'm re-running the missing jobs. [18:12:40] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10Test Kitchen, 07Essential-Work: Improve web instrument event data data lake management - https://phabricator.wikimedia.org/T429385#12204643 (10mpopov) Just a heads-up that the proposed `instrument_name`-based partitioning scheme will require Spark... [18:13:27] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): Add automated test run config option to dbt scheduler YAML - https://phabricator.wikimedia.org/T434000#12204647 (10amastilovic) Completed. [18:14:00] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 13Patch-For-Review: Reinforce Blunderbuss to better respond to source server outages - https://phabricator.wikimedia.org/T434344#12204651 (10amastilovic) Completed. [18:19:33] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10DPE-MediaWiki-Incremental-History, 10Event-Platform, 05MW-1.47-notes (1.47.0-wmf.15; 2026-08-11): mediawiki.page_change.v1 events - add wikidata id for pages - https://phabricator.wikimedia.org/T428176#12204694 (10Ottomata) This is live on testwi... [19:10:15] 06Data-Engineering, 10MediaWiki-extensions-PageAssessments, 07Wikimedia-production-error: PHP Warning: Failed to JSON encode wgPageAssessments: Malformed UTF-8 characters, possibly incorrectly encoded - https://phabricator.wikimedia.org/T434061#12205085 (10brennen) [19:12:27] 06Data-Engineering, 10MediaWiki-extensions-PageAssessments, 07Wikimedia-production-error: PHP Warning: Failed to JSON encode wgPageAssessments: Malformed UTF-8 characters, possibly incorrectly encoded - https://phabricator.wikimedia.org/T434061#12205093 (10brennen) This is currently producing the highest vol... [20:36:08] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10Event-Platform, 13Patch-For-Review: Backfill commonswiki and enwiki HTML for latest HTML when non-existent in event.mediawiki_page_html_content_change_v1 - https://phabricator.wikimedia.org/T426347#12205432 (10Isaac) @Snwachukwu I had been doing my... [22:10:01] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 06Data-Platform-SRE, 07Epic, 13Patch-For-Review: Upgrade Spark to a version with long term Iceberg support - https://phabricator.wikimedia.org/T338057#12205852 (10Ahoelzl) a:03Ahoelzl