[06:43:43] (03CR) 10Joal: [C:03+1] "LGTM!" [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1342767 (https://phabricator.wikimedia.org/T425668) (owner: 10Mforns) [07:18:20] (03CR) 10Joal: [C:03+1] "LGTM!" [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1342809 (https://phabricator.wikimedia.org/T438244) (owner: 10Xcollazo) [07:58:39] 06Data-Engineering, 06Data-Platform-SRE (2026-08-28 - 2026-09-18): Enable STS and IAM on the codfw RADOS Gateway and register the OIDC identity providers - https://phabricator.wikimedia.org/T435590#12336695 (10BTullis) [09:03:38] 06Data-Engineering, 10Event-Platform: Event tool error about CSRF-token when sending an after-event message to participants - https://phabricator.wikimedia.org/T438450#12336943 (10Ciell) [09:32:30] (03CR) 10Joal: [V:03+2 C:03+2] "Merging for later deploy" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1341858 (https://phabricator.wikimedia.org/T437883) (owner: 10Joal) [09:33:09] (03CR) 10Joal: [V:03+2 C:03+2] "Merging for later dpeloy" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1341859 (https://phabricator.wikimedia.org/T438021) (owner: 10Joal) [09:59:16] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10Event-Platform, 13Patch-For-Review: Relative Trending - Milestone 4 - Storage - https://phabricator.wikimedia.org/T431555#12337152 (10JMonton-WMF) The extension has been merged and deployed in Beta, it's working there and it will be deployed to pro... [10:00:40] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10Data-Persistence-Design-Review, 10Event-Platform, 05MW-1.47-notes (1.47.0-wmf.21; 2026-09-22): [Data Persistence Design Review] Relative trending pages - https://phabricator.wikimedia.org/T432352#12337155 (10JMonton-WMF) The patch has been merged... [10:11:18] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10Event-Platform: Relative Trending - Adjust K8s resources in Production. - https://phabricator.wikimedia.org/T438460 (10JMonton-WMF) 03NEW [12:26:50] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): Implement ArticleFeatureCounts Application - https://phabricator.wikimedia.org/T437000#12337604 (10AKhatun_WMF) [13:16:32] 06Data-Engineering, 06Data-Platform-SRE (2026-09-18 - 2026-10-09): Delete orphan EventLogging topic `eventlogging_HomepageModulet` - https://phabricator.wikimedia.org/T429017#12337875 (10Gehel) [13:17:05] 06Data-Engineering, 06Data-Platform-SRE (2026-09-18 - 2026-10-09), 07Essential-Work, 13Patch-For-Review: [Infra] Add a presto query logger - https://phabricator.wikimedia.org/T269832#12337885 (10Gehel) [13:18:28] 06Data-Engineering, 06Data-Platform-SRE (2026-09-18 - 2026-10-09), 07Essential-Work: ERROR AsyncEventQueue: Listener DatahubSparkListener threw an exception - https://phabricator.wikimedia.org/T400207#12337919 (10Gehel) [13:18:34] 06Data-Engineering, 10BetaFeatures, 06cloud-services-team, 10Data-Services, and 6 others: Create view for betafeatures_user_counts table in wiki replicas - https://phabricator.wikimedia.org/T402145#12337911 (10Gehel) [13:19:09] 06Data-Engineering, 06Data-Engineering-Radar, 06Data-Platform-SRE (2026-09-18 - 2026-10-09), 07Essential-Work: Superset "track job" button leads to broken URL - https://phabricator.wikimedia.org/T410149#12337935 (10Gehel) [13:20:26] 06Data-Engineering, 06Data-Platform-SRE (2026-09-18 - 2026-10-09): Task Tries and Logs for Airflow DAGs sometimes unavailable - https://phabricator.wikimedia.org/T419162#12337975 (10Gehel) [13:20:33] 06Data-Engineering, 06Data-Engineering-Radar, 06Data-Platform-SRE (2026-09-18 - 2026-10-09), 10Event-Platform: Enable kubernetes.operator.savepoint.dispose-on-delete by default - https://phabricator.wikimedia.org/T432455#12337977 (10Gehel) [13:21:20] 06Data-Engineering, 06Data-Platform-SRE (2026-09-18 - 2026-10-09): Enable STS and IAM on the codfw RADOS Gateway and register the OIDC identity providers - https://phabricator.wikimedia.org/T435590#12337993 (10Gehel) [13:22:53] 06Data-Engineering, 06Data-Platform-SRE (2026-09-18 - 2026-10-09), 07Essential-Work: Allow unauthenticated access to the dse-k8s OIDC discovery and JWKS endpoints - https://phabricator.wikimedia.org/T435591#12338021 (10Gehel) [13:22:59] 06Data-Engineering, 06Data-Platform-SRE (2026-09-18 - 2026-10-09), 07Essential-Work: [Tech evaluation] Table catalog options for the S3 data lake - https://phabricator.wikimedia.org/T435604#12338022 (10Gehel) [13:25:41] 06Data-Engineering, 06Data-Engineering-Radar, 06Data-Platform-SRE (2026-09-18 - 2026-10-09), 07Essential-Work: Implement brownout logic for dumps v1 on dumps web interface - https://phabricator.wikimedia.org/T437461#12338069 (10Gehel) [13:26:06] 14Analytics-Radar, 06Data-Engineering, 10Kafka-Infrastructure, 06serviceops-radar, and 5 others: Configuration Management for Kafka settings - https://phabricator.wikimedia.org/T276088#12338073 (10Gehel) [13:28:23] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 06Data-Platform-SRE (2026-09-18 - 2026-10-09), 07Essential-Work, 05Metrics-Sprint-2026-2027: Metrics Superset dashboard access for all WMF - https://phabricator.wikimedia.org/T431697#12338132 (10Gehel) [13:29:10] 06Data-Engineering, 06cloud-services-team, 06Data-Persistence, 10Data-Services, and 4 others: Set up x1 replication to Wiki Replicas - https://phabricator.wikimedia.org/T395881#12338154 (10Gehel) [13:29:20] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 06Wikimedia Enterprise, 10Wikimedia Enterprise - Content Integrity, 06Data-Platform-SRE (2026-09-18 - 2026-10-09), and 2 others: Implement an Airflow operator for moving data from point A to B - https://phabricator.wikimedia.org/T405360#12338156 (10... [13:29:26] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 06Data-Platform-SRE (2026-09-18 - 2026-10-09), 07Essential-Work: [Infra] Carry out end-user testing of spark on kubernetes - https://phabricator.wikimedia.org/T412925#12338158 (10Gehel) [13:29:50] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 06Data-Platform-SRE (2026-09-18 - 2026-10-09): Optimize enqueueing of refine_webrequest_hourly pipeline - https://phabricator.wikimedia.org/T419050#12338169 (10Gehel) [13:30:00] 06Data-Engineering, 06Data-Engineering-Radar, 06cloud-services-team, 06Data-Persistence, and 4 others: Create wiki replicas views for globaljsonlinks tables - https://phabricator.wikimedia.org/T387419#12338167 (10Gehel) [13:30:17] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10Data-Platform, 06Data-Platform-SRE (2026-09-18 - 2026-10-09): Debmonitor checks failing for docker-registry.discovery.wmnet/repos/data-engineering/eventstreams:v0.19.0 - https://phabricator.wikimedia.org/T432824#12338175 (10Gehel) [14:00:02] (03CR) 10Xcollazo: [C:03+2] refinery-spark: Distribute HdfsFileFingerprintWriter across executors [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1342809 (https://phabricator.wikimedia.org/T438244) (owner: 10Xcollazo) [14:08:56] 06Data-Engineering, 06Data-Engineering-Radar, 06SRE, 10SRE-Access-Requests, 13Patch-For-Review: Requesting access to analytics-privatedata-users level 3 for derenrich - https://phabricator.wikimedia.org/T437668#12338441 (10tappof) 05Open→03Resolved a:03tappof Patch merged. Access granted. [14:14:39] (03Merged) 10jenkins-bot: refinery-spark: Distribute HdfsFileFingerprintWriter across executors [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1342809 (https://phabricator.wikimedia.org/T438244) (owner: 10Xcollazo) [14:27:27] (03CR) 10Xcollazo: [C:03+2] "recheck" [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1342321 (https://phabricator.wikimedia.org/T437454) (owner: 10Xcollazo) [14:39:49] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): Re-establish rsync dumps access to PDApps mirror - https://phabricator.wikimedia.org/T437896#12338587 (10xcollazo) In terms of restoring full access and documenting the mirror, I think we are done. But I've also asked the mirror to change their rsync ta... [14:41:05] 14Data-Engineering (Q3 FY25/26 January 1st - March 31th), 10Datasets-General-or-Unknown: Get dump mirrors to use new dumps-rsync service name - https://phabricator.wikimedia.org/T415193#12338603 (10xcollazo) [14:42:29] (03Merged) 10jenkins-bot: refinery-job-35: Add 7z recompressor for the v2 history dumps [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1342321 (https://phabricator.wikimedia.org/T437454) (owner: 10Xcollazo) [14:49:04] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 13Patch-For-Review: Implement 7z compression for v2 history dumps - https://phabricator.wikimedia.org/T437454#12338661 (10xcollazo) >>! In T437454#12332199, @GGoncalves-WMF wrote: >> Considering this, should we even attempt to run 7z for wikidatawiki,... [14:51:58] 06Data-Engineering, 06Connection-Team, 06Growth-Team, 10Thanks: Define the requirements for Thanks instrumentation - https://phabricator.wikimedia.org/T438493 (10Urbanecm_WMF) 03NEW [14:52:15] 06Data-Engineering, 06Connection-Team, 06Growth-Team, 10Thanks: Define the requirements for Thanks instrumentation - https://phabricator.wikimedia.org/T438493#12338684 (10Urbanecm_WMF) [14:53:30] 06Data-Engineering, 06Connection-Team, 06Growth-Team, 10Thanks: Define the requirements for Thanks instrumentation - https://phabricator.wikimedia.org/T438493#12338687 (10Urbanecm_WMF) a:03GGoncalves-WMF @GGoncalves-WMF Boldly assigning to you, as discussed via Slack. [14:56:40] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10AQS2.0, 10Data-Platform, 06Growth-Team, and 3 others: Make the AQS endpoints more usable for the ImpactModule extension - https://phabricator.wikimedia.org/T433983#12338692 (10Urbanecm_WMF) [15:16:43] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 07Epic: Load Google Search Console social account impressions and clicks data into Data Lake - https://phabricator.wikimedia.org/T436710#12338806 (10Antoine_Quhen) This data is not reachable through the BigQuery path that produces our current searchdat... [15:26:12] 06Data-Engineering, 06Connection-Team, 06Growth-Team, 10Thanks: Define the requirements for Thanks instrumentation - https://phabricator.wikimedia.org/T438493#12338855 (10GGoncalves-WMF) a:05GGoncalves-WMF→03Snwachukwu I expect that we'll provide this guidance as part of the [[ https://docs.google.com/... [16:36:49] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): gitlab-mcp-server: Add read-only MCP server for GitLab merge requests and comments - https://phabricator.wikimedia.org/T438508 (10xcollazo) 03NEW [20:11:18] (03CR) 10Xcollazo: [C:03+2] "Update: we may have to reconsider the approach definitely, because Airflow is not happy with the amount of task instances (6.3K!) that the" [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1342321 (https://phabricator.wikimedia.org/T437454) (owner: 10Xcollazo) [20:47:47] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 13Patch-For-Review: Implement 7z compression for v2 history dumps - https://phabricator.wikimedia.org/T437454#12340502 (10xcollazo) **The 7z recompression makes the DAG too large for the scheduler** A test run on the dev Airflow instance shows a probl...