[00:01:18] 06Data-Engineering, 06DBA, 07Schema-change-in-production: Add new rc_name_source_patrolled_timestamp index to recentchanges table in wmf production - https://phabricator.wikimedia.org/T402010#11100712 (10Ladsgroup) [00:21:07] 06Data-Engineering, 06DBA, 07Schema-change-in-production: Add new rc_name_source_patrolled_timestamp index to recentchanges table in wmf production - https://phabricator.wikimedia.org/T402010#11100736 (10Ladsgroup) [00:35:56] 06Data-Engineering, 06DBA, 07Schema-change-in-production: Add new rc_name_source_patrolled_timestamp index to recentchanges table in wmf production - https://phabricator.wikimedia.org/T402010#11100751 (10Ladsgroup) [00:49:09] 06Data-Engineering, 06DBA, 07Schema-change-in-production: Add new rc_name_source_patrolled_timestamp index to recentchanges table in wmf production - https://phabricator.wikimedia.org/T402010#11100783 (10Ladsgroup) [08:08:46] (03Abandoned) 10Aqu: refine-monitor: RefineTarget.shouldRefine fix [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1166132 (https://phabricator.wikimedia.org/T369845) (owner: 10Aqu) [08:16:31] (03PS3) 10Aqu: Refine: Fix location of refined data-empty partitions [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1172318 (https://phabricator.wikimedia.org/T369845) [09:25:14] (03CR) 10Joal: [C:03+2] "LGTM!" [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1172318 (https://phabricator.wikimedia.org/T369845) (owner: 10Aqu) [09:36:44] (03Merged) 10jenkins-bot: Refine: Fix location of refined data-empty partitions [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1172318 (https://phabricator.wikimedia.org/T369845) (owner: 10Aqu) [10:28:34] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th): Data for display orientation in mobile views of Wikimedia projects - https://phabricator.wikimedia.org/T400963#11101512 (10GGoncalves-WMF) Hi, We had to ask around a little, and unfortunately we don't have a precise answer as we don't really instrument... [10:28:45] 06Data-Engineering, 06Data-Engineering-Radar, 06SRE, 10SRE-Access-Requests, 10Data-Platform-SRE (2025.08.16 - 2025.09.05): Request for Kerberos identity for querying SSAC table via statmachines - https://phabricator.wikimedia.org/T401827#11101515 (10BTullis) [10:28:50] 06Data-Engineering, 10Technical-blog-posts, 10Data-Platform-SRE (2025.08.16 - 2025.09.05): Write a blog post about the recent Airflow migration to Kubernetes - https://phabricator.wikimedia.org/T393603#11101520 (10BTullis) [10:31:05] 06Data-Engineering, 10Data-Platform-SRE (2025.08.16 - 2025.09.05), 07Documentation: https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log should be on Wikitech - https://phabricator.wikimedia.org/T387878#11101568 (10BTullis) [10:32:26] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th), 10Data-Platform-SRE (2025.08.16 - 2025.09.05), 10Event-Platform, 13Patch-For-Review: Build Flink docker image on bookworm - https://phabricator.wikimedia.org/T400600#11101606 (10BTullis) [10:32:48] 06Data-Engineering, 10Data-Platform-SRE (2025.08.16 - 2025.09.05), 13Patch-For-Review: Ensure that blunderbuss uses the minimum HDFS file system permissions required - https://phabricator.wikimedia.org/T401103#11101616 (10BTullis) [10:34:07] 06Data-Engineering, 06Data-Engineering-Radar, 06Discovery-Search, 06Infrastructure-Foundations, and 2 others: Elasticsearch dependency upgrade in spicerack - https://phabricator.wikimedia.org/T390860#11101647 (10BTullis) [10:34:23] 06Data-Engineering, 06Discovery-Search, 06Java-Scala-Standardization, 10Data-Platform-SRE (2025.08.16 - 2025.09.05), 07Epic: [Epic] Replace Archiva with Gitlab artifact repositories - https://phabricator.wikimedia.org/T367315#11101659 (10BTullis) [10:34:29] 06Data-Engineering, 06Data-Engineering-Radar, 10Data-Platform-SRE (2025.08.16 - 2025.09.05), 13Patch-For-Review: Fix the hard dependency between the Airflow scheduler and the DataHub GMS service - https://phabricator.wikimedia.org/T395106#11101667 (10BTullis) [10:34:37] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th), 10Dumps-Generation, 10Wikidata, 10Data-Platform-SRE (2025.08.16 - 2025.09.05), 07Essential-Work: wikidata-20250707-all.json.gz is corrupted - https://phabricator.wikimedia.org/T399077#11101669 (10BTullis) [10:34:53] 06Data-Engineering, 10Data-Platform-SRE (2025.08.16 - 2025.09.05): Request for dedicated Airflow instance for WME - https://phabricator.wikimedia.org/T396672#11101674 (10BTullis) [10:35:39] 06Data-Engineering, 06Data-Engineering-Radar, 06cloud-services-team, 06Data-Persistence, and 2 others: Create wiki replicas views for globaljsonlinks tables - https://phabricator.wikimedia.org/T387419#11101690 (10BTullis) [10:42:58] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th), 10Dumps-Generation, 10Wikidata, 10Data-Platform-SRE (2025.08.16 - 2025.09.05), 07Essential-Work: wikidata-20250707-all.json.gz is corrupted - https://phabricator.wikimedia.org/T399077#11101769 (10BTullis) 05In progress→03Resolved [10:44:40] 06Data-Engineering, 06Data-Platform-SRE, 07Documentation: https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log should be on Wikitech - https://phabricator.wikimedia.org/T387878#11101773 (10BTullis) I'm moving this out of the current milestone, because I think that there's little chance that we will work... [11:04:36] 06Data-Engineering, 06Data-Platform-SRE, 10Wikidata, 07Epic: EPIC: WDQS categories migration - https://phabricator.wikimedia.org/T375520#11101821 (10BTullis) [11:08:11] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th), 10Data-Platform-SRE (2025.08.16 - 2025.09.05): Blunderbuss: Move Hadoop/HDFS XML configuration into Helm deployment chart - https://phabricator.wikimedia.org/T402323#11101829 (10BTullis) [11:08:17] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th), 10Data-Platform-SRE (2025.08.16 - 2025.09.05): Blunderbuss: Move Hadoop/HDFS XML configuration into Helm deployment chart - https://phabricator.wikimedia.org/T402323#11101831 (10BTullis) p:05Triage→03Medium [11:21:21] 06Data-Engineering, 06DBA, 07Schema-change-in-production: Add new rc_name_source_patrolled_timestamp index to recentchanges table in wmf production - https://phabricator.wikimedia.org/T402010#11101897 (10Ladsgroup) [11:39:49] 06Data-Engineering, 06DBA, 07Schema-change-in-production: Add new rc_name_source_patrolled_timestamp index to recentchanges table in wmf production - https://phabricator.wikimedia.org/T402010#11101967 (10Ladsgroup) [12:00:47] 06Data-Engineering, 06DBA, 07Schema-change-in-production: Add new rc_name_source_patrolled_timestamp index to recentchanges table in wmf production - https://phabricator.wikimedia.org/T402010#11101994 (10Ladsgroup) [13:03:15] 06Data-Engineering, 10AbuseFilter, 06DBA, 07Schema-change-in-production: Add default value for afl_ip and remove default value for afl_ip_hex in abuse_filter_log table - https://phabricator.wikimedia.org/T401906#11102154 (10FCeratto-WMF) 05Open→03In progress [13:17:24] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th), 06Data-Platform-SRE, 10Event-Platform: Flink images should be build on top of openjdk - https://phabricator.wikimedia.org/T400296#11102186 (10BTullis) I am not very keen on the idea of running all flink applications on top of the JDK, for a couple of... [13:29:10] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th), 10Event-Platform: mediawiki.content_history: flink applications experiencing frequent restarts due to JobManager OOMs - https://phabricator.wikimedia.org/T397330#11102233 (10BTullis) I think I have identified a way of debugging a flink app, without hav... [13:31:50] 06Data-Engineering, 10Data-Platform-SRE (2025.08.16 - 2025.09.05): Ensure that blunderbuss uses the minimum HDFS file system permissions required - https://phabricator.wikimedia.org/T401103#11102252 (10BTullis) 05Open→03Resolved This is now complete. All files beneath `/wmf/cache/artifacts/airflow` are... [13:36:43] 06Data-Engineering, 06DBA, 07Schema-change-in-production: Add new rc_name_source_patrolled_timestamp index to recentchanges table in wmf production - https://phabricator.wikimedia.org/T402010#11102261 (10Ladsgroup) [13:36:53] 06Data-Engineering, 06DBA, 07Schema-change-in-production: Add new rc_name_source_patrolled_timestamp index to recentchanges table in wmf production - https://phabricator.wikimedia.org/T402010#11102263 (10Ladsgroup) 05Open→03Resolved [14:04:37] Starting build #41 for job analytics-refinery-maven-release [14:23:55] 06Data-Engineering, 06DBA, 07Schema-change-in-production: Add cl_timestamp_id index to categorylinks table - https://phabricator.wikimedia.org/T399249#11102428 (10FCeratto-WMF) [14:24:38] Project analytics-refinery-maven-release build #41: 09SUCCESS in 20 min: https://integration.wikimedia.org/ci/job/analytics-refinery-maven-release/41/ [14:35:04] 06Data-Engineering, 06DBA, 07Schema-change-in-production: Add cl_timestamp_id index to categorylinks table - https://phabricator.wikimedia.org/T399249#11102498 (10FCeratto-WMF) [14:37:37] 06Data-Engineering, 06Data-Engineering-Radar, 06Growth-Team, 10GrowthExperiments-NewcomerTasks, and 3 others: Error for mediawiki.cirrussearch-request: '' should NOT have additional properties - https://phabricator.wikimedia.org/T399965#11102517 (10pfischer) [14:38:42] 06Data-Engineering, 06Data-Engineering-Radar, 10CirrusSearch, 10Structured Data Engineering, and 4 others: Migrate image recommendation to use page_weighted_tags_changed stream - https://phabricator.wikimedia.org/T372912#11102553 (10pfischer) [14:38:48] 06Data-Engineering, 06Data-Platform-SRE, 06Java-Scala-Standardization, 10Discovery-Search (2025.08.15 - 2025.09.03), 13Patch-For-Review: Migrate existing Java packages to deploying to Gitlab, including new version of parent pom, validation that all depen... - https://phabricator.wikimedia.org/T367405#11102557 [14:39:55] 06Data-Engineering, 06Java-Scala-Standardization, 10Discovery-Search (2025.08.15 - 2025.09.03): Create Gitlab CI templates for JVM packages - https://phabricator.wikimedia.org/T386406#11102586 (10pfischer) [14:40:03] 10Data-Engineering-Roadmap, 10DPE-Mediawiki-Content, 10Discovery-Search (2025.08.15 - 2025.09.03), 13Patch-For-Review: SUP: Use flink 1.20.1 - https://phabricator.wikimedia.org/T398159#11102584 (10pfischer) [14:40:42] 06Data-Engineering, 10CirrusSearch, 10DPE-Mediawiki-Content, 10Discovery-Search (2025.08.15 - 2025.09.03): Source the CirrusSearch index dumps from hadoop instead of a MW maintenance script - https://phabricator.wikimedia.org/T366248#11102605 (10pfischer) [14:53:13] 06Data-Engineering, 10BetaFeatures, 06cloud-services-team, 10Data-Services, 06DBA: Create view for betafeatures_user_counts table in wiki replicas - https://phabricator.wikimedia.org/T402145#11102701 (10fnegri) [17:38:51] 06Data-Engineering: Improve handling of new stream onboarding in Refine - https://phabricator.wikimedia.org/T402186#11103314 (10Ottomata) > Gobblin may not have imported the first canary events to HDFS. Alternate solution: change gobblin setting to consume from beginning of topic if no offset is saved. I thin... [19:18:38] 06Data-Engineering, 06Data-Engineering-Radar, 10MobileFrontend, 10XAnalytics, and 3 others: PHP Deprecated: urldecode(): Passing null to parameter #1 ($string) of type string is deprecated / PHP Warning: Undefined array key 1 - https://phabricator.wikimedia.org/T400522#11103704 (10Reedy) ==== Error ====... [19:40:03] (03CR) 10Mforns: [C:03+1] "LGTM! Left a stupid comment xD" [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1180212 (https://phabricator.wikimedia.org/T402209) (owner: 10Xcollazo) [19:58:05] 06Data-Engineering, 10AQS2.0, 10Cassandra: Golang-based Cassandra clients do not perform TLS host verification - https://phabricator.wikimedia.org/T361964#11104045 (10Eevans) [20:04:39] 06Data-Engineering, 10AQS2.0, 10Cassandra: Golang-based Cassandra clients do not perform TLS host verification - https://phabricator.wikimedia.org/T361964#11104053 (10Eevans) [20:26:19] (03CR) 10Aleksandar Mastilovic: "No GZip test? `"writeXMlFiles" should "build a GZ compressed XML file"`.." [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1180212 (https://phabricator.wikimedia.org/T402209) (owner: 10Xcollazo) [21:10:54] (03CR) 10Xcollazo: "Will add GZIP and no compression as well." [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1180212 (https://phabricator.wikimedia.org/T402209) (owner: 10Xcollazo) [21:27:39] (03PS4) 10Xcollazo: Add support for multiple compression algorithms to MW Dumper. [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1180212 (https://phabricator.wikimedia.org/T402209) [21:28:30] (03CR) 10Aleksandar Mastilovic: Add support for multiple compression algorithms to MW Dumper. (031 comment) [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1180212 (https://phabricator.wikimedia.org/T402209) (owner: 10Xcollazo) [21:29:55] (03CR) 10Xcollazo: "Done, please re-review." [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1180212 (https://phabricator.wikimedia.org/T402209) (owner: 10Xcollazo)