[09:07:21] 06Data-Engineering, 06Data-Engineering-Radar, 10AbuseFilter, 06DBA, 07Schema-change-in-production: Add default value for afl_ip and remove default value for afl_ip_hex in abuse_filter_log table - https://phabricator.wikimedia.org/T401906#11142803 (10FCeratto-WMF) [10:07:58] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th), 10Event-Platform: mediawiki.content_history: flink applications experiencing frequent restarts due to JobManager OOMs - https://phabricator.wikimedia.org/T397330#11143101 (10BTullis) [10:25:22] 06Data-Engineering, 06Infrastructure-Foundations, 06Traffic: Export development_network_probe data to Puppet servers for CDN deployment - https://phabricator.wikimedia.org/T402512#11143218 (10Vgutierrez) I think we have 3 upcoming DAGs: * the one covered by this task * probenet data for the GeoDNS pipeline (... [10:53:09] 06Data-Engineering, 10BetaFeatures, 06cloud-services-team, 10Data-Services: Create view for betafeatures_user_counts table in wiki replicas - https://phabricator.wikimedia.org/T402145#11143335 (10Ladsgroup) This is not DBA work. I stay subscribed if you still need one. [10:55:35] 06Data-Engineering, 06Data-Engineering-Radar, 10CampaignEvents, 06Data-Persistence (work done), and 4 others: Update DB schema to store whether contribution tracking is enabled for a given event - https://phabricator.wikimedia.org/T402816#11143337 (10Ladsgroup) [11:00:05] 06Data-Engineering, 06Infrastructure-Foundations, 06Traffic: Export development_network_probe data to Puppet servers for CDN deployment - https://phabricator.wikimedia.org/T402512#11143345 (10brouberol) IMHO piggybacking on `platform_eng` might allow you to get a faster head start. If you find yourself in a... [11:01:10] 06Data-Engineering, 06Infrastructure-Foundations, 06Traffic: Export development_network_probe data to Puppet servers for CDN deployment - https://phabricator.wikimedia.org/T402512#11143351 (10Vgutierrez) That's great, thanks @brouberol [11:28:32] 06Data-Engineering, 06Data-Engineering-Radar, 06DBA, 13Patch-For-Review, 07Schema-change-in-production: Drop rc_new from recentchanges table in wmf production - https://phabricator.wikimedia.org/T402763#11143424 (10Ladsgroup) [11:48:49] 06Data-Engineering, 06Data-Engineering-Radar, 06DBA, 07Schema-change-in-production: Drop rc_new from recentchanges table in wmf production - https://phabricator.wikimedia.org/T402763#11143475 (10Ladsgroup) [11:49:44] 06Data-Engineering, 06Data-Engineering-Radar, 06DBA, 07Schema-change-in-production: Drop rc_new from recentchanges table in wmf production - https://phabricator.wikimedia.org/T402763#11143476 (10Ladsgroup) Ran it live on s6 codfw. I wait until next week before moving forward to the whole fleet. [13:05:17] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th), 10Event-Platform, 13Patch-For-Review: Update event-producing tools to overwrite `meta.dt` - https://phabricator.wikimedia.org/T376026#11143813 (10Ottomata) @colewhite how can I find an example of this log line? I need to figure out what is causing i... [13:16:22] 14Analytics-Radar, 06Data-Engineering, 06Data-Engineering-Icebox, 06cloud-services-team, 10Cloud-VPS: Report page views for labs instances - https://phabricator.wikimedia.org/T103726#11143884 (10fgiunchedi) 05Open→03Declined Boldly declining, I don't think there's any effort or plan behind this,... [14:21:39] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th), 10Event-Platform, 13Patch-For-Review: Update event-producing tools to overwrite `meta.dt` - https://phabricator.wikimedia.org/T376026#11144110 (10colewhite) @Ottomata https://logstash.wikimedia.org/goto/bf7b4b4118510333a45373f874eebc5c [14:26:53] 06Data-Engineering, 06cloud-services-team, 10Data-Services, 06DBA, 13Patch-For-Review: Make watchlist table available as curated foo_p.watchlist_count on labsdb - https://phabricator.wikimedia.org/T59617#11144124 (10fnegri) [14:56:39] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th), 10DPE-Mediawiki-Content: Airflow jobs to do monthly XML dumps - https://phabricator.wikimedia.org/T384381#11144205 (10xcollazo) 05Open→03In progress a:03xcollazo [15:20:31] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th), 10Event-Platform, 13Patch-For-Review: Update event-producing tools to overwrite `meta.dt` - https://phabricator.wikimedia.org/T376026#11144308 (10Ottomata) - [CirrusSearch - Allow event system to set meta.dt (1184550)](https://gerrit.wikimedia.org/r/... [15:44:42] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th), 10Event-Platform, 13Patch-For-Review: Update event-producing tools to overwrite `meta.dt` - https://phabricator.wikimedia.org/T376026#11144465 (10Ottomata) Asking about change-prop in https://wikimedia.slack.com/archives/C05D7UDJZ5E/p1756914070254739 [15:47:38] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th): OpsWeek: spark_process_reconciliation_events for monthly reconcile fails with FetchFailedException - https://phabricator.wikimedia.org/T403635 (10xcollazo) 03NEW [15:50:00] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th): OpsWeek: spark_process_reconciliation_events for monthly reconcile fails with FetchFailedException - https://phabricator.wikimedia.org/T403635#11144498 (10xcollazo) I have killed the job and reran with the following configuration changes: From: ` "spark... [16:17:37] 06Data-Engineering, 06Data-Engineering-Radar, 10AbuseFilter, 06DBA, 07Schema-change-in-production: Add default value for afl_ip and remove default value for afl_ip_hex in abuse_filter_log table - https://phabricator.wikimedia.org/T401906#11144591 (10FCeratto-WMF) [16:29:58] 06Data-Engineering, 06SRE, 06Traffic-Icebox, 10MobileFrontend (Tracking): QA the removal of m-dot subdomain - https://phabricator.wikimedia.org/T403638 (10MSantos) 03NEW [16:30:53] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th), 10Event-Platform, 13Patch-For-Review: Update event-producing tools to overwrite `meta.dt` - https://phabricator.wikimedia.org/T376026#11144718 (10Ottomata) Ah ha mobileapps PCS: https://gerrit.wikimedia.org/r/c/mediawiki/services/mobileapps/+/1184560 [16:32:52] 06Data-Engineering, 06SRE, 06Traffic-Icebox, 10MobileFrontend (Tracking): QA the removal of m-dot subdomain - https://phabricator.wikimedia.org/T403638#11144734 (10MSantos) @Krinkle after a conversation with @NBaca-WMF we realised that the affected teams might want to do their own QA analysis and this will... [16:33:47] 06Data-Engineering, 06SRE, 06Traffic-Icebox, 10MobileFrontend (Tracking): QA the removal of m-dot subdomain - https://phabricator.wikimedia.org/T403638#11144736 (10MSantos) a:05Krinkle→03None [16:34:47] 06Data-Engineering, 06SRE, 06Traffic-Icebox, 10MobileFrontend (Tracking): QA the removal of m-dot subdomain - https://phabricator.wikimedia.org/T403638#11144742 (10Krinkle) We're deploying next week. There is no further need for dedicated testing afaik. We've prepared this back in March already. The rollou... [16:36:46] 06Data-Engineering, 06SRE, 06Traffic-Icebox, 10MobileFrontend (Tracking): QA the removal of m-dot subdomain - https://phabricator.wikimedia.org/T403638#11144746 (10Krinkle) Is there a specific feature you're worried about, and does that feature not have test coverage or QA regression testing on a regular b... [16:41:05] 06Data-Engineering, 06SRE, 06Traffic-Icebox, 10MobileFrontend (Tracking): QA the removal of m-dot subdomain - https://phabricator.wikimedia.org/T403638#11144762 (10MSantos) >>! In T403638#11144746, @Krinkle wrote: > Is there a specific feature you're worried about, and does that feature not have test cover... [16:44:13] 06Data-Engineering, 06SRE, 06Traffic-Icebox, 10MobileFrontend (Tracking): QA features on the new mobile URLs - https://phabricator.wikimedia.org/T403638#11144781 (10Krinkle) [16:55:39] 14Analytics-Radar, 06Data-Engineering, 06Data-Engineering-Icebox, 06cloud-services-team, 10Cloud-VPS: Report page views for labs instances - https://phabricator.wikimedia.org/T103726#11144832 (10bd808) It would be reasonably possible to implement this in roughly the same way that https://toolviews.to... [16:58:52] 06Data-Engineering, 06SRE, 06Traffic-Icebox, 10MobileFrontend (Tracking): QA features on the new mobile URLs - https://phabricator.wikimedia.org/T403638#11144837 (10Krinkle) >>! In T403638#11144733, @MSantos wrote: > However, to kickstart this work stream they need to know 2 things: > - What exactly needs... [17:06:24] 06Data-Engineering, 06SRE, 06Traffic-Icebox, 10MobileFrontend (Tracking): QA features on the new mobile URLs - https://phabricator.wikimedia.org/T403638#11144863 (10NBaca-WMF) Hm, I'm not sure that general-purpose QA flows will necessarily uncover potential breaking changes here. I also think teams and tea... [17:37:35] 06Data-Engineering, 10CirrusSearch, 10DPE-Mediawiki-Content, 10Discovery-Search (2025.08.15 - 2025.09.05), 13Patch-For-Review: Source the CirrusSearch index dumps from hadoop instead of a MW maintenance script - https://phabricator.wikimedia.org/T366248#11145000 (10xcollazo) > We need to add the step tha... [17:38:55] 06Data-Engineering, 10MediaWiki-extensions-CentralAuth, 06MediaWiki-Platform-Team: Include CentralAuth global user id in mediawiki_history - https://phabricator.wikimedia.org/T403644 (10Ottomata) 03NEW [17:39:38] 06Data-Engineering, 10MediaWiki-extensions-CentralAuth, 06MediaWiki-Platform-Team: Include CentralAuth global user id in mediawiki_history - https://phabricator.wikimedia.org/T403644#11145019 (10Ottomata) I added #mediawiki-extensions-centralauth tag as an FYI and in case those folks have thoughts. There sh... [18:00:27] 14Analytics-Radar, 06Data-Engineering, 06Data-Engineering-Icebox, 06SRE, and 2 others: Add request_id to webrequest logs as well as other event records ingested into Hadoop - https://phabricator.wikimedia.org/T113817#11145138 (10Ottomata) [18:15:17] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th), 06Experimentation Lab: NEW/CHANGE FEATURE REQUEST: make available the centralauth.globaluser table in Data Lake - https://phabricator.wikimedia.org/T389666#11145187 (10Ottomata) [18:15:18] 06Data-Engineering, 10MediaWiki-extensions-CentralAuth, 06MediaWiki-Platform-Team: Include CentralAuth global user id in mediawiki_history - https://phabricator.wikimedia.org/T403644#11145188 (10Ottomata) [18:16:07] 06Data-Engineering, 10MediaWiki-extensions-CentralAuth, 06MediaWiki-Platform-Team: Include CentralAuth global user id in mediawiki_history - https://phabricator.wikimedia.org/T403644#11145192 (10Ottomata) →14Duplicate dup:03T365648 [18:16:09] 06Data-Engineering, 10Data Pipelines: Add user Central ID to mediawiki_history table in Hive - https://phabricator.wikimedia.org/T365648#11145194 (10Ottomata) [18:17:25] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th), 06Experimentation Lab: NEW/CHANGE FEATURE REQUEST: make available the centralauth.globaluser table in Data Lake - https://phabricator.wikimedia.org/T389666#11145200 (10Ottomata) This will also be needed for {T388455}. [18:18:21] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th), 06Experimentation Lab: NEW/CHANGE FEATURE REQUEST: make available the centralauth.globaluser table in Data Lake - https://phabricator.wikimedia.org/T389666#11145205 (10Ottomata) a:03Ottomata [18:40:29] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th), 06Experimentation Lab: NEW/CHANGE FEATURE REQUEST: make available the centralauth.globaluser table in Data Lake - https://phabricator.wikimedia.org/T389666#11145303 (10Ottomata) [18:40:39] 06Data-Engineering, 10MediaWiki-extensions-CentralAuth, 06MediaWiki-Platform-Team: Include CentralAuth global user id in mediawiki_history - https://phabricator.wikimedia.org/T403644#11145304 (10Ottomata) [19:00:25] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th), 06Experimentation Lab: NEW/CHANGE FEATURE REQUEST: make available the centralauth.globaluser table in Data Lake - https://phabricator.wikimedia.org/T389666#11145363 (10Ottomata) For YiR, monthly is fine. However, for Growth Impact Module and for app Ac... [19:42:24] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th), 06Data-Persistence: Data Persistence Design Review: Year in Review (YiR) - https://phabricator.wikimedia.org/T401260#11145524 (10Ottomata) [20:12:15] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th), 10Event-Platform: EventBus - Add CentralAuth global user id to MediaWiki events - https://phabricator.wikimedia.org/T403664 (10Ottomata) 03NEW [20:24:30] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th), 06Experimentation Lab: NEW/CHANGE FEATURE REQUEST: make available the centralauth.globaluser table in Data Lake - https://phabricator.wikimedia.org/T389666#11145658 (10Ottomata) [20:30:18] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th), 06Experimentation Lab: NEW/CHANGE FEATURE REQUEST: make available the centralauth.globaluser table in Data Lake - https://phabricator.wikimedia.org/T389666#11145685 (10Ottomata) [20:30:21] 06Data-Engineering, 10MediaWiki-extensions-CentralAuth, 06MediaWiki-Platform-Team: Include CentralAuth global user id in mediawiki_history - https://phabricator.wikimedia.org/T403644#11145684 (10Ottomata)