[00:06:51] 06Data-Engineering, 06Data-Engineering-Radar, 06DBA, 07Schema-change-in-production: Drop rc_new from recentchanges table in wmf production - https://phabricator.wikimedia.org/T402763#11160724 (10Ladsgroup) [00:18:33] 06Data-Engineering, 06SRE, 06Traffic-Icebox, 10MobileFrontend (Tracking): QA features on the new mobile URLs - https://phabricator.wikimedia.org/T403638#11160755 (10Etonkovidova) [06:15:05] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th), 13Patch-For-Review: Update unique_devices tables to add the `access_method` field - https://phabricator.wikimedia.org/T401666#11161094 (10JAllemandou) >>! In T401666#11160448, @Krinkle wrote: > Ah I see. I wasn't sure how frequently the dataset is publ... [06:18:18] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th), 13Patch-For-Review: Update unique_devices tables to add the `access_method` field - https://phabricator.wikimedia.org/T401666#11161099 (10JAllemandou) >>! In T401666#11160652, @nshahquinn-wmf wrote: >>>! In T401666#11160376, @JAllemandou wrote: >>>>! I... [07:24:47] (03CR) 10Joal: [C:03+2] "LGTM!" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1182855 (https://phabricator.wikimedia.org/T400270) (owner: 10Vgutierrez) [07:25:00] (03CR) 10Joal: [V:03+2 C:03+2] "Merging" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1182855 (https://phabricator.wikimedia.org/T400270) (owner: 10Vgutierrez) [09:11:02] (03CR) 10Aqu: [C:03+1] "* Need an airflow-dag update to update source tables." [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1186087 (https://phabricator.wikimedia.org/T401666) (owner: 10Joal) [09:14:30] 06Data-Engineering, 06Data-Engineering-Radar, 10CheckUser, 06Trust and Safety Product Team, and 4 others: Drop index cul_target_type from cu_log - https://phabricator.wikimedia.org/T401884#11161606 (10Dreamy_Jazz) [09:47:31] (03CR) 10Mforns: [C:03+1] Add access_method to unique-devices per-domain (032 comments) [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1186087 (https://phabricator.wikimedia.org/T401666) (owner: 10Joal) [09:51:15] (03CR) 10Joal: "I'm gonna add the script to backfill the access_method column, good catch antoine, thank you. I'm preparing a new patch." [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1186087 (https://phabricator.wikimedia.org/T401666) (owner: 10Joal) [10:22:48] (03PS2) 10Joal: Add access_method to unique-devices per-domain [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1186087 (https://phabricator.wikimedia.org/T401666) [10:26:17] 06Data-Engineering, 06Data-Engineering-Radar, 10AbuseFilter, 06DBA, 07Schema-change-in-production: Add default value for afl_ip and remove default value for afl_ip_hex in abuse_filter_log table - https://phabricator.wikimedia.org/T401906#11161881 (10FCeratto-WMF) [11:55:32] 06Data-Engineering, 06Data-Engineering-Radar, 10CheckUser, 06Trust and Safety Product Team, and 4 others: Drop index cul_target_type from cu_log - https://phabricator.wikimedia.org/T401884#11162299 (10Dreamy_Jazz) (Moved back to 'In Progress' for the creation of the #schema-change-in-production ticket) [12:10:38] 06Data-Engineering, 10CheckUser, 06DBA, 06Trust and Safety Product Team, 07Schema-change-in-production: Drop `cul_target_type` index from `cu_log` in WMF prod - https://phabricator.wikimedia.org/T404074 (10mszwarc) 03NEW [12:10:51] 06Data-Engineering, 06Data-Engineering-Radar, 10CheckUser, 06Trust and Safety Product Team, and 4 others: Drop index cul_target_type from cu_log - https://phabricator.wikimedia.org/T401884#11162370 (10mszwarc) [12:10:53] 06Data-Engineering, 10CheckUser, 06DBA, 06Trust and Safety Product Team, 07Schema-change-in-production: Drop `cul_target_type` index from `cu_log` in WMF prod - https://phabricator.wikimedia.org/T404074#11162371 (10mszwarc) [12:11:25] 06Data-Engineering, 06Data-Engineering-Radar, 10CheckUser, 06Trust and Safety Product Team, and 4 others: Drop index cul_target_type from cu_log - https://phabricator.wikimedia.org/T401884#11162375 (10mszwarc) [12:11:46] 06Data-Engineering, 06Data-Engineering-Radar, 10CheckUser, 06Trust and Safety Product Team, and 4 others: Drop index cul_target_type from cu_log - https://phabricator.wikimedia.org/T401884#11162377 (10mszwarc) 05In progress→03Resolved [12:24:46] 06Data-Engineering, 06SRE, 06Traffic-Icebox, 10MobileFrontend (Tracking): QA features on the new mobile URLs - https://phabricator.wikimedia.org/T403638#11162415 (10MSantos) [12:25:39] 06Data-Engineering, 06SRE, 06Traffic-Icebox, 10MobileFrontend (Tracking): QA features on the new mobile URLs - https://phabricator.wikimedia.org/T403638#11162427 (10MSantos) [12:30:31] 06Data-Engineering-Radar, 10CheckUser, 06DBA, 06Trust and Safety Product Team, 07Schema-change-in-production: Add '*_actor_ip_hex_time' indexes to 'cu_changes', 'cu_log_event', and 'cu_private_event' on WMF wikis - https://phabricator.wikimedia.org/T399728#11162448 (10Ladsgroup) 05In progress→03Re... [12:31:25] 06Data-Engineering, 06Data-Engineering-Radar, 06DBA, 07Schema-change-in-production: Drop afl_patrolled_by from abuse_filter_log in production - https://phabricator.wikimedia.org/T391056#11162459 (10Ladsgroup) [12:31:42] 06Data-Engineering, 06Data-Engineering-Radar, 06DBA, 07Schema-change-in-production: Drop afl_patrolled_by from abuse_filter_log in production - https://phabricator.wikimedia.org/T391056#11162462 (10Ladsgroup) 05In progress→03Resolved [12:37:29] 06Data-Engineering, 06Data-Engineering-Radar, 06DBA, 07Schema-change-in-production: Drop cl_to and cl_collation from categorylinks in wmf production - https://phabricator.wikimedia.org/T402925#11162476 (10Ladsgroup) [12:50:44] (03PS2) 10Santiago Faci: Added `agent.ua_string` as a possible source when parsing user agent [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1186049 (https://phabricator.wikimedia.org/T385180) [13:01:06] 06Data-Engineering, 06Data-Engineering-Radar, 06DBA, 07Schema-change-in-production: Drop cl_to and cl_collation from categorylinks in wmf production - https://phabricator.wikimedia.org/T402925#11162576 (10Ladsgroup) [13:03:24] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th), 10DPE-Mediawiki-Content, 13Patch-For-Review: Airflow jobs to do monthly XML dumps - https://phabricator.wikimedia.org/T384381#11162594 (10BTullis) [13:12:21] 06Data-Engineering, 10CheckUser, 06DBA, 06Trust and Safety Product Team, 07Schema-change-in-production: Drop `cul_target_type` index from `cu_log` in WMF prod - https://phabricator.wikimedia.org/T404074#11162658 (10Ladsgroup) 05Open→03Resolved a:03Ladsgroup [13:14:04] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th), 10DPE-Mediawiki-Content, 13Patch-For-Review: Airflow jobs to do monthly XML dumps - https://phabricator.wikimedia.org/T384381#11162667 (10BTullis) Something occurs to me here. Since {T352650} was completed, we already have Airflow DAGs that are alrea... [13:29:23] 06Data-Engineering, 06Data-Platform-SRE: Move the dumps_v1 DAGs from the Airflow test_k8s instance to the main instance - https://phabricator.wikimedia.org/T404084 (10BTullis) 03NEW [13:47:06] 06Data-Engineering, 06Data-Engineering-Icebox, 06cloud-services-team, 10Data-Services, 10Datasets-General-or-Unknown: Provide dumps using bittorrent - https://phabricator.wikimedia.org/T29653#11162783 (10Broken-Viking) Subscribing to this as I'm the person currently taking on making [[https://academictor... [13:57:09] 06Data-Engineering, 06Data-Engineering-Radar, 10Data-Platform-SRE (2025.09.05 - 2025.09.26), 13Patch-For-Review: Fix the hard dependency between the Airflow scheduler and the DataHub GMS service - https://phabricator.wikimedia.org/T395106#11162856 (10brouberol) 05In progress→03Declined I'm actually... [14:05:23] 06Data-Engineering-Radar, 06Data-Platform-SRE, 10Research-engineering: Add analytics-research user to stat boxes - https://phabricator.wikimedia.org/T403207#11162960 (10Gehel) p:05Triage→03High [14:09:33] 06Data-Engineering, 06SRE, 06Traffic-Icebox, 10MobileFrontend (Tracking): QA features on the new mobile URLs - https://phabricator.wikimedia.org/T403638#11162971 (10Peachey88) [14:16:07] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th), 06Growth-Team, 06Wikipedia-Android-App-Backlog, 06Wikipedia-iOS-App-Backlog: Global Editor Metrics for YiR, Apps Activity Tab, and Growth Impact Module - https://phabricator.wikimedia.org/T403660#11162990 (10Ottomata) FWIW, we can do these very acc... [14:21:57] 06Data-Engineering-Radar, 10Research-engineering, 10Data-Platform-SRE (2025.09.05 - 2025.09.26): Add analytics-research user to stat boxes - https://phabricator.wikimedia.org/T403207#11163021 (10Gehel) [14:47:15] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th), 06cloud-services-team, 06Data-Persistence, 10Data-Services, and 6 others: Title of suppressed recentchanges entries can be viewed through the wiki replicas - https://phabricator.wikimedia.org/T402283#11163147 (10sbassett) [15:14:51] (03CR) 10Joal: [C:03+1] "LGTM! Merge at will :)" [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1186058 (https://phabricator.wikimedia.org/T384381) (owner: 10Xcollazo) [15:23:34] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th), 10DPE-Mediawiki-Content: Compare outputs between XML File Export and MediaWiki's Special:Export - https://phabricator.wikimedia.org/T402229#11163356 (10xcollazo) 05In progress→03Resolved [15:23:44] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th), 10DPE-Mediawiki-Content: Modify XML dumping code to support multiple compression algorithms - https://phabricator.wikimedia.org/T402209#11163358 (10xcollazo) 05In progress→03Resolved [15:56:23] 06Data-Engineering, 06Traffic: Reduce noise from duplicate sequence-gap alerts on HaProxy-webrequests - https://phabricator.wikimedia.org/T401383#11163549 (10Fabfur) I'm also taking care of this with some experiments to check when actually HAProxy (or HaproxyKafka) skips these messages [17:14:41] 06Data-Engineering, 10Product-Analytics (Kanban): Follow-up analysis to understand usage of dumps to inform v2 rollout - https://phabricator.wikimedia.org/T402963#11164125 (10KCVelaga_WMF) @GGoncalves-WMF I have been able to work with the scripts Marcel and Jennifer developed for processes the logs - super hel... [17:29:24] 06Data-Engineering, 06Data-Engineering-Radar, 10CampaignEvents, 06Data-Persistence (work done), and 4 others: Update DB schema to store whether contribution tracking is enabled for a given event - https://phabricator.wikimedia.org/T402816#11164170 (10Daimona) [18:13:01] 06Data-Engineering, 06Data-Engineering-Radar, 06DBA, 07Schema-change-in-production: Drop rc_new from recentchanges table in wmf production - https://phabricator.wikimedia.org/T402763#11164444 (10FCeratto-WMF) [18:16:19] 06Data-Engineering, 06Data-Engineering-Radar, 10Fundraising analytics stack, 07Epic: EPIC: Trino/MinIO/Hive-Standalone-Metaserver/Dagster/Metabase/Superset Implementation - https://phabricator.wikimedia.org/T377362#11164452 (10BTullis) [18:28:16] 06Data-Engineering, 10MediaWiki-extensions-WikimediaEvents: Prepare mediawiki-client-error Logstash dashboards for mobile subdomain sunsetting - https://phabricator.wikimedia.org/T400852#11164529 (10Jdlrobson-WMF) [18:29:06] 06Data-Engineering, 06Data-Engineering-Radar, 10AbuseFilter, 06DBA, 07Schema-change-in-production: Add default value for afl_ip and remove default value for afl_ip_hex in abuse_filter_log table - https://phabricator.wikimedia.org/T401906#11164535 (10FCeratto-WMF) [19:52:23] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th), 10Event-Platform, 13Patch-For-Review: EventBus - Add central user id to MediaWiki events - https://phabricator.wikimedia.org/T403664#11164982 (10Ottomata) Some points from Slack: @Reedy > https://www.mediawiki.org/wiki/Manual:Central_ID is publicly... [20:30:01] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th), 10DPE-Mediawiki-Content, 13Patch-For-Review: Airflow jobs to do monthly XML dumps - https://phabricator.wikimedia.org/T384381#11165113 (10xcollazo) >>! In T384381#11162665, @BTullis wrote: > Something occurs to me here. Since {T352650} was completed,... [20:35:45] (03CR) 10Xcollazo: [C:03+2] Remove 'partial' flag from MediawikiDumper [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1186058 (https://phabricator.wikimedia.org/T384381) (owner: 10Xcollazo) [20:37:37] 06Data-Engineering, 06SRE, 06Traffic-Icebox, 10MobileFrontend (Tracking): RFC: Serve mobile and desktop variants through the same URL (unified mobile routing) - https://phabricator.wikimedia.org/T214998#11165143 (10DonTrung) Has anyone actually used Wikimedia websites on a mobile device here? Most of the t... [20:41:45] 06Data-Engineering, 06SRE, 06Traffic-Icebox, 10MobileFrontend (Tracking): RFC: Serve mobile and desktop variants through the same URL (unified mobile routing) - https://phabricator.wikimedia.org/T214998#11165154 (10Novem_Linguae) I don't think this ticket is to remove mobile mode (i.e. the skin MinervaNeue... [20:43:41] 06Data-Engineering, 06SRE, 06Traffic-Icebox, 10MobileFrontend (Tracking): RFC: Serve mobile and desktop variants through the same URL (unified mobile routing) - https://phabricator.wikimedia.org/T214998#11165163 (10TheDJ) >>! In T214998#11165143, @DonTrung wrote: > Has anyone actually used Wikimedia websit... [20:47:03] 06Data-Engineering, 06SRE, 06Traffic-Icebox, 10MobileFrontend (Tracking): RFC: Serve mobile and desktop variants through the same URL (unified mobile routing) - https://phabricator.wikimedia.org/T214998#11165193 (10Rexogamer) do I understand correctly that you want to use the desktop version on mobile? if... [20:50:10] (03Merged) 10jenkins-bot: Remove 'partial' flag from MediawikiDumper [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1186058 (https://phabricator.wikimedia.org/T384381) (owner: 10Xcollazo) [21:14:56] 06Data-Engineering, 06SRE, 06Traffic-Icebox, 10MobileFrontend (Tracking): RFC: Serve mobile and desktop variants through the same URL (unified mobile routing) - https://phabricator.wikimedia.org/T214998#11165349 (10Strainu) >>! In T214998#11165163, @TheDJ wrote: > This should make that easier and not harde... [21:55:57] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th): Analytics Cluster Dataset Usage Discovery Task - https://phabricator.wikimedia.org/T389903#11165430 (10Ahoelzl) 05Open→03Declined [22:01:25] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th): Backup pageview data before backfilling, announce backfilling progress - https://phabricator.wikimedia.org/T404151 (10Ahoelzl) 03NEW [22:14:27] 06Data-Engineering, 06SRE, 06Traffic-Icebox, 10MobileFrontend (Tracking): RFC: Serve mobile and desktop variants through the same URL (unified mobile routing) - https://phabricator.wikimedia.org/T214998#11165529 (10Ladsgroup) Okay let me try: this change is not making the mobile mode go away. It doesn't ch... [23:39:42] 06Data-Engineering, 10MediaWiki-extensions-WikimediaEvents: Prepare mediawiki-client-error Logstash dashboards for mobile subdomain sunsetting - https://phabricator.wikimedia.org/T400852#11165733 (10Jdlrobson-WMF) > Having said that, if an isMobile field is desired in the interim, we can add it now. The rollou...