[08:33:14] 06Data-Engineering, 06SRE, 06Traffic-Icebox, 10MobileFrontend (Tracking): RFC: Remove m-dot subdomain, serve mobile and desktop variants through the same URL - https://phabricator.wikimedia.org/T214998#11146776 (10Peter) [08:47:43] 06Data-Engineering, 06SRE, 06Traffic-Icebox, 10MobileFrontend (Tracking): RFC: Remove m-dot subdomain, serve mobile and desktop variants through the same URL - https://phabricator.wikimedia.org/T214998#11146860 (10Peter) [09:04:21] 06Data-Engineering, 10Data-Platform-SRE (2025.08.16 - 2025.09.05): Errors from refinery-sqoop-whole-mediawiki.service - September 2025 - re: categorylinks - https://phabricator.wikimedia.org/T403702 (10BTullis) 03NEW [09:04:34] 06Data-Engineering, 10Data-Platform-SRE (2025.08.16 - 2025.09.05): Errors from refinery-sqoop-whole-mediawiki.service - September 2025 - re: categorylinks - https://phabricator.wikimedia.org/T403702#11146937 (10BTullis) p:05Triage→03High [09:55:26] 06Data-Engineering, 06SRE, 06Traffic-Icebox, 10MobileFrontend (Tracking): RFC: Remove m-dot subdomain, serve mobile and desktop variants through the same URL - https://phabricator.wikimedia.org/T214998#11147104 (10Peter) [10:04:59] 06Data-Engineering, 10Data-Platform-SRE (2025.08.16 - 2025.09.05): Errors from refinery-sqoop-whole-mediawiki.service - September 2025 - re: categorylinks - https://phabricator.wikimedia.org/T403702#11147131 (10Ladsgroup) Some datapoint: we have dropped the old columns in most places (T402925). The wikis that... [10:20:04] 06Data-Engineering, 10Data-Platform-SRE (2025.08.16 - 2025.09.05): Errors from refinery-sqoop-whole-mediawiki.service - September 2025 - re: categorylinks - https://phabricator.wikimedia.org/T403702#11147166 (10BTullis) OK, thanks @Ladsgroup - Yes I found this patch, which looks like it hadn't been applied to... [10:26:21] 06Data-Engineering, 10Data-Platform-SRE (2025.08.16 - 2025.09.05): Errors from refinery-sqoop-whole-mediawiki.service - September 2025 - re: categorylinks - https://phabricator.wikimedia.org/T403702#11147185 (10BTullis) It looks like {T393388} would have helped in this case. [11:05:47] (03PS1) 10Mforns: Change pageview actor automated reasons to a map [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1184740 (https://phabricator.wikimedia.org/T402645) [11:20:32] (03CR) 10Joal: [C:03+2] "LGTM!" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1184740 (https://phabricator.wikimedia.org/T402645) (owner: 10Mforns) [11:57:56] 06Data-Engineering, 06Data-Engineering-Radar, 10AbuseFilter, 07Schema-change, and 2 others: AbuseFilter abuse_filter_log table: Store IP addresses as hex values - https://phabricator.wikimedia.org/T395612#11147440 (10Dreamy_Jazz) [11:58:36] 06Data-Engineering, 06Data-Engineering-Radar, 10AbuseFilter, 07Schema-change, and 2 others: AbuseFilter abuse_filter_log table: Store IP addresses as hex values - https://phabricator.wikimedia.org/T395612#11147441 (10Dreamy_Jazz) [12:07:08] 06Data-Engineering, 10Data-Platform-SRE (2025.08.16 - 2025.09.05): Errors from refinery-sqoop-whole-mediawiki.service - September 2025 - re: categorylinks - https://phabricator.wikimedia.org/T403702#11147469 (10fnegri) @BTullis the alert is still in my priorities, I hope to have something working by the end of... [12:32:40] (03CR) 10Mforns: [V:03+2] Change pageview actor automated reasons to a map [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1184740 (https://phabricator.wikimedia.org/T402645) (owner: 10Mforns) [12:32:44] 06Data-Engineering, 10Data-Platform-SRE (2025.08.16 - 2025.09.05): Errors from refinery-sqoop-whole-mediawiki.service - September 2025 - re: categorylinks - https://phabricator.wikimedia.org/T403702#11147570 (10BTullis) >>! In T403702#11147469, @fnegri wrote: > @BTullis the alert is still in my priorities, I h... [12:38:12] 06Data-Engineering, 10Data-Platform-SRE (2025.08.16 - 2025.09.05): Errors from refinery-sqoop-whole-mediawiki.service - September 2025 - re: categorylinks - https://phabricator.wikimedia.org/T403702#11147609 (10BTullis) I manually re-ran the sqoop using a script like this: ` analytics@an-launcher1002:/home/btu... [13:27:23] !log starting refinery deploy to fix pageview actor automated reason [13:27:25] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [13:28:41] !log paused Airflow DAG pageview_actor_hourly [13:28:43] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [13:54:54] !log unpaused Airflow DAG pageview_actor_hourly [13:54:56] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [13:55:07] !log finished refinery deploy to fix pageview actor automated reason [13:55:09] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [14:12:43] 06Data-Engineering, 06Data-Engineering-Radar, 10CheckUser, 06Trust and Safety Product Team, and 3 others: Drop index cul_target_type from cu_log - https://phabricator.wikimedia.org/T401884#11148100 (10Dreamy_Jazz) [14:34:57] 06Data-Engineering-Radar, 10Fundraising analytics stack, 07Epic: [Trino] Connect to Google Sheets - https://phabricator.wikimedia.org/T385748#11148227 (10Gehel) [15:06:49] 06Data-Engineering, 06Data-Engineering-Radar, 10AbuseFilter, 07Schema-change, and 2 others: AbuseFilter abuse_filter_log table: Store IP addresses as hex values - https://phabricator.wikimedia.org/T395612#11148419 (10OKryva-WMF) [15:51:00] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th), 10Event-Platform, 13Patch-For-Review: [Event Platform] eventutilites-python: improve consistency guarantees of async process functions - https://phabricator.wikimedia.org/T347282#11148678 (10Ottomata) [16:10:14] 06Data-Engineering, 10Data-Platform-SRE (2025.08.16 - 2025.09.05): Errors from refinery-sqoop-whole-mediawiki.service - September 2025 - re: categorylinks - https://phabricator.wikimedia.org/T403702#11148753 (10BTullis) 05Open→03Resolved I think that this is all complete now. I reset the failed-service... [16:47:20] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th), 10Event-Platform: EventBus - Add CentralAuth central user id to MediaWiki events - https://phabricator.wikimedia.org/T403664#11148964 (10Ottomata) [17:46:09] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th), 10Event-Platform, 13Patch-For-Review: EventBus - Add central user id to MediaWiki events - https://phabricator.wikimedia.org/T403664#11149342 (10Ottomata) p:05Triage→03High [18:56:14] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th), 10Event-Platform, 13Patch-For-Review: EventBus - Add central user id to MediaWiki events - https://phabricator.wikimedia.org/T403664#11149612 (10Ottomata) @mforns patches ready for review if you are willing! :) cc @tchin as well. [19:26:30] 06Data-Engineering, 06Data-Engineering-Radar, 10AbuseFilter, 06DBA, 07Schema-change-in-production: Add default value for afl_ip and remove default value for afl_ip_hex in abuse_filter_log table - https://phabricator.wikimedia.org/T401906#11149750 (10FCeratto-WMF) [20:14:58] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th), 10Event-Platform, 13Patch-For-Review: EventBus - Add central user id to MediaWiki events - https://phabricator.wikimedia.org/T403664#11149917 (10Ottomata) I waffled between `user_central_id` and `central_user_id`, but chose `user_central_id` because... [20:48:06] (03PS1) 10Ottomata: Sqoop CentralAuth's globaluser and localuser tables [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1184925 (https://phabricator.wikimedia.org/T389666) [20:57:00] 06Data-Engineering, 06SRE, 06Traffic-Icebox, 10MobileFrontend (Tracking): RFC: Serve mobile and desktop variants through the same URL (unified mobile routing) - https://phabricator.wikimedia.org/T214998#11150061 (10Krinkle) [23:18:08] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th), 10Event-Platform, 13Patch-For-Review: EventBus - Add central user id to MediaWiki events - https://phabricator.wikimedia.org/T403664#11150560 (10nshahquinn-wmf) Thank you very much for the invitiation to bikeshed! I'd suggest `user_global_id` instea...