[05:42:51] 06Data-Engineering, 06DBA, 13Patch-For-Review, 07Schema-change-in-production: Drop rc_type from recentchanges in wmf production - https://phabricator.wikimedia.org/T410531#11418163 (10Marostegui) [05:48:35] 06Data-Engineering, 06DBA, 13Patch-For-Review, 07Schema-change-in-production: Drop rc_type from recentchanges in wmf production - https://phabricator.wikimedia.org/T410531#11418168 (10Marostegui) [05:48:39] 06Data-Engineering, 06DBA, 13Patch-For-Review, 07Schema-change-in-production: Drop rc_type from recentchanges in wmf production - https://phabricator.wikimedia.org/T410531#11418170 (10Marostegui) 05Open→03Resolved This is all done [05:49:39] 06Data-Engineering, 06DBA, 07Schema-change-in-production: Drop ar_sha1 from archive table in wmf production - https://phabricator.wikimedia.org/T411163#11418173 (10Marostegui) [06:44:28] 06Data-Engineering, 06DBA, 07Schema-change-in-production: Drop ar_sha1 from archive table in wmf production - https://phabricator.wikimedia.org/T411163#11418205 (10Marostegui) [06:44:32] 06Data-Engineering, 06DBA, 07Schema-change-in-production: Drop rev_sha1 from revision table in wmf production - https://phabricator.wikimedia.org/T411164#11418206 (10Marostegui) [08:17:30] 06Data-Engineering, 06Data-Engineering-Radar, 10Observability-Logging, 06serviceops, and 2 others: Fix Kafka replicas skew - https://phabricator.wikimedia.org/T407185#11418283 (10brouberol) I've generated a rebalancing plan on `kafka-main2008` using ` brouberol@kafka-main2008:~/T407185$ topicmappr rebalanc... [09:43:27] (03PS1) 10Joal: Fix sqoop archive and revision queries settings [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1213423 [09:45:36] (03CR) 10A-pizzata: [C:03+1] Fix sqoop archive and revision queries settings [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1213423 (owner: 10Joal) [09:46:03] (03CR) 10JavierMonton: [C:03+1] Fix sqoop archive and revision queries settings [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1213423 (owner: 10Joal) [09:58:36] 06Data-Engineering, 10MediaWiki-extensions-EventLogging, 10mwcli: Update eventlogging image for MWCLI - https://phabricator.wikimedia.org/T406317#11418670 (10Addshore) > n one find the latest deployed container images for various services these days? TLDR is I'm trying to find out what version of https://doc... [10:05:05] (03CR) 10Joal: [V:03+2 C:03+2] "Hotfix - merging" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1213423 (owner: 10Joal) [10:06:47] 06Data-Engineering, 10MediaWiki-extensions-EventLogging, 10mwcli, 13Patch-For-Review: Update eventlogging image for MWCLI - https://phabricator.wikimedia.org/T406317#11418710 (10Addshore) Looking encouraging ` wdev dev dc logs eventlogging eventlogging-1 | {"@timestamp":"2025-12-01T10:02:21.336Z","ecs.ve... [10:06:56] 06Data-Engineering, 10MediaWiki-extensions-EventLogging, 10mwcli, 13Patch-For-Review: Update eventlogging image for MWCLI - https://phabricator.wikimedia.org/T406317#11418712 (10Addshore) a:03Addshore [10:49:51] !log Deployed refinery using scap, then deployed onto hdfs [10:49:53] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [11:25:46] !log Test Kitchen mw-user experiment (poll 46014) - adds: none; removes: growthexperiments-get-started-notification; fields: none - xLab/MPIC/TK tips at https://w.wiki/FwuD [11:25:48] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [11:48:14] 06Data-Engineering, 06DBA, 07Schema-change-in-production: Drop ar_sha1 from archive table in wmf production - https://phabricator.wikimedia.org/T411163#11418940 (10Marostegui) [11:48:37] 06Data-Engineering, 06DBA, 07Schema-change-in-production: Drop ar_sha1 from archive table in wmf production - https://phabricator.wikimedia.org/T411163#11418953 (10Marostegui) [11:48:56] 06Data-Engineering, 06DBA, 07Schema-change-in-production: Drop ar_sha1 from archive table in wmf production - https://phabricator.wikimedia.org/T411163#11418956 (10Marostegui) [13:31:14] 06Data-Engineering, 06Machine-Learning-Team, 06serviceops: Enable ChangeProp to consume mediawiki.page_content_change.v1 - https://phabricator.wikimedia.org/T409469#11419269 (10achou) [13:31:44] 06Data-Engineering, 06Machine-Learning-Team, 06serviceops: Enable ChangeProp to consume mediawiki.page_content_change.v1 - https://phabricator.wikimedia.org/T409469#11419273 (10achou) 05Open→03Declined [14:45:26] (03PS1) 10Mforns: Add user_agent_map to the ja3n_ua_hourly table [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1213488 (https://phabricator.wikimedia.org/T409584) [14:55:38] (03PS2) 10Mforns: YAdd user_agent_map to the ja3n_ua_hourly table [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1213488 (https://phabricator.wikimedia.org/T409584) [14:56:51] (03PS3) 10Mforns: Add user_agent_map to the ja3n_ua_hourly table [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1213488 (https://phabricator.wikimedia.org/T409584) [15:06:47] (03CR) 10Hghani: [C:03+1] Add user_agent_map to the ja3n_ua_hourly table [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1213488 (https://phabricator.wikimedia.org/T409584) (owner: 10Mforns) [15:09:50] (03CR) 10Mforns: [V:03+2 C:03+2] "Deploying!" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1213488 (https://phabricator.wikimedia.org/T409584) (owner: 10Mforns) [15:31:02] 06Data-Engineering, 10DPE-Mediawiki-Content, 06Data-Platform-SRE (2025.11.07 - 2025.11.28): When wikis cannot be exported due to SiteInfo, don't fail them - https://phabricator.wikimedia.org/T408819#11419808 (10xcollazo) > If that works as expected, I'll try to integrate it into the dump DAGs. Nice! [16:10:11] (03PS1) 10Mforns: Fix issue in ja3n_ua_hourly query [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1213522 (https://phabricator.wikimedia.org/T409584) [16:16:43] (03CR) 10Mforns: [V:03+2 C:03+2] "Very small fix, already tested. Self-merging!" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1213522 (https://phabricator.wikimedia.org/T409584) (owner: 10Mforns) [16:28:23] 06Data-Engineering (Q2 FY25/26 October 1st - December 31th): Human vs Bot ALERTING - https://phabricator.wikimedia.org/T411378 (10Snwachukwu) 03NEW [16:29:43] 06Data-Engineering (Q2 FY25/26 October 1st - December 31th): Human vs Bot Alerting Email Upgrade - https://phabricator.wikimedia.org/T411378#11420060 (10Snwachukwu) [16:38:32] 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 06Data-Platform-SRE (2025.11.07 - 2025.11.28), 07OKR-Work, 13Patch-For-Review: Provide a Spark production access for dbt with Airflow - https://phabricator.wikimedia.org/T410017#11420120 (10BTullis) I ran into a bit of a problem because the pre-b... [18:15:28] 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 06Data-Platform-SRE: Create alert on Airflow scheduler slow down - https://phabricator.wikimedia.org/T411405 (10Ahoelzl) 03NEW [19:59:36] 06Data-Engineering (Q2 FY25/26 October 1st - December 31th): Review and productionize the WME differential privacy data set - https://phabricator.wikimedia.org/T409601#11421076 (10Snwachukwu) Hi @Htriedman . Can you help me confirm that these are all the list of output tables that need to be moved to a non-user... [20:10:22] 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 13Patch-For-Review: Develop HQL Scripts for Creating Global Editor Metrics Cassandra Tables in Hive. - https://phabricator.wikimedia.org/T410289#11421119 (10Snwachukwu) 05In progress→03Resolved [20:11:50] 06Data-Engineering (Q2 FY25/26 October 1st - December 31th): Review and productionize the WME differential privacy data set - https://phabricator.wikimedia.org/T409601#11421128 (10Snwachukwu) Regarding the schema @Htriedman , I took alook at the hourly job output table schemas, and I noticed the following: 1. T... [21:17:56] (03PS1) 10Mforns: Modify ja3n_ua_hourly queries to migrate the table to Iceberg [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1213572 (https://phabricator.wikimedia.org/T409584)