[07:46:11] 06Data-Engineering (Q3 FY25/26 January 1st - March 31th), 10Research-engineering, 06Research-Freezer, 10Event-Platform, 13Patch-For-Review: Productionized Edit Types - https://phabricator.wikimedia.org/T351225#11696094 (10AKhatun_WMF) ===== [Initial Test Version] State of edit type schema and Flink app =... [08:24:58] 06Data-Engineering, 06Data-Engineering-Radar, 06SRE, 10SRE-Access-Requests: Requesting Kerberos access for ben.buchenau - https://phabricator.wikimedia.org/T390734#11696209 (10Ben.buchenau) Hi Andrea! Thanks for picking this up. A good name would be: **wmde_goal_monitoring**. Best, Ben [08:44:25] 06Data-Engineering (Q3 FY25/26 January 1st - March 31th), 06Data-Platform-SRE (2026-03-06 - 2026-03-27): Make canary-events use a single airflow task per dg-run instead of one per stream - https://phabricator.wikimedia.org/T419540#11696288 (10JAllemandou) My assumption was that we would rerun failed airflow ta... [09:17:29] 06Data-Engineering (Q3 FY25/26 January 1st - March 31th), 13Patch-For-Review: DagProperties don't automatically update Airflow variables - https://phabricator.wikimedia.org/T348963#11696364 (10mforns) [09:17:59] 06Data-Engineering (Q3 FY25/26 January 1st - March 31th), 13Patch-For-Review: DagProperties don't automatically update Airflow variables - https://phabricator.wikimedia.org/T348963#11696365 (10mforns) a:03mforns [09:40:57] 06Data-Engineering (Q3 FY25/26 January 1st - March 31th), 10AQS2.0, 13Patch-For-Review: Introduce a new AQS endpoint to expose video plays - https://phabricator.wikimedia.org/T415202#11696437 (10TheDJ) I understand the focus on video (as there is a very specific problem there right now), but I'd like to caut... [09:49:15] (03PS1) 10Joal: Update changelog.md for v0.3.13 [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1250525 [09:49:54] 06Data-Engineering (Q3 FY25/26 January 1st - March 31th), 07Epic: Attribution Research: Instrument Donation Attempts - https://phabricator.wikimedia.org/T419569#11696477 (10Milimetric) [09:53:50] (03CR) 10JavierMonton: [C:03+1] Update changelog.md for v0.3.13 [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1250525 (owner: 10Joal) [09:53:55] 06Data-Engineering, 06Data-Engineering-Radar, 06SRE, 10SRE-Access-Requests: Requesting Kerberos access for ben.buchenau - https://phabricator.wikimedia.org/T390734#11696491 (10BTullis) >>! In T390734#11687686, @Ben.buchenau wrote: > Hello guys - follow-up request regarding Kerebos authentication: Can I get... [09:56:24] 06Data-Engineering (Q3 FY25/26 January 1st - March 31th), 06Movement-Insights: Investigate and repair pageviews and unique devices spike starting in Nov 2025 - https://phabricator.wikimedia.org/T416933#11696495 (10mforns) I agree that a backfill makes sense in this case. Kudos @Hghani for pinpointed the nature... [09:57:35] (03CR) 10Joal: [V:03+2 C:03+2] "Merging for release" [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1250525 (owner: 10Joal) [09:58:22] Starting build #58 for job analytics-refinery-maven-release [10:00:20] 06Data-Engineering, 06Data-Engineering-Radar, 10MediaWiki-extensions-EventLogging, 06Test Kitchen, 07Technical-Debt: Migrate EventLogging to use DefaultEventSubmitter - https://phabricator.wikimedia.org/T375749#11696502 (10phuedx) 05Open→03Declined Experiment Platform are currently running experi... [10:22:19] Project analytics-refinery-maven-release build #58: 09SUCCESS in 23 min: https://integration.wikimedia.org/ci/job/analytics-refinery-maven-release/58/ [10:37:15] !log Test Kitchen edge-unique experiments (poll 239223) - adds: mobile-toc-abc2; removes: none; fields: none - xLab/MPIC/TK tips at https://w.wiki/FwuD [10:37:17] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [11:36:45] 06Data-Engineering, 06Data-Engineering-Radar, 06SRE, 10SRE-Access-Requests: Requesting Kerberos access for ben.buchenau - https://phabricator.wikimedia.org/T390734#11696957 (10Ben.buchenau) Hi Ben & Andrea, Thanks for sharing the info! I implemented a DAG last year together with Andrew McAllister for vide... [11:49:25] 06Data-Engineering (Q3 FY25/26 January 1st - March 31th), 10AQS2.0, 13Patch-For-Review: Introduce a new AQS endpoint to expose video plays - https://phabricator.wikimedia.org/T415202#11697048 (10TheDJ) >>! In T415202#11583694, @GGoncalves-WMF wrote: > Having spoken to @Ladsgroup this morning (thanks!), here'... [12:38:35] 06Data-Engineering (Q3 FY25/26 January 1st - March 31th), 10DPE-Mediawiki-Content: Missing/inconsistent page_redirect_target field for redirects in Mediawiki content current v1 dumps - https://phabricator.wikimedia.org/T400632#11697165 (10APizzata-WMF) >>! In T400632#11652060, @xcollazo wrote: > Will discuss t... [13:00:15] 06Data-Engineering (Q3 FY25/26 January 1st - March 31th), 10AQS2.0, 13Patch-For-Review: Introduce a new AQS endpoint to expose video plays - https://phabricator.wikimedia.org/T415202#11697223 (10AndrewTavis_WMDE) Providing some feedback from @Ben.buchenau and I about this process: - We're wondering whether... [13:27:00] !log Test Kitchen edge-unique experiments (poll 239729) - adds: growthexperiments-editattempt-anonwarning; removes: none; fields: none - xLab/MPIC/TK tips at https://w.wiki/FwuD [13:27:02] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [13:44:52] 06Data-Engineering, 06Research: Make Enterprise HTML Dumps available in hadoop - https://phabricator.wikimedia.org/T305688#11697450 (10Ahoelzl) Should be reviewed in context of https://phabricator.wikimedia.org/T360794 [14:56:40] 06Data-Engineering, 06Data-Platform-SRE (2026-03-06 - 2026-03-27): Task Tries and Logs for Airflow DAGs sometimes unavailable - https://phabricator.wikimedia.org/T419162#11698089 (10BTullis) Do we have any way to try to reproduce this? I haven't seen it happen, personally. As @dr0ptp4kt mentioned: > ...it is d... [15:09:32] 06Data-Engineering, 06Data-Platform-SRE (2026-03-06 - 2026-03-27): Task Tries and Logs for Airflow DAGs sometimes unavailable - https://phabricator.wikimedia.org/T419162#11698195 (10BTullis) [15:11:16] 06Data-Engineering, 06Data-Platform-SRE (2026-03-06 - 2026-03-27): Task Tries and Logs for Airflow DAGs sometimes unavailable - https://phabricator.wikimedia.org/T419162#11698209 (10Gehel) p:05Triage→03Medium [15:14:27] 06Data-Engineering, 06Data-Platform-SRE (2026-03-06 - 2026-03-27): Task Tries and Logs for Airflow DAGs sometimes unavailable - https://phabricator.wikimedia.org/T419162#11698223 (10dr0ptp4kt) >>! In T419162#11698089, @BTullis wrote: > Do we have any way to try to reproduce this? I haven't seen it happen, pers... [16:35:04] 06Data-Engineering, 06Data-Engineering-Radar, 06SRE, 10SRE-Access-Requests: Requesting Kerberos access for ben.buchenau - https://phabricator.wikimedia.org/T390734#11698609 (10BTullis) Thanks for the additional context @Ben.buchenau. I think that there might be a bit of a misunderstanding here: > I checked... [16:39:36] 06Data-Engineering, 06Data-Engineering-Radar, 10MediaWiki-extensions-EventLogging, 07Essential-Work, 06Test Kitchen (Experiment Platform Sprint 20): Deluge of inactionable console warnings - https://phabricator.wikimedia.org/T419481#11698642 (10Ottomata) [16:39:52] 06Data-Engineering (Q3 FY25/26 January 1st - March 31th), 06Data-Platform-SRE (2026-03-06 - 2026-03-27): Task Tries and Logs for Airflow DAGs sometimes unavailable - https://phabricator.wikimedia.org/T419162#11698645 (10Ahoelzl) [16:41:55] 06Data-Engineering, 06Data-Engineering-Icebox, 10Dumps-Generation, 13Patch-Needs-Improvement: Add versioning to DCAT-AP config - https://phabricator.wikimedia.org/T198676#11698668 (10Ottomata) [16:44:35] 06Data-Engineering, 06Data-Engineering-Radar, 06Commons, 10Dumps-Generation, 10StructuredDataOnCommons: Wikimedia Commons entity dumps are lacking datatype field - https://phabricator.wikimedia.org/T311977#11698680 (10Ottomata) [16:44:48] 06Data-Engineering (Q3 FY25/26 January 1st - March 31th), 06Data-Platform-SRE (2026-03-06 - 2026-03-27): Optimize enqueueing of refine_webrequest_hourly pipeline - https://phabricator.wikimedia.org/T419050#11698687 (10Ahoelzl) [16:45:51] 06Data-Engineering, 06Data-Engineering-Radar, 06Data-Platform-SRE, 10Dumps-Generation, and 3 others: mediawiki-dumps-legacy is running without security policy on dse-k8s-eqiad - https://phabricator.wikimedia.org/T419259#11698701 (10Ottomata) [16:47:14] 06Data-Engineering (Q3 FY25/26 January 1st - March 31th): The revision_seconds_to_identity_revert field in wmf.mediawiki_history has sometimes negative values - https://phabricator.wikimedia.org/T419267#11698710 (10Ahoelzl) [16:52:32] 06Data-Engineering (Q3 FY25/26 January 1st - March 31th): Create an MVP data product of API requests - https://phabricator.wikimedia.org/T419522#11698742 (10Ahoelzl) [16:54:36] 06Data-Engineering (Q3 FY25/26 January 1st - March 31th): Adapt Sqoop for imagelinks schema changes - https://phabricator.wikimedia.org/T416481#11698754 (10Ottomata) {T419635} just showed up in #Data-Engineering inbox. Just verifying that the sqoop work is coordinated with the mariadb work. [16:54:40] 06Data-Engineering, 06Data-Engineering-Radar, 06DBA, 07Schema-change-in-production: Drop il_to column from imagelinks table in wmf production - https://phabricator.wikimedia.org/T419635#11698757 (10Ottomata) [16:55:18] 06Data-Engineering, 06Data-Engineering-Radar, 06DBA, 07Schema-change-in-production: Drop il_to column from imagelinks table in wmf production - https://phabricator.wikimedia.org/T419635#11698759 (10Ottomata) Just verifying that {T419635} is being coordinated appropriately. [16:57:21] 06Data-Engineering: Add new API rate limiting fields from webrequest_logs to Turnilo view - https://phabricator.wikimedia.org/T419736 (10HCoplin-WMF) 03NEW [16:58:05] 06Data-Engineering (Q3 FY25/26 January 1st - March 31th): Adapt Sqoop for imagelinks schema changes - https://phabricator.wikimedia.org/T416481#11698783 (10Snwachukwu) [16:58:35] 06Data-Engineering (Q3 FY25/26 January 1st - March 31th): Adapt Sqoop for imagelinks schema changes - https://phabricator.wikimedia.org/T416481#11698784 (10Snwachukwu) The sqoop work is done. [16:58:46] 06Data-Engineering (Q3 FY25/26 January 1st - March 31th): Add new API rate limiting fields from webrequest_logs to Turnilo view - https://phabricator.wikimedia.org/T419736#11698786 (10Ahoelzl) [17:22:03] 06Data-Engineering (Q3 FY25/26 January 1st - March 31th), 06Research, 10Event-Platform, 13Patch-For-Review: Event stream with latest revision HTML & parent revision HTML diff - https://phabricator.wikimedia.org/T360794#11698867 (10BTullis) >>! In T360794#11692023, @JMonton-WMF wrote: > Hi @BTullis, > Coul... [17:40:21] 06Data-Engineering (Q3 FY25/26 January 1st - March 31th), 13Patch-For-Review: Do multiple code and data clean ups for content tables - https://phabricator.wikimedia.org/T418754#11698943 (10xcollazo) [18:00:26] 06Data-Engineering (Q3 FY25/26 January 1st - March 31th), 10Research-engineering, 06Research-Freezer, 10Event-Platform, 13Patch-For-Review: Productionized Edit Types - https://phabricator.wikimedia.org/T351225#11699031 (10AKhatun_WMF) Hi @BTullis, I'd need the s3 users created for the `mw-page-edit-type-... [18:04:17] 06Data-Engineering (Q3 FY25/26 January 1st - March 31th), 13Patch-For-Review: Do multiple code and data clean ups for content tables - https://phabricator.wikimedia.org/T418754#11699058 (10xcollazo) At beginning of this task: >>! In T418754#11664610, @xcollazo wrote: > ... > ` > !hdfs dfs -count -h /wmf/data/w... [18:07:26] 06Data-Engineering (Q3 FY25/26 January 1st - March 31th), 13Patch-For-Review: Do multiple code and data clean ups for content tables - https://phabricator.wikimedia.org/T418754#11699083 (10xcollazo) In prod: ` $ spark3-sql spark-sql (default)> ALTER TABLE wmf_content.mediawiki_revision_history_v1... [18:09:25] (03PS2) 10Snwachukwu: Extend mediarequest Cassandra loads with poster/plays for video-requests API [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1250005 (https://phabricator.wikimedia.org/T415202) [18:18:49] 06Data-Engineering (Q3 FY25/26 January 1st - March 31th), 13Patch-For-Review: Do multiple code and data clean ups for content tables - https://phabricator.wikimedia.org/T418754#11699127 (10xcollazo) [18:19:19] 06Data-Engineering, 10MediaWiki-extensions-CentralAuth, 06MediaWiki-Platform-Team, 06Growth-Team (FY2025-26 Q3 Sprint 5): New accounts created from editor anon warning redirect to welcome survey, not back to editor (2026) - https://phabricator.wikimedia.org/T419723#11699134 (10Michael) p:05Triage→03Unbr... [18:57:14] 06Data-Engineering (Q3 FY25/26 January 1st - March 31th), 13Patch-For-Review: Monthly reconcile continues to emit a really large amount of events after user_id changes - https://phabricator.wikimedia.org/T419055#11699345 (10xcollazo) I have renamed the last `all-of-wiki-time` reconcile run to `all-of-wiki-time... [19:01:59] 06Data-Engineering (Q3 FY25/26 January 1st - March 31th), 13Patch-For-Review: Monthly reconcile continues to emit a really large amount of events after user_id changes - https://phabricator.wikimedia.org/T419055#11699373 (10xcollazo) Double checked that `mw_content_reconcile_mw_content_history_monthly` DAG has... [19:09:41] !log Test Kitchen edge-unique experiments (poll 240750) - adds: none; removes: growthexperiments-editattempt-anonwarning; fields: none - xLab/MPIC/TK tips at https://w.wiki/FwuD [19:09:43] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [19:22:51] 06Data-Engineering, 10MediaWiki-extensions-CentralAuth, 06MediaWiki-Platform-Team, 06Growth-Team (FY2025-26 Q3 Sprint 5): New accounts created from editor anon warning redirect to welcome survey, not back to editor (2026) - https://phabricator.wikimedia.org/T419723#11699427 (10Tgr) I couldn't reproduce - r... [19:35:25] 06Data-Engineering, 10MediaWiki-extensions-CentralAuth, 06MediaWiki-Platform-Team, 06Growth-Team (FY2025-26 Q3 Sprint 5): New accounts created from editor anon warning redirect to welcome survey, not back to editor (2026) - https://phabricator.wikimedia.org/T419723#11699473 (10Michael) >>! In T419723#11699... [19:42:04] 06Data-Engineering, 10MediaWiki-extensions-CentralAuth, 06MediaWiki-Platform-Team, 06Growth-Team (FY2025-26 Q3 Sprint 5): New accounts created from editor anon warning redirect to welcome survey, not back to editor (2026) - https://phabricator.wikimedia.org/T419723#11699490 (10Michael) I just reproduced it... [20:20:27] 06Data-Engineering, 10MediaWiki-extensions-CentralAuth, 06MediaWiki-Platform-Team, 06Growth-Team (FY2025-26 Q3 Sprint 5): New accounts created from editor anon warning redirect to welcome survey, not back to editor (2026) - https://phabricator.wikimedia.org/T419723#11699682 (10KStoller-WMF) p:05Unbreak!→... [21:32:59] 06Data-Engineering, 10MediaWiki-extensions-CentralAuth, 06MediaWiki-Platform-Team, 06Growth-Team (FY2025-26 Q3 Sprint 5): New accounts created from editor anon warning redirect to welcome survey, not back to editor (2026) - https://phabricator.wikimedia.org/T419723#11700027 (10Tgr) Thanks. That looks corre... [21:38:57] 06Data-Engineering, 10MediaWiki-extensions-CentralAuth, 06MediaWiki-Platform-Team, 06Growth-Team (FY2025-26 Q3 Sprint 5): New accounts created from editor anon warning redirect to welcome survey, not back to editor (2026) - https://phabricator.wikimedia.org/T419723#11700046 (10Tgr) Nevermind, I'm misrememb... [21:43:18] 06Data-Engineering, 10MediaWiki-extensions-CentralAuth, 06MediaWiki-Platform-Team, 06Growth-Team (FY2025-26 Q3 Sprint 5): New accounts created from editor anon warning redirect to welcome survey, not back to editor (2026) - https://phabricator.wikimedia.org/T419723#11700053 (10Tgr) ...you probably shouldn'... [22:01:48] !log Test Kitchen edge-unique experiments (poll 241263) - adds: none; removes: mobile-toc-abc2; fields: none - xLab/MPIC/TK tips at https://w.wiki/FwuD [22:01:50] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [22:35:07] 06Data-Engineering (Q3 FY25/26 January 1st - March 31th), 06Research, 10Event-Platform: Analyze size distribution of wiki page html - https://phabricator.wikimedia.org/T419495#11700223 (10cscott) I added some graphs to https://grafana.wikimedia.org/dashboard/snapshot/xzDtG1FZnWCRRaFBQKw2oxpmzK8EUZec -- the t...