[02:06:16] 14Analytics, 06Data-Engineering, 06Test Kitchen: Count the number of video plays - https://phabricator.wikimedia.org/T198628#11532177 (10Ladsgroup) This is somewhat easy to fix without needing to load js and doing tracking. Someone should have looked at the data in depth. Let me give you an example: Top vide... [02:19:05] (03PS1) 10Ladsgroup: mediarequest: Stop counting poster images as media views [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1228304 (https://phabricator.wikimedia.org/T198628) [06:26:23] 06Data-Engineering, 06DBA, 07Schema-change-in-production: Add il_target_id to imagelinks table in wmf production - https://phabricator.wikimedia.org/T413525#11532308 (10Marostegui) [06:29:39] 06Data-Engineering, 06DBA, 07Schema-change-in-production: Add il_target_id to imagelinks table in wmf production - https://phabricator.wikimedia.org/T413525#11532313 (10Marostegui) Some hosts were not done in codfw: db2248, db2240 And in eqiad db1262 I am running it now on them. [08:09:07] 14Analytics, 06Data-Engineering, 06Test Kitchen, 13Patch-For-Review: Count the number of video plays - https://phabricator.wikimedia.org/T198628#11532393 (10TheDJ) >>! In T198628#11532177, @Ladsgroup wrote: > This is somewhat easy to fix without needing to load js and doing tracking. Someone should have lo... [09:38:43] 06Data-Engineering, 10Dumps-Generation, 06Data-Platform-SRE (2026.01.05 - 2026.01.23), 07Essential-Work: Dump indexes do not agree - https://phabricator.wikimedia.org/T401048#11532659 (10BTullis) 05Open→03Declined I'm going to decline this ticket, since this work is likely to supersede it: {T414389} [09:39:13] 06Data-Engineering (Q3 FY25/26 January 1st - March 31th): Switch Refine DAG priority weights to absolute - https://phabricator.wikimedia.org/T414810#11532666 (10JAllemandou) [09:39:16] 06Data-Engineering (Q3 FY25/26 January 1st - March 31th), 06Data-Platform-SRE (2026.01.05 - 2026.01.23), 07Essential-Work: Airflow-main scheduler loop sometimes slows down markedly - https://phabricator.wikimedia.org/T412003#11532667 (10JAllemandou) [09:44:51] 06Data-Engineering, 06Infrastructure-Foundations, 06Traffic, 13Patch-For-Review: Export development_network_probe data to Puppet servers for CDN deployment - https://phabricator.wikimedia.org/T402512#11532749 (10brouberol) @MoritzMuehlenhoff re `cn=ops,ou=groups,dc=wikimedia,dc=org` understood! The LDAP/Ai... [09:52:04] 06Data-Engineering, 06Infrastructure-Foundations, 06Traffic, 13Patch-For-Review: Export development_network_probe data to Puppet servers for CDN deployment - https://phabricator.wikimedia.org/T402512#11532864 (10brouberol) [10:31:51] 06Data-Engineering (Q3 FY25/26 January 1st - March 31th): Reduce main Airflow DB size and consider splitting heavy workloads into separate instances - https://phabricator.wikimedia.org/T411992#11533116 (10Antoine_Quhen) Deployment of db_cleaner dag on Airflow instances went mostly well. The exception was `searc... [11:24:29] 06Data-Engineering, 06DBA, 07Schema-change-in-production: Add il_target_id to imagelinks table in wmf production - https://phabricator.wikimedia.org/T413525#11533256 (10Marostegui) db1262 done [11:36:10] 06Data-Engineering, 06Infrastructure-Foundations, 06Traffic: Export development_network_probe data to Puppet servers for CDN deployment - https://phabricator.wikimedia.org/T402512#11533322 (10brouberol) https://airflow-sre.wikimedia.org has been deployed! {F71570205} Give it a good hour for the ATS change... [11:46:48] 06Data-Engineering, 06DBA, 07Schema-change-in-production: Add il_target_id to imagelinks table in wmf production - https://phabricator.wikimedia.org/T413525#11533371 (10Marostegui) Running this schema change on the old s4 eqiad master: db1160 [12:32:23] 06Data-Engineering (Q3 FY25/26 January 1st - March 31th), 06Data-Platform-SRE (2026.01.05 - 2026.01.23), 07Essential-Work: Airflow-main scheduler loop sometimes slows down markedly - https://phabricator.wikimedia.org/T412003#11533481 (10JAllemandou) My latest findings on this: * Heavy networking on scheduler... [12:39:59] 06Data-Engineering (Q3 FY25/26 January 1st - March 31th), 06Data-Platform-SRE (2026.01.05 - 2026.01.23), 07Essential-Work: Refine generates very large XCOM values - https://phabricator.wikimedia.org/T414953 (10JAllemandou) 03NEW [12:40:33] 06Data-Engineering, 06SRE, 10SRE-Access-Requests, 13Patch-For-Review: Requesting access to analytics-privatedata-users for kareid - https://phabricator.wikimedia.org/T413364#11533524 (10FCeratto-WMF) 05Open→03In progress a:03FCeratto-WMF [12:41:59] 06Data-Engineering (Q3 FY25/26 January 1st - March 31th): Change delete selection for SLO metric - https://phabricator.wikimedia.org/T414779#11533540 (10APizzata-WMF) Testing the following solution: ` deletes_and_undeletes as ( -- select all the pages that have both delete and undelete change_kind... [12:43:03] 06Data-Engineering (Q3 FY25/26 January 1st - March 31th), 06Data-Platform-SRE (2026.01.05 - 2026.01.23), 07Essential-Work: Airflow-main scheduler loop sometimes slows down markedly - https://phabricator.wikimedia.org/T412003#11533545 (10JAllemandou) I'm calling this investigation done. There are 2 follow up... [12:43:29] 06Data-Engineering (Q3 FY25/26 January 1st - March 31th), 06Data-Platform-SRE (2026.01.05 - 2026.01.23), 07Essential-Work: Airflow-main scheduler loop sometimes slows down markedly - https://phabricator.wikimedia.org/T412003#11533549 (10JAllemandou) 05Open→03Resolved [13:22:45] 06Data-Engineering, 06Data-Persistence, 10GlobalBlocking, 07Essential-Work, and 2 others: Change type of gb_address to VARBINARY - https://phabricator.wikimedia.org/T414211#11533692 (10Dreamy_Jazz) a:03Dreamy_Jazz [13:25:16] 06Data-Engineering, 10Data-Engineering-Wikistats, 10Pageviews-Anomaly: Sudden traffic increase on 1 November 2025 - https://phabricator.wikimedia.org/T412655#11533699 (10Oesjaar) Hi there! Any progress? I am from afwiki. [13:26:28] 14Analytics, 06Data-Engineering, 06Test Kitchen, 13Patch-For-Review: Count the number of video plays - https://phabricator.wikimedia.org/T198628#11533700 (10Ladsgroup) >>! In T198628#11532393, @TheDJ wrote: >>>! In T198628#11532177, @Ladsgroup wrote: >> One thing to note that SRE has a vested interest to s... [13:35:52] 06Data-Engineering, 10CheckUser, 06DBA, 06Product Safety and Integrity, 07Schema-change-in-production: Remove default from gb_address in globalblocks table on WMF wikis - https://phabricator.wikimedia.org/T414964 (10Dreamy_Jazz) 03NEW [13:36:32] 06Data-Engineering, 10CheckUser, 06DBA, 06Product Safety and Integrity, 07Schema-change-in-production: Remove default from gb_address in globalblocks table on WMF wikis - https://phabricator.wikimedia.org/T414964#11533771 (10Marostegui) p:05Triage→03Medium a:03Marostegui [13:36:50] 06Data-Engineering, 06Data-Persistence, 10GlobalBlocking, 07Essential-Work, and 2 others: Change type of gb_address to VARBINARY - https://phabricator.wikimedia.org/T414211#11533786 (10Dreamy_Jazz) [13:37:18] 06Data-Engineering, 10CheckUser, 06DBA, 06Product Safety and Integrity, 07Schema-change-in-production: Remove default from gb_address in globalblocks table on WMF wikis - https://phabricator.wikimedia.org/T414964#11533806 (10Dreamy_Jazz) [13:37:31] 06Data-Engineering, 10CheckUser, 06DBA, 06Product Safety and Integrity, 07Schema-change-in-production: Remove default from gb_address in globalblocks table on WMF wikis - https://phabricator.wikimedia.org/T414964#11533808 (10Marostegui) 05Open→03Resolved Done on the master with replication [13:38:27] 06Data-Engineering, 06Data-Persistence, 10GlobalBlocking, 07Essential-Work, and 2 others: Change type of gb_address to VARBINARY - https://phabricator.wikimedia.org/T414211#11533818 (10Dreamy_Jazz) 05Open→03Resolved Schema change applied to the extension to fix the type inconsistency, filed T395669... [14:04:04] 06Data-Engineering (Q3 FY25/26 January 1st - March 31th): Troubleshoot duplicates issue in mw_content_merge_events_to_mw_content_history_daily - https://phabricator.wikimedia.org/T410431#11534001 (10APizzata-WMF) While exploring the data and validating the solution in T414779, found the following curious example... [14:30:07] !log Test Kitchen edge-unique experiments (poll 21350) - adds: none; removes: fy25-26-we-4-2-hcaptcha-editing; fields: none - xLab/MPIC/TK tips at https://w.wiki/FwuD [14:30:09] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [16:09:50] 06Data-Engineering (Q3 FY25/26 January 1st - March 31th): Troubleshoot duplicates issue in mw_content_merge_events_to_mw_content_history_daily - https://phabricator.wikimedia.org/T410431#11534523 (10APizzata-WMF) > I have yet to understand what's happening behind the scenes, but maybe the presence of the `delet... [16:42:52] 06Data-Engineering, 06SRE, 10SRE-Access-Requests: Requesting access to analytics-privatedata-users for kareid - https://phabricator.wikimedia.org/T413364#11534704 (10FCeratto-WMF) @KReid-WMF access configured - can you please confirm it works so we can close the task? Thanks [20:54:27] 06Data-Engineering, 06Data-Platform-SRE, 06SRE, 10SRE-Access-Requests: Grant Access to analytics-privatedata-users for hmonroy - https://phabricator.wikimedia.org/T414375#11535094 (10Ottomata) 05Open→03Invalid @HMonroy, [[ https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Edits/MediaWiki_...