[00:23:52] 06Data-Engineering, 06DBA: Move SpecialUnusedTemplates computation to Hadoop - https://phabricator.wikimedia.org/T422443 (10Zabe) 03NEW [00:24:46] 06Data-Engineering, 06DBA: Move SpecialUnusedImages computation to Hadoop - https://phabricator.wikimedia.org/T422444 (10Zabe) 03NEW [00:25:24] 06Data-Engineering, 06DBA: Move SpecialWantedFiles computation to Hadoop - https://phabricator.wikimedia.org/T422445 (10Zabe) 03NEW [00:26:02] 06Data-Engineering, 06DBA: Move SpecialLonelyPages computation to Hadoop - https://phabricator.wikimedia.org/T422446 (10Zabe) 03NEW [00:26:40] 06Data-Engineering, 06DBA: Move SpecialDisambiguationPageLinks computation to Hadoop - https://phabricator.wikimedia.org/T422447 (10Zabe) 03NEW [00:27:35] 06Data-Engineering, 06DBA: Move SpecialUnusedCategories computation to Hadoop - https://phabricator.wikimedia.org/T422448 (10Zabe) 03NEW [00:28:05] 06Data-Engineering, 06DBA: Move SpecialLonelyPages computation to Hadoop - https://phabricator.wikimedia.org/T422446#11791923 (10Zabe) →14Duplicate dup:03T371662 [00:28:40] 06Data-Engineering, 06DBA: Move SpecialUncategorizedImages computation to Hadoop - https://phabricator.wikimedia.org/T422449 (10Zabe) 03NEW [00:29:18] 06Data-Engineering, 06DBA: Move SpecialWantedCategories computation to Hadoop - https://phabricator.wikimedia.org/T422450 (10Zabe) 03NEW [00:38:50] (03PS1) 10Zabe: querypage: Add UnusedCategories.hql [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1268292 (https://phabricator.wikimedia.org/T422448) [00:49:04] 06Data-Engineering, 06DBA: Move SpecialUnusedImages computation to Hadoop - https://phabricator.wikimedia.org/T422444#11791968 (10Zabe) It might make sense to wait with this one until {T416548} is done. [05:14:27] 06Data-Engineering, 06Data-Engineering-Radar, 06DBA: Re-run maintainviews on all clouddb* and an-redacteddb1001.eqiad.wmnet - https://phabricator.wikimedia.org/T422459 (10Marostegui) 03NEW [05:14:30] 06Data-Engineering, 06Data-Engineering-Radar, 06DBA: Re-run maintainviews on all clouddb* and an-redacteddb1001.eqiad.wmnet - https://phabricator.wikimedia.org/T422459#11792275 (10Marostegui) p:05Triage→03High [06:00:57] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 06Growth-Team, 10Image-Suggestions, 13Patch-For-Review: Add an Image: filtering by suggestion "kind" or "confidence" - https://phabricator.wikimedia.org/T368987#11792324 (10dcausse) @Ahoelzl yes I can confirm the run scheduled on April 2nd did run prop... [06:48:25] 06Data-Engineering, 06Data-Persistence: Move SpecialWantedCategories computation to Hadoop - https://phabricator.wikimedia.org/T422450#11792405 (10Marostegui) [06:49:04] 06Data-Engineering, 06Data-Persistence, 13Patch-For-Review: Move SpecialUnusedCategories computation to Hadoop - https://phabricator.wikimedia.org/T422448#11792407 (10Marostegui) [06:49:09] 06Data-Engineering, 06Data-Persistence: Move SpecialUnusedTemplates computation to Hadoop - https://phabricator.wikimedia.org/T422443#11792408 (10Marostegui) [06:49:18] 06Data-Engineering, 06Data-Persistence: Move SpecialWantedFiles computation to Hadoop - https://phabricator.wikimedia.org/T422445#11792409 (10Marostegui) [06:49:35] 06Data-Engineering, 06Data-Persistence: Move SpecialUncategorizedImages computation to Hadoop - https://phabricator.wikimedia.org/T422449#11792411 (10Marostegui) [06:49:44] 06Data-Engineering, 06Data-Persistence: Move SpecialDisambiguationPageLinks computation to Hadoop - https://phabricator.wikimedia.org/T422447#11792412 (10Marostegui) [06:49:58] 06Data-Engineering, 06Data-Persistence: Move SpecialUnusedImages computation to Hadoop - https://phabricator.wikimedia.org/T422444#11792413 (10Marostegui) [08:03:39] 06Data-Engineering, 06Data-Engineering-Radar, 06DBA, 07Schema-change-in-production: Drop il_to column from imagelinks table in wmf production - https://phabricator.wikimedia.org/T419635#11792541 (10FCeratto-WMF) [08:06:28] (03CR) 10Joal: Implement more verbose error logging of Sqoop (031 comment) [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1268268 (https://phabricator.wikimedia.org/T422412) (owner: 10Aleksandar Mastilovic) [08:07:30] 06Data-Engineering, 06Data-Engineering-Radar, 06DBA, 07Schema-change-in-production: Drop il_to column from imagelinks table in wmf production - https://phabricator.wikimedia.org/T419635#11792552 (10FCeratto-WMF) [08:10:52] 06Data-Engineering, 06Data-Engineering-Radar, 06cloud-services-team, 10Data-Services, 06DBA: Re-run maintainviews on all clouddb* and an-redacteddb1001.eqiad.wmnet - https://phabricator.wikimedia.org/T422459#11792557 (10taavi) [08:11:42] (03CR) 10Joal: querypage: MostCategories: Include all content namespaces (031 comment) [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1267966 (https://phabricator.wikimedia.org/T413362) (owner: 10Zabe) [08:14:03] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 13Patch-For-Review: Implement list of JA3N-JA4H pairs to be tagged as automated into the bot detection pipeline - https://phabricator.wikimedia.org/T420412#11792564 (10JAllemandou) Plan looks good to me :) [08:16:03] 06Data-Engineering, 06Data-Engineering-Icebox, 06DBA, 13Patch-For-Review: Move Mostcategories computation to Hadoop - https://phabricator.wikimedia.org/T413362#11792570 (10JAllemandou) Ping @Ahoelzl on this. There are patches to review that the team doesn't know about. [08:25:48] 14Analytics-Radar, 06Data-Engineering, 06Data-Engineering-Icebox, 10WMDE-TechWish-Maintenance, 13Patch-For-Review: Add missing normalization to CodeMirror Grafana board - https://phabricator.wikimedia.org/T273748#11792607 (10WMDE-Fisch) 05Open→03Invalid Cleaning up, the Grafana board got deprecat... [08:26:35] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 06Traffic: Surge in webrequest validation check - https://phabricator.wikimedia.org/T422030#11792610 (10JAllemandou) >>! In T422030#11789124, @Vgutierrez wrote: An interesting change in behavior from 3.0 to 3.2 and that could be related is that after the u... [08:38:24] 06Data-Engineering, 06DBA: Move SpecialUnusedImages computation to Hadoop - https://phabricator.wikimedia.org/T422444#11792668 (10Ladsgroup) (After talking to Manuel, I'm putting back DBA so we can keep track of Zabe's work in this area) [08:38:41] 06Data-Engineering, 06DBA: Move SpecialUnusedImages computation to Hadoop - https://phabricator.wikimedia.org/T422444#11792671 (10Ladsgroup) p:05Triage→03Medium [08:39:09] 06Data-Engineering, 06DBA: Move SpecialDisambiguationPageLinks computation to Hadoop - https://phabricator.wikimedia.org/T422447#11792687 (10Ladsgroup) [08:39:21] 06Data-Engineering, 06DBA: Move SpecialDisambiguationPageLinks computation to Hadoop - https://phabricator.wikimedia.org/T422447#11792690 (10Ladsgroup) p:05Triage→03Medium [08:39:51] 06Data-Engineering, 06DBA, 13Patch-For-Review: Move SpecialUnusedCategories computation to Hadoop - https://phabricator.wikimedia.org/T422448#11792691 (10Ladsgroup) [08:40:08] 06Data-Engineering, 06DBA, 13Patch-For-Review: Move SpecialUnusedCategories computation to Hadoop - https://phabricator.wikimedia.org/T422448#11792695 (10Ladsgroup) p:05Triage→03Medium [08:40:30] 06Data-Engineering, 06DBA: Move SpecialUnusedTemplates computation to Hadoop - https://phabricator.wikimedia.org/T422443#11792696 (10Ladsgroup) [08:40:42] 06Data-Engineering, 06DBA: Move SpecialUnusedTemplates computation to Hadoop - https://phabricator.wikimedia.org/T422443#11792700 (10Ladsgroup) p:05Triage→03Medium [08:41:38] 06Data-Engineering, 06DBA: Move SpecialWantedFiles computation to Hadoop - https://phabricator.wikimedia.org/T422445#11792702 (10Ladsgroup) [08:41:49] 06Data-Engineering, 06DBA: Move SpecialWantedFiles computation to Hadoop - https://phabricator.wikimedia.org/T422445#11792704 (10Ladsgroup) p:05Triage→03Medium [08:42:19] 06Data-Engineering, 06DBA: Move SpecialUncategorizedImages computation to Hadoop - https://phabricator.wikimedia.org/T422449#11792705 (10Ladsgroup) [08:42:35] 06Data-Engineering, 06DBA: Move SpecialUncategorizedImages computation to Hadoop - https://phabricator.wikimedia.org/T422449#11792707 (10Ladsgroup) p:05Triage→03Medium [08:43:14] 06Data-Engineering, 06DBA: Move SpecialWantedCategories computation to Hadoop - https://phabricator.wikimedia.org/T422450#11792710 (10Ladsgroup) [08:43:32] 06Data-Engineering, 06DBA: Move SpecialWantedCategories computation to Hadoop - https://phabricator.wikimedia.org/T422450#11792714 (10Ladsgroup) p:05Triage→03Medium [09:12:53] 06Data-Engineering, 06Data-Engineering-Radar, 06DBA, 07Schema-change-in-production: Drop il_to column from imagelinks table in wmf production - https://phabricator.wikimedia.org/T419635#11792827 (10FCeratto-WMF) [09:26:37] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 10Event-Platform, 13Patch-For-Review: HTML Enrichment - Tuning & Backfilling configuration - https://phabricator.wikimedia.org/T421216#11792886 (10JMonton-WMF) > If we do try: we should try by creating a new temporary kafka topic with more partitions, an... [09:57:33] (03PS3) 10Zabe: querypage: MostCategories: Include all content namespaces [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1267966 (https://phabricator.wikimedia.org/T413362) [09:59:26] (03CR) 10Zabe: querypage: MostCategories: Include all content namespaces (031 comment) [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1267966 (https://phabricator.wikimedia.org/T413362) (owner: 10Zabe) [10:13:55] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st): Add new API rate limiting fields from webrequest_logs to Turnilo view - https://phabricator.wikimedia.org/T419736#11793064 (10KCVelaga_WMF) Just adding another usecase to have this data in Turnilo. The API analytics data product and the dashboard would be... [10:19:08] 06Data-Engineering, 06Data-Engineering-Radar, 06Data-Persistence, 06DBA, and 4 others: ICU 72 upgrade: `categorylinks` table swap - https://phabricator.wikimedia.org/T419980#11793076 (10Raine) >>! In T419980#11777371, @Marostegui wrote: > Sorry for the delay, I've been out for almost 3 weeks and I am catch... [10:31:03] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st): Add new API rate limiting fields from webrequest_logs to Turnilo view - https://phabricator.wikimedia.org/T419736#11793111 (10daniel) Beyond the top-n use case KC mentioned, it would also be super helpful to have the rate limit class in Turnilo when investig... [11:42:38] 06Data-Engineering, 06Data-Engineering-Radar, 06Data-Persistence, 06DBA, and 4 others: ICU 72 upgrade: `categorylinks` table swap - https://phabricator.wikimedia.org/T419980#11793374 (10Marostegui) >>! In T419980#11793076, @Raine wrote: >>>! In T419980#11777371, @Marostegui wrote: >> Sorry for the delay, I... [11:54:04] 06Data-Engineering, 06Data-Engineering-Radar, 06cloud-services-team, 10Data-Services, 06DBA: Re-run maintainviews on all clouddb* and an-redacteddb1001.eqiad.wmnet - https://phabricator.wikimedia.org/T422459#11793398 (10Marostegui) [12:02:48] 06Data-Engineering, 06Data-Engineering-Radar, 06cloud-services-team, 10Data-Services, 06DBA: Re-run maintainviews on all clouddb* and an-redacteddb1001.eqiad.wmnet - https://phabricator.wikimedia.org/T422459#11793411 (10Marostegui) [12:22:36] 06Data-Engineering, 06Data-Engineering-Radar, 10Event-Platform, 06Machine-Learning-Team (Q4 FY2025-26): Add Multilingual RevertRisk predictions to mediawiki.page_revert_risk_prediction_change - https://phabricator.wikimedia.org/T415892#11793475 (10isarantopoulos) [14:41:42] 06Data-Engineering, 06Data-Engineering-Radar, 06Data-Persistence, 06DBA, and 4 others: ICU 72 upgrade: `categorylinks` table swap - https://phabricator.wikimedia.org/T419980#11794261 (10Raine) >>! In T419980#11793374, @Marostegui wrote: >>>! In T419980#11793076, @Raine wrote: >>> 1) I'd strongly suggest we... [14:47:59] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 10Event-Platform: page_change.v1 increate partitions to 3 - https://phabricator.wikimedia.org/T422511 (10JMonton-WMF) 03NEW [14:50:04] 06Data-Engineering, 06Data-Engineering-Radar, 06Data-Persistence, 06DBA, and 4 others: ICU 72 upgrade: `categorylinks` table swap - https://phabricator.wikimedia.org/T419980#11794354 (10Raine) [14:52:03] 06Data-Engineering, 06Data-Engineering-Radar, 06Data-Persistence, 06DBA, and 4 others: ICU 72 upgrade: `categorylinks` table swap - https://phabricator.wikimedia.org/T419980#11794369 (10Raine) Clarifying that on s6, only frwiki and ruwiki are affected by the ICU upgrade, so we are only going to do the proc... [14:54:10] 06Data-Engineering, 10Data-Platform, 06Growth-Team, 06Reader Experience Team, and 2 others: Image Suggestions uses AI-generated images from Commons when adding images on English Wikipedia - https://phabricator.wikimedia.org/T422513#11794393 (10Seddon) [15:13:46] (03PS1) 10Andrew McAllister (WMDE): Update repo dev dependencies in preparation for further work [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/1268581 (https://phabricator.wikimedia.org/T422510) [15:14:07] (03CR) 10CI reject: [V:04-1] Update repo dev dependencies in preparation for further work [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/1268581 (https://phabricator.wikimedia.org/T422510) (owner: 10Andrew McAllister (WMDE)) [15:33:13] 06Data-Engineering, 06Data-Engineering-Radar, 06cloud-services-team, 10Data-Services, 06DBA: Re-run maintainviews on all clouddb* and an-redacteddb1001.eqiad.wmnet - https://phabricator.wikimedia.org/T422459#11794638 (10amastilovic) Can confirm that this resolved our Sqoop issue - thank you @Marostegui ! [15:58:32] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st): Implement list of JA3N-JA4H pairs to be tagged as automated into the bot detection pipeline - https://phabricator.wikimedia.org/T420412#11794828 (10mforns) The deployment finished successfully. The pageview and unique devices data will be using the new JA3N-... [15:59:17] (03PS2) 10Andrew McAllister (WMDE): Update repo dev dependencies in preparation for further work [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/1268581 (https://phabricator.wikimedia.org/T422510) [15:59:36] (03CR) 10CI reject: [V:04-1] Update repo dev dependencies in preparation for further work [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/1268581 (https://phabricator.wikimedia.org/T422510) (owner: 10Andrew McAllister (WMDE)) [16:04:07] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 13Patch-For-Review: Sunset in-pipeline metrics computation for the MW Content Pipelines - https://phabricator.wikimedia.org/T401010#11794871 (10xcollazo) [16:05:42] (03CR) 10Aleksandar Mastilovic: Implement more verbose error logging of Sqoop (031 comment) [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1268268 (https://phabricator.wikimedia.org/T422412) (owner: 10Aleksandar Mastilovic) [16:12:47] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 06Traffic: Surge in webrequest validation check - https://phabricator.wikimedia.org/T422030#11794907 (10Vgutierrez) It looks like the root cause is [[ https://github.com/haproxy/haproxy/commit/0b7a5a64eb51ce4b22866064caa1c8e08ee17b8c | MEDIUM: log/session:... [16:30:28] (03PS3) 10Andrew McAllister (WMDE): Update repo dev dependencies in preparation for further work [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/1268581 (https://phabricator.wikimedia.org/T422510) [16:37:25] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 10Event-Platform, 13Patch-For-Review: HTML Enrichment - Tuning & Backfilling configuration - https://phabricator.wikimedia.org/T421216#11795129 (10JMonton-WMF) Before testing the increase in partitions, I'm testing something else. Looking at the Flink... [16:46:07] (03PS4) 10Andrew McAllister (WMDE): Update repo dev dependencies in preparation for further work [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/1268581 (https://phabricator.wikimedia.org/T422510) [16:56:06] (03PS5) 10Andrew McAllister (WMDE): Update repo dev dependencies in preparation for further work [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/1268581 (https://phabricator.wikimedia.org/T422510) [17:08:19] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st): Backfill newly productionized edit types dataset - https://phabricator.wikimedia.org/T421919#11795512 (10AKhatun_WMF) Update: - Following @fkaelin's recommendation, running the backfill in a airflow devenv. - research dag branch: [akhatun/edit-type-dag](http... [17:26:37] 06Data-Engineering, 06Data-Engineering-Radar, 06Data-Persistence, 06DBA, and 4 others: ICU 72 upgrade: `categorylinks` table swap - https://phabricator.wikimedia.org/T419980#11795641 (10Raine) 05In progress→03Declined Upon further discussion with DBA, we will fall back to the old process this time... [17:56:07] !log Test Kitchen edge-unique experiments (poll 81473) - adds: none; removes: we-1-8-account-creation-form-v1; fields: none - xLab/MPIC/TK tips at https://w.wiki/FwuD [17:56:09] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [18:01:36] 06Data-Engineering, 10Data-Platform, 06Growth-Team, 06Reader Growth Team, and 2 others: Image Suggestions uses AI-generated images from Commons when adding images on English Wikipedia - https://phabricator.wikimedia.org/T422513#11795796 (10Seddon) [20:40:06] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 06Reader Experience Team, 10Test Kitchen, 05MW-1.46-notes (1.46.0-wmf.22; 2026-03-31), 13Patch-For-Review: Logged in reader retention logging - https://phabricator.wikimedia.org/T420621#11796508 (10tchin) Realized that it would be useful to have the...