[01:10:19] 14Analytics-Radar, 06Data-Engineering, 06Data-Engineering-Radar, 10MediaViewer: Mediaviewer preloads should be marked as such via x-analytics tag - https://phabricator.wikimedia.org/T239655#11961692 (10Krinkle) 05Open→03Resolved a:03Krinkle Marking resolved. The 5% inflation (2019 estimate by Nur... [01:10:26] 14Analytics-Radar, 06Data-Engineering, 06Data-Engineering-Radar, 10MediaViewer: Mediaviewer preloads should be marked as such via x-analytics tag - https://phabricator.wikimedia.org/T239655#11961696 (10Krinkle) a:05Krinkle→03simon04 [02:13:28] (03PS2) 10Milimetric: Add one-off tables [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1294434 [06:35:56] 14Analytics, 06Data-Engineering, 10Data-Engineering-Wikistats: Wikimedia Statistics page-views-by-country no-data - https://phabricator.wikimedia.org/T426935#11961873 (10Skif.res) 05Duplicate→03Open As per https://foundation.wikimedia.org/wiki/Legal:Wikimedia_Foundation_Country_and_Territory_Protection_L... [06:56:39] 06Data-Engineering, 06Traffic, 13Patch-For-Review: Add X-Provenance data to webrequest_sampled_live - https://phabricator.wikimedia.org/T427068#11961935 (10JAllemandou) > Just to frame the context, am I correct? AFAIU I have the same understanding as you @Fabfur :) [06:59:05] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 10Data Pipelines, 10Pageviews-API: Pageviews API returning 404 for 2026-04-17 onward - https://phabricator.wikimedia.org/T423818#11961937 (10JAllemandou) You're right @amastilovic . We experienced a failure on May 23rd which prevented pageview to flow du... [07:21:31] (03PS1) 10A-pizzata: Change mediawiki_content to private. [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1294816 (https://phabricator.wikimedia.org/T424355) [07:42:53] 06Data-Engineering: Request for backfill of webrequest with is_api_request and ip_provenance columns - https://phabricator.wikimedia.org/T427474 (10KCVelaga_WMF) 03NEW p:05Triage→03High [09:21:00] (03CR) 10Joal: [C:03+1] "LGTM!" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1294816 (https://phabricator.wikimedia.org/T424355) (owner: 10A-pizzata) [09:26:02] 06Data-Engineering, 06Data-Engineering-Radar, 06DBA, 07Schema-change-in-production: Drop il_to column from imagelinks table in wmf production - https://phabricator.wikimedia.org/T419635#11962546 (10FCeratto-WMF) [09:28:42] (03CR) 10A-pizzata: [V:03+2 C:03+2] Change mediawiki_content to private. [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1294816 (https://phabricator.wikimedia.org/T424355) (owner: 10A-pizzata) [09:35:55] 06Data-Engineering: Delete `wmf_raw.mediawiki_content` table after a few months - https://phabricator.wikimedia.org/T427441#11962599 (10APizzata-WMF) a:03APizzata-WMF [10:11:18] 06Data-Engineering, 06Machine-Learning-Team (Q4 FY2025-26): EventStreams - Expose mediawiki.page_outlink_topic_prediction_change.v1 stream - https://phabricator.wikimedia.org/T427416#11962747 (10isarantopoulos) [10:11:29] 06Data-Engineering, 06Machine-Learning-Team (Q4 FY2025-26): EventStreams - Expose mediawiki.page_outlink_topic_prediction_change.v1 stream - https://phabricator.wikimedia.org/T427416#11962749 (10isarantopoulos) 05Open→03Resolved a:03isarantopoulos [12:00:59] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 10DPE-MediaWiki-Incremental-History, 13Patch-For-Review: Spike: drop all 90-day windows in MWHistoryDeltaWriter and replace with full-table revert detection - https://phabricator.wikimedia.org/T427314#11963004 (10xcollazo) **Update — algorithm correctnes... [12:27:15] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 10DPE-MediaWiki-Incremental-History, 13Patch-For-Review: Accelerate sqoop landing for MediaWiki History private tables - https://phabricator.wikimedia.org/T424355#11963068 (10APizzata-WMF) executed the following commands: ` screen -S T424355-copy-conten... [12:29:14] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 06Wikimedia Enterprise, 10Wikimedia Enterprise - Content Integrity, 06Data-Platform-SRE (2026-04-24 - 2026-05-15), 07Essential-Work: Implement an Airflow operator for moving data from point A to B - https://phabricator.wikimedia.org/T405360#11963071 (... [13:29:42] (03PS5) 10Xcollazo: Add DDL for mediawiki_history_incremental_v1 Iceberg table [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1287959 (https://phabricator.wikimedia.org/T425729) [13:42:08] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 10Data Pipelines, 10Pageviews-API: Pageviews API returning 404 for 2026-04-17 onward - https://phabricator.wikimedia.org/T423818#11963273 (10MusikAnimal) 05Open→03Resolved [13:43:37] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 10Data Pipelines, 10Pageviews-API: Pageviews API returning 404 for 2026-04-17 onward - https://phabricator.wikimedia.org/T423818#11963278 (10MusikAnimal) New tasks are preferred, I think. See T427171 [13:47:19] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 06Data-Platform-SRE (2026-04-24 - 2026-05-15), 13Patch-For-Review: Support for Java 21 and Flink 2 - https://phabricator.wikimedia.org/T412978#11963297 (10JMonton-WMF) [13:49:08] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 06Data-Platform-SRE (2026-04-24 - 2026-05-15), 13Patch-For-Review: Support for Java 21 and Flink 2 - https://phabricator.wikimedia.org/T412978#11963312 (10JMonton-WMF) [13:59:36] PROBLEM - statsv Varnishkafka log producer on cp6015 is CRITICAL: PROCS CRITICAL: 0 processes with args /usr/bin/varnishkafka -S /etc/varnishkafka/statsv.conf https://wikitech.wikimedia.org/wiki/Analytics/Systems/Varnishkafka [14:02:36] RECOVERY - statsv Varnishkafka log producer on cp6015 is OK: PROCS OK: 1 process with args /usr/bin/varnishkafka -S /etc/varnishkafka/statsv.conf https://wikitech.wikimedia.org/wiki/Analytics/Systems/Varnishkafka [15:39:28] 06Data-Engineering: Sqoop globalimagelinks and filerevision - https://phabricator.wikimedia.org/T427532 (10dr0ptp4kt) 03NEW [15:41:14] 06Data-Engineering: Sqoop globalimagelinks and filerevision - https://phabricator.wikimedia.org/T427532#11964076 (10dr0ptp4kt) [16:51:16] 06Data-Engineering: Request for backfill of webrequest with is_api_request and ip_provenance columns - https://phabricator.wikimedia.org/T427474#11964386 (10JAllemandou) In my understanding the plan written in {T419522} is about building an intermediary table storing a pre-aggregated API-only subset of webreques... [18:03:56] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st): Check Editor Counts - https://phabricator.wikimedia.org/T427548 (10AKhatun_WMF) 03NEW [18:52:21] (03PS1) 10Dr0ptp4kt: WIP DNM: Add globalimagelinks table to sqoop [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1295064 (https://phabricator.wikimedia.org/T427532) [19:49:51] (03PS1) 10Dr0ptp4kt: WIP DNM: Add filerevision table to sqoop [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1295069 (https://phabricator.wikimedia.org/T427532) [20:04:33] (03PS2) 10Dr0ptp4kt: WIP DNM: Add filerevision table to sqoop [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1295069 (https://phabricator.wikimedia.org/T427532) [20:14:25] 06Data-Engineering, 13Patch-For-Review: Sqoop globalimagelinks and filerevision - https://phabricator.wikimedia.org/T427532#11965070 (10dr0ptp4kt) [20:15:01] 06Data-Engineering, 13Patch-For-Review: Sqoop globalimagelinks and filerevision - https://phabricator.wikimedia.org/T427532#11965074 (10dr0ptp4kt) [20:17:29] 06Data-Engineering, 13Patch-For-Review: Sqoop globalimagelinks and filerevision - https://phabricator.wikimedia.org/T427532#11965079 (10dr0ptp4kt) Patches up for review. @mforns and I had spot checked the other day, and @JAllemandou and I had a read today as well. More review appreciated, though. https://gerr... [20:19:30] 06Data-Engineering, 13Patch-For-Review: Sqoop globalimagelinks and filerevision - https://phabricator.wikimedia.org/T427532#11965080 (10dr0ptp4kt) [20:20:16] 06Data-Engineering, 13Patch-For-Review: Sqoop globalimagelinks and filerevision - https://phabricator.wikimedia.org/T427532#11965081 (10dr0ptp4kt) [20:27:35] 06Data-Engineering, 13Patch-For-Review: Sqoop globalimagelinks and filerevision - https://phabricator.wikimedia.org/T427532#11965091 (10dr0ptp4kt) [20:29:28] (03PS3) 10Dr0ptp4kt: Add filerevision table to sqoop [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1295069 (https://phabricator.wikimedia.org/T427532) [20:30:05] (03PS2) 10Dr0ptp4kt: Add globalimagelinks table to sqoop [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1295064 (https://phabricator.wikimedia.org/T427532) [21:02:21] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 13Patch-For-Review: Sqoop globalimagelinks and filerevision - https://phabricator.wikimedia.org/T427532#11965195 (10Ahoelzl) [21:34:27] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 10DPE-MediaWiki-Incremental-History, 13Patch-For-Review: Spike: drop all 90-day windows in MWHistoryDeltaWriter and replace with full-table revert detection - https://phabricator.wikimedia.org/T427314#11965283 (10xcollazo) **Update — two algorithm bug fi... [23:10:02] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st): Request for backfill of webrequest with is_api_request and ip_provenance columns - https://phabricator.wikimedia.org/T427474#11965667 (10Ahoelzl)