[07:38:36] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): Include pageview_actor in Turnilo - https://phabricator.wikimedia.org/T424235#12315953 (10JAllemandou) 05Open→03Declined As we're not going to put `pageview_hourly` in Turnilo, I'm boldly declining this task. [07:53:50] (03PS3) 10Joal: Add transform to kafka-druid webrequest_sampled [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1339067 (https://phabricator.wikimedia.org/T437638) [08:53:20] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10DPE-MediaWiki-Incremental-History: Backfill wmf_objective_metrics.heartbeat_active_editors_weekly - https://phabricator.wikimedia.org/T437118#12316408 (10APizzata-WMF) Fixed! ` select dt, count(*) from wmf_objective_metrics.heartbeat_active_editors... [09:53:30] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 06Commons, 06Data-Persistence, 07Epic, 07OKR-Work: FY2025-26 WE 6.4.1: Move links tables of commons to a dedicated cluster - https://phabricator.wikimedia.org/T398709#12316826 (10Ladsgroup) The last one was actually on reads in the past six h... [10:37:06] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10Event-Platform: New Schema for Mediawiki output job - https://phabricator.wikimedia.org/T437875 (10JMonton-WMF) 03NEW [10:40:04] 06Data-Engineering, 06Data-Engineering-Radar, 06Java-Scala-Standardization, 06Discovery-Search (2026.08.03 - 2026.08.31), and 2 others: Publish search instance artifact JARs to GitLab Package Registry - https://phabricator.wikimedia.org/T435141#12317023 (10pfischer) 05Open→03Resolved [10:40:17] 06Data-Engineering, 06Data-Engineering-Radar, 10CirrusSearch, 06Discovery-Search (2026.08.03 - 2026.08.31), 10Event-Platform: EventRowSerializer does not support schema upgrades - https://phabricator.wikimedia.org/T432207#12317032 (10pfischer) 05Open→03Resolved [12:34:10] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): Drop `aqs_hourly` hive table now that the iceberg one works - https://phabricator.wikimedia.org/T437883 (10JAllemandou) 03NEW [12:57:30] 06Data-Engineering, 06cloud-services-team, 10Data-Services, 06tools-platform-team, 07Documentation: Provide documentation for toolforge users to request access to unexposed data through WikiReplicas - https://phabricator.wikimedia.org/T209992#12317534 (10fnegri) [13:06:02] (03CR) 10Xcollazo: [C:03+1] "Assuming the definition is correct." [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1339067 (https://phabricator.wikimedia.org/T437638) (owner: 10Joal) [13:12:30] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 13Patch-For-Review: Add a new `is_api` field to webrequest_sampled in druid - https://phabricator.wikimedia.org/T437638#12317661 (10JAllemandou) [13:13:15] 06Data-Engineering: analytics-refinery-source repo fails post-merge builds, releases succeed - https://phabricator.wikimedia.org/T426369#12317665 (10xcollazo) Just passing by to mention that as of this comment, this issue continues. Latest instance at: https://integration.wikimedia.org/ci/job/analytics-refinery... [13:13:47] (03CR) 10Joal: [V:03+2 C:03+2] "Merging and manually deploying (no automatic deploy)" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1339067 (https://phabricator.wikimedia.org/T437638) (owner: 10Joal) [13:18:58] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10Data-Platform, 06Growth-Team, 05FY 2026-27 DE1.3.2 Impact + Dashboard, 07OKR-Work (DE1 FY2026-27): DE1.3.2: Implement "Sliding 30 Day Top-K Pages for Editor" - https://phabricator.wikimedia.org/T437710#12317693 (10Urbanecm_WMF) [13:21:23] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10DPE-MediaWiki-Incremental-History: Incremental MediaWiki History v2 - data requests - https://phabricator.wikimedia.org/T437051#12317712 (10xcollazo) > I guess I was arguing for using MW's value at event time and then switching to the MWH algorithm... [13:47:39] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): Re-establish rsync dumps access to PDApps mirror - https://phabricator.wikimedia.org/T437896 (10xcollazo) 03NEW [13:52:22] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10DPE-MediaWiki-Incremental-History: Incremental MediaWiki History v2 - data requests - https://phabricator.wikimedia.org/T437051#12317897 (10Isaac) > the field will always be off... Wouldn't you rather have a stable count? If the stable count comes fr... [13:55:13] 06Data-Engineering, 06Product-Analytics: Create a new database for WMF traffic related metrics - https://phabricator.wikimedia.org/T436678#12317946 (10Ottomata) > wmf_traffic is owned, and I think should continue to be owned, by the analytics service user. I don't think we have any official enforcement of data... [14:32:39] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): Re-establish rsync dumps access to PDApps mirror - https://phabricator.wikimedia.org/T437896#12318330 (10xcollazo) p:05Triage→03Medium a:03xcollazo [15:05:55] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): Add a new `is_api` field to webrequest_sampled in druid - https://phabricator.wikimedia.org/T437638#12318448 (10Ottomata) Ah got it, this is ingested druid only. +1 [15:44:02] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10Dumps-Generation: mediawiki_content_current exports silently omit all pages edited between the snapshot cutoff and dump generation time - https://phabricator.wikimedia.org/T431872#12318618 (10xcollazo) >>! In T431872#12304587, @JeffDoozan wrote: > Hi... [15:44:25] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10Dumps-Generation: mediawiki_content_current exports silently omit all pages edited between the snapshot cutoff and dump generation time - https://phabricator.wikimedia.org/T431872#12318622 (10xcollazo) 05In progress→03Resolved [15:45:17] 14Data-Engineering (Q4 FS25/26 April 1st - June 30st), 10Dumps-Generation: Data missing from en.wiktionary.org February 2026 "MediaWiki Content File Exports" compared to "XML Database dump" - https://phabricator.wikimedia.org/T417596#12318633 (10xcollazo) 05Resolved→03Open Jeff reports that we may have a r... [15:46:03] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10Dumps-Generation: Data missing from en.wiktionary.org February 2026 "MediaWiki Content File Exports" compared to "XML Database dump" - https://phabricator.wikimedia.org/T417596#12318637 (10xcollazo) [15:50:30] (03PS1) 10Joal: Fix webrequest_sampled druid ingestion [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1341247 (https://phabricator.wikimedia.org/T437638) [15:51:05] (03CR) 10Joal: [V:03+2 C:03+2] "Self merging hotfix" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1341247 (https://phabricator.wikimedia.org/T437638) (owner: 10Joal) [17:03:35] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): Visualizing inconsistencies and reconciles via Superset - https://phabricator.wikimedia.org/T420787#12319093 (10xcollazo) 05Open→03Resolved Being bold and closing this as good enough. [17:09:21] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10DPE-MediaWiki-Incremental-History: Backfill wmf_objective_metrics.heartbeat_active_editors_weekly - https://phabricator.wikimedia.org/T437118#12319131 (10nshahquinn-wmf) Yes, everything looks good now! Thank you, @APizzata-WMF 😊 [17:29:55] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10AQS2.0, 10Data-Platform, 06Growth-Team, and 2 others: top_pages_per_editor returns implausible data for metawiki:Steward requests/Global permissions - https://phabricator.wikimedia.org/T434113#12319229 (10Snwachukwu) The fix is merged, I'm curren... [18:14:53] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10Dumps-Generation: when analyzing a Wikifunctions dump, parent_id in page creation revisions is sometimes 0 and sometimes None - https://phabricator.wikimedia.org/T420974#12319415 (10xcollazo) An update: With T420974#11888191 landed a long time ago,... [18:30:24] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10DPE-MediaWiki-Incremental-History: migrate dbt_jobs pipelines to use MWH incremental - https://phabricator.wikimedia.org/T429770#12319462 (10nshahquinn-wmf) Brief notes from a meeting with @APizzata-WMF, @Ahoelzl, and @Milimetric: - The biggest techn... [19:51:10] 06Data-Engineering, 06SRE, 10SRE-Access-Requests, 13Patch-For-Review: Requesting access to deployment and analytics-privatedata-users for Cklimas - https://phabricator.wikimedia.org/T437653#12319717 (10Dzahn) [20:03:56] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 13Patch-For-Review: Linked Artifact Cache - Automated MediaWiki JobQueue precompute - https://phabricator.wikimedia.org/T436695#12319842 (10Ottomata) Okay, patch 1 ready for review. This patch only implements the first checkbox: > A LAC fetch for an... [20:10:55] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10EditCheck, 06Editing-team, 10VisualEditor: Server Side Edit Suggestions - Linked Artifacts Cache precompute job - https://phabricator.wikimedia.org/T432733#12319881 (10Ottomata) FYI, the more generic version of this is being developed in {T436695}. [20:17:45] 06Data-Engineering, 06SRE, 10SRE-Access-Requests, 13Patch-For-Review: Requesting access to analytics-privatedata-users level 3 for derenrich - https://phabricator.wikimedia.org/T437668#12319894 (10Dzahn) [20:18:08] 06Data-Engineering, 06SRE, 10SRE-Access-Requests, 13Patch-For-Review: Requesting access to analytics-privatedata-users level 3 for derenrich - https://phabricator.wikimedia.org/T437668#12319897 (10Dzahn) Tagging Data Engineering per https://wikitech.wikimedia.org/wiki/SRE/Clinic_Duty/Access_requests#analyt... [21:52:49] 06Data-Engineering, 10DPE-MediaWiki-Incremental-History: "Infinity" blocks (aka indefinite) are not captured by mediawiki_user_history (and therefore also missing from mediawiki_history) - https://phabricator.wikimedia.org/T432058#12320248 (10Isaac) [23:14:05] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): Calculate active UWERs on a weekly cadence - https://phabricator.wikimedia.org/T437961 (10nshahquinn-wmf) 03NEW [23:15:39] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): Calculate active UWERs on a weekly cadence - https://phabricator.wikimedia.org/T437961#12320429 (10nshahquinn-wmf) >>! In T429770#12319462, @nshahquinn-wmf wrote: > Brief notes from a meeting with @APizzata-WMF, @Ahoelzl, and @Milimetric: > - The biggest... [23:15:54] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): Calculate active UWERs on a weekly cadence - https://phabricator.wikimedia.org/T437961#12320432 (10nshahquinn-wmf) a:03Ahoelzl [23:17:38] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10DPE-MediaWiki-Incremental-History: migrate dbt_jobs pipelines to use MWH incremental - https://phabricator.wikimedia.org/T429770#12320436 (10nshahquinn-wmf) All the remaining work here is now covered by {T437961}. [23:46:09] 06Data-Engineering, 06SRE, 10SRE-Access-Requests, 13Patch-For-Review: Requesting access to deployment and analytics-privatedata-users for Cklimas - https://phabricator.wikimedia.org/T437653#12320516 (10thcipriani) Reason for access makes sense for `deployment` group membership. Approved! --- @Cklimas som...