[09:05:11] 06Data-Engineering-Radar, 10CheckUser, 06DBA, 06Trust and Safety Product Team, 07Schema-change-in-production: Add '*_actor_ip_hex_time' indexes to 'cu_changes', 'cu_log_event', and 'cu_private_event' on WMF wikis - https://phabricator.wikimedia.org/T399728#11073078 (10FCeratto-WMF) [09:36:19] 06Data-Engineering-Radar, 10CheckUser, 06DBA, 06Trust and Safety Product Team, 07Schema-change-in-production: Add '*_actor_ip_hex_time' indexes to 'cu_changes', 'cu_log_event', and 'cu_private_event' on WMF wikis - https://phabricator.wikimedia.org/T399728#11073137 (10FCeratto-WMF) [10:02:57] 14Data-Engineering (Q4 2025 April 1st - June 30th): Analyze impact for webrequest and unique devices pipelines to derive access_method without m-dot domain - https://phabricator.wikimedia.org/T389696#11073198 (10JAllemandou) 05Resolved→03In progress [10:05:39] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th): Analyze data differences between `access_method` derived from URL and from x-analytics - https://phabricator.wikimedia.org/T401576 (10JAllemandou) 03NEW [10:47:01] 06Data-Engineering-Radar, 10CheckUser, 06DBA, 06Trust and Safety Product Team, 07Schema-change-in-production: Add '*_actor_ip_hex_time' indexes to 'cu_changes', 'cu_log_event', and 'cu_private_event' on WMF wikis - https://phabricator.wikimedia.org/T399728#11073284 (10FCeratto-WMF) [11:03:03] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th), 13Patch-For-Review: Adapt Sqoop for categorylinks schema change - https://phabricator.wikimedia.org/T397923#11073329 (10JAllemandou) I approved the MR above. And actually while we're at it, we should review if the list here https://github.com/wikimedia... [12:53:09] 06Data-Engineering-Radar, 10CheckUser, 06DBA, 06Trust and Safety Product Team, 07Schema-change-in-production: Add '*_actor_ip_hex_time' indexes to 'cu_changes', 'cu_log_event', and 'cu_private_event' on WMF wikis - https://phabricator.wikimedia.org/T399728#11073547 (10FCeratto-WMF) [13:31:44] 06Data-Engineering, 06DBA, 07Schema-change-in-production: Add cl_timestamp_id index to categorylinks table - https://phabricator.wikimedia.org/T399249#11073663 (10FCeratto-WMF) Running on s4 in codfw while @Marostegui is OOtO [13:41:22] (03PS1) 10Aqu: add zh-wikifunctions project to allowlist [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1177398 [14:29:44] 06Data-Engineering, 10Data-Platform-SRE (2025.07.26 - 2025.08.15): Ensure that blunderbuss uses the minimum HDFS file system permissions required - https://phabricator.wikimedia.org/T401103#11074004 (10xcollazo) [14:30:20] 06Data-Engineering, 10Data-Platform-SRE (2025.07.26 - 2025.08.15): Ensure that blunderbuss uses the minimum HDFS file system permissions required - https://phabricator.wikimedia.org/T401103#11074015 (10xcollazo) >I think that we can use the airflow-deployers group, as defined here, to ensure that those users w... [14:46:34] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th), 13Patch-For-Review: Adapt Sqoop for categorylinks schema change - https://phabricator.wikimedia.org/T397923#11074113 (10amastilovic) >>! In T397923#11073329, @JAllemandou wrote: > I approved the MR above. > And actually while we're at it, we should rev... [15:01:28] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th), 13Patch-For-Review: Adapt Sqoop for categorylinks schema change - https://phabricator.wikimedia.org/T397923#11074217 (10JAllemandou) >>! In T397923#11074113, @amastilovic wrote: > Re: the "drop mediawiki snapshots" thing, the new `collation` table is... [15:04:34] (03CR) 10Joal: [V:03+2 C:03+2] "Merging for next deploy" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1170221 (https://phabricator.wikimedia.org/T399785) (owner: 10Gerrit maintenance bot) [15:09:13] (03CR) 10Joal: "Before +1ing, I'd like we verify that this project is actually a real thing. IIUC wikifunctions should be like commons, a cross-language p" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1177398 (owner: 10Aqu) [15:27:17] (03CR) 10Joal: "I forgot in the previous comment: usually we have automated patches coming our way when new projects are created, and we have not received" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1177398 (owner: 10Aqu) [16:46:03] 06Data-Engineering, 10Data-Platform-SRE (2025.07.26 - 2025.08.15): Ensure that blunderbuss uses the minimum HDFS file system permissions required - https://phabricator.wikimedia.org/T401103#11074798 (10xcollazo) >>! In T400902#11056857, @BTullis wrote: > ... >> the topic at hand is to somehow reduce the privil... [18:35:57] 14Analytics, 06Data-Engineering, 06Data-Engineering-Radar, 10AQS2.0, 10Pageviews-API: Track page views by page ID rather than title (handles moved pages) - https://phabricator.wikimedia.org/T159046#11075182 (10MusikAnimal) [18:36:46] 14Analytics, 06Data-Engineering, 06Data-Engineering-Radar, 10AQS2.0, 10Pageviews-API: Track page views by page ID rather than title (handles moved pages) - https://phabricator.wikimedia.org/T159046#11075184 (10MusikAnimal) A related, older task: {T121912} [21:37:46] (03PS1) 10Aleksandar Mastilovic: Add wmf_raw.mediawiki_collation table to snapshot maintenance [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1177507 (https://phabricator.wikimedia.org/T397923) [21:41:20] 07Analytics-Data-Problem, 06Data-Engineering: Most edits to subsequently deleted pages have Null event_comment data in mediawiki_history - https://phabricator.wikimedia.org/T401436#11075938 (10nshahquinn-wmf) [22:48:42] 06Data-Engineering-Radar, 06DBA, 07Schema-change-in-production: Add rc_source_name_timestamp index to recentchanges table in wmf production - https://phabricator.wikimedia.org/T400854#11076112 (10Ladsgroup) [23:15:39] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th), 10CheckUser, 06Trust and Safety Product Team: Inform Data-Engineering about removal of cuc_ip, cule_ip, and cupe_ip - https://phabricator.wikimedia.org/T399958#11076207 (10amastilovic) 05Open→03Resolved