[07:24:29] (03CR) 10DCausse: "I was told to wait until official announcement before moving to gitlab but just saw https://phabricator.wikimedia.org/T366836#10191912 whi" [schemas/event/primary] - 10https://gerrit.wikimedia.org/r/594098 (https://phabricator.wikimedia.org/T374918) (owner: 10DCausse) [09:24:59] 10Data-Engineering (Q1 2024 July 1st - September 30th), 10Data-Platform-SRE (2024.09.28 - 2024.10.18), 13Patch-For-Review: Update druid config to automatically drop unused segments - https://phabricator.wikimedia.org/T376118#10198893 (10BTullis) I have the beginnings of a patch to enable the dropping of unus... [12:58:24] 06Data-Engineering, 10Cassandra, 10Data Pipelines, 10Data-Platform-SRE (2024.09.28 - 2024.10.18), 13Patch-For-Review: Create puppet defined type for adding/updating/deleting secrets or other small files on HDFS - https://phabricator.wikimedia.org/T323692#10199267 (10BTullis) @Ottomata - this is a follow-... [13:01:11] 06Data-Engineering, 10Cassandra, 10Data Pipelines, 10Data-Platform-SRE (2024.09.28 - 2024.10.18), 13Patch-For-Review: Create puppet defined type for adding/updating/deleting secrets or other small files on HDFS - https://phabricator.wikimedia.org/T323692#10199299 (10BTullis) Once that is done, we could m... [13:26:07] 06Data-Engineering, 06SRE, 10SRE-Access-Requests, 13Patch-For-Review: Requesting access to analytics-privatedata-users for Seanleong-WMDE - https://phabricator.wikimedia.org/T376034#10199354 (10kamila) @Dzahn it appears that Sean is already in the LDAP groups, unless I'm misunderstanding something: ` kamil... [13:28:29] 06Data-Engineering, 06SRE, 10SRE-Access-Requests, 13Patch-For-Review: Requesting access to analytics-privatedata-users for Seanleong-WMDE - https://phabricator.wikimedia.org/T376034#10199356 (10kamila) [13:36:07] 06Data-Engineering, 06SRE, 10SRE-Access-Requests, 13Patch-For-Review: Requesting access to analytics-privatedata-users for Seanleong-WMDE - https://phabricator.wikimedia.org/T376034#10199363 (10kamila) @odimitrijevic @Milimetric @WDoranWMF @Ahoelzl @Ottomata could one of you approve Sean's access request p... [13:36:08] 06Data-Engineering: [SPIKE] Learn and document how to use Flink-CDC from MediaWiki MariaDB locally - https://phabricator.wikimedia.org/T373144#10199396 (10Ottomata) I even had difficultly with Flink 1.18! Having more success with 1.17 at the moment. [14:56:25] !log Deployed latest DAGs to the analytics Airflow instance. T373694. T375402. [14:56:28] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [14:56:29] T373694: [Iceberg Migration] Extend Iceberg table maintenance mechanism to support data rewrite - https://phabricator.wikimedia.org/T373694 [14:56:29] T375402: Tune Dumps 2.0 hourly ingestion jobs - https://phabricator.wikimedia.org/T375402 [14:59:54] 06Data-Engineering, 10Dumps 2.0 (Kanban Board): [Iceberg Migration] Extend Iceberg table maintenance mechanism to support data rewrite - https://phabricator.wikimedia.org/T373694#10199737 (10xcollazo) [15:05:56] (03PS1) 10Ebernhardson: SearchSatisfaction: Add virtualPageView action [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/1077731 (https://phabricator.wikimedia.org/T375387) [15:24:21] (03PS1) 10Dbrant: Add is_temp field to Android schema fragment. [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/1077738 (https://phabricator.wikimedia.org/T374057) [15:33:44] Does anyone know how to clear the backlog for change-prop with jobs? [15:35:25] (03PS1) 10Dbrant: Add is_temp field to iOS schema fragment. [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/1077742 (https://phabricator.wikimedia.org/T374058) [15:35:47] (03CR) 10CI reject: [V:04-1] Add is_temp field to iOS schema fragment. [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/1077742 (https://phabricator.wikimedia.org/T374058) (owner: 10Dbrant) [16:33:01] (03CR) 10Dbrant: "@Phuedx The `ios_talk_page_interaction` schema seems to have a weird and unfortunate problem:" [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/1077742 (https://phabricator.wikimedia.org/T374058) (owner: 10Dbrant) [16:38:19] (03CR) 10Phuedx: [C:03+2] Add is_temp field to Android schema fragment. [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/1077738 (https://phabricator.wikimedia.org/T374057) (owner: 10Dbrant) [16:38:46] (03Merged) 10jenkins-bot: Add is_temp field to Android schema fragment. [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/1077738 (https://phabricator.wikimedia.org/T374057) (owner: 10Dbrant) [16:52:11] 06Data-Engineering, 10Event-Platform, 13Patch-For-Review, 10Web Team Essential Work 2024 (Migrate to new Event Platform), 10Web-Team-Backlog (FY2024-25 Q2 Sprint 1): Delete redundant mobile- and desktopwebuiactions event in WikimediaEvents - https://phabricator.wikimedia.org/T376065#10200117 (10KSarabia-W... [17:20:45] 14Analytics-Radar, 06Data-Engineering, 10Data Pipelines, 06Editing-team, and 4 others: WikiEditor records all edits as platform = desktop in EventLogging - https://phabricator.wikimedia.org/T249944#10200326 (10phuedx) I came across this task while taking a look over #mediawiki-extensions-eventlogging. Was... [17:35:15] 14Analytics-Radar, 06Data-Engineering, 10Data Pipelines, 06Editing-team, and 4 others: WikiEditor records all edits as platform = desktop in EventLogging - https://phabricator.wikimedia.org/T249944#10200409 (10DLynch) @phuedx No change there. The current state is still that `platform: mobile/desktop` from... [17:36:31] (03CR) 10Phuedx: "There are no spurious fields in the associated table. Forcefully updating the schema to fix the error seems OK for maintenance and a NOP f" [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/1077742 (https://phabricator.wikimedia.org/T374058) (owner: 10Dbrant) [18:00:38] 06Data-Engineering, 06Data Products, 10MediaWiki-extensions-EventLogging, 10Metrics Platform: Remove deprecated $logger parameter from EventLogging::submit() - https://phabricator.wikimedia.org/T376410 (10phuedx) 03NEW [18:01:57] 06Data-Engineering, 06Data Products, 10MediaWiki-extensions-EventLogging, 10Metrics Platform: Remove deprecated $logger parameter from EventLogging::submit() - https://phabricator.wikimedia.org/T376410#10200510 (10phuedx) [18:16:20] (03PS2) 10Dbrant: Add is_temp field to iOS schema fragment. [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/1077742 (https://phabricator.wikimedia.org/T374058) [18:16:49] (03CR) 10CI reject: [V:04-1] Add is_temp field to iOS schema fragment. [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/1077742 (https://phabricator.wikimedia.org/T374058) (owner: 10Dbrant) [18:21:22] (03CR) 10Dbrant: "I've updated the `ios_talk_page_interaction` with the correct indentation (Of course this still causes tests to fail)." [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/1077742 (https://phabricator.wikimedia.org/T374058) (owner: 10Dbrant) [18:31:56] (03CR) 10Ottomata: "Likely he meant manually updating the previous schemas. As long as this results in a functional no op in materialized schemas (does it?) " [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/1077742 (https://phabricator.wikimedia.org/T374058) (owner: 10Dbrant) [18:36:03] (03PS3) 10Dbrant: Add is_temp field to iOS schema fragment. [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/1077742 (https://phabricator.wikimedia.org/T374058) [18:38:25] (03CR) 10Dbrant: "Done! Tests are now passing, and indeed it doesn't look like this will result in any functional changes." [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/1077742 (https://phabricator.wikimedia.org/T374058) (owner: 10Dbrant) [18:39:38] 06Data-Engineering, 06SRE, 10SRE-Access-Requests, 13Patch-For-Review: Requesting access to analytics-privatedata-users for Seanleong-WMDE - https://phabricator.wikimedia.org/T376034#10200668 (10Dzahn) >>! In T376034#10199354, @kamila wrote: > @Dzahn it appears that Sean is already in the LDAP groups, unles... [20:48:22] (03CR) 10Ebernhardson: [C:03+1] "Looks good to me, but I'm not so picky about field naming. The documentation is great and the schema is short enough to be easily understo" [schemas/event/primary] - 10https://gerrit.wikimedia.org/r/594098 (https://phabricator.wikimedia.org/T374918) (owner: 10DCausse) [23:11:33] 10Data-Engineering (Q1 2024 July 1st - September 30th): Some Gobblin folders don't have `_IMPORTED` flags - https://phabricator.wikimedia.org/T376144#10201287 (10Ahoelzl) [23:12:11] 10Data-Engineering (Q1 2024 July 1st - September 30th): Some Gobblin folders don't have `_IMPORTED` flags - https://phabricator.wikimedia.org/T376144#10201285 (10Ahoelzl) a:03JAllemandou