[00:04:09] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10Data-Persistence-Design-Review, 10Event-Platform, 13Patch-For-Review: [Data Persistence Design Review] Relative trending pages - https://phabricator.wikimedia.org/T432352#12234912 (10Eevans) The object cache approach seems reasonable to me (provi... [07:52:26] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): data lake: phabricator events - https://phabricator.wikimedia.org/T434047#12235375 (10Antoine_Quhen) What's the Collaboration Services team's take on this topic of extracting data from Phabricator into the Data Lake (HDFS): * Initially, a backfill: retr... [08:24:31] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 05Metrics-Sprint-2026-2027: Move all FY2026-2027 chart data to PostgreSQL - https://phabricator.wikimedia.org/T432017#12235481 (10APizzata-WMF) a:05Milimetric→03APizzata-WMF [08:55:16] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): dbt isolated model orchestration - https://phabricator.wikimedia.org/T430625#12235660 (10GGoncalves-WMF) Having discussed this yesterday in relation to the progress we've made in {T429439}: > dbt models can execute with different parameter values (i.e.... [08:57:06] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): dbt data tests validate production data - https://phabricator.wikimedia.org/T430786#12235673 (10GGoncalves-WMF) Having discussed this again, I think what we have now implemented (configurable `dbt test` after `dbt run` for a set of models) is good enough... [09:08:00] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10Event-Platform, 13Patch-For-Review: Relative Trending - Milestone 4 - Storage - https://phabricator.wikimedia.org/T431555#12235739 (10JMonton-WMF) [09:43:18] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): data lake: git commit history - https://phabricator.wikimedia.org/T433696#12235923 (10Antoine_Quhen) In meeting `DPE SRE / DE sync up` of 20260820, we validated in principle that the solution of building a ceph-fs persistent volume to mount into the k8s... [09:58:10] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 13Patch-For-Review: data lake: git commit history - https://phabricator.wikimedia.org/T433696#12235989 (10Antoine_Quhen) @Addshore Here is schema definition placeholder https://gitlab.wikimedia.org/repos/data-engineering/schemas-event-secondary/-/merge... [10:02:41] 06Data-Engineering, 06Data-Engineering-Radar, 06DBA, 07Schema-change-in-production: Drop two columns from transcode table - https://phabricator.wikimedia.org/T435064#12236005 (10Marostegui) [10:10:42] 06Data-Engineering, 06Data-Engineering-Radar, 06DBA, 07Schema-change-in-production: Drop two columns from transcode table - https://phabricator.wikimedia.org/T435064#12236034 (10Marostegui) [10:18:58] 06Data-Engineering, 06Data-Engineering-Radar, 06DBA, 07Schema-change-in-production: Drop two columns from transcode table - https://phabricator.wikimedia.org/T435064#12236075 (10Marostegui) [11:18:46] 06Data-Engineering, 10Data-Platform, 06Data-Platform-SRE, 07Epic: [Epic] Migrate the Data Lake from Hadoop to Kubernetes and Ceph/S3 - https://phabricator.wikimedia.org/T435461 (10BTullis) 03NEW [11:26:32] 06Data-Engineering, 10Data-Platform, 06Data-Platform-SRE, 07Epic: [Epic] Migrate the Data Lake from Hadoop to Kubernetes and Ceph/S3 - https://phabricator.wikimedia.org/T435461#12236328 (10BTullis) [11:26:48] 06Data-Engineering, 10Data-Platform, 06Data-Platform-SRE, 07Epic: [Epic] Migrate the Data Lake from Hadoop to Kubernetes and Ceph/S3 - https://phabricator.wikimedia.org/T435461#12236333 (10BTullis) p:05Triage→03High [11:59:04] 06Data-Engineering, 06Data-Platform-SRE: Enable OIDC authentication and IAM authorization on the Data Platform Ceph clusters - https://phabricator.wikimedia.org/T435470 (10BTullis) 03NEW [12:03:41] 06Data-Engineering, 10Data-Platform, 06Data-Platform-SRE, 07Epic: [Epic] Migrate the Data Lake from Hadoop to Kubernetes and Ceph/S3 - https://phabricator.wikimedia.org/T435461#12236508 (10BTullis) [12:21:10] 06Data-Engineering, 06Data-Platform-SRE: Decide upon and deploy the table catalog for the S3 data lake - https://phabricator.wikimedia.org/T435474 (10BTullis) 03NEW [12:23:46] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 13Patch-For-Review: data lake: phabricator events - https://phabricator.wikimedia.org/T434047#12236594 (10Antoine_Quhen) @Addshore here is an event schema definition placeholder: https://gitlab.wikimedia.org/repos/data-engineering/schemas-event-seconda... [12:26:55] 06Data-Engineering, 10Data-Platform, 06Data-Platform-SRE: Implement group-level authorization in the query engines (Spark and Presto) - https://phabricator.wikimedia.org/T435475 (10BTullis) 03NEW [12:34:55] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 13Patch-For-Review: data lake: git commit history - https://phabricator.wikimedia.org/T433696#12236780 (10Antoine_Quhen) **Decision** In a first version, we are going to generate all events through a script iterating over all repos and generating an ev... [12:49:03] 06Data-Engineering, 06Data-Platform-SRE: Data Lake ingestion after Hadoop: decide the future of Sqoop and Gobblin - https://phabricator.wikimedia.org/T435489 (10BTullis) 03NEW [12:50:28] 06Data-Engineering, 10DPE-MediaWiki-Incremental-History, 10[MW-API] FY2026-27 Q1, 07Epic, 10Event-Platform: Epic: MediaWiki DomainEvents - Create new User related DomainEvents - https://phabricator.wikimedia.org/T427817#12236837 (10OWresch-WMF) [12:53:00] 06Data-Engineering, 10DPE-MediaWiki-Incremental-History, 10[MW-API] FY2026-27 Q1, 07Epic, 10Event-Platform: Epic: MediaWiki DomainEvents - Create new User related DomainEvents - https://phabricator.wikimedia.org/T427817#12236843 (10OWresch-WMF) [12:54:47] 06Data-Engineering, 10DPE-MediaWiki-Incremental-History, 10[MW-API] FY2026-27 Q1, 07Epic, 10Event-Platform: Epic: MediaWiki User DomainEvents - https://phabricator.wikimedia.org/T427817#12236844 (10OWresch-WMF) [13:09:28] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 13Patch-For-Review: data lake: git commit history - https://phabricator.wikimedia.org/T433696#12236929 (10Antoine_Quhen) Code placeholder: https://gitlab.wikimedia.org/repos/data-engineering/developer-activity-pipelines @Addshore feel free to reorganis... [13:09:53] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 13Patch-For-Review: data lake: phabricator events - https://phabricator.wikimedia.org/T434047#12236931 (10Antoine_Quhen) Code placeholder: https://gitlab.wikimedia.org/repos/data-engineering/developer-activity-pipelines @Addshore feel free to reorganis... [13:12:23] 06Data-Engineering, 06Data-Engineering-Radar, 06DBA, 07Schema-change-in-production: Drop two columns from transcode table - https://phabricator.wikimedia.org/T435064#12236935 (10Marostegui) [13:36:43] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 06Wikimedia Enterprise, 10Wikimedia Enterprise - Content Integrity, 06Data-Platform-SRE (2026-08-07 - 2026-08-28), and 2 others: Implement an Airflow operator for moving data from point A to B - https://phabricator.wikimedia.org/T405360#12237064 (10... [13:42:58] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 07Epic: data lake: server admin log (sal) - https://phabricator.wikimedia.org/T435417#12237094 (10Ottomata) > Later runs switch to incremental mode: a range query for @timestamp >= update_from, again paginated with search_after. Rather than make a cus... [13:44:47] 06Data-Engineering, 06Data-Platform-SRE: Move the remaining HDFS consumers (Druid deep storage, dumps distribution) away from HDFS - https://phabricator.wikimedia.org/T435496 (10BTullis) 03NEW [13:45:07] 06Data-Engineering, 06Data-Platform-SRE: Move the remaining HDFS consumers (Druid deep storage, dumps distribution) away from HDFS - https://phabricator.wikimedia.org/T435496#12237136 (10BTullis) [13:49:01] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 13Patch-For-Review: data lake: git commit history - https://phabricator.wikimedia.org/T433696#12237150 (10Ottomata) Re git commit schema, while we def need a commit data model, IIUC from T433696#12183612, the event schema should be modeled around git..... [13:52:14] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 06Wikimedia Enterprise, 10Wikimedia Enterprise - Content Integrity, 06Data-Platform-SRE (2026-08-07 - 2026-08-28), and 2 others: Implement an Airflow operator for moving data from point A to B - https://phabricator.wikimedia.org/T405360#12237174 (10... [13:56:42] 06Data-Engineering, 06Data-Platform-SRE: Decide upon and deploy the table catalog for the S3 data lake - https://phabricator.wikimedia.org/T435474#12237194 (10Ottomata) Yes a task for this yes! Thank you! A tech evaluation of metastore options may help us make this decision. E.g. If we examine [[ https://git... [14:15:55] 06Data-Engineering, 06Data-Platform-SRE: Data Lake ingestion after Hadoop: decide the future of Sqoop and Gobblin - https://phabricator.wikimedia.org/T435489#12237304 (10Ottomata) > Gobblin's future FWIW, Gobblin is also a dead project. We know we need to replace both Sqoop and Gobblin, I really don't think... [14:32:45] 06Data-Engineering, 06Data-Engineering-Radar, 06Traffic: Normalize URI host in Turnilo's webrequest_sampled_live - https://phabricator.wikimedia.org/T434766#12237420 (10ssingh) Adding @Fabfur so that he can comment. [14:37:47] 06Data-Engineering, 06Data-Platform-SRE: Data Lake ingestion after Hadoop: decide the future of Sqoop and Gobblin - https://phabricator.wikimedia.org/T435489#12237459 (10Ottomata) Here are my (non-evalutated) preferences: - We replace Gobblin (and possibly the Refine spark jobs) with [[ https://iceberg.apache... [15:04:06] 06Data-Engineering, 06Data-Engineering-Radar, 06Traffic: Normalize URI host in Turnilo's webrequest_sampled_live - https://phabricator.wikimedia.org/T434766#12237590 (10Fabfur) That's very strange because we should've already fixed this (at least for port 443) with T392880 Let me investigate better [15:29:46] 06Data-Engineering, 06Data-Platform-SRE, 07Epic: Migrate the Data Lake datasets from HDFS to Ceph/S3 - https://phabricator.wikimedia.org/T435510 (10BTullis) 03NEW [15:30:31] 06Data-Engineering, 06Data-Platform-SRE: Move the remaining HDFS consumers (Druid deep storage, dumps distribution) away from HDFS - https://phabricator.wikimedia.org/T435496#12237715 (10BTullis) [15:34:13] 06Data-Engineering, 06Data-Platform-SRE, 07Epic: Migrate the Data Lake datasets from HDFS to Ceph/S3 - https://phabricator.wikimedia.org/T435510#12237756 (10BTullis) [15:35:08] 06Data-Engineering, 06Data-Platform-SRE: Move the remaining HDFS consumers (Druid deep storage, dumps distribution) away from HDFS - https://phabricator.wikimedia.org/T435496#12237766 (10BTullis) [15:35:09] 06Data-Engineering, 06Data-Platform-SRE, 07Epic: Migrate the Data Lake datasets from HDFS to Ceph/S3 - https://phabricator.wikimedia.org/T435510#12237765 (10BTullis) [15:35:10] 06Data-Engineering, 06Data-Platform-SRE: Data Lake ingestion after Hadoop: decide the future of Sqoop and Gobblin - https://phabricator.wikimedia.org/T435489#12237767 (10BTullis) [15:37:39] 06Data-Engineering, 06Data-Engineering-Icebox: [Spike] Define technology roadmap around Airflow / k8s / ceph - https://phabricator.wikimedia.org/T361509#12237791 (10BTullis) 05Open→03Resolved a:03BTullis Superseded by {T428255} and incorporated into the parent epic: {T435461} [15:56:30] 06Data-Engineering, 06Data-Platform-SRE: Enable OIDC authentication and IAM authorization on the Data Platform Ceph clusters - https://phabricator.wikimedia.org/T435470#12237963 (10BTullis) [15:57:22] 06Data-Engineering, 06Data-Platform-SRE: Enable OIDC authentication and IAM authorization on the Data Platform Ceph clusters - https://phabricator.wikimedia.org/T435470#12237971 (10BTullis) [15:57:24] 06Data-Engineering, 06Data-Platform-SRE, 07Epic: Migrate the Data Lake datasets from HDFS to Ceph/S3 - https://phabricator.wikimedia.org/T435510#12237970 (10BTullis) [15:57:54] 06Data-Engineering, 06Data-Platform-SRE: Enable OIDC authentication and IAM authorization on the Data Platform Ceph clusters - https://phabricator.wikimedia.org/T435470#12237973 (10BTullis) [15:57:55] 06Data-Engineering, 10Data-Platform, 06Data-Platform-SRE: Implement group-level authorization in the query engines (Spark and Presto) - https://phabricator.wikimedia.org/T435475#12237972 (10BTullis) [15:58:40] 06Data-Engineering, 06Data-Platform-SRE: Enable OIDC authentication and IAM authorization on the Data Platform Ceph clusters - https://phabricator.wikimedia.org/T435470#12237979 (10BTullis) [15:59:01] 14Data-Engineering (Q4 FS25/26 April 1st - June 30st), 05Metrics-Sprint-2026-2027: Heartbeat - Active UWERs - https://phabricator.wikimedia.org/T426420#12237983 (10OSefu-WMF) 05Resolved→03Open [15:59:08] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 06Wikimedia Enterprise, 10Wikimedia Enterprise - Content Integrity, 06Data-Platform-SRE (2026-08-07 - 2026-08-28), and 2 others: Implement an Airflow operator for moving data from point A to B - https://phabricator.wikimedia.org/T405360#12237981 (10... [16:00:45] 06Data-Engineering, 06Data-Platform-SRE, 07Epic: Migrate the Data Lake datasets from HDFS to Ceph/S3 - https://phabricator.wikimedia.org/T435510#12237991 (10BTullis) [16:01:25] 06Data-Engineering, 06Data-Platform-SRE, 07Epic: Migrate the Data Lake datasets from HDFS to Ceph/S3 - https://phabricator.wikimedia.org/T435510#12237999 (10BTullis) [16:01:26] 06Data-Engineering, 10Data-Platform, 06Data-Platform-SRE, 07Epic: [Epic] Migrate the Data Lake from Hadoop to Kubernetes and Ceph/S3 - https://phabricator.wikimedia.org/T435461#12238000 (10BTullis) [16:03:10] 06Data-Engineering, 06Data-Platform-SRE (2026-08-07 - 2026-08-28): Enable Ceph S3 locations for Hive Metastore tables - https://phabricator.wikimedia.org/T425673#12238017 (10BTullis) [16:04:36] 06Data-Engineering, 06Data-Platform-SRE: Enable OIDC authentication and IAM authorization on the Data Platform Ceph clusters - https://phabricator.wikimedia.org/T435470#12238024 (10BTullis) [16:11:01] 06Data-Engineering, 06Data-Platform-SRE: Data Lake ingestion after Hadoop: decide the future of Sqoop and Gobblin - https://phabricator.wikimedia.org/T435489#12238060 (10xcollazo) [16:11:39] 06Data-Engineering, 06Data-Platform-SRE: Data Lake ingestion after Hadoop: decide the future of Sqoop and Gobblin - https://phabricator.wikimedia.org/T435489#12238061 (10xcollazo) (Added links to DPE Deep Dives, for context.) [16:12:12] 06Data-Engineering, 10Data-Platform, 06Data-Platform-SRE, 07Epic: [Epic] Migrate the Data Lake from Hadoop to Kubernetes and Ceph/S3 - https://phabricator.wikimedia.org/T435461#12238063 (10BTullis) [16:12:13] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 07Epic: Move production spark jobs from YARN to k8s - https://phabricator.wikimedia.org/T432322#12238064 (10BTullis) [16:14:41] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 07OKR-Work (WE1 FY2025-26): [Spike] Adding access_method metadata to moderator action event streams - https://phabricator.wikimedia.org/T419019#12238069 (10Ottomata) @mforns @Milimetric and I met today to brainstorm some ideas here. Here is what we ca... [16:16:21] 06Data-Engineering, 06Data-Engineering-Radar, 06MediaWiki-API-Platform-Team, 07OKR-Work: REST API vNext: Create dedicated REST shared-schema repository - https://phabricator.wikimedia.org/T432799#12238106 (10HCoplin-WMF) Notes from estimation: * Where the repo lives doesn't matter much in terms of referen... [16:18:28] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 07OKR-Work (WE1 FY2025-26): [Spike] Adding access_method metadata to moderator action event streams - https://phabricator.wikimedia.org/T419019#12238124 (10Ottomata) Alternatives to `server_interface` name: - `server_endpoint` - maybe less opinionated... [16:18:42] (03PS1) 10A-pizzata: refinery-job: Add HiveToJdbc job to mirror Hive tables to PostgreSQL [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1327582 (https://phabricator.wikimedia.org/T432017) [16:19:58] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10DPE-MediaWiki-Incremental-History, 13Patch-For-Review: migrate dbt_jobs pipelines to use MWH incremental - https://phabricator.wikimedia.org/T429770#12238135 (10APizzata-WMF) [16:27:11] 06Data-Engineering, 06Data-Engineering-Radar, 06MediaWiki-API-Platform-Team, 07OKR-Work: REST API vNext: Create dedicated REST shared-schema repository - https://phabricator.wikimedia.org/T432799#12238163 (10aaron) We also need to decide if this repo will have releases or if any schema file that is committ... [16:30:20] 06Data-Engineering, 06Data-Engineering-Radar, 06MediaWiki-API-Platform-Team, 07OKR-Work: REST API vNext: Create dedicated REST shared-schema repository - https://phabricator.wikimedia.org/T432799#12238169 (10AGhirelli-WMF) p:05Triage→03Medium [16:38:30] 14Data-Engineering (Q4 FS25/26 April 1st - June 30st), 05Metrics-Sprint-2026-2027, 13Patch-For-Review: DE3.1 - Logged-out Wikipedia 21-day retention on mobile web - https://phabricator.wikimedia.org/T424706#12238203 (10OSefu-WMF) 05Resolved→03Open [16:41:10] (03CR) 10Milimetric: [C:03+1] "looks good to me, merge whenever you're able to run a test with real data" [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1327582 (https://phabricator.wikimedia.org/T432017) (owner: 10A-pizzata) [16:52:59] 06Data-Engineering, 06Data-Platform-SRE: Enable OIDC authentication and IAM authorization on the Data Platform Ceph clusters - https://phabricator.wikimedia.org/T435470#12238278 (10BTullis) [16:53:00] 06Data-Engineering, 06Data-Platform-SRE, 07Epic: Migrate the Data Lake datasets from HDFS to Ceph/S3 - https://phabricator.wikimedia.org/T435510#12238277 (10BTullis) [16:53:30] 06Data-Engineering, 06Data-Platform-SRE: Move the remaining HDFS consumers (Druid deep storage, dumps distribution) away from HDFS - https://phabricator.wikimedia.org/T435496#12238285 (10BTullis) [16:53:32] 06Data-Engineering, 06Data-Platform-SRE, 07Epic: Migrate the Data Lake datasets from HDFS to Ceph/S3 - https://phabricator.wikimedia.org/T435510#12238284 (10BTullis) [16:53:33] 06Data-Engineering, 06Data-Platform-SRE: Data Lake ingestion after Hadoop: decide the future of Sqoop and Gobblin - https://phabricator.wikimedia.org/T435489#12238286 (10BTullis) [16:54:26] 06Data-Engineering, 06Data-Platform-SRE: Enable OIDC authentication and IAM authorization on the Data Platform Ceph clusters - https://phabricator.wikimedia.org/T435470#12238297 (10BTullis) [16:54:42] 06Data-Engineering, 06Data-Platform-SRE: Enable OIDC authentication and IAM authorization on the Data Platform Ceph clusters - https://phabricator.wikimedia.org/T435470#12238299 (10BTullis) [16:55:07] 06Data-Engineering, 10Data-Platform, 06Data-Platform-SRE: Implement group-level authorization in the query engines (Spark and Presto) - https://phabricator.wikimedia.org/T435475#12238300 (10BTullis) [16:55:08] 06Data-Engineering, 06Data-Platform-SRE: Enable OIDC authentication and IAM authorization on the Data Platform Ceph clusters - https://phabricator.wikimedia.org/T435470#12238301 (10BTullis) [16:57:18] 06Data-Engineering, 10Data-Platform, 06Data-Platform-SRE: Implement group-level authorization in the query engines (Spark and Presto) - https://phabricator.wikimedia.org/T435475#12238322 (10BTullis) [16:57:19] 06Data-Engineering, 06Data-Platform-SRE: Enable OIDC authentication and IAM authorization on the Data Platform Ceph clusters - https://phabricator.wikimedia.org/T435470#12238323 (10BTullis) [16:57:53] 06Data-Engineering, 06Data-Platform-SRE: Enable OIDC authentication and IAM authorization on the Data Platform Ceph clusters - https://phabricator.wikimedia.org/T435470#12238327 (10BTullis) [16:58:12] 06Data-Engineering, 06Data-Platform-SRE: Enable OIDC authentication and IAM authorization on the Data Platform Ceph clusters - https://phabricator.wikimedia.org/T435470#12238331 (10BTullis) [16:58:14] 06Data-Engineering, 06Data-Platform-SRE, 07Epic: Migrate the Data Lake datasets from HDFS to Ceph/S3 - https://phabricator.wikimedia.org/T435510#12238330 (10BTullis) [17:09:57] 06Data-Engineering, 06Data-Engineering-Radar, 06MediaWiki-API-Platform-Team, 07OKR-Work: REST API vNext: Create dedicated REST shared-schema repository - https://phabricator.wikimedia.org/T432799#12238385 (10aaron) Note that this would include things similar to what is under includes/Rest/Handler/Schema/.... [17:23:11] 06Data-Engineering, 06Data-Engineering-Radar, 06MediaWiki-API-Platform-Team, 07OKR-Work: REST API vNext: Create dedicated REST shared-schema repository - https://phabricator.wikimedia.org/T432799#12238461 (10Ottomata) > For example, if title-object-1.1.json was committed, can it immediately be assumed to b... [17:33:48] (03CR) 10Ottomata: refinery-job: Add HiveToJdbc job to mirror Hive tables to PostgreSQL (033 comments) [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1327582 (https://phabricator.wikimedia.org/T432017) (owner: 10A-pizzata) [18:18:01] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 06Product-Analytics, 06Product Safety and Integrity (Sprint Sunflower (Aug 11 - Aug 28)): Run backfills for bad faith edit reverts metrics - https://phabricator.wikimedia.org/T435372#12238775 (10amastilovic) Backfill completed. [18:42:52] 06Data-Engineering, 06Data-Engineering-Radar, 06MediaWiki-API-Platform-Team, 07OKR-Work: REST API vNext: Create dedicated REST shared-schema repository - https://phabricator.wikimedia.org/T432799#12238856 (10daniel) >>! In T432799#12238461, @Ottomata wrote: >> For example, if title-object-1.1.json was comm... [18:59:44] 06Data-Engineering, 10Observability-Logging, 06SRE, 10Wikimedia-Logstash, and 2 others: Produce ECS formatted logstash logs to Event Platform, allowing them to be queried in the WMF Data Lake with SQL - https://phabricator.wikimedia.org/T291645#12238908 (10Ottomata) > We now have a means for any applic... [19:42:47] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): Update regular expressions for bot UserAgents - https://phabricator.wikimedia.org/T428267#12239036 (10mforns) Good question, we could maybe add this as part of the recurrent bot traffic audit? [21:43:18] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): Handling Flagged Revs for Attribution API - https://phabricator.wikimedia.org/T435557 (10AKhatun_WMF) 03NEW [22:04:10] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 07OKR-Work, 13Patch-For-Review, 10Test Kitchen (Experiment Platform Sprint 28): [DE3.2.8] Improve app instrument event data data lake management - https://phabricator.wikimedia.org/T434445#12239528 (10mpopov) 05Open→03Resolved