[00:27:45] 06Data-Engineering: Request for a new request dataset for caching research - https://phabricator.wikimedia.org/T401331#11076312 (10nshahquinn-wmf) [00:32:10] 06Data-Engineering: Request for a new request dataset for caching research - https://phabricator.wikimedia.org/T401331#11076322 (10nshahquinn-wmf) [00:34:20] 10Analytics-Canonical-Data, 06Research: Create a canonical dataset for incubating wikis - https://phabricator.wikimedia.org/T393075#11076323 (10nshahquinn-wmf) [05:03:32] 10Analytics-Canonical-Data, 10Movement-Insights (FY25-26 H1): Add page view code to the canonical wiki data set - https://phabricator.wikimedia.org/T345124#11076568 (10nshahquinn-wmf) [05:03:54] 10Analytics-Canonical-Data, 10Movement-Insights (FY25-26 H1): Add page view code to the canonical wiki data set - https://phabricator.wikimedia.org/T345124#11076570 (10nshahquinn-wmf) 05Open→03In progress a:03nshahquinn-wmf [08:35:09] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th), 10Data-Platform-SRE (2025.07.26 - 2025.08.15), 10Event-Platform, 13Patch-For-Review: Build Flink docker image on bookworm - https://phabricator.wikimedia.org/T400600#11077072 (10brouberol) According to the [documentation](https://nightlies.apache.o... [08:36:04] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th), 10Data-Platform-SRE (2025.07.26 - 2025.08.15), 10Event-Platform, 13Patch-For-Review: Build Flink docker image on bookworm - https://phabricator.wikimedia.org/T400600#11077073 (10brouberol) @gmodena the doc states: > These Flink features have not b... [08:36:33] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th), 10Data-Platform-SRE (2025.07.26 - 2025.08.15), 10Event-Platform, 13Patch-For-Review: Build Flink docker image on bookworm - https://phabricator.wikimedia.org/T400600#11077077 (10brouberol) Message from @MoritzMuehlenhoff > so I'd say let's simply... [08:43:59] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th), 10Data-Platform-SRE (2025.07.26 - 2025.08.15), 10Event-Platform, 13Patch-For-Review: Build Flink docker image on bookworm - https://phabricator.wikimedia.org/T400600#11077099 (10brouberol) a:03brouberol [08:44:08] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th), 10Data-Platform-SRE (2025.07.26 - 2025.08.15), 10Event-Platform, 13Patch-For-Review: Build Flink docker image on bookworm - https://phabricator.wikimedia.org/T400600#11077102 (10brouberol) 05Open→03In progress [08:46:01] (03CR) 10Joal: [C:03+2] "LGTM! Merge at will" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1177507 (https://phabricator.wikimedia.org/T397923) (owner: 10Aleksandar Mastilovic) [08:47:22] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th): Analyze data differences between `access_method` derived from URL and from x-analytics - https://phabricator.wikimedia.org/T401576#11077116 (10JAllemandou) 05Open→03Resolved [08:47:41] 14Data-Engineering (Q4 2025 April 1st - June 30th): Analyze impact for webrequest and unique devices pipelines to derive access_method without m-dot domain - https://phabricator.wikimedia.org/T389696#11077118 (10JAllemandou) 05In progress→03Resolved [08:53:30] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th): Use `x_analytics` `ismobile` instead of url `.m` subdomain for webrequest mobile-web `access_method` - https://phabricator.wikimedia.org/T401665 (10JAllemandou) 03NEW [08:55:00] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th): Use `x_analytics` `ismobile` instead of url `.m` subdomain for webrequest mobile-web `access_method` - https://phabricator.wikimedia.org/T401665#11077148 (10JAllemandou) [08:55:30] 06Data-Engineering, 06SRE, 06Traffic-Icebox, 10MobileFrontend (Tracking): RFC: Remove m-dot subdomain, serve mobile and desktop variants through the same URL - https://phabricator.wikimedia.org/T214998#11077149 (10JAllemandou) [09:00:27] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th): Hack unique_devices_per_domain recreating `.m` subdomain use `x_analytics` `ismobile` value - https://phabricator.wikimedia.org/T401666 (10JAllemandou) 03NEW [09:00:57] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th): Hack unique_devices_per_domain recreating `.m` subdomain use `x_analytics` `ismobile` value - https://phabricator.wikimedia.org/T401666#11077172 (10JAllemandou) [09:01:27] 06Data-Engineering, 06SRE, 06Traffic-Icebox, 10MobileFrontend (Tracking): RFC: Remove m-dot subdomain, serve mobile and desktop variants through the same URL - https://phabricator.wikimedia.org/T214998#11077173 (10JAllemandou) [09:01:43] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th): Use `x_analytics` `ismobile` instead of url `.m` subdomain for webrequest mobile-web `access_method` - https://phabricator.wikimedia.org/T401665#11077176 (10JAllemandou) p:05Triage→03High a:03JAllemandou [09:02:29] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th): Hack unique_devices_per_domain recreating `.m` subdomain use `x_analytics` `ismobile` value - https://phabricator.wikimedia.org/T401666#11077182 (10JAllemandou) p:05Triage→03High a:03JAllemandou [09:17:25] (03Abandoned) 10Aqu: add zh-wikifunctions project to allowlist [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1177398 (owner: 10Aqu) [09:43:43] 14Analytics, 06Data-Engineering, 06Data-Engineering-Icebox: Count the number of video plays - https://phabricator.wikimedia.org/T198628#11077320 (10Milimetric) Hi @AndrewTavis_WMDE, yes I'm supporting Yaron in his work here. He has a proof of concept metric implementation. We just have to get it incorporat... [09:46:16] 14Analytics, 06Data-Engineering, 06Data-Engineering-Icebox: Count the number of video plays - https://phabricator.wikimedia.org/T198628#11077325 (10AndrewTavis_WMDE) Thanks for the note here, @Milimetric! Please let us know when all of this is finished up and we'll switch out process over to the new metrics. [12:43:30] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th), 10Data-Platform-SRE (2025.07.26 - 2025.08.15), 10Event-Platform, 13Patch-For-Review: Build Flink docker image on bookworm - https://phabricator.wikimedia.org/T400600#11077915 (10BTullis) We might need Java 11 on bookworm in order to support Hadoop,... [13:03:10] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th), 06Data-Platform-SRE, 10Event-Platform: Flink images should be build on top of openjdk - https://phabricator.wikimedia.org/T400296#11077972 (10Ottomata) Oh, @bking! if jattach can do what jmap does, we might not need openjdk. IIUC, the reasoning for... [13:04:01] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th), 10Data-Platform-SRE (2025.07.26 - 2025.08.15), 10Event-Platform, 13Patch-For-Review: Build Flink docker image on bookworm - https://phabricator.wikimedia.org/T400600#11077978 (10Ottomata) What is the urgency for bookworm? I think there is a little... [13:29:50] 06Data-Engineering, 10Data Pipelines: Provide an easy way for MediaWiki to fetch aggregate statistics from the data lake - https://phabricator.wikimedia.org/T341649#11078047 (10Ottomata) Nice, @Addshore, could you summarize that in a brief one or two items and add them to the task description? Thank you! [13:30:45] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th), 10Data-Platform-SRE (2025.07.26 - 2025.08.15), 10Event-Platform, 13Patch-For-Review: Build Flink docker image on bookworm - https://phabricator.wikimedia.org/T400600#11078050 (10MoritzMuehlenhoff) >>! In T400600#11077978, @Ottomata wrote: > What is... [13:33:11] 06Data-Engineering, 06Traffic: Request for a new request dataset for caching research - https://phabricator.wikimedia.org/T401331#11078059 (10Ottomata) [13:34:28] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th): Hack unique_devices_per_domain recreating `.m` subdomain use `x_analytics` `ismobile` value - https://phabricator.wikimedia.org/T401666#11078062 (10JAllemandou) The decision of hacking the metric-definition has been challenged (thanks @Ottomata :) By loo... [13:35:00] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th), 10Data-Platform-SRE (2025.07.26 - 2025.08.15), 10Event-Platform, 13Patch-For-Review: Build Flink docker image on bookworm - https://phabricator.wikimedia.org/T400600#11078063 (10Ottomata) Oh, wow, sooner than I thought. Okay, let's get Java 11 .de... [13:39:54] !log change druid hosts used by datahub and Druid related dags T400330 [13:39:57] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [13:39:58] T400330: Remove an-druid100[1-2] from zookeeper cluster - https://phabricator.wikimedia.org/T400330 [13:55:05] 06Data-Engineering-Radar, 06DBA, 07Schema-change-in-production: Add rc_source_name_timestamp index to recentchanges table in wmf production - https://phabricator.wikimedia.org/T400854#11078138 (10Ladsgroup) [13:57:18] 06Data-Engineering-Radar, 06DBA, 07Schema-change-in-production: Add rc_source_name_timestamp index to recentchanges table in wmf production - https://phabricator.wikimedia.org/T400854#11078143 (10Ladsgroup) [14:01:02] 06Data-Engineering-Radar, 06DBA, 07Schema-change-in-production: Add rc_source_name_timestamp index to recentchanges table in wmf production - https://phabricator.wikimedia.org/T400854#11078156 (10Ladsgroup) [14:35:53] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th): HaproxyKafkaDeliveryErrors AlertLintProblem - https://phabricator.wikimedia.org/T395539#11078334 (10Ottomata) a:03Ottomata [14:38:51] 06Data-Engineering-Radar, 06DBA, 07Schema-change-in-production: Add rc_source_name_timestamp index to recentchanges table in wmf production - https://phabricator.wikimedia.org/T400854#11078354 (10Ladsgroup) [14:50:17] FIRING: EventgateProduceRateAnomaly: Significant produce rate deviation (+-25%) on eventgate-logging-external in codfw. - https://wikitech.wikimedia.org/wiki/Event_Platform/EventGate - https://grafana.wikimedia.org/d/ZB39Izmnz/eventgate?orgId=1&refresh=1m&var-dc=codfw%2Bprometheus/k8s&var-service=eventgate-logging-external - https://alerts.wikimedia.org/?q=alertname%3DEventgateProduceRateAnomaly [15:17:15] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th), 06Data-Platform-SRE, 10Event-Platform: Flink images should be build on top of openjdk - https://phabricator.wikimedia.org/T400296#11078532 (10Ottomata) [15:20:17] RESOLVED: EventgateProduceRateAnomaly: Significant produce rate deviation (+-25%) on eventgate-logging-external in codfw. - https://wikitech.wikimedia.org/wiki/Event_Platform/EventGate - https://grafana.wikimedia.org/d/ZB39Izmnz/eventgate?orgId=1&refresh=1m&var-dc=codfw%2Bprometheus/k8s&var-service=eventgate-logging-external - https://alerts.wikimedia.org/?q=alertname%3DEventgateProduceRateAnomaly [15:33:17] FIRING: EventgateProduceRateAnomaly: Significant produce rate deviation (+-25%) on eventgate-logging-external in codfw. - https://wikitech.wikimedia.org/wiki/Event_Platform/EventGate - https://grafana.wikimedia.org/d/ZB39Izmnz/eventgate?orgId=1&refresh=1m&var-dc=codfw%2Bprometheus/k8s&var-service=eventgate-logging-external - https://alerts.wikimedia.org/?q=alertname%3DEventgateProduceRateAnomaly [15:37:07] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th): Hack unique_devices_per_domain recreating `.m` subdomain use `x_analytics` `ismobile` value - https://phabricator.wikimedia.org/T401666#11078741 (10Krinkle) I would suggest one of two approaches: 1. Explicitly and openly make no attempt to match real do... [15:49:13] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th): Turn dependency on past tasks off for Gobblin DAGs - https://phabricator.wikimedia.org/T401709 (10amastilovic) 03NEW [15:49:44] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th): Turn dependency on past tasks off for Gobblin DAGs - https://phabricator.wikimedia.org/T401709#11078821 (10amastilovic) 05Open→03In progress [15:53:09] (03PS3) 10Mforns: Improve the automated traffic detection pipeline [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1163417 [15:59:35] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th), 10Data-Platform-SRE (2025.07.26 - 2025.08.15), 10Event-Platform, 13Patch-For-Review: Build Flink docker image on bookworm - https://phabricator.wikimedia.org/T400600#11078905 (10bking) I've created T401694 to get Java 11 into the Bookworm repos. On... [16:04:54] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th), 10DPE-Mediawiki-Content: MediaWiki Content History alerts too much for minor reconcile issues - https://phabricator.wikimedia.org/T395139#11078947 (10xcollazo) After fixing the issue discussed in T395139#11044435, we can now see a sharp drop in inconsi... [16:05:46] (03CR) 10Aleksandar Mastilovic: [V:03+2 C:03+2] Add wmf_raw.mediawiki_collation table to snapshot maintenance [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1177507 (https://phabricator.wikimedia.org/T397923) (owner: 10Aleksandar Mastilovic) [16:13:17] RESOLVED: EventgateProduceRateAnomaly: Significant produce rate deviation (+-25%) on eventgate-logging-external in codfw. - https://wikitech.wikimedia.org/wiki/Event_Platform/EventGate - https://grafana.wikimedia.org/d/ZB39Izmnz/eventgate?orgId=1&refresh=1m&var-dc=codfw%2Bprometheus/k8s&var-service=eventgate-logging-external - https://alerts.wikimedia.org/?q=alertname%3DEventgateProduceRateAnomaly [16:16:16] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th), 06Data-Platform-SRE, 10Event-Platform: Flink images should be build on top of openjdk - https://phabricator.wikimedia.org/T400296#11079011 (10xcollazo) > if jattach can do what jmap does, we might not need openjdk. stat machines do have openjdk: `... [16:25:26] 07Analytics-Data-Problem, 06Data-Engineering: Most edits to subsequently deleted pages have Null event_comment data in mediawiki_history - https://phabricator.wikimedia.org/T401436#11079072 (10Samwalton9-WMF) 05Open→03Invalid Today I Learned that Mediawiki History does not contain some data. When a pag... [16:52:24] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th), 10Event-Platform, 10MW-1.45-notes (1.45.0-wmf.14; 2025-08-12), 13Patch-For-Review: Update event-producing tools to overwrite `meta.dt` - https://phabricator.wikimedia.org/T376026#11079237 (10Ottomata) [16:56:50] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th), 06Data-Platform-SRE, 10Event-Platform: Flink images should be build on top of openjdk - https://phabricator.wikimedia.org/T400296#11079270 (10Ottomata) a:05Ottomata→03brouberol [16:57:39] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th), 06Data-Platform-SRE, 10Event-Platform: Flink images should be build on top of openjdk - https://phabricator.wikimedia.org/T400296#11079276 (10Ottomata) [16:58:03] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th), 10Data-Platform-SRE (2025.07.26 - 2025.08.15), 10Event-Platform, 13Patch-For-Review: Build Flink docker image on bookworm - https://phabricator.wikimedia.org/T400600#11079278 (10Ottomata) [16:59:21] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th), 06Data-Platform-SRE, 10Event-Platform: Flink images should be build on top of openjdk - https://phabricator.wikimedia.org/T400296#11079286 (10Ottomata) @brouberol since you are assigned to T400600, I figured you could work on this at the same time.... [17:02:31] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th), 10Event-Platform, 13Patch-For-Review: Inconsistent state visibility for Flink deployments on dse-k8s-eqiad - https://phabricator.wikimedia.org/T395984#11079324 (10Ottomata) Agree this is done. There are other tasks about memory issues. [17:02:54] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th): Investigate mw-page-content-change Flink memory alerts - https://phabricator.wikimedia.org/T397336#11079326 (10Ottomata) [17:05:59] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th), 10Event-Platform: mediawiki.content_history: flink applications experiencing frequent restarts - https://phabricator.wikimedia.org/T397330#11079338 (10Ottomata) a:03Ottomata [17:07:27] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th): Investigate mw-page-content-change Flink memory alerts - https://phabricator.wikimedia.org/T397336#11079342 (10Ottomata) @gmodena getting my tickets straight. {T397330} is about the JobManager memory issue in dse-k8s, correct? This task can be resolved? [17:08:08] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th), 10Event-Platform: mediawiki.content_history: flink applications experiencing frequent restarts due to JobManager OOMs - https://phabricator.wikimedia.org/T397330#11079346 (10Ottomata) [17:08:35] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th), 10Event-Platform, 13Patch-For-Review: [Event Platform] eventutilites-python: improve consistency guarantees of async process functions - https://phabricator.wikimedia.org/T347282#11079349 (10Ottomata) [17:11:48] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th), 10Event-Platform: mediawiki.content_history: flink applications experiencing frequent restarts due to JobManager OOMs - https://phabricator.wikimedia.org/T397330#11079354 (10Ottomata) p:05Triage→03Medium [17:22:21] 06Data-Engineering: Deploy mediawiki-event-enrichment Flink jobs running 1.20 - https://phabricator.wikimedia.org/T401725 (10Ottomata) 03NEW [17:22:59] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th), 10Event-Platform: mediawiki.content_history: flink applications experiencing frequent restarts due to JobManager OOMs - https://phabricator.wikimedia.org/T397330#11079428 (10Ottomata) [17:23:01] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th), 06Data-Platform-SRE, 10Event-Platform: Flink images should be build on top of openjdk - https://phabricator.wikimedia.org/T400296#11079429 (10Ottomata) [17:23:48] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th), 10Event-Platform: mediawiki.content_history: flink applications experiencing frequent restarts due to JobManager OOMs - https://phabricator.wikimedia.org/T397330#11079431 (10Ottomata) [17:23:51] 06Data-Engineering: Deploy mediawiki-event-enrichment Flink jobs running 1.20 - https://phabricator.wikimedia.org/T401725#11079432 (10Ottomata) [17:23:52] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th), 06Data-Platform-SRE, 10Event-Platform: Flink images should be build on top of openjdk - https://phabricator.wikimedia.org/T400296#11079433 (10Ottomata) [17:24:17] 06Data-Engineering: Deploy mediawiki-event-enrichment Flink jobs running 1.20 - https://phabricator.wikimedia.org/T401725#11079435 (10Ottomata) [17:24:19] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th), 06Data-Platform-SRE, 10Event-Platform: Flink images should be build on top of openjdk - https://phabricator.wikimedia.org/T400296#11079436 (10Ottomata) [17:25:37] 10Data-Engineering-Roadmap, 06Discovery-Search, 10DPE-Mediawiki-Content, 07Epic, 13Patch-For-Review: EPIC: Update flink jobs to support Flink 1.20 - https://phabricator.wikimedia.org/T376812#11079442 (10Ottomata) [17:32:41] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th): Investigate mw-page-content-change Flink memory alerts - https://phabricator.wikimedia.org/T397336#11079466 (10Ottomata) 05Open→03Resolved Since the main investigation and context for issues encountered with T347282 are in that task at T347282#11... [17:47:25] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th), 10Event-Platform: mediawiki.content_history: flink applications experiencing frequent restarts due to JobManager OOMs - https://phabricator.wikimedia.org/T397330#11079545 (10Ottomata) [17:49:04] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th), 10Event-Platform: mediawiki.content_history: flink applications experiencing frequent restarts due to JobManager OOMs - https://phabricator.wikimedia.org/T397330#11079550 (10Ottomata) Copying over context from T397336#11042604 @gmodena wrote: We see... [17:59:38] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th): update mediawiki-event-enrichment base docker image - https://phabricator.wikimedia.org/T400623#11079580 (10Ottomata) →14Duplicate dup:03T401725 [17:59:40] 06Data-Engineering: Deploy mediawiki-event-enrichment Flink jobs running 1.20 - https://phabricator.wikimedia.org/T401725#11079582 (10Ottomata) [18:00:36] 07Analytics-Data-Problem, 06Data-Engineering, 10Event-Platform, 10MediaWiki-Platform-Team (Radar), 05SUL3: [EventBus] Fix incorrect CentralAuth meta.domain values for relevant streams - https://phabricator.wikimedia.org/T400093#11079583 (10Ottomata) a:05Ottomata→03None [18:01:29] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th): Deploy mediawiki-event-enrichment Flink jobs running 1.20 - https://phabricator.wikimedia.org/T401725#11079587 (10Ottomata) [18:10:31] 06Data-Engineering, 10Event-Platform, 13Patch-For-Review: Add schema diffing support to jsonschema-tools and run diff in CI - https://phabricator.wikimedia.org/T321850#11079592 (10Ottomata) [18:14:54] 06Data-Engineering, 10Event-Platform, 13Patch-For-Review: Add schema diffing support to jsonschema-tools and run diff in CI - https://phabricator.wikimedia.org/T321850#11079614 (10Ottomata) [18:15:12] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th), 10Event-Platform, 13Patch-For-Review: Add schema diffing support to jsonschema-tools and run diff in CI - https://phabricator.wikimedia.org/T321850#11079616 (10Ottomata) a:03Ottomata [18:40:41] 10Analytics-Canonical-Data, 06Movement-Insights: Create a first version of the canonical language dataset - https://phabricator.wikimedia.org/T392951#11079734 (10nshahquinn-wmf) [18:41:28] 10Analytics-Canonical-Data, 06Movement-Insights: Create a first version of the canonical language dataset - https://phabricator.wikimedia.org/T392951#11079736 (10nshahquinn-wmf) [18:43:53] 10Analytics-Canonical-Data, 06Research, 10Movement-Insights (FY25-26 H1): Provide ISO 639 language codes in canonical wiki dataset - https://phabricator.wikimedia.org/T346855#11079739 (10nshahquinn-wmf) @CMyrick-WMF I just realized you've actually been working on {T392951}! We've actually decided not to do t... [18:44:16] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th), 10Event-Platform, 13Patch-For-Review: Add schema diffing support to jsonschema-tools and run diff in CI - https://phabricator.wikimedia.org/T321850#11079741 (10Ottomata) https://gitlab.wikimedia.org/repos/data-engineering/jsonschema-tools/-/merge_req... [18:46:09] 10Analytics-Canonical-Data, 06Research: Create a first version of the canonical language dataset - https://phabricator.wikimedia.org/T392951#11079763 (10nshahquinn-wmf) 05Open→03In progress p:05Medium→03Low a:03CMyrick-WMF [18:47:43] 10Analytics-Canonical-Data, 06Research: Create a first version of the canonical language dataset - https://phabricator.wikimedia.org/T392951#11079771 (10nshahquinn-wmf) @CMyrick-WMF has put together [a first-draft MR](https://gitlab.wikimedia.org/repos/movement-insights/canonical-data/-/merge_requests/18), whi... [18:49:16] 10Analytics-Canonical-Data, 06Research, 10Movement-Insights (FY25-26 H1): Provide ISO 639 language codes in canonical wiki dataset - https://phabricator.wikimedia.org/T346855#11079785 (10nshahquinn-wmf) 05In progress→03Declined [18:53:57] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th), 10Event-Platform, 13Patch-For-Review: Add schema diffing support to jsonschema-tools and run diff in CI - https://phabricator.wikimedia.org/T321850#11079814 (10Ottomata) Hm, https://github.com/homeport/dyff?tab=readme-ov-file#use-cases-and-examples h... [19:49:50] 06Data-Engineering-Radar, 06DBA, 07Schema-change-in-production: Add rc_source_name_timestamp index to recentchanges table in wmf production - https://phabricator.wikimedia.org/T400854#11080027 (10Ladsgroup) [20:10:45] 06Data-Engineering-Radar, 06DBA, 07Schema-change-in-production: Add rc_source_name_timestamp index to recentchanges table in wmf production - https://phabricator.wikimedia.org/T400854#11080146 (10Ladsgroup) [21:04:33] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th), 13Patch-For-Review: Adapt Sqoop for categorylinks schema change - https://phabricator.wikimedia.org/T397923#11080353 (10amastilovic) 05Open→03Resolved [21:09:25] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th), 10Event-Platform, 13Patch-For-Review: Add schema diffing support to jsonschema-tools and run diff in CI - https://phabricator.wikimedia.org/T321850#11080376 (10Ottomata) Got a little demo up: https://gitlab.wikimedia.org/repos/data-engineering/schem... [23:42:09] 10Analytics-Canonical-Data, 10Movement-Insights (FY25-26 H1), 13Patch-For-Review: Add page view code to the canonical wiki data set - https://phabricator.wikimedia.org/T345124#11080808 (10nshahquinn-wmf) 05In progress→03Resolved I've deployed the new dataset to the Data Lake. For the record, I joine...