[00:10:27] 10Analytics-Canonical-Data, 06Movement-Insights (FY26-27 H1), 13Patch-For-Review: Add Iceberg version of canonical data tables - https://phabricator.wikimedia.org/T388291#12357703 (10nshahquinn-wmf) [00:10:32] 10Analytics-Canonical-Data, 06Movement-Insights (FY26-27 H1), 13Patch-For-Review: Add Iceberg version of canonical data tables - https://phabricator.wikimedia.org/T388291#12357704 (10nshahquinn-wmf) a:03nshahquinn-wmf [02:33:46] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 05Metrics-Sprint-2026-2027: Backfill and update schedule of gcp_gsc_export.max_date_sitedata_daily_aggregate - https://phabricator.wikimedia.org/T436999#12357805 (10nshahquinn-wmf) I suggest making two different tables: - `wmf_traffic.google_searches_d... [05:50:36] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 13Patch-For-Review: Implement alerts and create runbooks - https://phabricator.wikimedia.org/T438384#12357954 (10AKhatun_WMF) [06:09:16] 10Analytics-Canonical-Data, 10MediaWiki-Configuration, 10MediaWiki-extensions-Wikibase-Client, 10MediaWiki-extensions-Wikibase-Repo, and 3 others: Completely distinguish various concepts including "global site ID", "global site key", "site DB name", "site ... - https://phabricator.wikimedia.org/T329424#12357980 [06:10:27] 10Analytics-Canonical-Data, 10MediaWiki-Configuration, 10MediaWiki-extensions-Wikibase-Client, 10MediaWiki-extensions-Wikibase-Repo, and 3 others: Completely distinguish various concepts including "global site ID", "global site key", "site DB name", "site ... - https://phabricator.wikimedia.org/T329424#12357983 [07:21:45] (03PS1) 10Aqu: Remove thin deployment environment [analytics/refinery/scap] - 10https://gerrit.wikimedia.org/r/1344537 [08:12:09] (03CR) 10Btullis: [C:03+1] "Looks good. Thanks." [analytics/refinery/scap] - 10https://gerrit.wikimedia.org/r/1344537 (owner: 10Aqu) [08:24:26] (03CR) 10Joal: [C:03+1] "LGTM!" [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1342767 (https://phabricator.wikimedia.org/T425668) (owner: 10Mforns) [08:31:07] 10Analytics-Canonical-Data, 10MediaWiki-Configuration, 10MediaWiki-extensions-Wikibase-Client, 10MediaWiki-extensions-Wikibase-Repo, and 3 others: Completely distinguish various concepts including "global site ID", "global site key", "site DB name", "site ... - https://phabricator.wikimedia.org/T329424#12358639 [09:08:33] 06Data-Engineering: Create article feature counts dashboard - https://phabricator.wikimedia.org/T439065#12358835 (10Aklapper) [09:08:34] 06Data-Engineering: article feature counts SLO setup - https://phabricator.wikimedia.org/T439066#12358836 (10Aklapper) [09:18:28] (03CR) 10Aqu: [V:03+2 C:03+2] Remove thin deployment environment [analytics/refinery/scap] - 10https://gerrit.wikimedia.org/r/1344537 (owner: 10Aqu) [09:23:52] 10Data-Engineering-Roadmap, 07Epic: [Epic] KAPOW: The next generation of bot detection in the Data Platform. - https://phabricator.wikimedia.org/T425661#12358898 (10GGoncalves-WMF) [12:56:06] 06Data-Engineering, 10Data-Platform, 06Data-Platform-SRE, 07Epic, 07Essential-Work: [Tech evaluation] Table management options for the S3 data lake - https://phabricator.wikimedia.org/T437472#12359889 (10Gehel) [13:23:51] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10SRE-SLO: page_change SLO windows - https://phabricator.wikimedia.org/T438054#12360023 (10elukey) @APizzata-WMF got it thanks! @RLazarus will review this use case and propose a way forward soon! [13:26:13] 06Data-Engineering, 10Test Kitchen: event_sanitized.serversideaccountcreation reports users that actually don't exist - https://phabricator.wikimedia.org/T429288#12360053 (10Ottomata) IMO: we should work together to decom SSA in favor of WIP mediawiki.user_change: {T423952}. [13:32:15] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 13Patch-For-Review: Finalize and/or standardize metrics - https://phabricator.wikimedia.org/T438383#12360075 (10Ottomata) @Eevans @Clement_Goubert @fgiunchedi etc., do we have standard http (and maybe grpc) request metric naming and labeling convention... [13:39:04] 06Data-Engineering, 06Data-Engineering-Radar, 06Data-Platform-SRE (2026-09-18 - 2026-10-09), 07Essential-Work: Matomo: Enable “AIAgents” core plugin - https://phabricator.wikimedia.org/T438862#12360121 (10Gehel) [13:39:11] 06Data-Engineering, 06Data-Engineering-Radar, 06Data-Platform-SRE (2026-09-18 - 2026-10-09), 07Essential-Work: Matomo: Enable “AIAgents” core plugin - https://phabricator.wikimedia.org/T438862#12360122 (10Gehel) p:05Triage→03Medium [13:40:01] 10Data-Engineering-Roadmap, 06cloud-services-team, 06Data-Platform-SRE, 10Data-Services, and 3 others: Ability to create new views for tools and analytic purposes - https://phabricator.wikimedia.org/T424524#12360134 (10Gehel) p:05Triage→03Low [13:59:48] 10Analytics-Canonical-Data, 10MediaWiki-Configuration, 10MediaWiki-extensions-Wikibase-Client, 10MediaWiki-extensions-Wikibase-Repo, and 4 others: Completely distinguish various concepts including "global site ID", "global site key", "site DB name", "site ... - https://phabricator.wikimedia.org/T329424#12360245 [14:20:06] 06Data-Engineering, 10Commons-Impact-Metrics, 10Commons-Impact-Metrics-Requests: Update Commons Impact Metrics allow-list for September 2026 - https://phabricator.wikimedia.org/T439050#12360350 (10mforns) Merged! Thank you. [14:25:40] (03PS1) 10Joal: Add spark operational metrics code [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1344687 (https://phabricator.wikimedia.org/T297231) [14:30:22] (03CR) 10CI reject: [V:04-1] Add spark operational metrics code [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1344687 (https://phabricator.wikimedia.org/T297231) (owner: 10Joal) [14:37:27] (03CR) 10Ottomata: Add spark operational metrics code (031 comment) [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1344687 (https://phabricator.wikimedia.org/T297231) (owner: 10Joal) [14:56:50] (03PS2) 10Joal: Add spark operational metrics code [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1344687 (https://phabricator.wikimedia.org/T297231) [15:00:13] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 13Patch-For-Review: User and team Hive database cleanup tracking for Sept 2026 - https://phabricator.wikimedia.org/T437733#12360511 (10Ahoelzl) p:05Triage→03High a:03xcollazo [15:01:23] (03CR) 10CI reject: [V:04-1] Add spark operational metrics code [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1344687 (https://phabricator.wikimedia.org/T297231) (owner: 10Joal) [15:30:42] (03PS3) 10Joal: Add spark operational metrics code [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1344687 (https://phabricator.wikimedia.org/T297231) [15:35:43] (03CR) 10Joal: Add spark operational metrics code (031 comment) [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1344687 (https://phabricator.wikimedia.org/T297231) (owner: 10Joal) [15:36:42] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): dbt-jobs backfill: new reverted-edit models - https://phabricator.wikimedia.org/T438793#12360698 (10amastilovic) Running it now. [15:37:22] (03PS4) 10Joal: Add spark operational metrics code [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1344687 (https://phabricator.wikimedia.org/T297231) [15:41:20] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10AQS2.0, 10Data-Platform, 06Growth-Team, and 3 others: Make the AQS endpoints more usable for the ImpactModule extension - https://phabricator.wikimedia.org/T433983#12360748 (10Urbanecm_WMF) [15:48:44] (03CR) 10CI reject: [V:04-1] Add spark operational metrics code [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1344687 (https://phabricator.wikimedia.org/T297231) (owner: 10Joal) [15:59:16] (03PS5) 10Joal: Add spark operational metrics code [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1344687 (https://phabricator.wikimedia.org/T297231) [17:12:17] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 13Patch-For-Review: MediawikiDumper: Reduce the memory that the huge wiki exports reserve - https://phabricator.wikimedia.org/T438245#12361169 (10xcollazo) **Summary** We measured where the huge wiki export spends its memory. Most of it goes to the re... [17:16:58] (03CR) 10Ottomata: Add spark operational metrics code (031 comment) [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1344687 (https://phabricator.wikimedia.org/T297231) (owner: 10Joal) [17:29:08] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 05Metrics-Sprint-2026-2027: Backfill and update schedule of gcp_gsc_export.max_date_sitedata_daily_aggregate - https://phabricator.wikimedia.org/T436999#12361267 (10Khantstop) @nshahquinn-wmf and team, thanks for putting this together! This looks good... [17:53:54] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 06Product-Analytics: Dbt-jobs backfill: structured_edits_weekly - https://phabricator.wikimedia.org/T438196#12361308 (10amastilovic) This backfill is now completed. [17:54:15] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): dbt-jobs backfill: new reverted-edit models - https://phabricator.wikimedia.org/T438793#12361309 (10amastilovic) Backfill completed. [17:56:06] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10SRE-SLO: page_change SLO windows - https://phabricator.wikimedia.org/T438054#12361311 (10Ahoelzl) a:03APizzata-WMF [17:58:28] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 13Patch-For-Review: MediawikiDumper: Reduce the memory that the huge wiki exports reserve - https://phabricator.wikimedia.org/T438245#12361315 (10Ahoelzl) a:03xcollazo [17:59:23] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): Mediawiki History Failure [2026-04] - https://phabricator.wikimedia.org/T425443#12361317 (10Ahoelzl) a:03Ahoelzl [18:01:05] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 05Metrics-Sprint-2026-2027: Backfill and update schedule of gcp_gsc_export.max_date_sitedata_daily_aggregate - https://phabricator.wikimedia.org/T436999#12361322 (10DTotten-WMF) Overall looks good suggestion: average position is a useful calculation -... [18:03:34] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): MediaWiki History: Fix anonymous-performer misclassification for CentralAuth group changes (caused 2026-04 check failure) - https://phabricator.wikimedia.org/T425443#12361327 (10Ahoelzl) [18:05:40] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10DPE-MediaWiki-Incremental-History, 10Event-Platform, 13Patch-For-Review: Capture relevant mediawiki tags changes in event stream(s) - https://phabricator.wikimedia.org/T434143#12361329 (10Ottomata) @tchin question: Easy to get confused here but:... [18:23:55] 06Data-Engineering, 10DPE-MediaWiki-Incremental-History, 06MediaWiki-API-Platform-Team, 05MW-1.47-notes (1.47.0-wmf.18; 2026-09-01), 13Patch-For-Review: MediaWiki DomainEvents - Include LogEntry - https://phabricator.wikimedia.org/T427815#12361373 (10Ottomata) assuming the log_id+transaction stuff will b... [18:58:06] FIRING: EventgateProduceRateAnomaly: Significant produce rate deviation (+-25%) on eventgate-logging-external. - https://wikitech.wikimedia.org/wiki/Event_Platform/EventGate - https://grafana.wikimedia.org/d/ZB39Izmnz/eventgate?orgId=1&refresh=1m&var-dc=000000026&var-service=eventgate-logging-external - https://alerts.wikimedia.org/?q=alertname%3DEventgateProduceRateAnomaly [19:23:06] RESOLVED: EventgateProduceRateAnomaly: Significant produce rate deviation (+-25%) on eventgate-logging-external. - https://wikitech.wikimedia.org/wiki/Event_Platform/EventGate - https://grafana.wikimedia.org/d/ZB39Izmnz/eventgate?orgId=1&refresh=1m&var-dc=000000026&var-service=eventgate-logging-external - https://alerts.wikimedia.org/?q=alertname%3DEventgateProduceRateAnomaly [19:24:45] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 13Patch-For-Review: MediawikiDumper: Reduce the memory that the huge wiki exports reserve - https://phabricator.wikimedia.org/T438245#12361589 (10xcollazo) >>! In T438245#12361571, @CodeReviewBot wrote: > xcollazo **merged** https://gitlab.wikimedia.or... [19:57:17] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 05Metrics-Sprint-2026-2027: Backfill and update schedule of gcp_gsc_export.max_date_sitedata_daily_aggregate - https://phabricator.wikimedia.org/T436999#12361722 (10nshahquinn-wmf) Thanks @Khantstop! I wrote an explanation of the difference on the [Off... [20:00:26] 06Data-Engineering, 10Datasets-General-or-Unknown, 06Wikimedia Enterprise: Missing DP files 2022-10-19.tsv, 2020-07-19.tsv, 2020-07-20.tsv - https://phabricator.wikimedia.org/T381057#12361740 (10Htriedman) Hi all! Working on backfilling this data now, should be done in the next day or two. Sorry for the dela... [20:18:13] 07Analytics-Data-Problem, 06Data-Engineering, 06Wikimedia Enterprise: Netherlands (NL) absent from country_project_page flat files since 2023-11-09 - https://phabricator.wikimedia.org/T426559#12361804 (10Htriedman) Hi everyone. I've been digging into this issue, and there are some complex issues intersecting... [20:22:01] (03PS1) 10Xcollazo: refinery-job: Sort the XML export partitions in Catalyst [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1344777 (https://phabricator.wikimedia.org/T438245) [20:29:02] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 13Patch-For-Review: MediawikiDumper: Reduce the memory that the huge wiki exports reserve - https://phabricator.wikimedia.org/T438245#12361832 (10xcollazo) **Status** - The merge request !2695 is merged, and the DAG properties are regenerated in Airfl... [20:50:34] (03PS2) 10Xcollazo: refinery-job: Sort the XML export partitions in Catalyst [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1344777 (https://phabricator.wikimedia.org/T438245) [20:53:06] FIRING: EventgateProduceRateAnomaly: Significant produce rate deviation (+-25%) on eventgate-logging-external. - https://wikitech.wikimedia.org/wiki/Event_Platform/EventGate - https://grafana.wikimedia.org/d/ZB39Izmnz/eventgate?orgId=1&refresh=1m&var-dc=000000026&var-service=eventgate-logging-external - https://alerts.wikimedia.org/?q=alertname%3DEventgateProduceRateAnomaly [21:08:36] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 06Movement-Insights: WE3.3 Account Creation metrics dashboard showing lower numbers than expected - https://phabricator.wikimedia.org/T438385#12361921 (10amastilovic) @jwang I'm not sure I understand which rows should be deleted? These `dbt` jobs are... [21:28:06] RESOLVED: EventgateProduceRateAnomaly: Significant produce rate deviation (+-25%) on eventgate-logging-external. - https://wikitech.wikimedia.org/wiki/Event_Platform/EventGate - https://grafana.wikimedia.org/d/ZB39Izmnz/eventgate?orgId=1&refresh=1m&var-dc=000000026&var-service=eventgate-logging-external - https://alerts.wikimedia.org/?q=alertname%3DEventgateProduceRateAnomaly [22:58:40] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 05Metrics-Sprint-2026-2027: Non-incremental active UWERs job has incorrect Airflow schedule and dependencies - https://phabricator.wikimedia.org/T438584#12362201 (10amastilovic) @nshahquinn-wmf would it be possible for the dbt model to be rewritten so...