[07:00:15] 06Data-Engineering, 06Data-Platform-SRE (2026-09-18 - 2026-10-09): Delete orphan EventLogging topic `eventlogging_HomepageModulet` - https://phabricator.wikimedia.org/T429017#12367542 (10brouberol) ` brouberol@kafka-jumbo1010:~$ kafka topics --describe --topic eventlogging_HomepageModulet Error while executing... [07:00:24] 06Data-Engineering, 06Data-Platform-SRE (2026-09-18 - 2026-10-09): Delete orphan EventLogging topic `eventlogging_HomepageModulet` - https://phabricator.wikimedia.org/T429017#12367543 (10brouberol) a:03brouberol [07:00:26] 06Data-Engineering, 06Data-Platform-SRE (2026-09-18 - 2026-10-09): Delete orphan EventLogging topic `eventlogging_HomepageModulet` - https://phabricator.wikimedia.org/T429017#12367545 (10brouberol) 05Open→03Resolved [07:00:40] 06Data-Engineering, 06Data-Platform-SRE (2026-09-18 - 2026-10-09): Delete orphan EventLogging topic `eventlogging_HomepageModulet` - https://phabricator.wikimedia.org/T429017#12367546 (10brouberol) [07:53:16] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10DPE-MediaWiki-Incremental-History, 10Event-Platform, 13Patch-For-Review: Capture relevant mediawiki tags changes in event stream(s) - https://phabricator.wikimedia.org/T434143#12367706 (10tchin) >>! In T434143#12361329, @Ottomata wrote: > @tchin... [08:13:14] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10DPE-MediaWiki-Incremental-History, 10Event-Platform, 13Patch-For-Review: Capture relevant mediawiki tags changes in event stream(s) - https://phabricator.wikimedia.org/T434143#12367918 (10tchin) Hmm but I guess it might be useful if we could join... [08:30:34] 06Data-Engineering: Migrate etl producing wmf_readership.google_sitedata_daily_aggregate to dbt - https://phabricator.wikimedia.org/T439364 (10Antoine_Quhen) 03NEW [08:30:56] 06Data-Engineering: Migrate etl producing wmf_readership.google_sitedata_daily_aggregate to dbt - https://phabricator.wikimedia.org/T439364#12367996 (10Antoine_Quhen) [08:30:59] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 05Metrics-Sprint-2026-2027, 13Patch-For-Review: Backfill and update schedule of gcp_gsc_export.max_date_sitedata_daily_aggregate - https://phabricator.wikimedia.org/T436999#12367997 (10Antoine_Quhen) [09:05:49] (03PS1) 10Aqu: Update GSC table for Spark 3.5 [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1345492 [11:47:01] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 06SRE Observability: Finalize and/or standardize metrics - https://phabricator.wikimedia.org/T438383#12368987 (10hnowlan) [12:26:46] 06Data-Engineering, 06Data-Platform-SRE (2026-09-18 - 2026-10-09), 07Essential-Work, 13Patch-For-Review: Allow unauthenticated access to the dse-k8s OIDC discovery and JWKS endpoints - https://phabricator.wikimedia.org/T435591#12369139 (10BTullis) 05Open→03Resolved I am content that this now works... [12:32:14] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 06SRE Observability: Finalize and/or standardize metrics - https://phabricator.wikimedia.org/T438383#12369170 (10Clement_Goubert) IMO metrics that could be shared with other services should not include anything specific to the service (`afc_something_m... [13:14:40] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10DPE-MediaWiki-Incremental-History, 10Event-Platform: mediawiki.page_change.v1 - include dummy revisions created by page protection changes - https://phabricator.wikimedia.org/T439278#12369389 (10xcollazo) Is this equivalent to a null edit? Because... [13:15:18] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 06SRE Observability: Finalize and/or standardize metrics - https://phabricator.wikimedia.org/T438383#12369390 (10Ottomata) Right, and some metrics are just so standard across many services, especially http stuff: request latency, status codes, etc. It... [13:30:57] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 06MediaWiki-API-Platform-Team, 10Event-Platform, 13Patch-For-Review: mediawiki.page_change.v1 - adapt page change kind model to MediaWiki's PageUpdateCauses. - https://phabricator.wikimedia.org/T430588#12369432 (10xcollazo) What do consumers have t... [14:10:34] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): Migrate cleanup jobs for snapshot datasets from systemd timers to Airflow - https://phabricator.wikimedia.org/T411999#12369649 (10dcausse) Would the existing refinery docker image built from https://gitlab.wikimedia.org/repos/data-engineering/refinery be... [15:13:09] 06Data-Engineering, 10DPE-MediaWiki-Incremental-History, 06MediaWiki-API-Platform-Team, 05MW-1.47-notes (1.47.0-wmf.18; 2026-09-01), 13Patch-For-Review: MediaWiki DomainEvents - Include LogEntry - https://phabricator.wikimedia.org/T427815#12370104 (10Ottomata) Actually, more generally, what we are really... [15:34:27] 14Data-Engineering (Q4 FS25/26 April 1st - June 30st), 10DPE-MediaWiki-Incremental-History: mediawiki_history_incremental_v1: schema specification for stakeholder review - https://phabricator.wikimedia.org/T425573#12370197 (10Ottomata) > T425573#11902846 FYI {T428176} is deloyed. @Pablo @CMyrick-WMF medi... [15:39:49] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10DPE-MediaWiki-Incremental-History, 10Event-Platform: mediawiki.page_change.v1 - include dummy revisions created by page protection changes - https://phabricator.wikimedia.org/T439278#12370223 (10Ottomata) No, 'null edits' are 'reconciliation reques... [15:52:22] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): Stop publishing _SUCCESS files for v2 dumps - https://phabricator.wikimedia.org/T438748#12370313 (10xcollazo) 05In progress→03Resolved [15:52:33] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): refinery-spark: Distribute HdfsFileFingerprintWriter instead of looping in the driver - https://phabricator.wikimedia.org/T438244#12370315 (10xcollazo) 05In progress→03Resolved [16:15:26] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 06MediaWiki-API-Platform-Team, 10Event-Platform, 13Patch-For-Review: mediawiki.page_change.v1 - adapt page change kind model to MediaWiki's PageUpdateCauses. - https://phabricator.wikimedia.org/T430588#12370403 (10Ottomata) Correct. Before decidin... [16:26:23] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): MediaWiki History: Fix anonymous-performer misclassification for CentralAuth group changes (caused 2026-04 check failure) - https://phabricator.wikimedia.org/T425443#12370453 (10Ahoelzl) a:05Ahoelzl→03xcollazo [16:51:13] 06Data-Engineering, 07Epic: EPIC: DYK Archive - https://phabricator.wikimedia.org/T430319#12370558 (10Ahoelzl) [16:51:22] 06Data-Engineering, 07Epic: DYK Archive: Write Design Doc - https://phabricator.wikimedia.org/T431102#12370560 (10Ahoelzl) [16:51:31] 06Data-Engineering, 07Epic: [DYK Archive] Enrichment resolve & enrich linked pages - https://phabricator.wikimedia.org/T433984#12370561 (10Ahoelzl) [16:51:44] 06Data-Engineering, 07Epic: DYK Archive Backfill — Fetch Raw Archive Pages for all wikis - https://phabricator.wikimedia.org/T431103#12370562 (10Ahoelzl) [17:08:22] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 06MediaWiki-API-Platform-Team, 10Event-Platform, 13Patch-For-Review: mediawiki.page_change.v1 - adapt page change kind model to MediaWiki's PageUpdateCauses. - https://phabricator.wikimedia.org/T430588#12370635 (10Ottomata) Here are the consumer us... [17:09:32] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 06MediaWiki-API-Platform-Team, 10Event-Platform, 13Patch-For-Review: mediawiki.page_change.v1 - adapt page change kind model to MediaWiki's PageUpdateCauses. - https://phabricator.wikimedia.org/T430588#12370638 (10Ottomata) Oh, not sure why gerritb... [17:30:52] 07Analytics-Data-Problem, 06Data-Engineering, 06Wikimedia Enterprise, 13Patch-For-Review: Netherlands (NL) absent from country_project_page flat files since 2023-11-09 - https://phabricator.wikimedia.org/T426559#12370736 (10Htriedman) Ok, merge request for backfilling filed here. Would appreciate if anyone... [17:50:45] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 05Metrics-Sprint-2026-2027, 13Patch-For-Review: Calculate active UWERs on a weekly cadence - https://phabricator.wikimedia.org/T437961#12370795 (10Ahoelzl) Discussed in the DE sync meeting. Due to the implementation urgency and challenges with a tags... [18:08:24] 07Analytics-Data-Problem, 06Data-Engineering, 06Wikimedia Enterprise, 13Patch-For-Review: Netherlands (NL) absent from country_project_page flat files since 2023-11-09 - https://phabricator.wikimedia.org/T426559#12370851 (10Htriedman) Another merge request opened [[ https://gitlab.wikimedia.org/repos/data-... [18:17:28] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 05Metrics-Sprint-2026-2027, 13Patch-For-Review: Calculate active UWERs on a weekly cadence - https://phabricator.wikimedia.org/T437961#12370879 (10Ottomata) Thanks. As discussed, let's set an expiration date on weekly sqooping of change_tag and chan... [19:03:06] FIRING: EventgateProduceRateAnomaly: Significant produce rate deviation (+-25%) on eventgate-logging-external. - https://wikitech.wikimedia.org/wiki/Event_Platform/EventGate - https://grafana.wikimedia.org/d/ZB39Izmnz/eventgate?orgId=1&refresh=1m&var-dc=000000026&var-service=eventgate-logging-external - https://alerts.wikimedia.org/?q=alertname%3DEventgateProduceRateAnomaly [19:13:06] RESOLVED: EventgateProduceRateAnomaly: Significant produce rate deviation (+-25%) on eventgate-logging-external. - https://wikitech.wikimedia.org/wiki/Event_Platform/EventGate - https://grafana.wikimedia.org/d/ZB39Izmnz/eventgate?orgId=1&refresh=1m&var-dc=000000026&var-service=eventgate-logging-external - https://alerts.wikimedia.org/?q=alertname%3DEventgateProduceRateAnomaly [19:31:27] (03CR) 10Aleksandar Mastilovic: [C:03+2] HiveToJdbc: Add optional target_table param [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1345051 (https://phabricator.wikimedia.org/T436999) (owner: 10Aqu) [19:31:43] (03CR) 10Aleksandar Mastilovic: [C:03+2] Declare new table Google Sitedata Aggregate [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1345123 (https://phabricator.wikimedia.org/T436999) (owner: 10Aqu) [19:44:16] (03Merged) 10jenkins-bot: HiveToJdbc: Add optional target_table param [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1345051 (https://phabricator.wikimedia.org/T436999) (owner: 10Aqu) [20:16:44] 06Data-Engineering: Create article feature counts dashboard - https://phabricator.wikimedia.org/T439065#12371545 (10AKhatun_WMF) [20:23:28] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): Include v2 dumps into mirrors rsync configuration - https://phabricator.wikimedia.org/T437463#12371605 (10xcollazo) **Update: v2 bz2 size** My previous comment said that v2 `mediawiki_content_history` bz2 is 48% larger than v1 `pages-meta-history` bz2.... [20:58:02] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): Include v2 dumps into mirrors rsync configuration - https://phabricator.wikimedia.org/T437463#12371788 (10xcollazo) **Decision needed: how to choose between v1 and v2 for each run** This comment explains a behavior of the mirror change, the two rules we... [21:00:06] FIRING: EventgateProduceRateAnomaly: Significant produce rate deviation (+-25%) on eventgate-logging-external. - https://wikitech.wikimedia.org/wiki/Event_Platform/EventGate - https://grafana.wikimedia.org/d/ZB39Izmnz/eventgate?orgId=1&refresh=1m&var-dc=000000026&var-service=eventgate-logging-external - https://alerts.wikimedia.org/?q=alertname%3DEventgateProduceRateAnomaly [21:15:06] RESOLVED: EventgateProduceRateAnomaly: Significant produce rate deviation (+-25%) on eventgate-logging-external. - https://wikitech.wikimedia.org/wiki/Event_Platform/EventGate - https://grafana.wikimedia.org/d/ZB39Izmnz/eventgate?orgId=1&refresh=1m&var-dc=000000026&var-service=eventgate-logging-external - https://alerts.wikimedia.org/?q=alertname%3DEventgateProduceRateAnomaly