[06:42:16] 06Data-Engineering: dbt compilation error: day is out of range for month - https://phabricator.wikimedia.org/T436493 (10KCVelaga_WMF) 03NEW [06:42:22] 06Data-Engineering: dbt compilation error: day is out of range for month - https://phabricator.wikimedia.org/T436493#12269671 (10KCVelaga_WMF) p:05Triage→03High [06:43:51] 06Data-Engineering: dbt compilation error: day is out of range for month - https://phabricator.wikimedia.org/T436493#12269672 (10KCVelaga_WMF) [08:56:15] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): dbt isolated model orchestration - https://phabricator.wikimedia.org/T430625#12270086 (10GGoncalves-WMF) 05Open→03Resolved Agree! For posterity, the new documentation is at https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/dbt/Schedule-d... [09:47:58] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10Event-Platform, 13Patch-For-Review: Flink - Test `zstd` compression - https://phabricator.wikimedia.org/T429456#12270247 (10JMonton-WMF) The results from the test are these: I used the topic eqiad.mediawiki.page_html_feature_counts_change.v1 for i... [09:55:35] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10Event-Platform: Review "page_view" schema, definition and operations. - https://phabricator.wikimedia.org/T427901#12270267 (10JMonton-WMF) [09:57:16] 06Data-Engineering: dbt compilation error: day is out of range for month - https://phabricator.wikimedia.org/T436493#12270271 (10GGoncalves-WMF) [[ https://gitlab.wikimedia.org/repos/data-engineering/dbt-jobs/-/blob/main/models/fy-2026-2027-metrics/deepen_engagement/de3_3_registered_active_reader_accounts.sql?re... [10:02:25] 06Data-Engineering: dbt compilation error: day is out of range for month - https://phabricator.wikimedia.org/T436493#12270286 (10KCVelaga_WMF) > Relating this to T430625, I think the reason why de3_3_registered_active_reader_accounts is breaking unrelated models like media_traffic_known_clients_daily is that bot... [10:08:38] 06Data-Engineering: dbt compilation error: day is out of range for month - https://phabricator.wikimedia.org/T436493#12270297 (10KCVelaga_WMF) >>! In T436493#12270269, @GGoncalves-WMF wrote: > > So I propose the following next steps, using this as a chance to do a little cleanup of the dbt repository: > > 1. I... [10:10:58] 06Data-Engineering, 06Data-Engineering-Radar, 06Traffic, 13Patch-For-Review: Normalize URI host in Turnilo's webrequest_sampled_live - https://phabricator.wikimedia.org/T434766#12270301 (10Fabfur) We've identified the issue (the Host header was captured and logged before the normalization directive). We've... [10:52:51] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): dbt compilation error: day is out of range for month - https://phabricator.wikimedia.org/T436493#12270385 (10Milimetric) a:03Milimetric Fixed by Antonio here: https://gitlab.wikimedia.org/repos/data-engineering/dbt-jobs/-/merge_requests/174 Rerun jobs... [13:23:02] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 06Traffic, 13Patch-For-Review: Turnilo: X-Is-Browser filter doesn't work (always HTTP 500) - https://phabricator.wikimedia.org/T435152#12270798 (10JAllemandou) Hi @CDanis and @Krinkle , I have added a new field `X-Is-Browser score (STR)` to make filt... [13:44:27] 06Data-Engineering, 06Data-Engineering-Radar, 06DBA: Move SpecialUnusedTemplates computation to Hadoop - https://phabricator.wikimedia.org/T422443#12270890 (10JAllemandou) >>! In T422443#12228359, @Zabe wrote: > @JAllemandou the DAG is failing, but only for commonswiki. Any idea why that is the case? I have... [13:49:34] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): MWH `page_is_deleted` and `revision_is_deleted_py_page_deletion` are not consistent - https://phabricator.wikimedia.org/T430543#12270907 (10AKhatun_WMF) Apologies for the delay! Some of the scenarios are real cases, but some are bugs(?). It would be best... [13:54:18] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 06Data-Platform-SRE: Data Lake ingestion after Hadoop: decide the future of Sqoop and Gobblin - https://phabricator.wikimedia.org/T435489#12270917 (10JAllemandou) My 2 cents: * Replacing Gobblin should be a lot easier than replacing Sqoop as we use Go... [13:58:42] 06Data-Engineering, 06Data-Platform-SRE (2026-08-28 - 2026-09-18), 13Patch-For-Review: [Infra] Add a presto query logger - https://phabricator.wikimedia.org/T269832#12270928 (10Ahoelzl) [14:15:34] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 06Traffic: Turnilo: X-Is-Browser filter doesn't work (always HTTP 500) - https://phabricator.wikimedia.org/T435152#12271154 (10CDanis) Looks good to me, thanks Joseph! [14:20:02] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): GSC→HDFS: fetch data ASAP instead of waiting for late updates - https://phabricator.wikimedia.org/T436523 (10Antoine_Quhen) 03NEW [14:27:44] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): wmf_contributors.edit_per_editor_per_page_daily claims `Martin Urbanec` is a system user - https://phabricator.wikimedia.org/T434217#12271229 (10Snwachukwu) Checked how much editors in the backfill period that's not covered in the events table: `sql SELE... [14:49:55] 06Data-Engineering, 13Patch-For-Review: NEW BUG REPORT wmf.interlanguage_navigation missing mobile data - https://phabricator.wikimedia.org/T396514#12271340 (10Milimetric) [14:52:40] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): dbt: delay job by arbitrary amounts of time - https://phabricator.wikimedia.org/T433976#12271377 (10Milimetric) 05Open→03Declined For now, we decided to use date logic in dbt job config (in the airflow-dags repository). [14:54:01] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 05Metrics-Sprint-2026-2027: Track mobile app and api account registration separately - https://phabricator.wikimedia.org/T429211#12271386 (10Milimetric) For simplicity I'm going to say that this task is just about the metrics work we are wrapping up, u... [14:55:23] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 05Metrics-Sprint-2026-2027: Track mobile app and api account registration separately - https://phabricator.wikimedia.org/T429211#12271399 (10Milimetric) 05Open→03Invalid [15:14:31] 06Data-Engineering, 06Data-Engineering-Radar, 06Java-Scala-Standardization, 06Discovery-Search (2026.08.03 - 2026.08.31), and 2 others: Publish search instance artifact JARs to GitLab Package Registry - https://phabricator.wikimedia.org/T435141#12271456 (10EBernhardson) mjolnir ran it's weekly job to success. [15:14:43] 06Data-Engineering, 06Data-Engineering-Radar, 06Java-Scala-Standardization, 06Discovery-Search (2026.08.03 - 2026.08.31), and 2 others: Publish search instance artifact JARs to GitLab Package Registry - https://phabricator.wikimedia.org/T435141#12271458 (10EBernhardson) [15:22:41] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): MWH `page_is_deleted` and `revision_is_deleted_py_page_deletion` are not consistent - https://phabricator.wikimedia.org/T430543#12271479 (10AKhatun_WMF) a:05AKhatun_WMF→03Ahoelzl [15:24:31] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10DPE-MediaWiki-Incremental-History: Quality verification for mediawiki_history_incremental_v1 using Iceberg time travel - https://phabricator.wikimedia.org/T425734#12271485 (10Snwachukwu) a:05APizzata-WMF→03xcollazo [15:43:00] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 06Data-Platform-SRE: Upgrade airflow-main to 3.3.x - https://phabricator.wikimedia.org/T435480#12271651 (10JAllemandou) a:03JAllemandou [15:53:17] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 13Patch-For-Review: Sqoop globalimagelinks and filerevision - https://phabricator.wikimedia.org/T427532#12271736 (10Ahoelzl) a:05Ahoelzl→03mforns [15:54:11] 06Data-Engineering, 06Data-Platform-SRE: Data Lake ingestion after Hadoop: decide the future of Sqoop and Gobblin - https://phabricator.wikimedia.org/T435489#12271739 (10Ahoelzl) [15:55:23] 06Data-Engineering, 10Data-Engineering-Wikistats, 06Movement-Insights: NEW FEATURE REQUEST: Temp Accounts on Wikistats - https://phabricator.wikimedia.org/T410796#12271743 (10Ahoelzl) [15:56:58] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 06Commons, 06Data-Persistence, 07OKR-Work: Data Lake - sqoop of commons link tables needs to adapt to move to dedicated MariaDB cluster - https://phabricator.wikimedia.org/T431476#12271766 (10Ahoelzl) p:05Triage→03High a:05Ahoelzl→03Milimetr... [16:06:22] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10AQS2.0, 10Data-Platform, 06Growth-Team, and 2 others: top_pages_per_editor returns implausible data for metawiki:Steward requests/Global permissions - https://phabricator.wikimedia.org/T434113#12271793 (10Ahoelzl) a:05Ahoelzl→03Snwachukwu [16:10:55] (03CR) 10Ladsgroup: "Hi again. I merged that patch. I don't think there is any deployment needed for it (but I could be very wrong). Does it look correct on yo" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1328608 (https://phabricator.wikimedia.org/T435634) (owner: 10Ladsgroup) [16:13:53] 06Data-Engineering: [Refine Simplification] Remove Schema Merging in Refine Process by Enforcing Backward Compatibility - https://phabricator.wikimedia.org/T381072#12271813 (10Ahoelzl) a:05Ahoelzl→03None [16:16:42] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10Data-Engineering-Wikistats: The stat site show INVALID on Cantonese Wikipedia. - https://phabricator.wikimedia.org/T411938#12271828 (10Ahoelzl) p:05Triage→03Low a:05Ahoelzl→03Milimetric [16:16:58] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10Data-Engineering-Wikistats: The stat site show INVALID on Cantonese Wikipedia. - https://phabricator.wikimedia.org/T411938#12271831 (10Ahoelzl) Ops Week side task ... [16:54:06] 06Data-Engineering: Load Google Search Console data from BigQuery as soon as it's available and reload when data corrections occur - https://phabricator.wikimedia.org/T436193#12271996 (10nshahquinn-wmf) Maryana agrees that retaining a month of data (just to be extremely clear: a rolling 30 days of data, not the... [18:05:30] 06Data-Engineering, 06Data-Engineering-Radar, 06Traffic: Normalize URI host in Turnilo's webrequest_sampled_live - https://phabricator.wikimedia.org/T434766#12272228 (10Fabfur) 05Open→03Resolved a:03Fabfur as fare as I can see on turnilo, after the change above I can't find occurrences of "funny" `... [19:12:06] FIRING: EventgateProduceRateAnomaly: Significant produce rate deviation (+-25%) on eventgate-logging-external. - https://wikitech.wikimedia.org/wiki/Event_Platform/EventGate - https://grafana.wikimedia.org/d/ZB39Izmnz/eventgate?orgId=1&refresh=1m&var-dc=000000026&var-service=eventgate-logging-external - https://alerts.wikimedia.org/?q=alertname%3DEventgateProduceRateAnomaly [19:45:21] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): dbt: Change YAML group configuration keyword to "scheduling_group" - https://phabricator.wikimedia.org/T436559#12272594 (10amastilovic) a:03amastilovic [19:59:28] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): dbt: Change YAML group configuration keyword to "scheduling_group" - https://phabricator.wikimedia.org/T436559#12272662 (10amastilovic) [20:02:06] RESOLVED: EventgateProduceRateAnomaly: Significant produce rate deviation (+-25%) on eventgate-logging-external. - https://wikitech.wikimedia.org/wiki/Event_Platform/EventGate - https://grafana.wikimedia.org/d/ZB39Izmnz/eventgate?orgId=1&refresh=1m&var-dc=000000026&var-service=eventgate-logging-external - https://alerts.wikimedia.org/?q=alertname%3DEventgateProduceRateAnomaly [20:38:30] 06Data-Engineering, 06Data-Engineering-Radar, 06MediaWiki-API-Platform-Team (MediaWiki-Interfaces-Sprints), 07OKR-Work: REST API vNext: Create dedicated REST shared-schema repository - https://phabricator.wikimedia.org/T432799#12272798 (10AGhirelli-WMF) 05Open→03In progress [20:47:25] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): Hypothesis: Reference Counts [Attribution API] - https://phabricator.wikimedia.org/T432604#12272818 (10AKhatun_WMF) [20:49:17] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): Hypothesis: Reference Counts [Attribution API] - https://phabricator.wikimedia.org/T432604#12272821 (10AKhatun_WMF) [21:26:17] (03PS1) 10Xcollazo: File Export: HQL for point-in-time snapshot of mediawiki content [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1332814 (https://phabricator.wikimedia.org/T431872) [21:39:06] FIRING: EventgateProduceRateAnomaly: Significant produce rate deviation (+-25%) on eventgate-logging-external. - https://wikitech.wikimedia.org/wiki/Event_Platform/EventGate - https://grafana.wikimedia.org/d/ZB39Izmnz/eventgate?orgId=1&refresh=1m&var-dc=000000026&var-service=eventgate-logging-external - https://alerts.wikimedia.org/?q=alertname%3DEventgateProduceRateAnomaly