[03:04:04] 06Data-Engineering, 06Data-Engineering-Icebox, 10Data-Engineering-Wikistats, 10PageViewInfo, and 2 others: Pageviews Analysis 3.0 (Vue + Codex) - https://phabricator.wikimedia.org/T378549#12254926 (10MusikAnimal) [03:07:00] 06Data-Engineering, 06Data-Engineering-Icebox, 10Data-Engineering-Wikistats, 10PageViewInfo, and 2 others: Pageviews Analysis 3.0 (Vue + Codex) - https://phabricator.wikimedia.org/T378549#12254936 (10MusikAnimal) WIP: * https://pageviews-test.wmcloud.org * https://pageviews-test.toolforge.org We'll likely... [04:23:34] 06Data-Engineering, 06Data-Engineering-Icebox, 10Data-Engineering-Wikistats, 10PageViewInfo, and 2 others: Pageviews Analysis 2026 (Vue + Codex) - https://phabricator.wikimedia.org/T378549#12255014 (10MusikAnimal) [08:00:17] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 13Patch-For-Review, 06Product-Analytics (Kanban): Create an MVP data product of API requests - https://phabricator.wikimedia.org/T419522#12255364 (10KCVelaga_WMF) 05In progress→03Resolved We produced three datasets as part of this work: * `w... [13:32:46] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 05Metrics-Sprint-2026-2027: Move all FY2026-2027 chart data to PostgreSQL - https://phabricator.wikimedia.org/T432017#12256748 (10APizzata-WMF) The [[ https://airflow.wikimedia.org/dags/datalake_to_postgres/grid?lastrun=running&search=datalake_to_postg... [13:32:55] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 05Metrics-Sprint-2026-2027: Move all FY2026-2027 chart data to PostgreSQL - https://phabricator.wikimedia.org/T432017#12256749 (10APizzata-WMF) [14:01:07] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10DPE-MediaWiki-Incremental-History, 13Patch-For-Review: migrate dbt_jobs pipelines to use MWH incremental - https://phabricator.wikimedia.org/T429770#12256920 (10Ahoelzl) [15:02:20] 14Analytics, 06Data-Engineering, 10Data-Engineering-Wikistats: shangti0168 - https://phabricator.wikimedia.org/T436127 (10Shangti0168) 03NEW [15:02:51] 14Analytics, 06Data-Engineering, 10Data-Engineering-Wikistats: shangti0168 - https://phabricator.wikimedia.org/T436127#12257530 (10Shangti0168) 安全性'網路安全 [15:03:35] 14Analytics, 06Data-Engineering, 10Data-Engineering-Wikistats: shangti0168 - https://phabricator.wikimedia.org/T436127#12257536 (10Shangti0168) 05Open→03Resolved a:03Shangti0168 安全性'網路路安全 [15:39:13] 06Data-Engineering, 06Data-Engineering-Icebox, 10Data-Engineering-Wikistats, 10PageViewInfo, and 2 others: Pageviews Analysis 2026 (Vue + Codex) - https://phabricator.wikimedia.org/T378549#12257700 (10SunloungerFrog) A little testing I tried out both WIP versions using massviews against Quarry query 90922... [16:00:21] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): wmf_contributors.edit_per_editor_per_page_daily claims `Martin Urbanec` is a system user - https://phabricator.wikimedia.org/T434217#12257846 (10Snwachukwu) > For the record, non-system users are defined by MediaWiki as "user is considered to exist as a... [16:28:44] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): dbt data tests validate production data - https://phabricator.wikimedia.org/T430786#12257982 (10GGoncalves-WMF) This is now documented at https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/dbt/Schedule-dbt-on-Airflow#Run_tests_after_a_model, closi... [16:28:57] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): dbt data tests validate production data - https://phabricator.wikimedia.org/T430786#12257983 (10GGoncalves-WMF) 05Open→03Resolved [16:58:40] 06Data-Engineering, 06Data-Engineering-Radar, 06Data-Platform-SRE, 06Product-Analytics, 10superset.wikimedia.org: Improve Superset's error message for draft dashboards - https://phabricator.wikimedia.org/T405535#12258160 (10Ahoelzl) Seems to be a chart permissioning issue. No error for @Milimetric but er... [17:12:53] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 06Data-Platform-SRE: Data Lake ingestion after Hadoop: decide the future of Sqoop and Gobblin - https://phabricator.wikimedia.org/T435489#12258284 (10Ahoelzl) [17:13:08] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 06Data-Platform-SRE: Data Lake ingestion after Hadoop: decide the future of Sqoop and Gobblin - https://phabricator.wikimedia.org/T435489#12258287 (10Ahoelzl) a:03Ahoelzl [17:22:31] 06Data-Engineering: Reload Google Search Console data for 13-17 August 2026 - https://phabricator.wikimedia.org/T436144 (10nshahquinn-wmf) 03NEW [17:30:07] 06Data-Engineering: Reload Google Search Console data for 13-17 August 2026 - https://phabricator.wikimedia.org/T436144#12258426 (10nshahquinn-wmf) [19:00:32] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10Dumps-Generation: mediawiki_content_current exports silently omit all pages edited between the snapshot cutoff and dump generation time - https://phabricator.wikimedia.org/T431872#12258762 (10xcollazo) [19:03:06] FIRING: EventgateProduceRateAnomaly: Significant produce rate deviation (+-25%) on eventgate-logging-external. - https://wikitech.wikimedia.org/wiki/Event_Platform/EventGate - https://grafana.wikimedia.org/d/ZB39Izmnz/eventgate?orgId=1&refresh=1m&var-dc=000000026&var-service=eventgate-logging-external - https://alerts.wikimedia.org/?q=alertname%3DEventgateProduceRateAnomaly [19:03:42] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10Dumps-Generation: MediaWiki Content File Exports are incomplete - https://phabricator.wikimedia.org/T431723#12258771 (10xcollazo) →14Duplicate dup:03T431872 [19:03:43] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10Dumps-Generation: mediawiki_content_current exports silently omit all pages edited between the snapshot cutoff and dump generation time - https://phabricator.wikimedia.org/T431872#12258773 (10xcollazo) [19:06:14] 14Data-Engineering (Q4 FS25/26 April 1st - June 30st), 05Metrics-Sprint-2026-2027, 13Patch-For-Review: DE3.1 - Logged-out Wikipedia 21-day retention on mobile web - https://phabricator.wikimedia.org/T424706#12258790 (10JAnstee_WMF) 05Open→03In progress [19:07:08] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10Dumps-Generation: mediawiki_content_current exports silently omit all pages edited between the snapshot cutoff and dump generation time - https://phabricator.wikimedia.org/T431872#12258795 (10xcollazo) Hey all, just acknowledging here that we can rep... [19:15:21] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10Test Kitchen, 07OKR-Work (DE1 FY2026-27): [DE 1.1.9] Iceberg table of constructive edits - https://phabricator.wikimedia.org/T433379#12258837 (10mpopov) 05Open→03Invalid We decided to use incremental MWH approach for determining constructiv... [19:48:06] RESOLVED: EventgateProduceRateAnomaly: Significant produce rate deviation (+-25%) on eventgate-logging-external. - https://wikitech.wikimedia.org/wiki/Event_Platform/EventGate - https://grafana.wikimedia.org/d/ZB39Izmnz/eventgate?orgId=1&refresh=1m&var-dc=000000026&var-service=eventgate-logging-external - https://alerts.wikimedia.org/?q=alertname%3DEventgateProduceRateAnomaly [20:45:57] krinkle@stat1011.eqiad.wmnet$ kafkacat .. [20:45:57] bash: kafkacat: command not found [20:46:34] https://sal.toolforge.org/production?p=0&q=stat1011&d= [20:46:39] I guess it got lost in the reimage [20:47:20] kcat [20:48:37] he [20:48:38] nice [20:50:48] https://gerrit.wikimedia.org/g/operations/puppet/+/7b301c6a275c38149aafc5ac3b78fb2f3f339b91/modules/profile/manifests/analytics/cluster/client.pp#38 [21:09:06] FIRING: EventgateProduceRateAnomaly: Significant produce rate deviation (+-25%) on eventgate-logging-external. - https://wikitech.wikimedia.org/wiki/Event_Platform/EventGate - https://grafana.wikimedia.org/d/ZB39Izmnz/eventgate?orgId=1&refresh=1m&var-dc=000000026&var-service=eventgate-logging-external - https://alerts.wikimedia.org/?q=alertname%3DEventgateProduceRateAnomaly [21:59:06] RESOLVED: EventgateProduceRateAnomaly: Significant produce rate deviation (+-25%) on eventgate-logging-external. - https://wikitech.wikimedia.org/wiki/Event_Platform/EventGate - https://grafana.wikimedia.org/d/ZB39Izmnz/eventgate?orgId=1&refresh=1m&var-dc=000000026&var-service=eventgate-logging-external - https://alerts.wikimedia.org/?q=alertname%3DEventgateProduceRateAnomaly [22:00:43] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): Load Google Search Console data into the Data Lake - https://phabricator.wikimedia.org/T420996#12259661 (10Ahoelzl) @nshahquinn-wmf looks like we need options here. Would an immediate daily update paired with a 2-4 days backfill make sense? That way... [22:57:22] 06Data-Engineering: Load Google Search Console data from BigQuery as soon as it's available and reload when data corrections occur - https://phabricator.wikimedia.org/T436193 (10nshahquinn-wmf) 03NEW