[08:01:53] (03CR) 10JavierMonton: [C:03+1] "Syntax-wise, it looks good to me, but I'm not yet confident enough to evaluate whether the SQL changes are correct." [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1194951 (https://phabricator.wikimedia.org/T406263) (owner: 10Aleksandar Mastilovic) [08:12:37] 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 06Data-Persistence, 10Data-Persistence-Design-Review, 06Growth-Team, and 3 others: Data Persistence Design Review: Improve Tone Suggested Edits newcomer task - https://phabricator.wikimedia.org/T401021#11267664 (10dcausse) >>! In T401021#11264016... [08:23:24] (03CR) 10Joal: "I'd like to suggest following the existing pattern for reading the new `central_auth.localuser` table instead of adding the `snapshot` fie" [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1194951 (https://phabricator.wikimedia.org/T406263) (owner: 10Aleksandar Mastilovic) [09:52:12] 06Data-Engineering, 10Dumps-Generation, 06Wikibase Reuse Team, 10Wikidata, and 3 others: No Wikidata dumps for Week 40 of 2025 (recurring issue) - https://phabricator.wikimedia.org/T406429#11267946 (10BTullis) [09:57:26] 06Data-Engineering (Q2 FY25/26 October 1st - December 31th): SDS 1.3.6 First analysis review - https://phabricator.wikimedia.org/T407103 (10Antoine_Quhen) 03NEW [09:58:00] 06Data-Engineering, 06Data-Platform-SRE, 10Event-Platform: Avoid accepting Kafka messages with whacky timestamps - https://phabricator.wikimedia.org/T282887#11267977 (10JMonton-WMF) There are 2 possible scenarios causing different issues: - Future timestamps that can block the Kafka's clean-up policy, filli... [10:01:34] 06Data-Engineering: SDS 1.3.6 Import 2 new datasets of Spurs in a parquet table - https://phabricator.wikimedia.org/T407104 (10Antoine_Quhen) 03NEW [10:47:56] 06Data-Engineering, 10Dumps-Generation, 06Wikibase Reuse Team, 10Wikidata, and 3 others: No Wikidata dumps for Week 40 of 2025 (recurring issue) - https://phabricator.wikimedia.org/T406429#11268111 (10BTullis) It's possible that the performance regression is similar to that observed here: [12:05:15] 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 06Movement-Insights, 13Patch-For-Review: NEW BUG REPORT : Referer Name field is Null on Druid pageviews_daily - https://phabricator.wikimedia.org/T406530#11268294 (10JAllemandou) All the data has been backfilled. [12:51:04] 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 06Data-Platform-SRE: Set up a working, usable dbt installation on stat boxes - https://phabricator.wikimedia.org/T406634#11268374 (10LSobanski) Presumably this is correct, please revert if not. [13:37:22] (03CR) 10Joal: [V:03+2 C:03+2] "Merging for deploy" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1194885 (https://phabricator.wikimedia.org/T405533) (owner: 10Joal) [14:13:47] 06Data-Engineering: Stop sqooping revision.rev_sha1 - https://phabricator.wikimedia.org/T406644#11268695 (10Aklapper) [15:16:59] 06Data-Engineering (Q2 FY25/26 October 1st - December 31th): SDS 1.3.6 Import 2 new datasets of Spurs in a parquet table - https://phabricator.wikimedia.org/T407104#11268957 (10Antoine_Quhen) [15:20:50] 06Data-Engineering, 06Data-Platform-SRE, 10Event-Platform: Avoid accepting Kafka messages with whacky timestamps - https://phabricator.wikimedia.org/T282887#11268967 (10JMonton-WMF) 05Open→03In progress [16:19:23] 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 10DPE-Mediawiki-Content, 13Patch-For-Review: Rewrite wmf_content.mediawiki_content_*_v1 tables with a new column for origin_rev_id - https://phabricator.wikimedia.org/T405944#11269224 (10Antoine_Quhen) Done. That took ~3.5h and ~1h respectively. [20:59:17] FIRING: EventgateProduceRateAnomaly: Significant produce rate deviation (+-25%) on eventgate-logging-external in codfw. - https://wikitech.wikimedia.org/wiki/Event_Platform/EventGate - https://grafana.wikimedia.org/d/ZB39Izmnz/eventgate?orgId=1&refresh=1m&var-dc=codfw%2Bprometheus/k8s&var-service=eventgate-logging-external - https://alerts.wikimedia.org/?q=alertname%3DEventgateProduceRateAnomaly [21:04:17] RESOLVED: EventgateProduceRateAnomaly: Significant produce rate deviation (+-25%) on eventgate-logging-external in codfw. - https://wikitech.wikimedia.org/wiki/Event_Platform/EventGate - https://grafana.wikimedia.org/d/ZB39Izmnz/eventgate?orgId=1&refresh=1m&var-dc=codfw%2Bprometheus/k8s&var-service=eventgate-logging-external - https://alerts.wikimedia.org/?q=alertname%3DEventgateProduceRateAnomaly