[00:29:04] FIRING: GobblinKafkaRecordsExtractedNotEqualRecordsExpected: Gobblin job event_default ingested an unexpected number of records for a Kafka topic partition. ... [00:29:04] - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Gobblin - https://grafana.wikimedia.org/d/pAQaJwEnk/gobblin?orgId=1&var-gobblin_job_name=event_default&var-kafka_topic=eqiad.pageview.trending.relative.v1&viewPanel=24 - https://alerts.wikimedia.org/?q=alertname%3DGobblinKafkaRecordsExtractedNotEqualRecordsExpected [00:59:03] RESOLVED: GobblinKafkaRecordsExtractedNotEqualRecordsExpected: Gobblin job event_default ingested an unexpected number of records for a Kafka topic partition. ... [00:59:04] - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Gobblin - https://grafana.wikimedia.org/d/pAQaJwEnk/gobblin?orgId=1&var-gobblin_job_name=event_default&var-kafka_topic=eqiad.pageview.trending.relative.v1&viewPanel=24 - https://alerts.wikimedia.org/?q=alertname%3DGobblinKafkaRecordsExtractedNotEqualRecordsExpected [01:59:04] FIRING: GobblinKafkaRecordsExtractedNotEqualRecordsExpected: Gobblin job event_default ingested an unexpected number of records for a Kafka topic partition. ... [01:59:04] - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Gobblin - https://grafana.wikimedia.org/d/pAQaJwEnk/gobblin?orgId=1&var-gobblin_job_name=event_default&var-kafka_topic=eqiad.pageview.trending.relative.v1&viewPanel=24 - https://alerts.wikimedia.org/?q=alertname%3DGobblinKafkaRecordsExtractedNotEqualRecordsExpected [02:29:04] RESOLVED: GobblinKafkaRecordsExtractedNotEqualRecordsExpected: Gobblin job event_default ingested an unexpected number of records for a Kafka topic partition. ... [02:29:04] - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Gobblin - https://grafana.wikimedia.org/d/pAQaJwEnk/gobblin?orgId=1&var-gobblin_job_name=event_default&var-kafka_topic=eqiad.pageview.trending.relative.v1&viewPanel=24 - https://alerts.wikimedia.org/?q=alertname%3DGobblinKafkaRecordsExtractedNotEqualRecordsExpected [03:29:03] FIRING: GobblinKafkaRecordsExtractedNotEqualRecordsExpected: Gobblin job event_default ingested an unexpected number of records for a Kafka topic partition. ... [03:29:04] - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Gobblin - https://grafana.wikimedia.org/d/pAQaJwEnk/gobblin?orgId=1&var-gobblin_job_name=event_default&var-kafka_topic=eqiad.pageview.trending.relative.v1&viewPanel=24 - https://alerts.wikimedia.org/?q=alertname%3DGobblinKafkaRecordsExtractedNotEqualRecordsExpected [03:53:31] 06Data-Engineering, 06Data-Engineering-Icebox: Improve pageview automated traffic detection heuristics - https://phabricator.wikimedia.org/T280565#12177498 (10nshahquinn-wmf) →14Duplicate dup:03T425661 [03:53:33] 10Data-Engineering-Roadmap, 07Epic: [Epic] KAPOW: The next generation of bot detection in the Data Platform. - https://phabricator.wikimedia.org/T425661#12177500 (10nshahquinn-wmf) [03:58:36] 06Data-Engineering, 06Data-Engineering-Icebox, 10Pageviews-Anomaly: Anomalous views to articles on Carles Puigdemont across multiple Wikipedias - https://phabricator.wikimedia.org/T321707#12177502 (10nshahquinn-wmf) [03:58:44] 06Data-Engineering, 06Data-Engineering-Icebox, 10Pageviews-Anomaly: Anomalous views to articles on Carles Puigdemont across multiple Wikipedias - https://phabricator.wikimedia.org/T321707#12177504 (10nshahquinn-wmf) [03:58:49] 06Data-Engineering, 06SRE: WE 5.4 FY 25/26: Improve automata detection at the edge and pass it to the refinery pipeline - https://phabricator.wikimedia.org/T396562#12177505 (10nshahquinn-wmf) [03:58:51] 06Data-Engineering, 06Data-Engineering-Radar, 10Data Pipelines, 10Pageviews-API, and 3 others: There are anomalies in some of the mostread data on zhwiki for March 2024 - https://phabricator.wikimedia.org/T360499#12177506 (10nshahquinn-wmf) [03:59:03] RESOLVED: GobblinKafkaRecordsExtractedNotEqualRecordsExpected: Gobblin job event_default ingested an unexpected number of records for a Kafka topic partition. ... [03:59:04] - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Gobblin - https://grafana.wikimedia.org/d/pAQaJwEnk/gobblin?orgId=1&var-gobblin_job_name=event_default&var-kafka_topic=eqiad.pageview.trending.relative.v1&viewPanel=24 - https://alerts.wikimedia.org/?q=alertname%3DGobblinKafkaRecordsExtractedNotEqualRecordsExpected [03:59:21] 06Data-Engineering, 06Data-Engineering-Radar, 10Data Pipelines, 10Pageviews-Anomaly, and 4 others: There are anomalies in some of the mostread data on zhwiki for March 2024 - https://phabricator.wikimedia.org/T360499#12177507 (10nshahquinn-wmf) [04:00:33] 06Data-Engineering, 06Data-Engineering-Icebox, 10Pageviews-Anomaly, 06Product-Analytics: Analyse possible bot traffic for ptwiki article Ambev - https://phabricator.wikimedia.org/T282502#12177508 (10nshahquinn-wmf) [04:00:34] 06Data-Engineering, 06Data-Engineering-Icebox, 06Research-Freezer: [Open question] Improve bot identification at scale - https://phabricator.wikimedia.org/T138207#12177509 (10nshahquinn-wmf) [04:00:48] 06Data-Engineering, 06Data-Engineering-Icebox, 10Pageviews-Anomaly: Anomalous views to articles on Carles Puigdemont across multiple Wikipedias - https://phabricator.wikimedia.org/T321707#12177510 (10nshahquinn-wmf) [04:00:50] 06Data-Engineering, 06Data-Engineering-Icebox, 06Research-Freezer: [Open question] Improve bot identification at scale - https://phabricator.wikimedia.org/T138207#12177511 (10nshahquinn-wmf) [04:01:29] 06Data-Engineering, 06Data-Engineering-Icebox, 10Pageviews-Anomaly, 06Product-Analytics: Analyse possible bot traffic for ptwiki article Ambev - https://phabricator.wikimedia.org/T282502#12177512 (10nshahquinn-wmf) p:05High→03Low [04:59:03] FIRING: GobblinKafkaRecordsExtractedNotEqualRecordsExpected: Gobblin job event_default ingested an unexpected number of records for a Kafka topic partition. ... [04:59:04] - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Gobblin - https://grafana.wikimedia.org/d/pAQaJwEnk/gobblin?orgId=1&var-gobblin_job_name=event_default&var-kafka_topic=eqiad.pageview.trending.relative.v1&viewPanel=24 - https://alerts.wikimedia.org/?q=alertname%3DGobblinKafkaRecordsExtractedNotEqualRecordsExpected [05:29:04] RESOLVED: GobblinKafkaRecordsExtractedNotEqualRecordsExpected: Gobblin job event_default ingested an unexpected number of records for a Kafka topic partition. ... [05:29:04] - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Gobblin - https://grafana.wikimedia.org/d/pAQaJwEnk/gobblin?orgId=1&var-gobblin_job_name=event_default&var-kafka_topic=eqiad.pageview.trending.relative.v1&viewPanel=24 - https://alerts.wikimedia.org/?q=alertname%3DGobblinKafkaRecordsExtractedNotEqualRecordsExpected [06:29:04] FIRING: GobblinKafkaRecordsExtractedNotEqualRecordsExpected: Gobblin job event_default ingested an unexpected number of records for a Kafka topic partition. ... [06:29:04] - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Gobblin - https://grafana.wikimedia.org/d/pAQaJwEnk/gobblin?orgId=1&var-gobblin_job_name=event_default&var-kafka_topic=eqiad.pageview.trending.relative.v1&viewPanel=24 - https://alerts.wikimedia.org/?q=alertname%3DGobblinKafkaRecordsExtractedNotEqualRecordsExpected [06:59:03] RESOLVED: GobblinKafkaRecordsExtractedNotEqualRecordsExpected: Gobblin job event_default ingested an unexpected number of records for a Kafka topic partition. ... [06:59:04] - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Gobblin - https://grafana.wikimedia.org/d/pAQaJwEnk/gobblin?orgId=1&var-gobblin_job_name=event_default&var-kafka_topic=eqiad.pageview.trending.relative.v1&viewPanel=24 - https://alerts.wikimedia.org/?q=alertname%3DGobblinKafkaRecordsExtractedNotEqualRecordsExpected [07:59:04] FIRING: GobblinKafkaRecordsExtractedNotEqualRecordsExpected: Gobblin job event_default ingested an unexpected number of records for a Kafka topic partition. ... [07:59:04] - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Gobblin - https://grafana.wikimedia.org/d/pAQaJwEnk/gobblin?orgId=1&var-gobblin_job_name=event_default&var-kafka_topic=eqiad.pageview.trending.relative.v1&viewPanel=24 - https://alerts.wikimedia.org/?q=alertname%3DGobblinKafkaRecordsExtractedNotEqualRecordsExpected [08:29:03] RESOLVED: GobblinKafkaRecordsExtractedNotEqualRecordsExpected: Gobblin job event_default ingested an unexpected number of records for a Kafka topic partition. ... [08:29:04] - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Gobblin - https://grafana.wikimedia.org/d/pAQaJwEnk/gobblin?orgId=1&var-gobblin_job_name=event_default&var-kafka_topic=eqiad.pageview.trending.relative.v1&viewPanel=24 - https://alerts.wikimedia.org/?q=alertname%3DGobblinKafkaRecordsExtractedNotEqualRecordsExpected [09:29:04] FIRING: GobblinKafkaRecordsExtractedNotEqualRecordsExpected: Gobblin job event_default ingested an unexpected number of records for a Kafka topic partition. ... [09:29:04] - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Gobblin - https://grafana.wikimedia.org/d/pAQaJwEnk/gobblin?orgId=1&var-gobblin_job_name=event_default&var-kafka_topic=eqiad.pageview.trending.relative.v1&viewPanel=24 - https://alerts.wikimedia.org/?q=alertname%3DGobblinKafkaRecordsExtractedNotEqualRecordsExpected [09:51:55] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10Data-Persistence-Design-Review, 10Event-Platform: [Data Persistence Design Review] Relative trending pages - https://phabricator.wikimedia.org/T432352#12178134 (10JMonton-WMF) Hi @Eevans, thanks for looking into it! We don't have a lot of data yet... [09:59:04] RESOLVED: GobblinKafkaRecordsExtractedNotEqualRecordsExpected: Gobblin job event_default ingested an unexpected number of records for a Kafka topic partition. ... [09:59:04] - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Gobblin - https://grafana.wikimedia.org/d/pAQaJwEnk/gobblin?orgId=1&var-gobblin_job_name=event_default&var-kafka_topic=eqiad.pageview.trending.relative.v1&viewPanel=24 - https://alerts.wikimedia.org/?q=alertname%3DGobblinKafkaRecordsExtractedNotEqualRecordsExpected [10:59:03] FIRING: GobblinKafkaRecordsExtractedNotEqualRecordsExpected: Gobblin job event_default ingested an unexpected number of records for a Kafka topic partition. ... [10:59:04] - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Gobblin - https://grafana.wikimedia.org/d/pAQaJwEnk/gobblin?orgId=1&var-gobblin_job_name=event_default&var-kafka_topic=eqiad.pageview.trending.relative.v1&viewPanel=24 - https://alerts.wikimedia.org/?q=alertname%3DGobblinKafkaRecordsExtractedNotEqualRecordsExpected [11:12:04] (03CR) 10Aqu: [V:03+2 C:03+2] Add GSC site/url impression Hive tables (032 comments) [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1305857 (https://phabricator.wikimedia.org/T427457) (owner: 10Aqu) [11:29:04] RESOLVED: GobblinKafkaRecordsExtractedNotEqualRecordsExpected: Gobblin job event_default ingested an unexpected number of records for a Kafka topic partition. ... [11:29:04] - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Gobblin - https://grafana.wikimedia.org/d/pAQaJwEnk/gobblin?orgId=1&var-gobblin_job_name=event_default&var-kafka_topic=eqiad.pageview.trending.relative.v1&viewPanel=24 - https://alerts.wikimedia.org/?q=alertname%3DGobblinKafkaRecordsExtractedNotEqualRecordsExpected [11:59:03] FIRING: GobblinKafkaRecordsExtractedNotEqualRecordsExpected: Gobblin job event_default ingested an unexpected number of records for a Kafka topic partition. ... [11:59:04] - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Gobblin - https://grafana.wikimedia.org/d/pAQaJwEnk/gobblin?orgId=1&var-gobblin_job_name=event_default&var-kafka_topic=eqiad.pageview.trending.relative.v1&viewPanel=24 - https://alerts.wikimedia.org/?q=alertname%3DGobblinKafkaRecordsExtractedNotEqualRecordsExpected [12:27:26] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st): Fix mediarequest_top_files OOM - https://phabricator.wikimedia.org/T430737#12178521 (10Ahoelzl) [12:27:39] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): Fix mediarequest_top_files OOM - https://phabricator.wikimedia.org/T430737#12178523 (10Ahoelzl) [12:29:04] RESOLVED: GobblinKafkaRecordsExtractedNotEqualRecordsExpected: Gobblin job event_default ingested an unexpected number of records for a Kafka topic partition. ... [12:29:04] - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Gobblin - https://grafana.wikimedia.org/d/pAQaJwEnk/gobblin?orgId=1&var-gobblin_job_name=event_default&var-kafka_topic=eqiad.pageview.trending.relative.v1&viewPanel=24 - https://alerts.wikimedia.org/?q=alertname%3DGobblinKafkaRecordsExtractedNotEqualRecordsExpected [12:53:03] (03PS1) 10Joal: HQLs to create and import Cloudflare bot directory. [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1319913 (https://phabricator.wikimedia.org/T430673) (owner: 10KCVelaga) [12:53:03] (03CR) 10Joal: [C:03+1] "LGTM! The only dowside I see is that I don't like the term `directory` for a table. This is minor and non-blocking :)" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1319913 (https://phabricator.wikimedia.org/T430673) (owner: 10KCVelaga) [12:58:08] 06Data-Engineering: Master's Thesis Proposal: Contributing to Wikimedia's Data Platform - https://phabricator.wikimedia.org/T428674#12178637 (10Ahoelzl) Hi @JaimeAvaloss, I'm sorry to decline your request. At this point we don't have capacity to support a master thesis. You might want to reach out to other teams... [13:01:18] 06Data-Engineering: Master's Thesis Proposal: Contributing to Wikimedia's Data Platform - https://phabricator.wikimedia.org/T428674#12178650 (10Ahoelzl) 05Open→03Declined [13:03:25] (03CR) 10Joal: "I quickly scanned the code structure and comments, it looks good :)" [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1319887 (https://phabricator.wikimedia.org/T405360) (owner: 10Aqu) [13:05:29] (03CR) 10Joal: "Open dumb question: is it a good idea to keep all columns if the data is already stored as events? Should we only consider the use-case at" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1319873 (https://phabricator.wikimedia.org/T426347) (owner: 10Snwachukwu) [13:21:37] (03CR) 10Ottomata: "https://phabricator.wikimedia.org/T426347#12168993 and below has context! Please chime in Joseph! I am not sure about this, but it is my " [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1319873 (https://phabricator.wikimedia.org/T426347) (owner: 10Snwachukwu) [13:30:03] FIRING: GobblinKafkaRecordsExtractedNotEqualRecordsExpected: Gobblin job event_default ingested an unexpected number of records for a Kafka topic partition. ... [13:30:04] - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Gobblin - https://grafana.wikimedia.org/d/pAQaJwEnk/gobblin?orgId=1&var-gobblin_job_name=event_default&var-kafka_topic=eqiad.pageview.trending.relative.v1&viewPanel=24 - https://alerts.wikimedia.org/?q=alertname%3DGobblinKafkaRecordsExtractedNotEqualRecordsExpected [14:00:03] RESOLVED: GobblinKafkaRecordsExtractedNotEqualRecordsExpected: Gobblin job event_default ingested an unexpected number of records for a Kafka topic partition. ... [14:00:04] - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Gobblin - https://grafana.wikimedia.org/d/pAQaJwEnk/gobblin?orgId=1&var-gobblin_job_name=event_default&var-kafka_topic=eqiad.pageview.trending.relative.v1&viewPanel=24 - https://alerts.wikimedia.org/?q=alertname%3DGobblinKafkaRecordsExtractedNotEqualRecordsExpected [14:10:18] 06Data-Engineering, 06Product-Analytics (Kanban): Setup and populate initial version of user_agents_info table - https://phabricator.wikimedia.org/T430020#12178905 (10KCVelaga_WMF) The initial version of the table is setup and is being populated: * DDL: [[ https://gerrit.wikimedia.org/r/plugins/gitiles/analyt... [14:10:33] 06Data-Engineering, 06Product-Analytics (Kanban): Setup and populate initial version of user_agents_info table - https://phabricator.wikimedia.org/T430020#12178909 (10KCVelaga_WMF) 05Open→03Resolved [14:11:30] 06Data-Engineering, 06Product-Analytics (Kanban): Setup and populate initial version of user_agents_info table - https://phabricator.wikimedia.org/T430020#12178915 (10KCVelaga_WMF) [14:27:32] 06Data-Engineering, 06Data-Engineering-Radar, 06Discovery-Search (2026.06.01 - 2026.07.03), 10Event-Platform: Upgrade flink-utilities to flink 2.0.2 - https://phabricator.wikimedia.org/T429565#12178984 (10pfischer) 05Open→03Resolved [14:27:33] 06Data-Engineering, 06Data-Engineering-Radar, 06Discovery-Search (2026.06.01 - 2026.07.03), 10Event-Platform: Extract eventutilities-flink outside of wikimedia-eventutilities - https://phabricator.wikimedia.org/T429566#12178986 (10pfischer) 05Open→03Resolved [14:29:04] FIRING: GobblinKafkaRecordsExtractedNotEqualRecordsExpected: Gobblin job event_default ingested an unexpected number of records for a Kafka topic partition. ... [14:29:04] - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Gobblin - https://grafana.wikimedia.org/d/pAQaJwEnk/gobblin?orgId=1&var-gobblin_job_name=event_default&var-kafka_topic=eqiad.pageview.trending.relative.v1&viewPanel=24 - https://alerts.wikimedia.org/?q=alertname%3DGobblinKafkaRecordsExtractedNotEqualRecordsExpected [14:40:46] 06Data-Engineering, 06Data-Engineering-Radar, 10CirrusSearch, 06Discovery-Search (2026.08.03 - 2026.08.31), 10Event-Platform: EventRowSerializer does not support schema upgrades - https://phabricator.wikimedia.org/T432207#12179064 (10pfischer) [14:58:41] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10Event-Platform, 13Patch-For-Review: Review `pageview` and `pageview.trending.relative` Kafka topic sizes. - https://phabricator.wikimedia.org/T432204#12179199 (10JMonton-WMF) Compaction `cleanup.policy=compact,delete` was added to `pageview.trendin... [14:59:04] RESOLVED: GobblinKafkaRecordsExtractedNotEqualRecordsExpected: Gobblin job event_default ingested an unexpected number of records for a Kafka topic partition. ... [14:59:04] - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Gobblin - https://grafana.wikimedia.org/d/pAQaJwEnk/gobblin?orgId=1&var-gobblin_job_name=event_default&var-kafka_topic=eqiad.pageview.trending.relative.v1&viewPanel=24 - https://alerts.wikimedia.org/?q=alertname%3DGobblinKafkaRecordsExtractedNotEqualRecordsExpected [15:13:06] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10DPE-MediaWiki-Incremental-History, 10Event-Platform, 13Patch-For-Review: mediawiki.page_change.v1 events - add wikidata id for pages - https://phabricator.wikimedia.org/T428176#12179316 (10Ottomata) @tchin I updated patches to align with how we d... [15:29:04] FIRING: GobblinKafkaRecordsExtractedNotEqualRecordsExpected: Gobblin job event_default ingested an unexpected number of records for a Kafka topic partition. ... [15:29:04] - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Gobblin - https://grafana.wikimedia.org/d/pAQaJwEnk/gobblin?orgId=1&var-gobblin_job_name=event_default&var-kafka_topic=eqiad.pageview.trending.relative.v1&viewPanel=24 - https://alerts.wikimedia.org/?q=alertname%3DGobblinKafkaRecordsExtractedNotEqualRecordsExpected [15:30:04] (03CR) 10Joal: "I don't really have preferences, I was wondering the reason. I assume the point is to start using Iceberg to backfill, as event-tables wil" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1319873 (https://phabricator.wikimedia.org/T426347) (owner: 10Snwachukwu) [15:37:06] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 07Epic: data lake: git commit history - https://phabricator.wikimedia.org/T433696#12179463 (10Ottomata) a:03Ahoelzl [15:37:23] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 06Data-Platform-SRE, 10Dumps-Generation, 10Wikidata: No new wikibase dump downloads being published. - https://phabricator.wikimedia.org/T433240#12179464 (10Ottomata) a:03Ahoelzl [15:37:53] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): analytics-refinery-source repo fails post-merge builds, releases succeed - https://phabricator.wikimedia.org/T426369#12179465 (10Ottomata) a:03Ahoelzl [15:39:18] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): Backfill event_sanitized.mediawiki_page_outlink_topic_prediction_change_v1 with predictions for all existing wiki pages - https://phabricator.wikimedia.org/T431601#12179473 (10Ottomata) a:03Snwachukwu Sandra, assigning to you as you are working on T426... [15:59:04] RESOLVED: GobblinKafkaRecordsExtractedNotEqualRecordsExpected: Gobblin job event_default ingested an unexpected number of records for a Kafka topic partition. ... [15:59:04] - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Gobblin - https://grafana.wikimedia.org/d/pAQaJwEnk/gobblin?orgId=1&var-gobblin_job_name=event_default&var-kafka_topic=eqiad.pageview.trending.relative.v1&viewPanel=24 - https://alerts.wikimedia.org/?q=alertname%3DGobblinKafkaRecordsExtractedNotEqualRecordsExpected [16:08:31] (03CR) 10Ottomata: "Ah, yes. But, this is the 'html current' table, so we will need a job that reads from events in any case." [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1319873 (https://phabricator.wikimedia.org/T426347) (owner: 10Snwachukwu) [16:29:04] FIRING: GobblinKafkaRecordsExtractedNotEqualRecordsExpected: Gobblin job event_default ingested an unexpected number of records for a Kafka topic partition. ... [16:29:04] - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Gobblin - https://grafana.wikimedia.org/d/pAQaJwEnk/gobblin?orgId=1&var-gobblin_job_name=event_default&var-kafka_topic=eqiad.pageview.trending.relative.v1&viewPanel=24 - https://alerts.wikimedia.org/?q=alertname%3DGobblinKafkaRecordsExtractedNotEqualRecordsExpected [16:36:25] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 06Data-Platform-SRE, 10Dumps-Generation, 10Wikidata: No new wikibase dump downloads being published. - https://phabricator.wikimedia.org/T433240#12179864 (10Ahoelzl) @gmodena is this something your team can handle? [16:37:28] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10Event-Platform: eventgate-analytics - allow refetching of stream config - https://phabricator.wikimedia.org/T430154#12179885 (10Ottomata) a:05Ahoelzl→03tchin [16:38:54] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): Audit and update data pipelines that extract thumbnail requests from webrequest_text - https://phabricator.wikimedia.org/T432735#12179892 (10Ottomata) a:05Ahoelzl→03Snwachukwu [16:39:38] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10Dumps-Generation: mediawiki_content_current exports silently omit all pages edited between the snapshot cutoff and dump generation time (enwiki 2026-07-01: ~3,560 pages missing per partition file) - https://phabricator.wikimedia.org/T431872#12179894 (... [16:39:55] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10Dumps-Generation: MediaWiki Content File Exports are incomplete - https://phabricator.wikimedia.org/T431723#12179895 (10Ottomata) a:05Ahoelzl→03APizzata-WMF [16:41:31] 06Data-Engineering: analytics-refinery-source repo fails post-merge builds, releases succeed - https://phabricator.wikimedia.org/T426369#12179926 (10Ottomata) a:05Ahoelzl→03None [16:41:57] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 07Epic: Ingest developer metrics related data sources - https://phabricator.wikimedia.org/T431155#12179941 (10Ottomata) [16:42:28] 06Data-Engineering: Monitor webrequest data loss on a dashboard - https://phabricator.wikimedia.org/T429972#12179942 (10Ottomata) a:05Ahoelzl→03None [16:43:42] 06Data-Engineering: Analyze Superset virtual datasets to find candidates for materialization - https://phabricator.wikimedia.org/T429226#12179957 (10Ottomata) [16:45:42] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 05Metrics-Sprint-2026-2027: Track mobile app and api account registration separately - https://phabricator.wikimedia.org/T429211#12179966 (10Ahoelzl) [16:48:12] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 05Metrics-Sprint-2026-2027: Track mobile app and api account registration separately - https://phabricator.wikimedia.org/T429211#12180005 (10Ottomata) a:05Ahoelzl→03Milimetric We need someone to define and own a new definition of access method as d... [16:49:18] 06Data-Engineering, 10DPE-MediaWiki-Incremental-History: Add user status details for cross-wiki users in MWH - https://phabricator.wikimedia.org/T428018#12180013 (10Ottomata) [16:49:24] 06Data-Engineering, 10DPE-MediaWiki-Incremental-History: Add user status details for cross-wiki users in MWH - https://phabricator.wikimedia.org/T428018#12180015 (10Ottomata) a:05Ahoelzl→03None [16:51:29] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10Data-Engineering-Wikistats: The stat site show INVALID on Cantonese Wikipedia. - https://phabricator.wikimedia.org/T411938#12180025 (10Ottomata) cc @Milimetric [16:58:26] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 06cloud-services-team, 10Cloud-VPS (Debian Bullseye Deprecation), 10Event-Platform: Upgrade (replace) beta|deployment-prep event platform VPS instances - https://phabricator.wikimedia.org/T429497#12180053 (10Ottomata) a:05Ottomata→03tchin [16:59:03] RESOLVED: GobblinKafkaRecordsExtractedNotEqualRecordsExpected: Gobblin job event_default ingested an unexpected number of records for a Kafka topic partition. ... [16:59:04] - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Gobblin - https://grafana.wikimedia.org/d/pAQaJwEnk/gobblin?orgId=1&var-gobblin_job_name=event_default&var-kafka_topic=eqiad.pageview.trending.relative.v1&viewPanel=24 - https://alerts.wikimedia.org/?q=alertname%3DGobblinKafkaRecordsExtractedNotEqualRecordsExpected [17:10:16] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 07Essential-Work, 10Event-Platform: jsonschema-tools should not consider definitions fields in compatibility checks. - https://phabricator.wikimedia.org/T425028#12180105 (10Ottomata) 05Open→03Resolved [17:11:58] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 13Patch-For-Review: Use KAPOW scores for existing metrics (pageviews and unique_devices). - https://phabricator.wikimedia.org/T425668#12180117 (10Ahoelzl) [17:12:25] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): Classify requests to developer.wikimedia.org as pageviews - https://phabricator.wikimedia.org/T428550#12180122 (10mforns) [17:16:17] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10Data Pipelines, 06Data-Platform-SRE (2026-07-03 - 2026-07-31), 07Essential-Work: Airflow dynamic task mapping logs mix up when, on rerun, an id is mapped to a different map_index_template - https://phabricator.wikimedia.org/T408802#12180185 (10Ant... [17:28:12] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10DPE-MediaWiki-Incremental-History, 10Event-Platform: Incremental MWH - MediaWiki event data source improvements - https://phabricator.wikimedia.org/T423935#12180213 (10Ottomata) [17:28:51] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 05Metrics-Sprint-2026-2027: Track mobile app and api account registration separately - https://phabricator.wikimedia.org/T429211#12180216 (10Ottomata) This task might be a duplicate of {T424887} or {T419019}. [18:00:04] FIRING: GobblinKafkaRecordsExtractedNotEqualRecordsExpected: Gobblin job event_default ingested an unexpected number of records for a Kafka topic partition. ... [18:00:04] - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Gobblin - https://grafana.wikimedia.org/d/pAQaJwEnk/gobblin?orgId=1&var-gobblin_job_name=event_default&var-kafka_topic=eqiad.pageview.trending.relative.v1&viewPanel=24 - https://alerts.wikimedia.org/?q=alertname%3DGobblinKafkaRecordsExtractedNotEqualRecordsExpected [18:30:04] RESOLVED: GobblinKafkaRecordsExtractedNotEqualRecordsExpected: Gobblin job event_default ingested an unexpected number of records for a Kafka topic partition. ... [18:30:04] - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Gobblin - https://grafana.wikimedia.org/d/pAQaJwEnk/gobblin?orgId=1&var-gobblin_job_name=event_default&var-kafka_topic=eqiad.pageview.trending.relative.v1&viewPanel=24 - https://alerts.wikimedia.org/?q=alertname%3DGobblinKafkaRecordsExtractedNotEqualRecordsExpected [18:59:04] FIRING: GobblinKafkaRecordsExtractedNotEqualRecordsExpected: Gobblin job event_default ingested an unexpected number of records for a Kafka topic partition. ... [18:59:04] - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Gobblin - https://grafana.wikimedia.org/d/pAQaJwEnk/gobblin?orgId=1&var-gobblin_job_name=event_default&var-kafka_topic=eqiad.pageview.trending.relative.v1&viewPanel=24 - https://alerts.wikimedia.org/?q=alertname%3DGobblinKafkaRecordsExtractedNotEqualRecordsExpected [19:29:03] RESOLVED: GobblinKafkaRecordsExtractedNotEqualRecordsExpected: Gobblin job event_default ingested an unexpected number of records for a Kafka topic partition. ... [19:29:04] - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Gobblin - https://grafana.wikimedia.org/d/pAQaJwEnk/gobblin?orgId=1&var-gobblin_job_name=event_default&var-kafka_topic=eqiad.pageview.trending.relative.v1&viewPanel=24 - https://alerts.wikimedia.org/?q=alertname%3DGobblinKafkaRecordsExtractedNotEqualRecordsExpected [19:32:27] (03CR) 10Mforns: [C:03+2] "Looks great to me! Thank you :-)" [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1311901 (https://phabricator.wikimedia.org/T425663) (owner: 10TChin) [19:49:54] (03CR) 10CI reject: [V:04-1] Add Java implentation of haproxy's sdbm hashing algorithm in C [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1311901 (https://phabricator.wikimedia.org/T425663) (owner: 10TChin) [19:59:04] FIRING: GobblinKafkaRecordsExtractedNotEqualRecordsExpected: Gobblin job event_default ingested an unexpected number of records for a Kafka topic partition. ... [19:59:04] - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Gobblin - https://grafana.wikimedia.org/d/pAQaJwEnk/gobblin?orgId=1&var-gobblin_job_name=event_default&var-kafka_topic=eqiad.pageview.trending.relative.v1&viewPanel=24 - https://alerts.wikimedia.org/?q=alertname%3DGobblinKafkaRecordsExtractedNotEqualRecordsExpected [20:29:04] RESOLVED: GobblinKafkaRecordsExtractedNotEqualRecordsExpected: Gobblin job event_default ingested an unexpected number of records for a Kafka topic partition. ... [20:29:04] - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Gobblin - https://grafana.wikimedia.org/d/pAQaJwEnk/gobblin?orgId=1&var-gobblin_job_name=event_default&var-kafka_topic=eqiad.pageview.trending.relative.v1&viewPanel=24 - https://alerts.wikimedia.org/?q=alertname%3DGobblinKafkaRecordsExtractedNotEqualRecordsExpected [20:59:03] FIRING: GobblinKafkaRecordsExtractedNotEqualRecordsExpected: Gobblin job event_default ingested an unexpected number of records for a Kafka topic partition. ... [20:59:04] - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Gobblin - https://grafana.wikimedia.org/d/pAQaJwEnk/gobblin?orgId=1&var-gobblin_job_name=event_default&var-kafka_topic=eqiad.pageview.trending.relative.v1&viewPanel=24 - https://alerts.wikimedia.org/?q=alertname%3DGobblinKafkaRecordsExtractedNotEqualRecordsExpected [21:09:38] 06Data-Engineering, 06Data-Engineering-Radar, 06Data-Platform-SRE (2026-07-03 - 2026-07-31): hive metastore was down - https://phabricator.wikimedia.org/T432507#12180908 (10mpopov) Happened again last Friday afternoon, which would have been early 2026-08-01 UTC ([[ https://wikimedia.slack.com/archives/CSV483... [21:29:04] RESOLVED: GobblinKafkaRecordsExtractedNotEqualRecordsExpected: Gobblin job event_default ingested an unexpected number of records for a Kafka topic partition. ... [21:29:04] - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Gobblin - https://grafana.wikimedia.org/d/pAQaJwEnk/gobblin?orgId=1&var-gobblin_job_name=event_default&var-kafka_topic=eqiad.pageview.trending.relative.v1&viewPanel=24 - https://alerts.wikimedia.org/?q=alertname%3DGobblinKafkaRecordsExtractedNotEqualRecordsExpected [22:29:04] FIRING: GobblinKafkaRecordsExtractedNotEqualRecordsExpected: Gobblin job event_default ingested an unexpected number of records for a Kafka topic partition. ... [22:29:04] - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Gobblin - https://grafana.wikimedia.org/d/pAQaJwEnk/gobblin?orgId=1&var-gobblin_job_name=event_default&var-kafka_topic=eqiad.pageview.trending.relative.v1&viewPanel=24 - https://alerts.wikimedia.org/?q=alertname%3DGobblinKafkaRecordsExtractedNotEqualRecordsExpected [22:59:04] RESOLVED: GobblinKafkaRecordsExtractedNotEqualRecordsExpected: Gobblin job event_default ingested an unexpected number of records for a Kafka topic partition. ... [22:59:04] - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Gobblin - https://grafana.wikimedia.org/d/pAQaJwEnk/gobblin?orgId=1&var-gobblin_job_name=event_default&var-kafka_topic=eqiad.pageview.trending.relative.v1&viewPanel=24 - https://alerts.wikimedia.org/?q=alertname%3DGobblinKafkaRecordsExtractedNotEqualRecordsExpected [23:29:03] FIRING: GobblinKafkaRecordsExtractedNotEqualRecordsExpected: Gobblin job event_default ingested an unexpected number of records for a Kafka topic partition. ... [23:29:04] - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Gobblin - https://grafana.wikimedia.org/d/pAQaJwEnk/gobblin?orgId=1&var-gobblin_job_name=event_default&var-kafka_topic=eqiad.pageview.trending.relative.v1&viewPanel=24 - https://alerts.wikimedia.org/?q=alertname%3DGobblinKafkaRecordsExtractedNotEqualRecordsExpected [23:59:04] RESOLVED: GobblinKafkaRecordsExtractedNotEqualRecordsExpected: Gobblin job event_default ingested an unexpected number of records for a Kafka topic partition. ... [23:59:04] - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Gobblin - https://grafana.wikimedia.org/d/pAQaJwEnk/gobblin?orgId=1&var-gobblin_job_name=event_default&var-kafka_topic=eqiad.pageview.trending.relative.v1&viewPanel=24 - https://alerts.wikimedia.org/?q=alertname%3DGobblinKafkaRecordsExtractedNotEqualRecordsExpected