[00:29:04] <jinxer-wm>	 FIRING: [2x] GobblinKafkaRecordsExtractedNotEqualRecordsExpected: Gobblin job event_default ingested an unexpected number of records for a Kafka topic partition. ...
[00:29:04] <jinxer-wm>	 - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Gobblin - https://grafana.wikimedia.org/d/pAQaJwEnk/gobblin?orgId=1&var-gobblin_job_name=event_default&var-kafka_topic=eqiad.pageview.trending.relative.v1&viewPanel=24 - https://alerts.wikimedia.org/?q=alertname%3DGobblinKafkaRecordsExtractedNotEqualRecordsExpected
[00:59:04] <jinxer-wm>	 RESOLVED: GobblinKafkaRecordsExtractedNotEqualRecordsExpected: Gobblin job event_default ingested an unexpected number of records for a Kafka topic partition. ...
[00:59:04] <jinxer-wm>	 - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Gobblin - https://grafana.wikimedia.org/d/pAQaJwEnk/gobblin?orgId=1&var-gobblin_job_name=event_default&var-kafka_topic=eqiad.pageview.trending.relative.v1&viewPanel=24 - https://alerts.wikimedia.org/?q=alertname%3DGobblinKafkaRecordsExtractedNotEqualRecordsExpected
[01:29:03] <jinxer-wm>	 FIRING: GobblinKafkaRecordsExtractedNotEqualRecordsExpected: Gobblin job event_default ingested an unexpected number of records for a Kafka topic partition. ...
[01:29:04] <jinxer-wm>	 - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Gobblin - https://grafana.wikimedia.org/d/pAQaJwEnk/gobblin?orgId=1&var-gobblin_job_name=event_default&var-kafka_topic=eqiad.pageview.trending.relative.v1&viewPanel=24 - https://alerts.wikimedia.org/?q=alertname%3DGobblinKafkaRecordsExtractedNotEqualRecordsExpected
[01:59:04] <jinxer-wm>	 FIRING: [2x] GobblinKafkaRecordsExtractedNotEqualRecordsExpected: Gobblin job event_default ingested an unexpected number of records for a Kafka topic partition. ...
[01:59:04] <jinxer-wm>	 - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Gobblin - https://grafana.wikimedia.org/d/pAQaJwEnk/gobblin?orgId=1&var-gobblin_job_name=event_default&var-kafka_topic=eqiad.pageview.trending.relative.v1&viewPanel=24 - https://alerts.wikimedia.org/?q=alertname%3DGobblinKafkaRecordsExtractedNotEqualRecordsExpected
[02:29:04] <jinxer-wm>	 RESOLVED: GobblinKafkaRecordsExtractedNotEqualRecordsExpected: Gobblin job event_default ingested an unexpected number of records for a Kafka topic partition. ...
[02:29:04] <jinxer-wm>	 - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Gobblin - https://grafana.wikimedia.org/d/pAQaJwEnk/gobblin?orgId=1&var-gobblin_job_name=event_default&var-kafka_topic=eqiad.pageview.trending.relative.v1&viewPanel=24 - https://alerts.wikimedia.org/?q=alertname%3DGobblinKafkaRecordsExtractedNotEqualRecordsExpected
[03:00:04] <jinxer-wm>	 FIRING: GobblinKafkaRecordsExtractedNotEqualRecordsExpected: Gobblin job event_default ingested an unexpected number of records for a Kafka topic partition. ...
[03:00:04] <jinxer-wm>	 - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Gobblin - https://grafana.wikimedia.org/d/pAQaJwEnk/gobblin?orgId=1&var-gobblin_job_name=event_default&var-kafka_topic=eqiad.pageview.trending.relative.v1&viewPanel=24 - https://alerts.wikimedia.org/?q=alertname%3DGobblinKafkaRecordsExtractedNotEqualRecordsExpected
[03:30:03] <jinxer-wm>	 FIRING: [2x] GobblinKafkaRecordsExtractedNotEqualRecordsExpected: Gobblin job event_default ingested an unexpected number of records for a Kafka topic partition. ...
[03:30:04] <jinxer-wm>	 - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Gobblin - https://grafana.wikimedia.org/d/pAQaJwEnk/gobblin?orgId=1&var-gobblin_job_name=event_default&var-kafka_topic=eqiad.pageview.trending.relative.v1&viewPanel=24 - https://alerts.wikimedia.org/?q=alertname%3DGobblinKafkaRecordsExtractedNotEqualRecordsExpected
[04:00:04] <jinxer-wm>	 RESOLVED: GobblinKafkaRecordsExtractedNotEqualRecordsExpected: Gobblin job event_default ingested an unexpected number of records for a Kafka topic partition. ...
[04:00:04] <jinxer-wm>	 - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Gobblin - https://grafana.wikimedia.org/d/pAQaJwEnk/gobblin?orgId=1&var-gobblin_job_name=event_default&var-kafka_topic=eqiad.pageview.trending.relative.v1&viewPanel=24 - https://alerts.wikimedia.org/?q=alertname%3DGobblinKafkaRecordsExtractedNotEqualRecordsExpected
[04:30:03] <jinxer-wm>	 FIRING: GobblinKafkaRecordsExtractedNotEqualRecordsExpected: Gobblin job event_default ingested an unexpected number of records for a Kafka topic partition. ...
[04:30:04] <jinxer-wm>	 - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Gobblin - https://grafana.wikimedia.org/d/pAQaJwEnk/gobblin?orgId=1&var-gobblin_job_name=event_default&var-kafka_topic=eqiad.pageview.trending.relative.v1&viewPanel=24 - https://alerts.wikimedia.org/?q=alertname%3DGobblinKafkaRecordsExtractedNotEqualRecordsExpected
[05:00:04] <jinxer-wm>	 FIRING: [2x] GobblinKafkaRecordsExtractedNotEqualRecordsExpected: Gobblin job event_default ingested an unexpected number of records for a Kafka topic partition. ...
[05:00:04] <jinxer-wm>	 - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Gobblin - https://grafana.wikimedia.org/d/pAQaJwEnk/gobblin?orgId=1&var-gobblin_job_name=event_default&var-kafka_topic=eqiad.pageview.trending.relative.v1&viewPanel=24 - https://alerts.wikimedia.org/?q=alertname%3DGobblinKafkaRecordsExtractedNotEqualRecordsExpected
[05:30:04] <jinxer-wm>	 RESOLVED: GobblinKafkaRecordsExtractedNotEqualRecordsExpected: Gobblin job event_default ingested an unexpected number of records for a Kafka topic partition. ...
[05:30:04] <jinxer-wm>	 - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Gobblin - https://grafana.wikimedia.org/d/pAQaJwEnk/gobblin?orgId=1&var-gobblin_job_name=event_default&var-kafka_topic=eqiad.pageview.trending.relative.v1&viewPanel=24 - https://alerts.wikimedia.org/?q=alertname%3DGobblinKafkaRecordsExtractedNotEqualRecordsExpected
[06:12:49] <wikibugs>	 (03CR) 10Joal: Add x_provenance to webrequest tables (031 comment) [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1308104 (https://phabricator.wikimedia.org/T431256) (owner: 10Joal)
[06:29:03] <jinxer-wm>	 FIRING: GobblinKafkaRecordsExtractedNotEqualRecordsExpected: Gobblin job event_default ingested an unexpected number of records for a Kafka topic partition. ...
[06:29:04] <jinxer-wm>	 - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Gobblin - https://grafana.wikimedia.org/d/pAQaJwEnk/gobblin?orgId=1&var-gobblin_job_name=event_default&var-kafka_topic=eqiad.pageview.trending.relative.v1&viewPanel=24 - https://alerts.wikimedia.org/?q=alertname%3DGobblinKafkaRecordsExtractedNotEqualRecordsExpected
[06:59:03] <jinxer-wm>	 RESOLVED: GobblinKafkaRecordsExtractedNotEqualRecordsExpected: Gobblin job event_default ingested an unexpected number of records for a Kafka topic partition. ...
[06:59:04] <jinxer-wm>	 - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Gobblin - https://grafana.wikimedia.org/d/pAQaJwEnk/gobblin?orgId=1&var-gobblin_job_name=event_default&var-kafka_topic=eqiad.pageview.trending.relative.v1&viewPanel=24 - https://alerts.wikimedia.org/?q=alertname%3DGobblinKafkaRecordsExtractedNotEqualRecordsExpected
[07:36:51] <wikibugs>	 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): data lake: git commit history - https://phabricator.wikimedia.org/T433696#12186069 (10Addshore)
[07:36:52] <wikibugs>	 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): data lake: phabricator events - https://phabricator.wikimedia.org/T434047 (10Addshore) 03NEW
[07:38:12] <wikibugs>	 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 07Epic: Make developer metrics related data sets available in the data lake - https://phabricator.wikimedia.org/T433683#12186085 (10Addshore) The discussion on the `git` ticket T433696 has been going well, so I thought I'd also go ahead and created {T4...
[08:00:25] <wikibugs>	 14Data-Engineering (Q4 FS25/26 April 1st - June 30st), 05Metrics-Sprint-2026-2027, 13Patch-For-Review: DE3.1 - Logged-out Wikipedia 21-day retention on mobile web - https://phabricator.wikimedia.org/T424706#12186157 (10Test-Kitchen-Experiments-Bot) Your experiment [[ https://growthbook.wikimedia.org/expe...
[08:01:04] <jinxer-wm>	 FIRING: GobblinKafkaRecordsExtractedNotEqualRecordsExpected: Gobblin job event_default ingested an unexpected number of records for a Kafka topic partition. ...
[08:01:04] <jinxer-wm>	 - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Gobblin - https://grafana.wikimedia.org/d/pAQaJwEnk/gobblin?orgId=1&var-gobblin_job_name=event_default&var-kafka_topic=eqiad.pageview.trending.relative.v1&viewPanel=24 - https://alerts.wikimedia.org/?q=alertname%3DGobblinKafkaRecordsExtractedNotEqualRecordsExpected
[08:31:04] <jinxer-wm>	 FIRING: [2x] GobblinKafkaRecordsExtractedNotEqualRecordsExpected: Gobblin job event_default ingested an unexpected number of records for a Kafka topic partition. ...
[08:31:04] <jinxer-wm>	 - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Gobblin - https://grafana.wikimedia.org/d/pAQaJwEnk/gobblin?orgId=1&var-gobblin_job_name=event_default&var-kafka_topic=eqiad.pageview.trending.relative.v1&viewPanel=24 - https://alerts.wikimedia.org/?q=alertname%3DGobblinKafkaRecordsExtractedNotEqualRecordsExpected
[08:34:16] <wikibugs>	 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10Event-Platform, 13Patch-For-Review: Review `pageview` and `pageview.trending.relative` Kafka topic sizes. - https://phabricator.wikimedia.org/T432204#12186278 (10brouberol) All good for `eqiad.pageview.trending.relative.v1` ` brouberol@kafka-jumbo1...
[09:01:04] <jinxer-wm>	 RESOLVED: GobblinKafkaRecordsExtractedNotEqualRecordsExpected: Gobblin job event_default ingested an unexpected number of records for a Kafka topic partition. ...
[09:01:04] <jinxer-wm>	 - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Gobblin - https://grafana.wikimedia.org/d/pAQaJwEnk/gobblin?orgId=1&var-gobblin_job_name=event_default&var-kafka_topic=eqiad.pageview.trending.relative.v1&viewPanel=24 - https://alerts.wikimedia.org/?q=alertname%3DGobblinKafkaRecordsExtractedNotEqualRecordsExpected
[09:13:13] <wikibugs>	 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10Event-Platform, 13Patch-For-Review: Review `pageview` and `pageview.trending.relative` Kafka topic sizes. - https://phabricator.wikimedia.org/T432204#12186378 (10JMonton-WMF)
[16:13:06] <wikibugs>	 06Data-Engineering, 06Data-Engineering-Radar, 10ServiceOps-SharedInfra, 06Editing-team (FY2026-27 Q1 sprint 3), 06ServiceOps (Next quarter): Standard helm chart for simple service-utils nodejs apps - https://phabricator.wikimedia.org/T428174#12188206 (10ppelberg)
[16:13:20] <wikibugs>	 06Data-Engineering, 06Data-Engineering-Radar, 10ServiceOps-SharedInfra, 06ServiceOps (Next quarter): Standard helm chart for simple service-utils nodejs apps - https://phabricator.wikimedia.org/T428174#12188207 (10ppelberg)
[16:14:52] <wikibugs>	 06Data-Engineering, 10Data-Platform, 06Growth-Team, 05DE1.3.2 Impact + Dashboard, 05Goal: Make the AQS endpoints more usable for the ImpactModule extension - https://phabricator.wikimedia.org/T433983#12188235 (10Urbanecm_WMF) Looking for your feedback on this :).
[16:14:59] <wikibugs>	 06Data-Engineering, 10Data-Platform, 06Growth-Team, 05DE1.3.2 Impact + Dashboard, 05Goal: Make the AQS endpoints more usable for the ImpactModule extension - https://phabricator.wikimedia.org/T433983#12188237 (10Urbanecm_WMF)
[16:31:11] <wikibugs>	 06Data-Engineering, 10AQS2.0, 10Data-Platform, 06Growth-Team, 05DE1.3.2 Impact + Dashboard: top_pages_per_editor returns implausible data for metawiki:Steward requests/Global permissions - https://phabricator.wikimedia.org/T434113 (10Urbanecm_WMF) 03NEW
[16:32:19] <wikibugs>	 06Data-Engineering, 10AQS2.0, 10Data-Platform, 06Growth-Team, 05DE1.3.2 Impact + Dashboard: top_pages_per_editor returns implausible data for metawiki:Steward requests/Global permissions - https://phabricator.wikimedia.org/T434113#12188356 (10Urbanecm_WMF) Discussed via Slack as well ([WMF internal link]...
[16:51:42] <wikibugs>	 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10AQS2.0, 10Data-Platform, 06Growth-Team, 05DE1.3.2 Impact + Dashboard: top_pages_per_editor returns implausible data for metawiki:Steward requests/Global permissions - https://phabricator.wikimedia.org/T434113#12188492 (10Milimetric)
[16:51:55] <wikibugs>	 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10AQS2.0, 10Data-Platform, 06Growth-Team, 05DE1.3.2 Impact + Dashboard: top_pages_per_editor returns implausible data for metawiki:Steward requests/Global permissions - https://phabricator.wikimedia.org/T434113#12188494 (10Milimetric) a:03Ahoelzl
[16:55:21] <wikibugs>	 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): Migrate Google Search Console analytics off GCP BigQuery to the Data Lake - https://phabricator.wikimedia.org/T433927#12188506 (10Milimetric)
[17:00:10] <wikibugs>	 06Data-Engineering, 10MediaWiki-Change-tagging, 06Product Safety and Integrity, 05DE4.1 Platform capacity: Remove private tags from mediawiki-history public dumps - https://phabricator.wikimedia.org/T431524#12188528 (10Milimetric) a:03GGoncalves-WMF
[17:00:49] <wikibugs>	 06Data-Engineering, 10MediaWiki-Change-tagging, 06Product Safety and Integrity, 05DE4.1 Platform capacity: Update Sqoop to get `change_tag` and `change_tag_def` from production replicas - https://phabricator.wikimedia.org/T431523#12188534 (10Ottomata) @GGoncalves-WMF we are moving this into Needs Clarifica...
[17:02:08] <wikibugs>	 06Data-Engineering, 10Dumps-Generation: pageviews dump 2022-12 misses zh - https://phabricator.wikimedia.org/T432429#12188549 (10Milimetric) a:03Milimetric There are old tasks that identified all the gaps and proposed backfill strategies.  This was unfortunately deprioritized in 2021, but I agree with you th...
[17:03:25] <wikibugs>	 06Data-Engineering, 10Data-Engineering-Wikistats: Metric is not available for all projects error: show more constructive solution - https://phabricator.wikimedia.org/T433965#12188554 (10Milimetric) a:03Milimetric The error message is a bit confusing, but the underlying issue will be fixed with the upcoming p...
[17:04:05] <wikibugs>	 06Data-Engineering, 10MediaWiki-Change-tagging, 06Product Safety and Integrity, 05DE4.1 Platform capacity: Update Sqoop to get `change_tag` and `change_tag_def` from production replicas - https://phabricator.wikimedia.org/T431523#12188560 (10GGoncalves-WMF) Correct, and I think the main factor for moving t...
[18:14:04] <wikibugs>	 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10Event-Platform, 13Patch-For-Review: Backfill commonswiki and enwiki HTML for latest HTML when non-existent in event.mediawiki_page_html_content_change_v1 - https://phabricator.wikimedia.org/T426347#12188951 (10Snwachukwu) Thanks Isaac. It would be...
[18:45:15] <wikibugs>	 06Data-Engineering, 10AQS2.0, 06Growth-Team, 05DE1.3.2 Impact + Dashboard: AQS - Add per wiki filtering to the edits/v3/per_editor - https://phabricator.wikimedia.org/T434136 (10Ottomata) 03NEW
[18:45:37] <wikibugs>	 06Data-Engineering, 10Data-Platform, 06Growth-Team, 05DE1.3.2 Impact + Dashboard, 05Goal: Make the AQS endpoints more usable for the ImpactModule extension - https://phabricator.wikimedia.org/T433983#12189085 (10Ottomata)
[18:54:19] <wikibugs>	 14Data-Engineering (Q4 FS25/26 April 1st - June 30st), 10DPE-MediaWiki-Incremental-History, 10Event-Platform: mediawiki.page_change.v1 event - Add user first_registration_dt field - https://phabricator.wikimedia.org/T426998#12189113 (10Ottomata) 05Declined→03Open Reopening. If 'central auth registration...
[19:13:37] <wikibugs>	 (03CR) 10Mforns: [C:03+2] "LGTM!" [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1311901 (https://phabricator.wikimedia.org/T425663) (owner: 10TChin)
[19:20:48] <wikibugs>	 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10AQS2.0, 10Data-Platform, 06Growth-Team, 05DE1.3.2 Impact + Dashboard: top_pages_per_editor returns implausible data for metawiki:Steward requests/Global permissions - https://phabricator.wikimedia.org/T434113#12189230 (10Ottomata) `wmf_readersh...
[19:33:58] <wikibugs>	 (03Merged) 10jenkins-bot: Add Java implentation of haproxy's sdbm hashing algorithm in C [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1311901 (https://phabricator.wikimedia.org/T425663) (owner: 10TChin)
[19:35:30] <wikibugs>	 06Data-Engineering, 10DPE-MediaWiki-Incremental-History, 10Event-Platform: Create new mediawiki.tags_change event stream - https://phabricator.wikimedia.org/T434143 (10Ottomata) 03NEW
[19:36:14] <wikibugs>	 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10DPE-MediaWiki-Incremental-History, 10Event-Platform: Incremental MWH - MediaWiki event data source improvements - https://phabricator.wikimedia.org/T423935#12189293 (10Ottomata)
[19:37:09] <wikibugs>	 06Data-Engineering, 10MediaWiki-Change-tagging, 06Product Safety and Integrity, 05DE4.1 Platform capacity: Update Sqoop to get `change_tag` and `change_tag_def` from production replicas - https://phabricator.wikimedia.org/T431523#12189297 (10Ottomata) Related? {T434143}
[20:29:48] <wikibugs>	 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10Test Kitchen, 07OKR-Work (DE1 FY2026-27): [DE 1.1.9] Iceberg table of constructive edits - https://phabricator.wikimedia.org/T433379#12189434 (10ppelberg) hi, @Ahoelzl ! To what extent (if any!) would it be accurate for Editing and Product Analytic...