[00:48:03] <jinxer-wm>	 FIRING: [2x] GobblinKafkaRecordsExtractedNotEqualRecordsExpected: Gobblin job webrequest ingested an unexpected number of records for a Kafka topic partition. ...
[00:48:03] <jinxer-wm>	 - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Gobblin - https://grafana.wikimedia.org/d/pAQaJwEnk/gobblin?orgId=1&var-gobblin_job_name=webrequest&var-kafka_topic=webrequest_text&viewPanel=4 - https://alerts.wikimedia.org/?q=alertname%3DGobblinKafkaRecordsExtractedNotEqualRecordsExpected
[00:58:03] <jinxer-wm>	 FIRING: [3x] GobblinKafkaRecordsExtractedNotEqualRecordsExpected: Gobblin job webrequest ingested an unexpected number of records for a Kafka topic partition. ...
[00:58:03] <jinxer-wm>	 - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Gobblin - https://grafana.wikimedia.org/d/pAQaJwEnk/gobblin?orgId=1&var-gobblin_job_name=webrequest&var-kafka_topic=webrequest_text&viewPanel=4 - https://alerts.wikimedia.org/?q=alertname%3DGobblinKafkaRecordsExtractedNotEqualRecordsExpected
[01:43:03] <jinxer-wm>	 RESOLVED: GobblinKafkaRecordsExtractedNotEqualRecordsExpected: Gobblin job webrequest ingested an unexpected number of records for a Kafka topic partition. ...
[01:43:03] <jinxer-wm>	 - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Gobblin - https://grafana.wikimedia.org/d/pAQaJwEnk/gobblin?orgId=1&var-gobblin_job_name=webrequest&var-kafka_topic=webrequest_text&viewPanel=4 - https://alerts.wikimedia.org/?q=alertname%3DGobblinKafkaRecordsExtractedNotEqualRecordsExpected
[01:44:03] <jinxer-wm>	 FIRING: GobblinKafkaRecordsExtractedNotEqualRecordsExpected: Gobblin job webrequest ingested an unexpected number of records for a Kafka topic partition. ...
[01:44:03] <jinxer-wm>	 - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Gobblin - https://grafana.wikimedia.org/d/pAQaJwEnk/gobblin?orgId=1&var-gobblin_job_name=webrequest&var-kafka_topic=webrequest_text&viewPanel=4 - https://alerts.wikimedia.org/?q=alertname%3DGobblinKafkaRecordsExtractedNotEqualRecordsExpected
[01:48:18] <jinxer-wm>	 FIRING: [2x] GobblinKafkaRecordsExtractedNotEqualRecordsExpected: Gobblin job webrequest ingested an unexpected number of records for a Kafka topic partition. ...
[01:48:19] <jinxer-wm>	 - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Gobblin - https://grafana.wikimedia.org/d/pAQaJwEnk/gobblin?orgId=1&var-gobblin_job_name=webrequest&var-kafka_topic=webrequest_text&viewPanel=4 - https://alerts.wikimedia.org/?q=alertname%3DGobblinKafkaRecordsExtractedNotEqualRecordsExpected
[01:49:03] <jinxer-wm>	 RESOLVED: [2x] GobblinKafkaRecordsExtractedNotEqualRecordsExpected: Gobblin job webrequest ingested an unexpected number of records for a Kafka topic partition. ...
[01:49:03] <jinxer-wm>	 - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Gobblin - https://grafana.wikimedia.org/d/pAQaJwEnk/gobblin?orgId=1&var-gobblin_job_name=webrequest&var-kafka_topic=webrequest_text&viewPanel=4 - https://alerts.wikimedia.org/?q=alertname%3DGobblinKafkaRecordsExtractedNotEqualRecordsExpected
[01:50:03] <jinxer-wm>	 FIRING: GobblinKafkaRecordsExtractedNotEqualRecordsExpected: Gobblin job webrequest ingested an unexpected number of records for a Kafka topic partition. ...
[01:50:03] <jinxer-wm>	 - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Gobblin - https://grafana.wikimedia.org/d/pAQaJwEnk/gobblin?orgId=1&var-gobblin_job_name=webrequest&var-kafka_topic=webrequest_text&viewPanel=4 - https://alerts.wikimedia.org/?q=alertname%3DGobblinKafkaRecordsExtractedNotEqualRecordsExpected
[01:53:18] <jinxer-wm>	 FIRING: [3x] GobblinKafkaRecordsExtractedNotEqualRecordsExpected: Gobblin job webrequest ingested an unexpected number of records for a Kafka topic partition. ...
[01:53:18] <jinxer-wm>	 - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Gobblin - https://grafana.wikimedia.org/d/pAQaJwEnk/gobblin?orgId=1&var-gobblin_job_name=webrequest&var-kafka_topic=webrequest_text&viewPanel=4 - https://alerts.wikimedia.org/?q=alertname%3DGobblinKafkaRecordsExtractedNotEqualRecordsExpected
[02:23:18] <jinxer-wm>	 RESOLVED: GobblinKafkaRecordsExtractedNotEqualRecordsExpected: Gobblin job webrequest ingested an unexpected number of records for a Kafka topic partition. ...
[02:23:19] <jinxer-wm>	 - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Gobblin - https://grafana.wikimedia.org/d/pAQaJwEnk/gobblin?orgId=1&var-gobblin_job_name=webrequest&var-kafka_topic=webrequest_text&viewPanel=4 - https://alerts.wikimedia.org/?q=alertname%3DGobblinKafkaRecordsExtractedNotEqualRecordsExpected
[02:25:03] <jinxer-wm>	 FIRING: [2x] GobblinKafkaRecordsExtractedNotEqualRecordsExpected: Gobblin job webrequest ingested an unexpected number of records for a Kafka topic partition. ...
[02:25:03] <jinxer-wm>	 - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Gobblin - https://grafana.wikimedia.org/d/pAQaJwEnk/gobblin?orgId=1&var-gobblin_job_name=webrequest&var-kafka_topic=webrequest_text&viewPanel=4 - https://alerts.wikimedia.org/?q=alertname%3DGobblinKafkaRecordsExtractedNotEqualRecordsExpected
[04:48:18] <jinxer-wm>	 FIRING: [2x] GobblinKafkaRecordsExtractedNotEqualRecordsExpected: Gobblin job webrequest ingested an unexpected number of records for a Kafka topic partition. ...
[04:48:19] <jinxer-wm>	 - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Gobblin - https://grafana.wikimedia.org/d/pAQaJwEnk/gobblin?orgId=1&var-gobblin_job_name=webrequest&var-kafka_topic=webrequest_text&viewPanel=4 - https://alerts.wikimedia.org/?q=alertname%3DGobblinKafkaRecordsExtractedNotEqualRecordsExpected
[08:01:02] <wikibugs>	 06Data-Engineering, 06Data-Platform-SRE, 06Java-Scala-Standardization, 10Discovery-Search (2025.03.22 - 2025.04.11), 13Patch-For-Review: Migrate existing Java packages to deploying to Gitlab, including new version of parent pom, validation that all depen... - https://phabricator.wikimedia.org/T367405#10728771
[08:50:03] <jinxer-wm>	 FIRING: GobblinKafkaRecordsExtractedNotEqualRecordsExpected: Gobblin job webrequest ingested an unexpected number of records for a Kafka topic partition. ...
[08:50:03] <jinxer-wm>	 - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Gobblin - https://grafana.wikimedia.org/d/pAQaJwEnk/gobblin?orgId=1&var-gobblin_job_name=webrequest&var-kafka_topic=webrequest_text&viewPanel=4 - https://alerts.wikimedia.org/?q=alertname%3DGobblinKafkaRecordsExtractedNotEqualRecordsExpected
[10:00:25] <wikibugs>	 10Data-Engineering (Q4 2025 April 1st - June 30th): Enable Spark data lineage for all Airflow instances - https://phabricator.wikimedia.org/T386862#10729089 (10brouberol) Hmm, we might need to iterate on a test environment so we can figure this out.
[12:38:19] <jinxer-wm>	 RESOLVED: [2x] GobblinKafkaRecordsExtractedNotEqualRecordsExpected: Gobblin job webrequest ingested an unexpected number of records for a Kafka topic partition. ...
[12:38:19] <jinxer-wm>	 - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Gobblin - https://grafana.wikimedia.org/d/pAQaJwEnk/gobblin?orgId=1&var-gobblin_job_name=webrequest&var-kafka_topic=webrequest_text&viewPanel=4 - https://alerts.wikimedia.org/?q=alertname%3DGobblinKafkaRecordsExtractedNotEqualRecordsExpected
[12:40:33] <jinxer-wm>	 FIRING: [3x] GobblinKafkaRecordsExtractedNotEqualRecordsExpected: Gobblin job webrequest ingested an unexpected number of records for a Kafka topic partition. ...
[12:40:33] <jinxer-wm>	 - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Gobblin - https://grafana.wikimedia.org/d/pAQaJwEnk/gobblin?orgId=1&var-gobblin_job_name=webrequest&var-kafka_topic=webrequest_text&viewPanel=4 - https://alerts.wikimedia.org/?q=alertname%3DGobblinKafkaRecordsExtractedNotEqualRecordsExpected
[13:07:55] <wikibugs>	 10Data-Engineering (Q4 2025 April 1st - June 30th), 10Data-Engineering-Roadmap, 10DPE-Data-Quality, 10DPE-Mediawiki-Content, 13Patch-For-Review: [Data Quality] Add ability to add tags to alerts - https://phabricator.wikimedia.org/T389162#10729551 (10Ahoelzl)
[13:10:36] <wikibugs>	 10Data-Engineering-Roadmap, 07Epic: DPE Data Engineering Phabricator Improvements - https://phabricator.wikimedia.org/T391580 (10Ahoelzl) 03NEW
[13:11:00] <wikibugs>	 14Data-Engineering (Q3 2025 January 1st - March 31th): Provide a list of Phabricator tags relevant for Data-Engineering and use them on Data-Engineering board - https://phabricator.wikimedia.org/T386752#10729595 (10Ahoelzl)
[13:11:01] <wikibugs>	 10Data-Engineering-Roadmap, 07Epic: DPE Data Engineering Phabricator Improvements - https://phabricator.wikimedia.org/T391580#10729596 (10Ahoelzl)
[13:13:19] <jinxer-wm>	 FIRING: [2x] GobblinKafkaRecordsExtractedNotEqualRecordsExpected: Gobblin job webrequest ingested an unexpected number of records for a Kafka topic partition. ...
[13:13:19] <jinxer-wm>	 - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Gobblin - https://grafana.wikimedia.org/d/pAQaJwEnk/gobblin?orgId=1&var-gobblin_job_name=webrequest&var-kafka_topic=webrequest_text&viewPanel=4 - https://alerts.wikimedia.org/?q=alertname%3DGobblinKafkaRecordsExtractedNotEqualRecordsExpected
[13:15:33] <wikibugs>	 10Data-Engineering (Q4 2025 April 1st - June 30th), 10DPE-Data-Quality, 10DPE-Mediawiki-Content, 13Patch-For-Review: [Data Quality] Add ability to add tags to alerts - https://phabricator.wikimedia.org/T389162#10729624 (10Ahoelzl)
[13:15:33] <jinxer-wm>	 RESOLVED: [2x] GobblinKafkaRecordsExtractedNotEqualRecordsExpected: Gobblin job webrequest ingested an unexpected number of records for a Kafka topic partition. ...
[13:15:33] <jinxer-wm>	 - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Gobblin - https://grafana.wikimedia.org/d/pAQaJwEnk/gobblin?orgId=1&var-gobblin_job_name=webrequest&var-kafka_topic=webrequest_text&viewPanel=4 - https://alerts.wikimedia.org/?q=alertname%3DGobblinKafkaRecordsExtractedNotEqualRecordsExpected
[13:17:03] <jinxer-wm>	 FIRING: GobblinKafkaRecordsExtractedNotEqualRecordsExpected: Gobblin job webrequest ingested an unexpected number of records for a Kafka topic partition. ...
[13:17:03] <jinxer-wm>	 - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Gobblin - https://grafana.wikimedia.org/d/pAQaJwEnk/gobblin?orgId=1&var-gobblin_job_name=webrequest&var-kafka_topic=webrequest_text&viewPanel=4 - https://alerts.wikimedia.org/?q=alertname%3DGobblinKafkaRecordsExtractedNotEqualRecordsExpected
[13:18:18] <jinxer-wm>	 FIRING: [3x] GobblinKafkaRecordsExtractedNotEqualRecordsExpected: Gobblin job webrequest ingested an unexpected number of records for a Kafka topic partition. ...
[13:18:19] <jinxer-wm>	 - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Gobblin - https://grafana.wikimedia.org/d/pAQaJwEnk/gobblin?orgId=1&var-gobblin_job_name=webrequest&var-kafka_topic=webrequest_text&viewPanel=4 - https://alerts.wikimedia.org/?q=alertname%3DGobblinKafkaRecordsExtractedNotEqualRecordsExpected
[13:57:03] <jinxer-wm>	 RESOLVED: GobblinKafkaRecordsExtractedNotEqualRecordsExpected: Gobblin job webrequest ingested an unexpected number of records for a Kafka topic partition. ...
[13:57:03] <jinxer-wm>	 - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Gobblin - https://grafana.wikimedia.org/d/pAQaJwEnk/gobblin?orgId=1&var-gobblin_job_name=webrequest&var-kafka_topic=webrequest_text&viewPanel=4 - https://alerts.wikimedia.org/?q=alertname%3DGobblinKafkaRecordsExtractedNotEqualRecordsExpected
[14:45:27] <wikibugs>	 06Data-Engineering, 06Data-Engineering-Radar, 06Growth-Team, 10GrowthExperiments, and 6 others: mw.track: support for histogram metrics - https://phabricator.wikimedia.org/T383563#10730092 (10Krinkle)
[14:48:12] <wikibugs>	 06Data-Engineering, 06Data-Engineering-Radar, 06Growth-Team, 10GrowthExperiments, and 6 others: mw.track: support for histogram metrics - https://phabricator.wikimedia.org/T383563#10730095 (10Krinkle) p:05Triage→03Low >>! From the **task description**: > > `timing.growthExperiments.specialHomepage.navi...
[16:05:43] <wikibugs>	 06Data-Engineering, 06Data-Platform-SRE, 06Java-Scala-Standardization, 10Discovery-Search (2025.03.22 - 2025.04.11), 13Patch-For-Review: Migrate existing Java packages to deploying to Gitlab, including new version of parent pom, validation that all depen... - https://phabricator.wikimedia.org/T367405#10730580
[16:16:17] <wikibugs>	 06Data-Engineering, 06DC-Ops, 10ops-eqiad, 06SRE: relocate snapshot1017 out of eqiad D6 - https://phabricator.wikimedia.org/T391601#10730632 (10RobH)
[16:18:42] <wikibugs>	 06Data-Engineering, 06DC-Ops, 10ops-eqiad, 06SRE: relocate snapshot1017 out of eqiad D6 - https://phabricator.wikimedia.org/T391601#10730642 (10RobH) 05Open→03Declined I've folded this into T391539 which has the other #data-persistence-sre hosts for migration!  Thanks for the feedback.
[16:19:34] <wikibugs>	 06Data-Engineering, 06DC-Ops, 10ops-eqiad, 06SRE: relocate snapshot1017 out of eqiad D6 - https://phabricator.wikimedia.org/T391601#10730650 (10RobH) a:05BTullis→03None
[16:19:40] <wikibugs>	 06Data-Engineering, 06DC-Ops, 10ops-eqiad, 06SRE: relocate snapshot1017 out of eqiad D6 - https://phabricator.wikimedia.org/T391601#10730651 (10RobH)
[16:36:55] <wikibugs>	 06Data-Engineering, 06Data-Engineering-Icebox, 10Data-Engineering-Wikistats, 10Data Pipelines, and 3 others: Merge ks-Arab and ks-Deva to ks - https://phabricator.wikimedia.org/T314476#10730741 (10MaryMunyoki) p:05Triage→03Medium
[17:24:28] <wikibugs>	 06Data-Engineering, 10ContentTranslation, 06Language and Product Localization, 10Metrics Platform, and 2 others: Update WMF-deployed extensions to use mw.config checks instead of manual m-dot URL hacks - https://phabricator.wikimedia.org/T390923#10731013 (10SBisson) I don't think CX `mw.cx.SiteMapper.js` i...
[17:35:57] <wikibugs>	 06Data-Engineering: Migrate away from Skein for most of our Airflow workload. - https://phabricator.wikimedia.org/T391613 (10xcollazo) 03NEW
[20:29:10] <wikibugs>	 10Data-Engineering (Q4 2025 April 1st - June 30th), 10DPE-Mediawiki-Content, 13Patch-For-Review: Modify table maintenance mechanism to support Iceberg's rewrite_position_delete_files() - https://phabricator.wikimedia.org/T391280#10731577 (10xcollazo) >>! In T391280#10731267, @CodeReviewBot wrote: > xcollazo...
[20:56:01] <wikibugs>	 10Data-Engineering (Q4 2025 April 1st - June 30th), 10DPE-Mediawiki-Content, 13Patch-For-Review: Modify table maintenance mechanism to support Iceberg's rewrite_position_delete_files() - https://phabricator.wikimedia.org/T391280#10731621 (10xcollazo) Updated README: https://gitlab.wikimedia.org/repos/data-en...