[02:05:43] 10Analytics-Canonical-Data, 06Movement-Insights: Retire mobile-heavy wikis metric segment - https://phabricator.wikimedia.org/T364520 (10nshahquinn-wmf) 03NEW [02:10:33] 10Analytics-Canonical-Data, 06Movement-Insights: Retire mobile-heavy wikis metric segment - https://phabricator.wikimedia.org/T364520#9782365 (10nshahquinn-wmf) [02:10:53] 10Analytics-Canonical-Data, 06Movement-Insights: Retire mobile-heavy wikis metric segment - https://phabricator.wikimedia.org/T364520#9782366 (10nshahquinn-wmf) 05Open→03Resolved a:03nshahquinn-wmf [08:55:29] 06Data-Engineering, 10Observability-Logging, 06Traffic, 13Patch-For-Review: Benthos loses messages when under high load - https://phabricator.wikimedia.org/T364379#9782635 (10Fabfur) Little addendum: the [[ https://github.com/benthosdev/benthos/releases/tag/v4.27.0 | latest Benthos release ]] introduced th... [09:02:49] 06Data-Engineering, 10Observability-Logging, 06Traffic, 10Event-Platform, 13Patch-For-Review: Remove extra fields currently sent to Kafka - https://phabricator.wikimedia.org/T360642#9782643 (10Fabfur) 05Open→03Resolved [09:03:37] 06Data-Engineering, 06Data Products, 10Observability-Logging, 06Traffic, 13Patch-For-Review: Change mtail configuration to ignore new fields in HAProxy logs - https://phabricator.wikimedia.org/T358107#9782645 (10Fabfur) 05Open→03Resolved [09:24:55] 14Data-Engineering (Sprint 7), 10Observability-Metrics, 13Patch-For-Review: Configure Airflow to send metrics to Prometheus - https://phabricator.wikimedia.org/T343232#9782673 (10CodeReviewBot) btullis closed https://gitlab.wikimedia.org/repos/data-engineering/airflow-dags/-/merge_requests/548 Add the s... [13:17:00] 06Data-Engineering, 10Observability-Logging, 06Traffic, 13Patch-For-Review: Benthos loses messages when under high load - https://phabricator.wikimedia.org/T364379#9783228 (10CDanis) I was thinking about this while I was falling asleep last night, and I think it's actually desirable to drop some messages u... [14:13:26] 10Data-Engineering (Q4 2024 April 1st - June 30th), 13Patch-For-Review: [Data Quality] Migrate MWHistoryChecker to DeeQu checks - https://phabricator.wikimedia.org/T361016#9783384 (10CodeReviewBot) ebysans opened https://gitlab.wikimedia.org/repos/data-engineering/airflow-dags/-/merge_requests/688 Update Medi... [14:44:44] 10Data-Engineering (Q4 2024 April 1st - June 30th): [Datasets Config][Spike] Understand and document the details and conflicts between Datasets Config, Refine refactor, Dynamic EventStreamConfig, and Metrics Platform Instrumentation Configurator - https://phabricator.wikimedia.org/T361853#9783569 (10Ottomata) >... [14:45:48] 10Data-Engineering (Q4 2024 April 1st - June 30th): [Datasets Config][Spike] Understand and document the details and conflicts between Datasets Config, Refine refactor, Dynamic EventStreamConfig, and Metrics Platform Instrumentation Configurator - https://phabricator.wikimedia.org/T361853#9783572 (10Ottomata) In... [15:17:28] 10Data-Engineering (Q4 2024 April 1st - June 30th), 13Patch-For-Review: [Data Quality] Migrate MWHistoryChecker to DeeQu checks - https://phabricator.wikimedia.org/T361016#9783664 (10CodeReviewBot) amastilovic merged https://gitlab.wikimedia.org/repos/data-engineering/airflow-dags/-/merge_requests/688 Update... [18:13:07] 06Data-Engineering: Add programs_events_dashboard db to DataHub ingestion - https://phabricator.wikimedia.org/T364573 (10lbowmaker) 03NEW [19:04:03] 06Data-Engineering: Airflow DAG (hdfs_usage_weekly) failed with no details in the application log - https://phabricator.wikimedia.org/T364487#9784364 (10amastilovic) MR to switch to using DagProperties: https://gitlab.wikimedia.org/repos/data-engineering/airflow-dags/-/merge_requests/689 [19:24:26] 06Data-Engineering, 10Data Pipelines, 07Documentation: Deprecate reportupdater documentation - https://phabricator.wikimedia.org/T364579 (10TBurmeister) 03NEW [22:53:25] (03PS1) 10Amdrel: Add new fields to quicksurveysresponses [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/1029722 (https://phabricator.wikimedia.org/T363140)