[13:20:05] (KafkaReplicationFactorTooLow) firing: Kafka topic mediawiki.page_change.v1 replication factor is too low on jumbo-eqiad - https://wikitech.wikimedia.org/wiki/Kafka/Administration#Increase_a_topic's_replication_factor - https://grafana.wikimedia.org/d/000000234/kafka-by-topic?var-kafka_cluster=jumbo-eqiad&var-kafka_broker=All&var-topic=mediawiki.page_change.v1&viewPanel=40 - https://alerts.wikimedia.org/?q=alertname%3DKafkaReplicationFacto [13:25:05] (KafkaReplicationFactorTooLow) resolved: ... [13:25:05] Kafka topic mediawiki.page_change.v1 replication factor is too low on jumbo-eqiad - https://wikitech.wikimedia.org/wiki/Kafka/Administration#Increase_a_topic's_replication_factor - https://grafana.wikimedia.org/d/000000234/kafka-by-topic?var-kafka_cluster=jumbo-eqiad&var-kafka_broker=All&var-topic=mediawiki.page_change.v1&viewPanel=40 - https://alerts.wikimedia.org/?q=alertname%3DKafkaReplicationFactorTooLow [13:44:32] 06Data-Engineering, 06Data Products, 10Observability-Logging, 06Traffic, 13Patch-For-Review: Move analytics log from Varnish to HAProxy - https://phabricator.wikimedia.org/T351117#9614889 (10Fabfur) Update: yesterday we modified the HAProxy log destination to send them into Benthos and repooled cp4037 fo... [13:48:45] 06Data-Engineering, 06Data Products, 10Observability-Logging, 06Traffic: Benthos: better management for unparsable logs - https://phabricator.wikimedia.org/T359627 (10Fabfur) 03NEW [14:40:24] 10Data-Engineering (Sprint 9): We should provide DQ integration with Python - https://phabricator.wikimedia.org/T353940#9615271 (10gmodena) >>! In T353940#9613196, @xcollazo wrote: > IIUC, the necessity for py4j is only tied to the fact that we developed helper code like the case of `HivePartition` and `DeequAna... [14:55:36] (03CR) 10Gmodena: [C: 03+1] Extract RefineSingleApp code from Refine (033 comments) [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1003745 (https://phabricator.wikimedia.org/T356363) (owner: 10Joal) [15:34:48] 06Data-Engineering, 06Data Products, 10Observability-Logging, 06Traffic, 13Patch-For-Review: Move analytics log from Varnish to HAProxy - https://phabricator.wikimedia.org/T351117#9615392 (10Fabfur) Note: I've repooled cp4037 for the next days as I'll be busy on the SRE Summit to work on it. All modifi... [16:29:20] 06Data-Engineering, 10Foundational Technology Requests, 10Data-Platform-SRE (2024.03.04 - 2024.03.24): Enable the Marketing Campaigns Reporting plugin for matomo - https://phabricator.wikimedia.org/T319013#9615640 (10BTullis) [16:29:24] 06Data-Engineering, 10Foundational Technology Requests, 10Data-Platform-SRE (2024.03.04 - 2024.03.24): Enable the Marketing Campaigns Reporting plugin for matomo - https://phabricator.wikimedia.org/T319013#9615639 (10BTullis) I realised that I had used an earlier version of the plugin than was required and t... [16:33:20] 06Data-Engineering, 10Foundational Technology Requests, 10Data-Platform-SRE (2024.03.04 - 2024.03.24): Enable the Marketing Campaigns Reporting plugin for matomo - https://phabricator.wikimedia.org/T319013#9615645 (10BTullis) 05Open→03Resolved Tentatively marking as resolved, although I will be monitorin... [16:36:23] 10Data-Engineering (Sprint 9): We should provide DQ integration with Python - https://phabricator.wikimedia.org/T353940#9615651 (10xcollazo) > lets maybe pair on it? I'd love to hack on this at the offsite!! [17:21:38] 10Data-Engineering (Sprint 9), 13Patch-For-Review: [Maintenance] Migrate ReportUpdater browser queries to Airflow - https://phabricator.wikimedia.org/T354552#9615768 (10CodeReviewBot) ebysans merged https://gitlab.wikimedia.org/repos/data-engineering/airflow-dags/-/merge_requests/622 Update browser metric air... [17:35:39] 06Data-Engineering, 10Foundational Technology Requests, 10Data-Platform-SRE (2024.03.04 - 2024.03.24): Enable the Marketing Campaigns Reporting plugin for matomo - https://phabricator.wikimedia.org/T319013#9615854 (10sbassett) [18:34:00] 06Data-Engineering, 06Tech-Docs-Team, 05Goal: Redesign Data Platform docs on Wikitech - https://phabricator.wikimedia.org/T350911#9615998 (10TBurmeister) Since work on this project has been stalled for a bit due to its large scope and complexity, today I built out a set of demo wiki pages in my sandbox, to... [19:30:34] 06Data-Engineering, 06Data-Platform, 10MediaWiki-extensions-EventLogging, 10Metrics Platform Backlog, 07Epic: Deprecate and remove MetricsClient#dispatch() - https://phabricator.wikimedia.org/T352969#9616190 (10Jdforrester-WMF)