[06:47:59] Hello joal do you have time to speak about xml dumps? [08:02:35] 10Data-Platform-SRE, 10Discovery-Search (Current work): Ensure WCQS/WDQS stack works on Bullseye - https://phabricator.wikimedia.org/T331300 (10Gehel) [08:02:38] 10Data-Platform-SRE, 10Discovery-Search (Current work): Ensure prometheus-blazegraph-exporter-wdqs-* services can start in Bullseye or later - https://phabricator.wikimedia.org/T336540 (10Gehel) 05Open→03Resolved [08:05:04] 10Data-Platform-SRE, 10Wikidata, 10Patch-For-Review: Create WDQS Lag SLO dashboard with Grizzly && documentation - https://phabricator.wikimedia.org/T324811 (10Gehel) [08:11:08] 10Data-Platform-SRE, 10Discovery-Search (Current work): Investigate performance differences between wdqs2022 and older hosts - https://phabricator.wikimedia.org/T336443 (10Gehel) 05Open→03Resolved a:03Gehel [08:11:10] 10Data-Platform-SRE, 10Discovery-Search (Current work): Ensure WCQS/WDQS stack works on Bullseye - https://phabricator.wikimedia.org/T331300 (10Gehel) [08:11:25] 10Data-Platform-SRE, 10Wikidata, 10Wikidata-Query-Service, 10Discovery-Search (Current work): Find why the wdqs-updater service can't start after data-transfer and fix it - https://phabricator.wikimedia.org/T339368 (10Gehel) 05Open→03Resolved a:03Gehel [08:51:59] 10Data-Platform-SRE: Swap an existing Journal node analytics1069 with an-worker1142 - https://phabricator.wikimedia.org/T338336 (10Gehel) 05Open→03Resolved [08:52:04] 10Data-Platform-SRE, 10Shared-Data-Infrastructure, 10Patch-For-Review: Decommission analytics10[58-69] - https://phabricator.wikimedia.org/T317861 (10Gehel) [08:52:10] 10Data-Platform-SRE, 10Wikidata, 10Wikidata-Query-Service, 10Discovery-Search (Current work): Make WCQS/WDQS data transfer cookbook more reliable - https://phabricator.wikimedia.org/T321605 (10Gehel) 05In progress→03Resolved [08:52:13] 10Data-Platform-SRE: Disk failure on an-worker1110 - https://phabricator.wikimedia.org/T336929 (10Gehel) 05Open→03Resolved [09:50:14] Good morning aqu :) I'm free to talk about dumps :) [09:52:22] Batcave? [09:52:27] sure :) [10:38:16] 10Data-Engineering, 10Event-Platform (Sprint 14 B): mw-page-content-change-enrich should partition by and process by wiki_id,page_id - https://phabricator.wikimedia.org/T338169 (10gmodena) a:03gmodena [10:39:46] 10Data-Engineering, 10Epic, 10Event-Platform: [Event Platform] Design and Implement realtime enrichment pipeline for MW page change with content - https://phabricator.wikimedia.org/T307959 (10gmodena) [10:42:28] 10Data-Engineering, 10serviceops, 10Event-Platform (Sprint 14 B): Flink k8s operator in staging sometimes will not sync changes to FlinkDeployments - https://phabricator.wikimedia.org/T340059 (10gmodena) > Did that happen in DSE as well? Are there logs (from the operator, k8s events etc.)? f/up to what @Ott... [10:54:03] 10Data-Engineering, 10Event-Platform (Sprint 14 B), 10Patch-For-Review: mw-page-content-change-enrich should partition by and process by wiki_id,page_id - https://phabricator.wikimedia.org/T338169 (10CodeReviewBot) gmodena opened https://gitlab.wikimedia.org/repos/data-engineering/mediawiki-event-enrichment/... [10:54:18] 10Data-Engineering, 10Event-Platform (Sprint 14 B), 10Patch-For-Review: mw-page-content-change-enrich should partition by and process by wiki_id,page_id - https://phabricator.wikimedia.org/T338169 (10CodeReviewBot) [11:09:16] 10Data-Engineering, 10Event-Platform (Sprint 14 B), 10Patch-For-Review: mw-page-content-change-enrich should partition by and process by wiki_id,page_id - https://phabricator.wikimedia.org/T338169 (10gmodena) > We should change this partitioning to use wiki_id and page_id (via a hash) Not sure if we need ha... [11:36:05] 10Data-Engineering, 10Epic, 10Event-Platform: [Event Platform] Design and Implement realtime enrichment pipeline for MW page change with content - https://phabricator.wikimedia.org/T307959 (10gmodena) [11:53:47] 10Data-Engineering, 10GitLab (CI & Job Runners), 10Performance Issue: Improve speed of Gitlab CI - https://phabricator.wikimedia.org/T311111 (10hashar) I am adding back #data-engineering since the slowness comes from how the test environments have been defined. See my analysis from last year above: T311111#8... [12:30:06] 10Data-Platform-SRE, 10Discovery-Search (Current work): Investigate performance differences between wdqs2022 and older hosts - https://phabricator.wikimedia.org/T336443 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage started by bking@cumin1001 for host wdqs2021.codfw.wmnet with OS bullseye executed... [12:55:23] 10Data-Engineering, 10GitLab (CI & Job Runners), 10Performance Issue: Improve speed of Gitlab CI - https://phabricator.wikimedia.org/T311111 (10xcollazo) I think @Antoine_Quhen took care of this via custom docker images. Right Antoine? [13:45:51] (03PS2) 10Nick Ifeajika: Update schema response in v1/knowledge-gap.yaml [analytics/aqs] - 10https://gerrit.wikimedia.org/r/933603 (https://phabricator.wikimedia.org/T337059) [13:49:01] (03CR) 10CI reject: [V: 04-1] Update schema response in v1/knowledge-gap.yaml [analytics/aqs] - 10https://gerrit.wikimedia.org/r/933603 (https://phabricator.wikimedia.org/T337059) (owner: 10Nick Ifeajika) [14:04:33] 10Data-Platform-SRE, 10Discovery-Search (Current work), 10KaiOS-Wikipedia-app (Discovery): Implement depool (source only) and keep-downtime options on data-transfer cookbook - https://phabricator.wikimedia.org/T340793 (10bking) p:05Triage→03High a:03bking [14:30:10] 10Data-Platform-SRE, 10DC-Ops, 10SRE, 10ops-eqiad: Q3:rack/setup/install an-worker11[49-56] - https://phabricator.wikimedia.org/T327295 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage was started by jhancock@cumin2002 for host an-worker1149.eqiad.wmnet with OS bullseye [14:34:16] 10Analytics-Kanban, 10Data-Engineering, 10Patch-For-Review, 10User-MoritzMuehlenhoff: Automate kerberos credential creation and management to ease the creation of testing infrastructure - https://phabricator.wikimedia.org/T292389 (10JArguello-WMF) p:05High→03Low [14:34:50] 10Analytics-Kanban, 10Data-Engineering, 10Data-Platform-SRE, 10Patch-For-Review, 10User-MoritzMuehlenhoff: Automate kerberos credential creation and management to ease the creation of testing infrastructure - https://phabricator.wikimedia.org/T292389 (10JArguello-WMF) [14:36:03] 10Data-Engineering: hdfs password file for mysql should be re-generated when the password file is changed by puppet - https://phabricator.wikimedia.org/T170162 (10JArguello-WMF) 05Open→03Declined [14:39:58] 10Analytics-Radar, 10Data-Engineering, 10Discovery-Search, 10Wikimedia-production-error: '.event.pageViewId' should be string, '.event.subTest' should be string, '.event.searchSessionId' should be string - https://phabricator.wikimedia.org/T286814 (10JArguello-WMF) [15:34:29] (03PS1) 10Btullis: Improve the datahub kafka-setup container [analytics/datahub] (wmf) - 10https://gerrit.wikimedia.org/r/934574 (https://phabricator.wikimedia.org/T329514) [15:47:30] 10Data-Engineering: [Airflow] Setup Airflow instance for WMDE - https://phabricator.wikimedia.org/T340648 (10AndrewTavis_WMDE) Based on discussions in T334558 it looks like at a minimum we'll be naming the base directory in [[ https://gitlab.wikimedia.org/repos/data-engineering/airflow-dags | airflow-dags ]] `wm... [15:50:28] 10Data-Platform-SRE, 10DC-Ops, 10SRE, 10ops-eqiad: Q3:rack/setup/install an-worker11[49-56] - https://phabricator.wikimedia.org/T327295 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage started by jhancock@cumin2002 for host an-worker1149.eqiad.wmnet with OS bullseye executed with errors: - an-wo... [15:53:38] 10Data-Engineering, 10Data Engineering and Event Platform Team (Sprint 0), 10Event-Platform (Sprint 14 B): Provide basic data quality metrics for page_content_change - https://phabricator.wikimedia.org/T340831 (10JArguello-WMF) [15:53:42] 10Data-Engineering, 10Data Engineering and Event Platform Team (Sprint 0), 10Event-Platform (Sprint 14 B): mw-page-content-change-enrich should bump page_change schema - https://phabricator.wikimedia.org/T340746 (10JArguello-WMF) [15:53:44] 10Data-Engineering, 10serviceops, 10Data Engineering and Event Platform Team (Sprint 0), 10Event-Platform (Sprint 14 B): Flink k8s operator in staging sometimes will not sync changes to FlinkDeployments - https://phabricator.wikimedia.org/T340059 (10JArguello-WMF) [15:53:46] 10Data-Engineering, 10Data Engineering and Event Platform Team (Sprint 0), 10Event-Platform (Sprint 14 B): jsonschema-tools tests should fail if schema $id does not match title or path - https://phabricator.wikimedia.org/T300404 (10JArguello-WMF) [15:53:48] 10Data-Engineering, 10Discovery-Search, 10Data Engineering and Event Platform Team (Sprint 0), 10Event-Platform (Sprint 14 B): Flink Enrichment job alerting - https://phabricator.wikimedia.org/T340666 (10JArguello-WMF) [15:53:52] (03CR) 10CI reject: [V: 04-1] Improve the datahub kafka-setup container [analytics/datahub] (wmf) - 10https://gerrit.wikimedia.org/r/934574 (https://phabricator.wikimedia.org/T329514) (owner: 10Btullis) [15:55:17] 10Data-Engineering, 10Data Engineering and Event Platform Team (Sprint 0), 10Event-Platform (Sprint 14 B), 10Patch-For-Review: mw-page-content-change-enrich should partition by and process by wiki_id,page_id - https://phabricator.wikimedia.org/T338169 (10JArguello-WMF) [15:56:18] 10Data-Engineering, 10Data Engineering and Event Platform Team (Sprint 0), 10Event-Platform (Sprint 14 B), 10MW-1.41-notes (1.41.0-wmf.13; 2023-06-13), 10Patch-For-Review: Release mediawiki.page_change.v1 stream - https://phabricator.wikimedia.org/T336817 (10JArguello-WMF) [16:15:53] 10Data-Engineering, 10Data Engineering and Event Platform Team, 10Epic, 10Event-Platform: Event Platform Value Stream Documentation Tasks - https://phabricator.wikimedia.org/T329628 (10JArguello-WMF) [16:16:00] 10Data-Engineering, 10Data Engineering and Event Platform Team, 10Event-Platform: [EPIC] Flink Applications on Kubernetes - https://phabricator.wikimedia.org/T324578 (10JArguello-WMF) [16:16:02] 10Data-Engineering, 10Data Engineering and Event Platform Team, 10Discovery-Search (Current work), 10Epic, 10Event-Platform: Flink Operations - https://phabricator.wikimedia.org/T328561 (10JArguello-WMF) [16:16:06] 10Data-Engineering, 10Data Engineering and Event Platform Team, 10Event-Platform: [EPIC] Streaming and event driven Python services - https://phabricator.wikimedia.org/T324689 (10JArguello-WMF) [16:16:12] 10Data-Engineering, 10Data Engineering and Event Platform Team, 10Epic, 10Event-Platform: [Event Platform] Design and Implement realtime enrichment pipeline for MW page change with content - https://phabricator.wikimedia.org/T307959 (10JArguello-WMF) [16:16:15] 10Data-Engineering, 10Data Engineering and Event Platform Team, 10Product-Analytics, 10Event-Platform: Migrate legacy metawiki schemas to Event Platform - https://phabricator.wikimedia.org/T259163 (10JArguello-WMF) [16:16:25] 10Data-Engineering, 10Data Engineering and Event Platform Team, 10MediaWiki-extensions-EventLogging, 10Event-Platform: Decommission EventLogging backend components by migrating to MEP - https://phabricator.wikimedia.org/T238230 (10JArguello-WMF) [16:16:41] 10Data-Engineering, 10Data Engineering and Event Platform Team, 10Platform Engineering, 10tech-decision-forum, 10Event-Platform: MediaWiki Event Carried State Transfer - Problem Statement - https://phabricator.wikimedia.org/T291120 (10JArguello-WMF) [16:16:53] 10Analytics-Kanban, 10Data-Engineering, 10Data Engineering and Event Platform Team, 10Fundraising-Backlog, and 4 others: Determine which remaining legacy EventLogging schemas need to be migrated or decommissioned - https://phabricator.wikimedia.org/T282131 (10JArguello-WMF) [16:17:05] 10Analytics, 10Data-Engineering, 10Data Engineering and Event Platform Team, 10Event-Platform: Discussion of Event Driven Systems - https://phabricator.wikimedia.org/T290203 (10JArguello-WMF) [16:17:32] 10Analytics-Kanban, 10Data-Engineering, 10Data Engineering and Event Platform Team, 10MediaWiki-extensions-EventLogging, and 4 others: Modern Event Platform - https://phabricator.wikimedia.org/T185233 (10JArguello-WMF) [16:17:35] 10Analytics, 10Data-Engineering, 10Data Engineering and Event Platform Team, 10Event-Platform, 10Goal: Event Platform: Stream Connectors - https://phabricator.wikimedia.org/T214430 (10JArguello-WMF) [16:18:08] 10Analytics, 10Data-Engineering, 10DBA, 10Data Engineering and Event Platform Team, 10Event-Platform: Consistent MediaWiki state change events | MediaWiki events as source of truth - https://phabricator.wikimedia.org/T120242 (10JArguello-WMF) [16:18:55] 10Data-Engineering, 10Data Engineering and Event Platform Team, 10Epic, 10Event-Platform: Event Platform Value Stream Documentation Tasks - https://phabricator.wikimedia.org/T329628 (10JArguello-WMF) [16:19:01] 10Data-Engineering, 10Data Engineering and Event Platform Team, 10Discovery-Search (Current work), 10Epic, 10Event-Platform: Flink Operations - https://phabricator.wikimedia.org/T328561 (10JArguello-WMF) [16:19:06] 10Data-Engineering, 10Data Engineering and Event Platform Team, 10Event-Platform: [EPIC] Streaming and event driven Python services - https://phabricator.wikimedia.org/T324689 (10JArguello-WMF) [16:19:08] 10Data-Engineering, 10Data Engineering and Event Platform Team, 10Event-Platform: [EPIC] Flink Applications on Kubernetes - https://phabricator.wikimedia.org/T324578 (10JArguello-WMF) [16:19:15] 10Data-Engineering, 10Data Engineering and Event Platform Team, 10Epic, 10Event-Platform: [Event Platform] Design and Implement realtime enrichment pipeline for MW page change with content - https://phabricator.wikimedia.org/T307959 (10JArguello-WMF) [16:19:18] 10Data-Engineering, 10Data Engineering and Event Platform Team, 10Product-Analytics, 10Event-Platform: Migrate legacy metawiki schemas to Event Platform - https://phabricator.wikimedia.org/T259163 (10JArguello-WMF) [16:19:38] 10Data-Engineering, 10Data Engineering and Event Platform Team, 10MediaWiki-extensions-EventLogging, 10Event-Platform: Decommission EventLogging backend components by migrating to MEP - https://phabricator.wikimedia.org/T238230 (10JArguello-WMF) [16:19:42] 10Data-Engineering, 10Data Engineering and Event Platform Team, 10Platform Engineering, 10tech-decision-forum, 10Event-Platform: MediaWiki Event Carried State Transfer - Problem Statement - https://phabricator.wikimedia.org/T291120 (10JArguello-WMF) [16:19:52] 10Analytics-Kanban, 10Data-Engineering, 10Data Engineering and Event Platform Team, 10Fundraising-Backlog, and 4 others: Determine which remaining legacy EventLogging schemas need to be migrated or decommissioned - https://phabricator.wikimedia.org/T282131 (10JArguello-WMF) [16:20:18] 10Analytics, 10Data-Engineering, 10Data Engineering and Event Platform Team, 10Event-Platform: Discussion of Event Driven Systems - https://phabricator.wikimedia.org/T290203 (10JArguello-WMF) [16:20:28] 10Analytics-Kanban, 10Data-Engineering, 10Data Engineering and Event Platform Team, 10MediaWiki-extensions-EventLogging, and 4 others: Modern Event Platform - https://phabricator.wikimedia.org/T185233 (10JArguello-WMF) [16:20:54] 10Analytics, 10Data-Engineering, 10Data Engineering and Event Platform Team, 10Event-Platform, 10Goal: Event Platform: Stream Connectors - https://phabricator.wikimedia.org/T214430 (10JArguello-WMF) [16:21:05] 10Analytics, 10Data-Engineering, 10DBA, 10Data Engineering and Event Platform Team, 10Event-Platform: Consistent MediaWiki state change events | MediaWiki events as source of truth - https://phabricator.wikimedia.org/T120242 (10JArguello-WMF) [16:26:31] 10Data-Engineering, 10Data Engineering and Event Platform Team, 10Machine-Learning-Team, 10Event-Platform: Implement PoC Event-Driven Data Pipeline for Revert Risk Model Scores using Event Platform Capabilities - https://phabricator.wikimedia.org/T338792 (10JArguello-WMF) [16:26:42] 10Data-Engineering, 10Data Engineering and Event Platform Team, 10Event-Platform, 10MW-1.40-notes (1.40.0-wmf.24; 2023-02-20), and 3 others: Remove StreamConfig::INTERNAL_SETTINGS logic from EventStreamConfig and do it in EventLogging client instead - https://phabricator.wikimedia.org/T286344 (10JArguello-... [16:26:44] 10Data-Engineering, 10Data Engineering and Event Platform Team, 10Event-Platform, 10User-Elukey: Create EventStream's equivalent to irc.wikimedia.org's #central channel - https://phabricator.wikimedia.org/T240182 (10JArguello-WMF) [16:26:46] 10Analytics-Radar, 10Data-Engineering, 10Data Engineering and Event Platform Team, 10Growth-Team, and 3 others: Edits to Flow pages result in a page-links-change event with no performer - https://phabricator.wikimedia.org/T216726 (10JArguello-WMF) [16:28:57] 10Data-Engineering, 10Data Engineering and Event Platform Team, 10Event-Platform: jsonschema-tools test should fail if fields are removed in new (non major) version - https://phabricator.wikimedia.org/T340765 (10JArguello-WMF) [16:29:00] 10Data-Engineering, 10Data Engineering and Event Platform Team, 10Event-Platform: mediawiki-event-enrichment: changes to test image seem to be ignored in CI - https://phabricator.wikimedia.org/T340195 (10JArguello-WMF) [16:29:04] 10Data-Engineering, 10Data Engineering and Event Platform Team, 10Discovery-Search, 10Event-Platform: Set up multi DC Kafka stretch cluster - https://phabricator.wikimedia.org/T340492 (10JArguello-WMF) [16:29:07] 10Data-Engineering, 10Data Engineering and Event Platform Team, 10Event-Platform: Make meta.dt required on all schemas that declare it - https://phabricator.wikimedia.org/T340044 (10JArguello-WMF) [16:29:09] 10Data-Engineering, 10Data Engineering and Event Platform Team, 10Event-Platform: eventutilities-python: http event process function should report latency. - https://phabricator.wikimedia.org/T338380 (10JArguello-WMF) [16:29:11] 10Data-Engineering, 10Data Engineering and Event Platform Team, 10Event-Platform: mw-page-content-change-enrich should (re)produce kafka keys - https://phabricator.wikimedia.org/T338231 (10JArguello-WMF) [16:29:13] 10Data-Engineering, 10Data Engineering and Event Platform Team, 10Event-Platform: flink-app: swift bucket and zookeeper paths should be templated. - https://phabricator.wikimedia.org/T336901 (10JArguello-WMF) [16:29:15] 10Data-Engineering, 10Data Engineering and Event Platform Team, 10Event-Platform: eventutilities-python EventProcessFunction throws NPE if user func returns None - https://phabricator.wikimedia.org/T335706 (10JArguello-WMF) [16:29:19] 10Data-Engineering, 10Data Engineering and Event Platform Team, 10Data-Persistence, 10IP Masking, and 2 others: MediaWiki user types - https://phabricator.wikimedia.org/T336176 (10JArguello-WMF) [16:29:23] 10Data-Engineering, 10Data Engineering and Event Platform Team, 10EventStreams, 10Event-Platform: Include image/file changes in page-links-change - https://phabricator.wikimedia.org/T333497 (10JArguello-WMF) [16:29:29] 10Data-Engineering, 10Data Engineering and Event Platform Team, 10Machine-Learning-Team, 10Event-Platform: Create new mediawiki.page_links_change stream based on fragment/mediawiki/state/change/page - https://phabricator.wikimedia.org/T331399 (10JArguello-WMF) [16:29:33] 10Data-Engineering, 10Data Engineering and Event Platform Team, 10Event-Platform: Refactor Image Suggestions Feedback > Cassandra Flink Job and Deploy to DSE k8s - https://phabricator.wikimedia.org/T329524 (10JArguello-WMF) [16:29:37] 10Data-Engineering, 10Data Engineering and Event Platform Team, 10MediaWiki-extensions-WikimediaEvents, 10Product-Analytics, and 4 others: Decommission the EditorActivation instrument - https://phabricator.wikimedia.org/T330766 (10JArguello-WMF) [16:29:43] 10Data-Engineering, 10Data Engineering and Event Platform Team, 10MediaWiki-Vagrant, 10Event-Platform: EventBus should not blackhole undeclared streams - https://phabricator.wikimedia.org/T329480 (10JArguello-WMF) [16:29:49] 10Data-Engineering, 10Data Engineering and Event Platform Team, 10Event-Platform: Automated event stream throughput alerting for important state change streams - https://phabricator.wikimedia.org/T329070 (10JArguello-WMF) [16:29:57] 10Data-Engineering, 10Data Engineering and Event Platform Team, 10Edit-Review-Improvements-Integrated-Filters, 10Growth-Team, and 3 others: Integration of Revert Risk Scores to Recent Changes as a filter - https://phabricator.wikimedia.org/T329071 (10JArguello-WMF) [16:30:03] 10Data-Engineering, 10Data Engineering and Event Platform Team, 10Machine-Learning-Team, 10Event-Platform: Add a new outlink topic stream for EventGate main - https://phabricator.wikimedia.org/T328899 (10JArguello-WMF) [16:30:07] 10Data-Engineering, 10Data Engineering and Event Platform Team, 10Event-Platform: [Flink Operations] Automate Replay of Failed Events - https://phabricator.wikimedia.org/T328565 (10JArguello-WMF) [16:30:11] 10Data-Engineering, 10Data Engineering and Event Platform Team, 10Event-Platform: Support topics without a schema in Flink Catalog - https://phabricator.wikimedia.org/T328232 (10JArguello-WMF) [16:30:15] 10Data-Engineering, 10Data Engineering and Event Platform Team, 10Event-Platform: Support NULL values in RowData in eventutilities - https://phabricator.wikimedia.org/T328211 (10JArguello-WMF) [16:30:19] 10Data-Engineering, 10Data Engineering and Event Platform Team, 10Event-Platform: [NEEDS GROOMING] Integrate Flink Table API in eventutils-python - https://phabricator.wikimedia.org/T324953 (10JArguello-WMF) [16:30:25] 10Data-Engineering, 10Data Engineering and Event Platform Team, 10Machine-Learning-Team, 10Research, 10Event-Platform: Proposal: Create a stream end point for Revision Risk Model - https://phabricator.wikimedia.org/T326179 (10JArguello-WMF) [16:30:29] 10Data-Engineering, 10Data Engineering and Event Platform Team, 10SRE-OnFire, 10serviceops, 10Event-Platform: Incident: 2022-12-09 api appserver worker starvation - https://phabricator.wikimedia.org/T324994 (10JArguello-WMF) [16:30:41] 10Data-Engineering, 10Data Engineering and Event Platform Team, 10Discovery-Search (Current work), 10Event-Platform, and 2 others: Add support for redirects in CirrusSearch - https://phabricator.wikimedia.org/T325315 (10JArguello-WMF) [16:30:45] 10Data-Engineering, 10Data Engineering and Event Platform Team, 10Event-Platform: Spark Streaming Dumps POC: Backfill content table - https://phabricator.wikimedia.org/T323641 (10JArguello-WMF) [16:30:49] 10Data-Engineering, 10Data Engineering and Event Platform Team, 10Event-Platform: Spark Streaming Dumps POC: Update iceberg tables - https://phabricator.wikimedia.org/T323645 (10JArguello-WMF) [16:30:53] 10Data-Engineering, 10Data Engineering and Event Platform Team, 10Event-Platform: [SPIKE] Use Flink for batch backfilling - https://phabricator.wikimedia.org/T324108 (10JArguello-WMF) [16:30:57] 10Data-Engineering, 10Data Engineering and Event Platform Team, 10Event-Platform: Add schema diffing support to jsonschema-tools and run diff in CI - https://phabricator.wikimedia.org/T321850 (10JArguello-WMF) [16:31:01] 10Data-Engineering, 10Data Engineering and Event Platform Team, 10Event-Platform, 10MW-1.40-notes (1.40.0-wmf.8; 2022-10-31): EventBus' stream config destination_event_service setting should move into producers.mediawikI_eventbus specific settings. - https://phabricator.wikimedia.org/T321557 (10JArguello-WM... [16:31:07] 10Data-Engineering, 10Beta-Cluster-Infrastructure, 10Data Engineering and Event Platform Team, 10Event-Platform, 10MW-1.41-notes (1.41.0-wmf.12; 2023-06-06): cirrusSearchCheckerJob JobQueueErrors (Could not enqueue jobs) on Beta Cluster - https://phabricator.wikimedia.org/T322491 (10JArguello-WMF) [16:31:11] 10Data-Engineering, 10Data Engineering and Event Platform Team, 10MediaWiki-Core-Hooks, 10Event-Platform: Add $comment and $performer to ArticleRevisionVisibilitySet params - https://phabricator.wikimedia.org/T321411 (10JArguello-WMF) [16:31:17] 10Data-Engineering, 10Data Engineering and Event Platform Team, 10Event-Platform, 10Patch-For-Review: Move Spark JsonSchemaConverter out of analytics/refinery/source and into wikimedia-event-utilities - https://phabricator.wikimedia.org/T321854 (10JArguello-WMF) [16:31:21] 10Data-Engineering, 10Data Engineering and Event Platform Team, 10Event-Platform: Refactor EventBus extension Hooks to use new hook system - https://phabricator.wikimedia.org/T320655 (10JArguello-WMF) [16:31:25] 10Data-Engineering, 10Data Engineering and Event Platform Team, 10Data-Catalog, 10Event-Platform: Event Platform and DataHub Integration - https://phabricator.wikimedia.org/T318863 (10JArguello-WMF) [16:31:29] 10Data-Engineering, 10Data Engineering and Event Platform Team, 10Event-Platform: Document and Promote Image Suggestions Feedback > Cassandra Flink Job - https://phabricator.wikimedia.org/T316112 (10JArguello-WMF) [16:31:33] 10Data-Engineering, 10Data Engineering and Event Platform Team, 10Event-Platform: Drop GuidedTour* tables - https://phabricator.wikimedia.org/T317460 (10JArguello-WMF) [16:31:37] 10Analytics-Radar, 10Data-Engineering, 10Data Engineering and Event Platform Team, 10Event-Platform: Introduce EventBusSendUpdate - https://phabricator.wikimedia.org/T292123 (10JArguello-WMF) [16:31:41] 10Data-Engineering, 10Data Engineering and Event Platform Team, 10Event-Platform: Declare webrequest as an Event Platform stream - https://phabricator.wikimedia.org/T314956 (10JArguello-WMF) [16:31:47] 10Analytics-Radar, 10Data-Engineering-Radar, 10Data Engineering and Event Platform Team, 10MediaWiki-Recent-changes, and 2 others: Remove deprecated RCFeedEngine support - https://phabricator.wikimedia.org/T250628 (10JArguello-WMF) [16:31:53] 10Analytics, 10Data-Engineering, 10Data Engineering and Event Platform Team, 10Event-Platform, and 3 others: Adopt conventions for server receive and client/event timestamps in non analytics event schemas - https://phabricator.wikimedia.org/T267648 (10JArguello-WMF) [16:31:59] 10Analytics-Radar, 10Data-Engineering, 10ChangeProp, 10Data Engineering and Event Platform Team, and 7 others: Run EventBus tests in MediaWiki core CI - https://phabricator.wikimedia.org/T257583 (10JArguello-WMF) [16:32:03] 10Data-Engineering, 10Data Engineering and Event Platform Team, 10Discovery-Search, 10serviceops-radar, 10Event-Platform: [NEEDS GROOMING] Store Flink HA metadata in Zookeeper - https://phabricator.wikimedia.org/T331283 (10JArguello-WMF) [16:32:07] 10Analytics-Radar, 10Data-Engineering, 10Data Engineering and Event Platform Team, 10Internet-Archive, and 2 others: Store page-links-change data in a database table and make available through a Special page - https://phabricator.wikimedia.org/T221397 (10JArguello-WMF) [16:32:11] 10Data-Engineering, 10Anti-Harassment, 10Data Engineering and Event Platform Team, 10Privacy Engineering, and 4 others: Exposing revIDs (nothing more) of deleted/suppressed edits for research to respect their removal - https://phabricator.wikimedia.org/T200559 (10JArguello-WMF) [16:32:15] 10Analytics, 10Data-Engineering, 10Data Engineering and Event Platform Team, 10Platform Engineering, 10Event-Platform: EventStreams sending same data over and over (page links change) - https://phabricator.wikimedia.org/T290211 (10JArguello-WMF) [16:32:19] 10Data-Engineering, 10Data Engineering and Event Platform Team, 10Event-Platform: Move eventutiltities-python repo into main wikimedia-eventutilities repository - https://phabricator.wikimedia.org/T337491 (10JArguello-WMF) [16:32:23] 10Data-Engineering, 10Data Engineering and Event Platform Team, 10Event-Platform: Move wikimedia-event-utilities to gitlab - https://phabricator.wikimedia.org/T337477 (10JArguello-WMF) [16:32:27] 10Data-Engineering, 10Data Engineering and Event Platform Team, 10Event-Platform: Refine drops $schema field values - https://phabricator.wikimedia.org/T255818 (10JArguello-WMF) [16:32:31] 10Data-Engineering, 10Data Engineering and Event Platform Team, 10MediaWiki-libs-HTTP, 10Beta-Cluster-reproducible, and 2 others: PHP Warning: curl_multi_remove_handle(): supplied resource is not a valid cURL Multi Handle resource - https://phabricator.wikimedia.org/T288624 (10JArguello-WMF) [16:32:37] 10Data-Engineering, 10Data Engineering and Event Platform Team, 10SRE-OnFire, 10SRE-Sprint-Week-Sustainability-March2023, and 3 others: Uneven CPU throttling of eventgate-analytics under load - https://phabricator.wikimedia.org/T325068 (10JArguello-WMF) [16:32:49] 10Analytics, 10Data-Engineering, 10Data Engineering and Event Platform Team, 10Metrics-Platform-Planning, 10Event-Platform: Source geolocation directly rather than using IP in schema - https://phabricator.wikimedia.org/T290014 (10JArguello-WMF) [16:32:53] 10Analytics, 10Data-Engineering, 10Data Engineering and Event Platform Team, 10Observability-Logging, and 3 others: Integrate Event Platform and ECS logs - https://phabricator.wikimedia.org/T291645 (10JArguello-WMF) [16:32:59] 10Data-Engineering, 10Data Engineering and Event Platform Team, 10SRE, 10observability, and 3 others: Upgrade Kafka to 2.x or 3.x - https://phabricator.wikimedia.org/T300102 (10JArguello-WMF) [16:33:07] 10Analytics, 10Data-Engineering, 10Data Engineering and Event Platform Team, 10Event-Platform: mediawiki/page/properties-change schema should use map type for added and removed page properties - https://phabricator.wikimedia.org/T281483 (10JArguello-WMF) [16:33:15] 10Analytics, 10Data-Engineering, 10Data Engineering and Event Platform Team, 10Event-Platform: Automate EventGate validation error reporting - https://phabricator.wikimedia.org/T268027 (10JArguello-WMF) [16:33:19] 10Analytics, 10Data-Engineering, 10Data Engineering and Event Platform Team, 10Product-Analytics, 10Event-Platform: Develop comprehensive process, guidelines, and roles for Event Platform stream sanitization - https://phabricator.wikimedia.org/T276955 (10JArguello-WMF) [16:33:23] 10Data-Engineering, 10Data-Platform-SRE, 10Data Engineering and Event Platform Team, 10Event-Platform, 10Platform Team Workboards (Clinic Duty Team): Avoid accepting Kafka messages with whacky timestamps - https://phabricator.wikimedia.org/T282887 (10JArguello-WMF) [16:33:27] 10Analytics-Radar, 10Data-Engineering, 10Data Engineering and Event Platform Team, 10Event-Platform: mw.user.generateRandomSessionId should return a UUID - https://phabricator.wikimedia.org/T266813 (10JArguello-WMF) [16:33:31] 10Analytics, 10Data-Engineering, 10Data Engineering and Event Platform Team, 10Event-Platform: Enable canary events for all streams - https://phabricator.wikimedia.org/T266798 (10JArguello-WMF) [16:33:35] 10Analytics, 10Data-Engineering, 10Data Engineering and Event Platform Team, 10Metrics-Platform-Planning, 10Event-Platform: Document in-schema who sets which fields - https://phabricator.wikimedia.org/T253392 (10JArguello-WMF) [16:33:39] 10Analytics-Radar, 10Data-Engineering, 10Data Engineering and Event Platform Team, 10Event-Platform, 10Platform Team Workboards (Clinic Duty Team): Duplicated revision_create events - https://phabricator.wikimedia.org/T262203 (10JArguello-WMF) [16:33:43] 10Data-Engineering, 10Data Engineering and Event Platform Team, 10SRE, 10serviceops, and 2 others: DRY kafka broker declaration in helmfiles - https://phabricator.wikimedia.org/T253058 (10JArguello-WMF) [16:33:51] 10Analytics, 10Data-Engineering, 10Data Engineering and Event Platform Team, 10Event-Platform, and 2 others: Port architecture of irc-recentchanges to Kafka - https://phabricator.wikimedia.org/T234234 (10JArguello-WMF) [16:33:55] 10Data-Engineering-Radar, 10Data Engineering and Event Platform Team, 10Internet-Archive, 10The-Wikipedia-Library, 10Event-Platform: Page-links-change stream doesn't capture duplicated links - https://phabricator.wikimedia.org/T216492 (10JArguello-WMF) [16:33:59] 10Data-Engineering, 10Data Engineering and Event Platform Team, 10Internet-Archive, 10The-Wikipedia-Library, and 3 others: page-links-change stream is assigning template propagation events to the wrong edits - https://phabricator.wikimedia.org/T216504 (10JArguello-WMF) [16:34:05] 10Data-Engineering, 10Data Engineering and Event Platform Team, 10Browser-Support-Microsoft-Edge, 10Event-Platform, 10Performance-Team (Radar): Problem with delay caused by intake-analytics.wikimedia.org - https://phabricator.wikimedia.org/T295427 (10JArguello-WMF) [16:34:09] 10Data-Engineering, 10Data Engineering and Event Platform Team, 10EventStreams, 10Shared-Data-Infrastructure, 10Event-Platform: Implement server side filtering for EventStreams (if we should) - https://phabricator.wikimedia.org/T152731 (10JArguello-WMF) [16:34:13] 10Analytics, 10Data-Engineering, 10Data Engineering and Event Platform Team, 10Event-Platform: Deploy schema repos to analytics cluster and use local uris for analytics jobs - https://phabricator.wikimedia.org/T280017 (10JArguello-WMF) [16:34:17] 10Analytics, 10Data-Engineering, 10Data Engineering and Event Platform Team, 10Event-Platform, 10Platform Team Workboards (Clinic Duty Team): Add expiry info to mediawiki.page-restrictions-change stream - https://phabricator.wikimedia.org/T282057 (10JArguello-WMF) [16:34:23] 10Analytics, 10Data-Engineering, 10Data Engineering and Event Platform Team, 10Event-Platform, 10Release-Engineering-Team (Radar): Stop using puppet + git pull for auto deployment of schema repos - https://phabricator.wikimedia.org/T274901 (10JArguello-WMF) [16:34:27] 10Analytics-Radar, 10Data-Engineering, 10Data Engineering and Event Platform Team, 10SRE, and 2 others: Consider Julie for managing Kafka settings, perhaps even integrating with Event Stream Config - https://phabricator.wikimedia.org/T276088 (10JArguello-WMF) [16:34:33] 10Analytics, 10Data-Engineering-Radar, 10Data Engineering and Event Platform Team, 10Product-Analytics, 10Event-Platform: [MEP] Determine how stream configuration is authored and deployed - https://phabricator.wikimedia.org/T269774 (10JArguello-WMF) [16:34:37] 10Analytics, 10Data-Engineering, 10Data Engineering and Event Platform Team, 10Metrics-Platform-Planning, 10Event-Platform: Client-side error logging should use Elastic Common Schema (ECS) fields when possible - https://phabricator.wikimedia.org/T267602 (10JArguello-WMF) [16:34:41] 10Data-Engineering, 10Data Engineering and Event Platform Team, 10EventStreams, 10Event-Platform: EventStreams (via KafkaSSE) does not consume from newly added partitions in topic - https://phabricator.wikimedia.org/T173006 (10JArguello-WMF) [16:34:45] 10Analytics, 10Data-Engineering, 10Data Engineering and Event Platform Team, 10Infrastructure-Foundations, 10Event-Platform: > ~1 request/second to intake-logging.wikimedia.org times out at the traffic/service interface - https://phabricator.wikimedia.org/T264021 (10JArguello-WMF) [16:34:51] 10Analytics, 10Data-Engineering, 10Data Engineering and Event Platform Team, 10Event-Platform, 10Performance-Team (Radar): Avoid extra HTTPS connections for most Event Platform beacons - https://phabricator.wikimedia.org/T263049 (10JArguello-WMF) [16:52:35] 10Data-Engineering, 10Data Engineering and Event Platform Team, 10Epic, 10Event-Platform: [Event Platform] Design and Implement realtime enrichment pipeline for MW page change with content - https://phabricator.wikimedia.org/T307959 (10Ottomata) [16:54:04] 10Data-Engineering, 10Data Engineering and Event Platform Team, 10Epic, 10Event-Platform: [Event Platform] Design and Implement realtime enrichment pipeline for MW page change with content - https://phabricator.wikimedia.org/T307959 (10Ottomata) [16:56:19] 10Data-Engineering, 10Data Engineering and Event Platform Team, 10Epic, 10Event-Platform: [Event Platform] Design and Implement realtime enrichment pipeline for MW page change with content - https://phabricator.wikimedia.org/T307959 (10Ottomata) [17:31:15] 10Data-Engineering, 10Data-Engineering-Kanban, 10Data Engineering and Event Platform Team, 10Data Pipelines, 10Epic: Spark 3 Migration - https://phabricator.wikimedia.org/T309993 (10JArguello-WMF) [17:31:30] 10Data-Engineering, 10Data Engineering and Event Platform Team, 10Data Pipelines, 10Spike: Explore Containerization Solutions for DE Applications - https://phabricator.wikimedia.org/T288254 (10JArguello-WMF) [17:31:34] 10Data-Engineering, 10Data-Engineering-Kanban, 10Data Engineering and Event Platform Team, 10Data Pipelines, 10Epic: [Airflow] User manual and documentation - https://phabricator.wikimedia.org/T295199 (10JArguello-WMF) [17:31:36] 10Data-Engineering, 10Data Engineering and Event Platform Team, 10Data Pipelines, 10Epic, 10Patch-For-Review: Migrate Oozie jobs to Airflow - https://phabricator.wikimedia.org/T299074 (10JArguello-WMF) [17:31:38] 10Data-Engineering, 10Data Engineering and Event Platform Team, 10Data Pipelines, 10Product-Analytics, 10Epic: Replace Oozie with better workflow scheduler - https://phabricator.wikimedia.org/T271429 (10JArguello-WMF) [17:31:40] 10Data-Engineering, 10Data Engineering and Event Platform Team, 10Data Pipelines, 10Epic, 10Platform Team Workboards (Image Suggestion API): Airflow collaborations - https://phabricator.wikimedia.org/T282033 (10JArguello-WMF) [17:41:39] 10Data-Engineering, 10Data-Engineering-Wikistats, 10Data Pipelines (Sprint 12): Non-mobile UAs on mobile (2g/gprs, etc) IP-blocks - https://phabricator.wikimedia.org/T58628 (10JArguello-WMF) [17:44:54] 10Data-Platform-SRE, 10API Platform, 10Anti-Harassment, 10Cloud-Services, and 18 others: Migrate PipelineLib repos to GitLab - https://phabricator.wikimedia.org/T332953 (10JArguello-WMF) [17:45:24] 10Data-Platform-SRE, 10Data Engineering and Event Platform Team: Airflow scheduler and webserver logs should be readable by airflow instance admins - https://phabricator.wikimedia.org/T304615 (10JArguello-WMF) [17:45:28] 10Data-Engineering, 10Data Engineering and Event Platform Team: Reduce the number of files generated by geoeditors airflor jobs - https://phabricator.wikimedia.org/T304852 (10JArguello-WMF) [17:45:36] 10Analytics-Kanban, 10Data-Engineering, 10Data Engineering and Event Platform Team: SPIKE - Will Hadoop 3 container support help us for Airflow deployment pipelines? - https://phabricator.wikimedia.org/T288247 (10JArguello-WMF) [17:53:12] 10Data-Platform-SRE, 10Data Engineering and Event Platform Team, 10Data Pipelines: Add support for Iceberg to the Spark Docker Image - https://phabricator.wikimedia.org/T336012 (10JArguello-WMF) [17:53:18] 10Data-Engineering, 10Data Engineering and Event Platform Team, 10Data Pipelines, 10Patch-For-Review: Enable libmamba by default for conda environment solving - https://phabricator.wikimedia.org/T337258 (10JArguello-WMF) [17:53:22] 10Data-Engineering, 10Data Engineering and Event Platform Team, 10Data Pipelines: [datahub] Implement automatic deletion of datasets with deleted data sources - https://phabricator.wikimedia.org/T335528 (10JArguello-WMF) [17:53:24] 10Data-Engineering, 10Data Engineering and Event Platform Team, 10Data Pipelines: Wrong file names for 2 month files in pageview_complete/monthly - https://phabricator.wikimedia.org/T335685 (10JArguello-WMF) [17:55:18] 10Data-Engineering, 10Data-Engineering-Wikistats, 10Data Engineering and Event Platform Team, 10Data Pipelines: Wikistats in Uzbek - https://phabricator.wikimedia.org/T314477 (10JArguello-WMF) [17:55:25] 10Data-Engineering, 10Data-Engineering-Wikistats, 10Data Engineering and Event Platform Team, 10Data Pipelines, 10I18n: Merge Ks-Arab and Ks-Deva to ks - https://phabricator.wikimedia.org/T314476 (10JArguello-WMF) [17:55:37] 10Data-Engineering, 10Data-Engineering-Wikistats, 10Data Engineering and Event Platform Team, 10Data Pipelines: "Pages to date" not loading with "daily" metric - https://phabricator.wikimedia.org/T312717 (10JArguello-WMF) [17:56:34] 10Data-Engineering, 10Data Engineering and Event Platform Team, 10Data Pipelines: [Airflow] Refactor anomaly detection DAG factory into a TaskGroup factory - https://phabricator.wikimedia.org/T308011 (10JArguello-WMF) [17:56:38] 10Data-Engineering, 10Data Engineering and Event Platform Team, 10Data Pipelines: Migrate 1+ reportupdater jobs - https://phabricator.wikimedia.org/T307540 (10JArguello-WMF) [17:56:42] 10Data-Engineering, 10Data Engineering and Event Platform Team, 10Data Pipelines: Migrate 1+ Druid load jobs - https://phabricator.wikimedia.org/T307508 (10JArguello-WMF) [17:56:46] 10Data-Engineering, 10Data Engineering and Event Platform Team, 10Data Pipelines: Migrate 1+ Refine jobs - https://phabricator.wikimedia.org/T307505 (10JArguello-WMF) [17:56:54] 10Data-Engineering, 10Data Engineering and Event Platform Team, 10Data Pipelines: Integrate Airflow with DataHub - https://phabricator.wikimedia.org/T306977 (10JArguello-WMF) [17:57:02] 10Data-Engineering-Kanban, 10Data Engineering and Event Platform Team, 10Data Pipelines, 10Patch-For-Review: Improvements of artifacts cache - https://phabricator.wikimedia.org/T307115 (10JArguello-WMF) [17:57:34] 10Data-Engineering, 10Data Engineering and Event Platform Team, 10Data Pipelines: Variabilization of existing jobs - https://phabricator.wikimedia.org/T303473 (10JArguello-WMF) [17:57:54] 10Data-Engineering, 10Data Engineering and Event Platform Team, 10Data Pipelines: [Airflow] Research, discuss and decide on DAG/task dependencies VS. success/failure files (Oozie style) - https://phabricator.wikimedia.org/T301568 (10JArguello-WMF) [17:58:38] 10Data-Platform-SRE, 10Data Engineering and Event Platform Team, 10Data Pipelines: Replace db1108 with db1208 - https://phabricator.wikimedia.org/T334055 (10JArguello-WMF) [17:58:44] 10Analytics-Radar, 10Data-Engineering, 10Data Engineering and Event Platform Team, 10Data Pipelines, and 5 others: WikiEditor records all edits as platform = desktop in EventLogging - https://phabricator.wikimedia.org/T249944 (10JArguello-WMF) [17:59:02] 10Data-Engineering-Kanban, 10Data Engineering and Event Platform Team, 10Data Pipelines: Investigate why airflow sensor tasks fail without sending errors - https://phabricator.wikimedia.org/T311976 (10JArguello-WMF) [17:59:14] 10Data-Engineering-Kanban, 10Data Engineering and Event Platform Team, 10Data Pipelines: Investigate Gobblin dataloss during namenode failure - https://phabricator.wikimedia.org/T311263 (10JArguello-WMF) [17:59:26] 10Data-Engineering, 10Data Engineering and Event Platform Team, 10Data Pipelines: Gather all data-purge into a single job - https://phabricator.wikimedia.org/T262201 (10JArguello-WMF) [17:59:30] 10Data-Engineering, 10Data Engineering and Event Platform Team, 10Data Pipelines: Refine: Use Spark SQL instead of Hive JDBC - https://phabricator.wikimedia.org/T209453 (10JArguello-WMF) [17:59:50] 10Data-Engineering, 10Data Engineering and Event Platform Team, 10Data Pipelines, 10Product-Analytics: Add Product-Analytics Announcements to Airflow job for notifications - https://phabricator.wikimedia.org/T301281 (10JArguello-WMF) [20:28:24] (03PS2) 10Btullis: Improve the datahub kafka-setup container [analytics/datahub] (wmf) - 10https://gerrit.wikimedia.org/r/934574 (https://phabricator.wikimedia.org/T329514) [20:47:54] (03CR) 10CI reject: [V: 04-1] Improve the datahub kafka-setup container [analytics/datahub] (wmf) - 10https://gerrit.wikimedia.org/r/934574 (https://phabricator.wikimedia.org/T329514) (owner: 10Btullis) [20:55:47] (03PS3) 10Btullis: Improve the datahub kafka-setup container [analytics/datahub] (wmf) - 10https://gerrit.wikimedia.org/r/934574 (https://phabricator.wikimedia.org/T329514) [20:58:37] (03PS4) 10Btullis: Improve the datahub kafka-setup container [analytics/datahub] (wmf) - 10https://gerrit.wikimedia.org/r/934574 (https://phabricator.wikimedia.org/T329514) [21:03:26] (03PS5) 10Btullis: Improve the datahub kafka-setup container [analytics/datahub] (wmf) - 10https://gerrit.wikimedia.org/r/934574 (https://phabricator.wikimedia.org/T329514) [21:23:08] (03PS6) 10Btullis: Improve the datahub kafka-setup container [analytics/datahub] (wmf) - 10https://gerrit.wikimedia.org/r/934574 (https://phabricator.wikimedia.org/T329514) [21:28:48] (03PS7) 10Btullis: Improve the datahub kafka-setup container [analytics/datahub] (wmf) - 10https://gerrit.wikimedia.org/r/934574 (https://phabricator.wikimedia.org/T329514) [21:36:54] (03PS8) 10Btullis: Improve the datahub kafka-setup container [analytics/datahub] (wmf) - 10https://gerrit.wikimedia.org/r/934574 (https://phabricator.wikimedia.org/T329514) [21:39:24] (03PS9) 10Btullis: Improve the datahub kafka-setup container [analytics/datahub] (wmf) - 10https://gerrit.wikimedia.org/r/934574 (https://phabricator.wikimedia.org/T329514) [21:42:00] (03PS10) 10Btullis: Improve the datahub kafka-setup container [analytics/datahub] (wmf) - 10https://gerrit.wikimedia.org/r/934574 (https://phabricator.wikimedia.org/T329514) [21:45:42] (03PS11) 10Btullis: Improve the datahub kafka-setup container [analytics/datahub] (wmf) - 10https://gerrit.wikimedia.org/r/934574 (https://phabricator.wikimedia.org/T329514) [21:48:25] (03PS12) 10Btullis: Improve the datahub kafka-setup container [analytics/datahub] (wmf) - 10https://gerrit.wikimedia.org/r/934574 (https://phabricator.wikimedia.org/T329514) [21:51:49] (03PS13) 10Btullis: Improve the datahub kafka-setup container [analytics/datahub] (wmf) - 10https://gerrit.wikimedia.org/r/934574 (https://phabricator.wikimedia.org/T329514) [22:05:27] (HiveServerHeapUsage) firing: Hive Server JVM Heap usage is above 80% on an-coord1002:10100 - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Hive/Alerts#Hive_Server_Heap_Usage - https://grafana.wikimedia.org/d/000000379/hive?panelId=7&fullscreen&orgId=1&var-instance=an-coord1002:10100 - https://alerts.wikimedia.org/?q=alertname%3DHiveServerHeapUsage [22:08:37] (03PS14) 10Btullis: Improve the datahub kafka-setup container [analytics/datahub] (wmf) - 10https://gerrit.wikimedia.org/r/934574 (https://phabricator.wikimedia.org/T329514) [22:12:30] 10Data-Platform-SRE, 10Discovery-Search (Current work): Ensure WCQS/WDQS stack works on Bullseye - https://phabricator.wikimedia.org/T331300 (10bking) Leaving some notes before I step out for the weekend and forget everything. The Bullseye hosts are still not coming up without manual intervention beyond the da... [22:21:15] (03CR) 10CI reject: [V: 04-1] Improve the datahub kafka-setup container [analytics/datahub] (wmf) - 10https://gerrit.wikimedia.org/r/934574 (https://phabricator.wikimedia.org/T329514) (owner: 10Btullis) [22:25:27] (HiveServerHeapUsage) resolved: Hive Server JVM Heap usage is above 80% on an-coord1002:10100 - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Hive/Alerts#Hive_Server_Heap_Usage - https://grafana.wikimedia.org/d/000000379/hive?panelId=7&fullscreen&orgId=1&var-instance=an-coord1002:10100 - https://alerts.wikimedia.org/?q=alertname%3DHiveServerHeapUsage [22:36:31] (03CR) 10Btullis: "recheck" [analytics/datahub] (wmf) - 10https://gerrit.wikimedia.org/r/934574 (https://phabricator.wikimedia.org/T329514) (owner: 10Btullis) [23:01:34] (03CR) 10Btullis: "recheck" [analytics/datahub] (wmf) - 10https://gerrit.wikimedia.org/r/934574 (https://phabricator.wikimedia.org/T329514) (owner: 10Btullis) [23:04:51] 10Data-Engineering, 10Data Engineering and Event Platform Team, 10Event-Platform, 10MW-1.40-notes (1.40.0-wmf.24; 2023-02-20), and 3 others: Remove StreamConfig::INTERNAL_SETTINGS logic from EventStreamConfig and do it in EventLogging client instead - https://phabricator.wikimedia.org/T286344 (10JArguello-... [23:27:09] 10Analytics, 10Data-Engineering, 10Data Engineering and Event Platform Team, 10EventStreams, and 3 others: Expose rdf-streaming-updater.mutation content through EventStreams - https://phabricator.wikimedia.org/T294133 (10JArguello-WMF)