[07:47:51] 10Data-Engineering (Q1 2024 July 1st - September 30th), 10Data-Platform-SRE (2024.09.06 - 2024.09.27): Deploy the HDFS synchronizer service to the dse-k8s cluster - https://phabricator.wikimedia.org/T371994#10163354 (10Gehel) p:05Triage→03High [08:42:20] (03PS2) 10David Martin: Add mediawiki.product_metrics.wikilambda_api data stream to the sanitization allowlist [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1064438 (https://phabricator.wikimedia.org/T372987) [08:53:02] (03CR) 10David Martin: Add mediawiki.product_metrics.wikilambda_api data stream to the sanitization allowlist (031 comment) [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1064438 (https://phabricator.wikimedia.org/T372987) (owner: 10David Martin) [09:04:38] 06Data-Engineering, 03Discovery-Search (Current work): Decide how to make datasets owned by analytics-search-users also readable by analytics-privatedata-users - https://phabricator.wikimedia.org/T374637#10163589 (10Gehel) 05Open→03Resolved [10:16:25] 06Data-Engineering, 10CirrusSearch, 10Structured Data Engineering, 06Structured-Data-Backlog, 03Discovery-Search (Current work): Migrate image recommendation to use page_weighted_tags_changed stream - https://phabricator.wikimedia.org/T372912#10163750 (10Cparle) > @Cparle, would you know the rate of upda... [11:31:58] (03PS1) 10TChin: Remove deleted mediawiki_linktarget table from drop-mediawiki-snapshots [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1074392 [11:36:38] (03PS2) 10TChin: Remove deleted mediawiki_linktarget table from drop-mediawiki-snapshots [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1074392 [12:00:42] (03CR) 10Joal: [C:03+1] Remove deleted mediawiki_linktarget table from drop-mediawiki-snapshots [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1074392 (owner: 10TChin) [12:27:50] 06Data-Engineering, 10Dumps 2.0, 10Event-Platform: [SPIKE] how can we support Spark producer/consumers in Event Platform - https://phabricator.wikimedia.org/T374341#10163912 (10pfischer) @Ottomata, regarding volumes to be expected for image recommendations: According to @Cparle [[ https://phabricator.wikimed... [12:28:40] (03CR) 10Milimetric: [V:03+2 C:03+2] Remove deleted mediawiki_linktarget table from drop-mediawiki-snapshots [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1074392 (owner: 10TChin) [12:54:01] 06Data-Engineering, 10CirrusSearch, 10Structured Data Engineering, 06Structured-Data-Backlog, 03Discovery-Search (Current work): Migrate image recommendation to use page_weighted_tags_changed stream - https://phabricator.wikimedia.org/T372912#10163969 (10pfischer) [13:59:48] 10Data-Engineering (Q1 2024 July 1st - September 30th): Handle Late-Arrived Events from Gobblin into Airflow triggered Refine - https://phabricator.wikimedia.org/T370665#10164106 (10JAllemandou) Second round of analysis : https://phabricator.wikimedia.org/P69381 TL;DR: * When gobblin has issues/is paused, qwe... [17:50:43] 10Quarry: Emtpy Quarry query names are not linked/should not be allowed - https://phabricator.wikimedia.org/T375292 (101234qwer1234qwer4) 03NEW