[08:23:43] 06Data-Engineering, 06Data-Platform-SRE, 06Discovery-Search, 06Java-Scala-Standardization: List python projects that are published to Archiva and how they are deployed - https://phabricator.wikimedia.org/T373450#10098815 (10Gehel) p:05Triage→03Medium [08:25:14] 06Data-Engineering, 10Data-Platform-SRE (2024.08.17 - 2024.09.06), 07Kubernetes: Migrate dse cluster off of Pod Security Policies - https://phabricator.wikimedia.org/T369492#10098817 (10Gehel) p:05Triage→03Medium [08:49:43] 06Data-Engineering, 06Discovery-Search, 06Java-Scala-Standardization, 10Data-Platform-SRE (2024.08.17 - 2024.09.06): Update parent pom to disable fetching dependencies from Archiva and use Gitlab instead - https://phabricator.wikimedia.org/T367404#10098932 (10Gehel) Code is merged in the parent pom, we'll... [08:49:57] 06Data-Engineering, 10Event-Platform, 07Wikimedia-production-error: PHP Warning: Stats: Cannot associate label keys with label values: Not all initialized labels have an assigned value. - https://phabricator.wikimedia.org/T373086#10098934 (10gmodena) a:03gmodena [08:53:20] 10Data-Engineering (Q1 2024 July 1st - September 30th), 10Event-Platform, 07Wikimedia-production-error: PHP Warning: Stats: Cannot associate label keys with label values: Not all initialized labels have an assigned value. - https://phabricator.wikimedia.org/T373086#10098937 (10gmodena) [09:34:03] 10Data-Engineering (Q1 2024 July 1st - September 30th), 10Event-Platform, 07Wikimedia-production-error: PHP Warning: Stats: Cannot associate label keys with label values: Not all initialized labels have an assigned value. - https://phabricator.wikimedia.org/T373086#10099082 (10gmodena) @colewhite ack. Thanks... [09:42:47] 10Data-Engineering (Q1 2024 July 1st - September 30th), 10Event-Platform, 13Patch-For-Review: Rollback haproxy feed automated ingestion - https://phabricator.wikimedia.org/T372456#10099117 (10gmodena) I don't know why matching on the `job` label alone did not work, by a more extensive match (all labels excep... [09:43:00] 10Data-Engineering (Q1 2024 July 1st - September 30th), 10Event-Platform, 13Patch-For-Review: Rollback haproxy feed automated ingestion - https://phabricator.wikimedia.org/T372456#10099118 (10gmodena) [09:43:33] (03CR) 10Gmodena: [C:03+2] gobblin: remove webrequest_frontend_rc0.pull [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1062677 (https://phabricator.wikimedia.org/T372456) (owner: 10Gmodena) [09:50:44] 06Data-Engineering, 06serviceops-radar, 10Event-Platform, 13Patch-For-Review: Improve eventgates health check/readiness probe - https://phabricator.wikimedia.org/T373192#10099127 (10JMeybohm) @Ottomata could you please verify the above/patches to unblock the hardware refresh of kafka-main? [09:58:31] 06Data-Engineering, 10CheckUser, 06Data Products, 06DBA, and 2 others: Remove cuc_actiontext, cuc_only_for_read_old, and cuc_private from cu_changes on WMF wikis - https://phabricator.wikimedia.org/T370903#10099140 (10Ladsgroup) [14:44:33] 10Quarry: Remove quarry-124 cluster - https://phabricator.wikimedia.org/T373375#10099868 (10rook) 05Open→03Resolved a:03rook [14:45:43] 10Quarry: unused dns proxies? - https://phabricator.wikimedia.org/T373528 (10rook) 03NEW [14:47:14] 10Quarry: unused dns proxies? - https://phabricator.wikimedia.org/T373528#10099881 (10rook) [14:47:18] 10Quarry: unused dns proxies? - https://phabricator.wikimedia.org/T373528#10099882 (10rook) [14:47:28] 10Quarry: unused dns proxies? - https://phabricator.wikimedia.org/T373528#10099883 (10rook) [15:52:10] 10Data-Engineering (Q1 2024 July 1st - September 30th), 10Dumps 2.0 (Kanban Board): Implement Airflow Dataset class for RestExternalTaskSensor - https://phabricator.wikimedia.org/T372647#10100242 (10Ottomata) > If we made it universal across instances, how would that affect current deployment method? AFAIK we'... [16:11:02] (03CR) 10Ottomata: Refactor Refine to be triggered by Airflow (031 comment) [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1016808 (https://phabricator.wikimedia.org/T356762) (owner: 10Aqu) [16:24:53] 10Data-Engineering (Q1 2024 July 1st - September 30th): [Refine Refactoring] Refine jobs should be scheduled by Airflow: deployment - https://phabricator.wikimedia.org/T369845#10100345 (10Ottomata) [17:28:52] (03PS46) 10Ottomata: Refactor Refine to be triggered by Airflow [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1016808 (https://phabricator.wikimedia.org/T356762) (owner: 10Aqu) [17:29:15] (03CR) 10Ottomata: Refactor Refine to be triggered by Airflow (032 comments) [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1016808 (https://phabricator.wikimedia.org/T356762) (owner: 10Aqu) [17:29:55] (03CR) 10Ottomata: [C:03+1] "This LGTM, let's merge after https://gerrit.wikimedia.org/r/c/analytics/refinery/source/+/1051061 and as a separate versioned release." [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1016808 (https://phabricator.wikimedia.org/T356762) (owner: 10Aqu) [17:37:24] 10Data-Engineering (Q1 2024 July 1st - September 30th): [Refine Refactoring] Refine jobs should be scheduled by Airflow: deployment - https://phabricator.wikimedia.org/T369845#10100665 (10Ottomata) [17:38:30] 10Data-Engineering (Q1 2024 July 1st - September 30th): [Refine Refactoring] Refine jobs should be scheduled by Airflow: deployment - https://phabricator.wikimedia.org/T369845#10100685 (10Ottomata) [17:54:18] 10Data-Engineering (Q1 2024 July 1st - September 30th), 06Data Products, 10Metrics Platform: [MPIC] Analyse risk of potential performance issues with static approach to stream configuration - https://phabricator.wikimedia.org/T366627#10100721 (10VirginiaPoundstone) @Ottomata and @phuedx is this task ready to... [18:37:21] 06Data-Engineering, 13Patch-For-Review: Timeout hive-metastore locks - https://phabricator.wikimedia.org/T365563#10100921 (10Ottomata) Thank you! looks like there are outstanding comments in https://gerrit.wikimedia.org/r/c/analytics/refinery/source/+/1034851 [19:00:36] 10Data-Engineering (Q1 2024 July 1st - September 30th), 10Dumps 2.0 (Kanban Board): Implement Airflow Dataset class for RestExternalTaskSensor - https://phabricator.wikimedia.org/T372647#10100973 (10Ahoelzl) a:03amastilovic [19:08:57] (03CR) 10Gehel: [C:04-1] ci: migrate to new parent pom (031 comment) [analytics/gobblin-wmf] - 10https://gerrit.wikimedia.org/r/1062711 (https://phabricator.wikimedia.org/T360219) (owner: 10Gehel) [19:16:26] (03CR) 10Ebernhardson: [C:03+2] page_weighted_tags_change: add rev_based flag [schemas/event/primary] - 10https://gerrit.wikimedia.org/r/1065287 (https://phabricator.wikimedia.org/T372914) (owner: 10Peter Fischer) [19:16:51] (03Merged) 10jenkins-bot: page_weighted_tags_change: add rev_based flag [schemas/event/primary] - 10https://gerrit.wikimedia.org/r/1065287 (https://phabricator.wikimedia.org/T372914) (owner: 10Peter Fischer) [20:40:45] 06Data-Engineering: [SPIKE] Learn and document how to use Flink-CDC from MediaWiki MariaDB locally - https://phabricator.wikimedia.org/T373144#10101216 (10NoZeroDay) a:03NoZeroDay [20:49:55] 10Quarry, 10PAWS: PR usually not posting to phabricator - https://phabricator.wikimedia.org/T373134#10101229 (10rook) [20:56:29] 10Quarry, 10PAWS: PR usually not posting to phabricator - https://phabricator.wikimedia.org/T373134#10101244 (10rook) May be caused by T362401 [21:14:04] 06Data-Engineering: [SPIKE] Learn and document how to use Flink-CDC from MediaWiki MariaDB locally - https://phabricator.wikimedia.org/T373144#10101292 (10NoZeroDay) Though related to the parent task T370354, some preliminary work had commenced on [[ https://github.com/john-mwangi/mariadb_iceberg_demo | this Gi...