[03:11:20] 06Data-Engineering, 10Commons-Impact-Metrics, 13Patch-For-Review: [CIM] Skewed ranking with the top Editors monthly API - https://phabricator.wikimedia.org/T370470#10569939 (10EChukwukere-WMF) @Eevans Typically we move the DEV fixes or features to the cassandra test env ( Link below ). When testing is done... [10:04:25] 10Data-Engineering-Roadmap, 06Data-Platform-SRE, 10Dumps-Generation, 10MW-on-K8s, and 4 others: WE 5.4 KR - Hypothesis 5.4.4 - Q3 FY24/25 - Migrate current-generation dumps to run on kubernetes - https://phabricator.wikimedia.org/T352650#10570484 (10brouberol) The Cronjob and PVC have been deployed! ` bro... [13:36:23] 10Data-Engineering (Q3 2024 January 1st - March 31th), 10DPE-Mediawiki-Content, 10Data-Platform-SRE (2025.02.10 - 2025.02.28), 07Essential-Work, 13Patch-For-Review: DAG failing due to failure to acquire lock on wmf_data_ops.data_quality_metrics table - https://phabricator.wikimedia.org/T386114#10570977 (1... [13:36:48] 10Data-Engineering (Q3 2024 January 1st - March 31th), 10DPE-Mediawiki-Content, 10Data-Platform-SRE (2025.02.10 - 2025.02.28), 07Essential-Work, 13Patch-For-Review: DAG failing due to failure to acquire lock on wmf_data_ops.data_quality_metrics table - https://phabricator.wikimedia.org/T386114#10570979 (1... [13:55:19] 06Data-Engineering, 06Research: A dataset sensor should work indepent of airflow instance - https://phabricator.wikimedia.org/T386973#10571038 (10xcollazo) [14:22:54] 06Data-Engineering, 10Commons-Impact-Metrics, 13Patch-For-Review: [CIM] Skewed ranking with the top Editors monthly API - https://phabricator.wikimedia.org/T370470#10571153 (10Eevans) >>! In T370470#10569939, @EChukwukere-WMF wrote: > > @Eevans Typically we move the DEV fixes or features to the cassandra te... [14:35:05] 10Data-Engineering (Q3 2024 January 1st - March 31th), 10Growth-Structured-Tasks, 06Growth-Team, 10Image-Suggestions, and 7 others: wmf.wikidata_item_page_link and wmf.wikidata_entity snapshots stuck at 2025-01-20 - https://phabricator.wikimedia.org/T386255#10571208 (10Lydia_Pintscher) [14:56:57] 06Data-Engineering, 06Research, 13Patch-For-Review: Research airflow instance - https://phabricator.wikimedia.org/T386933#10571291 (10xcollazo) [15:00:20] 06Data-Engineering, 10Commons-Impact-Metrics, 13Patch-For-Review: [CIM] Skewed ranking with the top Editors monthly API - https://phabricator.wikimedia.org/T370470#10571299 (10EChukwukere-WMF) @Eevans Got it!.. once testing is done in the Cassandra env I will notify you to deploy to staging. I should be done... [15:30:54] 10Data-Engineering (Q3 2024 January 1st - March 31th), 10DPE-Mediawiki-Content, 13Patch-For-Review: Figure root cause of silent failures of when computing metrics for mediawiki_content_history_v1 - https://phabricator.wikimedia.org/T387033#10571378 (10xcollazo) [15:32:39] 06Data-Engineering, 10Commons-Impact-Metrics, 13Patch-For-Review: [CIM] Skewed ranking with the top Editors monthly API - https://phabricator.wikimedia.org/T370470#10571381 (10mforns) Hey @EChukwukere-WMF and @Eevans, coincidentally, I retook this task yesterday. We re-prioritized it and I will try and push... [15:44:52] 10Data-Engineering (Q3 2024 January 1st - March 31th), 10DPE-Mediawiki-Content, 13Patch-For-Review: Figure root cause of silent failures when computing metrics for mediawiki_content_history_v1 - https://phabricator.wikimedia.org/T387033#10571410 (10xcollazo) [15:49:17] 14Data-Engineering (Q4 2024 April 1st - June 30th), 10Wikidata, 10Wikidata Analytics: [Bug?] Can't find wikidatawiki on wmf.mediawiki_wikitext_history - https://phabricator.wikimedia.org/T364045#10571426 (10xcollazo) 05Open→03Resolved [16:16:46] 06Data-Engineering, 10Commons-Impact-Metrics, 13Patch-For-Review: [CIM] Skewed ranking with the top Editors monthly API - https://phabricator.wikimedia.org/T370470#10571551 (10Eevans) >>! In T370470#10571381, @mforns wrote: > Hey @EChukwukere-WMF and @Eevans, coincidentally, I retook this task yesterday. > W... [17:01:28] 10Data-Engineering (Q3 2024 January 1st - March 31th), 13Patch-For-Review: Migrate analytics Airflow DAGs to k8s Airflow deployment - https://phabricator.wikimedia.org/T386282#10571687 (10brouberol) As discussed in the sync meeting, we're going to provision a whole new airflow instance on kubernetes, and progr... [17:05:33] 10Data-Engineering (Q3 2024 January 1st - March 31th), 13Patch-For-Review: Migrate analytics Airflow DAGs to k8s Airflow deployment - https://phabricator.wikimedia.org/T386282#10571696 (10mforns) @brouberol sounds good to me! [18:03:29] 06Data-Engineering, 10Commons-Impact-Metrics, 13Patch-For-Review: [CIM] Skewed ranking with the top Editors monthly API - https://phabricator.wikimedia.org/T370470#10571834 (10EChukwukere-WMF) @mforns Hmm interesting.. I did a git pull now into the cassandra Test env, If the fix is all there I will check the... [18:34:28] !log Deployed latest DAGs for the analytics Airflow instance. T387033. [18:34:31] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [18:34:31] T387033: Figure root cause of silent failures when computing metrics for mediawiki_content_history_v1 - https://phabricator.wikimedia.org/T387033 [18:44:15] 10Data-Engineering (Q3 2024 January 1st - March 31th), 10DPE-Mediawiki-Content: Figure root cause of silent failures when computing metrics for mediawiki_content_history_v1 - https://phabricator.wikimedia.org/T387033#10571969 (10xcollazo) 05Open→03In progress p:05Triage→03High [19:51:20] 06Data-Engineering, 06Data-Engineering-Radar, 06DBA, 10Charts (Sprint 15), 07Schema-change-in-production: Deploy patch-gjlw_namespace_text.sql on x1.commonswiki for JsonConfig - https://phabricator.wikimedia.org/T385917#10572161 (10bvibber) [19:52:55] 06Data-Engineering, 06Data-Engineering-Radar, 06DBA, 10Charts (Sprint 15), 07Schema-change-in-production: Deploy patch-gjlw_namespace_text.sql on x1.commonswiki for JsonConfig - https://phabricator.wikimedia.org/T385917#10572163 (10bvibber) @Ladsgroup I'm reasonably happy with the state of the updated pa... [20:42:45] 06Data-Engineering, 10Commons-Impact-Metrics, 13Patch-For-Review: [CIM] Skewed ranking with the top Editors monthly API - https://phabricator.wikimedia.org/T370470#10572234 (10EChukwukere-WMF) @mforns I did find this issue in production. I don't have enough data in that cassandra QA env to duplication the is... [22:23:41] 06Data-Engineering, 06Research: A dataset sensor should work indepent of airflow instance - https://phabricator.wikimedia.org/T386973#10572402 (10amastilovic) a:03amastilovic