[08:49:44] 06Data-Engineering, 10Data-Platform-SRE (2024.05.06 - 2024.05.26), 13Patch-For-Review: ISPDatabaseReader null pointer exception - https://phabricator.wikimedia.org/T365197#9828768 (10Gehel) 05Open→03Resolved a:03Gehel Fix is merged and will be deployed with the next release. [09:09:06] (03CR) 10Phuedx: [C:03+2] Add new fields to quicksurveysresponses [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/1029722 (https://phabricator.wikimedia.org/T363140) (owner: 10Amdrel) [09:09:40] (03Merged) 10jenkins-bot: Add new fields to quicksurveysresponses [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/1029722 (https://phabricator.wikimedia.org/T363140) (owner: 10Amdrel) [12:21:46] 06Data-Engineering, 10Dumps-Generation, 06SRE, 10Data-Platform-SRE (2024.05.27 - 2024.06.16): Migrate Dumps Snapshot hosts from Buster to Bullseye - https://phabricator.wikimedia.org/T325228#9829264 (10Gehel) [12:22:31] 06Data-Engineering, 10Temporary accounts, 10Data-Platform-SRE (2024.05.27 - 2024.06.16): Generate a list of Superset users affected by changes to IP masking/temp users - https://phabricator.wikimedia.org/T347510#9829286 (10Gehel) [12:29:48] 14Data-Engineering-Kanban, 10Cassandra, 10Data-Platform-SRE (2024.05.27 - 2024.06.16): Properly add aqsloader user (w/ secrets) - https://phabricator.wikimedia.org/T305600#9829322 (10BTullis) [12:44:27] 06Data-Engineering, 10Data-Platform-SRE (2024.05.27 - 2024.06.16): Alluxio for Improved Superset Query Performance - https://phabricator.wikimedia.org/T288252#9829379 (10Gehel) [12:44:49] 06Data-Engineering, 10MediaWiki-General, 10Event-Platform, 10MediaWiki-Platform-Team (Radar), 13Patch-For-Review: Create legacy EventLogging proxy HTTP intake (for MediaWikiPingback) endpoint to EventGate - https://phabricator.wikimedia.org/T353817#9829380 (10Ottomata) I have scheduled a config deploymen... [12:45:12] 06Data-Engineering, 10Data-Platform-SRE (2024.05.27 - 2024.06.16): Alluxio for Improved Superset Query Performance - https://phabricator.wikimedia.org/T288252#9829382 (10Gehel) I think that the latest superset deployments have caching enabled. This might not be useful anymore. [13:23:28] 06Data-Engineering, 06Data-Platform-SRE: Alluxio for Improved Superset Query Performance - https://phabricator.wikimedia.org/T288252#9829598 (10Gehel) [13:28:30] 06Data-Engineering, 06Data-Platform-SRE: Alluxio for Improved Superset Query Performance - https://phabricator.wikimedia.org/T288252#9829614 (10Gehel) Actually, this brings a different level of caching and could reduce network pressure in some instances (T364893#9800673). [13:43:19] btullis: o/ we can meet in a bit if you have time! [13:44:38] Yes, sure thing. How about 10 minutes from now? five to the hour? [13:46:03] 06Data-Engineering, 10Dumps-Generation, 06SRE, 10Data-Platform-SRE (2024.05.27 - 2024.06.16): Migrate Dumps Snapshot hosts from Buster to Bullseye - https://phabricator.wikimedia.org/T325228#9829693 (10BTullis) [13:47:05] even 15 mins! [13:49:53] ack. See you then. I'll send a link. [14:56:48] 10Data-Engineering (Q4 2024 April 1st - June 30th), 06Data Products, 06Movement-Insights, 10Movement-Metrics: Data Quality Issue: Wikitext History Job fail / rerun in Airflow - https://phabricator.wikimedia.org/T342911#9829890 (10xcollazo) @Snwachukwu and I looked into this a bit and we figured that an alt... [15:09:46] 10Data-Engineering (Q4 2024 April 1st - June 30th): Fix DPE alerts dashboard to work with Google Groups - https://phabricator.wikimedia.org/T365829 (10Ahoelzl) 03NEW [15:12:52] 10Data-Engineering (Q4 2024 April 1st - June 30th): Fix DPE alerts dashboard to work with Google Groups - https://phabricator.wikimedia.org/T365829#9829954 (10Ahoelzl) [15:17:49] 10Data-Engineering (Q4 2024 April 1st - June 30th), 06Data Products, 06Movement-Insights, 10Movement-Metrics: Data Quality Issue: Wikitext History Job fail / rerun in Airflow - https://phabricator.wikimedia.org/T342911#9829989 (10xcollazo) >>! In T342911#9829889, @xcollazo wrote: > @Snwachukwu and I looked... [16:07:35] (03CR) 10Mforns: "Wow! I thought writing these queries was going to be lighter." [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1023461 (https://phabricator.wikimedia.org/T358707) (owner: 10Xcollazo) [16:44:57] 06Data-Engineering, 10Data Pipelines, 10Data-Platform-SRE (2024.05.27 - 2024.06.16): Upgrade Airflow to 2.9.1 - https://phabricator.wikimedia.org/T365449#9830322 (10BTullis) p:05Triage→03High [16:57:56] 10Data-Engineering (Q4 2024 April 1st - June 30th), 13Patch-For-Review: [Bug?] Can't find wikidatawiki on wmf.mediawiki_wikitext_history - https://phabricator.wikimedia.org/T364045#9830381 (10lbowmaker) a:03JAllemandou [17:01:54] 10Data-Engineering (Q4 2024 April 1st - June 30th), 13Patch-For-Review: Update MW history data quality job to use Deequ Anomaly detection Capability - https://phabricator.wikimedia.org/T362803#9830402 (10lbowmaker) @Snwachukwu I’ll move this to in review? Is it stalled on anything? [17:05:23] 10Data-Engineering (Q4 2024 April 1st - June 30th), 13Patch-For-Review: Update MW history data quality job to use Deequ Anomaly detection Capability - https://phabricator.wikimedia.org/T362803#9830413 (10lbowmaker) [17:06:45] 10Data-Engineering (Q4 2024 April 1st - June 30th): Move reportupdater reports away from their local filesystem locations - https://phabricator.wikimedia.org/T365382#9830415 (10lbowmaker) [19:04:57] (03CR) 10Mforns: SQL queries that format the base Commons Impact Metrics datasets into the expected shape for the 14 Cassandra tables. (034 comments) [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1023461 (https://phabricator.wikimedia.org/T358707) (owner: 10Xcollazo)