[10:56:17] 06Data-Engineering, 06Data-Platform, 06DBA, 07Schema-change-in-production: Change page.page_links_updated to fixed-length timestamp in wmf wikis - https://phabricator.wikimedia.org/T371742#10140271 (10Ladsgroup) [12:21:29] 10Data-Engineering (Q1 2024 July 1st - September 30th), 10Data Pipelines, 10Data-Catalog, 13Patch-For-Review: Spike: Integrate Spark with DataHub with lineage - https://phabricator.wikimedia.org/T306896#10140486 (10tchin) I don't know how/where spark's `appName` is autogenerated, but for dags to use spark... [12:36:35] 06Data-Engineering, 06DBA, 07Schema-change-in-production: Drop deprecated abuse filter fields on wmf wikis - https://phabricator.wikimedia.org/T367781#10140520 (10ABran-WMF) [12:40:27] 06Data-Engineering, 06DBA, 07Schema-change-in-production: Drop deprecated abuse filter fields on wmf wikis - https://phabricator.wikimedia.org/T367781#10140544 (10Ladsgroup) For this you don't need even switchover at all. You can run the script with --dc-masters and it should be fine, the tables are small an... [12:49:10] 06Data-Engineering, 06Data-Platform, 10Temporary accounts: Add MW table 'cu_log' to data lake - https://phabricator.wikimedia.org/T364398#10140612 (10JayCano) [13:09:12] 06Data-Engineering, 10CheckUser, 06Data Products, 06DBA, 07Schema-change-in-production: Remove cuc_actiontext, cuc_only_for_read_old, and cuc_private from cu_changes on WMF wikis - https://phabricator.wikimedia.org/T370903#10140701 (10Ladsgroup) [13:13:05] 06Data-Engineering, 06DBA, 07Schema-change-in-production: Drop deprecated abuse filter fields on wmf wikis - https://phabricator.wikimedia.org/T367781#10140706 (10ABran-WMF) [13:44:23] 10Data-Engineering (Q1 2024 July 1st - September 30th), 10Data Pipelines, 10Data-Catalog, 13Patch-For-Review: Spike: Integrate Spark with DataHub with lineage - https://phabricator.wikimedia.org/T306896#10140826 (10Ottomata) This looks like it is happening because of the way the default SparkSubmitOperator... [14:50:48] 10Quarry, 10cloud-services-team (FY2024/2025-Q1-Q2), 07User-notice: Support queries against Quarry's own database and ToolsDB - https://phabricator.wikimedia.org/T151158#10141169 (10fnegri) @UOzurumba apologies for the delay. Yes, it's a good idea to add it to the next Tech News! Here's a summary, feel f... [15:58:25] 06Data-Engineering, 06Discovery-Search: Decide how to make datasets owned by analytics-search-users also readable by analytics-privatedata-users - https://phabricator.wikimedia.org/T374637 (10dcausse) 03NEW [16:28:41] 06Data-Engineering, 10MediaWiki-extensions-WikimediaEvents, 10Observability-Metrics, 10Event-Platform, and 2 others: Add Prometheus support to statsd.js via mw.track() - https://phabricator.wikimedia.org/T355837#10141616 (10DLynch) To note a particular use-case from Graphite... we have some [recommendation... [16:51:08] 10Data-Engineering (Q1 2024 July 1st - September 30th): Handle Late-Arrived Events from Gobblin into Airflow triggered Refine - https://phabricator.wikimedia.org/T370665#10141739 (10JAllemandou) a:03JAllemandou [16:57:49] (03PS1) 10Gerrit maintenance bot: Add mos.wikipedia to pageview allowlist [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1072576 (https://phabricator.wikimedia.org/T374644) [17:52:52] 06Data-Engineering, 06Data Products, 10Dumps 2.0, 10Event-Platform: Consider renaming columns and/or table to abide by the data modeling guidelines - https://phabricator.wikimedia.org/T366542#10142079 (10xcollazo) On a meeting yeterday with the #dumps_2.0 team, we agreed that the table name will be: `wmf_... [22:36:34] 07Analytics-Data-Problem, 06Design-System-Team, 06MW-Interfaces-Team, 07JavaScript, 10Web-Team-Backlog (Needs Prioritization (Tech)): Send Api-User-Agent header from MediaWiki client-side code - https://phabricator.wikimedia.org/T373874#10142780 (10Jdlrobson) p:05Triage→03Low [23:40:09] 06Data-Engineering, 10MediaWiki-extensions-WikimediaEvents, 10Observability-Metrics, 10Event-Platform, and 2 others: Add Prometheus support to statsd.js via mw.track() - https://phabricator.wikimedia.org/T355837#10142902 (10Krinkle) There is no Prometheus client for MediaWiki JS yet, not for core, not for...