[00:34:59] 06Data-Engineering, 06Movement-Insights, 10Wmfdata-Python: Define Setuptools as Wmfdata-Python's build system using a pyproject.toml file - https://phabricator.wikimedia.org/T378254#10283248 (10nshahquinn-wmf) 05Open→03Resolved a:03nshahquinn-wmf Merged as [4f3ed41](https://github.com/wikimedia/wmf... [00:36:52] 06Data-Engineering, 10Wmfdata-Python: wmfdata.__version__ doesn't exist in wmfdata-python - https://phabricator.wikimedia.org/T356708#10283251 (10nshahquinn-wmf) 05Open→03Resolved a:03nshahquinn-wmf Merged as [8b74b01](https://github.com/wikimedia/wmfdata-python/commit/8b74b01e2e2c58c02324bbe59a9d66c... [00:37:47] 06Data-Engineering, 06Data Products, 10Wmfdata-Python: Specify Conda-Pack as a dependency - https://phabricator.wikimedia.org/T370718#10283254 (10nshahquinn-wmf) 05Open→03Resolved a:03nshahquinn-wmf Merged as [43bc3ae](https://github.com/wikimedia/wmfdata-python/commit/43bc3ae98a09195c41e3a094bcafc... [00:41:01] 06Data-Engineering, 06Movement-Insights, 10Wmfdata-Python: Wmfdata does not specify tabulate as a dependency - https://phabricator.wikimedia.org/T378430#10283257 (10nshahquinn-wmf) 05Open→03Resolved a:03nshahquinn-wmf Merged as [bcda3d3](https://github.com/wikimedia/wmfdata-python/commit/bcda3d3f77... [01:45:59] 06Data-Engineering: Request Kerberos identity for jsn.sherman - https://phabricator.wikimedia.org/T378786 (10jsn.sherman) 03NEW [01:57:03] 06Data-Engineering, 06Movement-Insights, 10Wmfdata-Python: Transfer Setuptools configuration from setup.py to pyproject.toml - https://phabricator.wikimedia.org/T378789 (10nshahquinn-wmf) 03NEW [02:11:08] 06Data-Engineering, 06Product-Analytics, 10Wmfdata-Python: Wmfdata-Python triggers a Pandas warning during mariadb.run and hive.run - https://phabricator.wikimedia.org/T324135#10283413 (10nshahquinn-wmf) 05Open→03Resolved Double resolved! [02:58:53] 06Data-Engineering, 06Movement-Insights, 10Wmfdata-Python: Transfer Setuptools configuration from setup.py to pyproject.toml - https://phabricator.wikimedia.org/T378789#10283417 (10nshahquinn-wmf) p:05Triage→03Low [09:23:24] 06Data-Engineering, 06Movement-Insights, 10Wmfdata-Python: Wmfdata does not specify tabulate as a dependency - https://phabricator.wikimedia.org/T378430#10283618 (10AndrewTavis_WMDE) Thanks for handling this, @nshahquinn-wmf! [09:55:05] 06Data-Engineering, 03Discovery-Search (Current work): Datahub - ingest Hive discovery database - https://phabricator.wikimedia.org/T374118#10283685 (10Gehel) 05Open→03Resolved [10:01:25] 10Data-Engineering (Q2 2024 October 1st - December 31th), 13Patch-For-Review: [Refine Refactoring] Refine jobs should be scheduled by Airflow: deployment - https://phabricator.wikimedia.org/T369845#10283694 (10gmodena) > Discussed with @tchin about adding the Hive consumer into ESC update. We should discuss wi... [11:17:36] 06Data-Engineering, 06Data Products, 10GlobalBlocking, 07Schema-change-in-production: Drop gbw_address and gbw_target_central_id from the global_block_whitelist table on WMF wikis - https://phabricator.wikimedia.org/T378747#10283853 (10Dreamy_Jazz) [11:34:00] 06Data-Engineering, 06Data Products, 06DBA, 10GlobalBlocking, 07Schema-change-in-production: Drop gbw_address and gbw_target_central_id from the global_block_whitelist table on WMF wikis - https://phabricator.wikimedia.org/T378747#10283875 (10Dreamy_Jazz) [15:21:04] 06Data-Engineering, 10MediaWiki-extensions-WikimediaEvents, 10Observability-Metrics, 10Event-Platform, and 3 others: Add Prometheus support to statsd.js via mw.track() - https://phabricator.wikimedia.org/T355837#10284315 (10lmata) Thank you for the proposal; it seems we have some options forward. To move u... [15:58:24] 10Data-Engineering (Q2 2024 October 1st - December 31th), 10Data Pipelines, 10Data-Catalog, 13Patch-For-Review: Integrate Spark with DataHub with lineage - https://phabricator.wikimedia.org/T306896#10284397 (10Ahoelzl) [16:29:17] 06Data-Engineering, 10MediaWiki-extensions-WikimediaEvents, 10Observability-Metrics, 10Event-Platform, and 3 others: Add Prometheus support to statsd.js via mw.track() - https://phabricator.wikimedia.org/T355837#10284492 (10Ottomata) > allowing metric owners to choose which mechanism and data store best su... [16:40:18] 06Data-Engineering, 10Event-Platform: Implement stream of HTML content on mw.page_change event - https://phabricator.wikimedia.org/T360794#10284527 (10diego) [18:50:39] 06Data-Engineering, 10MediaWiki-extensions-EventLogging, 10MediaWiki-extensions-WikimediaEvents, 13Patch-For-Review, 07Test-Infrastructure: Decide on how data platform wants to monitor bundle sizes - https://phabricator.wikimedia.org/T378772#10285178 (10Jdforrester-WMF) a:05Jdforrester-WMF→03None Not... [19:18:38] 06Data-Engineering, 10MediaWiki-extensions-EventLogging, 10MediaWiki-extensions-WikimediaEvents, 13Patch-For-Review, 07Test-Infrastructure: Decide on how data platform wants to monitor bundle sizes - https://phabricator.wikimedia.org/T378772#10285356 (10Jdlrobson) Sorry :) Not intentional! [19:52:51] 06Data-Engineering, 06Data Products, 10MediaWiki-extensions-EventLogging, 10MediaWiki-extensions-WikimediaEvents, and 3 others: Decide on how data platform wants to monitor bundle sizes - https://phabricator.wikimedia.org/T378772#10285410 (10Ottomata) [19:56:05] 10Data-Engineering (Q2 2024 October 1st - December 31th), 10Dumps 2.0, 03Discovery-Search (Current work), 13Patch-For-Review: [SPIKE] how can we support Spark producer/consumers in Event Platform - https://phabricator.wikimedia.org/T374341#10285419 (10xcollazo) [19:56:48] 10Data-Engineering (Q2 2024 October 1st - December 31th), 03Discovery-Search (Current work), 10Dumps 2.0 (Kanban Board), 13Patch-For-Review: [SPIKE] how can we support Spark producer/consumers in Event Platform - https://phabricator.wikimedia.org/T374341#10285422 (10xcollazo) [19:58:56] 10Data-Engineering (Q2 2024 October 1st - December 31th), 03Discovery-Search (Current work), 10Dumps 2.0 (Kanban Board), 13Patch-For-Review: [SPIKE] How can we support Spark producer/consumers in Event Platform - https://phabricator.wikimedia.org/T374341#10285414 (10xcollazo) a:03pfischer Folks, I'm tryi... [20:02:50] 10Data-Engineering (Q2 2024 October 1st - December 31th), 03Discovery-Search (Current work), 10Dumps 2.0 (Kanban Board), 13Patch-For-Review: [SPIKE] How can we support Spark producer/consumers in Event Platform - https://phabricator.wikimedia.org/T374341#10285428 (10xcollazo) [20:04:34] 06Data-Engineering, 06Data Products, 06Data-Platform, 06Movement-Insights, and 3 others: Temporary Accounts Initiative (IP Masking) - Add user_is_temporary and user_is_permanent to data tables - https://phabricator.wikimedia.org/T356701#10285440 (10Mayakp.wiki) [20:09:50] 06Data-Engineering, 06Data Products, 06Data-Platform, 06Movement-Insights, and 3 others: Temporary Accounts Initiative (IP Masking) - Add user_is_temporary and user_is_permanent to data tables - https://phabricator.wikimedia.org/T356701#10285447 (10Mayakp.wiki) Updated the title based on recent discussions... [20:15:45] 10Data-Engineering (Q2 2024 October 1st - December 31th), 13Patch-For-Review: [Refine Refactoring] Refine jobs should be scheduled by Airflow: deployment - https://phabricator.wikimedia.org/T369845#10285459 (10Ottomata) > Is there a reason why this can't be added to the default block, like we do for Gobblin?... [22:06:27] 06Data-Engineering, 06Movement-Insights, 10Wmfdata-Python, 10GitLab (Project Migration): Move Wmfdata-Python from Github to Gitlab - https://phabricator.wikimedia.org/T304544#10285712 (10nshahquinn-wmf) I just revised the plan because I had made a mistake about how the update notification works. It generat...