[00:28:07] 06Data-Engineering-Radar, 10CheckUser, 06DBA, 06Trust and Safety Product Team, 07Schema-change-in-production: Add '*_actor_ip_hex_time' indexes to 'cu_changes', 'cu_log_event', and 'cu_private_event' on WMF wikis - https://phabricator.wikimedia.org/T399728#11117476 (10Ladsgroup) [00:36:08] 06Data-Engineering-Radar, 10CheckUser, 06DBA, 06Trust and Safety Product Team, 07Schema-change-in-production: Add '*_actor_ip_hex_time' indexes to 'cu_changes', 'cu_log_event', and 'cu_private_event' on WMF wikis - https://phabricator.wikimedia.org/T399728#11117492 (10Ladsgroup) [00:44:19] 06Data-Engineering-Radar, 10CheckUser, 06DBA, 06Trust and Safety Product Team, 07Schema-change-in-production: Add '*_actor_ip_hex_time' indexes to 'cu_changes', 'cu_log_event', and 'cu_private_event' on WMF wikis - https://phabricator.wikimedia.org/T399728#11117497 (10Ladsgroup) [00:48:15] 06Data-Engineering-Radar, 10CheckUser, 06DBA, 06Trust and Safety Product Team, 07Schema-change-in-production: Add '*_actor_ip_hex_time' indexes to 'cu_changes', 'cu_log_event', and 'cu_private_event' on WMF wikis - https://phabricator.wikimedia.org/T399728#11117500 (10Ladsgroup) [00:50:48] 06Data-Engineering-Radar, 10CheckUser, 06DBA, 06Trust and Safety Product Team, 07Schema-change-in-production: Add '*_actor_ip_hex_time' indexes to 'cu_changes', 'cu_log_event', and 'cu_private_event' on WMF wikis - https://phabricator.wikimedia.org/T399728#11117503 (10Ladsgroup) [00:51:52] 06Data-Engineering-Radar, 10CheckUser, 06DBA, 06Trust and Safety Product Team, 07Schema-change-in-production: Add '*_actor_ip_hex_time' indexes to 'cu_changes', 'cu_log_event', and 'cu_private_event' on WMF wikis - https://phabricator.wikimedia.org/T399728#11117506 (10Ladsgroup) Done in all masters since... [00:54:28] 06Data-Engineering, 06Data-Engineering-Radar, 06DBA, 07Schema-change-in-production: Drop afl_patrolled_by from abuse_filter_log in production - https://phabricator.wikimedia.org/T391056#11117508 (10Ladsgroup) [00:58:25] 06Data-Engineering, 06Data-Engineering-Radar, 06DBA, 07Schema-change-in-production: Drop afl_patrolled_by from abuse_filter_log in production - https://phabricator.wikimedia.org/T391056#11117509 (10Ladsgroup) [01:09:22] 06Data-Engineering, 06DBA, 07Schema-change-in-production: Add cl_timestamp_id index to categorylinks table - https://phabricator.wikimedia.org/T399249#11117535 (10Ladsgroup) Running on the old master of s4, gonna take a while. Downtimed for 16 hours just in case. [10:38:25] 06Data-Engineering, 06DBA, 07Schema-change-in-production: Add cl_timestamp_id index to categorylinks table - https://phabricator.wikimedia.org/T399249#11118475 (10Ladsgroup) [12:55:07] (03PS1) 10Zabe: Replace rc_new with rc_source [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/1182134 (https://phabricator.wikimedia.org/T36320) [13:01:03] (03CR) 10Lucas Werkmeister (WMDE): [C:03+2] "Seems to be an equivalent condition indeed:" [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/1182134 (https://phabricator.wikimedia.org/T36320) (owner: 10Zabe) [13:01:33] (03Merged) 10jenkins-bot: Replace rc_new with rc_source [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/1182134 (https://phabricator.wikimedia.org/T36320) (owner: 10Zabe) [13:02:27] !log restart analytics druid jvm to pick up the newly decommissioned hosts and broken links T402814 [13:02:30] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [13:02:30] T402814: decommission an-druid100[1-2] - https://phabricator.wikimedia.org/T402814 [13:06:29] (03PS1) 10Lucas Werkmeister (WMDE): Replace rc_new with rc_source [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/1182137 (https://phabricator.wikimedia.org/T36320) [13:06:53] (03CR) 10Lucas Werkmeister (WMDE): [C:03+2] Replace rc_new with rc_source [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/1182137 (https://phabricator.wikimedia.org/T36320) (owner: 10Lucas Werkmeister (WMDE)) [13:07:19] (03Merged) 10jenkins-bot: Replace rc_new with rc_source [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/1182137 (https://phabricator.wikimedia.org/T36320) (owner: 10Lucas Werkmeister (WMDE)) [13:09:37] 06Data-Engineering, 10Event-Platform, 13Patch-For-Review: CI in schemas-event-secondary fails because the tests do not follow WMF's Robot policy - https://phabricator.wikimedia.org/T402801#11119029 (10tchin) a:03tchin [13:40:17] 06Data-Engineering, 06DBA, 07Schema-change-in-production: Drop cl_to and cl_collation from categorylinks in wmf production - https://phabricator.wikimedia.org/T402925 (10Zabe) 03NEW [13:46:49] 06Data-Engineering, 06DBA, 07Schema-change-in-production: Drop cl_to and cl_collation from categorylinks in wmf production - https://phabricator.wikimedia.org/T402925#11119208 (10Ladsgroup) p:05Triage→03High a:03Ladsgroup Oh this is my precious. Noone dare to touch this ticket. [15:17:37] 06Data-Engineering, 06cloud-services-team, 06Data-Persistence, 10Data-Services, 13Patch-For-Review: [wikireplicas] Remove rc_new from recentchanges view definitions - https://phabricator.wikimedia.org/T402787#11119601 (10fnegri) p:05Triage→03Medium [15:20:10] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th): Data for display orientation in mobile views of Wikimedia projects - https://phabricator.wikimedia.org/T400963#11119606 (10FocalPoint) Excellent approach dear GGoncalves-WMF! Your first estimate is 80% portrait and your second estimate is 99,4% of mobil... [15:23:57] 06Data-Engineering, 06Traffic, 13Patch-For-Review: Reduce noise from duplicate sequence-gap alerts on HaProxy-webrequests - https://phabricator.wikimedia.org/T401383#11119641 (10Vgutierrez) 05Open→03Resolved a:03Vgutierrez I'm closing this since we've fixed the wrong behavior on HAProxy regarding s... [15:50:44] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th), 06Data-Platform-SRE, 10Event-Platform: Flink images should be build on top of openjdk - https://phabricator.wikimedia.org/T400296#11119923 (10Ottomata) > Alternatively, we could replace the hard-coded wmfdebug container in our flink-app chart with so... [15:56:04] 06Data-Engineering, 10Data Pipelines: Provide an easy way for MediaWiki to fetch aggregate statistics from the data lake - https://phabricator.wikimedia.org/T341649#11119964 (10Ottomata) [15:56:05] 06Data-Engineering, 06Traffic: Export development_network_probe data to Puppet servers for CDN deployment - https://phabricator.wikimedia.org/T402512#11119965 (10Ottomata) [15:56:18] 06Data-Engineering, 10Data Pipelines: Provide an easy way for MediaWiki to fetch aggregate data from the data lake - https://phabricator.wikimedia.org/T341649#11119966 (10Ottomata) [15:59:09] 06Data-Engineering, 06Traffic: Export development_network_probe data to Puppet servers for CDN deployment - https://phabricator.wikimedia.org/T402512#11119987 (10Ottomata) Another option that people do, but not one I would recommend: - use the https://wikitech.wikimedia.org/wiki/Data_Platform/Web_publication... [16:07:44] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th), 13Patch-For-Review: Improve handling of new stream onboarding in Refine - https://phabricator.wikimedia.org/T402186#11120050 (10Ottomata) > Refine then "senses" for data for 2 consecutive hours. Ah, I see. Hm. Is there a way to vary the sensor? If t... [16:56:22] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th): Data for display orientation in mobile views of Wikimedia projects - https://phabricator.wikimedia.org/T400963#11120359 (10GGoncalves-WMF) 05Open→03Resolved You're welcome, happy to help! [16:58:45] 06Data-Engineering, 06Traffic: Request for a new request dataset for caching research - https://phabricator.wikimedia.org/T401331#11120372 (10ssingh) Thanks for creating this task and the request. We will be discussing it shortly within Traffic and Data Engineering and we will follow up. [17:32:50] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th): Clean up airflow-dags gitlab-ci.yaml CI/CD pipelines - https://phabricator.wikimedia.org/T400283#11120523 (10amastilovic) [18:35:54] 06Data-Engineering: Dumps Analysis Follow-up - https://phabricator.wikimedia.org/T402963 (10HCoplin-WMF) 03NEW [18:44:04] 06Data-Engineering: Dumps Analysis Follow-up - https://phabricator.wikimedia.org/T402963#11120918 (10HCoplin-WMF) [20:21:17] 06Data-Engineering, 10Datasets-General-or-Unknown: all links on dumps "Wikimedia DVD Downloads" page are broken - https://phabricator.wikimedia.org/T402976 (10Dzahn) 03NEW [23:03:01] 06Data-Engineering, 06DBA, 13Patch-For-Review, 07Schema-change-in-production: Drop cl_to and cl_collation from categorylinks in wmf production - https://phabricator.wikimedia.org/T402925#11121817 (10Ladsgroup) [23:12:44] 06Data-Engineering, 06Data-Engineering-Radar, 10Wmfdata-Python: Convert existing Wmfdata docstrings to a standard format - https://phabricator.wikimedia.org/T380742#11121851 (10nshahquinn-wmf) [23:12:56] 06Data-Engineering, 06Data-Engineering-Icebox, 10Wmfdata-Python, 07Documentation: Publish HTML docs for Wmfdata-Python on doc.wikimedia.org - https://phabricator.wikimedia.org/T298178#11121852 (10nshahquinn-wmf) [23:36:25] 06Data-Engineering, 10CampaignEvents, 06DBA, 10Connection-Team (Connection-Current-Sprint), and 3 others: Update DB schema to store whether contribution tracking is enabled for a given event - https://phabricator.wikimedia.org/T402816#11121924 (10Ladsgroup) Has DBA sign off. It's straightforward.