[02:06:42] 10Data-Engineering (Q1 2024 July 1st - September 30th), 06Data Products, 10Metrics Platform Backlog: [MPIC] Analyse risk of potential performance issues with static approach to stream configuration - https://phabricator.wikimedia.org/T366627#10026033 (10Ottomata) [04:24:51] 06Data-Engineering, 06Data Products, 06DBA, 07Schema-change-in-production: Cleanup revision table schema - https://phabricator.wikimedia.org/T367856#10026126 (10Marostegui) [04:27:28] 06Data-Engineering, 06Data Products, 06DBA, 07Schema-change-in-production: Cleanup revision table schema - https://phabricator.wikimedia.org/T367856#10026133 (10Marostegui) [04:27:57] 06Data-Engineering, 06Data Products, 06DBA, 07Schema-change-in-production: Cleanup revision table schema - https://phabricator.wikimedia.org/T367856#10026134 (10Marostegui) [06:40:14] 06Data-Engineering, 06Data Products, 06DBA, 07Schema-change-in-production: Cleanup revision table schema - https://phabricator.wikimedia.org/T367856#10026247 (10Marostegui) [07:23:40] 06Data-Engineering, 06Data Products, 06Data-Persistence, 10GlobalBlocking, and 4 others: Add gb_enable_autoblock and gb_autoblock_parent_id to the globalblocks table - https://phabricator.wikimedia.org/T371268#10026325 (10Marostegui) [09:32:09] 06Data-Engineering, 10CheckUser, 06Data Products, 06DBA, 07Schema-change-in-production: Remove cuc_actiontext, cuc_only_for_read_old, and cuc_private from cu_changes on WMF wikis - https://phabricator.wikimedia.org/T370903#10026681 (10Dreamy_Jazz) > Is this part of a larger initiative? This is cleanup wo... [09:56:39] 14Analytics-Radar, 06Data-Engineering-Icebox, 10Wikidata, 06WMDE-Analytics-Engineering: wmde-toolkit-analyzer-build.service fails on stat1007 - https://phabricator.wikimedia.org/T278665#10026745 (10Manuel) [10:16:11] 06Data-Engineering: Add wikitech (labswiki) to the sqoop list - https://phabricator.wikimedia.org/T217792#10026824 (10jijiki) @Milimetric @JAllemandou Sorry for the driveby comment, can this task be closed? [12:36:42] 06Data-Engineering, 10CheckUser, 06Data Products, 06DBA, 07Schema-change-in-production: Remove cuc_actiontext, cuc_only_for_read_old, and cuc_private from cu_changes on WMF wikis - https://phabricator.wikimedia.org/T370903#10027335 (10Ladsgroup) I'll wait for the sqoop to be over and then start, you'll h... [12:52:18] 10Data-Engineering (Q1 2024 July 1st - September 30th): airflow-dags: Mutualization of _IMPORTED flag sensors creations - https://phabricator.wikimedia.org/T371373 (10Antoine_Quhen) 03NEW [13:50:17] 06Data-Engineering, 06collaboration-services, 10Data Pipelines, 10Data-Platform-SRE (2024.07.08 - 2024.07.28), and 2 others: Upgrade Airflow to 2.9.3 - https://phabricator.wikimedia.org/T365449#10027707 (10Stevemunene) With the tags work around we have been able to release the airflow 2.9.3 upgrade, I don'... [14:08:28] 06Data-Engineering: Add wikitech (labswiki) to the sqoop list - https://phabricator.wikimedia.org/T217792#10027827 (10Milimetric) Oh! Thanks for the reminder, this is now available but not included in the sqoop lists. I'll make a patch, easy enough. `labswiki` seems to be available in both the analytics repli... [14:11:23] 06Data-Engineering, 06collaboration-services, 10Data Pipelines, 10Data-Platform-SRE (2024.07.08 - 2024.07.28), and 2 others: Upgrade Airflow to 2.9.3 - https://phabricator.wikimedia.org/T365449#10027832 (10Stevemunene) The airflow v2.9.3 is ready to be deployed for testing on the `an-test-client1002` [14:13:40] 10Data-Engineering (Q1 2024 July 1st - September 30th), 06Data Products, 10Metrics Platform Backlog: [MPIC] Analyse risk of potential performance issues with static approach to stream configuration - https://phabricator.wikimedia.org/T366627#10027847 (10xcollazo) >>! In T366627#10019310, @Ottomata wrote: >If... [14:18:48] (03PS1) 10Milimetric: Add labswiki (wikitech) to the sqoop list [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1058175 (https://phabricator.wikimedia.org/T217792) [14:28:25] (03CR) 10Ottomata: Refactor Refine to be triggerd by Airflow (031 comment) [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1016808 (https://phabricator.wikimedia.org/T356762) (owner: 10Aqu) [14:28:40] 10Data-Engineering (Q1 2024 July 1st - September 30th), 06Data Products, 10Metrics Platform Backlog: [MPIC] Analyse risk of potential performance issues with static approach to stream configuration - https://phabricator.wikimedia.org/T366627#10027964 (10xcollazo) >>! In T366627#10022878, @Antoine_Quhen wrote... [14:49:29] !log deployed airflow analytics to update the commons category allow list [14:49:31] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [15:44:44] 10Data-Engineering (Q1 2024 July 1st - September 30th), 06Data Products, 10Metrics Platform Backlog: [MPIC] Analyse risk of potential performance issues with static approach to stream configuration - https://phabricator.wikimedia.org/T366627#10028449 (10Ottomata) > I thought the reason we don't partition now... [15:49:15] 10Data-Engineering (Q1 2024 July 1st - September 30th), 06Data Products, 10Metrics Platform Backlog: [MPIC] Analyse risk of potential performance issues with static approach to stream configuration - https://phabricator.wikimedia.org/T366627#10028461 (10Ottomata) But, for this ticket, I'd still like to have... [16:13:42] 10Data-Engineering (Q1 2024 July 1st - September 30th), 06Data Products, 10Metrics Platform Backlog: [MPIC] Analyse risk of potential performance issues with static approach to stream configuration - https://phabricator.wikimedia.org/T366627#10028545 (10mpopov) @Ottomata @xcollazo: I can't review all the dis... [16:33:46] 10Data-Engineering (Q1 2024 July 1st - September 30th), 06Data Products, 10Metrics Platform Backlog: [MPIC] Analyse risk of potential performance issues with static approach to stream configuration - https://phabricator.wikimedia.org/T366627#10028615 (10Ottomata) > partitioning based on experiment info Ya, I... [17:31:06] 10Data-Engineering (Q1 2024 July 1st - September 30th), 10MediaWiki-General, 10Event-Platform, 10MediaWiki-Platform-Team (Radar), 13Patch-For-Review: Create legacy EventLogging proxy HTTP intake (for MediaWikiPingback) endpoint to EventGate - https://phabricator.wikimedia.org/T353817#10028930 (10Ottomata... [17:34:20] 06Data-Engineering, 06Data Products, 06Data-Persistence, 10GlobalBlocking, and 4 others: Add gb_enable_autoblock and gb_autoblock_parent_id to the globalblocks table - https://phabricator.wikimedia.org/T371268#10028940 (10Dreamy_Jazz) 05Open→03Resolved [17:39:00] 06Data-Engineering, 06Data Products, 06DBA, 10GlobalBlocking, and 2 others: Add gb_autoblock_parent_id, gb_autoblock_enabled, and gb_create_account to the globalblocks table - https://phabricator.wikimedia.org/T371415 (10Dreamy_Jazz) 03NEW [18:17:58] 06Data-Engineering, 06Data Products, 06DBA, 10GlobalBlocking, and 2 others: Add gb_autoblock_parent_id, gb_autoblock_enabled, and gb_create_account to the globalblocks table - https://phabricator.wikimedia.org/T371415#10029078 (10Ladsgroup) 05Open→03Resolved p:05Triage→03Medium a:03Ladsgroup [18:21:04] 06Data-Engineering, 06Data Products, 06DBA, 10GlobalBlocking, and 2 others: Add gb_autoblock_parent_id, gb_autoblock_enabled, and gb_create_account to the globalblocks table - https://phabricator.wikimedia.org/T371415#10029096 (10Dreamy_Jazz) [18:21:47] 06Data-Engineering, 06Data Products, 06DBA, 10GlobalBlocking, and 2 others: Add gb_autoblock_parent_id, gb_autoblock_enabled, and gb_create_account to the globalblocks table - https://phabricator.wikimedia.org/T371415#10029098 (10Dreamy_Jazz) [19:30:36] 10Data-Engineering (Q1 2024 July 1st - September 30th), 10MediaWiki-General, 10Event-Platform, 10MediaWiki-Platform-Team (Radar), 13Patch-For-Review: Create legacy EventLogging proxy HTTP intake (for MediaWikiPingback) endpoint to EventGate - https://phabricator.wikimedia.org/T353817#10029516 (10Ottomata... [19:50:52] 06Data-Engineering, 10Event-Platform, 07Wikimedia-production-error: EventBus::send incorrectly assumes that response will always be convertible to an array - https://phabricator.wikimedia.org/T371432#10029656 (10Dreamy_Jazz) Actually this seems to be a problem in the #EventBus extension that was surfaced by... [19:50:53] 06Data-Engineering, 10Event-Platform, 07Wikimedia-production-error: EventBus::send incorrectly assumes that response will always be convertible to an array - https://phabricator.wikimedia.org/T371432#10029659 (10Dreamy_Jazz) [19:51:38] 06Data-Engineering, 10Event-Platform, 07Wikimedia-production-error: EventBus::send incorrectly assumes that JSON response can be converted to an associative array - https://phabricator.wikimedia.org/T371432#10029663 (10Dreamy_Jazz) [20:06:12] 06Data-Engineering, 10WMF-JobQueue, 10Event-Platform, 07Wikimedia-production-error: JobQueueError: Could not enqueue jobs - https://phabricator.wikimedia.org/T371433 (10RAdimer-WMF) 03NEW [20:34:08] 10Data-Engineering (Q1 2024 July 1st - September 30th), 10MediaWiki-General, 10Event-Platform, 10MediaWiki-Platform-Team (Radar), 13Patch-For-Review: Create legacy EventLogging proxy HTTP intake (for MediaWikiPingback) endpoint to EventGate - https://phabricator.wikimedia.org/T353817#10029834 (10Ottomata... [21:18:07] 06Data-Engineering, 10Data-Platform-SRE (2024.07.08 - 2024.07.28): Design a suitable DAG deployment method - https://phabricator.wikimedia.org/T368033#10030004 (10bking) Thanks @hashar and @Ottomata for following up. Based on this exchange [[ https://docs.google.com/document/d/1gytt1rzO5wO1IWmmrGKdfuwSlVvFyQ9... [21:55:22] 10Data-Engineering (Q1 2024 July 1st - September 30th), 06Data Products, 10Metrics Platform Backlog: [MPIC] Analyse risk of potential performance issues with static approach to stream configuration - https://phabricator.wikimedia.org/T366627#10030135 (10VirginiaPoundstone) What do you think about these laten... [23:24:12] 10Data-Engineering (Q1 2024 July 1st - September 30th), 06Data Products, 10Metrics Platform Backlog: [MPIC] Analyse risk of potential performance issues with static approach to stream configuration - https://phabricator.wikimedia.org/T366627#10030263 (10nettrom_WMF) >>! In T366627#10030134, @VirginiaPoundsto... [23:57:28] 06Data-Engineering, 06Data Products, 10Pageviews-API: Missed pageview data over API - https://phabricator.wikimedia.org/T370108#10030298 (10Mayakp.wiki) Hi @VirginiaPoundstone , not aware of any other edge cases. I spot checked a few pages from the [[ https://drive.google.com/file/d/1tbpc8fp-p47v4QNy_lBYrmbv...