[01:43:36] 06Data-Engineering: MaxMind seems to be mapping the same IP to different countries - https://phabricator.wikimedia.org/T366369#9853198 (10OKJ04) [01:50:50] 06Data-Engineering: MaxMind seems to be mapping the same IP to different countries - https://phabricator.wikimedia.org/T366369#9853300 (10JJMC89) [07:09:06] 06Data-Engineering, 13Patch-For-Review: ISPDatabaseReader null pointer exception - https://phabricator.wikimedia.org/T365197#9853563 (10JAllemandou) Task description updated with latest stack trace. [09:25:18] 06Data-Engineering, 10Data Pipelines, 10Datasets-General-or-Unknown, 06Wikimedia Enterprise: Missing NS0 dumps in 20230420 and 20230501 and 20230520 - https://phabricator.wikimedia.org/T335887#9853998 (10awight) Unfortunately, this bug is about 2023 dumps and the files are long-since deleted. Task should... [09:44:09] 06Data-Engineering, 10Dumps-Generation, 06SRE, 10Data-Platform-SRE (2024.05.27 - 2024.06.16), 13Patch-For-Review: Migrate Dumps Snapshot hosts from Buster to Bullseye - https://phabricator.wikimedia.org/T325228#9854057 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage was started by btullis@cum... [09:44:24] !log reimagaing snapshot1013 to bullseye for T325228 [09:44:28] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [09:44:28] T325228: Migrate Dumps Snapshot hosts from Buster to Bullseye - https://phabricator.wikimedia.org/T325228 [10:29:27] 06Data-Engineering, 10Dumps-Generation, 06SRE, 10Data-Platform-SRE (2024.05.27 - 2024.06.16), 13Patch-For-Review: Migrate Dumps Snapshot hosts from Buster to Bullseye - https://phabricator.wikimedia.org/T325228#9854241 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage started by btullis@cumin10... [10:45:18] 06Data-Engineering, 10Dumps-Generation, 06SRE, 10Data-Platform-SRE (2024.05.27 - 2024.06.16), 13Patch-For-Review: Migrate Dumps Snapshot hosts from Buster to Bullseye - https://phabricator.wikimedia.org/T325228#9854288 (10BTullis) [13:46:25] 06Data-Engineering, 10Dumps-Generation, 06SRE, 10Data-Platform-SRE (2024.05.27 - 2024.06.16), 13Patch-For-Review: Migrate Dumps Snapshot hosts from Buster to Bullseye - https://phabricator.wikimedia.org/T325228#9854843 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage was started by btullis@cum... [13:47:06] 06Data-Engineering, 10Dumps-Generation, 06SRE, 10Data-Platform-SRE (2024.05.27 - 2024.06.16), 13Patch-For-Review: Migrate Dumps Snapshot hosts from Buster to Bullseye - https://phabricator.wikimedia.org/T325228#9854847 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage was started by btullis@cum... [14:19:17] 06Data-Engineering, 06Discovery-Search, 10Dumps-Generation, 10Data-Platform-SRE (2024.05.27 - 2024.06.16), 13Patch-For-Review: Some dumps are not available since mid may 2024 - https://phabricator.wikimedia.org/T366043#9855010 (10BTullis) I had to kill three running wikibase dumps on snapshot1017 * `com... [14:28:44] 06Data-Engineering, 10Dumps-Generation, 06SRE, 10Data-Platform-SRE (2024.05.27 - 2024.06.16), 13Patch-For-Review: Migrate Dumps Snapshot hosts from Buster to Bullseye - https://phabricator.wikimedia.org/T325228#9855048 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage started by btullis@cumin10... [14:32:02] 06Data-Engineering, 10Dumps-Generation, 06SRE, 10Data-Platform-SRE (2024.05.27 - 2024.06.16): Migrate Dumps Snapshot hosts from Buster to Bullseye - https://phabricator.wikimedia.org/T325228#9855072 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage started by btullis@cumin1002 for host snapshot10... [14:40:47] 10Data-Engineering (Q4 2024 April 1st - June 30th): [Datasets Config][Spike] Understand and document the details and conflicts between Datasets Config, Refine refactor, Dynamic EventStreamConfig, and Metrics Platform Instrumentation Configurator - https://phabricator.wikimedia.org/T361853#9855111 (10phuedx) >>!... [14:47:38] 06Data-Engineering, 10Dumps-Generation, 06SRE, 10Data-Platform-SRE (2024.05.27 - 2024.06.16): Migrate Dumps Snapshot hosts from Buster to Bullseye - https://phabricator.wikimedia.org/T325228#9855143 (10BTullis) [14:48:32] 06Data-Engineering, 10Dumps-Generation, 06SRE, 10Data-Platform-SRE (2024.05.27 - 2024.06.16): Migrate Dumps Snapshot hosts from Buster to Bullseye - https://phabricator.wikimedia.org/T325228#9855144 (10BTullis) 05Openā†’03Resolved [14:59:22] 10Data-Engineering (Q4 2024 April 1st - June 30th), 10Event-Platform, 10GitLab (Pipeline Services MigrationšŸ¤), 13Patch-For-Review: Migrate Data Engineering Pipelinelib repos to GitLab - https://phabricator.wikimedia.org/T344730#9855241 (10tchin) >>! In T344730#9848618, @Ottomata wrote: > Added jsonschema-t... [15:04:01] 06Data-Engineering, 06Content-Transform-Team-WIP, 10MediaWiki-extensions-Linter, 10Parsoid-Read-Views, and 3 others: Commons page fatals when accessed in parsoid read views mode - https://phabricator.wikimedia.org/T364229#9855267 (10MSantos) [15:08:23] 06Data-Engineering, 06Discovery-Search, 10Dumps-Generation, 10Data-Platform-SRE (2024.05.27 - 2024.06.16): Some dumps are not available since mid may 2024 - https://phabricator.wikimedia.org/T366043#9855306 (10BTullis) I briefly attempted to sync the relevant contents of `/data/xmldatadumps/temp` from dump... [15:28:50] 06Data-Engineering, 06Discovery-Search, 10Dumps-Generation, 10Data-Platform-SRE (2024.05.27 - 2024.06.16): Some dumps are not available since mid may 2024 - https://phabricator.wikimedia.org/T366043#9855371 (10BTullis) 05Openā†’03Resolved I believe that this is now resolved, but please do let me know... [15:34:59] 06Data-Engineering, 13Patch-Needs-Improvement: Event Platform schemas should not support type changes to structs as array element or map value types - https://phabricator.wikimedia.org/T366487 (10Ottomata) 03NEW [15:35:08] 06Data-Engineering, 10Event-Platform: Event Platform schemas should not support type changes to structs as array element or map value types - https://phabricator.wikimedia.org/T366487#9855431 (10Ottomata) [15:39:54] 10Data-Engineering (Q4 2024 April 1st - June 30th), 10Event-Platform, 10GitLab (Pipeline Services MigrationšŸ¤), 13Patch-For-Review: Migrate Data Engineering Pipelinelib repos to GitLab - https://phabricator.wikimedia.org/T344730#9855455 (10Ottomata) > Should I merge and deploy this MR before it gets migrate... [16:06:02] 10Data-Engineering (Q4 2024 April 1st - June 30th): [Datasets Config][Spike] Understand and document the details and conflicts between Datasets Config, Refine refactor, Dynamic EventStreamConfig, and Metrics Platform Instrumentation Configurator - https://phabricator.wikimedia.org/T361853#9855592 (10phuedx) Neat... [16:09:23] 06Data-Engineering, 10Data-Engineering-Dashiki, 10Data Products (Data Products Sprint 14): Update Dashiki Cloud Instances - https://phabricator.wikimedia.org/T360914#9855607 (10WDoranWMF) [16:52:23] 06Data-Engineering, 10Data Products (Data Products Sprint 14), 10Web-Team-Backlog (FY2023-24 Q4 Sprint 5): Follow-Up Ticket for QA: Validate Sample Rate Adjustments - https://phabricator.wikimedia.org/T365489#9855897 (10KSarabia-WMF) a:03KSarabia-WMF [17:09:15] 10Data-Engineering (Q4 2024 April 1st - June 30th): [Datasets Config][Spike] Understand and document the details and conflicts between Datasets Config, Refine refactor, Dynamic EventStreamConfig, and Metrics Platform Instrumentation Configurator - https://phabricator.wikimedia.org/T361853#9855992 (10Ottomata) Oh... [17:32:00] 06Data-Engineering, 10CirrusSearch, 03Discovery-Search (Current work): [Search Update Pipeline] Source streams for private wikis - https://phabricator.wikimedia.org/T346046#9856120 (10Ottomata) @gmodena @lbowmaker @tchin @Ahoelzl Let's discuss as a team what we want to do here. As stated above, a few code a... [20:20:38] 06Data-Engineering, 10[DEPRECATED] wdwb-tech, 10Citoid, 06Content-Transform-Team-WIP, and 10 others: Migrate node-based services in production to node18 - https://phabricator.wikimedia.org/T349118#9857004 (10Ottomata) [20:20:44] 06Data-Engineering, 10[DEPRECATED] wdwb-tech, 10Citoid, 06Content-Transform-Team-WIP, and 10 others: Migrate node-based services in production to node18 - https://phabricator.wikimedia.org/T349118#9857005 (10Ottomata) [20:23:51] 06Data-Engineering, 10Data Products (Data Products Sprint 14), 10Web-Team-Backlog (FY2023-24 Q4 Sprint 5): Follow-Up Ticket for QA: Validate Sample Rate Adjustments - https://phabricator.wikimedia.org/T365489#9857018 (10KSarabia-WMF) ### Report on SQL Query Analysis and Sampling Rate Fix #### Summary of Con... [20:28:34] 06Data-Engineering, 10Data Products (Data Products Sprint 14), 10Web-Team-Backlog (FY2023-24 Q4 Sprint 5): Follow-Up Ticket for QA: Validate Sample Rate Adjustments - https://phabricator.wikimedia.org/T365489#9857022 (10KSarabia-WMF) [20:29:20] 06Data-Engineering, 10Data Products (Data Products Sprint 14), 10Web-Team-Backlog (FY2023-24 Q4 Sprint 5): Follow-Up Ticket for QA: Validate Sample Rate Adjustments - https://phabricator.wikimedia.org/T365489#9857026 (10KSarabia-WMF) a:05KSarabia-WMFā†’03None [20:30:51] 10Data-Engineering (Q4 2024 April 1st - June 30th), 10Event-Platform, 10GitLab (Pipeline Services MigrationšŸ¤), 13Patch-For-Review: Migrate Data Engineering Pipelinelib repos to GitLab - https://phabricator.wikimedia.org/T344730#9857030 (10Ottomata) [20:55:50] 06Data-Engineering: Create gitlab ci npm publish pipeline and job in workflow_utils gitlab_ci_templates - https://phabricator.wikimedia.org/T366537 (10Ottomata) 03NEW