[11:04:52] !log rebooting an-mariadb1001 for T376800 [11:04:55] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [11:38:37] 06Data-Engineering: NEW BUG REPORT: The latest wikidata entity dump (latest-all.ttl.bz2) contains each triple twice - https://phabricator.wikimedia.org/T389787 (10BTullis) 03NEW [11:45:01] 06Data-Engineering, 06Data-Engineering-Radar, 10ConfirmEdit (CAPTCHA extension), 10MediaWiki-extensions-EventLogging, and 2 others: Send hCaptcha API response data to event platform - https://phabricator.wikimedia.org/T379179#10667448 (10kostajh) a:03Reedy [12:51:01] (03CR) 10Milimetric: 1.Add a closed flag to the project namespace map dataset 2. Add a whether to sqoop flag by checking if wikidb exists in cloud replica. (031 comment) [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1125184 (https://phabricator.wikimedia.org/T241741) (owner: 10Milimetric) [12:58:49] (03PS1) 10Joal: Update webrequest_frontend validation [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1130589 [13:03:33] (03CR) 10Joal: [V:03+2 C:03+2] "Merging for later deploy" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1129900 (https://phabricator.wikimedia.org/T388397) (owner: 10Joal) [13:09:07] (03CR) 10Aqu: [C:03+1] "It looks good. Please attach a ticket." [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1130589 (owner: 10Joal) [13:14:44] (03PS2) 10Joal: Update webrequest_frontend validation [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1130589 [13:35:52] 10Data-Engineering (Q3 2025 January 1st - March 31th), 10DPE HAProxy Migration: Update webrequest_frontend validation jobs to use `` instead of invalid dt - https://phabricator.wikimedia.org/T389797 (10JAllemandou) 03NEW [13:38:31] (03PS3) 10Joal: Update webrequest_frontend validation [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1130589 (https://phabricator.wikimedia.org/T389797) [13:47:35] 06Data-Engineering: Update Commons Impact Metrics to account for new File table - https://phabricator.wikimedia.org/T389800 (10Milimetric) 03NEW [13:56:11] (03CR) 10Milimetric: 1.Add a closed flag to the project namespace map dataset 2. Add a whether to sqoop flag by checking if wikidb exists in cloud replica. (031 comment) [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1125184 (https://phabricator.wikimedia.org/T241741) (owner: 10Milimetric) [14:31:55] (03CR) 10Joal: [V:03+2 C:03+2] "Merging for deploy" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1130589 (https://phabricator.wikimedia.org/T389797) (owner: 10Joal) [14:45:57] (03CR) 10Joal: [C:03+2] "Merging for later deploy" [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1128801 (https://phabricator.wikimedia.org/T354694) (owner: 10Aqu) [14:46:39] 06Data-Engineering, 06Data-Engineering-Radar, 06Data-Platform-SRE, 10DPE-Mediawiki-Content: Test if an existing conda environment with Spark 3.1.2 clients works fine with Spark 3.5.3 - https://phabricator.wikimedia.org/T380417#10668564 (10BTullis) Moving back to the longer-term backlog, since we are not ye... [14:49:43] 06Data-Engineering, 06Data-Platform-SRE, 10DPE-Mediawiki-Content, 13Patch-For-Review: Upgrade Spark to a version with long term Iceberg support, and with fixes to support Dumps 2.0 - https://phabricator.wikimedia.org/T338057#10668580 (10BTullis) a:05BTullis→03None Unassigning myself for now, since this... [14:53:26] !log Refinery deployed (scap+hdfs) [14:53:28] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [15:00:17] (03Merged) 10jenkins-bot: Refine webrequest - uri_host with trailing dot [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1128801 (https://phabricator.wikimedia.org/T354694) (owner: 10Aqu) [15:14:25] 10Data-Engineering (Q3 2025 January 1st - March 31th): Some search entries in wmf.webrequest have their query appended to their uri_path - https://phabricator.wikimedia.org/T383135#10668829 (10JAllemandou) Ping @Fabfur On this :) [15:21:02] 06Data-Engineering, 06Data-Engineering-Radar, 10ConfirmEdit (CAPTCHA extension), 10MediaWiki-extensions-Campaigns, and 3 others: Send hCaptcha API response data to event platform - https://phabricator.wikimedia.org/T379179#10668878 (10Reedy) [15:39:54] (03PS1) 10Joal: Add needed HQL file to webrequest_frontend [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1130641 (https://phabricator.wikimedia.org/T389797) [15:40:22] (03CR) 10Joal: [V:03+2 C:03+2] "Self merging hotfix" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1130641 (https://phabricator.wikimedia.org/T389797) (owner: 10Joal) [16:50:52] 06Data-Engineering, 06Data-Engineering-Radar, 10CirrusSearch, 10Structured Data Engineering, and 3 others: Migrate image recommendation to use page_weighted_tags_changed stream - https://phabricator.wikimedia.org/T372912#10669747 (10Gehel) [16:51:08] 06Data-Engineering, 06Java-Scala-Standardization, 10Discovery-Search (2025.03.22 - 2025.04.11): Create Gitlab CI templates for JVM packages - https://phabricator.wikimedia.org/T386406#10669751 (10Gehel) [16:54:36] 06Data-Engineering, 06Data-Platform-SRE, 06Java-Scala-Standardization, 10Discovery-Search (2025.03.22 - 2025.04.11): Migrate existing Java packages to deploying to Gitlab, including new version of parent pom, validation that all dependencies are available,... - https://phabricator.wikimedia.org/T367405#10669827 [17:22:37] 06Data-Engineering, 10MediaWiki-extensions-Campaigns, 10Event-Platform, 07Technical-Debt: ServerSideAccountCreation violates Identifier Naming Rules? - https://phabricator.wikimedia.org/T389822#10670063 (10Ottomata) This is a legacy schema, migrated from the older eventlogging system. From https://gitlab.... [17:24:35] 06Data-Engineering, 10MediaWiki-extensions-Campaigns, 10Event-Platform, 07Technical-Debt: ServerSideAccountCreation violates Identifier Naming Rules? - https://phabricator.wikimedia.org/T389822#10670082 (10Reedy) [17:25:15] 06Data-Engineering, 10MediaWiki-extensions-Campaigns, 10Event-Platform, 07Technical-Debt: ServerSideAccountCreation violates Identifier Naming Rules? - https://phabricator.wikimedia.org/T389822#10670084 (10Reedy) So... Do we care? Should new fields (going forward) be named to meet the new rules, rather th... [17:27:59] 06Data-Engineering, 10MediaWiki-extensions-Campaigns, 10Event-Platform, 07Technical-Debt: ServerSideAccountCreation violates Identifier Naming Rules? - https://phabricator.wikimedia.org/T389822#10670119 (10Ottomata) New fields should use the new rules. Or... you could make a brand new [[ https://wikitec... [17:30:00] 06Data-Engineering, 10MediaWiki-extensions-Campaigns, 10Event-Platform, 07Technical-Debt: ServerSideAccountCreation violates Identifier Naming Rules? - https://phabricator.wikimedia.org/T389822#10670138 (10Reedy) >>! In T389822#10670119, @Ottomata wrote: > New fields should use the new rules. So https://g... [17:32:13] 06Data-Engineering, 10MediaWiki-extensions-Campaigns, 10Event-Platform, 07Technical-Debt: ServerSideAccountCreation violates Identifier Naming Rules? - https://phabricator.wikimedia.org/T389822#10670150 (10Ottomata) > broke those rules ;) I suppose it did! But the legacy schemas are bit exempt from the r... [17:43:02] 10Data-Engineering (Q3 2025 January 1st - March 31th): NEW BUG REPORT: The latest wikidata entity dump (latest-all.ttl.bz2) contains each triple twice - https://phabricator.wikimedia.org/T389787#10670217 (10Ahoelzl) [17:48:27] 10Data-Engineering (Q3 2025 January 1st - March 31th), 06Experimentation Lab: NEW/CHANGE FEATURE REQUEST: Documentation for v1 Enterprise endpoint deprecation - https://phabricator.wikimedia.org/T389542#10670241 (10Ottomata) ^ <3 thank you! [19:10:15] 06Data-Engineering, 10MediaWiki-extensions-Campaigns, 10Event-Platform, 07Technical-Debt: ServerSideAccountCreation violates Identifier Naming Rules? - https://phabricator.wikimedia.org/T389822#10670924 (10Reedy) p:05Triage→03Low [20:09:48] 10Data-Engineering (Q3 2025 January 1st - March 31th), 10Wikidata: NEW BUG REPORT: The latest wikidata entity dump (latest-all.ttl.bz2) contains each triple twice - https://phabricator.wikimedia.org/T389787#10671240 (10Lydia_Pintscher) [20:32:44] 10Data-Engineering (Q3 2025 January 1st - March 31th): Assess data platform implications for RFC domain unification - https://phabricator.wikimedia.org/T389696#10671340 (10Ahoelzl) a:03mforns [21:18:19] 10Data-Engineering (Q3 2025 January 1st - March 31th), 10Wikidata: NEW BUG REPORT: The latest wikidata entity dump (latest-all.ttl.bz2) contains each triple twice - https://phabricator.wikimedia.org/T389787#10671508 (10Ahoelzl) For the moment, can we just wait on the next entity dump and check that the issue r... [21:25:11] 06Data-Engineering, 10Event-Platform: Bug: jsonschema-tools generates non deterministic examples for date format fields - https://phabricator.wikimedia.org/T389881 (10Ottomata) 03NEW [21:34:49] 06Data-Engineering, 10Event-Platform: Bug: jsonschema-tools generates non deterministic examples for date format fields - https://phabricator.wikimedia.org/T389881#10671607 (10Ottomata) [21:41:26] 06Data-Engineering, 10Event-Platform, 13Patch-For-Review: Bug: jsonschema-tools generates non deterministic examples for date format fields - https://phabricator.wikimedia.org/T389881#10671621 (10Ottomata) Patch up for review. I will not have time to write an extensive unit test for this. I did test that... [22:43:36] 10Data-Engineering (Q3 2025 January 1st - March 31th), 10Wikidata: NEW BUG REPORT: The latest wikidata entity dump (latest-all.ttl.bz2) contains each triple twice - https://phabricator.wikimedia.org/T389787#10671828 (10Hannah_Bast) I agree and will check as soon as the new dump is there!