[09:16:47] joal: any objection to me doing a new release of that parent pom? [11:18:04] 10Data-Engineering (Sprint 9), 10Patch-For-Review: [Maintenance] Migrate ReportUpdater browser queries to Airflow - https://phabricator.wikimedia.org/T354552#9558453 (10CodeReviewBot) ebysans merged https://gitlab.wikimedia.org/repos/data-engineering/airflow-dags/-/merge_requests/615 Add dag for browser All S... [11:19:55] 10Data-Platform-SRE ( 2024.02.12 - 2024.03.03), 10Patch-For-Review: Serve Superset static assets from an optimised container - https://phabricator.wikimedia.org/T357890#9558456 (10CodeReviewBot) btullis opened https://gitlab.wikimedia.org/repos/data-engineering/superset/-/merge_requests/28 Correct the names o... [11:29:44] 10Data-Platform-SRE ( 2024.02.12 - 2024.03.03), 10Patch-For-Review: Serve Superset static assets from an optimised container - https://phabricator.wikimedia.org/T357890#9558484 (10CodeReviewBot) btullis merged https://gitlab.wikimedia.org/repos/data-engineering/superset/-/merge_requests/28 Correct the names o... [12:08:35] Hi gehel - no problem for me - please go ahead and release! [12:17:08] (03CR) 10Nikerabbit: "I think the best course of action would be to set suitable export threshold on translatewiki.net side, and then drop the threshold here, b" [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/921329 (https://phabricator.wikimedia.org/T336752) (owner: 10Nik Gkountas) [12:39:13] (03PS11) 10Joal: [WIP] Extract RefineSingleApp code from Refine [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1003745 (https://phabricator.wikimedia.org/T356363) [13:07:11] (03PS12) 10Joal: Extract RefineSingleApp code from Refine [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1003745 (https://phabricator.wikimedia.org/T356363) [13:07:38] 10Data-Engineering, 10MediaWiki-extensions-EventLogging, 10Metrics Platform Backlog, 10Data Products (Data Products Sprint 09), 10Technical-Debt: Fix public documentation for mw.eventLog.submit() and dispatch() - https://phabricator.wikimedia.org/T357003#9558798 (10phuedx) [13:07:42] 10Data-Engineering, 10MediaWiki-extensions-EventLogging, 10Patch-For-Review: Migrate EventLogging to JSDoc - https://phabricator.wikimedia.org/T357444#9558799 (10phuedx) [13:48:17] (03CR) 10Snwachukwu: [V: 03+2 C: 03+2] Add Reportupdater Browser All Sites Queries. [analytics/refinery] - 10https://gerrit.wikimedia.org/r/995740 (https://phabricator.wikimedia.org/T354552) (owner: 10Snwachukwu) [13:49:14] (03CR) 10Snwachukwu: [V: 03+2 C: 03+2] Add Reportupdater Browser All Sites Queries. (031 comment) [analytics/refinery] - 10https://gerrit.wikimedia.org/r/995740 (https://phabricator.wikimedia.org/T354552) (owner: 10Snwachukwu) [15:49:45] 10Data-Engineering, 10Data-Platform, 10MediaWiki-extensions-EventLogging, 10Metrics Platform Backlog, 10Epic: Deprecate and remove MetricsClient#dispatch() - https://phabricator.wikimedia.org/T352969#9559779 (10WDoranWMF) [15:50:24] 10Data-Engineering, 10Data-Engineering-Wikistats, 10Data Products (Data Products Sprint 07): Incorrect number of content pages on stats.wikimedia.org - https://phabricator.wikimedia.org/T354489#9559788 (10WDoranWMF) 05Open→03Resolved [15:50:32] 10Analytics, 10Data-Engineering, 10Data-Engineering-Wikistats, 10Data Products (Data Products Sprint 07): Wikistats - incorrect number of content articles for Latvian Wikipedia - https://phabricator.wikimedia.org/T354074#9559792 (10WDoranWMF) 05Open→03Resolved [15:50:34] 10Data-Engineering, 10MediaWiki-extensions-EventLogging, 10Metrics Platform Backlog, 10Data Products (Data Products Sprint 07), and 3 others: EventLoggingTest::testDispatch fails when time ticks within the test run - https://phabricator.wikimedia.org/T353243#9559794 (10WDoranWMF) 05Open→03Resolved [15:50:58] 10Data-Engineering, 10MediaWiki-extensions-EventLogging, 10Metrics Platform Backlog, 10Data Products (Data Products Sprint 08), 10Patch-For-Review: Add and export MetricsClient#isStreamInSample() - https://phabricator.wikimedia.org/T352966#9559803 (10WDoranWMF) 05Open→03Resolved [15:57:11] !log deployed latest Airflow DAG updates for the analytics instance [15:57:13] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [16:30:29] 10Data-Engineering, 10Metrics Platform Backlog, 10Data Products (Data Products Sprint 09), 10Spike: [SPIKE] Remove mentions of MetricsClient#dispatch() and the monoschema from documentation - https://phabricator.wikimedia.org/T355046#9560168 (10phuedx) I used the Global Search tool https://global-search.t... [16:39:36] 10Data-Platform-SRE ( 2024.02.12 - 2024.03.03), 10observability, 10Patch-For-Review: Change data platform-related IRC channels to improve communication - https://phabricator.wikimedia.org/T352783#9560214 (10bking) [16:41:24] 10Data-Engineering, 10CX-cxserver, 10Citoid, 10Content-Transform-Team-WIP, and 11 others: Migrate node-based services in production to node18 - https://phabricator.wikimedia.org/T349118#9560239 (10Sbailey) a:05Sbailey→03None [16:43:12] 10Data-Platform-SRE ( 2024.02.12 - 2024.03.03), 10Discovery-Search (Current work): Rebuild and deploy textify plugin - https://phabricator.wikimedia.org/T356651#9560266 (10Gehel) a:03RKemper [16:52:37] 10Data-Engineering, 10Data-Platform-SRE: [Iceberg Migration] P.O.C. on Iceberg sensor using Postgres table to keep status of updates - https://phabricator.wikimedia.org/T340466#9560323 (10Gehel) [16:53:20] 10Data-Engineering, 10Data-Platform-SRE: [Iceberg Migration] P.O.C. on Iceberg sensor using Postgres table to keep status of updates - https://phabricator.wikimedia.org/T340466#9560325 (10lbowmaker) [16:53:55] 10Data-Engineering, 10Movement-Insights: [Data Quality] Implement basic data quality metrics for Unique Devices datasets - https://phabricator.wikimedia.org/T357833#9560343 (10Mayakp.wiki) great, thanks @lbowmaker for reminding me about that task! will review it. yes, its ok to not implement something this FY... [17:51:40] (03PS1) 10Snwachukwu: Add spark sql version of browser mobile and desktop querries. 1. Modify browser all_site queries. 2. Add browser desktop and mobile queries. [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1005129 (https://phabricator.wikimedia.org/T354552) [18:11:59] 10Data-Platform-SRE ( 2024.02.12 - 2024.03.03): Migrate selected Search Platform alerts from icinga search-platform team to prometheus data-platform team - https://phabricator.wikimedia.org/T358029#9560690 (10bking) [18:40:43] (03CR) 10Joal: "I think we should remove the `reportupdater_queries` folder: we have not used tools in the name of HQL folders, and we wish to deprecate t" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1005129 (https://phabricator.wikimedia.org/T354552) (owner: 10Snwachukwu) [18:43:02] 10Data-Platform-SRE ( 2024.02.12 - 2024.03.03), 10Discovery-Search (Current work), 10Documentation: Review wikitech:Search and write processes for k8s world - https://phabricator.wikimedia.org/T356303#9560913 (10TBurmeister) [18:43:19] 10Data-Platform-SRE ( 2024.02.12 - 2024.03.03), 10Discovery-Search (Current work), 10Documentation: Document review/refresh for https://wikitech.wikimedia.org/wiki/Search - https://phabricator.wikimedia.org/T356806#9560914 (10TBurmeister) [19:19:24] (03CR) 10Joal: "Many comments :S" [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/995271 (https://phabricator.wikimedia.org/T354552) (owner: 10Snwachukwu) [19:38:17] 10Data-Platform-SRE, 10Wikidata, 10Wikidata-Query-Service: Allow federated queries with the Iconclass sparql endpoint - https://phabricator.wikimedia.org/T357533#9561146 (10RKemper) a:03RKemper [19:46:31] (03PS1) 10Kimberly Sarabia: Updates web accessibility schema [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/1005149 (https://phabricator.wikimedia.org/T356335) [19:47:07] (03CR) 10CI reject: [V: 04-1] Updates web accessibility schema [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/1005149 (https://phabricator.wikimedia.org/T356335) (owner: 10Kimberly Sarabia) [19:51:34] 10Data-Platform-SRE ( 2024.02.12 - 2024.03.03): Decommission cloudelastic1001-1004 - https://phabricator.wikimedia.org/T357780#9561193 (10bking) [19:52:25] (03PS2) 10Kimberly Sarabia: Updates web accessibility schema [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/1005149 (https://phabricator.wikimedia.org/T356335) [19:53:09] (03CR) 10CI reject: [V: 04-1] Updates web accessibility schema [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/1005149 (https://phabricator.wikimedia.org/T356335) (owner: 10Kimberly Sarabia) [19:55:17] (03PS3) 10Kimberly Sarabia: Updates web accessibility schema [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/1005149 (https://phabricator.wikimedia.org/T356335) [19:55:55] (03CR) 10CI reject: [V: 04-1] Updates web accessibility schema [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/1005149 (https://phabricator.wikimedia.org/T356335) (owner: 10Kimberly Sarabia) [20:18:53] (03CR) 10Bernard Wang: Updates web accessibility schema (031 comment) [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/1005149 (https://phabricator.wikimedia.org/T356335) (owner: 10Kimberly Sarabia) [20:32:05] 10Data-Platform-SRE ( 2024.02.12 - 2024.03.03): Decommission cloudelastic1001-1004 - https://phabricator.wikimedia.org/T357780#9561306 (10ops-monitoring-bot) cookbooks.sre.hosts.decommission executed by ryankemper@cumin2002 for hosts: `cloudelastic[1001-1004].wikimedia.org` - cloudelastic1001.wikimedia.org (**FA... [20:57:12] 10Data-Platform-SRE ( 2024.02.12 - 2024.03.03): Check home/HDFS leftovers of mhoutti - https://phabricator.wikimedia.org/T356641#9561380 (10Isaac) a:05Isaac→03None Checked and grabbed a few files that are important so mhoutti's home directory on stat1008 and HDFS may now be removed. Thanks! [22:18:29] !log Starting refinery deployment [22:18:30] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [22:20:53] 10Data-Engineering, 10Data Products, 10Pageviews-API, 10Tool-Pageviews: No Pageviews data since 2024-02-17 - https://phabricator.wikimedia.org/T357910#9561660 (10Framawiki) 05Open→03Resolved a:03Sfaci Looks fixed for me, thanks @Sfaci and @BTullis for the quick fix. [22:26:50] (03CR) 10Ottomata: Extract RefineSingleApp code from Refine (036 comments) [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1003745 (https://phabricator.wikimedia.org/T356363) (owner: 10Joal) [22:46:25] 10Data-Platform-SRE ( 2024.02.12 - 2024.03.03): Migrate selected Search Platform alerts from icinga search-platform team to prometheus data-platform team - https://phabricator.wikimedia.org/T358029#9561719 (10bking) I'm doing a first pass on alerts I already recorded in [[ https://docs.google.com/spreadsheets/d/... [22:52:05] !log Deployed refinery using scap, then deployed onto hdfs [22:52:07] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [23:17:00] (03Abandoned) 10Kimberly Sarabia: Updates web accessibility schema [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/1005149 (https://phabricator.wikimedia.org/T356335) (owner: 10Kimberly Sarabia) [23:46:49] (03PS1) 10Kimberly Sarabia: Adds new field to webA11y schema [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/1005201 (https://phabricator.wikimedia.org/T356335) [23:48:34] (03PS2) 10Kimberly Sarabia: Adds new field to webA11y schema [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/1005201 (https://phabricator.wikimedia.org/T356335)