[00:19:57] 06Data-Engineering, 06Abstract Wikipedia team, 10MediaWiki-extensions-EventLogging, 10Metrics Platform Backlog, and 2 others: wikimedia/metrics-platform 4.1.0 in composer.json causes errors - https://phabricator.wikimedia.org/T367338#9887155 (10DMartin-WMF) Even though @vaughnwalters has gotten past his lo... [07:22:05] 10Quarry: Users get logged out from Quarry every day (or two) - https://phabricator.wikimedia.org/T362025#9887551 (10SD0001) This is because of redis pod getting restarted. It'll also happen during deployments. Ideally, we should configure RDB or AOF persistence for it. [08:42:20] 10Quarry, 10cloud-services-team (FY2023/2024-Q3-Q4): [bug] Access denied for user 'quarry'@'172.16.2.72' (using password: NO) - https://phabricator.wikimedia.org/T365374#9887687 (10fnegri) 05In progress→03Resolved The specific error described in this bug report (`Access denied for user 'quarry'@'172.16... [09:10:33] 14Analytics-Radar, 06Data-Engineering-Icebox, 06Machine-Learning-Team, 06serviceops: Using docker in WMF production network outside of kubernetes - https://phabricator.wikimedia.org/T275551#9887755 (10akosiaris) In Kubernetes Special Interest Group, we recently re-evaluated the approach of running Docker o... [09:18:19] 06Data-Engineering, 10Observability-Logging, 06Traffic, 13Patch-For-Review: Better Benthos performances - https://phabricator.wikimedia.org/T360454#9887794 (10Fabfur) Update on Benthos performances. To be able to compare Benthos (now RedPanda) to some tools we already use, I've collected some data from cp... [10:01:38] 10Quarry, 10Data-Services, 10cloud-services-team (FY2023/2024-Q3-Q4), 13Patch-For-Review: Create db user for Quarry with readonly access to public ToolsDB databases - https://phabricator.wikimedia.org/T348407#9887935 (10fnegri) After the fixes in T365374 (thanks to @SD0001 for the fix and thanks to @rook f... [10:02:57] 10Quarry, 10cloud-services-team (FY2023/2024-Q3-Q4): Support queries against Quarry's own database and ToolsDB - https://phabricator.wikimedia.org/T151158#9887943 (10fnegri) p:05Low→03Medium [10:03:51] 10Quarry, 10cloud-services-team (FY2023/2024-Q3-Q4): Support queries against Quarry's own database and ToolsDB - https://phabricator.wikimedia.org/T151158#9887941 (10fnegri) a:03fnegri [10:04:23] 10Quarry, 10cloud-services-team (FY2023/2024-Q3-Q4): Support queries against Quarry's own database and ToolsDB - https://phabricator.wikimedia.org/T151158#9887944 (10fnegri) 05Open→03In progress [10:11:30] 06Data-Engineering, 06Data-Platform-SRE, 06Discovery-Search, 07Epic: [Epic] Replace Archiva with Gitlab artifact repositories - https://phabricator.wikimedia.org/T367315#9887982 (10Gehel) [10:13:49] 06Data-Engineering, 06Data-Platform-SRE, 06Discovery-Search, 06Java-Scala-Standardization, 07Epic: [Epic] Replace Archiva with Gitlab artifact repositories - https://phabricator.wikimedia.org/T367315#9887987 (10Gehel) [10:23:36] 06Data-Engineering, 10Data Pipelines, 10Data-Platform-SRE (2024.05.27 - 2024.06.16), 13Patch-For-Review: Upgrade Airflow to 2.9.1 - https://phabricator.wikimedia.org/T365449#9888005 (10Stevemunene) Manual changes to packages are the mentioned [[ https://wikitech.wikimedia.org/wiki/Data_Engineering/Systems/... [10:34:48] 10Quarry, 10cloud-services-team (FY2023/2024-Q3-Q4): Support queries against Quarry's own database and ToolsDB - https://phabricator.wikimedia.org/T151158#9888093 (10fnegri) We are finally close to resolving this task! After the work in T348407 I can successfully query ToolsDB from Quarry. Access at the moment... [10:43:27] 06Data-Engineering, 06Data Products, 10Observability-Logging, 06Traffic, 13Patch-For-Review: Move analytics log from Varnish to HAProxy - https://phabricator.wikimedia.org/T351117#9888132 (10gmodena) The haproxy / benthos feed is now available in raw form under `wmf_staging.webrequest_frontend_rc0` and p... [10:55:34] 06Data-Engineering, 06Tech-Docs-Team, 05Goal: Redesign Data Platform docs on Wikitech - https://phabricator.wikimedia.org/T350911#9888148 (10BTullis) Great! Thanks. Are you planning to leave redirects when moving the pages, or should we minimise the number of redirects and fix any broken links as we discover... [12:36:31] 06Data-Engineering, 06Data-Platform-SRE, 06Discovery-Search, 06Java-Scala-Standardization: Validate CI integration so that Ci can release Maven artifacts on user's demand - https://phabricator.wikimedia.org/T367403 (10Gehel) 03NEW [12:37:09] 06Data-Engineering, 06Data-Platform-SRE, 06Discovery-Search, 06Java-Scala-Standardization, 07Epic: [Epic] Replace Archiva with Gitlab artifact repositories - https://phabricator.wikimedia.org/T367315#9888406 (10Gehel) [12:37:12] 06Data-Engineering, 06Data-Platform-SRE, 06Discovery-Search, 06Java-Scala-Standardization: Update parent pom to disable fetching dependencies from Archiva and use Gitlab instead - https://phabricator.wikimedia.org/T367404 (10Gehel) 03NEW [12:37:42] 06Data-Engineering, 06Data-Platform-SRE, 06Discovery-Search, 06Java-Scala-Standardization: Migrate existing Java packages to deploying to Gitlab, including new version of parent pom, validation that all dependencies are available, and validation that deployment to ... - https://phabricator.wikimedia.org/T367405 [12:37:59] 06Data-Engineering, 06Data-Platform-SRE, 06Discovery-Search, 06Java-Scala-Standardization: Migration Python projects that depend on Archiva for deployment - https://phabricator.wikimedia.org/T367406 (10Gehel) 03NEW [12:38:17] 06Data-Engineering, 06Data-Platform-SRE, 06Discovery-Search, 06Java-Scala-Standardization: Retire Archiva, including keeping a read only copy of all previously published artifacts - https://phabricator.wikimedia.org/T367407 (10Gehel) 03NEW [12:39:37] 06Data-Engineering, 06Data-Platform-SRE, 06Discovery-Search, 06Java-Scala-Standardization, 07Epic: [Epic] Replace Archiva with Gitlab artifact repositories - https://phabricator.wikimedia.org/T367315#9888453 (10Gehel) [12:44:48] 06Data-Engineering, 06Data-Platform-SRE, 06Discovery-Search, 06Java-Scala-Standardization: Retire Archiva, including keeping a read only copy of all previously published artifacts - https://phabricator.wikimedia.org/T367407#9888477 (10Gehel) [12:50:51] 10Quarry, 10Data-Services, 10cloud-services-team (FY2023/2024-Q3-Q4): Create db user for Quarry with readonly access to public ToolsDB databases - https://phabricator.wikimedia.org/T348407#9888500 (10fnegri) [13:00:18] 06Data-Engineering, 06Data-Platform-SRE, 06Discovery-Search, 06Java-Scala-Standardization: Migrate existing Java packages to deploying to Gitlab, including new version of parent pom, validation that all dependencies are available, and validation that deploy... - https://phabricator.wikimedia.org/T367405#9888526 [13:17:03] 06Data-Engineering, 06Data-Platform-SRE, 06Discovery-Search, 06Java-Scala-Standardization: Validate CI integration so that Ci can release Maven artifacts on user's demand - https://phabricator.wikimedia.org/T367403#9888641 (10Gehel) p:05Triage→03High [13:17:11] 06Data-Engineering, 06Data-Platform-SRE, 06Discovery-Search, 06Java-Scala-Standardization, 07Epic: [Epic] Replace Archiva with Gitlab artifact repositories - https://phabricator.wikimedia.org/T367315#9888634 (10Gehel) p:05Triage→03High [13:17:30] 06Data-Engineering, 06Data-Platform-SRE, 06Discovery-Search, 06Java-Scala-Standardization: Update parent pom to disable fetching dependencies from Archiva and use Gitlab instead - https://phabricator.wikimedia.org/T367404#9888644 (10Gehel) p:05Triage→03High [13:17:36] 06Data-Engineering, 06Data-Platform-SRE, 06Discovery-Search, 06Java-Scala-Standardization: Migrate existing Java packages to deploying to Gitlab, including new version of parent pom, validation that all dependencies are available, and validation that deploy... - https://phabricator.wikimedia.org/T367405#9888646 [13:17:44] 06Data-Engineering, 06Data-Platform-SRE, 06Discovery-Search, 06Java-Scala-Standardization: Migration Python projects that depend on Archiva for deployment - https://phabricator.wikimedia.org/T367406#9888648 (10Gehel) p:05Triage→03High [13:18:03] 06Data-Engineering, 06Data-Platform-SRE, 06Discovery-Search, 06Java-Scala-Standardization: Retire Archiva, including keeping a read only copy of all previously published artifacts - https://phabricator.wikimedia.org/T367407#9888650 (10Gehel) p:05Triage→03High [14:01:11] (03PS17) 10Aqu: Refactor Refine to be triggerd by Airflow [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1016808 (https://phabricator.wikimedia.org/T356762) [14:04:23] 06Data-Engineering, 06Abstract Wikipedia team, 10MediaWiki-extensions-EventLogging, 10Metrics Platform Backlog, and 2 others: wikimedia/metrics-platform 4.1.0 in composer.json causes errors - https://phabricator.wikimedia.org/T367338#9888772 (10Jdforrester-WMF) p:05Unbreak!→03High No longer a train blo... [14:04:48] 06Data-Engineering, 06Abstract Wikipedia team, 10MediaWiki-extensions-EventLogging, 10Metrics Platform Backlog, and 2 others: wikimedia/metrics-platform 4.1.0 in composer.json causes errors - https://phabricator.wikimedia.org/T367338#9888775 (10Jdforrester-WMF) [14:11:10] There's a local change on deploy1002 in deployment-charts helmfile.d/dse-k8s-services/datahub-next/values-staging.yaml that's blocking the git pull from working [14:11:57] ottomata: o/ - is there a reason why eventgate-ci is running Stretch? https://docker-registry.wikimedia.org/wikimedia/eventgate-ci/tags/ - if we don't use it, we could delete it from the registry [14:12:43] I'll stash it, pull, and unstash it [14:13:39] the change was overwritten by a commit [14:36:24] 10Quarry: Allow Quarry to query its own database - https://phabricator.wikimedia.org/T367415 (10fnegri) 03NEW [14:39:36] 10Quarry, 10cloud-services-team (FY2023/2024-Q3-Q4): Support queries against Quarry's own database and ToolsDB - https://phabricator.wikimedia.org/T151158#9888977 (10fnegri) [14:45:01] 10Quarry, 10cloud-services-team (FY2023/2024-Q3-Q4): Support queries against Quarry's own database and ToolsDB - https://phabricator.wikimedia.org/T151158#9889006 (10fnegri) [14:49:47] 10Quarry, 10Data-Services, 10cloud-services-team (FY2023/2024-Q3-Q4): Allow Quarry to query ToolsDB public databases - https://phabricator.wikimedia.org/T348407#9889028 (10fnegri) [15:14:52] claime: sorry, that was me [15:15:03] I was experimenting with a weird feature [15:15:32] thanks for cleaning that mess, and sorry again [15:18:56] elukey: eventgate-ci is unsed [15:18:58] it is archived [15:18:58] https://gerrit.wikimedia.org/r/admin/repos/eventgate-ci,general [15:19:00] [ARCHIVED] Deprecated in favour of eventgate-wikimedia (T229111). [15:19:01] T229111: Archive eventgate-ci repository from gerrit - https://phabricator.wikimedia.org/T229111 [15:19:25] ottomata: ooook! So is it ok to drop it from the docker registry? [15:19:28] absolutely [15:19:43] goooood [15:39:10] 06Data-Engineering, 06Data-Platform-SRE, 06Discovery-Search, 06Java-Scala-Standardization, 07Epic: [Epic] Replace Archiva with Gitlab artifact repositories - https://phabricator.wikimedia.org/T367315#9889408 (10Gehel) [15:41:41] 06Data-Engineering, 06Data-Platform-SRE, 06Discovery-Search, 06Java-Scala-Standardization, 07Epic: [Epic] Replace Archiva with Gitlab artifact repositories - https://phabricator.wikimedia.org/T367315#9889438 (10BTullis) [15:58:04] 06Data-Engineering, 06Data-Platform-SRE, 06Discovery-Search, 06Java-Scala-Standardization: Migration Python projects that depend on Archiva for deployment - https://phabricator.wikimedia.org/T367406#9889600 (10Ottomata) FYI, DPE has [[ https://gitlab.wikimedia.org/repos/data-engineering/workflow_utils/-/tr... [16:28:58] !log started copying sqldata.s1 from clouddbd1021 to an-redacteddb1001 for T365453 [16:29:00] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [16:29:02] T365453: Bring an-redacteddb1001 into service to replace clouddb1021 - https://phabricator.wikimedia.org/T365453 [16:44:47] (03PS4) 10Jon Harald Søby: Remove text-transform:capitalize; and clean up capital letter use [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/928802 [17:23:30] (03CR) 10Aleksandar Mastilovic: [C:03+2] Clean up old MobileWikiApp schemas [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1015126 (https://phabricator.wikimedia.org/T360579) (owner: 10Cooltey) [17:23:39] (03CR) 10Aleksandar Mastilovic: [C:03+2] Add `app_patroller_experience` to allowlist for Android app [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1013142 (https://phabricator.wikimedia.org/T358299) (owner: 10Cooltey) [17:24:08] (03CR) 10Aleksandar Mastilovic: [V:03+2 C:03+2] Add `app_patroller_experience` to allowlist for Android app [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1013142 (https://phabricator.wikimedia.org/T358299) (owner: 10Cooltey) [17:24:19] (03CR) 10Aleksandar Mastilovic: [V:03+2 C:03+2] Clean up old MobileWikiApp schemas [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1015126 (https://phabricator.wikimedia.org/T360579) (owner: 10Cooltey) [18:05:02] 06Data-Engineering, 06Abstract Wikipedia team, 10MediaWiki-extensions-EventLogging, 10Metrics Platform Backlog, and 3 others: wikimedia/metrics-platform 4.1.0 in composer.json causes errors - https://phabricator.wikimedia.org/T367338#9890225 (10Jdforrester-WMF) 05Open→03Resolved a:05vaughnwalters... [18:10:30] 06Data-Engineering, 06Tech-Docs-Team, 05Goal: Redesign Data Platform docs on Wikitech - https://phabricator.wikimedia.org/T350911#9890249 (10TBurmeister) I was planning to leave redirects, but I'm open to not doing that if you think it's a better long-term solution for the overall health of the docs and wiki... [19:41:14] (03PS1) 10Ecarg: Create HQL for new join table [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1043205 (https://phabricator.wikimedia.org/T363436) [19:43:46] (03CR) 10Ecarg: Create HQL for new join table (032 comments) [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1043205 (https://phabricator.wikimedia.org/T363436) (owner: 10Ecarg) [20:21:29] 10Quarry, 10cloud-services-team (FY2023/2024-Q3-Q4): [bug] Access denied for user 'quarry'@'172.16.2.72' (using password: NO) - https://phabricator.wikimedia.org/T365374#9890676 (10Liz) I'm not getting that message any more but some queries are just running endlessly and never finishing. I had one that ran... [20:21:36] (03PS2) 10Ecarg: Create HQL for new join table [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1043205 (https://phabricator.wikimedia.org/T363436) [20:21:55] (03CR) 10Ecarg: Create HQL for new join table (031 comment) [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1043205 (https://phabricator.wikimedia.org/T363436) (owner: 10Ecarg) [20:27:57] 10Quarry: [bug] Quarry queries not completing - https://phabricator.wikimedia.org/T367464 (10Liz) 03NEW [20:29:53] 07Analytics-Data-Problem, 06Data-Platform: WMF-last-access cookie sets wrong domain for static assets on commons - https://phabricator.wikimedia.org/T367346#9890711 (10Mayakp.wiki) [20:36:49] 14Analytics, 10AQS2.0, 06Tech-Docs-Team, 10Data Products (Epics Timeline), and 2 others: AQS 2.0 user documentation - https://phabricator.wikimedia.org/T288664#9890755 (10apaskulin) [22:02:28] 14Analytics, 10AQS2.0, 06Tech-Docs-Team, 10Data Products (Epics Timeline), and 2 others: AQS 2.0 user documentation - https://phabricator.wikimedia.org/T288664#9891075 (10apaskulin) [22:02:43] 14Analytics, 10AQS2.0, 06Tech-Docs-Team, 10Data Products (Epics Timeline), and 2 others: AQS 2.0 user documentation - https://phabricator.wikimedia.org/T288664#9891077 (10apaskulin) [22:02:51] 14Analytics, 10AQS2.0, 06Tech-Docs-Team, 10Data Products (Epics Timeline), and 2 others: AQS 2.0 user documentation - https://phabricator.wikimedia.org/T288664#9891079 (10apaskulin) [22:04:50] 14Analytics, 10AQS2.0, 06Tech-Docs-Team, 10Data Products (Epics Timeline), and 2 others: AQS 2.0 user documentation - https://phabricator.wikimedia.org/T288664#9891082 (10apaskulin)