[06:40:48] (03CR) 10Gergő Tisza: [C: 03+1] image-suggestions-feedback: Bump to version 2.0.0 (031 comment) [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/809150 (https://phabricator.wikimedia.org/T302925) (owner: 10Kosta Harlan) [10:25:38] !log enabled dashboard native filtering in superset https://gerrit.wikimedia.org/r/c/operations/puppet/+/881510 for T318299 [10:25:41] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [10:25:41] T318299: Superset Date Filter fix needed - https://phabricator.wikimedia.org/T318299 [10:32:20] 10Data-Engineering, 10Equity-Landscape: Milestone: Ingest and Transform Input Data - https://phabricator.wikimedia.org/T305475 (10KCVelaga_WMF) [10:32:25] 10Data-Engineering, 10Equity-Landscape: Programs Metrics Transform - https://phabricator.wikimedia.org/T306621 (10KCVelaga_WMF) 05In progress→03Invalid This approach for calculating the metric is no longer used. T309277 will be used further. [10:33:26] 10Data-Engineering, 10Equity-Landscape: Overall Engagement output rank metric - https://phabricator.wikimedia.org/T306622 (10KCVelaga_WMF) a:05JAnstee_WMF→03ntsako to move to next steps for production. [11:08:21] 10Data-Engineering, 10Equity-Landscape: Affiliates input metric - https://phabricator.wikimedia.org/T309275 (10KCVelaga_WMF) a:05JAnstee_WMF→03ntsako Ntsako will handle the column name changes in the next steps. [11:08:31] 10Data-Engineering, 10serviceops, 10Discovery-Search (Current work), 10Event-Platform Value Stream (Sprint 07), 10Patch-For-Review: Flink on Kubernetes Helm charts - https://phabricator.wikimedia.org/T324576 (10akosiaris) >>! In T324576#8537916, @Ottomata wrote: > @akosiaris manually edited the flink-pod... [11:27:03] 10Data-Engineering, 10Equity-Landscape: Affiliates output rank metrics - https://phabricator.wikimedia.org/T306619 (10KCVelaga_WMF) It is being caused due to rounding off error. When I limit the number of decimal places to 3, the values match with the outputs from the sheets. If not, they cause slight differen... [11:27:40] 10Data-Engineering, 10Equity-Landscape: Affiliates output rank metrics - https://phabricator.wikimedia.org/T306619 (10KCVelaga_WMF) a:05JAnstee_WMF→03ntsako To move to next steps [11:30:57] 10Data-Engineering, 10Equity-Landscape: Grants input metric - https://phabricator.wikimedia.org/T309276 (10KCVelaga_WMF) a:05JAnstee_WMF→03ntsako the affiliate components are signed-off by Jaime at T309275#8538693, can be moved to next step. [13:30:30] 10Data-Engineering, 10serviceops, 10Discovery-Search (Current work), 10Event-Platform Value Stream (Sprint 07), 10Patch-For-Review: Flink on Kubernetes Helm charts - https://phabricator.wikimedia.org/T324576 (10Ottomata) YES! Thank you so much @akosiaris! Okay just so I understand, setting KUBERNETES... [14:36:01] 10Quarry, 10Cloud-Services, 10cloud-services-team (FY2022/2023-Q3): Consider moving Quarry to be an installation of Redash - https://phabricator.wikimedia.org/T169452 (10fnegri) [14:38:46] 10Quarry, 10Cloud-Services, 10cloud-services-team (FY2022/2023-Q3): Consider moving Quarry to be an installation of Redash - https://phabricator.wikimedia.org/T169452 (10fnegri) I agree this is something worth exploring. I'll add [Metabase](https://www.metabase.com/start/oss/) to the options, I had good expe... [14:49:58] (03CR) 10Matthias Mullie: [C: 03+2] Update searchPreview schema to be inline with required changes [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/880953 (https://phabricator.wikimedia.org/T326663) (owner: 10Simone Cuomo) [14:50:36] (03Merged) 10jenkins-bot: Update searchPreview schema to be inline with required changes [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/880953 (https://phabricator.wikimedia.org/T326663) (owner: 10Simone Cuomo) [15:04:57] PROBLEM - Check systemd state on an-launcher1002 is CRITICAL: CRITICAL - degraded: The following units failed: produce_canary_events.service https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state [15:30:03] RECOVERY - Check systemd state on an-launcher1002 is OK: OK - running: The system is fully operational https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state [16:10:37] (03CR) 10Ottomata: image-suggestions-feedback: Bump to version 2.0.0 (031 comment) [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/809150 (https://phabricator.wikimedia.org/T302925) (owner: 10Kosta Harlan) [16:26:44] 10Data-Engineering, 10CheckUser, 10MW-1.38-notes (1.38.0-wmf.26; 2022-03-14), 10MW-1.39-notes (1.39.0-wmf.23; 2022-08-01), and 4 others: Update CheckUser for actor and comment table - https://phabricator.wikimedia.org/T233004 (10Zabe) [16:54:25] Hi! I’m currently working on making ref-spark-tools ready to be compatible with Spark 3 for the search team. SparkUtils.scala in the rdf-spark-tools does a matching against HiveString, a type that apparently no longer exists in any of the dependencies. Do we work with hive? For spark 3.0.2 there still is javadoc but I do not know what happened to that type afterwards. Was it deprecated? Was it moved? [16:54:56] joal: this might be a question for you ^ [17:00:55] indeed gehel! Hi pfischer [17:04:56] pfischer: I'm assuming you're talking about the HiveStringType? [17:05:11] pfischer: I can't see references to "HiveString" [17:18:05] 10Data-Engineering, 10Product-Analytics (Kanban), 10Shared-Data-Infrastructure (EQ2 Kanban (Sprints 04-05)): Superset Date Filter fix needed - https://phabricator.wikimedia.org/T318299 (10BTullis) [17:23:55] 10Data-Engineering: Requesting Kerberos identity for Hxi-ctr - https://phabricator.wikimedia.org/T325857 (10HXi-WMF) I get this result ` The authenticity of host 'stat1007.eqiad.wmnet ()' can't be established. ED25519 key fingerprint is SHA256:8rvZNxbCHfNE8dxB8+CIjUZHsblCeOgBu9c2Jy... [17:24:35] 10Data-Engineering: Requesting Kerberos identity for Hxi-ctr - https://phabricator.wikimedia.org/T325857 (10HXi-WMF) When I run ` ssh -N stat1005.eqiad.wmnet -L 8880:127.0.0.1:8880 ` I'm able to connect but when I go to the Jupyter login, it says my username and Password are not correct even when I enter the s... [18:05:58] 10Data-Engineering, 10serviceops, 10Discovery-Search (Current work), 10Event-Platform Value Stream (Sprint 07), 10Patch-For-Review: Flink on Kubernetes Helm charts - https://phabricator.wikimedia.org/T324576 (10Ottomata) Something is messing with app label I'm setting, and we suspect it is the flink-kube... [18:13:50] 10Data-Engineering: Requesting Kerberos identity for Hxi-ctr - https://phabricator.wikimedia.org/T325857 (10BTullis) Thanks for that explanation @HXi-WMF - yes it looks like we might have to rename your shell account. Apologies for the delay in getting you this acces. I'm seeking guidance on the best course of a... [18:21:16] 10Data-Engineering-Planning, 10Epic, 10Patch-For-Review, 10Shared-Data-Infrastructure (EQ2 Kanban (Sprints 04-05)): Decide on installation details for new ceph cluster - https://phabricator.wikimedia.org/T326945 (10BTullis) [18:23:14] 10Data-Engineering-Planning, 10Epic, 10Patch-For-Review, 10Shared-Data-Infrastructure (EQ2 Kanban (Sprints 04-05)): Decide on installation details for new ceph cluster - https://phabricator.wikimedia.org/T326945 (10BTullis) [19:02:35] joal: Hi! Yes, I’m talking about HiveStringType, my bad. [19:14:45] 10Data-Engineering, 10API Platform (Sprint 03), 10AQS2.0, 10Platform Engineering Roadmap, 10User-Eevans: AQS 2.0: Pageviews: Implement Unit Tests - https://phabricator.wikimedia.org/T299735 (10EChukwukere-WMF) @BPirkle based on on convo this will be a Smoke test and full QA to validate the pageviews endp... [21:07:07] 10Data-Engineering-Planning: FYI: Other changes to the CheckUser tables - https://phabricator.wikimedia.org/T327447 (10Milimetric) [21:08:08] (03PS1) 10Milimetric: Reference changes to the cu_changes table [analytics/refinery] - 10https://gerrit.wikimedia.org/r/881713 (https://phabricator.wikimedia.org/T327447) [21:08:33] (03CR) 10Milimetric: [V: 03+2 C: 03+2] Reference changes to the cu_changes table [analytics/refinery] - 10https://gerrit.wikimedia.org/r/881713 (https://phabricator.wikimedia.org/T327447) (owner: 10Milimetric)