[03:19:57] FIRING: MediawikiPageContentChangeEnrichAvailability: ... [03:19:57] Low percentage of enriched events produced by mw_page_content_change_enrich in eqiad - TODO - https://grafana.wikimedia.org/d/K9x0c4aVk/flink-app?orgId=1&var-datasource=eqiad%20prometheus/k8s&var-namespace=mw-page-content-change-enrich&var-helm_release=main&var-operator_name=All&var-flink_job_name=mw_page_content_change_enrich - https://alerts.wikimedia.org/?q=alertname%3DMediawikiPageContentChangeEnrichAvailability [05:13:27] (03CR) 10KCVelaga: "Thanks Marcel, this mostly looks good to me. I am also adding the engineers from the LPL team to review." [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/1061096 (https://phabricator.wikimedia.org/T369687) (owner: 10Mforns) [07:19:57] FIRING: MediawikiPageContentChangeEnrichAvailability: ... [07:19:57] Low percentage of enriched events produced by mw_page_content_change_enrich in eqiad - TODO - https://grafana.wikimedia.org/d/K9x0c4aVk/flink-app?orgId=1&var-datasource=eqiad%20prometheus/k8s&var-namespace=mw-page-content-change-enrich&var-helm_release=main&var-operator_name=All&var-flink_job_name=mw_page_content_change_enrich - https://alerts.wikimedia.org/?q=alertname%3DMediawikiPageContentChangeEnrichAvailability [07:48:52] 06Data-Engineering, 06Data-Platform-SRE, 10observability, 06serviceops, and 3 others: Upgrade Kafka to from 1.x to later version - https://phabricator.wikimedia.org/T300102#10072072 (10brouberol) The upgrade of kafka is currently a stretch OKR and will probably be a core OKR for next quarter. I'll definite... [08:44:54] 06Data-Engineering, 10Data-Platform-SRE (2024.08.17 - 2024.09.06): Requesting Kerberos access for ifrahkhanyaree - https://phabricator.wikimedia.org/T371894#10072277 (10Ifrahkhanyaree_WMDE) Ah ha, so, the keys don't match. Shall I just copy the one you linked to into my pub key file? Or, do you think it might... [09:13:02] 06Data-Engineering, 10Data-Platform-SRE (2024.08.17 - 2024.09.06): Requesting Kerberos access for ifrahkhanyaree - https://phabricator.wikimedia.org/T371894#10072416 (10BTullis) >>! In T371894#10072277, @Ifrahkhanyaree_WMDE wrote: > Ah ha, so, the keys don't match. Shall I just copy the one you linked to into... [09:22:08] 10Quarry, 10cloud-services-team (FY2024/2025-Q1-Q2): Support queries against Quarry's own database and ToolsDB - https://phabricator.wikimedia.org/T151158#10072439 (10fnegri) [09:23:30] 10Quarry, 10cloud-services-team (FY2024/2025-Q1-Q2): Allow Quarry to query its own database - https://phabricator.wikimedia.org/T367415#10072441 (10fnegri) [09:28:03] 10Quarry, 10superset.wmcloud.org, 10cloud-services-team (FY2024/2025-Q1-Q2): Replace Quarry with an installation of Superset - https://phabricator.wikimedia.org/T169452#10072501 (10fnegri) [09:46:22] 06Data-Engineering, 10Data-Platform-SRE (2024.08.17 - 2024.09.06): Requesting Kerberos access for ifrahkhanyaree - https://phabricator.wikimedia.org/T371894#10072550 (10Ifrahkhanyaree_WMDE) I couldn't find a matching private key for that public key. I'll generate a new key pair right away and share the public... [10:33:29] 10Data-Engineering (Q1 2024 July 1st - September 30th), 10Data Pipelines, 10Data-Catalog: Spike: Integrate Spark with DataHub - https://phabricator.wikimedia.org/T306896#10072662 (10tchin) Update: Tried using spark 3.3.2 with this: `lang=bash sudo -u analytics-privatedata spark3-sql \ --master local[12] --d... [11:11:07] 06Data-Engineering, 10Data-Platform-SRE (2024.08.17 - 2024.09.06): Requesting Kerberos access for ifrahkhanyaree - https://phabricator.wikimedia.org/T371894#10072804 (10BTullis) >>! In T371894#10072550, @Ifrahkhanyaree_WMDE wrote: > I couldn't find a matching private key for that public key. I'll generate a ne... [11:18:51] 10Data-Engineering (Q1 2024 July 1st - September 30th), 10Data Pipelines, 10Data-Catalog: Spike: Integrate Spark with DataHub - https://phabricator.wikimedia.org/T306896#10072822 (10BTullis) I don't know if it is useful, but @xcollazo did some work on using custom spark assemblies and there are some notes in... [12:17:50] 06Data-Engineering, 10Data-Platform-SRE (2024.08.17 - 2024.09.06): Requesting Kerberos access for ifrahkhanyaree - https://phabricator.wikimedia.org/T371894#10072943 (10Ifrahkhanyaree_WMDE) Ah, I'm not sure I know how to do that properly, apologies. Here's the new public key ` ssh-rsa AAAAB3NzaC1yc2EAAAADAQAB... [12:52:21] 06Data-Engineering, 10Data-Platform-SRE (2024.08.17 - 2024.09.06), 13Patch-For-Review: Requesting Kerberos access for ifrahkhanyaree - https://phabricator.wikimedia.org/T371894#10073033 (10BTullis) I checked that the key is not in user anywhere else, with: ` btullis@mwmaint1002:~$ cross-validate-accounts --u... [13:19:28] (03CR) 10Kosta Harlan: [C:03+1] Don't select cuc_actiontext from cu_changes for sqoop [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1057221 (https://phabricator.wikimedia.org/T371099) (owner: 10Dreamy Jazz) [13:20:14] 06Data-Engineering, 10Data-Platform-SRE (2024.08.17 - 2024.09.06), 13Patch-For-Review: Requesting Kerberos access for ifrahkhanyaree - https://phabricator.wikimedia.org/T371894#10073195 (10Ifrahkhanyaree_WMDE) Confirming that everything works now. Thank you for all the help! [13:50:12] 10Data-Engineering (Q1 2024 July 1st - September 30th), 10Dumps 2.0, 10Event-Platform: [BUG] MediawikiPageContentChangeEnrichAvailability is firing - https://phabricator.wikimedia.org/T372768 (10gmodena) 03NEW [14:05:07] 06Data-Engineering, 10Data-Platform-SRE (2024.08.17 - 2024.09.06), 13Patch-For-Review: Requesting Kerberos access for ifrahkhanyaree - https://phabricator.wikimedia.org/T371894#10073373 (10BTullis) 05Open→03Resolved >>! In T371894#10073195, @Ifrahkhanyaree_WMDE wrote: > Confirming that everything wor... [14:17:38] 10Data-Engineering (Q1 2024 July 1st - September 30th), 10Data Pipelines, 10Data-Catalog: Spike: Integrate Spark with DataHub - https://phabricator.wikimedia.org/T306896#10073415 (10xcollazo) >>! In T306896#10072820, @BTullis wrote: > I don't know if it is useful, but @xcollazo did some work on using custom... [14:19:41] 10Data-Engineering (Q1 2024 July 1st - September 30th), 10Data Pipelines, 10Data-Catalog: Spike: Integrate Spark with DataHub - https://phabricator.wikimedia.org/T306896#10073438 (10xcollazo) (Shameless plug {T338057}) [14:21:46] 07Analytics-Data-Problem, 06Data-Engineering, 10Data-Engineering-Dashiki, 10Data Products (Data Products Sprint 17), 10MediaWiki-Platform-Team (Radar): Investigate surprising "10% Other" portion of Analytics Browsers report - https://phabricator.wikimedia.org/T342267#10073452 (10Milimetric) > So to confi... [14:49:46] (03PS1) 10Mforns: Update changelog.md for v0.2.48 [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1063822 [14:50:39] (03CR) 10Mforns: [V:03+2 C:03+2] "LGTM!" [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1063822 (owner: 10Mforns) [14:51:58] Starting build #14 for job analytics-refinery-maven-release [15:11:08] Project analytics-refinery-maven-release build #14: 04FAILURE in 19 min: https://integration.wikimedia.org/ci/job/analytics-refinery-maven-release/14/ [15:15:03] Starting build #15 for job analytics-refinery-maven-release [15:34:16] Yippee, build fixed! [15:34:16] Project analytics-refinery-maven-release build #15: 09FIXED in 19 min: https://integration.wikimedia.org/ci/job/analytics-refinery-maven-release/15/ [15:41:13] Starting build #13 for job analytics-refinery-update-jars [15:43:03] (03PS1) 10Maven-release-user: Add refinery-source jars for v0.2.48 to artifacts [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1063839 [15:43:03] Project analytics-refinery-update-jars build #13: 09SUCCESS in 1 min 50 sec: https://integration.wikimedia.org/ci/job/analytics-refinery-update-jars/13/ [15:48:32] (03CR) 10Mforns: [V:03+2 C:03+2] "LGTM!" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1063839 (owner: 10Maven-release-user) [15:50:33] 06Data-Engineering, 06Data Products, 06DBA, 07Schema-change-in-production: Change page.page_links_updated to fixed-length timestamp in wmf wikis - https://phabricator.wikimedia.org/T371742#10074039 (10VirginiaPoundstone) @Umherirrender what is the timeline for this work? This change will have has critica... [15:57:27] !log deployed refinery-source for v0.2.48 [15:57:29] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [15:57:47] 06Data-Engineering, 06Data Products, 06DBA, 07Schema-change-in-production: Change page.page_links_updated to fixed-length timestamp in wmf wikis - https://phabricator.wikimedia.org/T371742#10074084 (10Ladsgroup) are you sure? This is just changing the data type from varbinary to binary, there shouldn't be... [16:00:24] 06Data-Engineering, 06Data Products, 06Data-Platform, 06DBA, and 2 others: Change page.page_links_updated to fixed-length timestamp in wmf wikis - https://phabricator.wikimedia.org/T371742#10074098 (10WDoranWMF) [16:11:59] 06Data-Engineering, 06Data Products, 06Data-Platform, 06DBA, 07Schema-change-in-production: Change page.page_links_updated to fixed-length timestamp in wmf wikis - https://phabricator.wikimedia.org/T371742#10074158 (10Ladsgroup) [16:46:57] (03CR) 10Mforns: Add MP fragment schema for translation workflows (034 comments) [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/1061096 (https://phabricator.wikimedia.org/T369687) (owner: 10Mforns) [17:42:09] !log starting refinery deploy (just links for v0.2.48) [17:42:10] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [18:52:57] 10Data-Engineering (Q1 2024 July 1st - September 30th), 10Dumps 2.0 (Kanban Board), 10Event-Platform: [BUG] MediawikiPageContentChangeEnrichAvailability is firing - https://phabricator.wikimedia.org/T372768#10075066 (10gmodena) [19:33:57] !log finished refinery deploy (just links for v0.2.48) [19:33:59] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [20:45:03] !log deployed airflow-dags to analytics_test instance for T368303 [20:45:05] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [20:45:05] T368303: REQUEST: Add Special:AllEvents to allowlist for campaigns-product pageview tracking - https://phabricator.wikimedia.org/T368303 [20:58:08] 10Quarry, 10superset.wmcloud.org: Analysis and metrics collection for quarry and superset adoption - https://phabricator.wikimedia.org/T369150#10075628 (10rook) Superset was deployed almost a year ago. I've made a graph of the daily queries in superset and quarry. The total queries between last September's lau...