[00:16:08] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10Cloud-VPS (Debian Bullseye Deprecation), 10Event-Platform: Upgrade (replace) beta|deployment-prep event platform VPS instances - https://phabricator.wikimedia.org/T429497#12283790 (10Ottomata) 🫡 Already added to task description and noted to Thoma... [00:44:00] 06Data-Engineering, 10DPE-MediaWiki-Incremental-History, 10Event-Platform, 13Patch-For-Review: Create new mediawiki.tags_change event stream - https://phabricator.wikimedia.org/T434143#12283823 (10Ottomata) OH, in MR81 adding the log entity schema, I [[ https://gitlab.wikimedia.org/repos/data-engineering/s... [01:06:52] 06Data-Engineering: Backfill wmf_objective_metrics.heartbeat_active_editors for June 2026 - https://phabricator.wikimedia.org/T436886 (10nshahquinn-wmf) 03NEW [01:07:09] 06Data-Engineering: Backfill wmf_objective_metrics.heartbeat_active_editors for June 2026 - https://phabricator.wikimedia.org/T436886#12283845 (10nshahquinn-wmf) [01:13:37] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10DPE-MediaWiki-Incremental-History, 13Patch-For-Review: migrate dbt_jobs pipelines to use MWH incremental - https://phabricator.wikimedia.org/T429770#12283854 (10nshahquinn-wmf) @Milimetric and I took a look at the [hearbeat_active_editors_mart MR](... [01:40:52] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10DPE-MediaWiki-Incremental-History, 13Patch-For-Review: migrate dbt_jobs pipelines to use MWH incremental - https://phabricator.wikimedia.org/T429770#12283876 (10nshahquinn-wmf) @APizzata-WMF, given that active editors is so close, I'd suggest focus... [02:23:45] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10DPE-MediaWiki-Incremental-History, 13Patch-For-Review: migrate dbt_jobs pipelines to use MWH incremental - https://phabricator.wikimedia.org/T429770#12283895 (10nshahquinn-wmf) Here's my understanding of the status of the active UWERs migration: -... [07:05:35] 06Data-Engineering, 06SRE, 10SRE-Access-Requests, 13Patch-For-Review: Requesting Kerberos access for kamila - https://phabricator.wikimedia.org/T436703#12284205 (10MLechvien-WMF) > @MLechvien-WMF as my manager, can you please approve this? I approve that request [08:18:29] 06Data-Engineering, 10ChangeProp, 10EventStreams, 10Proton, and 5 others: Migrate node-based services in production to node20 - https://phabricator.wikimedia.org/T364779#12284363 (10Dreamy_Jazz) [09:45:27] 06Data-Engineering, 06Data-Platform-SRE, 10Dumps-Generation: 7za is OOMkilled when dumps are running on a Bookworm-based image - https://phabricator.wikimedia.org/T436913 (10brouberol) 03NEW p:05Triage→03High [09:47:47] 06Data-Engineering, 06Data-Platform-SRE, 10Dumps-Generation: 7za is OOMkilled when dumps are running on a Bookworm-based image - https://phabricator.wikimedia.org/T436913#12284755 (10brouberol) [10:16:02] 06Data-Engineering, 06SRE, 10SRE-Access-Requests, 13Patch-For-Review: Requesting Kerberos access for kamila - https://phabricator.wikimedia.org/T436703#12284861 (10Volans) 05Open→03Resolved a:03Volans @Raine patch merged, kerberos principal created, you should have received an email about it and... [11:34:46] 06Data-Engineering, 06Traffic: Add backend information to webrequests in data lake - https://phabricator.wikimedia.org/T436223#12285273 (10GGoncalves-WMF) This looks like something that Traffic SRE would initiate, ensuring this information is included in events produced at the edge, and then Data Engineering c... [11:35:02] 06Data-Engineering, 06Data-Engineering-Radar, 06Traffic: Add backend information to webrequests in data lake - https://phabricator.wikimedia.org/T436223#12285275 (10GGoncalves-WMF) [11:45:19] 06Data-Engineering, 06SRE, 10SRE-Access-Requests: Requesting Kerberos access for kamila - https://phabricator.wikimedia.org/T436703#12285310 (10Raine) Working, awesome sauce, thanks! [15:10:56] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10Event-Platform, 13Patch-For-Review: Relative Trending - Milestone 4 - Storage - https://phabricator.wikimedia.org/T431555#12286426 (10JMonton-WMF) For the record, I've done a test where our Flink application produces updates for Mediawiki, based on... [15:49:26] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10Dumps-Generation: mediawiki_content_current exports silently omit all pages edited between the snapshot cutoff and dump generation time - https://phabricator.wikimedia.org/T431872#12286605 (10xcollazo) Corrected exports for the reported wikis are now... [16:29:13] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): Load Google Search Console AI impressions into the data lake - https://phabricator.wikimedia.org/T436573#12286730 (10Antoine_Quhen) I don't have access to the gsc dashboard as it requires dns access to be setup. @Ahoelzl please let me know when the expo... [17:09:21] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): IR2.1.2d: Feature count data product [Attribution API] - https://phabricator.wikimedia.org/T432604#12286829 (10AKhatun_WMF) [17:09:22] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 07Documentation: Complete Documentation of Article Feature Counts - https://phabricator.wikimedia.org/T436717#12286827 (10AKhatun_WMF) [17:11:34] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 07Documentation: Complete Documentation of Article Feature Counts - https://phabricator.wikimedia.org/T436717#12286834 (10AKhatun_WMF) [17:12:07] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 07Documentation: Complete Documentation of Article Feature Counts - https://phabricator.wikimedia.org/T436717#12286838 (10AKhatun_WMF) [17:15:22] 06Data-Engineering, 06Product-Analytics: Analyze differences between checksum-based and revert-tag based reverts in mediawiki_history - https://phabricator.wikimedia.org/T266374#12286844 (10Isaac) 05Open→03Resolved a:03Isaac Just following up here and boldly resolving (please undo if there was more w... [17:43:57] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10Data-Persistence-Design-Review, 10Event-Platform, 13Patch-For-Review: [Data Persistence Design Review] Relative trending pages - https://phabricator.wikimedia.org/T432352#12287034 (10pmiazga) This sounds good, only a minor nitpick - lets keep it... [18:00:08] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 06Commons, 06Data-Persistence, 07OKR-Work: Data Lake - sqoop of commons link tables needs to adapt to move to dedicated MariaDB cluster - https://phabricator.wikimedia.org/T431476#12287053 (10Ottomata) a:05Milimetric→03Ottomata [18:05:26] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): Linked Artifact Cache - Automated MediaWiki JobQueue precompute - https://phabricator.wikimedia.org/T436695#12287123 (10Ottomata) [18:12:16] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10Data-Persistence-Design-Review, 10Event-Platform, 13Patch-For-Review: [Data Persistence Design Review] Relative trending pages - https://phabricator.wikimedia.org/T432352#12287179 (10JMonton-WMF) Ok, I'll work on that tomorrow, thanks! I've doin... [18:20:42] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): Fix dataset.yaml entries for wmf_raw.mediawiki.* tables - https://phabricator.wikimedia.org/T436879#12287192 (10amastilovic) Done. [18:20:59] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): Update DBT Airflow operator's task notes only in case of failure - https://phabricator.wikimedia.org/T436410#12287193 (10amastilovic) Done. [18:33:58] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 06Commons, 06Data-Persistence, 07OKR-Work: Data Lake - sqoop of commons link tables needs to adapt to move to dedicated MariaDB cluster - https://phabricator.wikimedia.org/T431476#12287288 (10Ottomata) @Ladsgroup @Zabe, we use [[ https://gerrit.wik... [18:34:42] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 06Commons, 06Data-Persistence, 07OKR-Work: Data Lake - sqoop of commons link tables needs to adapt to move to dedicated MariaDB cluster - https://phabricator.wikimedia.org/T431476#12287291 (10Ottomata) Also, from what I can tell, the work to migrat... [18:39:53] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 06Commons, 06Data-Persistence, 07OKR-Work: Data Lake - sqoop of commons link tables needs to adapt to move to dedicated MariaDB cluster - https://phabricator.wikimedia.org/T431476#12287323 (10Ottomata) a:05Ottomata→03Ahoelzl [18:54:49] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 06Commons, 06Data-Persistence, 07OKR-Work: Data Lake - sqoop of commons link tables needs to adapt to move to dedicated MariaDB cluster - https://phabricator.wikimedia.org/T431476#12287395 (10Ladsgroup) >>! In T431476#12287288, @Ottomata wrote: > @... [19:19:37] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 06Commons, 06Data-Persistence, 07OKR-Work: Data Lake - sqoop of commons link tables needs to adapt to move to dedicated MariaDB cluster - https://phabricator.wikimedia.org/T431476#12287432 (10Ottomata) > The only thing that is going to have a diffe... [19:51:20] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 06Commons, 06Data-Persistence, 07OKR-Work: Data Lake - sqoop of commons link tables needs to adapt to move to dedicated MariaDB cluster - https://phabricator.wikimedia.org/T431476#12287544 (10Ladsgroup) >>! In T431476#12287432, @Ottomata wrote: >>... [20:01:38] 06Data-Engineering, 06Data-Engineering-Icebox, 10Tool-Pageviews, 07User-notice: Pageviews Analysis 2026 (Vue + Codex) - https://phabricator.wikimedia.org/T378549#12287581 (10MusikAnimal) I think we should advertise in Tech News, especially given the new features. I've added an entry: https://meta.wikim... [20:02:25] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 06Commons, 06Data-Persistence, 07OKR-Work: Data Lake - sqoop of commons link tables needs to adapt to move to dedicated MariaDB cluster - https://phabricator.wikimedia.org/T431476#12287583 (10Ottomata) We query from all wikis. Rather than duplicati... [20:04:03] (03PS1) 10Ottomata: sqoop-mediawiki-tables - add a DB_MAPPING_TABLE_OVERRIDES [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1335154 (https://phabricator.wikimedia.org/T431476) [20:45:27] (03CR) 10Aleksandar Mastilovic: [C:03+2] "LGTM!" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1335154 (https://phabricator.wikimedia.org/T431476) (owner: 10Ottomata) [20:47:36] FIRING: MediawikiContentHistoryReconcileEnrichHighKafkaConsumerLag: ... [20:47:36] High Kafka consumer lag for mw_content_history_reconcile_enrich in eqiad - TODO - https://grafana.wikimedia.org/d/K9x0c4aVk/flink-app?orgId=1&var-datasource=eqiad%20prometheus/k8s-dse&var-namespace=mw-content-history-reconcile-enrich&var-helm_release=production&var-operator_name=All&var-flink_job_name=mw_content_history_reconcile_enrich - https://alerts.wikimedia.org/?q=alertname%3DMediawikiContentHistoryReconcileEnrichHighKafkaConsumerLag [20:57:36] RESOLVED: MediawikiContentHistoryReconcileEnrichHighKafkaConsumerLag: ... [20:57:36] High Kafka consumer lag for mw_content_history_reconcile_enrich in eqiad - TODO - https://grafana.wikimedia.org/d/K9x0c4aVk/flink-app?orgId=1&var-datasource=eqiad%20prometheus/k8s-dse&var-namespace=mw-content-history-reconcile-enrich&var-helm_release=production&var-operator_name=All&var-flink_job_name=mw_content_history_reconcile_enrich - https://alerts.wikimedia.org/?q=alertname%3DMediawikiContentHistoryReconcileEnrichHighKafkaConsumerLag [21:14:36] FIRING: MediawikiContentHistoryReconcileEnrichHighKafkaConsumerLag: ... [21:14:36] High Kafka consumer lag for mw_content_history_reconcile_enrich in eqiad - TODO - https://grafana.wikimedia.org/d/K9x0c4aVk/flink-app?orgId=1&var-datasource=eqiad%20prometheus/k8s-dse&var-namespace=mw-content-history-reconcile-enrich&var-helm_release=production&var-operator_name=All&var-flink_job_name=mw_content_history_reconcile_enrich - https://alerts.wikimedia.org/?q=alertname%3DMediawikiContentHistoryReconcileEnrichHighKafkaConsumerLag [21:19:36] FIRING: [2x] MediawikiContentHistoryReconcileEnrichHighKafkaConsumerLag: ... [21:19:36] High Kafka consumer lag for mw_content_history_reconcile_enrich in eqiad - TODO - https://grafana.wikimedia.org/d/K9x0c4aVk/flink-app?orgId=1&var-datasource=eqiad%20prometheus/k8s-dse&var-namespace=mw-content-history-reconcile-enrich&var-helm_release=production&var-operator_name=All&var-flink_job_name=mw_content_history_reconcile_enrich - https://alerts.wikimedia.org/?q=alertname%3DMediawikiContentHistoryReconcileEnrichHighKafkaConsumerLag [21:20:50] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 13Patch-For-Review: Load Google Search Console data from BigQuery as soon as it's available and reload when data corrections occur - https://phabricator.wikimedia.org/T436193#12287819 (10nshahquinn-wmf) Just confirmed the immediate loading is already w... [21:22:02] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): Reload Google Search Console data for 13-17 August 2026 - https://phabricator.wikimedia.org/T436144#12287823 (10nshahquinn-wmf) Just confirmed that data in `wmf_raw.google_search_console_site_impression` for these days matches the data in the web console... [21:55:23] 06Data-Engineering, 05Metrics-Sprint-2026-2027: Backfill and update schedule of gcp_gsc_export.max_date_sitedata_daily_aggregate - https://phabricator.wikimedia.org/T436999 (10nshahquinn-wmf) 03NEW [21:59:09] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): IR2.1.2d: Feature count data product [Attribution API] - https://phabricator.wikimedia.org/T432604#12287936 (10AKhatun_WMF) [22:15:34] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): Implement ArticleFeatureCounts Application - https://phabricator.wikimedia.org/T437000 (10AKhatun_WMF) 03NEW [23:52:56] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 06Commons, 06Data-Persistence, 07OKR-Work, 13Patch-For-Review: Data Lake - sqoop of commons link tables needs to adapt to move to dedicated MariaDB cluster - https://phabricator.wikimedia.org/T431476#12288067 (10Ladsgroup) I think that's an out-d... [23:59:36] FIRING: [2x] MediawikiContentHistoryReconcileEnrichHighKafkaConsumerLag: ... [23:59:36] High Kafka consumer lag for mw_content_history_reconcile_enrich in eqiad - TODO - https://grafana.wikimedia.org/d/K9x0c4aVk/flink-app?orgId=1&var-datasource=eqiad%20prometheus/k8s-dse&var-namespace=mw-content-history-reconcile-enrich&var-helm_release=production&var-operator_name=All&var-flink_job_name=mw_content_history_reconcile_enrich - https://alerts.wikimedia.org/?q=alertname%3DMediawikiContentHistoryReconcileEnrichHighKafkaConsumerLag