[00:49:59] 06Data-Engineering, 10Test Kitchen, 07Essential-Work: Improve instrument event data data lake management - https://phabricator.wikimedia.org/T429385#12027460 (10Ottomata) > would that data live in an instrument_name=null partition(?) Hm! I don't know! I asked that question not to block this task at all, b... [01:16:58] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 10DPE-MediaWiki-Incremental-History, 10Event-Platform, 13Patch-For-Review: mediawiki.page_change.v1 event - Add user first_registration_dt field - https://phabricator.wikimedia.org/T426998#12027471 (10Ottomata) Thank you so much @mszwarc. Indeed that... [01:46:39] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10Event-Platform: mediawiki.page_change.v1 event - add a 'new revision created' field - https://phabricator.wikimedia.org/T409464#12027478 (10Ottomata) Yes, or possibly just a generic event platform related improvement. I'm not certain this would be us... [03:39:37] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 13Patch-For-Review: Airflow devenv cannot run SkeinOperator - https://phabricator.wikimedia.org/T429410#12027533 (10AKhatun_WMF) [04:06:15] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 06Data-Platform-SRE, 06Traffic: Provide a scheduled data download service from Google Cloud Storage - https://phabricator.wikimedia.org/T427457#12027563 (10Ahoelzl) @Antoine_Quhen newly has access to Google Cloud and can configure granular data access go... [06:24:07] FIRING: EventgateProduceRateAnomaly: Significant produce rate deviation (+-25%) on eventgate-logging-external. - https://wikitech.wikimedia.org/wiki/Event_Platform/EventGate - https://grafana.wikimedia.org/d/ZB39Izmnz/eventgate?orgId=1&refresh=1m&var-dc=000000026&var-service=eventgate-logging-external - https://alerts.wikimedia.org/?q=alertname%3DEventgateProduceRateAnomaly [06:29:07] RESOLVED: EventgateProduceRateAnomaly: Significant produce rate deviation (+-25%) on eventgate-logging-external. - https://wikitech.wikimedia.org/wiki/Event_Platform/EventGate - https://grafana.wikimedia.org/d/ZB39Izmnz/eventgate?orgId=1&refresh=1m&var-dc=000000026&var-service=eventgate-logging-external - https://alerts.wikimedia.org/?q=alertname%3DEventgateProduceRateAnomaly [06:37:07] FIRING: EventgateProduceRateAnomaly: Significant produce rate deviation (+-25%) on eventgate-logging-external. - https://wikitech.wikimedia.org/wiki/Event_Platform/EventGate - https://grafana.wikimedia.org/d/ZB39Izmnz/eventgate?orgId=1&refresh=1m&var-dc=000000026&var-service=eventgate-logging-external - https://alerts.wikimedia.org/?q=alertname%3DEventgateProduceRateAnomaly [06:42:06] RESOLVED: EventgateProduceRateAnomaly: Significant produce rate deviation (+-25%) on eventgate-logging-external. - https://wikitech.wikimedia.org/wiki/Event_Platform/EventGate - https://grafana.wikimedia.org/d/ZB39Izmnz/eventgate?orgId=1&refresh=1m&var-dc=000000026&var-service=eventgate-logging-external - https://alerts.wikimedia.org/?q=alertname%3DEventgateProduceRateAnomaly [08:00:51] 06Data-Engineering: dbt: per-group DAG generation + a dedicated dbt Airflow instance - https://phabricator.wikimedia.org/T429439#12027994 (10Aklapper) [08:04:23] PROBLEM - statsv Varnishkafka log producer on cp7005 is CRITICAL: PROCS CRITICAL: 2 processes with args /usr/bin/varnishkafka -S /etc/varnishkafka/statsv.conf https://wikitech.wikimedia.org/wiki/Analytics/Systems/Varnishkafka [08:05:23] RECOVERY - statsv Varnishkafka log producer on cp7005 is OK: PROCS OK: 1 process with args /usr/bin/varnishkafka -S /etc/varnishkafka/statsv.conf https://wikitech.wikimedia.org/wiki/Analytics/Systems/Varnishkafka [08:13:37] 14Analytics-Radar, 06Data-Engineering, 06Data-Platform-SRE, 06serviceops-radar, and 2 others: Configuration Management for Kafka settings - https://phabricator.wikimedia.org/T276088#12028023 (10RKemper) We should be able to get the PoC working again by bumping confluent-kafka to 2.14.2 (latest) and swappin... [08:32:48] 14Analytics-Radar, 06Data-Engineering, 06Data-Platform-SRE, 06serviceops-radar, and 2 others: Configuration Management for Kafka settings - https://phabricator.wikimedia.org/T276088#12028089 (10elukey) We have a Kafka upgrade Cloud project that we could use with Pontoon, we could use it to create the PoC i... [08:37:15] 06Data-Engineering, 06Data-Platform-SRE (2026-06-05 - 2026-06-26), 13Patch-For-Review: Add a presto query logger - https://phabricator.wikimedia.org/T269832#12028120 (10Gehel) We expect #data-engineering to work on this. [08:41:57] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st): Request for backfill of webrequest with is_api_request and ip_provenance columns - https://phabricator.wikimedia.org/T427474#12028142 (10KCVelaga_WMF) >>! In T427474#12026589, @Ahoelzl wrote: > @JAllemandou @KCVelaga_WMF can you provide an update on the prog... [08:57:29] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): Include pageview_actor in Turnilo - https://phabricator.wikimedia.org/T424235#12028193 (10JAllemandou) From an engineering perspective, "in turnilo" means being stored in Druid. It is not feasible to store the `pageview_actor` table in druid in its curre... [09:13:51] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st): The revision_seconds_to_identity_revert field in wmf.mediawiki_history has sometimes negative values - https://phabricator.wikimedia.org/T419267#12028281 (10JAllemandou) I think we should park this task until we have new instances of the problem. My assumpti... [09:29:27] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 10Event-Platform: Fix PyFlink log levels - https://phabricator.wikimedia.org/T419997#12028334 (10JMonton-WMF) [09:31:03] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 10Event-Platform, 13Patch-For-Review: Audit and fix observability (logging and metrics) for pyflink jobs - https://phabricator.wikimedia.org/T418996#12028342 (10JMonton-WMF) 05Open→03Resolved [09:32:51] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 10Event-Platform, 13Patch-For-Review: Streaming HTML & Edit Types - productionization checklist - https://phabricator.wikimedia.org/T423920#12028359 (10JMonton-WMF) [09:35:06] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 10Event-Platform, 13Patch-For-Review: Streaming HTML & Edit Types - productionization checklist - https://phabricator.wikimedia.org/T423920#12028368 (10JMonton-WMF) [09:36:13] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 10Event-Platform, 13Patch-For-Review: Streaming HTML & Edit Types - productionization checklist - https://phabricator.wikimedia.org/T423920#12028376 (10JMonton-WMF) I think we can move this task to "Done". There are a few additional tasks that we could d... [09:38:32] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 10Event-Platform: `mediawiki.page_change.v1`: two schema validation errors causing events to be silently dropped by EventGate - https://phabricator.wikimedia.org/T421237#12028397 (10JMonton-WMF) Hi @dcausse, Do you know if `Flink cirrus-streaming-updater... [09:38:44] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 10Event-Platform: `mediawiki.page_change.v1`: two schema validation errors causing events to be silently dropped by EventGate - https://phabricator.wikimedia.org/T421237#12028398 (10JMonton-WMF) [09:43:02] (03PS2) 10Joal: Update Incremental MWH with a fix [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1302824 (https://phabricator.wikimedia.org/T428928) [09:43:45] (03CR) 10Joal: "Should be good to go :)" [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1302824 (https://phabricator.wikimedia.org/T428928) (owner: 10Joal) [09:57:59] (03CR) 10CI reject: [V:04-1] Update Incremental MWH with a fix [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1302824 (https://phabricator.wikimedia.org/T428928) (owner: 10Joal) [09:58:32] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 10Event-Platform, 13Patch-For-Review: Flink - Test `zstd` compression - https://phabricator.wikimedia.org/T429456#12028482 (10JMonton-WMF) [10:21:31] 06Data-Engineering, 10Test Kitchen, 07Essential-Work: Improve instrument event data data lake management - https://phabricator.wikimedia.org/T429385#12028526 (10GGoncalves-WMF) This looks good to me, thanks for proposing! So overall the story for experiment owners becomes: 1. Create your experiment. 2. Use... [10:33:18] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 10DPE-Mediawiki-Content: Bug: fix page_id for redirect_page_link - https://phabricator.wikimedia.org/T429457 (10APizzata-WMF) 03NEW [10:34:51] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 10DPE-Mediawiki-Content: Bug: fix page_id for redirect_page_link - https://phabricator.wikimedia.org/T429457#12028564 (10APizzata-WMF) By checking the content of the `event.mediawiki_page_change_v1` we can see that in case of interwiki we has results like... [11:08:02] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st): WE5.3.3b: Contributor Count Per Page [Attribution API] - https://phabricator.wikimedia.org/T426316#12028713 (10AKhatun_WMF) The pipeline is ready, tested in staging. Data pipeline and Cassandra loads are working great. ## What it is Distinct **visible** ed... [11:10:27] (03PS1) 10Seanleong-wmde: Adding execute permission to wikpedia recentChanges.php [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/1303388 (https://phabricator.wikimedia.org/T426384) [11:13:15] (03CR) 10Awight: [C:03+2] "That should do it!" [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/1303388 (https://phabricator.wikimedia.org/T426384) (owner: 10Seanleong-wmde) [11:14:18] (03Merged) 10jenkins-bot: Adding execute permission to wikpedia recentChanges.php [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/1303388 (https://phabricator.wikimedia.org/T426384) (owner: 10Seanleong-wmde) [11:16:35] (03PS1) 10Seanleong-wmde: Adding execute permission to wikpedia recentChanges.php [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/1303392 (https://phabricator.wikimedia.org/T426384) [11:27:49] !log Test Kitchen experiment (poll 16989) - adds: none; removes: none; fields: incident_reporting_system_interaction - TK tips at https://w.wiki/FwuD [11:27:51] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [12:18:44] (03CR) 10Joal: [V:03+2 C:03+2] "Merging for later dpeloy - no-op" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1302825 (https://phabricator.wikimedia.org/T428928) (owner: 10Joal) [12:46:40] (03CR) 10Awight: [C:03+2] Adding execute permission to wikpedia recentChanges.php [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/1303392 (https://phabricator.wikimedia.org/T426384) (owner: 10Seanleong-wmde) [12:47:09] (03Merged) 10jenkins-bot: Adding execute permission to wikpedia recentChanges.php [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/1303392 (https://phabricator.wikimedia.org/T426384) (owner: 10Seanleong-wmde) [12:50:11] 06Data-Engineering, 06Commons, 10MediaWiki-File-management, 07Schema-change: Future of filearchive table - https://phabricator.wikimedia.org/T425897#12029040 (10jcrespo) @Ladsgroup Should I keep scanning filearchive table to backup deleted files for now? My understanding is currently yes. [13:07:17] 06Data-Engineering, 06Commons, 10MediaWiki-File-management, 07Schema-change: Future of filearchive table - https://phabricator.wikimedia.org/T425897#12029101 (10Ladsgroup) Yes. filearchive is not going to be changed at all in the foreseeable future. I don't think the subtasks here are correctly honestly. [13:23:28] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st): haproxykafka and varnishkafka sent different uri_paths - https://phabricator.wikimedia.org/T418767#12029184 (10Milimetric) I was just thinking of starting this when the other work got prioritized over it. I would still love to do it, if it can wait until Ju... [13:54:41] 06Data-Engineering: DBT: Standardize start and end date variable configuration and usage across dbt-jobs - https://phabricator.wikimedia.org/T429483 (10amastilovic) 03NEW [14:24:34] 06Data-Engineering, 10Test Kitchen, 07Essential-Work: Improve instrument event data data lake management - https://phabricator.wikimedia.org/T429385#12029633 (10Ottomata) > product_metrics_web_base is not a great target anyway, as we shouldn't be telling people to query it directly from a dashboard. Yeah, t... [14:30:07] !log Test Kitchen experiment (poll 18076) - adds: none; removes: fy25-26-we-1-7-8-suggestion-mode-beta; fields: none - TK tips at https://w.wiki/FwuD [14:30:09] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [14:32:28] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 06Data-Platform-SRE (2026-06-05 - 2026-06-26), 13Patch-For-Review: Add a presto query logger - https://phabricator.wikimedia.org/T269832#12029685 (10Ahoelzl) a:03JAllemandou [14:47:13] 06Data-Engineering, 06cloud-services-team, 10Cloud-VPS (Debian Bullseye Deprecation), 10Event-Platform: Upgrade (replace) beta|deployment-prep event platform VPS instances - https://phabricator.wikimedia.org/T429497 (10Ottomata) 03NEW [14:48:32] 06Data-Engineering, 06cloud-services-team, 10Cloud-VPS (Debian Bullseye Deprecation), 10Event-Platform: Upgrade (replace) beta|deployment-prep event platform VPS instances - https://phabricator.wikimedia.org/T429497#12029785 (10Ottomata) cc #editing_qa and #test_kitchen: Do you all use event platform in be... [14:50:55] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 10MediaWiki-REST-API, 10Tool-wikimedia-attribution: Check Editor Counts - https://phabricator.wikimedia.org/T427548#12029792 (10HCoplin-WMF) a:05HCoplin-WMF→03pmiazga @pmiazga will take a look at this this week. The recommendation from our sync was... [14:54:20] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 07OKR-Work (WE1 FY2025-26): [Spike] Adding access_method metadata to moderator action event streams - https://phabricator.wikimedia.org/T419019#12029798 (10CMyrick-WMF) @Ahoelzl Thanks for following up. For the MAM metrics work, we were able to go with [[... [14:58:19] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 10MediaWiki-REST-API, 06MW-Interfaces-Team, 10Tool-wikimedia-attribution: Check Editor Counts - https://phabricator.wikimedia.org/T427548#12029812 (10HCoplin-WMF) [15:00:20] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 07OKR-Work (WE1 FY2025-26): [Spike] Adding access_method metadata to moderator action event streams - https://phabricator.wikimedia.org/T419019#12029816 (10Ottomata) FWIW, I started looking into this in early May, but it is more complex than I originally t... [15:17:47] (03PS1) 10A-pizzata: Change comment line for event_user_groups_historical. [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1303466 (https://phabricator.wikimedia.org/T428928) [15:22:03] (03PS2) 10A-pizzata: Change comment line for event_user_groups_historical. [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1303466 (https://phabricator.wikimedia.org/T428928) [15:23:56] (03CR) 10Joal: [V:03+2 C:03+2] "Merging for later dpeloy" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1303466 (https://phabricator.wikimedia.org/T428928) (owner: 10A-pizzata) [15:28:52] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10DPE-MediaWiki-Incremental-History: Iceberg 1.6.1 vectorized Parquet reader crashes Spark 3.5 SELECTs - https://phabricator.wikimedia.org/T426801#12029982 (10APizzata-WMF) [15:40:22] !log Test Kitchen experiment (poll 18495) - adds: fy25-26-we-1-7-8-suggestion-mode-beta; removes: none; fields: none - TK tips at https://w.wiki/FwuD [15:40:24] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [16:20:53] 06Data-Engineering, 06Commons, 10MediaWiki-File-management, 07Schema-change: Future of filearchive table - https://phabricator.wikimedia.org/T425897#12030401 (10Bugreporter) One of reasons of {T20493} is deleting and undeleting pages with many revisions involves moving rows between tables, which is much sl... [16:27:17] 06Data-Engineering, 06Commons, 10MediaWiki-File-management, 07Schema-change: Future of filearchive table - https://phabricator.wikimedia.org/T425897#12030438 (10Bugreporter) [16:55:06] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 10Event-Platform, 13Patch-For-Review: `mediawiki.page_change.v1`: two schema validation errors causing events to be silently dropped by EventGate - https://phabricator.wikimedia.org/T421237#12030515 (10dcausse) >>! In T421237#12028397, @JMonton-WMF wrote... [16:55:23] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 10Event-Platform, 13Patch-For-Review: `mediawiki.page_change.v1`: two schema validation errors causing events to be silently dropped by EventGate - https://phabricator.wikimedia.org/T421237#12030516 (10dcausse) [17:00:31] !log Test Kitchen experiment (poll 18973) - adds: logged-out-retention-round16; removes: none; fields: none - TK tips at https://w.wiki/FwuD [17:00:33] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [17:03:14] 06Data-Engineering, 06Data-Persistence, 06Data-Platform-SRE, 10Dumps-Generation: XML dumps does not re-load the config for depooled databases - https://phabricator.wikimedia.org/T429282#12030544 (10Ottomata) Tagging #data-platform-sre and @btullis for help. [17:04:24] 06Data-Engineering: Add user status details for cross-wiki users in MWH - https://phabricator.wikimedia.org/T428018#12030556 (10Ottomata) [17:04:36] 06Data-Engineering, 10DPE-MediaWiki-Incremental-History: Add user status details for cross-wiki users in MWH - https://phabricator.wikimedia.org/T428018#12030561 (10Ottomata) [17:05:18] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10DPE-MediaWiki-Incremental-History: Add user status details for cross-wiki users in MWH - https://phabricator.wikimedia.org/T428018#12030563 (10Ottomata) a:03Ahoelzl [17:05:21] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10DPE-MediaWiki-Incremental-History: Add user status details for cross-wiki users in MWH - https://phabricator.wikimedia.org/T428018#12030565 (10Ottomata) [17:07:40] 06Data-Engineering, 06Data-Engineering-Radar, 06Commons, 10MediaWiki-File-management, 07Schema-change: Future of filearchive table - https://phabricator.wikimedia.org/T425897#12030570 (10Ottomata) [17:07:55] 06Data-Engineering, 06Data-Persistence, 06Data-Platform-SRE, 10Dumps-Generation: XML dumps does not re-load the config for depooled databases - https://phabricator.wikimedia.org/T429282#12030575 (10BTullis) I will kill the job from here: https://airflow-test-k8s.wikimedia.org/dags/mediawiki_dumps_sql_xml_l... [17:07:59] 06Data-Engineering, 13Patch-For-Review: generate mediawiki_history_reduced spark job failing - 2026-06 - https://phabricator.wikimedia.org/T428242#12030576 (10Ottomata) 05Open→03Resolved a:03Ottomata [17:08:16] 06Data-Engineering, 13Patch-For-Review: generate mediawiki_history_reduced spark job failing - 2026-06 - https://phabricator.wikimedia.org/T428242#12030578 (10Ottomata) 05Resolved→03Open [17:08:34] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 13Patch-For-Review: generate mediawiki_history_reduced spark job failing - 2026-06 - https://phabricator.wikimedia.org/T428242#12030580 (10Ottomata) [17:09:02] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 10MediaWiki-REST-API, 06MW-Interfaces-Team, 10Tool-wikimedia-attribution: Check Editor Counts - https://phabricator.wikimedia.org/T427548#12030584 (10AKhatun_WMF) The staging table(s) now have all revisions from `simplewiki` as of `2026-06-17 15:41:50... [17:11:58] 06Data-Engineering: MediaWiki history dumps - wikidatawiki dump has 2 new undocumented columns - https://phabricator.wikimedia.org/T428251#12030615 (10Ottomata) a:03JAllemandou We recently added these fields as part of {T424350}. I don't think the output of the dump files was considered. We should: - ensure... [17:12:09] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): MediaWiki history dumps - wikidatawiki dump has 2 new undocumented columns - https://phabricator.wikimedia.org/T428251#12030623 (10Ottomata) [17:12:10] 06Data-Engineering, 06Data-Persistence, 06Data-Platform-SRE, 10Dumps-Generation: XML dumps does not re-load the config for depooled databases - https://phabricator.wikimedia.org/T429282#12030620 (10BTullis) Incidentally, I think that these full wikidata sql/xml dumps have been consistently failing to compl... [17:12:54] 06Data-Engineering: Update regular expressions for bot UserAgents - https://phabricator.wikimedia.org/T428267#12030631 (10Ottomata) a:03mforns [17:13:03] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): Update regular expressions for bot UserAgents - https://phabricator.wikimedia.org/T428267#12030634 (10Ottomata) [17:13:12] 06Data-Engineering, 06Data-Persistence, 06Data-Platform-SRE, 10Dumps-Generation: XML dumps does not re-load the config for depooled databases - https://phabricator.wikimedia.org/T429282#12030637 (10BTullis) @Marostegui - does this unblock your upgrade now? Please feel free to ping me direct if you're still... [17:13:37] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): Update regular expressions for bot UserAgents - https://phabricator.wikimedia.org/T428267#12030641 (10Ahoelzl) Do we expect these changes to happen regularly? Or do we need to review periodically? [17:14:57] 06Data-Engineering: Classify requests to developer.wikimedia.org as pageviews - https://phabricator.wikimedia.org/T428550#12030651 (10Ottomata) a:03mforns [17:15:01] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st): Classify requests to developer.wikimedia.org as pageviews - https://phabricator.wikimedia.org/T428550#12030653 (10Ottomata) [17:15:09] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st): Classify requests to developer.wikimedia.org as pageviews - https://phabricator.wikimedia.org/T428550#12030654 (10Ahoelzl) p:05Triage→03High [17:16:49] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st): [dbt] Contributor metrics for May off by 100x - https://phabricator.wikimedia.org/T428785#12030666 (10amastilovic) So to address points 1., 2. and 3. I've created the following: 1. An MR to address the need to standardize the handling of start_date and end_... [17:19:01] 06Data-Engineering: WMF Data Engineering Request: Additional Columns to Geoeditors Tables - https://phabricator.wikimedia.org/T428888#12030682 (10Ottomata) a:03Ahoelzl [17:21:09] 06Data-Engineering, 06DBA, 10DiscussionTools, 07Schema-change-in-production: Adapt sqoop configs to account for discussiontools tables only present on some wiki databases - https://phabricator.wikimedia.org/T428916#12030698 (10Ahoelzl) TODO: Make sqoop not fail when columns are dropped. [17:21:42] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 06DBA, 10DiscussionTools, 07Schema-change-in-production: Adapt sqoop configs to account for discussiontools tables only present on some wiki databases - https://phabricator.wikimedia.org/T428916#12030702 (10Ottomata) [17:26:00] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10DPE-MediaWiki-Incremental-History, 10Event-Platform: MediaWiki state change streams- add access_method & platform details - https://phabricator.wikimedia.org/T424887#12030744 (10Ottomata) [17:26:19] 06Data-Engineering: Track mobile app and api account registration separately - https://phabricator.wikimedia.org/T429211#12030745 (10Ottomata) [17:26:21] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10DPE-MediaWiki-Incremental-History, 10Event-Platform: MediaWiki state change streams- add access_method & platform details - https://phabricator.wikimedia.org/T424887#12030746 (10Ottomata) [17:26:30] 06Data-Engineering: Track mobile app and api account registration separately - https://phabricator.wikimedia.org/T429211#12030747 (10Ottomata) a:03Ahoelzl [17:26:38] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): Track mobile app and api account registration separately - https://phabricator.wikimedia.org/T429211#12030749 (10Ottomata) [17:29:03] 06Data-Engineering: Analyze Superset virtual datasets to find candidates for materialization - https://phabricator.wikimedia.org/T429226#12030756 (10Ottomata) a:03Ahoelzl [17:29:05] 06Data-Engineering, 07Epic: [Epic] Provide Data Warehouse functionality to support metrics and analysts - https://phabricator.wikimedia.org/T429517 (10Ahoelzl) 03NEW [17:29:12] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): Analyze Superset virtual datasets to find candidates for materialization - https://phabricator.wikimedia.org/T429226#12030770 (10Ottomata) [17:29:25] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): Analyze Superset virtual datasets to find candidates for materialization - https://phabricator.wikimedia.org/T429226#12030771 (10Ahoelzl) [17:29:26] 06Data-Engineering, 07Epic: [Epic] Provide Data Warehouse functionality to support metrics and analysts - https://phabricator.wikimedia.org/T429517#12030772 (10Ahoelzl) [17:29:40] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 07Epic: [Epic] Provide Data Warehouse functionality to support metrics and analysts - https://phabricator.wikimedia.org/T429517#12030777 (10Ahoelzl) [17:30:04] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 07Epic: [Epic] Design a Data Warehouse to support metrics and analysts - https://phabricator.wikimedia.org/T429517#12030778 (10Ahoelzl) a:03GGoncalves-WMF [17:31:44] 06Data-Engineering: event_sanitized.serversideaccountcreation reports users that actually don't exist - https://phabricator.wikimedia.org/T429288#12030791 (10Ottomata) I'm not sure, but is this a duplicate of {T429061}? In that, it turned out the comparison was just incorrect? Also, FYI, another data point for... [17:35:56] 06Data-Engineering, 06cloud-services-team, 10Cloud-VPS (Debian Bullseye Deprecation), 10Event-Platform: Upgrade (replace) beta|deployment-prep event platform VPS instances - https://phabricator.wikimedia.org/T429497#12030801 (10Ottomata) [17:37:27] 06Data-Engineering, 06cloud-services-team, 10Cloud-VPS (Debian Bullseye Deprecation), 10Event-Platform: Upgrade (replace) beta|deployment-prep event platform VPS instances - https://phabricator.wikimedia.org/T429497#12030805 (10Ahoelzl) p:05Triage→03High [17:41:29] 06Data-Engineering, 06cloud-services-team, 10Cloud-VPS (Debian Bullseye Deprecation), 10Event-Platform: Upgrade (replace) beta|deployment-prep event platform VPS instances - https://phabricator.wikimedia.org/T429497#12030808 (10Ottomata) a:03Ottomata Assigning to myself for coordination. [18:04:07] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 07Epic, 05MW-1.47-notes (1.47.0-wmf.6; 2026-06-09): Attribution Research: Instrument pageviews - https://phabricator.wikimedia.org/T417050#12030894 (10Ahoelzl) [18:38:15] 06Data-Engineering: Requesting Kerberos password reset - https://phabricator.wikimedia.org/T424268#12031094 (10SKaram-WMF) 05Resolved→03Open Please re-open as I need to reset password [18:45:18] 06Data-Engineering: Requesting Kerberos password reset - https://phabricator.wikimedia.org/T424268#12031136 (10ssingh) 05Open→03Resolved ` sukhe@krb1002:~$ sudo manage_principals.py reset-password skaramwmf --email_address=skaram@wikimedia.org Password reset successfully. Successfully sent email to skara... [19:29:19] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 10MediaWiki-REST-API, 06MW-Interfaces-Team, 10Tool-wikimedia-attribution: Check Editor Counts - https://phabricator.wikimedia.org/T427548#12031270 (10AKhatun_WMF) 1/ So I was looking at some pages, and wanted to note that we count "Editors", so revisi... [19:52:05] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 06Product-Analytics: dbt-jobs backfill: PP3 API hourly and known clients aggregate jobs - https://phabricator.wikimedia.org/T429341#12031365 (10KCVelaga_WMF) [20:26:17] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 05Metrics-Sprint-2026-2027: Heartbeat - Active UWERs - https://phabricator.wikimedia.org/T426420#12031491 (10Milimetric) [21:43:15] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 10Event-Platform: Backfill commonswiki and enwiki HTML for latest HTML when non-existent in event.mediawiki_page_html_content_change_v1 - https://phabricator.wikimedia.org/T426347#12031798 (10dr0ptp4kt) Following up here: no rush at this point. It's someth...