[08:29:03] 06Data-Engineering, 06Machine-Learning-Team, 06Research, 10Event-Platform: Emit revision revert risk scores as a stream and expose in EventStreams API - https://phabricator.wikimedia.org/T326179#10681663 (10kevinbazira) A model-server that supports publishing revert-risk language-agnostic (RRLA) scores int... [09:20:00] 06Data-Engineering, 06Data-Platform-SRE, 06SRE: Rebuild Spark images with Bookworm / bullseye-backports deprecation - https://phabricator.wikimedia.org/T390139 (10MoritzMuehlenhoff) 03NEW [10:00:05] (03PS1) 10Joal: Add webrequest_frontend_test gobblin job [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1131652 (https://phabricator.wikimedia.org/T386177) [10:03:38] (03CR) 10Aqu: [C:03+1] "LGTM" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1131652 (https://phabricator.wikimedia.org/T386177) (owner: 10Joal) [10:05:54] (03CR) 10Joal: [V:03+2 C:03+2] "Merging for deploy" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1131652 (https://phabricator.wikimedia.org/T386177) (owner: 10Joal) [11:09:34] !log Delete webrequest_sampled_128 in druid [11:09:36] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [11:10:30] 06Data-Engineering, 06Machine-Learning-Team, 06Research, 10Event-Platform: Emit revision revert risk scores as a stream and expose in EventStreams API - https://phabricator.wikimedia.org/T326179#10682228 (10achou) We need to decide on the name for this stream. I think `mediawiki.revision_revertrisk_languag... [13:30:22] 10Data-Engineering (Q3 2025 January 1st - March 31th): Provide a list of Phabricator tags relevant for Data-Engineering and use them on Data-Engineering board - https://phabricator.wikimedia.org/T386752#10683014 (10Ottomata) [13:32:58] 10Data-Engineering (Q3 2025 January 1st - March 31th): Provide a list of Phabricator tags relevant for Data-Engineering and use them on Data-Engineering board - https://phabricator.wikimedia.org/T386752#10683034 (10Ottomata) cc also @BTullis who was [[ https://wikimedia.slack.com/archives/C02291Z9YQY/p1742817831... [13:47:10] 10Data-Engineering (Q4 2025 April 1st - June 30th), 10EventStreams, 06SRE Observability, 13Patch-For-Review: Eventstreams 'assignments' logstash field type - https://phabricator.wikimedia.org/T390140#10683102 (10tchin) a:03tchin [13:51:58] 10Data-Engineering (Q4 2025 April 1st - June 30th), 10EventStreams, 06SRE Observability, 13Patch-For-Review: Eventstreams 'assignments' logstash field type - https://phabricator.wikimedia.org/T390140#10683139 (10tchin) Or a real quick way is to not pass in the new logger from eventstreams to KafkaSSE, that... [13:58:05] 10Data-Engineering (Q4 2025 April 1st - June 30th), 10EventStreams, 06SRE Observability, 13Patch-For-Review: Eventstreams 'assignments' logstash field type - https://phabricator.wikimedia.org/T390140#10683155 (10Ottomata) Hm, this message doesn't look like it should be an error? Pretty normal operation?... [14:31:30] 10Data-Engineering (Q4 2025 April 1st - June 30th), 10Commons-Impact-Metrics: Update Commons Impact Metrics to account for new File table - https://phabricator.wikimedia.org/T389800#10683289 (10Milimetric) TL;DR; @ahoelzl I think we should action this ASAP @mforns I spoke to Amir and he gave me this picture o... [15:02:04] 10Data-Engineering (Q3 2025 January 1st - March 31th), 10Data Pipelines, 10Observability-Metrics, 07Essential-Work, and 2 others: Disable Data Platform Engineering generated graphite metrics and dashboards - https://phabricator.wikimedia.org/T372855#10683431 (10AndrewTavis_WMDE) Cross posting from https://... [15:12:30] 10Data-Engineering (Q3 2025 January 1st - March 31th): Deprecate `webrequest_sampled_128` druid datasource - https://phabricator.wikimedia.org/T385198#10683490 (10Joe) FWIW, given we don't have the `_128` datasource, we'll need to inccrease retention on the `_live` data. [15:45:52] 06Data-Engineering, 06Data-Engineering-Radar, 06Growth-Team, 10GrowthExperiments, and 6 others: mw.track: support for histogram metrics - https://phabricator.wikimedia.org/T383563#10683639 (10MSantos) [15:54:28] 06Data-Engineering, 06Data-Platform-SRE, 06Java-Scala-Standardization, 10Discovery-Search (2025.03.22 - 2025.04.11): Migrate existing Java packages to deploying to Gitlab, including new version of parent pom, validation that all dependencies are available,... - https://phabricator.wikimedia.org/T367405#10683671 [16:07:15] (03CR) 10Gmodena: Support inserting ResultKey into DeequVerificationSuiteToDataQualityAlerts (032 comments) [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1127964 (https://phabricator.wikimedia.org/T384962) (owner: 10TChin) [17:16:30] 10Data-Engineering (Q3 2025 January 1st - March 31th), 06SRE Observability, 10Event-Platform: NEL logs are missing geoip information - https://phabricator.wikimedia.org/T387850#10684039 (10Ottomata) FYI, I just deployed eventgate-logging-external again. The setting to enable collection of these headers h... [17:20:45] 06Data-Engineering, 10AQS2.0: AQS 2.0: follow-up deprecation work - https://phabricator.wikimedia.org/T390065#10684059 (10Ahoelzl) [17:34:03] 10Data-Engineering (Q3 2025 January 1st - March 31th), 07Essential-Work: Support for 4.3.11 - webrequest based scraping detection - https://phabricator.wikimedia.org/T388721#10684109 (10Ahoelzl) p:05Triage→03High [17:59:23] 10Data-Engineering (Q3 2025 January 1st - March 31th), 07Essential-Work, 10Event-Platform, 13Patch-For-Review: Upgrade eventgate-wikimedia to node20 - https://phabricator.wikimedia.org/T383814#10684219 (10Ottomata) [17:59:52] 10Data-Engineering (Q3 2025 January 1st - March 31th), 07Essential-Work, 10Event-Platform, 13Patch-For-Review: Upgrade eventgate-wikimedia to node20 - https://phabricator.wikimedia.org/T383814#10684220 (10Ottomata) Status update: all eventgate deployments are upgraded except eventgate-main. Let's do even... [18:11:55] 06Data-Engineering, 06Data-Engineering-Radar, 10Dumps-Generation, 06MediaWiki-Platform-Team, and 2 others: Migrate WMF production from PHP 7.4 to PHP 8.1 - https://phabricator.wikimedia.org/T319432#10684263 (10Scott_French) [18:13:38] 10Data-Engineering (Q4 2025 April 1st - June 30th), 10Commons-Impact-Metrics: Update Commons Impact Metrics to account for new File table - https://phabricator.wikimedia.org/T389800#10684279 (10Ahoelzl) a:03mforns [19:11:11] 06Data-Engineering, 10Event-Platform: Support JSON Schema draft-2019-09 schemas - https://phabricator.wikimedia.org/T390232 (10mpopov) 03NEW [20:54:29] 06Data-Engineering, 10Event-Platform: Support JSON Schema draft-2019-09 schemas - https://phabricator.wikimedia.org/T390232#10684780 (10Ottomata) Some details: From https://gitlab.wikimedia.org/repos/data-engineering/eventgate#eventvalidator-class--event-schema-urls: > EventValidator always supports draft-07... [21:08:52] 06Data-Engineering, 10Event-Platform: Event Platform - Support JSON Schema draft-2019-09 schemas - https://phabricator.wikimedia.org/T390232#10684798 (10Ottomata) [21:24:21] 06Data-Engineering, 10Event-Platform: Event Platform - Support JSON Schema draft-2019-09 schemas - https://phabricator.wikimedia.org/T390232#10684857 (10Ottomata) Hm! We should also align any JSONSchema validator implementations we use for Event Platform. Right now, we have 2. EventGate, and in [[ https:/... [23:16:57] 06Data-Engineering: Migrate Gobblin job repository to GitLab - https://phabricator.wikimedia.org/T390247 (10amastilovic) 03NEW [23:19:30] 10Data-Engineering (Q3 2025 January 1st - March 31th), 07Essential-Work, 10Event-Platform: Gobblin-wmf Gitlab migration and maintenance - https://phabricator.wikimedia.org/T370368#10685216 (10amastilovic) [23:23:30] 06Data-Engineering: Migrate Gobblin to Airflow - https://phabricator.wikimedia.org/T390249 (10amastilovic) 03NEW [23:23:47] 10Data-Engineering (Q3 2025 January 1st - March 31th), 07Essential-Work, 10Event-Platform: Gobblin-wmf Gitlab migration and maintenance - https://phabricator.wikimedia.org/T370368#10685240 (10amastilovic)