[00:07:28] (03CR) 10BCornwall: [C:04-1] Remove inactive Squarespace link from footer credit. Fixes T406502 (031 comment) [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/1194152 (owner: 10Hemmnt) [01:15:04] 06Data-Engineering (Q1 FY25/26 July 1st - September 30th): Stop Gobblin late-files alert for the `webrequest_frontend_test` job - https://phabricator.wikimedia.org/T406009#11253005 (10Ahoelzl) 05Open→03Resolved [01:15:07] 06Data-Engineering (Q1 FY25/26 July 1st - September 30th), 10Commons-Impact-Metrics, 10Commons-Impact-Metrics-Requests: Update Commons Impact Metrics allow-list September 2025 - https://phabricator.wikimedia.org/T405672#11253006 (10Ahoelzl) 05Open→03Resolved [01:15:12] 06Data-Engineering (Q1 FY25/26 July 1st - September 30th), 10Event-Platform, 05MW-1.45-notes (1.45.0-wmf.22; 2025-10-07): Bug: event validation error: mediawiki.page-restrictions-change - https://phabricator.wikimedia.org/T390012#11253010 (10Ahoelzl) 05In progress→03Resolved [01:15:17] 06Data-Engineering (Q1 FY25/26 July 1st - September 30th), 10service-utils, 10Event-Platform, 13Patch-For-Review: Migrate and re-deploy eventgate-wikimedia using new service-utils - https://phabricator.wikimedia.org/T403169#11253008 (10Ahoelzl) 05Open→03Resolved [01:15:20] 06Data-Engineering (Q1 FY25/26 July 1st - September 30th), 10DPE-Mediawiki-Content, 13Patch-For-Review: Airflow jobs to do monthly XML dumps - https://phabricator.wikimedia.org/T384381#11253011 (10Ahoelzl) 05In progress→03Resolved [01:15:23] 06Data-Engineering (Q1 FY25/26 July 1st - September 30th), 06MW-Interfaces-Team, 06Product-Analytics, 10Event-Platform, 05MW-1.45-notes (1.45.0-wmf.21; 2025-09-30): performer struct fields NULL in event_sanitized.mediawiki_revision_tags_change - https://phabricator.wikimedia.org/T352899#11253013 (10Ah... [01:15:25] 06Data-Engineering (Q1 FY25/26 July 1st - September 30th), 10Event-Platform, 13Patch-For-Review: Add schema diffing support to jsonschema-tools and run diff in CI - https://phabricator.wikimedia.org/T321850#11253014 (10Ahoelzl) 05Open→03Resolved [01:15:27] 06Data-Engineering (Q1 FY25/26 July 1st - September 30th), 10Data-Platform, 10Event-Platform, 05MW-1.45-notes (1.45.0-wmf.21; 2025-09-30): Warnings from handlePageHistoryVisibilityChangedEvent in EventBus from revision deletion - https://phabricator.wikimedia.org/T403648#11253015 (10Ahoelzl) 05Open→... [01:15:33] 06Data-Engineering (Q1 FY25/26 July 1st - September 30th), 10Observability-Logging, 10Event-Platform, 13Patch-For-Review: eventgate logs field explosion - https://phabricator.wikimedia.org/T343342#11253018 (10Ahoelzl) 05Open→03Resolved [01:15:36] 06Data-Engineering (Q1 FY25/26 July 1st - September 30th), 06Discovery-Search (2025.09.26 - 2025.10.17), 07Essential-Work, 10Event-Platform, 13Patch-For-Review: Update event-producing tools to overwrite `meta.dt` - https://phabricator.wikimedia.org/T376026#11253016 (10Ahoelzl) 05Open→03Resolved [01:16:22] 06Data-Engineering (Q1 FY25/26 July 1st - September 30th): Define Event Platform Essential Work FY25/26 - https://phabricator.wikimedia.org/T399661#11253022 (10Ahoelzl) a:05gmodena→03Ottomata [01:17:04] 06Data-Engineering (Q1 FY25/26 July 1st - September 30th): Define Event Platform Essential Work FY25/26 - https://phabricator.wikimedia.org/T399661#11253026 (10Ahoelzl) 05Open→03Resolved [01:17:34] 06Data-Engineering (Q1 FY25/26 July 1st - September 30th): Commons Impact Metrics has no data for September snapshot - https://phabricator.wikimedia.org/T406509#11253027 (10Ahoelzl) a:03mforns [01:17:56] 06Data-Engineering (Q1 FY25/26 July 1st - September 30th), 10MediaWiki-Page-derived-data, 07OKR-Work: Add user_central_id to mediawiki_content_history_v1 (and mediawiki_content_current_v1) - https://phabricator.wikimedia.org/T406515#11253028 (10Ahoelzl) a:03amastilovic [02:28:17] FIRING: EventgateProduceRateAnomaly: Significant produce rate deviation (+-25%) on eventgate-analytics in codfw. - https://wikitech.wikimedia.org/wiki/Event_Platform/EventGate - https://grafana.wikimedia.org/d/ZB39Izmnz/eventgate?orgId=1&refresh=1m&var-dc=codfw%2Bprometheus/k8s&var-service=eventgate-analytics - https://alerts.wikimedia.org/?q=alertname%3DEventgateProduceRateAnomaly [02:58:17] RESOLVED: EventgateProduceRateAnomaly: Significant produce rate deviation (+-25%) on eventgate-analytics in codfw. - https://wikitech.wikimedia.org/wiki/Event_Platform/EventGate - https://grafana.wikimedia.org/d/ZB39Izmnz/eventgate?orgId=1&refresh=1m&var-dc=codfw%2Bprometheus/k8s&var-service=eventgate-analytics - https://alerts.wikimedia.org/?q=alertname%3DEventgateProduceRateAnomaly [04:33:17] FIRING: EventgateProduceRateAnomaly: Significant produce rate deviation (+-25%) on eventgate-analytics in codfw. - https://wikitech.wikimedia.org/wiki/Event_Platform/EventGate - https://grafana.wikimedia.org/d/ZB39Izmnz/eventgate?orgId=1&refresh=1m&var-dc=codfw%2Bprometheus/k8s&var-service=eventgate-analytics - https://alerts.wikimedia.org/?q=alertname%3DEventgateProduceRateAnomaly [04:53:17] RESOLVED: EventgateProduceRateAnomaly: Significant produce rate deviation (+-25%) on eventgate-analytics in codfw. - https://wikitech.wikimedia.org/wiki/Event_Platform/EventGate - https://grafana.wikimedia.org/d/ZB39Izmnz/eventgate?orgId=1&refresh=1m&var-dc=codfw%2Bprometheus/k8s&var-service=eventgate-analytics - https://alerts.wikimedia.org/?q=alertname%3DEventgateProduceRateAnomaly [05:09:17] FIRING: EventgateProduceRateAnomaly: Significant produce rate deviation (+-25%) on eventgate-analytics in codfw. - https://wikitech.wikimedia.org/wiki/Event_Platform/EventGate - https://grafana.wikimedia.org/d/ZB39Izmnz/eventgate?orgId=1&refresh=1m&var-dc=codfw%2Bprometheus/k8s&var-service=eventgate-analytics - https://alerts.wikimedia.org/?q=alertname%3DEventgateProduceRateAnomaly [05:29:17] RESOLVED: EventgateProduceRateAnomaly: Significant produce rate deviation (+-25%) on eventgate-analytics in codfw. - https://wikitech.wikimedia.org/wiki/Event_Platform/EventGate - https://grafana.wikimedia.org/d/ZB39Izmnz/eventgate?orgId=1&refresh=1m&var-dc=codfw%2Bprometheus/k8s&var-service=eventgate-analytics - https://alerts.wikimedia.org/?q=alertname%3DEventgateProduceRateAnomaly [06:44:22] FIRING: EventgateProduceRateAnomaly: Significant produce rate deviation (+-25%) on eventgate-analytics in codfw. - https://wikitech.wikimedia.org/wiki/Event_Platform/EventGate - https://grafana.wikimedia.org/d/ZB39Izmnz/eventgate?orgId=1&refresh=1m&var-dc=codfw%2Bprometheus/k8s&var-service=eventgate-analytics - https://alerts.wikimedia.org/?q=alertname%3DEventgateProduceRateAnomaly [06:54:17] RESOLVED: EventgateProduceRateAnomaly: Significant produce rate deviation (+-25%) on eventgate-analytics in codfw. - https://wikitech.wikimedia.org/wiki/Event_Platform/EventGate - https://grafana.wikimedia.org/d/ZB39Izmnz/eventgate?orgId=1&refresh=1m&var-dc=codfw%2Bprometheus/k8s&var-service=eventgate-analytics - https://alerts.wikimedia.org/?q=alertname%3DEventgateProduceRateAnomaly [06:59:17] FIRING: EventgateProduceRateAnomaly: Significant produce rate deviation (+-25%) on eventgate-analytics in codfw. - https://wikitech.wikimedia.org/wiki/Event_Platform/EventGate - https://grafana.wikimedia.org/d/ZB39Izmnz/eventgate?orgId=1&refresh=1m&var-dc=codfw%2Bprometheus/k8s&var-service=eventgate-analytics - https://alerts.wikimedia.org/?q=alertname%3DEventgateProduceRateAnomaly [07:12:24] (03PS1) 10Hemmnt: Removed inactive Squarespace link and tag from footer credit. Fixes T406502 [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/1194387 [07:19:06] (03CR) 10Hemmnt: Remove inactive Squarespace link from footer credit. Fixes T406502 (031 comment) [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/1194152 (owner: 10Hemmnt) [07:19:17] RESOLVED: EventgateProduceRateAnomaly: Significant produce rate deviation (+-25%) on eventgate-analytics in codfw. - https://wikitech.wikimedia.org/wiki/Event_Platform/EventGate - https://grafana.wikimedia.org/d/ZB39Izmnz/eventgate?orgId=1&refresh=1m&var-dc=codfw%2Bprometheus/k8s&var-service=eventgate-analytics - https://alerts.wikimedia.org/?q=alertname%3DEventgateProduceRateAnomaly [07:36:15] 06Data-Engineering, 10Data-Engineering-Wikistats, 13Patch-For-Review: "Designed by Aislinn Grigas" at the bottom of stats.wikimedia.org leads to an inactive Squarespace account - https://phabricator.wikimedia.org/T406502#11253462 (10A_smart_kitten) I'm not a member of #data-engineering, but… should there be... [08:20:17] FIRING: EventgateProduceRateAnomaly: Significant produce rate deviation (+-25%) on eventgate-analytics in codfw. - https://wikitech.wikimedia.org/wiki/Event_Platform/EventGate - https://grafana.wikimedia.org/d/ZB39Izmnz/eventgate?orgId=1&refresh=1m&var-dc=codfw%2Bprometheus/k8s&var-service=eventgate-analytics - https://alerts.wikimedia.org/?q=alertname%3DEventgateProduceRateAnomaly [08:40:17] RESOLVED: EventgateProduceRateAnomaly: Significant produce rate deviation (+-25%) on eventgate-analytics in codfw. - https://wikitech.wikimedia.org/wiki/Event_Platform/EventGate - https://grafana.wikimedia.org/d/ZB39Izmnz/eventgate?orgId=1&refresh=1m&var-dc=codfw%2Bprometheus/k8s&var-service=eventgate-analytics - https://alerts.wikimedia.org/?q=alertname%3DEventgateProduceRateAnomaly [09:34:10] 06Data-Engineering, 06Product-Analytics (Kanban): Follow-up analysis to understand usage of dumps to inform v2 rollout - https://phabricator.wikimedia.org/T402963#11253797 (10KCVelaga_WMF) The [[ https://nbviewer.org/urls/gitlab.wikimedia.org/kcvelaga/we5-fy25-26-analytics/-/raw/main/03_dumps_analysis/02_dumps... [09:48:17] FIRING: EventgateProduceRateAnomaly: Significant produce rate deviation (+-25%) on eventgate-analytics in codfw. - https://wikitech.wikimedia.org/wiki/Event_Platform/EventGate - https://grafana.wikimedia.org/d/ZB39Izmnz/eventgate?orgId=1&refresh=1m&var-dc=codfw%2Bprometheus/k8s&var-service=eventgate-analytics - https://alerts.wikimedia.org/?q=alertname%3DEventgateProduceRateAnomaly [10:28:17] RESOLVED: EventgateProduceRateAnomaly: Significant produce rate deviation (+-25%) on eventgate-analytics in codfw. - https://wikitech.wikimedia.org/wiki/Event_Platform/EventGate - https://grafana.wikimedia.org/d/ZB39Izmnz/eventgate?orgId=1&refresh=1m&var-dc=codfw%2Bprometheus/k8s&var-service=eventgate-analytics - https://alerts.wikimedia.org/?q=alertname%3DEventgateProduceRateAnomaly [11:07:39] 06Data-Engineering, 10Data-Platform, 06Movement-Insights: NEWFEATURE REQUEST: Add new referral sources to pageview data - https://phabricator.wikimedia.org/T406531#11254281 (10JAllemandou) Thank you for your input folks :) In relation to using the `uri_query` to find referrers: it's not done like that curren... [12:42:21] 06Data-Engineering-Radar, 10Fundraising analytics stack, 07Epic: [MinIO] Improve cluster to minimum system configuration for production - https://phabricator.wikimedia.org/T392112#11254918 (10Jgreen) [12:54:17] 06Data-Engineering, 06Data-Engineering-Radar, 10AbuseFilter, 06DBA, 07Schema-change-in-production: Add default value for afl_ip and remove default value for afl_ip_hex in abuse_filter_log table - https://phabricator.wikimedia.org/T401906#11254981 (10Dreamy_Jazz) [13:15:57] 10Data-Engineering-Roadmap, 10Data Pipelines, 07Epic: Refine jobs should be scheduled by Airflow - https://phabricator.wikimedia.org/T307505#11255062 (10Ottomata) [13:27:25] !log running manual sqoop of centralauth tables - T389666 [13:27:55] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [13:27:55] T389666: NEW/CHANGE FEATURE REQUEST: make available the centralauth.globaluser table in Data Lake - https://phabricator.wikimedia.org/T389666 [13:43:32] 06Data-Engineering (Q1 FY25/26 July 1st - September 30th): Backfill datasets affected by automated traffic detection issues - https://phabricator.wikimedia.org/T405667#11255147 (10mforns) [13:49:28] 06Data-Engineering, 06Data-Engineering-Radar, 06Experimentation Lab, 10MediaWiki-extensions-EventLogging, and 2 others: Deprecate and remove MetricsClient#dispatch() - https://phabricator.wikimedia.org/T352969#11255169 (10phuedx) [13:51:42] 06Data-Engineering (Q1 FY25/26 July 1st - September 30th), 06Experimentation Lab: NEW/CHANGE FEATURE REQUEST: make available the centralauth.globaluser table in Data Lake - https://phabricator.wikimedia.org/T389666#11255187 (10Ottomata) `lang=sql > MSCK REPAIR TABLE wmf_raw.centralauth_globaluser; > MSCK REPAI... [13:56:46] 06Data-Engineering (Q1 FY25/26 July 1st - September 30th), 10DPE-Mediawiki-Content, 13Patch-For-Review: Rewrite wmf_content.mediawiki_content_v1 with a new column for origin_rev_id - https://phabricator.wikimedia.org/T405944#11255224 (10xcollazo) Today's daily ingestion is done, thus, we just paused all [[ h... [14:13:39] 06Data-Engineering (Q1 FY25/26 July 1st - September 30th), 10Event-Platform: mediawiki.content_history: flink applications experiencing frequent restarts due to JobManager OOMs - https://phabricator.wikimedia.org/T397330#11255344 (10BTullis) Could we please check to see if this issue is still affecting us, aft... [14:31:15] 06Data-Engineering: EventStreamConfig: Add top-level labels property - https://phabricator.wikimedia.org/T406741 (10phuedx) 03NEW [14:36:59] 06Data-Engineering (Q1 FY25/26 July 1st - September 30th), 10Event-Platform: mediawiki.content_history: flink applications experiencing frequent restarts due to JobManager OOMs - https://phabricator.wikimedia.org/T397330#11255472 (10tchin) [[ https://grafana.wikimedia.org/goto/_xsIrM6Ng?orgId=1 | Looks like it... [15:10:08] 06Data-Engineering: EventStreamConfig: Add top-level labels property - https://phabricator.wikimedia.org/T406741#11255582 (10Ottomata) Great stuff! I'm not yet sold on the use of e.g. `'producer'` for stuff like {T303602}, but for semantic information about the content of the stream, a top level `labels` fiel... [15:12:01] 06Data-Engineering: EventStreamConfig: Add top-level labels property - https://phabricator.wikimedia.org/T406741#11255584 (10Ottomata) Q: We don't have {T405516} yet so having varying types in `labels` (e.g. boolean `true` vs string `"a_value"`) is fine. But, if we did have a config schema, I think I would pr... [15:16:06] 06Data-Engineering, 10Event-Platform: Merge eventgate and eventgate-wikimedia repos - https://phabricator.wikimedia.org/T406747 (10tchin) 03NEW [15:20:19] 06Data-Engineering, 06Data-Persistence, 10MediaWiki-Core-Revision-backend, 10Wikidata, and 5 others: Rethink rev_sha1 field - https://phabricator.wikimedia.org/T389026#11255658 (10karapayneWMDE) [15:28:57] 06Data-Engineering, 06Data-Platform-SRE, 10Event-Platform: Avoid accepting Kafka messages with whacky timestamps - https://phabricator.wikimedia.org/T282887#11255690 (10JMonton-WMF) a:03JMonton-WMF [16:57:55] 06Data-Engineering, 06Data-Platform-SRE, 07Epic: Exlore the use of dbt-core and appropriate adapters in the data-platform environment - https://phabricator.wikimedia.org/T406764 (10BTullis) 03NEW [16:58:26] 06Data-Engineering, 06Data-Platform-SRE, 07Epic: Exlore the use of dbt-core and appropriate adapters in the data-platform environment - https://phabricator.wikimedia.org/T406764#11256148 (10BTullis) [16:58:28] 06Data-Engineering (Q1 FY25/26 July 1st - September 30th): Create a dbt Docker container - https://phabricator.wikimedia.org/T406636#11256149 (10BTullis) [16:58:29] 06Data-Engineering, 06SRE: Set up a working, usable dbt installation on stat boxes - https://phabricator.wikimedia.org/T406634#11256150 (10BTullis) [16:58:31] 06Data-Engineering, 06Data-Platform-SRE, 07Epic: Exlore the use of dbt-core and appropriate adapters in the data-platform environment - https://phabricator.wikimedia.org/T406764#11256151 (10BTullis) p:05Triage→03High [16:59:52] 06Data-Engineering: Create a new gitlab repository for use with dbt - https://phabricator.wikimedia.org/T406765 (10BTullis) 03NEW [17:01:54] 06Data-Engineering, 06Data-Platform-SRE: Add dbt related packages to conda-analytics - https://phabricator.wikimedia.org/T406766 (10BTullis) 03NEW [17:01:55] 06Data-Engineering, 06Data-Platform-SRE: Add dbt related packages to conda-analytics - https://phabricator.wikimedia.org/T406767 (10BTullis) 03NEW [17:07:09] 06Data-Engineering (Q1 FY25/26 July 1st - September 30th), 10Data-Platform, 06Movement-Insights: NEWFEATURE REQUEST: Add new referral sources to pageview data - https://phabricator.wikimedia.org/T406531#11256195 (10Ahoelzl) [17:07:15] 06Data-Engineering (Q1 FY25/26 July 1st - September 30th), 06Movement-Insights: NEW BUG REPORT : Referer Name field is Null on Druid pageviews_daily - https://phabricator.wikimedia.org/T406530#11256196 (10Ottomata) a:03JAllemandou [17:07:20] 06Data-Engineering (Q1 FY25/26 July 1st - September 30th), 06Movement-Insights: NEW BUG REPORT : Referer Name field is Null on Druid pageviews_daily - https://phabricator.wikimedia.org/T406530#11256198 (10Ahoelzl) [17:07:28] 06Data-Engineering (Q1 FY25/26 July 1st - September 30th), 10Data-Platform, 06Movement-Insights: NEWFEATURE REQUEST: Add new referral sources to pageview data - https://phabricator.wikimedia.org/T406531#11256199 (10Ottomata) a:03JAllemandou [17:07:51] 06Data-Engineering (Q1 FY25/26 July 1st - September 30th), 06Data-Platform-SRE, 07Epic: Exlore the use of dbt-core and appropriate adapters in the data-platform environment - https://phabricator.wikimedia.org/T406764#11256201 (10Ahoelzl) [17:07:55] 06Data-Engineering (Q1 FY25/26 July 1st - September 30th), 06Data-Platform-SRE, 07Epic: Exlore the use of dbt-core and appropriate adapters in the data-platform environment - https://phabricator.wikimedia.org/T406764#11256203 (10Ottomata) a:03amastilovic [17:10:47] 06Data-Engineering: Clarify what to do with the 'Wp-zero-data-bot' account - https://phabricator.wikimedia.org/T406298#11256210 (10Ottomata) No, we don't use it, please remove at will. Also. HELLO! :D [17:13:15] 06Data-Engineering (Q1 FY25/26 July 1st - September 30th): Create a new gitlab repository for use with dbt - https://phabricator.wikimedia.org/T406765#11256225 (10Ahoelzl) [17:13:33] 06Data-Engineering: MediawikiPageContentChangeEnrichAvailability fired - https://phabricator.wikimedia.org/T406389#11256227 (10Ottomata) 05Open→03Resolved a:03Ottomata I'd guess this was related to the wikikube k8s upgrade where they took services offline during the upgrade. (if the timing lines up, i... [17:13:40] 06Data-Engineering (Q1 FY25/26 July 1st - September 30th), 06Data-Platform-SRE: Add dbt related packages to conda-analytics - https://phabricator.wikimedia.org/T406766#11256231 (10Ahoelzl) [17:13:46] 06Data-Engineering (Q1 FY25/26 July 1st - September 30th), 06Data-Platform-SRE: Add dbt related packages to conda-analytics - https://phabricator.wikimedia.org/T406767#11256233 (10Ahoelzl) [17:15:16] 06Data-Engineering, 10Data-Engineering-Wikistats, 13Patch-For-Review: "Designed by Aislinn Grigas" at the bottom of stats.wikimedia.org leads to an inactive Squarespace account - https://phabricator.wikimedia.org/T406502#11256242 (10Ottomata) p:05Triage→03Low [17:16:24] 06Data-Engineering, 10Data-Engineering-Wikistats, 13Patch-For-Review: "Designed by Aislinn Grigas" at the bottom of stats.wikimedia.org leads to an inactive Squarespace account - https://phabricator.wikimedia.org/T406502#11256266 (10Milimetric) Thanks @A_smart_kitten, I'll try and contact Ash to get an updat... [17:17:14] 06Data-Engineering (Q1 FY25/26 July 1st - September 30th), 06SRE: Set up a working, usable dbt installation on stat boxes - https://phabricator.wikimedia.org/T406634#11256271 (10Ahoelzl) [17:19:25] 06Data-Engineering (Q1 FY25/26 July 1st - September 30th): GobblinLastSuccessfulRunTooLongAgo alerts - https://phabricator.wikimedia.org/T406526#11256286 (10Ahoelzl) [17:20:04] 06Data-Engineering (Q1 FY25/26 July 1st - September 30th): GobblinLastSuccessfulRunTooLongAgo alerts - https://phabricator.wikimedia.org/T406526#11256288 (10Ottomata) a:03Antoine_Quhen We should figure out why _test gobblin stuff is firing. It is annoying to get these alerts in ops week and just ignore them.... [17:21:24] 06Data-Engineering, 10Event-Platform: EventStreamConfig: Add top-level labels property - https://phabricator.wikimedia.org/T406741#11256290 (10Ottomata) a:03phuedx [17:23:07] 06Data-Engineering, 10Event-Platform: Merge eventgate and eventgate-wikimedia repos - https://phabricator.wikimedia.org/T406747#11256298 (10Ottomata) p:05Triage→03Low [17:27:27] 06Data-Engineering, 06cloud-services-team, 06Data-Persistence, 06Data-Platform-SRE, and 2 others: Set up x1 replication to Wiki Replicas - https://phabricator.wikimedia.org/T395881#11256308 (10Ottomata) Tagging #data-platform-sre to get their input. [17:33:15] 06Data-Engineering, 06Data-Persistence, 10MediaWiki-File-management, 06MediaWiki-Platform-Team (Radar): Update Data Pipelines with new image table schema - https://phabricator.wikimedia.org/T386133#11256323 (10Ottomata) →14Duplicate dup:03T389800 [17:33:20] 06Data-Engineering (Q4 2025 April 1st - June 30th), 10Commons-Impact-Metrics, 13Patch-For-Review: Update Commons Impact Metrics to account for new File table - https://phabricator.wikimedia.org/T389800#11256325 (10Ottomata) [17:46:34] (03CR) 10Milimetric: [C:04-1] "I reached out to Ash and she said we can update the link to point to her linked-in page: https://www.linkedin.com/in/aislinn." [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/1194152 (owner: 10Hemmnt) [17:48:32] (03CR) 10Milimetric: [C:04-1] Remove inactive Squarespace link from footer credit. Fixes T406502 (031 comment) [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/1194152 (owner: 10Hemmnt) [17:55:23] 14Analytics, 06Data-Engineering, 06Experimentation Lab: Count the number of video plays - https://phabricator.wikimedia.org/T198628#11256402 (10Milimetric) p:05Low→03Medium Hi @Ahoelzl. We have new interest in this work and volunteers to do it. I'm also tagging Experiment Platform because we can suppor... [18:13:49] !log Deploying Refinery for c1193888 th.wikimedia to allowlist [18:14:05] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [18:19:11] !log Abandoned Deploying Refinery for c1193888 th.wikimedia to allowlist (already done) [18:19:13] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [18:43:55] 06Data-Engineering (Q1 FY25/26 July 1st - September 30th), 06Movement-Insights: NEW BUG REPORT : Referer Name field is Null on Druid pageviews_daily - https://phabricator.wikimedia.org/T406530#11256621 (10JAllemandou) @OSefu-WMF - I think druid can cope with the field addition. The datasource currently weights... [18:47:36] 06Data-Engineering (Q1 FY25/26 July 1st - September 30th): Backfill datasets affected by automated traffic detection issues - https://phabricator.wikimedia.org/T405667#11256632 (10xcollazo) In a meeting with @mforns, we identified that we had to 'go back in time' for two Iceberg tables to reinstate the data as i... [18:50:00] 06Data-Engineering (Q1 FY25/26 July 1st - September 30th): Backfill datasets affected by automated traffic detection issues - https://phabricator.wikimedia.org/T405667#11256635 (10JAllemandou) Question on this: could we, instead of rolling back and possibly have to rerun airflow jobs, could we run a query agains... [18:50:02] (03PS2) 10Hemmnt: Updated footer credit link to Aislinn’s LinkedIn profile [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/1194387 (https://phabricator.wikimedia.org/T406502) [18:50:52] (03CR) 10Hemmnt: "done" [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/1194152 (owner: 10Hemmnt) [18:53:16] 06Data-Engineering (Q1 FY25/26 July 1st - September 30th): Backfill datasets affected by automated traffic detection issues - https://phabricator.wikimedia.org/T405667#11256649 (10mforns) We executed the snapshot revert commands with success: ` spark-sql (default)> CALL spark_catalog.system.rollback_to_snapshot(... [18:55:49] (03PS1) 10Hemmnt: Updated footer credit link to Aislinn’s LinkedIn profile [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/1194721 (https://phabricator.wikimedia.org/T406502) [18:57:37] (03Abandoned) 10Hemmnt: Updated footer credit link to Aislinn’s LinkedIn profile [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/1194387 (https://phabricator.wikimedia.org/T406502) (owner: 10Hemmnt) [19:01:47] 06Data-Engineering, 10Data-Engineering-Wikistats, 13Patch-For-Review: "Designed by Aislinn Grigas" at the bottom of stats.wikimedia.org leads to an inactive Squarespace account - https://phabricator.wikimedia.org/T406502#11256666 (10Hemmanttt) From your feedback, I have updated the patch as requested. Please... [19:31:14] 06Data-Engineering (Q1 FY25/26 July 1st - September 30th): Backfill datasets affected by automated traffic detection issues - https://phabricator.wikimedia.org/T405667#11256744 (10xcollazo) >>! In T405667#11256635, @JAllemandou wrote: > Question on this: could we, instead of rolling back and possibly have to rer... [19:40:50] 06Data-Engineering (Q1 FY25/26 July 1st - September 30th), 10Event-Platform: mediawiki.content_history: flink applications experiencing frequent restarts due to JobManager OOMs - https://phabricator.wikimedia.org/T397330#11256771 (10Ottomata) YESSSSSSS [19:52:25] (03CR) 10BCornwall: Updated footer credit link to Aislinn’s LinkedIn profile (031 comment) [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/1194721 (https://phabricator.wikimedia.org/T406502) (owner: 10Hemmnt) [19:58:02] 06Data-Engineering (Q1 FY25/26 July 1st - September 30th): Backfill datasets affected by automated traffic detection issues - https://phabricator.wikimedia.org/T405667#11256798 (10xcollazo) Just kidding!, the snapshots with the good old data are: ` CALL spark_catalog.system.rollback_to_snapshot('wmf_readership.u... [20:03:16] 06Data-Engineering, 10Event-Platform: Schema validation for EventStreamConfig - https://phabricator.wikimedia.org/T405516#11256831 (10mpopov) I drafted a schema: https://gitlab.wikimedia.org/bearloga/eventstreamconfig-schema-prototype/-/blob/main/eventstreamconfig/1.0.0.yml?ref_type=heads and have tested it w... [20:04:25] 06Data-Engineering, 10Event-Platform: Schema validation for EventStreamConfig - https://phabricator.wikimedia.org/T405516#11256836 (10mpopov) [20:12:59] 06Data-Engineering (Q1 FY25/26 July 1st - September 30th): Backfill datasets affected by automated traffic detection issues - https://phabricator.wikimedia.org/T405667#11256859 (10mforns) OK, I think this time it worked. - We rolled back to the Iceberg snapshot previous to the corrupting of the data by the backf... [20:13:11] 06Data-Engineering (Q1 FY25/26 July 1st - September 30th): Backfill datasets affected by automated traffic detection issues - https://phabricator.wikimedia.org/T405667#11256866 (10mforns) [20:16:04] 06Data-Engineering, 10Event-Platform: Schema validation for EventStreamConfig - https://phabricator.wikimedia.org/T405516#11256882 (10mpopov) > Learning 2: `mediawiki.product_metrics.checkuser_ip_auto_reveal_interaction` stream is currently subtly misconfigured Patch to fix it: https://gerrit.wikimedia.org/r/... [20:22:13] 06Data-Engineering, 10Event-Platform: Schema validation for EventStreamConfig - https://phabricator.wikimedia.org/T405516#11256898 (10Ottomata) COOL! > topic_prefixes I wonder if we could just make this a 'private' config and never expose it in API response. It is used to generate auto generate `topics` if... [20:27:01] 06Data-Engineering, 10Event-Platform: Schema validation for EventStreamConfig - https://phabricator.wikimedia.org/T405516#11256912 (10mpopov) > I wonder if we could just make this a 'private' config and never expose it in API response. It is used to generate auto generate `topics` if it is not explicitly set.... [20:57:58] (03PS2) 10Hemmnt: Updated footer credit link to Aislinn’s LinkedIn profile [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/1194721 (https://phabricator.wikimedia.org/T406502) [20:59:16] (03CR) 10Hemmnt: Updated footer credit link to Aislinn’s LinkedIn profile (031 comment) [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/1194721 (https://phabricator.wikimedia.org/T406502) (owner: 10Hemmnt) [21:01:31] (03CR) 10BCornwall: Updated footer credit link to Aislinn’s LinkedIn profile (031 comment) [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/1194721 (https://phabricator.wikimedia.org/T406502) (owner: 10Hemmnt) [21:23:04] (03PS3) 10Hemmnt: Updated footer credit link to Aislinn’s LinkedIn profile [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/1194721 (https://phabricator.wikimedia.org/T406502) [21:24:41] (03CR) 10Hemmnt: Updated footer credit link to Aislinn’s LinkedIn profile (031 comment) [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/1194721 (https://phabricator.wikimedia.org/T406502) (owner: 10Hemmnt) [21:52:10] (03CR) 10BCornwall: [C:03+1] "I don't have merge privs but looks good to me." [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/1194721 (https://phabricator.wikimedia.org/T406502) (owner: 10Hemmnt) [21:52:34] 06Data-Engineering: mediawiki_history_reduced.check_mediawiki_history_reduced error ratio hit - https://phabricator.wikimedia.org/T406525#11257185 (10dr0ptp4kt) Adapting from chat: > The error file is being produced, and so the DAG forks in a way such that the Druid load won't happen. The stuff descending from... [21:57:00] 06Data-Engineering (Q1 FY25/26 July 1st - September 30th), 10Event-Platform: mediawiki.content_history: flink applications experiencing frequent restarts due to JobManager OOMs - https://phabricator.wikimedia.org/T397330#11257194 (10xcollazo) Hilarious ending to this saga! 😄 [22:02:50] (03CR) 10BCornwall: [C:04-1] "Since Ifa5888d5c44148886c5795104e516ccf25ef2204 has superceded this CR, please abandon this change and rebase the other on top of master. " [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/1194152 (owner: 10Hemmnt) [22:06:25] 06Data-Engineering (Q1 FY25/26 July 1st - September 30th): Create a new gitlab repository for use with dbt - https://phabricator.wikimedia.org/T406765#11257215 (10amastilovic) I've created https://gitlab.wikimedia.org/repos/data-engineering/dbt [22:12:55] (03Abandoned) 10Hemmnt: Remove inactive Squarespace link from footer credit. Fixes T406502 [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/1194152 (owner: 10Hemmnt) [22:36:28] 06Data-Engineering (Q1 FY25/26 July 1st - September 30th), 10DPE-Mediawiki-Content, 13Patch-For-Review: Rewrite wmf_content.mediawiki_content_v1 with a new column for origin_rev_id - https://phabricator.wikimedia.org/T405944#11257287 (10xcollazo) Did a couple test to see if we could backfill `wmf_content.med... [22:39:12] 06Data-Engineering (Q1 FY25/26 July 1st - September 30th), 10DPE-Mediawiki-Content, 13Patch-For-Review: Rewrite wmf_content.mediawiki_content_v1 with a new column for origin_rev_id - https://phabricator.wikimedia.org/T405944#11257295 (10xcollazo) Now running the following: ` hostname -f an-launcher1002.eqia...