[00:19:58] 06Data-Engineering (Q1 FY25/26 July 1st - September 30th), 06Data-Persistence, 10Data-Persistence-Design-Review, 06Growth-Team, and 3 others: Data Persistence Design Review: Improve Tone Suggested Edits newcomer task - https://phabricator.wikimedia.org/T401021#11248240 (10Eevans) >>! In T401021#11246721, @... [00:23:17] FIRING: EventgateProduceRateAnomaly: Significant produce rate deviation (+-25%) on eventgate-logging-external in codfw. - https://wikitech.wikimedia.org/wiki/Event_Platform/EventGate - https://grafana.wikimedia.org/d/ZB39Izmnz/eventgate?orgId=1&refresh=1m&var-dc=codfw%2Bprometheus/k8s&var-service=eventgate-logging-external - https://alerts.wikimedia.org/?q=alertname%3DEventgateProduceRateAnomaly [00:28:17] RESOLVED: EventgateProduceRateAnomaly: Significant produce rate deviation (+-25%) on eventgate-logging-external in codfw. - https://wikitech.wikimedia.org/wiki/Event_Platform/EventGate - https://grafana.wikimedia.org/d/ZB39Izmnz/eventgate?orgId=1&refresh=1m&var-dc=codfw%2Bprometheus/k8s&var-service=eventgate-logging-external - https://alerts.wikimedia.org/?q=alertname%3DEventgateProduceRateAnomaly [01:12:14] 06Data-Engineering (Q1 FY25/26 July 1st - September 30th), 06Data-Persistence, 10Data-Persistence-Design-Review, 06Growth-Team, and 3 others: Data Persistence Design Review: Improve Tone Suggested Edits newcomer task - https://phabricator.wikimedia.org/T401021#11248269 (10Eevans) >>! In T401021#11197656, @... [01:16:12] 06Data-Engineering (Q1 FY25/26 July 1st - September 30th), 06Movement-Insights: mediawiki_history - account for temp accounts in mediawiki_user_history_check_error - https://phabricator.wikimedia.org/T401325#11248270 (10amastilovic) 05Open→03Resolved [02:56:32] 06Data-Engineering (Q1 FY25/26 July 1st - September 30th), 06Wikimedia Enterprise, 06Data-Platform-SRE (2025.09.26 - 2025.10.17), 07Essential-Work: Implement an Airflow operator for moving data from point A to B - https://phabricator.wikimedia.org/T405360#11248313 (10Htriedman) @Ottomata Yes correct! I'm n... [05:49:01] 06Data-Engineering (Q1 FY25/26 July 1st - September 30th): Backfill datasets affected by automated traffic detection issues - https://phabricator.wikimedia.org/T405667#11248459 (10mforns) [07:33:57] 06Data-Engineering, 06Movement-Insights: NEW BUG REPORT : Referer Name field is Null on Druid pageviews_daily - https://phabricator.wikimedia.org/T406530#11248704 (10JAllemandou) The `referer_name` field is loaded in the `pageviews_hourly` datasource containing 90 days of data. We don't load it in the `pagevie... [07:38:25] 06Data-Engineering, 10Data-Platform, 06Movement-Insights: NEWFEATURE REQUEST: Add new referral sources to pageview data - https://phabricator.wikimedia.org/T406531#11248714 (10JAllemandou) For this we need an analysis of chatbots referal URLs, in order to update our referer classification. I assume we'll cre... [07:53:20] 06Data-Engineering, 10Data-Platform, 06Movement-Insights: NEWFEATURE REQUEST: Add new referral sources to pageview data - https://phabricator.wikimedia.org/T406531#11248735 (10MGerlach) I did an ad-hoc analysis of counting the number of referers from chatgpt some time ago ([[ https://wikimedia.slack.com/arch... [08:41:26] 06Data-Engineering-Radar, 06Data-Platform-SRE, 06Product-Analytics, 10superset.wikimedia.org: Improve Superset's error message for draft dashboards - https://phabricator.wikimedia.org/T405535#11248848 (10Gehel) @Ottomata : this does seem like something that needs to be fixed upstream. We'll let #data-engin... [08:42:12] 06Data-Engineering, 10BetaFeatures, 06cloud-services-team, 06Data-Platform-SRE, 10Data-Services: Create view for betafeatures_user_counts table in wiki replicas - https://phabricator.wikimedia.org/T402145#11248853 (10Gehel) We're waiting on #data-engineering to validate. [08:51:55] 06Data-Engineering, 06Data-Engineering-Radar, 06SRE, 10SRE-Access-Requests, and 2 others: Requesting Kerberos access for sd - https://phabricator.wikimedia.org/T405219#11248920 (10Gehel) [08:52:07] 06Data-Engineering, 06Data-Engineering-Radar, 06Data-Platform-SRE (2025.09.26 - 2025.10.17), 07Essential-Work: Do performance testing of a big Hadoop Table hosted by Ceph - https://phabricator.wikimedia.org/T381416#11248924 (10Gehel) [08:52:47] 06Data-Engineering (Q1 FY25/26 July 1st - September 30th), 06Data-Platform-SRE (2025.09.26 - 2025.10.17), 07Essential-Work, 10Event-Platform: Flink images should be build on top of openjdk - https://phabricator.wikimedia.org/T400296#11248931 (10Gehel) [09:08:19] 14Analytics-Radar, 06Data-Engineering, 06Data-Engineering-Icebox, 10observability, 07Puppet: Upgrade prometheus-jmx-exporter on all services using it - https://phabricator.wikimedia.org/T192948#11249022 (10MoritzMuehlenhoff) 05Open→03Resolved a:03MoritzMuehlenhoff We have 0.15.0 running fleet-w... [10:04:58] (03PS1) 10Hemmnt: Remove inactive Squarespace link from footer credit. Fixes T406502 [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/1194152 [10:44:44] 06Data-Engineering (Q1 FY25/26 July 1st - September 30th): Backfill datasets affected by automated traffic detection issues - https://phabricator.wikimedia.org/T405667#11249409 (10mforns) [11:48:10] 06Data-Engineering (Q1 FY25/26 July 1st - September 30th): Backfill datasets affected by automated traffic detection issues - https://phabricator.wikimedia.org/T405667#11249669 (10mforns) [11:51:39] 06Data-Engineering (Q1 FY25/26 July 1st - September 30th): Backfill datasets affected by automated traffic detection issues - https://phabricator.wikimedia.org/T405667#11249675 (10mforns) [11:53:45] 06Data-Engineering (Q1 FY25/26 July 1st - September 30th): Backfill datasets affected by automated traffic detection issues - https://phabricator.wikimedia.org/T405667#11249686 (10mforns) [11:57:11] 06Data-Engineering (Q1 FY25/26 July 1st - September 30th): Backfill datasets affected by automated traffic detection issues - https://phabricator.wikimedia.org/T405667#11249694 (10mforns) [11:57:41] 06Data-Engineering (Q1 FY25/26 July 1st - September 30th): Backfill datasets affected by automated traffic detection issues - https://phabricator.wikimedia.org/T405667#11249695 (10mforns) [12:05:14] 06Data-Engineering (Q1 FY25/26 July 1st - September 30th): Backfill datasets affected by automated traffic detection issues - https://phabricator.wikimedia.org/T405667#11249722 (10mforns) [12:54:52] 06Data-Engineering (Q1 FY25/26 July 1st - September 30th): Backfill datasets affected by automated traffic detection issues - https://phabricator.wikimedia.org/T405667#11249873 (10mforns) [13:43:50] 06Data-Engineering (Q1 FY25/26 July 1st - September 30th), 10MediaWiki-Page-derived-data, 07OKR-Work: Add user_central_id to mediawiki_content_history_v1 (and mediawiki_content_current_v1) - https://phabricator.wikimedia.org/T406515#11250088 (10xcollazo) `wmf_raw. centralauth_localuser` appears empty. Perhap... [13:50:19] 06Data-Engineering (Q1 FY25/26 July 1st - September 30th), 10MediaWiki-Page-derived-data, 07OKR-Work: Add user_central_id to mediawiki_content_history_v1 (and mediawiki_content_current_v1) - https://phabricator.wikimedia.org/T406515#11250116 (10xcollazo) >>! In T406515#11250088, @xcollazo wrote: > `wmf_raw.... [13:53:28] 06Data-Engineering, 10ChangeProp, 10Citoid, 06Content-Transform-Team, and 19 others: Migrate node-based services in production to node22 - https://phabricator.wikimedia.org/T393434#11250145 (10Jdforrester-WMF) [14:01:26] 06Data-Engineering (Q1 FY25/26 July 1st - September 30th), 10MediaWiki-Page-derived-data, 07OKR-Work: Add user_central_id to mediawiki_content_history_v1 (and mediawiki_content_current_v1) - https://phabricator.wikimedia.org/T406515#11250189 (10Ottomata) Ya apparently I did it wrong. Trying to fix it asap.... [14:02:13] 06Data-Engineering (Q1 FY25/26 July 1st - September 30th), 10MediaWiki-Page-derived-data, 07OKR-Work: Add user_central_id to mediawiki_content_history_v1 (and mediawiki_content_current_v1) - https://phabricator.wikimedia.org/T406515#11250206 (10Ottomata) > wmf_raw. centralauth_localuser appears empty. Perhap... [14:21:40] 06Data-Engineering, 10Wikidata, 10Wikidata-Platform, 10Event-Platform: WDQS sparql query event generator should not set meta.dt - https://phabricator.wikimedia.org/T405949#11250313 (10BTracy-WMF) p:05Triage→03Medium [14:24:50] 14Analytics-Radar, 06Data-Engineering, 06Data-Engineering-Icebox, 10Wikidata, 10Wikidata-Platform: PoC on anomaly detection with Flink - https://phabricator.wikimedia.org/T262942#11250333 (10BTracy-WMF) p:05Triage→03Medium [14:31:01] 06Data-Engineering, 06Movement-Insights: NEW BUG REPORT : Referer Name field is Null on Druid pageviews_daily - https://phabricator.wikimedia.org/T406530#11250408 (10OSefu-WMF) @JAllemandou - We would prefer to have the full history of `referer_name` in `pageviews_daily` data sources. We have 'Turnilo-only'... [14:39:30] 06Data-Engineering, 10MediaWiki-Core-AuthManager, 06MediaWiki-Platform-Team, 10Event-Platform, 07Wikimedia-production-error: BadMethodCallException: MediaWiki\Session\SessionProvider::preventSessionsForUser must be implemented when canChangeUser() is fal... - https://phabricator.wikimedia.org/T406566#11250465 [14:41:19] 06Data-Engineering (Q1 FY25/26 July 1st - September 30th): Backfill datasets affected by automated traffic detection issues - https://phabricator.wikimedia.org/T405667#11250473 (10mforns) [15:33:22] 06Data-Engineering (Q1 FY25/26 July 1st - September 30th): Backfill datasets affected by automated traffic detection issues - https://phabricator.wikimedia.org/T405667#11250802 (10mforns) [15:33:44] 06Data-Engineering, 10Data-Platform, 06Movement-Insights: NEWFEATURE REQUEST: Add new referral sources to pageview data - https://phabricator.wikimedia.org/T406531#11250807 (10Isaac) FYI chiming in as I've done a bit of this in the past but am happy to pass it off to others! The basic query I used in previo... [15:38:18] 06Data-Engineering (Q1 FY25/26 July 1st - September 30th): Backfill datasets affected by automated traffic detection issues - https://phabricator.wikimedia.org/T405667#11250824 (10mforns) [15:46:25] 06Data-Engineering (Q1 FY25/26 July 1st - September 30th): Backfill datasets affected by automated traffic detection issues - https://phabricator.wikimedia.org/T405667#11250845 (10mforns) [17:08:13] (03CR) 10BCornwall: Remove inactive Squarespace link from footer credit. Fixes T406502 (031 comment) [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/1194152 (owner: 10Hemmnt) [17:36:01] (03CR) 10Hemmnt: Remove inactive Squarespace link from footer credit. Fixes T406502 (031 comment) [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/1194152 (owner: 10Hemmnt) [17:38:43] 06Data-Engineering (Q1 FY25/26 July 1st - September 30th): Backfill datasets affected by automated traffic detection issues - https://phabricator.wikimedia.org/T405667#11251467 (10mforns) [17:43:16] 06Data-Engineering (Q1 FY25/26 July 1st - September 30th): Backfill datasets affected by automated traffic detection issues - https://phabricator.wikimedia.org/T405667#11251492 (10mforns) [18:32:30] 06Data-Engineering, 06SRE: Set up a working, usable dbt installation on stat boxes - https://phabricator.wikimedia.org/T406634 (10amastilovic) 03NEW [18:49:17] 06Data-Engineering (Q1 FY25/26 July 1st - September 30th): Create a dbt Docker container - https://phabricator.wikimedia.org/T406636 (10amastilovic) 03NEW [18:59:44] 06Data-Engineering (Q1 FY25/26 July 1st - September 30th): Backfill datasets affected by automated traffic detection issues - https://phabricator.wikimedia.org/T405667#11251794 (10mforns) [19:01:59] 06Data-Engineering (Q1 FY25/26 July 1st - September 30th): Backfill datasets affected by automated traffic detection issues - https://phabricator.wikimedia.org/T405667#11251807 (10mforns) [19:23:52] 06Data-Engineering (Q1 FY25/26 July 1st - September 30th): Backfill datasets affected by automated traffic detection issues - https://phabricator.wikimedia.org/T405667#11251888 (10mforns) [20:05:13] 06Data-Engineering, 06Data-Engineering-Radar, 06Discovery-Search, 06Infrastructure-Foundations, and 3 others: Elasticsearch dependency upgrade in spicerack - https://phabricator.wikimedia.org/T390860#11252059 (10RKemper) Alright, we've got tests passing and it looks like we're ready to merge! It's been a w... [20:18:49] 06Data-Engineering (Q1 FY25/26 July 1st - September 30th): Prepare data engineering infrastructure for drop of rev_sha1 - https://phabricator.wikimedia.org/T405503#11252182 (10xcollazo) [20:21:30] 06Data-Engineering (Q1 FY25/26 July 1st - September 30th): Backfill datasets affected by automated traffic detection issues - https://phabricator.wikimedia.org/T405667#11252194 (10mforns) [20:37:36] 06Data-Engineering (Q1 FY25/26 July 1st - September 30th): Backfill datasets affected by automated traffic detection issues - https://phabricator.wikimedia.org/T405667#11252256 (10mforns) [20:39:41] 06Data-Engineering (Q1 FY25/26 July 1st - September 30th): Backfill datasets affected by automated traffic detection issues - https://phabricator.wikimedia.org/T405667#11252263 (10mforns) [22:23:32] 06Data-Engineering (Q1 FY25/26 July 1st - September 30th): Backfill datasets affected by automated traffic detection issues - https://phabricator.wikimedia.org/T405667#11252659 (10mforns) [23:00:55] 06Data-Engineering (Q1 FY25/26 July 1st - September 30th): Backfill datasets affected by automated traffic detection issues - https://phabricator.wikimedia.org/T405667#11252768 (10mforns) [23:29:25] 06Data-Engineering (Q1 FY25/26 July 1st - September 30th): Backfill datasets affected by automated traffic detection issues - https://phabricator.wikimedia.org/T405667#11252843 (10mforns)