[00:13:48] <wikibugs>	 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 06Data-Platform-SRE: Add dbt related packages to conda-analytics - https://phabricator.wikimedia.org/T406767#11257520 (10Ahoelzl)
[00:13:51] <wikibugs>	 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 06Data-Platform-SRE: Add dbt related packages to conda-analytics - https://phabricator.wikimedia.org/T406766#11257521 (10Ahoelzl)
[00:13:52] <wikibugs>	 06Data-Engineering (Q2 FY25/26 October 1st - December 31th): Create a new gitlab repository for use with dbt - https://phabricator.wikimedia.org/T406765#11257522 (10Ahoelzl)
[00:13:55] <wikibugs>	 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 06Data-Platform-SRE, 07Epic: Exlore the use of dbt-core and appropriate adapters in the data-platform environment - https://phabricator.wikimedia.org/T406764#11257523 (10Ahoelzl)
[00:13:56] <wikibugs>	 06Data-Engineering (Q2 FY25/26 October 1st - December 31th): Create a dbt Docker container - https://phabricator.wikimedia.org/T406636#11257526 (10Ahoelzl)
[00:14:00] <wikibugs>	 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 06SRE: Set up a working, usable dbt installation on stat boxes - https://phabricator.wikimedia.org/T406634#11257524 (10Ahoelzl)
[00:14:03] <wikibugs>	 06Data-Engineering (Q2 FY25/26 October 1st - December 31th): GobblinLastSuccessfulRunTooLongAgo alerts - https://phabricator.wikimedia.org/T406526#11257525 (10Ahoelzl)
[00:14:07] <wikibugs>	 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 10MediaWiki-Page-derived-data, 07OKR-Work: Add user_central_id to mediawiki_content_history_v1 (and mediawiki_content_current_v1) - https://phabricator.wikimedia.org/T406515#11257527 (10Ahoelzl)
[00:14:13] <wikibugs>	 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 10Observability-Alerting, 10Event-Platform: EventgateProduceRateStop / EventGateProduceRateAnomaly alert should be active datacenter aware - https://phabricator.wikimedia.org/T405952#11257528 (10Ahoelzl)
[00:14:18] <wikibugs>	 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 10MediaWiki-Page-derived-data, 07OKR-Work: Global Editor Metrics - Druid mediawiki_history_reduced changes - https://phabricator.wikimedia.org/T406069#11257530 (10Ahoelzl)
[00:14:24] <wikibugs>	 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 06Wikipedia-Android-App-Backlog, 06Wikipedia-iOS-App-Backlog: [Spike] Comparitive game stats - https://phabricator.wikimedia.org/T405865#11257529 (10Ahoelzl)
[00:14:34] <wikibugs>	 06Data-Engineering (Q2 FY25/26 October 1st - December 31th): Adapt mediawiki_history to the removal of mediawiki revision.rev_sha1 - https://phabricator.wikimedia.org/T406000#11257531 (10Ahoelzl)
[00:14:38] <wikibugs>	 06Data-Engineering (Q2 FY25/26 October 1st - December 31th): Update Gobblin documentation - https://phabricator.wikimedia.org/T405780#11257532 (10Ahoelzl)
[00:14:42] <wikibugs>	 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 10DPE-Mediawiki-Content: Adapt MW Content pipelines to the removal of upstream revision.rev_sha1 - https://phabricator.wikimedia.org/T405641#11257533 (10Ahoelzl)
[00:14:46] <wikibugs>	 06Data-Engineering (Q2 FY25/26 October 1st - December 31th): Clean up artifacts.yaml - https://phabricator.wikimedia.org/T405379#11257534 (10Ahoelzl)
[00:14:50] <wikibugs>	 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 10Cassandra: Cassandra multi-tenant access configuration - https://phabricator.wikimedia.org/T318407#11257536 (10Ahoelzl)
[00:14:58] <wikibugs>	 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 06Wikimedia Enterprise, 06Data-Platform-SRE (2025.09.26 - 2025.10.17), 07Essential-Work: Implement an Airflow operator for moving data from point A to B - https://phabricator.wikimedia.org/T405360#11257535 (10Ahoelzl)
[00:15:04] <wikibugs>	 06Data-Engineering (Q2 FY25/26 October 1st - December 31th): Do not set WMF-Last-Access cookie when Sec-Fetch-Dest is not 'document' - https://phabricator.wikimedia.org/T403897#11257537 (10Ahoelzl)
[00:15:08] <wikibugs>	 06Data-Engineering (Q2 FY25/26 October 1st - December 31th): Change RefererClassifier to capture malformed but internal referer strings as internal (wmf.pageview_actor) - https://phabricator.wikimedia.org/T400799#11257542 (10Ahoelzl)
[00:15:12] <wikibugs>	 06Data-Engineering (Q2 FY25/26 October 1st - December 31th): Manage druid `webrequest_sampled_live` data size - https://phabricator.wikimedia.org/T398236#11257543 (10Ahoelzl)
[00:15:18] <wikibugs>	 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 06Discovery-Search, 10Wikidata, 10Wikidata-Query-Service, and 2 others: [EPIC] Upgrade flink jobs to java 17 - https://phabricator.wikimedia.org/T404340#11257538 (10Ahoelzl)
[00:15:22] <wikibugs>	 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 13Patch-For-Review: Optimize metrics computation for the MW Content Pipeline - https://phabricator.wikimedia.org/T401010#11257540 (10Ahoelzl)
[00:15:26] <wikibugs>	 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 10ChangeProp, 06MW-Interfaces-Team, 10Observability-Tracing, and 2 others: Implement tracing across changeprop-jobqueue, kafka, eventgate - https://phabricator.wikimedia.org/T395038#11257541 (10Ahoelzl)
[00:15:30] <wikibugs>	 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 10MediaWiki-Page-derived-data, 07OKR-Work: Global Editor Metrics - backfill data - https://phabricator.wikimedia.org/T405040#11257546 (10Ahoelzl)
[00:15:37] <wikibugs>	 06Data-Engineering (Q2 FY25/26 October 1st - December 31th): Implement the data layout, UI, and documentation for the XML file export - https://phabricator.wikimedia.org/T401022#11257547 (10Ahoelzl)
[00:15:41] <wikibugs>	 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 06Data-Platform-SRE (2025.09.26 - 2025.10.17), 07Essential-Work: Blunderbuss: Move Hadoop/HDFS XML configuration into Helm deployment chart - https://phabricator.wikimedia.org/T402323#11257549 (10Ahoelzl)
[00:15:47] <wikibugs>	 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 10Dumps-Generation: wikidatawiki fails dumps of the wbt_* tables, also lagging on XML Dumps - https://phabricator.wikimedia.org/T396125#11257548 (10Ahoelzl)
[00:15:51] <wikibugs>	 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 06Trust and Safety Product Team, 13Patch-For-Review, 06Product-Analytics (Kanban): Add mediawiki_product_metrics_incident_reporting_system_interaction to the sanitization allowlist - https://phabricator.wikimedia.org/T384650#11257544 (10Ahoelzl)
[00:15:55] <wikibugs>	 06Data-Engineering (Q2 FY25/26 October 1st - December 31th): Update Blunderbuss wikitech documentation - https://phabricator.wikimedia.org/T402290#11257550 (10Ahoelzl)
[00:15:59] <wikibugs>	 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 06Growth-Team, 10MediaWiki-Page-derived-data, 06Wikipedia-Android-App-Backlog, and 3 others: Global Editor Metrics - HTTP API endpoints - https://phabricator.wikimedia.org/T405041#11257545 (10Ahoelzl)
[00:16:09] <wikibugs>	 06Data-Engineering (Q2 FY25/26 October 1st - December 31th): Reduce `refine_to_hive_hourly` airflow task number - https://phabricator.wikimedia.org/T380856#11257553 (10Ahoelzl)
[00:16:13] <wikibugs>	 06Data-Engineering (Q2 FY25/26 October 1st - December 31th): [Refine Simplification] Remove Schema Merging in Refine Process by Enforcing Backward Compatibility - https://phabricator.wikimedia.org/T381072#11257552 (10Ahoelzl)
[00:16:17] <wikibugs>	 06Data-Engineering (Q2 FY25/26 October 1st - December 31th): Move more of refine_hive_hourly dag logic into RefineConfiguration - https://phabricator.wikimedia.org/T375064#11257554 (10Ahoelzl)
[00:16:21] <wikibugs>	 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 10Observability-Tracing, 10Event-Platform, 13Patch-For-Review: EventGate: Enable OpenTelemetry Propagation - https://phabricator.wikimedia.org/T391353#11257551 (10Ahoelzl)
[00:16:25] <wikibugs>	 06Data-Engineering (Q2 FY25/26 October 1st - December 31th): Commons Impact Metrics has no data for September snapshot - https://phabricator.wikimedia.org/T406509#11257559 (10Ahoelzl)
[00:16:29] <wikibugs>	 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 06Movement-Insights: NEW BUG REPORT : Referer Name field is Null on Druid pageviews_daily - https://phabricator.wikimedia.org/T406530#11257555 (10Ahoelzl)
[00:16:33] <wikibugs>	 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 10Data-Platform, 06Movement-Insights: NEWFEATURE REQUEST: Add new referral sources to pageview data - https://phabricator.wikimedia.org/T406531#11257557 (10Ahoelzl)
[00:16:37] <wikibugs>	 06Data-Engineering (Q2 FY25/26 October 1st - December 31th): Prepare data engineering infrastructure for drop of rev_sha1 - https://phabricator.wikimedia.org/T405503#11257563 (10Ahoelzl)
[00:20:20] <wikibugs>	 06Data-Engineering (Q2 FY25/26 October 1st - December 31th): Mitigate consequences of Gobblin hiccups generating late events and alerts - https://phabricator.wikimedia.org/T402324#11257578 (10Ahoelzl)
[00:20:25] <wikibugs>	 07Analytics-Data-Problem, 06Data-Engineering (Q2 FY25/26 October 1st - December 31th): Unique devices data uses non-standard domains for Wikidata, Wikifunctions, and MediaWiki.org - https://phabricator.wikimedia.org/T405533#11257580 (10Ahoelzl)
[00:20:29] <wikibugs>	 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 10Event-Platform: mediawiki.content_history: flink applications experiencing frequent restarts due to JobManager OOMs - https://phabricator.wikimedia.org/T397330#11257588 (10Ahoelzl)
[00:20:32] <wikibugs>	 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 10Event-Platform, 13Patch-For-Review: Deploy mediawiki-event-enrichment Flink jobs running 1.20 - https://phabricator.wikimedia.org/T401725#11257586 (10Ahoelzl)
[00:20:35] <wikibugs>	 06Data-Engineering (Q2 FY25/26 October 1st - December 31th): Analyze hourly webrequest traffic loss - July 2025 - https://phabricator.wikimedia.org/T399312#11257596 (10Ahoelzl)
[00:20:36] <wikibugs>	 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 10DPE-Mediawiki-Content, 13Patch-For-Review: Rewrite wmf_content.mediawiki_content_v1 with a new column for origin_rev_id - https://phabricator.wikimedia.org/T405944#11257590 (10Ahoelzl)
[00:20:39] <wikibugs>	 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 10DPE-Mediawiki-Content, 13Patch-For-Review: When doing ADD COLUMN to a struct under a map, Iceberg fails to SELECT it - https://phabricator.wikimedia.org/T388793#11257594 (10Ahoelzl)
[00:20:43] <wikibugs>	 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 06Data-Persistence, 10Data-Persistence-Design-Review: Global Editor Metrics - Data Persistence Design Review - https://phabricator.wikimedia.org/T401260#11257602 (10Ahoelzl)
[00:20:46] <wikibugs>	 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 06Product-Analytics, 13Patch-For-Review: Propagate field descriptions from event schemas to Hive event tables and into DataHub - https://phabricator.wikimedia.org/T307040#11257598 (10Ahoelzl)
[00:20:50] <wikibugs>	 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 06Growth-Team, 10MediaWiki-Page-derived-data, 06Wikipedia-Android-App-Backlog, and 2 others: WE3.3.7 Year in Review and Activity Tab Services - Global Editor Metrics - https://phabricator.wikimedia.org/T403660#11257600 (10Ahoelzl)
[00:21:00] <wikibugs>	 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 10MediaWiki-Page-derived-data, 07OKR-Work: mediawiki_history_reduced - add page_id and user_central_id fields - https://phabricator.wikimedia.org/T406263#11257606 (10Ahoelzl)
[00:21:06] <wikibugs>	 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 10MediaWiki-Page-derived-data, 07OKR-Work: Global Editor Metrics - Data Pipeline - https://phabricator.wikimedia.org/T405039#11257608 (10Ahoelzl)
[00:21:12] <wikibugs>	 06Data-Engineering (Q2 FY25/26 October 1st - December 31th): Backfill datasets affected by automated traffic detection issues - https://phabricator.wikimedia.org/T405667#11257610 (10Ahoelzl)
[00:21:16] <wikibugs>	 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 06Data-Persistence, 10Data-Persistence-Design-Review, 06Growth-Team, and 3 others: Data Persistence Design Review: Improve Tone Suggested Edits newcomer task - https://phabricator.wikimedia.org/T401021#11257604 (10Ahoelzl)
[00:21:28] <wikibugs>	 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 13Patch-For-Review: Prepare webrequest derived Airflow DAGs for large scale re-runs - https://phabricator.wikimedia.org/T402645#11257612 (10Ahoelzl)
[00:21:32] <wikibugs>	 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 13Patch-For-Review: NEW BUG REPORT wmf.interlanguage_navigation missing mobile data - https://phabricator.wikimedia.org/T396514#11257614 (10Ahoelzl)
[00:21:40] <wikibugs>	 06Data-Engineering (Q2 FY25/26 October 1st - December 31th): Clean up airflow-dags gitlab-ci.yaml CI/CD pipelines - https://phabricator.wikimedia.org/T400283#11257620 (10Ahoelzl)
[00:21:44] <wikibugs>	 06Data-Engineering (Q2 FY25/26 October 1st - December 31th): Revive data engineering alert metrics dashboard - https://phabricator.wikimedia.org/T399518#11257618 (10Ahoelzl)
[00:21:48] <wikibugs>	 06Data-Engineering (Q2 FY25/26 October 1st - December 31th): Implement full parity between HiveSensor and RESTExternalTaskSensor - https://phabricator.wikimedia.org/T384726#11257622 (10Ahoelzl)
[00:21:52] <wikibugs>	 06Data-Engineering (Q2 FY25/26 October 1st - December 31th): Refine to Hive with Airflow – Kubernetes Resource Optimization - https://phabricator.wikimedia.org/T392668#11257626 (10Ahoelzl)
[00:21:56] <wikibugs>	 06Data-Engineering (Q2 FY25/26 October 1st - December 31th): Update MediaWiki Content History SLO draft for SRE review - https://phabricator.wikimedia.org/T401892#11257630 (10Ahoelzl)
[00:22:00] <wikibugs>	 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 10DPE-Mediawiki-Content: Another instance of duplicate rows on wmf_content.mediawiki_content_history_v1 - https://phabricator.wikimedia.org/T404975#11257632 (10Ahoelzl)
[00:22:04] <wikibugs>	 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 10DPE-Mediawiki-Content: Remove code and tables related to deprecated mediawiki_wikitext_history and mediawiki_wikitext_current - https://phabricator.wikimedia.org/T396031#11257636 (10Ahoelzl)
[00:22:08] <wikibugs>	 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 10DPE-Mediawiki-Content: MediaWiki Content History alerts too much for minor reconcile issues - https://phabricator.wikimedia.org/T395139#11257638 (10Ahoelzl)
[00:22:12] <wikibugs>	 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 10DPE-Mediawiki-Content, 13Patch-For-Review: Investigate reasons for remaining inconsistencies - https://phabricator.wikimedia.org/T385112#11257628 (10Ahoelzl)
[00:22:16] <wikibugs>	 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 06Traffic: Fix Hive event.development_network_probe table - https://phabricator.wikimedia.org/T400360#11257642 (10Ahoelzl)
[00:22:22] <wikibugs>	 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 10MediaWiki-Core-Revision-backend, 10MediaWiki-DomainEvents, 06MW-Interfaces-Team, and 4 others: MediaWiki\Revision\RevisionAccessException: Unable to load fresh row for rev_id: {rev_id} - https://phabricator.wikimedia.org/T400380#11257646 (10Ahoe...
[00:22:29] <wikibugs>	 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 06Experimentation Lab: NEW/CHANGE FEATURE REQUEST: make available the centralauth.globaluser table in Data Lake - https://phabricator.wikimedia.org/T389666#11257649 (10Ahoelzl)
[00:22:33] <wikibugs>	 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 07Essential-Work, 13Patch-For-Review: [Data Quality] Implement wiki completeness check for MediaWiki History - https://phabricator.wikimedia.org/T365203#11257651 (10Ahoelzl)
[06:54:55] <wikibugs>	 (03CR) 10Thiemo Kreuz (WMDE): [C:03+1] "I think this needs to be rebased or squashed with the previous change that removed the old URL. Otherwise this looks fine to me. 👍" [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/1194721 (https://phabricator.wikimedia.org/T406502) (owner: 10Hemmnt)
[07:07:57] <wikibugs>	 (03PS1) 10Joal: Add referer_name to druid pageview_daily [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1194821 (https://phabricator.wikimedia.org/T406530)
[07:23:52] <wikibugs>	 06Data-Engineering, 06Movement-Insights: Fix pageviews datasets in Druid/Turnilo/Superset - https://phabricator.wikimedia.org/T380754#11258238 (10JAllemandou) →14Duplicate dup:03T406530
[07:24:00] <wikibugs>	 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 06Movement-Insights, 13Patch-For-Review: NEW BUG REPORT : Referer Name field is Null on Druid pageviews_daily - https://phabricator.wikimedia.org/T406530#11258240 (10JAllemandou)
[07:35:05] <wikibugs>	 (03CR) 10JavierMonton: [C:03+1] Add referer_name to druid pageview_daily [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1194821 (https://phabricator.wikimedia.org/T406530) (owner: 10Joal)
[07:43:25] <wikibugs>	 (03CR) 10Joal: [V:03+2 C:03+2] "Merging for deploy" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1194821 (https://phabricator.wikimedia.org/T406530) (owner: 10Joal)
[07:52:02] <joal>	 !log Deploying refinery with scap to unlock T406530
[07:52:05] <stashbot>	 Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log
[07:52:06] <stashbot>	 T406530: NEW BUG REPORT : Referer Name field is Null on Druid pageviews_daily - https://phabricator.wikimedia.org/T406530
[08:30:57] <wikibugs>	 06Data-Engineering, 10Data-Engineering-Wikistats, 13Patch-For-Review: "Designed by Aislinn Grigas" at the bottom of stats.wikimedia.org leads to an inactive Squarespace account - https://phabricator.wikimedia.org/T406502#11258502 (10Hemmanttt) @BCornwall if everything is fine from your side please let this t...
[09:04:18] <wikibugs>	 (03PS1) 10Joal: Fix unique-devices per domain domains [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1194885 (https://phabricator.wikimedia.org/T405533)
[09:19:35] <wikibugs>	 06Data-Engineering, 10Data-Engineering-Wikistats, 13Patch-For-Review: "Designed by Aislinn Grigas" at the bottom of stats.wikimedia.org leads to an inactive Squarespace account - https://phabricator.wikimedia.org/T406502#11258691 (10A_smart_kitten) @hemmanttt it's just my opinion but I feel like we should wa...
[09:34:21] <wikibugs>	 (03CR) 10Aqu: [C:03+1] "Make sense." [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1194885 (https://phabricator.wikimedia.org/T405533) (owner: 10Joal)
[09:48:51] <wikibugs>	 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 06Data-Persistence, 10Data-Persistence-Design-Review, 06Growth-Team, and 3 others: Data Persistence Design Review: Improve Tone Suggested Edits newcomer task - https://phabricator.wikimedia.org/T401021#11258859 (10isarantopoulos) @Eevans Aiko has...
[11:34:00] <wikibugs>	 06Data-Engineering (Q2 FY25/26 October 1st - December 31th): GobblinLastSuccessfulRunTooLongAgo alerts - https://phabricator.wikimedia.org/T406526#11259362 (10dr0ptp4kt) >>! In T406526#11256288, @Ottomata wrote: > We should figure out why _test gobblin stuff is firing.  It is annoying to get these alerts in ops...
[11:58:14] <wikibugs>	 06Data-Engineering (Q2 FY25/26 October 1st - December 31th): GobblinLastSuccessfulRunTooLongAgo alerts - https://phabricator.wikimedia.org/T406526#11259472 (10JAllemandou) The `_test` issues were related to tests Aleks made on the airflow test instance, deleting the instance itself. Ben and Aleks talked about th...
[12:09:39] <jclark-ctr>	 Need some assistance with drive swaps at eqiad. When someone has a chance, could they please assist or update ticket to schedule?  T406293 (an-worker) and T406394 (druid server)
[12:09:39] <stashbot>	 T406293: Degraded RAID on an-worker1235 - https://phabricator.wikimedia.org/T406293
[12:09:40] <stashbot>	 T406394: Degraded RAID on druid1011 - https://phabricator.wikimedia.org/T406394
[12:28:59] <btullis>	 jclark-ctr: Ack, looking now. Thx.
[12:35:36] <wikibugs>	 06Data-Engineering, 10Gerrit, 06Release-Engineering-Team: Reduce size of analytics/superset/deploy.git Gerrit repo - https://phabricator.wikimedia.org/T406856 (10hashar) 03NEW
[13:11:15] <wikibugs>	 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 10DPE-Mediawiki-Content, 13Patch-For-Review: Rewrite wmf_content.mediawiki_content_v1 with a new column for origin_rev_id - https://phabricator.wikimedia.org/T405944#11259705 (10xcollazo) [[ https://wikimedia.slack.com/archives/CSV483812/p175995207...
[13:12:18] <wikibugs>	 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 10DPE-Mediawiki-Content, 13Patch-For-Review: Rewrite wmf_content.mediawiki_content_v1 with a new column for origin_rev_id - https://phabricator.wikimedia.org/T405944#11259707 (10xcollazo) With both tables now migrated, will start merging pipeline c...
[13:12:30] <wikibugs>	 06Data-Engineering (Q2 FY25/26 October 1st - December 31th): GobblinLastSuccessfulRunTooLongAgo alerts - https://phabricator.wikimedia.org/T406526#11259709 (10Ottomata) Hm, I think _test stuff fires relatively often, not just for this one instance?  {F66740244}
[13:12:52] <wikibugs>	 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 10DPE-Mediawiki-Content, 13Patch-For-Review: Rewrite wmf_content.mediawiki_content_*_v1 tables with a new column for origin_rev_id - https://phabricator.wikimedia.org/T405944#11259710 (10xcollazo)
[13:13:03] <wikibugs>	 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 10DPE-Mediawiki-Content, 13Patch-For-Review: Rewrite wmf_content.mediawiki_content_*_v1 tables with a new column for origin_rev_id - https://phabricator.wikimedia.org/T405944#11259712 (10xcollazo) 05Open→03In progress p:05Triage→03High
[13:13:08] <wikibugs>	 06Data-Engineering (Q2 FY25/26 October 1st - December 31th): GobblinLastSuccessfulRunTooLongAgo alerts - https://phabricator.wikimedia.org/T406526#11259715 (10Ottomata) Or actually, maybe not? I don't have any of these for event_default_test job before Oct 1 really.
[13:16:24] <wikibugs>	 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 06Data-Persistence, 10Data-Persistence-Design-Review, 06Growth-Team, and 3 others: Data Persistence Design Review: Improve Tone Suggested Edits newcomer task - https://phabricator.wikimedia.org/T401021#11259736 (10Ottomata) > Keying on it like th...
[13:19:25] <wikibugs>	 (03CR) 10Milimetric: [C:03+2] "Thanks very much all, will deploy this now" [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/1194721 (https://phabricator.wikimedia.org/T406502) (owner: 10Hemmnt)
[13:21:04] <wikibugs>	 (03CR) 10Milimetric: [C:03+2] Enable Estonian language [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/1191391 (owner: 10Pikne)
[13:21:18] <wikibugs>	 (03CR) 10Milimetric: [V:03+2] Localisation updates from https://translatewiki.net. [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/1194928 (owner: 10L10n-bot)
[13:22:26] <wikibugs>	 (03Merged) 10jenkins-bot: Enable Estonian language [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/1191391 (owner: 10Pikne)
[13:22:44] <wikibugs>	 (03CR) 10Milimetric: [C:03+2] Enable Persian language [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/1123658 (owner: 10Ebrahim)
[13:24:02] <wikibugs>	 (03Merged) 10jenkins-bot: Enable Persian language [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/1123658 (owner: 10Ebrahim)
[13:26:01] <wikibugs>	 06Data-Engineering (Q2 FY25/26 October 1st - December 31th): Optimize table maintenance for wmf_content.mediawiki_content_current_v1 - https://phabricator.wikimedia.org/T406864 (10xcollazo) 03NEW
[13:26:25] <wikibugs>	 10Data-Engineering-Roadmap, 10DPE-Mediawiki-Content, 07Epic: Dumps 2.0 Phase III: Production level dumps - https://phabricator.wikimedia.org/T366752#11259828 (10xcollazo)
[13:26:26] <wikibugs>	 06Data-Engineering (Q2 FY25/26 October 1st - December 31th): Optimize table maintenance for wmf_content.mediawiki_content_current_v1 - https://phabricator.wikimedia.org/T406864#11259827 (10xcollazo)
[13:27:31] <wikibugs>	 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 10DPE-Mediawiki-Content, 13Patch-For-Review: Rewrite wmf_content.mediawiki_content_*_v1 tables with a new column for origin_rev_id - https://phabricator.wikimedia.org/T405944#11259833 (10xcollazo) (Notice a significant reading slow down on the old...
[13:31:20] <wikibugs>	 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 10DPE-Mediawiki-Content: Rewrite wmf_content.mediawiki_content_*_v1 tables with a new column for origin_rev_id - https://phabricator.wikimedia.org/T405944#11259860 (10xcollazo) New `wmf_content.mediawiki_content_current_v1` looks good compared to old...
[13:47:10] <wikibugs>	 (03PS1) 10Milimetric: Release 2.11.0 [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/1194943
[13:47:56] <wikibugs>	 (03CR) 10Milimetric: [C:03+2] Release 2.11.0 [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/1194943 (owner: 10Milimetric)
[13:48:09] <wikibugs>	 (03CR) 10CI reject: [V:04-1] Release 2.11.0 [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/1194943 (owner: 10Milimetric)
[14:02:33] <wikibugs>	 06Data-Engineering, 10ChangeProp, 10Citoid, 06Content-Transform-Team, and 20 others: Migrate node-based services in production to node22 - https://phabricator.wikimedia.org/T393434#11260039 (10Mvolz)
[14:02:56] <wikibugs>	 06Data-Engineering, 10ChangeProp, 10Citoid, 06Content-Transform-Team, and 20 others: Migrate node-based services in production to node22 - https://phabricator.wikimedia.org/T393434#11260040 (10Mvolz)
[14:03:44] <wikibugs>	 06Data-Engineering, 10ChangeProp, 10Citoid, 06Content-Transform-Team, and 20 others: Migrate node-based services in production to node22 - https://phabricator.wikimedia.org/T393434#11260042 (10Mvolz)
[14:03:50] <wikibugs>	 06Data-Engineering, 10Event-Platform: Fix mediawiki event enrichment to work with newest version of Blubber - https://phabricator.wikimedia.org/T406872 (10tchin) 03NEW
[14:11:31] <wikibugs>	 (03PS1) 10Aleksandar Mastilovic: Add user_central_id to the mediawiki_history dataset [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1194951 (https://phabricator.wikimedia.org/T406263)
[14:16:02] <wikibugs>	 06Data-Engineering, 10Event-Platform: Fix mediawiki event enrichment to work with newest version of Blubber - https://phabricator.wikimedia.org/T406872#11260116 (10tchin)
[14:19:21] <wikibugs>	 06Data-Engineering, 10ChangeProp, 10Citoid, 06Editing-team, and 21 others: Migrate node-based services in production to node22 - https://phabricator.wikimedia.org/T393434#11260122 (10MSantos)
[14:19:44] <wikibugs>	 06Data-Engineering, 10ChangeProp, 10Citoid, 06Editing-team, and 21 others: Migrate node-based services in production to node22 - https://phabricator.wikimedia.org/T393434#11260124 (10MSantos)
[14:21:46] <wikibugs>	 (03PS2) 10Milimetric: Release 2.11.0 [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/1194943
[14:21:56] <wikibugs>	 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 10DPE-Mediawiki-Content, 13Patch-For-Review: Rewrite wmf_content.mediawiki_content_*_v1 tables with a new column for origin_rev_id - https://phabricator.wikimedia.org/T405944#11260133 (10xcollazo) Resumed `mw_content_merge_changes_to_mw_content_cur...
[14:23:08] <wikibugs>	 (03CR) 10Milimetric: [C:03+2] "tests fixed, new versions of packages seem to be working and remove some critical vulnerabilities" [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/1194943 (owner: 10Milimetric)
[14:23:45] <wikibugs>	 06Data-Engineering, 10Gerrit, 06Release-Engineering-Team: Reduce size of analytics/superset/deploy.git Gerrit repo - https://phabricator.wikimedia.org/T406856#11260143 (10ABran-WMF)
[14:24:05] <wikibugs>	 (03Merged) 10jenkins-bot: Release 2.11.0 [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/1194943 (owner: 10Milimetric)
[14:26:23] <wikibugs>	 (03CR) 10JavierMonton: Add user_central_id to the mediawiki_history dataset (031 comment) [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1194951 (https://phabricator.wikimedia.org/T406263) (owner: 10Aleksandar Mastilovic)
[14:27:38] <wikibugs>	 (03PS4) 10Milimetric: Updated footer credit link to Aislinn’s LinkedIn profile [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/1194721 (https://phabricator.wikimedia.org/T406502) (owner: 10Hemmnt)
[14:27:54] <wikibugs>	 (03CR) 10Milimetric: [V:03+2 C:03+2] "rebased and merging to deploy" [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/1194721 (https://phabricator.wikimedia.org/T406502) (owner: 10Hemmnt)
[14:28:15] <wikibugs>	 (03CR) 10Milimetric: [V:03+2 C:03+2] "done" [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/1194721 (https://phabricator.wikimedia.org/T406502) (owner: 10Hemmnt)
[14:28:20] <wikibugs>	 06Data-Engineering (Q2 FY25/26 October 1st - December 31th): airflow-dags shorten build/test time - https://phabricator.wikimedia.org/T406874 (10amastilovic) 03NEW
[14:32:38] <wikibugs>	 (03CR) 10Aleksandar Mastilovic: [C:03+2] "LGTM!" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1194885 (https://phabricator.wikimedia.org/T405533) (owner: 10Joal)
[14:33:53] <wikibugs>	 (03PS1) 10Milimetric: Release 2.11.1 [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/1194959
[14:34:11] <wikibugs>	 (03CR) 10Milimetric: [C:03+2] Release 2.11.1 [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/1194959 (owner: 10Milimetric)
[14:35:16] <wikibugs>	 (03Merged) 10jenkins-bot: Release 2.11.1 [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/1194959 (owner: 10Milimetric)
[14:40:21] <wikibugs>	 (03CR) 10Aleksandar Mastilovic: Add user_central_id to the mediawiki_history dataset (031 comment) [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1194951 (https://phabricator.wikimedia.org/T406263) (owner: 10Aleksandar Mastilovic)
[14:49:43] <wikibugs>	 (03CR) 10JavierMonton: [C:03+1] "Looks good to me, but it's my first time looking at this code." [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1194951 (https://phabricator.wikimedia.org/T406263) (owner: 10Aleksandar Mastilovic)
[14:59:31] <wikibugs>	 06Data-Engineering, 10Data-Engineering-Wikistats, 13Patch-For-Review: "Designed by Aislinn Grigas" at the bottom of stats.wikimedia.org leads to an inactive Squarespace account - https://phabricator.wikimedia.org/T406502#11260326 (10Milimetric) @A_smart_kitten: no worries, @Hemmanttt sent a new patch with th...
[15:00:26] <wikibugs>	 06Data-Engineering, 10Data-Engineering-Wikistats, 13Patch-For-Review: "Designed by Aislinn Grigas" at the bottom of stats.wikimedia.org leads to an inactive Squarespace account - https://phabricator.wikimedia.org/T406502#11260343 (10Milimetric) 05Open→03Resolved
[15:01:01] <wikibugs>	 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 06Data-Persistence, 10Data-Persistence-Design-Review, 06Growth-Team, and 3 others: Data Persistence Design Review: Improve Tone Suggested Edits newcomer task - https://phabricator.wikimedia.org/T401021#11260349 (10Eevans) >>! In T401021#11258859,...
[15:07:15] <wikibugs>	 06Data-Engineering (Q2 FY25/26 October 1st - December 31th): Conduct Analysis on Alerting for changes in automated traffic distribution - https://phabricator.wikimedia.org/T406882 (10Snwachukwu) 03NEW
[15:12:11] <wikibugs>	 06Data-Engineering (Q2 FY25/26 October 1st - December 31th): Conduct Analysis on Alerting for changes in automated traffic distribution - https://phabricator.wikimedia.org/T406882#11260475 (10Snwachukwu)
[15:12:22] <wikibugs>	 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 07OKR-Work: Conduct Analysis on Alerting for changes in automated traffic distribution - https://phabricator.wikimedia.org/T406882#11260476 (10Snwachukwu)
[15:20:09] <wikibugs>	 06Data-Engineering, 10Data-Engineering-Wikistats, 13Patch-For-Review: "Designed by Aislinn Grigas" at the bottom of stats.wikimedia.org leads to an inactive Squarespace account - https://phabricator.wikimedia.org/T406502#11260559 (10A_smart_kitten) >>! In T406502#11260326, @Milimetric wrote: > @A_smart_k...
[15:25:12] <wikibugs>	 06Data-Engineering, 06Data-Persistence, 10MediaWiki-Core-Revision-backend, 10Wikidata, and 5 others: Rethink rev_sha1 field - https://phabricator.wikimedia.org/T389026#11260613 (10karapayneWMDE)
[16:02:09] <wikibugs>	 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 07OKR-Work: Conduct Analysis on Alerting for changes in automated traffic distribution - https://phabricator.wikimedia.org/T406882#11260890 (10Snwachukwu) Curent plan: 1. Understand the variability of pageviews by monitoring the delta change of total...
[16:04:14] <wikibugs>	 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 10Data-Platform, 06Movement-Insights: NEWFEATURE REQUEST: Add new referral sources to pageview data - https://phabricator.wikimedia.org/T406531#11260894 (10GGoncalves-WMF) a:05JAllemandou→03Mayakp.wiki @JAllemandou and @OSefu-WMF just had a cha...
[16:05:38] <wikibugs>	 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 10Data-Platform, 06Movement-Insights: NEWFEATURE REQUEST: Add new referral sources to pageview data - https://phabricator.wikimedia.org/T406531#11260896 (10JAllemandou) I have replicated the query above on pageviews only, the ratios stay exactly si...
[16:14:51] <wikibugs>	 06Data-Engineering, 10Data-Engineering-Wikistats, 13Patch-For-Review: "Designed by Aislinn Grigas" at the bottom of stats.wikimedia.org leads to an inactive Squarespace account - https://phabricator.wikimedia.org/T406502#11260961 (10Milimetric) No worries at all, @A_smart_kitten, thank you very much for...
[16:21:13] <wikibugs>	 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 06Movement-Insights, 13Patch-For-Review: NEW BUG REPORT : Referer Name field is Null on Druid pageviews_daily - https://phabricator.wikimedia.org/T406530#11260971 (10JAllemandou) The `referer_name` field got added on April, 11th 2023 (T334120). I'l...
[16:22:12] <sukhe>	 hi folks
[16:22:17] <sukhe>	 does someone know the status of Servers dse-k8s-worker2002.codfw.wmnet?
[16:22:30] <sukhe>	 they are marked as pooled but pybal is not happy
[16:22:30] <sukhe>	                       k8s-ingress-dse_30443: Servers dse-k8s-worker2002.codfw.wmnet are marked down but pooled 
[16:30:25] <wikibugs>	 06Data-Engineering (Q2 FY25/26 October 1st - December 31th): GobblinLastSuccessfulRunTooLongAgo alerts - https://phabricator.wikimedia.org/T406526#11261047 (10JAllemandou) I sent a patch to remove data-alerts for the test cluster so it's expected they'd be gone, see T406009 :)
[16:45:42] <wikibugs>	 06Data-Engineering, 10Data-Engineering-Wikistats, 06RoadToWiki, 13Patch-For-Review: "Designed by Aislinn Grigas" at the bottom of stats.wikimedia.org leads to an inactive Squarespace account - https://phabricator.wikimedia.org/T406502#11261125 (10Kavaljeet_Singh)
[17:48:40] <wikibugs>	 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 06Wikimedia Enterprise, 10Wikimedia Enterprise - Content Integrity, 06Data-Platform-SRE (2025.09.26 - 2025.10.17), 07Essential-Work: Implement an Airflow operator for moving data from point A t... - https://phabricator.wikimedia.org/T405360#11261450
[18:10:48] <wikibugs>	 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 10DPE-Mediawiki-Content, 13Patch-For-Review: Rewrite wmf_content.mediawiki_content_*_v1 tables with a new column for origin_rev_id - https://phabricator.wikimedia.org/T405944#11261572 (10xcollazo) >>! In T405944#11260133, @xcollazo wrote: > Resumed...
[18:57:57] <wikibugs>	 06Data-Engineering, 06Product Safety and Integrity, 10QuickSurveys, 10Temporary accounts, 06Trust and Safety Product Team: QuickSurveyResponse lacks temporary account information - https://phabricator.wikimedia.org/T406919 (10Jdlrobson-WMF) 03NEW
[19:01:04] <wikibugs>	 06Data-Engineering, 06Product Safety and Integrity, 10QuickSurveys, 10Temporary accounts, 06Trust and Safety Product Team: Does QuickSurveyResponse lacks temporary account information? - https://phabricator.wikimedia.org/T406919#11261767 (10Jdlrobson-WMF)
[19:01:10] <wikibugs>	 06Data-Engineering, 06Product Safety and Integrity, 10QuickSurveys, 10Temporary accounts, 06Trust and Safety Product Team: Does QuickSurveyResponse lacks temporary account information? - https://phabricator.wikimedia.org/T406919#11261770 (10Jdlrobson-WMF) I'm hoping that is_temp is added automatically to...
[19:01:21] <wikibugs>	 06Data-Engineering (Q2 FY25/26 October 1st - December 31th): GobblinLastSuccessfulRunTooLongAgo alerts - https://phabricator.wikimedia.org/T406526#11261771 (10dr0ptp4kt) Is that  >>! In T406526#11261047, @JAllemandou wrote: > I sent a patch to remove data-alerts for the test cluster so it's expected they'd be go...
[19:32:12] <wikibugs>	 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 10MediaWiki-Page-derived-data, 07OKR-Work: Global Editor Metrics - Druid mediawiki_history_reduced changes - https://phabricator.wikimedia.org/T406069#11261850 (10Ottomata) Update!    So, all the load testing I did was with Druid SQL GROUP BY. This...
[19:35:16] <wikibugs>	 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 06Movement-Insights, 13Patch-For-Review: NEW BUG REPORT : Referer Name field is Null on Druid pageviews_daily - https://phabricator.wikimedia.org/T406530#11261854 (10JAllemandou) Data has been backfilled from 2025-04-01 to today using Airflow. I ne...
[19:36:11] <wikibugs>	 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 06Growth-Team, 10MediaWiki-Page-derived-data, 06Wikipedia-Android-App-Backlog, and 2 others: WE3.3.7 Year in Review and Activity Tab Services - Global Editor Metrics - https://phabricator.wikimedia.org/T403660#11261856 (10Ottomata) Hi all, after...
[19:38:32] <wikibugs>	 06Data-Engineering (Q2 FY25/26 October 1st - December 31th): GobblinLastSuccessfulRunTooLongAgo alerts - https://phabricator.wikimedia.org/T406526#11261858 (10JAllemandou) I don't think we should remove this alert. It fired lately because of tests made on infra that shouldn't have been done in the way they did (...
[19:43:09] <wikibugs>	 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 10DPE-Mediawiki-Content, 13Patch-For-Review: Rewrite wmf_content.mediawiki_content_*_v1 tables with a new column for origin_rev_id - https://phabricator.wikimedia.org/T405944#11261866 (10xcollazo) Coming back to T405944#11242574, we now need to fix...
[19:52:05] <wikibugs>	 06Data-Engineering (Q2 FY25/26 October 1st - December 31th): GobblinLastSuccessfulRunTooLongAgo alerts - https://phabricator.wikimedia.org/T406526#11261881 (10dr0ptp4kt) @JAllemandou I see. Right...with an email search of `GobblinLastSuccessfulRunTooLongAgo (eventlogging_legacy_test OR webrequest_frontend_test)`...
[20:27:15] <wikibugs>	 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 10DPE-Mediawiki-Content, 13Patch-For-Review: Rewrite wmf_content.mediawiki_content_*_v1 tables with a new column for origin_rev_id - https://phabricator.wikimedia.org/T405944#11262119 (10xcollazo) ` hostname -f an-launcher1002.eqiad.wmnet  sudo -u...
[21:10:56] <wikibugs>	 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 10DPE-Mediawiki-Content, 13Patch-For-Review: Rewrite wmf_content.mediawiki_content_*_v1 tables with a new column for origin_rev_id - https://phabricator.wikimedia.org/T405944#11262398 (10xcollazo) ` spark-sql (default)>  MERGE INTO wmf_content.medi...