[02:56:29] 06Data-Engineering, 13Patch-For-Review: [NEEDS GROOMING] deequ repo should be instantiated from Wikimedia's DQ metrics store - https://phabricator.wikimedia.org/T353939#10431252 (10tchin) Looking at it, it seems like the easiest thing to do would be to use Deequ's `AnalysisResultSerde` and add a new column to... [09:08:56] (03PS12) 10Peter Fischer: Rewrite MediawikiDumper partitioning implementation [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1101892 (https://phabricator.wikimedia.org/T381016) [09:39:07] (03CR) 10CI reject: [V:04-1] Rewrite MediawikiDumper partitioning implementation [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1101892 (https://phabricator.wikimedia.org/T381016) (owner: 10Peter Fischer) [10:47:35] 06Data-Engineering, 06Growth-Team, 06MediaWiki-Engineering, 10MediaWiki-extensions-WikimediaEvents, and 6 others: Add Prometheus support to statsd.js via mw.track() - https://phabricator.wikimedia.org/T355837#10431981 (10Michael) >>! In T355837#10417760, @Krinkle wrote: > A few updates: > > * The infr... [13:17:42] 06Data-Engineering, 10ConfirmEdit (CAPTCHA extension), 06Experimentation Lab, 10MediaWiki-extensions-EventLogging, and 2 others: Send captcha API response data to event logging - https://phabricator.wikimedia.org/T379179#10432318 (10kostajh) >>! In T379179#10406142, @Ottomata wrote: > @acooper, what would... [14:18:27] 06Data-Engineering, 06Data-Platform, 06DBA, 07Schema-change-in-production: Change page.page_links_updated to fixed-length timestamp in wmf wikis - https://phabricator.wikimedia.org/T371742#10432544 (10Ladsgroup) [14:39:46] 10Data-Engineering (Q2 2024 October 1st - December 31th), 07Epic, 13Patch-For-Review: [Maintenance] Safeguard VarnishKafka to HAProxy analytics transition - https://phabricator.wikimedia.org/T354694#10432675 (10gmodena) [14:41:20] 10Data-Engineering (Q2 2024 October 1st - December 31th): load haproxykafka topics into HDFS via gobblin - https://phabricator.wikimedia.org/T377931#10432679 (10gmodena) >>! In T377931#10254814, @gmodena wrote: >> You might want to start finding and engaging with consumers ASAP so they aren't surprised by this.... [14:56:13] 06Data-Engineering, 10Event-Platform, 10MW-1.44-notes (1.44.0-wmf.12; 2025-01-14), 13Patch-For-Review, 07Performance Issue: Ad-hoc EventBus event submissions should be batched - https://phabricator.wikimedia.org/T382970#10432739 (10Ottomata) Nice! [17:34:34] 10Data-Engineering (Q2 2024 October 1st - December 31th), 10CheckUser, 06DBA, 06Experimentation Lab, and 2 others: Remove cuc_actiontext, cuc_only_for_read_old, and cuc_private from cu_changes on WMF wikis - https://phabricator.wikimedia.org/T370903#10433438 (10Ladsgroup) [17:34:41] 10Data-Engineering (Q2 2024 October 1st - December 31th), 10CheckUser, 06DBA, 06Experimentation Lab, and 2 others: Remove cuc_actiontext, cuc_only_for_read_old, and cuc_private from cu_changes on WMF wikis - https://phabricator.wikimedia.org/T370903#10433440 (10Ladsgroup) [18:41:35] 06Data-Engineering, 06Research: Incremental HTML wiki content dataset to support "Who are moderators" SDS 1.2.3 - https://phabricator.wikimedia.org/T380874#10433685 (10Ottomata) [18:47:06] 10Data-Engineering (Q2 2024 October 1st - December 31th), 10MW-1.44-notes (1.44.0-wmf.12; 2025-01-14): EventBus PageChangeHooks uses unconventional log channel name - https://phabricator.wikimedia.org/T382288#10433711 (10Ahoelzl) [18:48:57] 10Data-Engineering (Q2 2024 October 1st - December 31th): Human pageviews potentially misclassified as automated - https://phabricator.wikimedia.org/T382713#10433716 (10Ahoelzl) a:03JAllemandou [18:49:49] 10Data-Engineering (Q2 2024 October 1st - December 31th): Human pageviews potentially misclassified as automated - https://phabricator.wikimedia.org/T382713#10433726 (10Ahoelzl) @JAllemandou can you comment on a potential root cause? Is this related to recent unique devices work? [18:51:02] 10Data-Engineering (Q2 2024 October 1st - December 31th): [Airflow-test] refine_to_hive_hourly_test.refine_hive_dataset.wait_for_gobblin_export is failing recurrently - https://phabricator.wikimedia.org/T382901#10433732 (10Ahoelzl) a:03Antoine_Quhen [18:54:56] 06Data-Engineering, 10Dumps-Generation: Wikimedia Downloads not complete - https://phabricator.wikimedia.org/T383030#10433746 (10Ahoelzl) [18:56:17] 06Data-Engineering, 06DBA, 07Schema-change-in-production: Change page.page_links_updated to fixed-length timestamp in wmf wikis - https://phabricator.wikimedia.org/T371742#10433751 (10Ottomata) [19:00:43] 10Data-Engineering (Q2 2024 October 1st - December 31th), 06Data-Platform, 10Dumps-Generation: 20241201 wikidatawiki xml dump not progressing - https://phabricator.wikimedia.org/T382084#10433765 (10Ahoelzl) @xcollazo can we consider this resolved? [19:14:25] 10Data-Engineering (Q2 2024 October 1st - December 31th), 06Data-Platform, 10Dumps-Generation: 20241201 wikidatawiki xml dump not progressing - https://phabricator.wikimedia.org/T382084#10433801 (10xcollazo) >>! In T382084#10433765, @Ahoelzl wrote: > @xcollazo can we consider this resolved? We still need to... [20:11:59] 06Data-Engineering, 10MediaWiki-Core-Hooks, 10MediaWiki-DomainEvents, 06MW-Interfaces-Team, 10Event-Platform: Implement DomainEventDispatcher (baseline) - https://phabricator.wikimedia.org/T377229#10433980 (10daniel) [20:12:29] 10Data-Engineering (Q2 2024 October 1st - December 31th), 10MediaWiki-Core-Hooks, 10MediaWiki-DomainEvents, 06MW-Interfaces-Team, and 3 others: Design and document new Domain Events feature in MediaWiki core - https://phabricator.wikimedia.org/T379959#10433990 (10daniel) [20:12:35] 10Data-Engineering (Q2 2024 October 1st - December 31th), 10MediaWiki-DomainEvents, 06MW-Interfaces-Team: Explore a mechanism for publishing domain events to an event bus - https://phabricator.wikimedia.org/T379935#10433991 (10daniel) [20:12:57] 10Data-Engineering (Q2 2024 October 1st - December 31th), 10MediaWiki-DomainEvents, 06MW-Interfaces-Team, 13Patch-For-Review: Explore mechanism for publishing domain events - https://phabricator.wikimedia.org/T378933#10433995 (10daniel) [20:13:13] 06Data-Engineering, 10Commons-Impact-Metrics-Requests, 06Experimentation Lab: Request for Images_from_Wiki_Loves_Africa_2024 - https://phabricator.wikimedia.org/T381352#10434000 (10VirginiaPoundstone) [20:17:01] 06Data-Engineering, 10Data-Engineering-Wikistats: slider bar for period in wikistats is becoming unusable - https://phabricator.wikimedia.org/T380565#10434020 (10VirginiaPoundstone) [20:17:13] 06Data-Engineering, 06Data-Platform: WMF-last-access cookie sets wrong domain for static assets on commons - https://phabricator.wikimedia.org/T367346#10434021 (10VirginiaPoundstone) [20:17:39] 06Data-Engineering, 06Abstract Wikipedia team, 06Data-Platform, 10Wikifunctions: Bug: Cassandra Unique Devices not loading Wikifunctions mobile data - https://phabricator.wikimedia.org/T370551#10434023 (10VirginiaPoundstone) [20:18:09] 06Data-Engineering, 06Data-Platform, 10FR-Tech-Analytics, 06Fundraising-Backlog, 10fundraising-tech-ops: Allow Fundraising Supserset to connect to Production Druid - https://phabricator.wikimedia.org/T370944#10434024 (10VirginiaPoundstone) [20:18:38] 06Data-Engineering, 06Data-Platform, 06Movement-Insights: Modify the automated traffic detection to be applied at the project family level - https://phabricator.wikimedia.org/T377257#10434025 (10VirginiaPoundstone) [20:18:52] 06Data-Engineering, 06Data-Platform, 06Movement-Insights, 13Patch-For-Review: Backfill and recalculate unique devices data from July 2024 to present - https://phabricator.wikimedia.org/T378852#10434038 (10VirginiaPoundstone) [20:19:02] 06Data-Engineering, 06Data-Platform, 06Movement-Insights: Fix pageviews datasets in Druid/Turnilo/Superset - https://phabricator.wikimedia.org/T380754#10434039 (10VirginiaPoundstone) [20:19:32] 06Data-Engineering, 10Commons-Impact-Metrics-Requests: Request for Images_from_Wiki_Loves_Africa_2024 - https://phabricator.wikimedia.org/T381352#10434040 (10VirginiaPoundstone) [20:20:24] 06Data-Engineering, 10Commons-Impact-Metrics: Commons Impact Metrics "all-wikis" problem - https://phabricator.wikimedia.org/T382731#10434048 (10VirginiaPoundstone) [20:20:42] 06Data-Engineering, 10Commons-Impact-Metrics: "Pageview counts for a given category" not offering "deep" metrics - https://phabricator.wikimedia.org/T382733#10434051 (10VirginiaPoundstone) [20:22:22] 06Data-Engineering, 10Commons-Impact-Metrics, 10Commons-Impact-Metrics-Requests: Update Commons Impact Metrics allow-list December 2024 - https://phabricator.wikimedia.org/T382740#10434058 (10VirginiaPoundstone) [20:34:39] 06Data-Engineering, 06Data-Platform, 06Product-Analytics, 10Temporary accounts, and 2 others: [Epic] Update schemas and instrumentation code for temporary accounts - https://phabricator.wikimedia.org/T374942#10434104 (10VirginiaPoundstone) [20:35:28] 06Data-Engineering, 06Data-Platform, 10Dumps-Generation: skwikibooks dumps failing - https://phabricator.wikimedia.org/T375928#10434108 (10VirginiaPoundstone) [20:35:29] 06Data-Engineering, 06Data-Platform, 10Dumps-Generation, 10MediaWiki-Core-Snapshots, 07Wikimedia-production-error: PHP Notice: fwrite(): write of X bytes failed with errno=32 Broken pipe - https://phabricator.wikimedia.org/T377136#10434107 (10VirginiaPoundstone) [20:35:31] 06Data-Engineering, 06Data-Platform, 10Dumps-Generation: Rsync of old results should still happen after new job starts - https://phabricator.wikimedia.org/T375646#10434109 (10VirginiaPoundstone) [20:36:03] 06Data-Engineering: 8 new wikis missing from mediawiki_history - https://phabricator.wikimedia.org/T368788#10434111 (10VirginiaPoundstone) [20:36:44] 06Data-Engineering, 06cloud-services-team, 06Data-Platform, 10Data-Services, 13Patch-For-Review: Add global_edit_count to wikireplicas - https://phabricator.wikimedia.org/T344108#10434115 (10VirginiaPoundstone) [20:37:05] 06Data-Engineering, 10Data Pipelines, 06Data-Platform, 06Movement-Insights: Wikistats "Active Editors by Country" does not follow definition for active editors - https://phabricator.wikimedia.org/T360073#10434116 (10VirginiaPoundstone) [20:37:43] 06Data-Engineering, 06Data-Platform, 10MediaWiki-Page-derived-data, 07Wikimedia-production-error: Burst of "InvalidArgumentException: The given page ([page]) does not belong to page ID [id] but actually belongs to [id]" after 1.42.0-wmf.18 to group1 - https://phabricator.wikimedia.org/T357577#10434117 (10Vi... [20:37:46] 06Data-Engineering, 06Data-Platform, 06MW-Interfaces-Team, 06Product-Analytics, 13Patch-For-Review: performer struct fields NULL in event_sanitized.mediawiki_revision_tags_change - https://phabricator.wikimedia.org/T352899#10434120 (10VirginiaPoundstone) [20:37:46] 06Data-Engineering, 06Data-Platform, 06Data-Platform-SRE, 10Wikidata, 07Epic: EPIC: WDQS categories migration - https://phabricator.wikimedia.org/T375520#10434121 (10VirginiaPoundstone) [20:37:54] 07Analytics-Data-Problem, 06Data-Engineering, 06Abstract Wikipedia team, 06Data-Platform, 06Movement-Insights: Unique devices per country spikes on wikifunctions - https://phabricator.wikimedia.org/T364872#10434123 (10VirginiaPoundstone) [20:37:56] 06Data-Engineering, 06Commons, 06Data-Persistence, 06Data-Platform, and 3 others: Migrate file tables to a modern layout (image/oldimage; file/file_revision; add primary keys) - https://phabricator.wikimedia.org/T28741#10434122 (10VirginiaPoundstone) [20:38:42] 06Data-Engineering, 06Data-Platform: Create a guideline for where to store data for official tables in HDFS - https://phabricator.wikimedia.org/T367243#10434124 (10VirginiaPoundstone) [20:38:43] 06Data-Engineering, 06Data-Platform, 06Movement-Insights: Establish a standard set of data domains - https://phabricator.wikimedia.org/T365892#10434125 (10VirginiaPoundstone) [20:38:45] 06Data-Engineering, 06Data-Platform, 07Documentation: [Documentation] Update and synchronize Data Platform/Engineering Contact Us and Intake Process docs - https://phabricator.wikimedia.org/T364572#10434126 (10VirginiaPoundstone) [20:38:48] 06Data-Engineering, 06Data-Platform, 07Documentation: Migrate Data Platform Engineering team and onboarding docs to mediawiki.org - https://phabricator.wikimedia.org/T367580#10434127 (10VirginiaPoundstone) [20:38:50] 06Data-Engineering, 06Data-Platform, 07Documentation: Review Dashiki dashboard tutorial and update if needed - https://phabricator.wikimedia.org/T367577#10434128 (10VirginiaPoundstone) [20:39:51] 06Data-Engineering, 10Data-Platform (Data Platform Ops Week Working Group): Team vacation calendar cannot import 'Out of Office' calender events - https://phabricator.wikimedia.org/T353006#10434141 (10VirginiaPoundstone) [20:40:29] 06Data-Engineering, 06Data-Platform, 10Dumps-Generation: 20241201 wikidatawiki xml dump not progressing - https://phabricator.wikimedia.org/T382084#10434142 (10VirginiaPoundstone) [20:40:30] 06Data-Engineering, 10ActiveAbstract, 06Data-Platform, 10Dumps-Generation: Undeploy and archive ActiveAbstract - https://phabricator.wikimedia.org/T382069#10434143 (10VirginiaPoundstone) [20:40:34] 06Data-Engineering, 06Data-Platform, 06Traffic: GeoDNS: Pipeline from event.development_network_probe to operations/dns.git - https://phabricator.wikimedia.org/T380626#10434144 (10VirginiaPoundstone) [20:40:39] 06Data-Engineering, 06Data-Platform, 10Dumps-Generation, 10MW-1.44-notes (1.44.0-wmf.12; 2025-01-14), 10Wikimedia-database-issue (Bad data): "PHP Warning: gzinflate(): data error" on eswiktionary (Nov 2024; 1.44.0-wmf.4) - https://phabricator.wikimedia.org/T380347#10434145 (10VirginiaPoundstone) [20:40:43] 10Analytics-Canonical-Data, 06Data-Engineering, 06Data-Platform: REQUEST: A useful namespace_canonical_name column in wmf_raw.mediawiki_project_namespace_map - https://phabricator.wikimedia.org/T371560#10434146 (10VirginiaPoundstone) [20:40:54] 06Data-Engineering, 06Data-Persistence, 06Data-Platform, 10Dumps-Generation, and 2 others: Switch dumps 1.0 processes to use the analytics MariadB replicas (dbstore100[7-9]) - https://phabricator.wikimedia.org/T382947#10434147 (10VirginiaPoundstone) [20:41:01] 06Data-Engineering, 06Data-Platform, 10Dumps-Generation, 10Data-Platform-SRE (2024.11.30 - 2024.12.20): WE 5.4 KR - Hypothesis 5.4.6 - Q3 FY24/55 - Validate Dumps 1.0 compatibility with PHP 8.1 - https://phabricator.wikimedia.org/T382484#10434148 (10VirginiaPoundstone) [20:50:23] 06Data-Engineering, 10ConfirmEdit (CAPTCHA extension), 10MediaWiki-extensions-EventLogging, 10Metrics Platform, 05FY2024-25 WE4.2.3 CAPTCHA evaluation framework: Send captcha API response data to event logging - https://phabricator.wikimedia.org/T379179#10434180 (10VirginiaPoundstone) [20:50:26] 07Analytics-Data-Problem, 06Data-Engineering, 10Pageviews-API: Missed pageview data over API - https://phabricator.wikimedia.org/T370108#10434181 (10VirginiaPoundstone) [20:50:29] 07Analytics-Data-Problem, 06Data-Engineering, 10Data-Engineering-Wikistats, 06Movement-Insights: arywiki view stats too low for agent = user? - https://phabricator.wikimedia.org/T359004#10434182 (10VirginiaPoundstone) [20:50:32] 06Data-Engineering, 10MediaWiki-extensions-WikimediaEvents: Owners phpunit test does not work with subfolders - https://phabricator.wikimedia.org/T352472#10434183 (10VirginiaPoundstone) [20:50:34] 06Data-Engineering, 10Data Pipelines, 10Dumps 2.0, 06Movement-Insights: Keep canonical_data.wikis updated - https://phabricator.wikimedia.org/T241741#10434185 (10VirginiaPoundstone) [20:50:39] 06Data-Engineering, 07Voice & Tone: Rename geoeditors_blacklist_country - https://phabricator.wikimedia.org/T259804#10434187 (10VirginiaPoundstone) [20:50:43] 06Data-Engineering, 06DBA, 07Schema-change-in-production: Cleanup revision table schema - https://phabricator.wikimedia.org/T367856#10434186 (10VirginiaPoundstone) [20:51:28] 06Data-Engineering, 10Data Pipelines: [SPIKE] Special:Statistics page data source alignment - https://phabricator.wikimedia.org/T367072#10434191 (10VirginiaPoundstone) [20:51:30] 06Data-Engineering, 10Data-Engineering-Wikistats, 10Data Pipelines: Wikistats Link with Language Option - https://phabricator.wikimedia.org/T366820#10434192 (10VirginiaPoundstone) [20:51:38] 06Data-Engineering, 10Data Pipelines, 10Dumps-Generation, 10MediaWiki-Core-Snapshots, and 3 others: MediaWiki Dumps XML - Provide attribute to indicate that user is temporary account in exported content - https://phabricator.wikimedia.org/T365693#10434193 (10VirginiaPoundstone) [20:51:50] 06Data-Engineering, 10Data Pipelines: Add user Central ID to mediawiki_history table in Hive - https://phabricator.wikimedia.org/T365648#10434198 (10VirginiaPoundstone) [20:51:55] 06Data-Engineering, 10Data Pipelines, 07Epic: [Epic] Create Lifecycle Diagrams for Webrequests - https://phabricator.wikimedia.org/T363836#10434199 (10VirginiaPoundstone) [20:51:57] 06Data-Engineering, 10Data Pipelines, 07Documentation: Combine multiple documentation pages that define and explain Sessions - https://phabricator.wikimedia.org/T363354#10434200 (10VirginiaPoundstone) [20:52:04] 06Data-Engineering, 10Data Pipelines, 10Pageviews-API, 10RESTBase-API, and 2 others: There are anomalies in some of the mostread data on zhwiki for March 2024 - https://phabricator.wikimedia.org/T360499#10434201 (10VirginiaPoundstone) [20:52:10] 06Data-Engineering, 10Data-Engineering-Dashiki, 10Data Pipelines: Provide visitor stats that can be imported into caniuse.com - https://phabricator.wikimedia.org/T359750#10434202 (10VirginiaPoundstone) [20:52:15] 06Data-Engineering, 10Data Pipelines, 07Documentation: Clickstream dataset documentation should be extracted from Research page - https://phabricator.wikimedia.org/T356528#10434203 (10VirginiaPoundstone) [20:52:18] 06Data-Engineering, 10Data Pipelines: Update Webrequest docs or job - https://phabricator.wikimedia.org/T345950#10434204 (10VirginiaPoundstone) [20:52:21] 06Data-Engineering, 10Data Pipelines: Mediarequests top articles: should use a disallow filter just like top articles - https://phabricator.wikimedia.org/T343793#10434205 (10VirginiaPoundstone) [20:53:08] 06Data-Engineering, 10Data Pipelines: Investigate why we consume empty partitions from webrequests - https://phabricator.wikimedia.org/T343238#10434206 (10VirginiaPoundstone) [20:53:08] 06Data-Engineering, 10Data-Engineering-Wikistats, 10Data Pipelines: A proposed modification to pageviews data protection for Wikistats - https://phabricator.wikimedia.org/T340926#10434207 (10VirginiaPoundstone) [20:53:08] 06Data-Engineering, 10Data Pipelines, 06Privacy Engineering: Add cswiki to clickstream - https://phabricator.wikimedia.org/T339805#10434209 (10VirginiaPoundstone) [20:53:09] 14Analytics, 06Data-Engineering, 10Data Pipelines: Add cawiki to clickstream dataset - https://phabricator.wikimedia.org/T327982#10434210 (10VirginiaPoundstone) [20:53:10] 06Data-Engineering, 10Data-Engineering-Wikistats, 10Data Pipelines: geoeditors public version is not available for non-Wikipedia projects - https://phabricator.wikimedia.org/T317040#10434211 (10VirginiaPoundstone) [20:53:11] 06Data-Engineering, 10Data Pipelines: Add Ukrainian Wikipedia to Clickstream dataset - https://phabricator.wikimedia.org/T310972#10434212 (10VirginiaPoundstone) [20:53:12] 06Data-Engineering, 10Data Pipelines, 10Observability-Metrics, 10SRE Observability (FY2024/2025-Q3), 07Technical-Debt: migrate Data Platform Engineering maintained metrics from graphite to prometheus - https://phabricator.wikimedia.org/T372855#10434213 (10VirginiaPoundstone) [20:53:14] 06Data-Engineering, 10Data-Engineering-Dashiki, 10Data Pipelines: Windows 11 missing in analytics ? - https://phabricator.wikimedia.org/T346890#10434214 (10VirginiaPoundstone) [20:53:15] 06Data-Engineering, 10Data Pipelines, 06Movement-Insights: New Data Pipeline for New and Returning Active Editor metrics by Geo (Country & Region) and wiki - https://phabricator.wikimedia.org/T359646#10434215 (10VirginiaPoundstone) [20:53:16] 06Data-Engineering, 10Data Pipelines, 06Movement-Insights: Investigate spikes in unique devices per domain, mobile, US+CA, Jun 2023 - https://phabricator.wikimedia.org/T355143#10434216 (10VirginiaPoundstone) [20:53:17] 06Data-Engineering, 10Data Pipelines: Mitigate the effect of MaxMind's country renames on our pipelines - https://phabricator.wikimedia.org/T353959#10434217 (10VirginiaPoundstone) [20:53:18] 06Data-Engineering, 10Data Pipelines: Consider edits from system accounts as bot edits in mediawiki_history - https://phabricator.wikimedia.org/T378104#10434219 (10VirginiaPoundstone) [20:53:29] 06Data-Engineering, 10Data Pipelines, 10Dumps 2.0: Generate XML dumps for simplewiki - https://phabricator.wikimedia.org/T346147#10434221 (10VirginiaPoundstone) [20:54:50] 06Data-Engineering, 10AQS2.0: All pageviews API should support aggregation over longer periods than a day (all-months) - https://phabricator.wikimedia.org/T373395#10434228 (10VirginiaPoundstone) [20:54:52] 06Data-Engineering, 10AQS2.0: Top-per-country API should support all-days - https://phabricator.wikimedia.org/T373394#10434229 (10VirginiaPoundstone) [20:54:55] 06Data-Engineering, 10AQS2.0: Support all-projects on editor metrics API - https://phabricator.wikimedia.org/T373396#10434227 (10VirginiaPoundstone) [20:54:59] 06Data-Engineering, 10AQS2.0: Make all AQS endpoints available via api.wikimedia.org subdomain - https://phabricator.wikimedia.org/T365591#10434231 (10VirginiaPoundstone) [20:55:00] 06Data-Engineering, 10AQS2.0: [spike] Study how we can make AQS2 service code more dry - https://phabricator.wikimedia.org/T368279#10434230 (10VirginiaPoundstone) [20:55:03] 06Data-Engineering, 10AQS2.0, 10Cassandra: DELETE mechanism for Cassandra Analytics datasets - https://phabricator.wikimedia.org/T366631#10434232 (10VirginiaPoundstone) [20:55:09] 06Data-Engineering: AQS 2.0 : Document unit testing and integration testing approach - https://phabricator.wikimedia.org/T352953#10434233 (10VirginiaPoundstone) [20:55:13] 06Data-Engineering, 10AQS2.0: AQS 2.0 : Make changes to golang scaffolding service - https://phabricator.wikimedia.org/T352952#10434234 (10VirginiaPoundstone) [20:55:17] 06Data-Engineering: AQS 2.0 Change AQS repository from generated data sets - https://phabricator.wikimedia.org/T352949#10434235 (10VirginiaPoundstone) [20:55:21] 06Data-Engineering, 10AQS2.0: Mediarequests "Not found" error message is confusing - https://phabricator.wikimedia.org/T343945#10434236 (10VirginiaPoundstone) [20:55:25] 06Data-Engineering, 10AQS2.0, 10PageViewInfo: MediaWiki frequently receives HTTP 500 from AQS (via PageViewInfo extension) - https://phabricator.wikimedia.org/T341634#10434237 (10VirginiaPoundstone) [20:55:33] 06Data-Engineering, 10AQS2.0: Automated way to test that /metrics endpoint is generating metrics properly - https://phabricator.wikimedia.org/T355514#10434243 (10VirginiaPoundstone) [20:55:38] 06Data-Engineering, 06Research-Freezer, 07Epic: [EPIC] Add Knowledge Gap Index metrics to the Wikistats UI - https://phabricator.wikimedia.org/T345454#10434244 (10VirginiaPoundstone) [20:55:41] 06Data-Engineering, 10AQS2.0, 10Cassandra: Golang-based Cassandra clients do not perform TLS host verification - https://phabricator.wikimedia.org/T361964#10434246 (10VirginiaPoundstone) [20:55:47] 06Data-Engineering, 10AQS2.0, 06serviceops: Investigate effort in routing device analytics via istio - https://phabricator.wikimedia.org/T358324#10434247 (10VirginiaPoundstone) [20:55:57] 14Analytics, 06Data-Engineering, 10AQS2.0, 10Pageviews-API: Track page views by page ID rather than title (handles moved pages) - https://phabricator.wikimedia.org/T159046#10434245 (10VirginiaPoundstone) [20:56:02] 06Data-Engineering, 10AQS2.0: Move How to add a wiki to an upstream document - https://phabricator.wikimedia.org/T356751#10434248 (10VirginiaPoundstone) [20:56:06] 06Data-Engineering, 10AQS2.0: Creating a new AQS service doc - https://phabricator.wikimedia.org/T356749#10434249 (10VirginiaPoundstone) [20:56:10] 06Data-Engineering, 10AQS2.0: Requesting test data from production - https://phabricator.wikimedia.org/T356746#10434250 (10VirginiaPoundstone) [20:56:14] 06Data-Engineering, 10AQS2.0: [SPRINT 09][SDS 2.6.4] AQS 2: Complete AQS 2.0 maintainer docs to do’s - https://phabricator.wikimedia.org/T356693#10434252 (10VirginiaPoundstone) [20:56:18] 06Data-Engineering, 10AQS2.0: Adding a AQS 2.0 endpoint guide - https://phabricator.wikimedia.org/T356748#10434251 (10VirginiaPoundstone) [20:56:22] 06Data-Engineering, 10AQS2.0: AQS 2 Process plan for breaking changes required for clean-up tasks - https://phabricator.wikimedia.org/T355540#10434255 (10VirginiaPoundstone) [20:56:26] 06Data-Engineering, 07Documentation: Review and deprecate Analytics/Geoeditors page on Wikitech - https://phabricator.wikimedia.org/T356538#10434253 (10VirginiaPoundstone) [20:56:30] 06Data-Engineering, 10AQS2.0: SLO dashboard and analytics for media analytics - https://phabricator.wikimedia.org/T359042#10434256 (10VirginiaPoundstone) [20:56:34] 06Data-Engineering, 10AQS2.0: [Sprint 08 GOAL] AQS 2: Define SLOs - https://phabricator.wikimedia.org/T355539#10434254 (10VirginiaPoundstone) [20:56:38] 06Data-Engineering: Golang scaffolfing service : Clean up golang scaffolding service - https://phabricator.wikimedia.org/T352950#10434259 (10VirginiaPoundstone) [20:56:42] 06Data-Engineering, 10AQS2.0: SLO dashboard and documentation for Device analytics - https://phabricator.wikimedia.org/T358750#10434258 (10VirginiaPoundstone) [20:56:46] 06Data-Engineering, 10AQS2.0: Write AQS 1 deprecation announcement - https://phabricator.wikimedia.org/T350143#10434260 (10VirginiaPoundstone) [20:56:50] 06Data-Engineering, 10AQS2.0, 13Patch-For-Review: SLO dashboard and documentation for geo analytics - https://phabricator.wikimedia.org/T358751#10434257 (10VirginiaPoundstone) [20:57:04] 06Data-Engineering: webrequest dataset sets referer_class "unknown" instead of "external (search engine)" for origin-based referer values - https://phabricator.wikimedia.org/T383088 (10Krinkle) 03NEW [20:57:08] 06Data-Engineering, 10Commons-Impact-Metrics: [CIM] Detail Key in JSON error shows "Category" instead of "Wiki" in error message for top_viewed_categories_monthly - https://phabricator.wikimedia.org/T377280#10434278 (10VirginiaPoundstone) [20:57:12] 06Data-Engineering, 10Commons-Impact-Metrics: [CIM] Detail Key in JSON error shows "Category" instead of "user name" in error message for edits_per_user_monthly - https://phabricator.wikimedia.org/T377281#10434277 (10VirginiaPoundstone) [20:57:16] 06Data-Engineering, 10Commons-Impact-Metrics: [CIM] Detail Key in JSON error shows "Category" instead of "Media" in error message - https://phabricator.wikimedia.org/T377279#10434279 (10VirginiaPoundstone) [20:57:20] 06Data-Engineering, 10Commons-Impact-Metrics: [Commons Impact Metrics] Bug: Category and Media File names are URL encoded in the AQS response context section - https://phabricator.wikimedia.org/T377256#10434280 (10VirginiaPoundstone) [20:57:28] 06Data-Engineering, 10Commons-Impact-Metrics: [CIM] Update dataset for ranking endpoints used for testing - https://phabricator.wikimedia.org/T373915#10434281 (10VirginiaPoundstone) [20:57:32] 06Data-Engineering, 10Commons-Impact-Metrics: [Commons Impact Metrics] Add page wiki to the corresponding top endpoints - https://phabricator.wikimedia.org/T372805#10434284 (10VirginiaPoundstone) [20:57:36] 06Data-Engineering, 10AQS2.0, 10Commons-Impact-Metrics: [Commons Impact Metrics] Usage monitoring for commons-analytics AQS service - https://phabricator.wikimedia.org/T371133#10434283 (10VirginiaPoundstone) [20:57:41] 06Data-Engineering, 10Commons-Impact-Metrics: [Commons Impact Metrics] Spike: Investigate whether it's possible to move to daily granularity - https://phabricator.wikimedia.org/T365159#10434286 (10VirginiaPoundstone) [20:57:45] 06Data-Engineering, 10Commons-Impact-Metrics: [Commons Impact Metrics] Spike: Create a development plan to add mediarequest counts to CIM data product - https://phabricator.wikimedia.org/T365163#10434285 (10VirginiaPoundstone) [20:57:49] 06Data-Engineering, 10Commons-Impact-Metrics: [CIM] Time format got reverted from ISO format 2023110100 to 2023-11-01 00:00:00.000Z - https://phabricator.wikimedia.org/T377271#10434288 (10VirginiaPoundstone) [20:57:53] 06Data-Engineering, 10Commons-Impact-Metrics, 13Patch-For-Review: [CIM] Skewed ranking with the top Editors monthly API - https://phabricator.wikimedia.org/T370470#10434290 (10VirginiaPoundstone) [20:57:57] 06Data-Engineering, 10AQS2.0, 10Commons-Impact-Metrics, 13Patch-For-Review: Get more data to populate CIM time series datasets for the AQS local test environment - https://phabricator.wikimedia.org/T372989#10434289 (10VirginiaPoundstone) [21:01:00] 06Data-Engineering, 10CirrusSearch, 10MediaWiki-extensions-EventLogging, 10Metrics Platform, and 2 others: Error: Call to a member function getPageAsLinkTarget() on null - https://phabricator.wikimedia.org/T368543#10434353 (10VirginiaPoundstone) 05Open→03Resolved a:03VirginiaPoundstone [21:10:49] 06Data-Engineering, 06Data-Engineering-Radar, 06Data-Platform-SRE, 06SRE: Data Platform access streamlining for WMDE staff - https://phabricator.wikimedia.org/T381824#10434381 (10VirginiaPoundstone) [21:10:49] 06Data-Engineering, 06Data-Engineering-Radar, 10Event-Platform, 10MW-1.44-notes (1.44.0-wmf.12; 2025-01-14), and 2 others: Ad-hoc EventBus event submissions should be batched - https://phabricator.wikimedia.org/T382970#10434380 (10VirginiaPoundstone) [21:10:52] 06Data-Engineering, 06Data-Engineering-Radar, 10CampaignEvents, 06Data-Persistence, and 4 others: Add "event_is_test_event" field to "campaign_events" table - https://phabricator.wikimedia.org/T381759#10434382 (10VirginiaPoundstone) [21:10:54] 06Data-Engineering, 06Data-Engineering-Radar, 10Data-Engineering-Wikistats: slider bar for period in wikistats is becoming unusable - https://phabricator.wikimedia.org/T380565#10434386 (10VirginiaPoundstone) [21:10:55] 06Data-Engineering, 06Data-Engineering-Radar, 06Data-Platform-SRE: Do performance testing of a big Hadoop Table hosted by Ceph - https://phabricator.wikimedia.org/T381416#10434384 (10VirginiaPoundstone) [21:11:00] 06Data-Engineering, 06Data-Engineering-Radar, 10ConfirmEdit (CAPTCHA extension), 10MediaWiki-extensions-EventLogging, and 2 others: Send captcha API response data to event logging - https://phabricator.wikimedia.org/T379179#10434385 (10VirginiaPoundstone) [21:11:06] 06Data-Engineering, 06Data-Engineering-Radar, 07Epic: Data Platform Data Incidents - https://phabricator.wikimedia.org/T378559#10434387 (10VirginiaPoundstone) [21:11:10] 06Data-Engineering, 06Data-Engineering-Radar, 10DPE Temporary Accounts, 06Product-Analytics, and 3 others: Ensure performer attributes in schemas clarify if the user is a temporary account - https://phabricator.wikimedia.org/T374940#10434388 (10VirginiaPoundstone) [21:11:14] 06Data-Engineering, 06Data-Engineering-Radar, 06Experimentation Lab, 10MediaWiki-extensions-EventLogging, and 2 others: Prepare EventLogging for temp accounts - https://phabricator.wikimedia.org/T374812#10434390 (10VirginiaPoundstone) [21:11:20] 06Data-Engineering, 06Data-Engineering-Radar, 10Structured-Data-Backlog (Current Work): [L] Track commons deletion requests - https://phabricator.wikimedia.org/T370898#10434395 (10VirginiaPoundstone) [21:11:24] 06Data-Engineering, 06Data-Engineering-Radar, 06DBA, 07Schema-change-in-production: Change page.page_links_updated to fixed-length timestamp in wmf wikis - https://phabricator.wikimedia.org/T371742#10434394 (10VirginiaPoundstone) [21:11:32] 06Data-Engineering, 06Data-Engineering-Radar, 10Wikidata, 03Discovery-Search (Current work), and 2 others: Configure https://stream.wikimedia.org to expose rdf-streaming-updater.mutation - https://phabricator.wikimedia.org/T374921#10434389 (10VirginiaPoundstone) [21:11:36] 07Analytics-Data-Problem, 06Data-Engineering, 06Data-Engineering-Radar, 10Pageviews-API: Missed pageview data over API - https://phabricator.wikimedia.org/T370108#10434397 (10VirginiaPoundstone) [21:11:40] 06Data-Engineering, 06Data-Engineering-Radar, 10Data-Engineering-Wikistats, 07dark-mode: Dark mode support for stats.wikimedia.org - https://phabricator.wikimedia.org/T370758#10434396 (10VirginiaPoundstone) [21:11:52] 06Data-Engineering, 06Data-Engineering-Radar, 10Data-Engineering-Wikistats, 10Data Pipelines: Wikistats Link with Language Option - https://phabricator.wikimedia.org/T366820#10434412 (10VirginiaPoundstone) [21:11:58] 06Data-Engineering, 06Data-Engineering-Radar, 10CampaignEvents, 10EntitySchema, and 16 others: Add namespace descriptions for Special:NamespaceInfo in WMF-deployed extensions - https://phabricator.wikimedia.org/T373070#10434391 (10VirginiaPoundstone) [21:12:06] 06Data-Engineering, 06Data-Engineering-Radar, 10Data-Engineering-Wikistats: Add azerbaijani language to Wikistats - https://phabricator.wikimedia.org/T365209#10434413 (10VirginiaPoundstone) [21:12:11] 06Data-Engineering: webrequest dataset sets referer_class "unknown" instead of "external (search engine)" for origin-based referer values - https://phabricator.wikimedia.org/T383088#10434415 (10Krinkle) [21:12:15] 06Data-Engineering, 10Data-Engineering-Dashiki, 06Data-Engineering-Radar, 07Epic, 10Experimentation Lab (Epics Timeline): Data Platform - Public dashboard support - https://phabricator.wikimedia.org/T361214#10434417 (10VirginiaPoundstone) [21:12:19] 06Data-Engineering, 06Data-Engineering-Radar, 10CheckUser, 06Trust and Safety Product Team: FYI: Changes to the cuc_agent column in the cu_changes table - https://phabricator.wikimedia.org/T361210#10434418 (10VirginiaPoundstone) [21:12:23] 06Data-Engineering, 06Data-Engineering-Radar, 10Data Pipelines, 10Pageviews-API, and 3 others: There are anomalies in some of the mostread data on zhwiki for March 2024 - https://phabricator.wikimedia.org/T360499#10434420 (10VirginiaPoundstone) [21:12:27] 06Data-Engineering, 10Data-Engineering-Dashiki, 06Data-Engineering-Radar, 10Data Pipelines: Provide visitor stats that can be imported into caniuse.com - https://phabricator.wikimedia.org/T359750#10434423 (10VirginiaPoundstone) [21:12:31] 07Analytics-Data-Problem, 06Data-Engineering, 06Data-Engineering-Radar, 10Data-Engineering-Wikistats, 06Movement-Insights: arywiki view stats too low for agent = user? - https://phabricator.wikimedia.org/T359004#10434424 (10VirginiaPoundstone) [21:12:43] 14Analytics, 06Data-Engineering, 06Data-Engineering-Radar, 10Data-Engineering-Wikistats: prefix symbol that modifies unit magnitude - https://phabricator.wikimedia.org/T356534#10434425 (10VirginiaPoundstone) [21:13:03] 06Data-Engineering, 06Data-Engineering-Radar, 10Data-Engineering-Wikistats: Page views by country and total page namespaces are confusingly displayed - https://phabricator.wikimedia.org/T354932#10434450 (10VirginiaPoundstone) [21:13:07] 06Data-Engineering, 06Data-Engineering-Radar, 10Data Pipelines, 07Documentation: Clickstream dataset documentation should be extracted from Research page - https://phabricator.wikimedia.org/T356528#10434448 (10VirginiaPoundstone) [21:13:11] 14Analytics, 06Data-Engineering, 06Data-Engineering-Radar, 10Data-Engineering-Wikistats: No page views by country data for Turkey - https://phabricator.wikimedia.org/T355404#10434449 (10VirginiaPoundstone) [21:13:19] 06Data-Engineering, 06Data-Engineering-Radar, 10Data-Engineering-Wikistats: Contradictory descriptions in "Total page views" - https://phabricator.wikimedia.org/T354931#10434451 (10VirginiaPoundstone) [21:13:23] 14Analytics, 06Data-Engineering, 06Data-Engineering-Radar, 10Data-Engineering-Wikistats: Wikistats Pageviews differ hugely from pageviews.wmcloud ( 0.1x — 1,000x ) - https://phabricator.wikimedia.org/T353892#10434453 (10VirginiaPoundstone) [21:13:28] 06Data-Engineering, 06Data-Engineering-Radar, 06Diffusion-Repository-Administrators, 10Projects-Cleanup, 10Wikimedia-GitHub: Consider archiving Gerrit repository "analytics/reportcard" and "analytics/reportcard/data" (20120810, 20160929) - https://phabricator.wikimedia.org/T351521#10434454 (10VirginiaPoun... [21:13:32] 06Data-Engineering, 06Data-Engineering-Radar, 06Diffusion-Repository-Administrators, 10Projects-Cleanup, 10Wikimedia-GitHub: Consider archiving Gerrit repository "analytics/pageview-api" (20120124) - https://phabricator.wikimedia.org/T351518#10434455 (10VirginiaPoundstone) [21:13:36] 06Data-Engineering, 06Data-Engineering-Radar, 10EventStreams, 10MediaWiki-Page-protection, and 5 others: Create Mediawiki "oversightprotect" action that suppresses usernames of all edits of a page - https://phabricator.wikimedia.org/T354577#10434452 (10VirginiaPoundstone) [21:13:44] 06Data-Engineering, 06Data-Engineering-Radar, 10MediaWiki-Page-deletion, 10Event-Platform, 10MediaWiki-Platform-Team (Radar): Undelete of page with same title leads to unexpected results - https://phabricator.wikimedia.org/T351411#10434458 (10VirginiaPoundstone) [21:13:54] 06Data-Engineering, 06Data-Engineering-Radar, 06Experimentation Lab, 10Observability-Logging, and 2 others: Move analytics log from Varnish to HAProxy - https://phabricator.wikimedia.org/T351117#10434459 (10VirginiaPoundstone) [21:14:00] 14Analytics, 06Data-Engineering, 06Data-Engineering-Radar, 10Data-Engineering-Wikistats: Make wikistats pages, sections and individual infoboxes transcludable - https://phabricator.wikimedia.org/T351053#10434462 (10VirginiaPoundstone) [21:14:04] 06Data-Engineering, 06Data-Engineering-Radar, 06Trust and Safety Product Team: Mitigate unwanted side effects to anti abuse work from Google Chrome's IP Protection rollout - https://phabricator.wikimedia.org/T350428#10434463 (10VirginiaPoundstone) [21:14:08] 06Data-Engineering, 06Data-Engineering-Radar, 10Data-Engineering-Wikistats: Add Farsi/Persian to WikiStats interface languages - https://phabricator.wikimedia.org/T348674#10434467 (10VirginiaPoundstone) [21:14:12] 06Data-Engineering, 06Data-Engineering-Radar, 06serviceops, 10Event-Platform: Make eventstreams-internal available to WMF staff without an ssh tunnel - https://phabricator.wikimedia.org/T348763#10434465 (10VirginiaPoundstone) [21:14:19] 06Data-Engineering, 10Data-Engineering-Jupyter, 06Data-Engineering-Radar: support Python >=3.11 on conda-analytics - https://phabricator.wikimedia.org/T346673#10434470 (10VirginiaPoundstone) [21:14:23] 06Data-Engineering, 06Data-Engineering-Radar, 06Structured-Data-Backlog: [Maintenance] Set up deletion jobs for Structured Data's data pipelines - https://phabricator.wikimedia.org/T347561#10434468 (10VirginiaPoundstone) [21:14:27] 06Data-Engineering, 06Data-Engineering-Radar, 10Wmfdata-Python: Remove Wmfdata's custom update-notification code - https://phabricator.wikimedia.org/T346706#10434469 (10VirginiaPoundstone) [21:14:31] 06Data-Engineering, 06Data-Engineering-Radar, 10Beta-Cluster-Infrastructure: Many kafka errors in beta/deployment-prep - https://phabricator.wikimedia.org/T346402#10434472 (10VirginiaPoundstone) [21:14:37] 06Data-Engineering, 06Data-Engineering-Radar, 10Data-Engineering-Wikistats: Missing contributor stats for Singapore - https://phabricator.wikimedia.org/T344624#10434473 (10VirginiaPoundstone) [21:14:41] 06Data-Engineering, 06Data-Engineering-Radar, 10AQS2.0: Method for per-file cumulative total in mediarequests API - https://phabricator.wikimedia.org/T343947#10434474 (10VirginiaPoundstone) [21:14:45] 06Data-Engineering, 06Data-Engineering-Radar, 10Data Pipelines: Mediarequests top articles: should use a disallow filter just like top articles - https://phabricator.wikimedia.org/T343793#10434475 (10VirginiaPoundstone) [21:14:49] 06Data-Engineering, 06Data-Engineering-Radar, 10AQS2.0, 10PageViewInfo: MediaWiki frequently receives HTTP 500 from AQS (via PageViewInfo extension) - https://phabricator.wikimedia.org/T341634#10434477 (10VirginiaPoundstone) [21:14:55] 06Data-Engineering, 06Data-Engineering-Radar, 10[DEPRECATED] wdwb-tech, 10Citoid, and 10 others: Migrate node-based services in production to node18 - https://phabricator.wikimedia.org/T349118#10434466 (10VirginiaPoundstone) [21:15:05] 06Data-Engineering, 10Dumps 2.0, 10Dumps-Generation, 07Epic: Outreach to producers of "other dumps" to raise awareness about Dumps 2.0 and options for deprecation or migration - https://phabricator.wikimedia.org/T364856#10434476 (10VirginiaPoundstone) [21:15:09] 06Data-Engineering, 06Data-Engineering-Radar, 10Data-Engineering-Wikistats, 10Data Pipelines: A proposed modification to pageviews data protection for Wikistats - https://phabricator.wikimedia.org/T340926#10434478 (10VirginiaPoundstone) [21:15:13] 06Data-Engineering, 06Data-Engineering-Radar, 06Product-Analytics, 10Wmfdata-Python: Retrieve host & port info when connecting to MariaDB replicas on the cluster - https://phabricator.wikimedia.org/T340472#10434479 (10VirginiaPoundstone) [21:15:17] 06Data-Engineering, 06Data-Engineering-Radar, 10Data Pipelines, 06Privacy Engineering: Add cswiki to clickstream - https://phabricator.wikimedia.org/T339805#10434482 (10VirginiaPoundstone) [21:15:21] 06Data-Engineering, 06Data-Engineering-Radar, 06Product-Analytics, 10Wmfdata-Python: Enable wmfdata-py to access MariaDB replicas on the cluster - https://phabricator.wikimedia.org/T340467#10434481 (10VirginiaPoundstone) [21:15:25] 06Data-Engineering, 06Data-Engineering-Radar, 06Product-Analytics, 10Wmfdata-Python: Let user specify cnf to use when connecting to MariaDB - https://phabricator.wikimedia.org/T340469#10434480 (10VirginiaPoundstone) [21:15:35] 06Data-Engineering, 06Data-Engineering-Radar, 06serviceops-radar: Rewrite all Airflow sensors that use datacenter prepartitions to depend on both datacenters - https://phabricator.wikimedia.org/T338796#10434487 (10VirginiaPoundstone) [21:15:39] 06Data-Engineering, 06Data-Engineering-Radar, 10Data Pipelines, 10Section-Topics: Auto clean old section topics data - https://phabricator.wikimedia.org/T335778#10434488 (10VirginiaPoundstone) [21:15:43] 06Data-Engineering, 06Data-Engineering-Radar: Provide aggregated user device data per-country - https://phabricator.wikimedia.org/T325306#10434492 (10VirginiaPoundstone) [21:15:53] 06Data-Engineering, 06Data-Engineering-Radar, 06Product-Analytics: Present "Notebooks in Airflow" solution to PA and discuss ownership of different steps - https://phabricator.wikimedia.org/T325181#10434495 (10VirginiaPoundstone) [21:15:57] 06Data-Engineering, 06Data-Engineering-Radar: Drop various event.contenttranslation tables - https://phabricator.wikimedia.org/T317943#10434498 (10VirginiaPoundstone) [21:16:01] 06Data-Engineering, 06Data-Engineering-Radar: Drop event.changeslistfiltergrouping table - https://phabricator.wikimedia.org/T317942#10434499 (10VirginiaPoundstone) [21:16:05] 06Data-Engineering, 06Data-Engineering-Radar, 10Data Pipelines, 13Patch-For-Review: Prototype Spark Streaming Job for Content Dumps - https://phabricator.wikimedia.org/T322326#10434496 (10VirginiaPoundstone) [21:16:09] 06Data-Engineering, 06Data-Engineering-Radar, 06SRE, 06Traffic: Add a rolled-up cache_status field to druid webrequest_sampled_128 - https://phabricator.wikimedia.org/T319344#10434497 (10VirginiaPoundstone) [21:16:17] 06Data-Engineering, 06Data-Engineering-Radar, 10Data-Engineering-Wikistats, 10Data Pipelines: geoeditors public version is not available for non-Wikipedia projects - https://phabricator.wikimedia.org/T317040#10434501 (10VirginiaPoundstone) [21:16:21] 06Data-Engineering, 06Data-Engineering-Radar, 07Technical-Debt: Drop event.flowreplies table - https://phabricator.wikimedia.org/T315857#10434502 (10VirginiaPoundstone) [21:16:25] 06Data-Engineering, 06Data-Engineering-Radar, 06Product-Analytics: Creating a Spark session causes a torrent of log spam - https://phabricator.wikimedia.org/T315024#10434503 (10VirginiaPoundstone) [21:16:29] 06Data-Engineering, 06Data-Engineering-Radar, 10Data Pipelines: Add Ukrainian Wikipedia to Clickstream dataset - https://phabricator.wikimedia.org/T310972#10434504 (10VirginiaPoundstone) [21:16:33] 06Data-Engineering, 06Data-Engineering-Radar: Reduce the number of files generated by geoeditors airflor jobs - https://phabricator.wikimedia.org/T304852#10434506 (10VirginiaPoundstone) [21:16:37] 06Data-Engineering, 06Data-Engineering-Radar, 10MediaWiki-extensions-EventLogging, 07CSS: Schema code samples popup appears under the JSON table - https://phabricator.wikimedia.org/T272857#10434507 (10VirginiaPoundstone) [21:16:43] 14Analytics-Radar, 06Data-Engineering, 06Data-Engineering-Radar, 10Data Pipelines, and 5 others: WikiEditor records all edits as platform = desktop in EventLogging - https://phabricator.wikimedia.org/T249944#10434508 (10VirginiaPoundstone) [21:16:51] 06Data-Engineering, 06Data-Engineering-Radar, 10Data Pipelines, 10Pageviews-Anomaly, and 3 others: Analyze possible bot traffic for frwiki article Cookie (informatique) - https://phabricator.wikimedia.org/T313114#10434505 (10VirginiaPoundstone) [21:16:58] 06Data-Engineering, 06Data-Engineering-Radar, 10Cassandra, 10Structured Data Engineering, 06Structured-Data-Backlog: image suggestions DAG should not use aqsloader Cassandra role - https://phabricator.wikimedia.org/T356446#10434514 (10VirginiaPoundstone) [21:17:06] 06Data-Engineering, 06Data-Engineering-Radar, 06Experimentation Lab, 06Traffic, and 2 others: New software: haproxykafka - https://phabricator.wikimedia.org/T370668#10434511 (10VirginiaPoundstone) [21:17:14] 06Data-Engineering, 10Data-Engineering-Dashiki, 06Data-Engineering-Radar, 10Data Pipelines: Windows 11 missing in analytics ? - https://phabricator.wikimedia.org/T346890#10434516 (10VirginiaPoundstone) [21:17:20] 06Data-Engineering, 06Data-Engineering-Radar, 10Wmfdata-Python: Fix lint issues in Wmfdata-Python and make the linting CI blocking - https://phabricator.wikimedia.org/T381657#10434521 (10VirginiaPoundstone) [21:17:24] 06Data-Engineering, 06Data-Engineering-Radar, 06Product-Analytics: Creation of canonical pageview dumps for users to download - https://phabricator.wikimedia.org/T251777#10434519 (10VirginiaPoundstone) [21:17:28] 14Analytics, 06Data-Engineering, 06Data-Engineering-Radar, 10AQS2.0, 10Pageviews-API: Track page views by page ID rather than title (handles moved pages) - https://phabricator.wikimedia.org/T159046#10434520 (10VirginiaPoundstone) [21:17:32] 06Data-Engineering, 06Data-Engineering-Radar, 10Wmfdata-Python: Convert existing Wmfdata docstrings to a standard format - https://phabricator.wikimedia.org/T380742#10434523 (10VirginiaPoundstone) [21:17:36] 06Data-Engineering, 06Data-Engineering-Radar, 10Wmfdata-Python: Add type annotations to Wmfdata-Python and make the type-checking CI blocking - https://phabricator.wikimedia.org/T381656#10434522 (10VirginiaPoundstone) [21:17:40] 06Data-Engineering, 06Data-Engineering-Radar, 10Cassandra, 10Data Pipelines, and 2 others: Create puppet resource for adding/updating/deleting secrets or other small files on HDFS - https://phabricator.wikimedia.org/T323692#10434518 (10VirginiaPoundstone) [21:17:48] 06Data-Engineering, 06Data-Engineering-Radar, 10Wmfdata-Python: Separate unit tests and integration tests - https://phabricator.wikimedia.org/T379416#10434524 (10VirginiaPoundstone) [21:17:52] 06Data-Engineering, 06Data-Engineering-Radar, 10BDC-Implementation, 06Data-Platform-SRE, 07Epic: EPIC: Trino/minIO/Hive/Hadoop Implementation - https://phabricator.wikimedia.org/T377362#10434527 (10VirginiaPoundstone) [21:17:58] 06Data-Engineering, 06Data-Engineering-Radar, 06Experimentation Lab, 10MediaWiki-extensions-EventLogging, 10Metrics Platform: Remove deprecated $logger parameter from EventLogging::submit() - https://phabricator.wikimedia.org/T376410#10434528 (10VirginiaPoundstone) [21:18:04] 06Data-Engineering, 06Data-Engineering-Radar, 10Proton, 10Recommendation-API, and 3 others: WikiKube: Rename the last few "production" named helm releases to use "main" instead - https://phabricator.wikimedia.org/T377805#10434525 (10VirginiaPoundstone) [21:18:12] 06Data-Engineering, 06Data-Engineering-Radar, 06Data-Platform-SRE, 06Discovery-Search, 06Java-Scala-Standardization: List python projects that are published to Archiva and how they are deployed - https://phabricator.wikimedia.org/T373450#10434529 (10VirginiaPoundstone) [21:18:18] 06Data-Engineering, 06Data-Engineering-Radar, 06Data-Platform-SRE, 06Java-Scala-Standardization: Migrate WMF Maven projects to new parent pom - https://phabricator.wikimedia.org/T360219#10434531 (10VirginiaPoundstone) [21:18:24] 06Data-Engineering, 06Data-Engineering-Radar, 06Experimentation Lab, 10MediaWiki-extensions-EventLogging, and 4 others: Decide on how data platform wants to monitor bundle sizes - https://phabricator.wikimedia.org/T378772#10434526 (10VirginiaPoundstone) [21:18:30] 06Data-Engineering, 06Data-Engineering-Radar, 10CirrusSearch, 10Structured Data Engineering, and 3 others: Migrate image recommendation to use page_weighted_tags_changed stream - https://phabricator.wikimedia.org/T372912#10434530 (10VirginiaPoundstone) [21:18:45] 06Data-Engineering, 10Data-Engineering-Jupyter, 06Data-Engineering-Radar, 06Data-Platform-SRE, 07Security: Use custom CDN if possible for Jupyter HTML exported notebooks - https://phabricator.wikimedia.org/T357064#10434539 (10VirginiaPoundstone) [21:18:51] 06Data-Engineering, 06Data-Engineering-Radar, 10Data Pipelines, 06Movement-Insights: Wikistats "Active Editors by Country" does not follow definition for active editors - https://phabricator.wikimedia.org/T360073#10434537 (10VirginiaPoundstone) [21:18:55] 06Data-Engineering, 06Data-Engineering-Radar, 10Data Pipelines, 06Movement-Insights: New Data Pipeline for New and Returning Active Editor metrics by Geo (Country & Region) and wiki - https://phabricator.wikimedia.org/T359646#10434538 (10VirginiaPoundstone) [21:18:59] 06Data-Engineering, 06Data-Engineering-Radar, 07Documentation: Review and deprecate Analytics/Geoeditors page on Wikitech - https://phabricator.wikimedia.org/T356538#10434540 (10VirginiaPoundstone) [21:19:03] 06Data-Engineering, 06Data-Engineering-Radar, 06Data-Platform-SRE: Validating that current jobs are running correctly with the new Conda Analytics environment - https://phabricator.wikimedia.org/T354735#10434542 (10VirginiaPoundstone) [21:19:09] 06Data-Engineering, 06Data-Engineering-Radar, 06Data-Platform-SRE: Deploy new Spark version on production - https://phabricator.wikimedia.org/T354737#10434541 (10VirginiaPoundstone) [21:19:15] 06Data-Engineering, 06Data-Engineering-Radar, 10MediaWiki-extensions-EventLogging, 10Metrics Platform, 07Epic: Deprecate and remove MetricsClient#dispatch() - https://phabricator.wikimedia.org/T352969#10434544 (10VirginiaPoundstone) [21:19:21] 06Data-Engineering, 06Data-Engineering-Radar, 06Data-Platform-SRE, 06Infrastructure-Foundations, 06SRE: Reduce Kerberos logs produced by Presto - https://phabricator.wikimedia.org/T353802#10434543 (10VirginiaPoundstone) [21:19:34] 06Data-Engineering, 06Data-Engineering-Radar, 06Tech-Docs-Team, 05Goal: Define dataset documentation strategy - https://phabricator.wikimedia.org/T349103#10434546 (10VirginiaPoundstone) [21:19:38] 06Data-Engineering, 06Data-Engineering-Radar, 06Movement-Insights, 06Traffic: Identify and label prefetch proxy data in our traffic - https://phabricator.wikimedia.org/T346463#10434547 (10VirginiaPoundstone) [21:19:44] 06Data-Engineering, 06Data-Engineering-Radar, 10Data Pipelines, 06Data-Platform-SRE: Figure out a way to automatize deployment of the spark assembly file - https://phabricator.wikimedia.org/T336513#10434549 (10VirginiaPoundstone) [21:19:54] 06Data-Engineering, 06Data-Engineering-Radar, 10Data Pipelines, 06Product-Analytics: Review why total_edits on Mediawiki_History differs from the total_edits on Editors_Daily - https://phabricator.wikimedia.org/T316896#10434551 (10VirginiaPoundstone) [21:19:58] 06Data-Engineering, 06Data-Engineering-Radar, 06Data-Platform-SRE: Alluxio for Improved Superset Query Performance - https://phabricator.wikimedia.org/T288252#10434556 (10VirginiaPoundstone) [21:20:04] 06Data-Engineering, 06Data-Engineering-Radar, 10Cassandra, 13Patch-For-Review: Audit and update AQS Cassandra roles & grants - https://phabricator.wikimedia.org/T313877#10434552 (10VirginiaPoundstone) [21:20:10] 06Data-Engineering, 06DBA, 06Experimentation Lab, 10MW-1.44-notes (1.44.0-wmf.12; 2025-01-14), and 2 others: Design and merge the new tables of file tables - https://phabricator.wikimedia.org/T368113#10434554 (10Ladsgroup) 05Open→03Resolved [21:20:16] 06Data-Engineering, 06Data-Engineering-Radar, 06Data-Platform-SRE: Investigate Hadoop 3 container support with reference to Airflow deployment pipelines - https://phabricator.wikimedia.org/T288247#10434558 (10VirginiaPoundstone) [21:20:22] 06Data-Engineering, 06Data-Engineering-Radar, 06Data-Platform-SRE, 13Patch-For-Review: [Data Platform] Test Alluxio as cache layer for Presto - https://phabricator.wikimedia.org/T266641#10434560 (10VirginiaPoundstone) [21:20:29] 14Analytics, 06Data-Engineering, 06Data-Engineering-Radar, 06Data-Platform-SRE, and 2 others: Discovery for Kafka cluster brokers - https://phabricator.wikimedia.org/T213561#10434561 (10VirginiaPoundstone) [21:20:37] 06Data-Engineering, 06Data-Engineering-Radar, 10Wmfdata-Python: Separate internal and public utility functions - https://phabricator.wikimedia.org/T378866#10434563 (10VirginiaPoundstone) [21:20:41] 06Data-Engineering, 06Data-Engineering-Radar, 10Wmfdata-Python: Wmfdata's Kerberos check should not fail if there's a valid keytab - https://phabricator.wikimedia.org/T378432#10434564 (10VirginiaPoundstone) [21:20:45] 06Data-Engineering, 06Data-Engineering-Radar, 06Experimentation Lab, 07Documentation, 10Event-Platform: Render human-readable schemas on schema.wikimedia.org - https://phabricator.wikimedia.org/T376841#10434566 (10VirginiaPoundstone) [21:20:49] 06Data-Engineering, 06Data-Engineering-Radar, 06Product-Analytics, 10Wmfdata-Python: Suppress tracebacks for Kerberos errors - https://phabricator.wikimedia.org/T345219#10434569 (10VirginiaPoundstone) [21:20:53] 06Data-Engineering, 06Data-Engineering-Radar, 10Wmfdata-Python: Wmfdata: Spark session creation fails when there is a zombie session - https://phabricator.wikimedia.org/T367998#10434568 (10VirginiaPoundstone) [21:21:01] 06Data-Engineering, 06Data-Engineering-Radar, 10Data Pipelines, 06Data-Platform-SRE: Add support for Iceberg to the Spark Docker Image - https://phabricator.wikimedia.org/T336012#10434576 (10VirginiaPoundstone) [21:21:07] 06Data-Engineering, 06Data-Engineering-Radar, 06Fundraising-Backlog, 10MediaWiki-extensions-CentralNotice, 06Movement-Insights: Unique Devices seasonal trends on small projects - https://phabricator.wikimedia.org/T344381#10434575 (10VirginiaPoundstone) [21:21:17] 06Data-Engineering, 06Data-Engineering-Radar, 10Data Pipelines, 06Data-Platform-SRE: Install jupyterhub separately from conda-analytics - https://phabricator.wikimedia.org/T321512#10434577 (10VirginiaPoundstone) [21:21:23] 06Data-Engineering, 06Data-Engineering-Radar, 06Data-Platform-SRE, 10Event-Platform: Upgrade to Kafka MirrorMaker 2 and revisit Kafka topic prefix convention - https://phabricator.wikimedia.org/T277467#10434578 (10VirginiaPoundstone) [21:21:32] 06Data-Engineering, 06Data-Engineering-Radar, 06Experimentation Lab, 10Wikidata, 10Wikidata-Query-Service: Publish WDQS JNL files to dumps.wikimedia.org - https://phabricator.wikimedia.org/T344905#10434574 (10VirginiaPoundstone) [21:21:36] 14Analytics-Radar, 06Data-Engineering, 06Data-Engineering-Radar, 06Growth-Team, and 4 others: Edits to Flow pages result in a page-links-change event with no performer - https://phabricator.wikimedia.org/T216726#10434579 (10VirginiaPoundstone) [21:21:42] 06Data-Engineering, 10Data-Engineering-Wikistats, 06Experimentation Lab, 10PageViewInfo, and 2 others: Pageviews Analysis 3.0 (Vue + Codex) - https://phabricator.wikimedia.org/T378549#10434582 (10VirginiaPoundstone) [21:21:48] 06Data-Engineering, 10Event-Platform: Simplify EventBus code by deprecating EventBusFactory - https://phabricator.wikimedia.org/T370524#10434584 (10VirginiaPoundstone) [21:22:02] 06Data-Engineering-Icebox, 06Experimentation Lab: Public DataHub - https://phabricator.wikimedia.org/T366720#10434601 (10VirginiaPoundstone) [21:22:07] 06Data-Engineering-Icebox, 06Privacy Engineering: Fix CI/CD issues in the differential-privacy repository - https://phabricator.wikimedia.org/T358601#10434602 (10VirginiaPoundstone) [21:22:11] 06Data-Engineering, 10Research-engineering, 10Event-Platform, 10Research (FY2024-25-Research-January-March): Productionized Edit Types - https://phabricator.wikimedia.org/T351225#10434603 (10VirginiaPoundstone) [21:22:15] 06Data-Engineering, 10Event-Platform: Utilize Kafka Headers - https://phabricator.wikimedia.org/T351089#10434605 (10VirginiaPoundstone) [21:22:19] 06Data-Engineering-Icebox: Use hive metastore when registering views - https://phabricator.wikimedia.org/T350617#10434607 (10VirginiaPoundstone) [21:22:23] 06Data-Engineering-Icebox: [SPIKE] Replicating EventGate Validation Errors in Local Environment - https://phabricator.wikimedia.org/T349018#10434608 (10VirginiaPoundstone) [21:22:27] 06Data-Engineering-Icebox: Allow retry on Airflow druid_load_webrequest_sampled_128_daily.remove_temporary_directory - https://phabricator.wikimedia.org/T345232#10434610 (10VirginiaPoundstone) [21:22:31] 06Data-Engineering, 10Data-Engineering-Wikistats: Add punjabi language in Wikistats - https://phabricator.wikimedia.org/T344572#10434611 (10VirginiaPoundstone) [21:22:35] 06Data-Engineering-Icebox, 10Data Pipelines: Investigate why we consume empty partitions from webrequests - https://phabricator.wikimedia.org/T343238#10434613 (10VirginiaPoundstone) [21:22:39] 06Data-Engineering-Icebox: [opsweek] Airflow DAGs with Spark jobs should always include Spark tuning variables - https://phabricator.wikimedia.org/T343154#10434614 (10VirginiaPoundstone) [21:22:43] 06Data-Engineering-Icebox: Spark tries to create database in wrong place - https://phabricator.wikimedia.org/T340787#10434625 (10VirginiaPoundstone) [21:22:52] 06Data-Engineering-Icebox, 06Product-Analytics: TikTok referral data gaps - https://phabricator.wikimedia.org/T340677#10434628 (10VirginiaPoundstone) [21:23:00] 06Data-Engineering-Icebox, 06SRE, 06Traffic: Webrequest x_analtics `wprov` value is incorrectly formatted - https://phabricator.wikimedia.org/T339910#10434633 (10VirginiaPoundstone) [21:23:16] 06Data-Engineering, 10Data-Engineering-Jupyter: Read and process parquet files from Jupyter notebooks - https://phabricator.wikimedia.org/T338932#10434639 (10VirginiaPoundstone) [21:23:20] 14Analytics-Radar, 06Data-Engineering-Icebox, 06Growth-Team, 07Browser-Support-Apple-Safari: Investigate how Safari in iOS 17 and macOS Sonoma will impact URLs generated in Wikimedia sites - https://phabricator.wikimedia.org/T338571#10434641 (10VirginiaPoundstone) [21:23:34] 06Data-Engineering, 10Data-Engineering-Wikistats, 07I18n: Fill in missing qqq.json and enforce in future - https://phabricator.wikimedia.org/T338072#10434650 (10VirginiaPoundstone) [21:23:38] 06Data-Engineering-Icebox, 10Data Pipelines: [Airflow] Simplify application and java_class parameters in SparkSqlOperator - https://phabricator.wikimedia.org/T338036#10434652 (10VirginiaPoundstone) [21:23:48] 06Data-Engineering-Icebox, 06SRE, 06Traffic, 06Trust and Safety Product Team, and 2 others: Include User-Agent Client Hints in WebRequest logs - https://phabricator.wikimedia.org/T337947#10434654 (10VirginiaPoundstone) [21:23:56] 06Data-Engineering-Icebox: Increase webrequest_sampled_live Druid datasource's retention - https://phabricator.wikimedia.org/T337460#10434655 (10VirginiaPoundstone) [21:24:01] 06Data-Engineering-Icebox, 10AQS2.0: Weekly views API - https://phabricator.wikimedia.org/T337085#10434656 (10VirginiaPoundstone) [21:24:05] 06Data-Engineering, 10Data-Engineering-Wikistats, 07I18n: In Wikistats, `npm run dev` only shows strings in English - https://phabricator.wikimedia.org/T337033#10434657 (10VirginiaPoundstone) [21:24:09] 06Data-Engineering-Icebox, 06Structured-Data-Backlog: Instrument {{Delete ...} template adding/removing on Commons and create a historical dataset - https://phabricator.wikimedia.org/T336955#10434661 (10VirginiaPoundstone) [21:24:13] 06Data-Engineering-Icebox, 10Data Pipelines: HDFS utils on Airflow to handle actions on hdfs files - https://phabricator.wikimedia.org/T336771#10434664 (10VirginiaPoundstone) [21:24:17] 06Data-Engineering, 10Data-Engineering-Wikistats, 07I18n, 13Patch-For-Review: Untranslatable strings in Wikistats - https://phabricator.wikimedia.org/T337032#10434659 (10VirginiaPoundstone) [21:24:21] 06Data-Engineering, 10Data-Engineering-Wikistats, 07I18n, 13Patch-For-Review: Wikistats 2 should translate month names and abbreviations - https://phabricator.wikimedia.org/T336815#10434662 (10VirginiaPoundstone) [21:24:25] 06Data-Engineering, 10Data-Engineering-Wikistats, 13Patch-For-Review: Change GitHub link to Gerrit in the Wikistats frontend - https://phabricator.wikimedia.org/T336765#10434665 (10VirginiaPoundstone) [21:24:29] 06Data-Engineering-Icebox, 10Data Pipelines: Make sure all partitions sensors are using the Dataset helpers - https://phabricator.wikimedia.org/T336741#10434669 (10VirginiaPoundstone) [21:24:33] 06Data-Engineering-Icebox, 10Data Pipelines: Refactor our existing Airflow dags to use EasyDAG & DagProperties - https://phabricator.wikimedia.org/T336738#10434671 (10VirginiaPoundstone) [21:24:39] 06Data-Engineering, 10Data-Engineering-Wikistats, 06translatewiki.net, 07I18n, 13Patch-For-Review: Automate adding languages to wikistats - https://phabricator.wikimedia.org/T336752#10434667 (10VirginiaPoundstone) [21:24:43] 06Data-Engineering-Icebox: Codex, Graph, and Wikistats walk into a bar graph - https://phabricator.wikimedia.org/T336544#10434672 (10VirginiaPoundstone) [21:24:47] 06Data-Engineering-Icebox, 06Privacy Engineering: The soon-to-be-released pageview datasets should be linked from dumps page - https://phabricator.wikimedia.org/T335958#10434673 (10VirginiaPoundstone) [21:24:51] 06Data-Engineering-Icebox, 10Data Pipelines, 07Epic, 13Patch-For-Review: Post Oozie -> Airflow migration refactorings - https://phabricator.wikimedia.org/T336739#10434670 (10VirginiaPoundstone) [21:24:55] 06Data-Engineering-Icebox, 10Data Pipelines, 06Product-Analytics: Delete the leading question mark from uri_query in the webrequest table - https://phabricator.wikimedia.org/T334495#10434674 (10VirginiaPoundstone) [21:24:59] 06Data-Engineering-Icebox, 10Observability-Logging: eventgate-analytics-external logs field explosion - https://phabricator.wikimedia.org/T333729#10434675 (10VirginiaPoundstone) [21:25:03] 06Data-Engineering, 10Data-Engineering-Wikistats: A way to see pageviews statistics on a geographical regional level - https://phabricator.wikimedia.org/T333718#10434676 (10VirginiaPoundstone) [21:25:07] 06Data-Engineering-Icebox, 10Data Pipelines: Investigate dangling tables after Airflow 2.5.1 upgrade of an-airflow1004.eqiad.wmnet - https://phabricator.wikimedia.org/T332820#10434680 (10VirginiaPoundstone) [21:25:11] 06Data-Engineering, 10Data-Engineering-Wikistats, 07Russian-Sites: "Active editors by country" doesn't display numbers for Belarus, Kazakhstan, Russia - https://phabricator.wikimedia.org/T333716#10434678 (10VirginiaPoundstone) [21:25:14] uh [21:25:15] 06Data-Engineering-Icebox, 10Data Pipelines, 06Product-Analytics: Add log_search to monthly sqoop list - https://phabricator.wikimedia.org/T332621#10434681 (10VirginiaPoundstone) [21:25:19] 06Data-Engineering-Icebox, 10Data Pipelines: Use RDD checkpointing in Mediawiki-History spark job - https://phabricator.wikimedia.org/T331003#10434683 (10VirginiaPoundstone) [21:25:23] 06Data-Engineering-Icebox, 10Data Pipelines: Airflow skein hook shouldn't fail when not managing to gather yarn logs - https://phabricator.wikimedia.org/T332215#10434682 (10VirginiaPoundstone) [21:25:27] 06Data-Engineering, 10Cassandra, 10Commons-Impact-Metrics: Recreate top-based Cassandra tables for Commons Impact Metrics - https://phabricator.wikimedia.org/T374268#10434684 (10VirginiaPoundstone) [21:25:33] 06Data-Engineering, 10MediaWiki-extensions-EventLogging, 10Metrics Platform: Determine what UserBucketService::getUserEditCountBucket should return for anons - https://phabricator.wikimedia.org/T329292#10434686 (10VirginiaPoundstone) [21:25:39] 06Data-Engineering-Icebox, 10Data Pipelines: Load wmf.unique_editors_by_country_monthly into Druid for access in Turnilo & Superset - https://phabricator.wikimedia.org/T330436#10434685 (10VirginiaPoundstone) [21:25:43] 06Data-Engineering-Icebox, 10Data Pipelines: Update HiveToDruid job -to not use intermediary data - https://phabricator.wikimedia.org/T329257#10434688 (10VirginiaPoundstone) [21:25:47] 06Data-Engineering-Icebox, 10Data Pipelines: Refactor analytics_test/dags/custom_operators_tryout_dag.py - https://phabricator.wikimedia.org/T327869#10434689 (10VirginiaPoundstone) [21:25:51] 06Data-Engineering-Icebox, 10Data Pipelines: Airflow operator to manage old data deletion - https://phabricator.wikimedia.org/T326826#10434690 (10VirginiaPoundstone) [21:25:55] 06Data-Engineering-Icebox, 10Data Pipelines: Use uap-core browser-family for bot detection - https://phabricator.wikimedia.org/T326339#10434692 (10VirginiaPoundstone) [21:25:59] 06Data-Engineering-Icebox, 10Data Pipelines: Migrate custom gitlab runner that runs Dockerfiles to releng's new production infra - https://phabricator.wikimedia.org/T326570#10434691 (10VirginiaPoundstone) [21:26:03] 06Data-Engineering, 10Pageviews-API: Provide a mechanism to notify subscribers when page view data is available - https://phabricator.wikimedia.org/T326229#10434693 (10VirginiaPoundstone) [21:26:07] 06Data-Engineering-Icebox, 10Data Pipelines, 06Product-Analytics: Add TikTok's in-app browser to ua-parser library - https://phabricator.wikimedia.org/T325611#10434694 (10VirginiaPoundstone) [21:26:11] 06Data-Engineering-Icebox, 10Data Pipelines: Update refinery-source PageviewDefinition to better handle `Special:` pages - https://phabricator.wikimedia.org/T325544#10434696 (10VirginiaPoundstone) [21:26:16] 06Data-Engineering-Icebox, 10Data Pipelines: Set up a repository to generate packaged conda environments via CI for Jupyter notebooks - https://phabricator.wikimedia.org/T325195#10434698 (10VirginiaPoundstone) [21:26:20] 06Data-Engineering-Icebox, 10Data Pipelines: Increase mypy coverage in airflow-dags - https://phabricator.wikimedia.org/T325213#10434697 (10VirginiaPoundstone) [21:26:24] 06Data-Engineering, 10Data-Engineering-Wikistats: User stats page - https://phabricator.wikimedia.org/T324993#10434699 (10VirginiaPoundstone) [21:26:28] 06Data-Engineering-Icebox, 10Data Pipelines: NEW FEATURE REQUEST: sqoop (all) user properties from mariadb to wmf_raw.mediawiki_user_properties - https://phabricator.wikimedia.org/T323456#10434704 (10VirginiaPoundstone) [21:26:32] 06Data-Engineering-Icebox, 10Data Pipelines: Improve docs around JupyterLab and conda-analytics - https://phabricator.wikimedia.org/T324025#10434702 (10VirginiaPoundstone) [21:26:36] 06Data-Engineering, 10Data-Engineering-Wikistats: Number of anonymous edits - https://phabricator.wikimedia.org/T323562#10434701 (10VirginiaPoundstone) [21:26:40] 06Data-Engineering-Icebox, 10Data Pipelines: Improve job to prune old dataset partitions - https://phabricator.wikimedia.org/T322754#10434705 (10VirginiaPoundstone) [21:26:44] 06Data-Engineering-Icebox, 10Data Pipelines: Add support for repository artifacts in Airflow - https://phabricator.wikimedia.org/T322690#10434706 (10VirginiaPoundstone) [21:26:48] 06Data-Engineering-Icebox, 10Data Pipelines: wmf.virtualpageview_hourly's language_variant field is corrupted - https://phabricator.wikimedia.org/T322545#10434707 (10VirginiaPoundstone) [21:26:52] 06Data-Engineering-Icebox, 10Data Pipelines: MVP for Notebook Scheduler - https://phabricator.wikimedia.org/T322533#10434708 (10VirginiaPoundstone) [21:26:56] 06Data-Engineering-Icebox, 10Data Pipelines, 07Epic: Notebook Scheduler for Product Analytics - https://phabricator.wikimedia.org/T322532#10434709 (10VirginiaPoundstone) [21:27:00] 06Data-Engineering-Icebox, 10Data Pipelines: Puppetize custom gitlab runner that can launch Docker containers - https://phabricator.wikimedia.org/T322251#10434710 (10VirginiaPoundstone) [21:27:04] 06Data-Engineering-Icebox, 10Data Pipelines: Back-fill Wikidata reliability Graphite metrics - https://phabricator.wikimedia.org/T321838#10434711 (10VirginiaPoundstone) [21:27:08] 06Data-Engineering-Icebox, 10Data Pipelines: Make mediawiki-history page and user sorting complete for denormalization - https://phabricator.wikimedia.org/T321493#10434713 (10VirginiaPoundstone) [21:27:14] 06Data-Engineering-Icebox, 07Epic, 10Experimentation Lab (Epics Timeline): Bot Detection - https://phabricator.wikimedia.org/T321707#10434712 (10VirginiaPoundstone) [21:27:18] 06Data-Engineering-Icebox, 10Data Pipelines: Make launcher an explicit parameter on SparkSubmitOperator() - https://phabricator.wikimedia.org/T319688#10434714 (10VirginiaPoundstone) [21:27:22] 06Data-Engineering-Icebox, 10Data Pipelines, 06Product-Analytics: Improved edit summary data in mediawiki_history - https://phabricator.wikimedia.org/T318010#10434715 (10VirginiaPoundstone) [21:27:26] 06Data-Engineering-Icebox, 10Data Pipelines: Convert to pure Docker the gitlab CI pipeline to build debianized conda - https://phabricator.wikimedia.org/T315475#10434716 (10VirginiaPoundstone) [21:27:34] 06Data-Engineering-Icebox, 06Product-Analytics: Suspicious user pageview activity in India during June from Android mobile web browsers - https://phabricator.wikimedia.org/T315267#10434717 (10VirginiaPoundstone) [21:27:38] 06Data-Engineering-Icebox, 10Data Pipelines: Bug: Deleted pages are accidentally excluded from mediawiki_history_reduced - https://phabricator.wikimedia.org/T313955#10434720 (10VirginiaPoundstone) [21:27:42] 06Data-Engineering-Icebox, 10Data Pipelines: Sanitize network_flows_internal dataset - https://phabricator.wikimedia.org/T312915#10434721 (10VirginiaPoundstone) [21:27:46] 06Data-Engineering-Icebox, 10Data Pipelines: [Iceberg] Migrate event_santised to Iceberg - https://phabricator.wikimedia.org/T311765#10434722 (10VirginiaPoundstone) [21:27:50] 06Data-Engineering-Icebox, 10Data Pipelines: [Iceberg] Modify superset dashboards to use timestamp based (instead of partition based) queries - https://phabricator.wikimedia.org/T311764#10434723 (10VirginiaPoundstone) [21:27:54] 06Data-Engineering-Icebox, 10Data Pipelines, 13Patch-Needs-Improvement: [Iceberg] Update Refine Sanitize to insert into Iceberg tables - https://phabricator.wikimedia.org/T311739#10434725 (10VirginiaPoundstone) [21:27:58] 06Data-Engineering-Icebox, 10Data Pipelines, 07Epic: [Iceberg] Epic: Icebergify event_sanitized database - https://phabricator.wikimedia.org/T311743#10434724 (10VirginiaPoundstone) [21:28:02] 06Data-Engineering-Icebox, 10Data Pipelines: [Iceberg] Migrate event_sanitized_iceberg to event_sanitized - https://phabricator.wikimedia.org/T311737#10434726 (10VirginiaPoundstone) [21:28:06] 06Data-Engineering-Icebox, 10Data-Catalog, 06Data-Platform-SRE: Re-enable Public Druid metadata ingestion - https://phabricator.wikimedia.org/T311547#10434727 (10VirginiaPoundstone) [21:28:12] 06Data-Engineering-Icebox, 10Data Pipelines: Generate data to count langswitches for every article - https://phabricator.wikimedia.org/T310975#10434729 (10VirginiaPoundstone) [21:28:16] 06Data-Engineering-Icebox, 10Data Pipelines: Drop MediaViewer and MultimediaViewer* tables - https://phabricator.wikimedia.org/T311229#10434728 (10VirginiaPoundstone) [21:28:20] 06Data-Engineering, 10Data-Engineering-Wikistats, 10Data Pipelines, 06LPL Technical Support, and 2 others: Merge ks-Arab and ks-Deva to ks - https://phabricator.wikimedia.org/T314476#10434718 (10VirginiaPoundstone) [21:28:24] 06Data-Engineering-Icebox, 10Data Pipelines: Drop ArticleCreationWorkflow data - https://phabricator.wikimedia.org/T310863#10434730 (10VirginiaPoundstone) [21:28:28] 06Data-Engineering-Icebox, 10Data Pipelines: Automatically monitor schema changes that would break sqoop - https://phabricator.wikimedia.org/T310824#10434732 (10VirginiaPoundstone) [21:28:32] 06Data-Engineering-Icebox: Late events in wdqs-external.sparql-query? - https://phabricator.wikimedia.org/T310790#10434733 (10VirginiaPoundstone) [21:28:36] 06Data-Engineering-Icebox, 10Data Pipelines: [NEEDS GROOMING] We should improve and automate python linting - https://phabricator.wikimedia.org/T310541#10434735 (10VirginiaPoundstone) [21:28:40] 06Data-Engineering-Icebox, 10Data Pipelines: Add scheduler pid file - https://phabricator.wikimedia.org/T310042#10434736 (10VirginiaPoundstone) [21:28:44] 06Data-Engineering-Icebox: Spike: Evaluate data steward assignment - https://phabricator.wikimedia.org/T307719#10434738 (10VirginiaPoundstone) [21:28:48] 06Data-Engineering-Icebox, 10Data Pipelines: [Airflow] Refactor anomaly detection DAG factory into a TaskGroup factory - https://phabricator.wikimedia.org/T308011#10434737 (10VirginiaPoundstone) [21:28:58] 06Data-Engineering-Icebox: Tagging Policy - Strategy - https://phabricator.wikimedia.org/T307710#10434739 (10VirginiaPoundstone) [21:29:02] 06Data-Engineering-Icebox: Dataset Tagging: Implement "PII" tag - https://phabricator.wikimedia.org/T307708#10434740 (10VirginiaPoundstone) [21:29:06] 06Data-Engineering-Icebox: Adding Datasets: Druid Datasets - https://phabricator.wikimedia.org/T307702#10434742 (10VirginiaPoundstone) [21:29:10] 06Data-Engineering-Icebox, 10Data Pipelines: Dataset Tagging: Curated dataset tag - https://phabricator.wikimedia.org/T307706#10434741 (10VirginiaPoundstone) [21:29:14] 06Data-Engineering-Icebox, 14Data-Engineering-Kanban, 10Data Pipelines: Improvements of artifacts cache - https://phabricator.wikimedia.org/T307115#10434743 (10VirginiaPoundstone) [21:29:18] 06Data-Engineering-Icebox, 10Data Pipelines: Migrate 1+ Druid load jobs - https://phabricator.wikimedia.org/T307508#10434744 (10VirginiaPoundstone) [21:29:22] 06Data-Engineering-Icebox, 10Data Pipelines: airflow-dags directory hierarchy refactor for CI testing - https://phabricator.wikimedia.org/T305955#10434747 (10VirginiaPoundstone) [21:29:26] 06Data-Engineering, 10Data-Engineering-Wikistats: Make it clear that WiViVi data is outdated - https://phabricator.wikimedia.org/T306478#10434745 (10VirginiaPoundstone) [21:29:30] 06Data-Engineering, 10MediaWiki-extensions-EventLogging, 10Metrics Platform, 13Patch-Needs-Improvement: Deprecate/delete the mw.eventLog.Schema class - https://phabricator.wikimedia.org/T305491#10434748 (10VirginiaPoundstone) [21:29:36] 06Data-Engineering-Icebox, 10Data Pipelines: Data pipelines should support conda environment files and integrate conda dist - https://phabricator.wikimedia.org/T303839#10434753 (10VirginiaPoundstone) [21:29:40] 06Data-Engineering, 10Data-Engineering-Wikistats: Feature requests for Active Editors by Country - https://phabricator.wikimedia.org/T304720#10434751 (10VirginiaPoundstone) [21:29:44] 06Data-Engineering-Icebox, 10Data Pipelines: Variabilization of existing jobs - https://phabricator.wikimedia.org/T303473#10434754 (10VirginiaPoundstone) [21:29:48] 06Data-Engineering-Icebox: Analysis: incomplete webrequest records - https://phabricator.wikimedia.org/T303215#10434756 (10VirginiaPoundstone) [21:29:52] 06Data-Engineering-Icebox, 10Data Pipelines: [NEEDS GROOMING] We should provide a migration path from client-mode spark jobs - https://phabricator.wikimedia.org/T303189#10434755 (10VirginiaPoundstone) [21:29:56] 06Data-Engineering-Icebox, 10Data Pipelines: [Airflow] Spike investigate of better ways to organize/access Airflow logs - https://phabricator.wikimedia.org/T302500#10434757 (10VirginiaPoundstone) [21:30:00] 06Data-Engineering-Icebox, 06Product-Analytics: Improvements to mediawiki_geoeditors_monthly dimensions - https://phabricator.wikimedia.org/T302079#10434760 (10VirginiaPoundstone) [21:30:04] 06Data-Engineering-Icebox, 10Data Pipelines: [Anomaly detection] Allow for custom email alert content - https://phabricator.wikimedia.org/T301571#10434762 (10VirginiaPoundstone) [21:30:08] 06Data-Engineering-Icebox, 10superset.wikimedia.org: [Spike] Test spark thrift-server for Superset - https://phabricator.wikimedia.org/T300611#10434766 (10VirginiaPoundstone) [21:30:12] 06Data-Engineering, 06Growth-Team, 10GrowthExperiments, 10MediaWiki-extensions-EventLogging, and 2 others: Create a test for end-to-end event logging data verification of happy path with Special:Homepage and suggested edits - https://phabricator.wikimedia.org/T301463#10434764 (10VirginiaPoundstone) [21:30:24] 06Data-Engineering-Icebox: Reduce number of missing revisions from mediawiki-history - https://phabricator.wikimedia.org/T294578#10434769 (10VirginiaPoundstone) [21:30:28] 06Data-Engineering-Icebox, 10Data Pipelines: [NEEDS GROOMING] Data pipelines should be published to archiva - https://phabricator.wikimedia.org/T295812#10434767 (10VirginiaPoundstone) [21:30:32] 06Data-Engineering, 14Data-Engineering-Kanban, 10Data-Engineering-Wikistats, 06Product-Analytics: Wikistats reports no mobile unique devices for Wikidata and MediaWiki.org - https://phabricator.wikimedia.org/T299559#10434768 (10VirginiaPoundstone) [21:30:36] 06Data-Engineering-Icebox, 06cloud-services-team, 10Data-Services, 13Patch-For-Review: Log_param is redacted in wiki replica when only comment and/or user should be - https://phabricator.wikimedia.org/T301943#10434761 (10VirginiaPoundstone) [21:30:42] 06Data-Engineering-Icebox, 10Data Pipelines: [SPIKE][PLACEHOLDER] we need to estimate the effort required to migrate Similarusers' backend to Cassandra - https://phabricator.wikimedia.org/T287274#10434771 (10VirginiaPoundstone) [21:30:46] 06Data-Engineering, 10Data-Engineering-Wikistats: Change state to store project as an array - https://phabricator.wikimedia.org/T283624#10434772 (10VirginiaPoundstone) [21:30:56] 06Data-Engineering, 10Data-Engineering-Wikistats, 07Epic: Add ability to compare wikis - https://phabricator.wikimedia.org/T283251#10434777 (10VirginiaPoundstone) [21:31:04] 06Data-Engineering-Icebox, 10VisualEditor, 06WMDE-TechWish, 10Editing-team (Tracking): Investigate missing dialog close events - https://phabricator.wikimedia.org/T272020#10434778 (10VirginiaPoundstone) [21:31:12] 14Analytics-Radar, 06Data-Engineering, 10Data-Engineering-Wikistats: Negative total number of bytes for German Wikipedia in 2001? - https://phabricator.wikimedia.org/T203906#10434782 (10VirginiaPoundstone) [21:31:16] 14Analytics-Radar, 06Data-Engineering, 10Pageviews-API, 10RESTBase-API, and 2 others: views error in mostread feed - https://phabricator.wikimedia.org/T267624#10434780 (10VirginiaPoundstone) [21:31:21] 06Data-Engineering, 10Data-Engineering-Wikistats: Automate creation of sqoop list of wikis to import data for from sitematrix - https://phabricator.wikimedia.org/T190700#10434784 (10VirginiaPoundstone) [21:31:25] 06Data-Engineering, 10Pageviews-Anomaly, 07SecTeam-Processed, 07Security: Views data integrity compromised by entity running up fake views - https://phabricator.wikimedia.org/T366554#10434786 (10VirginiaPoundstone) [21:31:29] 14Analytics-Radar, 06Data-Engineering, 10Data-Engineering-Wikistats: WiViVi: Per-person should account for connected percentage? - https://phabricator.wikimedia.org/T172335#10434787 (10VirginiaPoundstone) [21:31:33] 14Analytics-Radar, 06Data-Engineering, 10GLAM-Tech, 10Pageviews-API: WMF pageview API (404 error) when requesting statistics over around 1000 files on GLAMorgan - https://phabricator.wikimedia.org/T145197#10434788 (10VirginiaPoundstone) [21:31:37] 06Data-Engineering, 10MediaWiki-extensions-EventLogging, 10MediaWiki-General, 07Performance Issue: Add event tracking queue to MediaWiki core for loose coupling with EventLogging or other interested consumers - https://phabricator.wikimedia.org/T95356#10434789 (10VirginiaPoundstone) [21:31:43] 06Data-Engineering-Icebox, 10Data Pipelines: Prune raw HDFS FSImages stored on HDFS - https://phabricator.wikimedia.org/T325103#10434795 (10VirginiaPoundstone) [21:31:47] 06Data-Engineering, 10Data-Engineering-Wikistats: Wikistats returns a blank page when switching language to Icelandic - https://phabricator.wikimedia.org/T338466#10434794 (10VirginiaPoundstone) [21:31:51] 06Data-Engineering-Icebox, 10Cassandra, 10Data Pipelines: Encrypt Spark-Cassandra connection - https://phabricator.wikimedia.org/T310820#10434798 (10VirginiaPoundstone) [21:31:57] 06Data-Engineering, 10Data-Engineering-Wikistats: Non-mobile UAs on mobile (2g/gprs, etc) IP-blocks - https://phabricator.wikimedia.org/T58628#10434793 (10VirginiaPoundstone) [21:32:01] 06Data-Engineering-Icebox, 14Data-Engineering-Kanban, 10superset.wikimedia.org: Document and share Superset Hive Date Filter Guidance - https://phabricator.wikimedia.org/T299681#10434799 (10VirginiaPoundstone) [21:32:05] 06Data-Engineering-Icebox, 10Data-Platform-SRE (2024.11.30 - 2024.12.20): Some wikibase tables not available in commonswiki_p - https://phabricator.wikimedia.org/T298452#10434800 (10VirginiaPoundstone) [21:32:11] 06Data-Engineering-Icebox: [Session length] Apply different sample rates per wiki - https://phabricator.wikimedia.org/T291693#10434802 (10VirginiaPoundstone) [21:32:15] 06Data-Engineering-Icebox, 14Data-Engineering-Kanban, 10Data Pipelines, 07Epic: [Airflow] User manual and documentation - https://phabricator.wikimedia.org/T295199#10434801 (10VirginiaPoundstone) [21:32:19] 06Data-Engineering-Icebox: Fix gobblin not writing _IMPORTED flags when runs don't overlap hours - https://phabricator.wikimedia.org/T286343#10434805 (10VirginiaPoundstone) [21:32:23] 06Data-Engineering, 10Event-Platform: [EventGate] Failures when getting stream config from MediaWiki API - https://phabricator.wikimedia.org/T286793#10434803 (10VirginiaPoundstone) [21:32:27] 06Data-Engineering-Icebox: Add ignore success flags option to pageview monthly dumps - https://phabricator.wikimedia.org/T283593#10434807 (10VirginiaPoundstone) [21:32:31] 06Data-Engineering-Icebox, 06Data-Platform-SRE: Define priorities for HDFS data to be backed up - https://phabricator.wikimedia.org/T283261#10434808 (10VirginiaPoundstone) [21:32:37] 06Data-Engineering-Icebox: Crunch and delete many old dumps logs - https://phabricator.wikimedia.org/T280678#10434810 (10VirginiaPoundstone) [21:32:41] 06Data-Engineering-Icebox: Make data quality stats alert only if anomalous metrics change - https://phabricator.wikimedia.org/T263030#10434812 (10VirginiaPoundstone) [21:32:45] 06Data-Engineering-Icebox: Address jackson version security vulnerabilities in refinery-source - https://phabricator.wikimedia.org/T272058#10434811 (10VirginiaPoundstone) [21:32:53] 06Data-Engineering-Icebox: pagecounts-ez of month 2020-08 is incomplete - https://phabricator.wikimedia.org/T262141#10434813 (10VirginiaPoundstone) [21:32:57] 06Data-Engineering-Icebox, 06cloud-services-team, 10Data-Services, 06Privacy Engineering: Increased visibility in wiki-replicas for volunteers fighting vandals - https://phabricator.wikimedia.org/T284944#10434806 (10VirginiaPoundstone) [21:33:03] 06Data-Engineering-Icebox: explicitily exclude mobile-app traffic from unique devices per domain computation - https://phabricator.wikimedia.org/T258288#10434816 (10VirginiaPoundstone) [21:33:07] 06Data-Engineering-Icebox: actor_signature_per_project_family does not work for apps - https://phabricator.wikimedia.org/T258101#10434817 (10VirginiaPoundstone) [21:33:11] 06Data-Engineering-Icebox, 13Patch-Needs-Improvement: HiveExtensions.convertToSchema does not properly convert arrays of structs - https://phabricator.wikimedia.org/T259924#10434815 (10VirginiaPoundstone) [21:33:15] 06Data-Engineering-Icebox: Add backend field to webrequest Hive table - https://phabricator.wikimedia.org/T257354#10434818 (10VirginiaPoundstone) [21:33:19] 14Analytics-Radar, 06Data-Engineering, 10MediaWiki-extensions-EventLogging: SearchSatisfaction has validation errors for event.query - https://phabricator.wikimedia.org/T257331#10434819 (10VirginiaPoundstone) [21:33:25] 06Data-Engineering, 10Data-Engineering-Wikistats: Define reduce calculations needed to compute active editors per project family - https://phabricator.wikimedia.org/T249751#10434821 (10VirginiaPoundstone) [21:33:29] 06Data-Engineering-Icebox: Change sqoop project list config so that content sqoop doesn't fail - https://phabricator.wikimedia.org/T239589#10434825 (10VirginiaPoundstone) [21:33:33] 06Data-Engineering-Icebox: MW REST API Historical Data Endpoint Needs - https://phabricator.wikimedia.org/T240387#10434823 (10VirginiaPoundstone) [21:33:37] 06Data-Engineering-Icebox: Update mediawiki-history to use new Multi-Content-Revision tables - https://phabricator.wikimedia.org/T239591#10434824 (10VirginiaPoundstone) [21:33:41] 06Data-Engineering, 06Data-Platform-SRE, 10Dumps-Generation, 10MW-on-K8s, and 4 others: WE 5.4 KR - Hypothesis 5.4.4 - Q3 FY24/55 - Migrate current-generation dumps to run on kubernetes - https://phabricator.wikimedia.org/T352650#10434814 (10VirginiaPoundstone) [21:33:51] 06Data-Engineering-Icebox, 06Product-Analytics: Get "edits hourly" on a daily basis - https://phabricator.wikimedia.org/T231938#10434826 (10VirginiaPoundstone) [21:33:59] 06Data-Engineering-Icebox, 06Data-Platform-SRE, 06SRE Observability: [Data Platform] Install a Prometheus connector for Presto, pointed at thanos-query - https://phabricator.wikimedia.org/T347430#10434828 (10VirginiaPoundstone) [21:34:05] 06Data-Engineering-Icebox, 06Data-Platform-SRE, 10Observability-Alerting: Explore the use of Airflow notifiers for more flexible DAG failure handling - https://phabricator.wikimedia.org/T343234#10434829 (10VirginiaPoundstone) [21:34:12] 06Data-Engineering-Icebox, 10Product-Analytics (Kanban): Product Analytics ETL Migration: Pilot (MediaSearch ETLs) - https://phabricator.wikimedia.org/T333208#10434832 (10VirginiaPoundstone) [21:34:16] 10Analytics-Canonical-Data, 06Data-Engineering-Icebox, 06Movement-Insights: Automate the loading of canonical data tables to the Data Lake - https://phabricator.wikimedia.org/T339928#10434830 (10VirginiaPoundstone) [21:34:20] 06Data-Engineering-Icebox, 06Data-Platform-SRE, 06Infrastructure-Foundations, 06SRE: Investigate crypto KDC deprecations after Bullseye update - https://phabricator.wikimedia.org/T337544#10434831 (10VirginiaPoundstone) [21:34:28] 06Data-Engineering-Icebox, 10Data Pipelines: NEW FEATURE REQUEST: Dataset with active and non-active Wikis - https://phabricator.wikimedia.org/T323662#10434834 (10VirginiaPoundstone) [21:34:32] 06Data-Engineering-Icebox: Cleanup User Hive Databases - https://phabricator.wikimedia.org/T323884#10434833 (10VirginiaPoundstone) [21:34:36] 06Data-Engineering, 06Product-Analytics, 10Wmfdata-Python: Set up Wmfdata-Python integration test suite to run automatically - https://phabricator.wikimedia.org/T304547#10434836 (10VirginiaPoundstone) [21:34:40] 06Data-Engineering-Icebox, 10Data Pipelines, 07Documentation, 07Epic: [Airflow] Kick off documentation in wikitech - https://phabricator.wikimedia.org/T302400#10434839 (10VirginiaPoundstone) [21:34:44] 06Data-Engineering, 10Data-Engineering-Wikistats: Confusing filtering on "Active editors by country" topic - https://phabricator.wikimedia.org/T300365#10434840 (10VirginiaPoundstone) [21:34:48] 06Data-Engineering-Icebox, 06Product-Analytics, 13Patch-For-Review: Propagate field descriptions from event schemas to Hive event tables - https://phabricator.wikimedia.org/T307040#10434835 (10VirginiaPoundstone) [21:34:52] 06Data-Engineering-Icebox, 06serviceops, 06SRE, 06Trust-and-Safety: Disable GeoIP Legacy Download / Identify all users of legacy (v1) GeoIP datasets and inform them of the need to switch to GeoIP2 dataset - https://phabricator.wikimedia.org/T303464#10434838 (10VirginiaPoundstone) [21:35:00] 06Data-Engineering-Icebox, 06Data-Platform-SRE: Enforce authentication and authorization for webrequest_* topics in Kafka jumbo-eqiad cluster - https://phabricator.wikimedia.org/T294264#10434843 (10VirginiaPoundstone) [21:37:19] 06Data-Engineering, 10Event-Platform: Simplify EventBus code by deprecating EventBusFactory - https://phabricator.wikimedia.org/T370524#10435093 (10VirginiaPoundstone) [21:37:23] 06Data-Engineering, 10Data-Engineering-Wikistats, 06Experimentation Lab, 10PageViewInfo, and 2 others: Pageviews Analysis 3.0 (Vue + Codex) - https://phabricator.wikimedia.org/T378549#10435091 (10VirginiaPoundstone) [21:37:36] 06Data-Engineering, 10Event-Platform: Utilize Kafka Headers - https://phabricator.wikimedia.org/T351089#10435099 (10VirginiaPoundstone) [21:37:40] 06Data-Engineering, 10Research-engineering, 10Event-Platform, 10Research (FY2024-25-Research-January-March): Productionized Edit Types - https://phabricator.wikimedia.org/T351225#10435097 (10VirginiaPoundstone) [21:37:44] 06Data-Engineering, 10Data-Engineering-Jupyter: Read and process parquet files from Jupyter notebooks - https://phabricator.wikimedia.org/T338932#10435102 (10VirginiaPoundstone) [21:37:48] 06Data-Engineering, 10Data-Engineering-Wikistats: Add punjabi language in Wikistats - https://phabricator.wikimedia.org/T344572#10435101 (10VirginiaPoundstone) [21:37:52] 06Data-Engineering, 10Data-Engineering-Wikistats, 07I18n: Fill in missing qqq.json and enforce in future - https://phabricator.wikimedia.org/T338072#10435104 (10VirginiaPoundstone) [21:37:56] 06Data-Engineering, 10Data-Engineering-Wikistats, 07I18n: In Wikistats, `npm run dev` only shows strings in English - https://phabricator.wikimedia.org/T337033#10435105 (10VirginiaPoundstone) [21:38:00] 06Data-Engineering, 10Data-Engineering-Wikistats, 07I18n, 13Patch-For-Review: Wikistats 2 should translate month names and abbreviations - https://phabricator.wikimedia.org/T336815#10435110 (10VirginiaPoundstone) [21:38:04] 06Data-Engineering, 10Data-Engineering-Wikistats, 13Patch-For-Review: Change GitHub link to Gerrit in the Wikistats frontend - https://phabricator.wikimedia.org/T336765#10435113 (10VirginiaPoundstone) [21:38:08] 06Data-Engineering, 10Data-Engineering-Wikistats, 07I18n, 13Patch-For-Review: Untranslatable strings in Wikistats - https://phabricator.wikimedia.org/T337032#10435109 (10VirginiaPoundstone) [21:38:14] 06Data-Engineering, 10Data-Engineering-Wikistats, 06translatewiki.net, 07I18n: Automate adding languages to wikistats - https://phabricator.wikimedia.org/T336752#10435114 (10VirginiaPoundstone) [21:38:18] 06Data-Engineering, 10MediaWiki-extensions-EventLogging, 10Metrics Platform: Determine what UserBucketService::getUserEditCountBucket should return for anons - https://phabricator.wikimedia.org/T329292#10435119 (10VirginiaPoundstone) [21:38:24] 06Data-Engineering, 10Pageviews-API: Provide a mechanism to notify subscribers when page view data is available - https://phabricator.wikimedia.org/T326229#10435122 (10VirginiaPoundstone) [21:38:28] 06Data-Engineering, 10Data-Engineering-Wikistats: A way to see pageviews statistics on a geographical regional level - https://phabricator.wikimedia.org/T333718#10435117 (10VirginiaPoundstone) [21:38:32] 06Data-Engineering, 10Data-Engineering-Wikistats, 07Russian-Sites: "Active editors by country" doesn't display numbers for Belarus, Kazakhstan, Russia - https://phabricator.wikimedia.org/T333716#10435118 (10VirginiaPoundstone) [21:38:36] 06Data-Engineering, 10Data-Engineering-Wikistats: Number of anonymous edits - https://phabricator.wikimedia.org/T323562#10435126 (10VirginiaPoundstone) [21:38:40] 06Data-Engineering, 10Data-Engineering-Wikistats: User stats page - https://phabricator.wikimedia.org/T324993#10435125 (10VirginiaPoundstone) [21:38:44] 06Data-Engineering, 10MediaWiki-extensions-EventLogging, 10Metrics Platform, 13Patch-Needs-Improvement: Deprecate/delete the mw.eventLog.Schema class - https://phabricator.wikimedia.org/T305491#10435131 (10VirginiaPoundstone) [21:38:50] 06Data-Engineering, 10Data-Engineering-Wikistats: Make it clear that WiViVi data is outdated - https://phabricator.wikimedia.org/T306478#10435132 (10VirginiaPoundstone) [21:38:54] 06Data-Engineering, 10Data-Engineering-Wikistats: Feature requests for Active Editors by Country - https://phabricator.wikimedia.org/T304720#10435134 (10VirginiaPoundstone) [21:38:58] 06Data-Engineering, 06Growth-Team, 10GrowthExperiments, 10MediaWiki-extensions-EventLogging, and 2 others: Create a test for end-to-end event logging data verification of happy path with Special:Homepage and suggested edits - https://phabricator.wikimedia.org/T301463#10435137 (10VirginiaPoundstone) [21:39:06] 06Data-Engineering, 14Data-Engineering-Kanban, 10Data-Engineering-Wikistats, 06Product-Analytics: Wikistats reports no mobile unique devices for Wikidata and MediaWiki.org - https://phabricator.wikimedia.org/T299559#10435138 (10VirginiaPoundstone) [21:39:11] 06Data-Engineering, 10Data-Engineering-Wikistats, 10Data Pipelines, 06LPL Technical Support, and 2 others: Merge ks-Arab and ks-Deva to ks - https://phabricator.wikimedia.org/T314476#10435129 (10VirginiaPoundstone) [21:39:15] 06Data-Engineering, 10Data-Engineering-Wikistats: Change state to store project as an array - https://phabricator.wikimedia.org/T283624#10435141 (10VirginiaPoundstone) [21:39:19] 14Analytics-Radar, 06Data-Engineering, 10Data-Engineering-Wikistats: Negative total number of bytes for German Wikipedia in 2001? - https://phabricator.wikimedia.org/T203906#10435145 (10VirginiaPoundstone) [21:39:23] 06Data-Engineering, 10Data-Engineering-Wikistats, 07Epic: Add ability to compare wikis - https://phabricator.wikimedia.org/T283251#10435143 (10VirginiaPoundstone) [21:39:27] 06Data-Engineering, 10Data-Engineering-Wikistats: Automate creation of sqoop list of wikis to import data for from sitematrix - https://phabricator.wikimedia.org/T190700#10435149 (10VirginiaPoundstone) [21:39:31] 14Analytics-Radar, 06Data-Engineering, 10Pageviews-API, 10RESTBase-API, and 2 others: views error in mostread feed - https://phabricator.wikimedia.org/T267624#10435144 (10VirginiaPoundstone) [21:39:35] 14Analytics-Radar, 06Data-Engineering, 10GLAM-Tech, 10Pageviews-API: WMF pageview API (404 error) when requesting statistics over around 1000 files on GLAMorgan - https://phabricator.wikimedia.org/T145197#10435152 (10VirginiaPoundstone) [21:39:39] 14Analytics-Radar, 06Data-Engineering, 10Data-Engineering-Wikistats: WiViVi: Per-person should account for connected percentage? - https://phabricator.wikimedia.org/T172335#10435151 (10VirginiaPoundstone) [21:39:43] 06Data-Engineering, 10Data-Engineering-Wikistats: Non-mobile UAs on mobile (2g/gprs, etc) IP-blocks - https://phabricator.wikimedia.org/T58628#10435157 (10VirginiaPoundstone) [21:39:47] 06Data-Engineering, 10MediaWiki-extensions-EventLogging, 10MediaWiki-General, 07Performance Issue: Add event tracking queue to MediaWiki core for loose coupling with EventLogging or other interested consumers - https://phabricator.wikimedia.org/T95356#10435155 (10VirginiaPoundstone) [21:39:53] 06Data-Engineering, 10Event-Platform: [EventGate] Failures when getting stream config from MediaWiki API - https://phabricator.wikimedia.org/T286793#10435160 (10VirginiaPoundstone) [21:39:57] 06Data-Engineering, 10Data-Engineering-Wikistats: Define reduce calculations needed to compute active editors per project family - https://phabricator.wikimedia.org/T249751#10435162 (10VirginiaPoundstone) [21:40:01] 14Analytics-Radar, 06Data-Engineering, 10MediaWiki-extensions-EventLogging: SearchSatisfaction has validation errors for event.query - https://phabricator.wikimedia.org/T257331#10435161 (10VirginiaPoundstone) [21:40:07] 06Data-Engineering, 10Data-Engineering-Wikistats: Wikistats returns a blank page when switching language to Icelandic - https://phabricator.wikimedia.org/T338466#10435159 (10VirginiaPoundstone) [21:40:11] 06Data-Engineering, 06Product-Analytics, 10Wmfdata-Python: Set up Wmfdata-Python integration test suite to run automatically - https://phabricator.wikimedia.org/T304547#10435167 (10VirginiaPoundstone) [21:40:15] 06Data-Engineering, 06Movement-Insights, 10Wmfdata-Python, 07Documentation: Publish HTML docs for Wmfdata-Python on doc.wikimedia.org - https://phabricator.wikimedia.org/T298178#10435169 (10VirginiaPoundstone) [21:40:19] 06Data-Engineering, 10Data-Engineering-Wikistats: Confusing filtering on "Active editors by country" topic - https://phabricator.wikimedia.org/T300365#10435168 (10VirginiaPoundstone) [21:40:23] 06Data-Engineering, 10Data-Engineering-Wikistats: Offer map and queries by subdivisions of countries - https://phabricator.wikimedia.org/T284294#10435177 (10VirginiaPoundstone) [21:40:27] 06Data-Engineering, 10Data-Engineering-Wikistats, 13Patch-Needs-Improvement: Expand Wikiselector to allow more than one wiki - https://phabricator.wikimedia.org/T285050#10435175 (10VirginiaPoundstone) [21:40:31] 06Data-Engineering, 10Data-Engineering-Wikistats: Wikistats should allow more than one project - https://phabricator.wikimedia.org/T283254#10435178 (10VirginiaPoundstone) [21:40:41] 14Analytics, 06Data-Engineering, 10EventStreams, 10Wikidata, and 3 others: [EPIC] Expose rdf-streaming-updater.mutation content through EventStreams - https://phabricator.wikimedia.org/T294133#10435172 (10VirginiaPoundstone) [21:40:45] 06Data-Engineering, 10Data-Engineering-Jupyter, 10CAS-SSO, 06Data-Platform-SRE, 07Epic: Improve the JupyterHub services and use CAS/SSO - https://phabricator.wikimedia.org/T260386#10435183 (10VirginiaPoundstone) [21:40:53] 06Data-Engineering, 10Data-Engineering-Wikistats: Regional and group evaluations - https://phabricator.wikimedia.org/T264512#10435181 (10VirginiaPoundstone) [21:40:57] 06Data-Engineering, 10Data-Engineering-Wikistats, 06Commons: Creating tools for compiling list of Wikimedia Commons users by contributions/uploads - https://phabricator.wikimedia.org/T263377#10435182 (10VirginiaPoundstone) [21:41:03] 06Data-Engineering, 10Data-Engineering-Wikistats: Country pageview breakdown by language - https://phabricator.wikimedia.org/T250001#10435189 (10VirginiaPoundstone) [21:41:07] 06Data-Engineering, 10Data-Engineering-Wikistats, 10Technical-Tool-Request: Ranked list of all Wikipedias by yearly readership growth - https://phabricator.wikimedia.org/T224963#10435190 (10VirginiaPoundstone) [21:41:11] 14Analytics-Radar, 06Data-Engineering, 10Pageviews-API, 10Tool-Pageviews: 429 Too Many Requests hit despite throttling to 100 req/sec - https://phabricator.wikimedia.org/T219857#10435194 (10VirginiaPoundstone) [21:41:17] 06Data-Engineering, 10Data-Engineering-Wikistats: Group pageview data per family in AQS so we can surface it in wikistats per-family pageview metrics - https://phabricator.wikimedia.org/T205730#10435199 (10VirginiaPoundstone) [21:41:21] 14Analytics-Radar, 06Data-Engineering, 10MediaWiki-extensions-EventLogging, 07Epic: Explore an API for logging events sampled by session - https://phabricator.wikimedia.org/T168380#10435200 (10VirginiaPoundstone) [21:41:29] 06Data-Engineering, 10Pageviews-API: Endpoint for average view rate in Pageview API - https://phabricator.wikimedia.org/T162933#10435204 (10VirginiaPoundstone) [21:41:33] 06Data-Engineering, 10Pageviews-API: Provide weekly top pageviews stats - https://phabricator.wikimedia.org/T133575#10435205 (10VirginiaPoundstone) [21:41:41] 06Data-Engineering, 06Product-Analytics, 10Wmfdata-Python: PyHive ignores SET statements with a leading newline - https://phabricator.wikimedia.org/T334442#10435218 (10VirginiaPoundstone) [21:41:45] 06Data-Engineering, 10Data-Engineering-Jupyter, 06Data-Platform-SRE, 06Product-Analytics: Remove anaconda-wmf package from the cluster - https://phabricator.wikimedia.org/T337963#10435217 (10VirginiaPoundstone) [21:41:51] 06Data-Engineering, 10Data-Engineering-Wikistats, 10Movement-Metrics: Support including edits to deleted pages in editing metrics - https://phabricator.wikimedia.org/T295212#10435221 (10VirginiaPoundstone) [21:41:55] 06Data-Engineering, 06Product-Analytics, 10Wmfdata-Python: Support querying a range of hourly data partitions - https://phabricator.wikimedia.org/T294654#10435224 (10VirginiaPoundstone) [21:41:59] 06Data-Engineering, 06Product-Analytics, 10Wmfdata-Python: Decide whether and how to consolidate Wmfdata-Python and Refinery's Python modules - https://phabricator.wikimedia.org/T293700#10435227 (10VirginiaPoundstone) [21:42:03] 14Analytics-Kanban, 06Data-Engineering, 06Product-Analytics, 10Wmfdata-Python: wmfdata.mariadb relies on analytics-mysql being available - https://phabricator.wikimedia.org/T292479#10435228 (10VirginiaPoundstone) [21:42:07] 06Data-Engineering, 06Product-Analytics, 10Wmfdata-Python: Add utility functions for converting between various time formats - https://phabricator.wikimedia.org/T273209#10435231 (10VirginiaPoundstone) [21:42:11] 06Data-Engineering, 06Product-Analytics, 10Wmfdata-Python: Update all run functions to allow specifying date and index columns - https://phabricator.wikimedia.org/T273208#10435232 (10VirginiaPoundstone) [21:42:15] 06Data-Engineering, 06Product-Analytics, 10Wmfdata-Python: Update all Wmfdata-Python run functions to have consistent API - https://phabricator.wikimedia.org/T273197#10435233 (10VirginiaPoundstone) [21:42:19] 06Data-Engineering, 06Product-Analytics, 10Wmfdata-Python: Support importing a Parquet file into HDFS using wmfdata-python - https://phabricator.wikimedia.org/T273196#10435234 (10VirginiaPoundstone) [21:42:23] 06Data-Engineering, 06Product-Analytics, 10Wmfdata-Python: wmfdata should display more progress information and metadata when running a query - https://phabricator.wikimedia.org/T259808#10435239 (10VirginiaPoundstone) [21:42:27] 06Data-Engineering, 06Product-Analytics, 10Wmfdata-Python: Code toggle should remove standard error and center all output - https://phabricator.wikimedia.org/T247442#10435242 (10VirginiaPoundstone) [21:42:31] 06Data-Engineering, 10Data-Engineering-Wikistats: "Page views by edition of Wikipedia" for each country - https://phabricator.wikimedia.org/T257071#10435241 (10VirginiaPoundstone) [21:42:35] 06Data-Engineering, 10Data-Engineering-Wikistats: [Wikistats] The permanent link is broken - https://phabricator.wikimedia.org/T245445#10435245 (10VirginiaPoundstone) [21:42:39] 06Data-Engineering, 10Data-Engineering-Wikistats: Add "Top used photos" metric - https://phabricator.wikimedia.org/T220485#10435247 (10VirginiaPoundstone) [21:42:43] 14Analytics, 06Data-Engineering, 10MediaWiki-Action-API, 10PageViewInfo, 10Pageviews-API: API Analytics - page views by country - https://phabricator.wikimedia.org/T213221#10435248 (10VirginiaPoundstone) [21:42:50] 14Analytics, 06Data-Engineering, 10Pageviews-API: Filter top pages by namespace/category - https://phabricator.wikimedia.org/T182975#10435251 (10VirginiaPoundstone) [21:42:54] 06Data-Engineering, 10Data-Engineering-Wikistats: Render Wikistats graphs server-side, so that they can be embedded on-wikis - https://phabricator.wikimedia.org/T178016#10435253 (10VirginiaPoundstone) [21:42:58] 06Data-Engineering, 10Data-Engineering-Jupyter, 06Product-Analytics: Functionality to share & view notebooks - https://phabricator.wikimedia.org/T156934#10435255 (10VirginiaPoundstone) [21:43:02] 14Analytics, 06Data-Engineering, 10Pageviews-API: Adding top counts for wiki projects (ex: WikiProject:Medicine) to pageview API - https://phabricator.wikimedia.org/T141010#10435259 (10VirginiaPoundstone) [21:43:06] 14Analytics, 06Data-Engineering, 10Pageviews-API: Yearly endpoint for the /pageviews/top API - https://phabricator.wikimedia.org/T154381#10435257 (10VirginiaPoundstone) [21:43:10] 06Data-Engineering, 10Data-Engineering-Wikistats: Determine total number of external links in all Wikipedias - https://phabricator.wikimedia.org/T137984#10435260 (10VirginiaPoundstone) [21:43:14] 06Data-Engineering, 10Data-Engineering-Wikistats: add talk pages count to project statistics - https://phabricator.wikimedia.org/T71742#10435265 (10VirginiaPoundstone) [21:43:18] 06Data-Engineering, 10Data-Engineering-Wikistats: Views/hr column in WikiStats should consider an average on several months - https://phabricator.wikimedia.org/T37194#10435266 (10VirginiaPoundstone) [21:43:22] 06Data-Engineering, 10Data-Engineering-Wikistats: One column header in browsers per country report only contains '---' - https://phabricator.wikimedia.org/T73127#10435263 (10VirginiaPoundstone) [21:43:26] 06Data-Engineering, 10Data-Engineering-Wikistats: for all namespaces show page count without redirects - https://phabricator.wikimedia.org/T71743#10435264 (10VirginiaPoundstone) [21:43:50] 06Data-Engineering, 06Data-Engineering-Radar, 10CampaignEvents, 06Data-Persistence, and 5 others: Add "event_is_test_event" field to "campaign_events" table - https://phabricator.wikimedia.org/T381759#10435275 (10VirginiaPoundstone) [21:44:00] 06Data-Engineering, 10Data-Engineering-Wikistats, 06Experimentation Lab, 10PageViewInfo, and 3 others: Pageviews Analysis 3.0 (Vue + Codex) - https://phabricator.wikimedia.org/T378549#10435276 (10VirginiaPoundstone) [21:44:18] 06Data-Engineering, 06Data-Engineering-Radar, 10CampaignEvents, 10EntitySchema, and 17 others: Add namespace descriptions for Special:NamespaceInfo in WMF-deployed extensions - https://phabricator.wikimedia.org/T373070#10435277 (10VirginiaPoundstone) [21:45:30] 06Data-Engineering, 10Data-Engineering-Wikistats, 10PageViewInfo, 10Tool-Pageviews, and 2 others: Pageviews Analysis 3.0 (Vue + Codex) - https://phabricator.wikimedia.org/T378549#10435341 (10VirginiaPoundstone) [21:45:53] 06Data-Engineering, 10Data-Engineering-Wikistats, 10PageViewInfo, 10Tool-Pageviews, and 2 others: Pageviews Analysis 3.0 (Vue + Codex) - https://phabricator.wikimedia.org/T378549#10435347 (10Ottomata) [21:45:59] 06Data-Engineering, 10Event-Platform: Simplify EventBus code by deprecating EventBusFactory - https://phabricator.wikimedia.org/T370524#10435349 (10Ottomata) [21:46:03] 06Data-Engineering, 10Research-engineering, 10Event-Platform, 10Research (FY2024-25-Research-January-March): Productionized Edit Types - https://phabricator.wikimedia.org/T351225#10435351 (10Ottomata) [21:46:07] 06Data-Engineering, 10Event-Platform: Utilize Kafka Headers - https://phabricator.wikimedia.org/T351089#10435353 (10Ottomata) [21:46:11] 06Data-Engineering, 10Data-Engineering-Wikistats: Add punjabi language in Wikistats - https://phabricator.wikimedia.org/T344572#10435355 (10Ottomata) [21:46:15] 06Data-Engineering, 10Data-Engineering-Jupyter: Read and process parquet files from Jupyter notebooks - https://phabricator.wikimedia.org/T338932#10435357 (10Ottomata) [21:46:19] 06Data-Engineering, 10Data-Engineering-Wikistats, 07I18n: Fill in missing qqq.json and enforce in future - https://phabricator.wikimedia.org/T338072#10435359 (10Ottomata) [21:46:23] 06Data-Engineering, 10Data-Engineering-Wikistats, 07I18n: In Wikistats, `npm run dev` only shows strings in English - https://phabricator.wikimedia.org/T337033#10435361 (10Ottomata) [21:46:27] 06Data-Engineering, 10Data-Engineering-Wikistats, 07I18n, 13Patch-For-Review: Untranslatable strings in Wikistats - https://phabricator.wikimedia.org/T337032#10435364 (10Ottomata) [21:46:33] 06Data-Engineering, 10Data-Engineering-Wikistats, 07I18n, 13Patch-For-Review: Wikistats 2 should translate month names and abbreviations - https://phabricator.wikimedia.org/T336815#10435366 (10Ottomata) [21:46:43] 06Data-Engineering, 10Data-Engineering-Wikistats, 13Patch-For-Review: Change GitHub link to Gerrit in the Wikistats frontend - https://phabricator.wikimedia.org/T336765#10435368 (10Ottomata) [21:47:08] 06Data-Engineering, 10Data-Engineering-Wikistats, 06translatewiki.net, 07I18n: Automate adding languages to wikistats - https://phabricator.wikimedia.org/T336752#10435371 (10Ottomata) [21:47:12] 06Data-Engineering, 10Data-Engineering-Wikistats: A way to see pageviews statistics on a geographical regional level - https://phabricator.wikimedia.org/T333718#10435373 (10Ottomata) [21:47:19] 06Data-Engineering, 10Data-Engineering-Wikistats, 07Russian-Sites: "Active editors by country" doesn't display numbers for Belarus, Kazakhstan, Russia - https://phabricator.wikimedia.org/T333716#10435375 (10Ottomata) [21:47:23] 06Data-Engineering, 10MediaWiki-extensions-EventLogging, 10Metrics Platform: Determine what UserBucketService::getUserEditCountBucket should return for anons - https://phabricator.wikimedia.org/T329292#10435377 (10Ottomata) [21:47:26] 06Data-Engineering, 10Pageviews-API: Provide a mechanism to notify subscribers when page view data is available - https://phabricator.wikimedia.org/T326229#10435379 (10Ottomata) [21:47:31] 06Data-Engineering, 10Data-Engineering-Wikistats: User stats page - https://phabricator.wikimedia.org/T324993#10435381 (10Ottomata) [21:47:36] 06Data-Engineering, 10Data-Engineering-Wikistats: Number of anonymous edits - https://phabricator.wikimedia.org/T323562#10435383 (10Ottomata) [21:47:47] 06Data-Engineering, 10Data-Engineering-Wikistats: Make it clear that WiViVi data is outdated - https://phabricator.wikimedia.org/T306478#10435387 (10Ottomata) [21:47:49] 06Data-Engineering, 10MediaWiki-extensions-EventLogging, 10Metrics Platform, 13Patch-Needs-Improvement: Deprecate/delete the mw.eventLog.Schema class - https://phabricator.wikimedia.org/T305491#10435389 (10Ottomata) [21:47:50] 06Data-Engineering, 10Data-Engineering-Wikistats, 10Data Pipelines, 06LPL Technical Support, and 2 others: Merge ks-Arab and ks-Deva to ks - https://phabricator.wikimedia.org/T314476#10435385 (10Ottomata) [21:47:51] 06Data-Engineering, 10Data-Engineering-Wikistats: Feature requests for Active Editors by Country - https://phabricator.wikimedia.org/T304720#10435390 (10Ottomata) [21:47:55] 06Data-Engineering, 10Data-Engineering-Wikistats: Change state to store project as an array - https://phabricator.wikimedia.org/T283624#10435395 (10Ottomata) [21:47:56] 06Data-Engineering, 14Data-Engineering-Kanban, 10Data-Engineering-Wikistats, 06Product-Analytics: Wikistats reports no mobile unique devices for Wikidata and MediaWiki.org - https://phabricator.wikimedia.org/T299559#10435394 (10Ottomata) [21:48:00] 06Data-Engineering, 06Growth-Team, 10GrowthExperiments, 10MediaWiki-extensions-EventLogging, and 2 others: Create a test for end-to-end event logging data verification of happy path with Special:Homepage and suggested edits - https://phabricator.wikimedia.org/T301463#10435393 (10Ottomata) [21:48:08] 06Data-Engineering, 10Data-Engineering-Wikistats, 07Epic: Add ability to compare wikis - https://phabricator.wikimedia.org/T283251#10435399 (10Ottomata) [21:48:12] 14Analytics-Radar, 06Data-Engineering, 10Data-Engineering-Wikistats: Negative total number of bytes for German Wikipedia in 2001? - https://phabricator.wikimedia.org/T203906#10435402 (10Ottomata) [21:48:16] 06Data-Engineering, 10Data-Engineering-Wikistats: Automate creation of sqoop list of wikis to import data for from sitematrix - https://phabricator.wikimedia.org/T190700#10435405 (10Ottomata) [21:48:22] 14Analytics-Radar, 06Data-Engineering, 10Data-Engineering-Wikistats: WiViVi: Per-person should account for connected percentage? - https://phabricator.wikimedia.org/T172335#10435406 (10Ottomata) [21:48:26] 14Analytics-Radar, 06Data-Engineering, 10Pageviews-API, 10RESTBase-API, and 2 others: views error in mostread feed - https://phabricator.wikimedia.org/T267624#10435401 (10Ottomata) [21:48:30] 14Analytics-Radar, 06Data-Engineering, 10GLAM-Tech, 10Pageviews-API: WMF pageview API (404 error) when requesting statistics over around 1000 files on GLAMorgan - https://phabricator.wikimedia.org/T145197#10435409 (10Ottomata) [21:48:34] 06Data-Engineering, 10MediaWiki-extensions-EventLogging, 10MediaWiki-General, 07Performance Issue: Add event tracking queue to MediaWiki core for loose coupling with EventLogging or other interested consumers - https://phabricator.wikimedia.org/T95356#10435411 (10Ottomata) [21:48:40] 06Data-Engineering, 10Data-Engineering-Wikistats: Wikistats returns a blank page when switching language to Icelandic - https://phabricator.wikimedia.org/T338466#10435416 (10Ottomata) [21:48:49] 06Data-Engineering, 10Event-Platform: [EventGate] Failures when getting stream config from MediaWiki API - https://phabricator.wikimedia.org/T286793#10435420 (10Ottomata) [21:48:53] 06Data-Engineering, 06Product-Analytics, 10Wmfdata-Python: Set up Wmfdata-Python integration test suite to run automatically - https://phabricator.wikimedia.org/T304547#10435423 (10Ottomata) [21:48:57] 06Data-Engineering, 10Data-Engineering-Wikistats: Define reduce calculations needed to compute active editors per project family - https://phabricator.wikimedia.org/T249751#10435422 (10Ottomata) [21:49:01] 14Analytics-Radar, 06Data-Engineering, 10MediaWiki-extensions-EventLogging: SearchSatisfaction has validation errors for event.query - https://phabricator.wikimedia.org/T257331#10435421 (10Ottomata) [21:49:11] 06Data-Engineering, 10Data-Engineering-Wikistats: Confusing filtering on "Active editors by country" topic - https://phabricator.wikimedia.org/T300365#10435429 (10Ottomata) [21:49:15] 06Data-Engineering, 06Movement-Insights, 10Wmfdata-Python, 07Documentation: Publish HTML docs for Wmfdata-Python on doc.wikimedia.org - https://phabricator.wikimedia.org/T298178#10435430 (10Ottomata) [21:49:19] 06Data-Engineering, 10Data-Engineering-Wikistats, 13Patch-Needs-Improvement: Expand Wikiselector to allow more than one wiki - https://phabricator.wikimedia.org/T285050#10435436 (10Ottomata) [21:49:23] 06Data-Engineering, 10Data-Engineering-Wikistats: Offer map and queries by subdivisions of countries - https://phabricator.wikimedia.org/T284294#10435438 (10Ottomata) [21:49:33] 14Analytics, 06Data-Engineering, 10EventStreams, 10Wikidata, and 3 others: [EPIC] Expose rdf-streaming-updater.mutation content through EventStreams - https://phabricator.wikimedia.org/T294133#10435433 (10Ottomata) [21:49:37] 06Data-Engineering, 10Data-Engineering-Wikistats: Regional and group evaluations - https://phabricator.wikimedia.org/T264512#10435441 (10Ottomata) [21:49:41] 06Data-Engineering, 10Data-Engineering-Wikistats: Wikistats should allow more than one project - https://phabricator.wikimedia.org/T283254#10435440 (10Ottomata) [21:49:45] 06Data-Engineering, 10Data-Engineering-Wikistats, 06Commons: Creating tools for compiling list of Wikimedia Commons users by contributions/uploads - https://phabricator.wikimedia.org/T263377#10435444 (10Ottomata) [21:49:51] 06Data-Engineering, 10Data-Engineering-Wikistats: Country pageview breakdown by language - https://phabricator.wikimedia.org/T250001#10435447 (10Ottomata) [21:49:55] 06Data-Engineering, 10Data-Engineering-Jupyter, 10CAS-SSO, 06Data-Platform-SRE, 07Epic: Improve the JupyterHub services and use CAS/SSO - https://phabricator.wikimedia.org/T260386#10435446 (10Ottomata) [21:50:03] 06Data-Engineering, 10Data-Engineering-Wikistats, 10Technical-Tool-Request: Ranked list of all Wikipedias by yearly readership growth - https://phabricator.wikimedia.org/T224963#10435448 (10Ottomata) [21:50:07] 14Analytics-Radar, 06Data-Engineering, 10Pageviews-API, 10Tool-Pageviews: 429 Too Many Requests hit despite throttling to 100 req/sec - https://phabricator.wikimedia.org/T219857#10435452 (10Ottomata) [21:50:13] 06Data-Engineering, 10Pageviews-API: Endpoint for average view rate in Pageview API - https://phabricator.wikimedia.org/T162933#10435455 (10Ottomata) [21:50:17] 14Analytics-Radar, 06Data-Engineering, 10MediaWiki-extensions-EventLogging, 07Epic: Explore an API for logging events sampled by session - https://phabricator.wikimedia.org/T168380#10435456 (10Ottomata) [21:50:25] 06Data-Engineering, 10Data-Engineering-Wikistats: Link uploads reportcard from binaries stats - https://phabricator.wikimedia.org/T62391#10435461 (10Ottomata) [21:50:29] 06Data-Engineering, 10Pageviews-API: Provide weekly top pageviews stats - https://phabricator.wikimedia.org/T133575#10435460 (10Ottomata) [21:50:33] 06Data-Engineering, 10Data-Engineering-Wikistats: stats.wikimedia.org needs options to see exact counts and dates - https://phabricator.wikimedia.org/T37150#10435464 (10Ottomata) [21:50:37] 06Data-Engineering, 06Product-Analytics, 10Wmfdata-Python: PyHive ignores SET statements with a leading newline - https://phabricator.wikimedia.org/T334442#10435466 (10Ottomata) [21:50:41] 06Data-Engineering, 06Product-Analytics, 10Wmfdata-Python: Support querying a range of hourly data partitions - https://phabricator.wikimedia.org/T294654#10435472 (10Ottomata) [21:50:45] 06Data-Engineering, 10Data-Engineering-Jupyter, 06Data-Platform-SRE, 06Product-Analytics: Remove anaconda-wmf package from the cluster - https://phabricator.wikimedia.org/T337963#10435467 (10Ottomata) [21:50:51] 06Data-Engineering, 10Data-Engineering-Wikistats, 10Movement-Metrics: Support including edits to deleted pages in editing metrics - https://phabricator.wikimedia.org/T295212#10435470 (10Ottomata) [21:50:55] 06Data-Engineering, 06Product-Analytics, 10Wmfdata-Python: Decide whether and how to consolidate Wmfdata-Python and Refinery's Python modules - https://phabricator.wikimedia.org/T293700#10435474 (10Ottomata) [21:50:59] 06Data-Engineering, 06Product-Analytics, 10Wmfdata-Python: Update all run functions to allow specifying date and index columns - https://phabricator.wikimedia.org/T273208#10435479 (10Ottomata) [21:51:03] 06Data-Engineering, 06Product-Analytics, 10Wmfdata-Python: Update all Wmfdata-Python run functions to have consistent API - https://phabricator.wikimedia.org/T273197#10435480 (10Ottomata) [21:51:07] 06Data-Engineering, 06Product-Analytics, 10Wmfdata-Python: Add utility functions for converting between various time formats - https://phabricator.wikimedia.org/T273209#10435478 (10Ottomata) [21:51:11] 14Analytics-Kanban, 06Data-Engineering, 06Product-Analytics, 10Wmfdata-Python: wmfdata.mariadb relies on analytics-mysql being available - https://phabricator.wikimedia.org/T292479#10435476 (10Ottomata) [21:51:15] 06Data-Engineering, 06Product-Analytics, 10Wmfdata-Python: Support importing a Parquet file into HDFS using wmfdata-python - https://phabricator.wikimedia.org/T273196#10435484 (10Ottomata) [21:51:20] 06Data-Engineering, 06Product-Analytics, 10Wmfdata-Python: wmfdata should display more progress information and metadata when running a query - https://phabricator.wikimedia.org/T259808#10435485 (10Ottomata) [21:51:24] 06Data-Engineering, 06Product-Analytics, 10Wmfdata-Python: Code toggle should remove standard error and center all output - https://phabricator.wikimedia.org/T247442#10435490 (10Ottomata) [21:51:28] 06Data-Engineering, 10Data-Engineering-Wikistats: "Page views by edition of Wikipedia" for each country - https://phabricator.wikimedia.org/T257071#10435486 (10Ottomata) [21:51:32] 06Data-Engineering, 10Data-Engineering-Wikistats: Add "Top used photos" metric - https://phabricator.wikimedia.org/T220485#10435493 (10Ottomata) [21:51:36] 06Data-Engineering, 10Data-Engineering-Wikistats: [Wikistats] The permanent link is broken - https://phabricator.wikimedia.org/T245445#10435492 (10Ottomata) [21:51:40] 14Analytics, 06Data-Engineering, 10Pageviews-API: Filter top pages by namespace/category - https://phabricator.wikimedia.org/T182975#10435497 (10Ottomata) [21:51:44] 14Analytics, 06Data-Engineering, 10MediaWiki-Action-API, 10PageViewInfo, 10Pageviews-API: API Analytics - page views by country - https://phabricator.wikimedia.org/T213221#10435496 (10Ottomata) [21:51:50] 06Data-Engineering, 10Data-Engineering-Wikistats: Render Wikistats graphs server-side, so that they can be embedded on-wikis - https://phabricator.wikimedia.org/T178016#10435500 (10Ottomata) [21:51:54] 06Data-Engineering, 10Data-Engineering-Jupyter, 06Product-Analytics: Functionality to share & view notebooks - https://phabricator.wikimedia.org/T156934#10435502 (10Ottomata) [21:51:58] 14Analytics, 06Data-Engineering, 10Pageviews-API: Adding top counts for wiki projects (ex: WikiProject:Medicine) to pageview API - https://phabricator.wikimedia.org/T141010#10435505 (10Ottomata) [21:52:02] 14Analytics, 06Data-Engineering, 10Pageviews-API: Yearly endpoint for the /pageviews/top API - https://phabricator.wikimedia.org/T154381#10435504 (10Ottomata) [21:52:06] 06Data-Engineering, 10Data-Engineering-Wikistats: Determine total number of external links in all Wikipedias - https://phabricator.wikimedia.org/T137984#10435508 (10Ottomata) [21:52:10] 06Data-Engineering, 10Data-Engineering-Wikistats: for all namespaces show page count without redirects - https://phabricator.wikimedia.org/T71743#10435510 (10Ottomata) [21:52:14] 06Data-Engineering, 10Data-Engineering-Wikistats: One column header in browsers per country report only contains '---' - https://phabricator.wikimedia.org/T73127#10435511 (10Ottomata) [21:52:18] 06Data-Engineering, 10Data-Engineering-Wikistats: add talk pages count to project statistics - https://phabricator.wikimedia.org/T71742#10435514 (10Ottomata) [21:52:22] 06Data-Engineering, 10Data-Engineering-Wikistats: Views/hr column in WikiStats should consider an average on several months - https://phabricator.wikimedia.org/T37194#10435516 (10Ottomata) [21:57:38] 06Data-Engineering: Public DataHub - https://phabricator.wikimedia.org/T366720#10435534 (10Ottomata) [22:23:58] 06Data-Engineering, 10Data-Engineering-Dashiki, 06Data-Engineering-Radar, 10Experimentation Lab Roadmap, and 2 others: Data Platform - Public dashboard support - https://phabricator.wikimedia.org/T361214#10435572 (10VirginiaPoundstone) [22:24:08] 06Data-Engineering-Icebox, 10Experimentation Lab Roadmap, 07Epic, 10Experimentation Lab (Epics Timeline): Bot Detection - https://phabricator.wikimedia.org/T321707#10435577 (10VirginiaPoundstone) [22:24:16] 06Data-Engineering, 10Experimentation Lab Roadmap, 10MediaWiki-extensions-EventLogging, 07Epic, 10Experimentation Lab (Epics Timeline): [EPIC] Deprecate mw.eventLog.logEvent() - https://phabricator.wikimedia.org/T317874#10435579 (10VirginiaPoundstone) [22:24:26] 06Data-Engineering, 10Experimentation Lab Roadmap, 10MediaWiki-extensions-EventLogging, 07Epic, 10Experimentation Lab (Epics Timeline): [EPIC] Deprecate EventLogging::schemaValidate() - https://phabricator.wikimedia.org/T317793#10435580 (10VirginiaPoundstone) [22:24:40] 06Data-Engineering, 10Experimentation Lab Roadmap, 06Growth-Team, 10MediaWiki-extensions-EventLogging, and 4 others: [EPIC] Deprecate EventLogging::logEvent() - https://phabricator.wikimedia.org/T318263#10435578 (10VirginiaPoundstone) [22:28:52] 06Data-Engineering, 06Experimentation Lab, 10Experimentation Lab Roadmap, 10MediaWiki-extensions-EventLogging, 07Epic: [EPIC] Deprecate EventLogging::schemaValidate() - https://phabricator.wikimedia.org/T317793#10435605 (10VirginiaPoundstone) [22:28:55] 06Data-Engineering, 06Experimentation Lab, 10Experimentation Lab Roadmap, 10MediaWiki-extensions-EventLogging, 07Epic: [EPIC] Deprecate mw.eventLog.logEvent() - https://phabricator.wikimedia.org/T317874#10435607 (10VirginiaPoundstone) [22:29:06] 06Data-Engineering, 06Experimentation Lab, 10Experimentation Lab Roadmap, 06Growth-Team, and 4 others: [EPIC] Deprecate EventLogging::logEvent() - https://phabricator.wikimedia.org/T318263#10435609 (10VirginiaPoundstone) [22:29:09] 06Data-Engineering, 10Data-Engineering-Dashiki, 06Data-Engineering-Radar, 06Experimentation Lab, and 2 others: Data Platform - Public dashboard support - https://phabricator.wikimedia.org/T361214#10435615 (10VirginiaPoundstone) [22:29:14] 06Data-Engineering-Icebox, 06Experimentation Lab, 10Experimentation Lab Roadmap, 07Epic: Bot Detection - https://phabricator.wikimedia.org/T321707#10435617 (10VirginiaPoundstone)