[02:21:25] 06Data-Engineering, 06Data-Engineering-Radar, 06Commons, 06Data-Persistence, and 5 others: Migrate file tables to a modern layout (image/oldimage; file/filerevision; add primary keys) - https://phabricator.wikimedia.org/T28741#12048780 (10AlexisJazz) [03:59:07] 06Data-Engineering: dbt-jobs backfill: all base models for moderator actions - https://phabricator.wikimedia.org/T429995#12048822 (10CMyrick-WMF) [04:32:19] 06Data-Engineering, 06Data-Engineering-Radar, 06Data-Platform-SRE (2026-06-05 - 2026-06-26), 10Event-Platform: Delete some unused development topics on Kafka Jumbo - https://phabricator.wikimedia.org/T427951#12048828 (10RKemper) >>! In T427951#12045750, @AKhatun_WMF wrote: > @RKemper we can go ahead with y... [08:26:12] 06Data-Engineering: Setup and populate initial version of user_agents_info table - https://phabricator.wikimedia.org/T430020 (10KCVelaga_WMF) 03NEW [08:28:32] 06Data-Engineering, 06Data-Engineering-Radar, 06Data-Platform-SRE, 10superset.wikimedia.org, 07Essential-Work: Thanos / Prometheus metrics names with uppercase characters not accessible from Superset SQL Lab or Presto CLI - https://phabricator.wikimedia.org/T409874#12049219 (10BTullis) A [[https://github... [09:17:35] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 10DPE-MediaWiki-Incremental-History: Right-size Spark resource config using History Server data - https://phabricator.wikimedia.org/T428966#12049345 (10APizzata-WMF) [11:33:26] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st): Classify requests to developer.wikimedia.org as pageviews - https://phabricator.wikimedia.org/T428550#12049834 (10KCVelaga_WMF) This will make it much easier to calculate the required metrics downstream, rather than aggregating from webrequest. Thanks for pr... [11:42:49] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 10DPE-MediaWiki-Incremental-History: Right-size Spark resource config using History Server data - https://phabricator.wikimedia.org/T428966#12049847 (10APizzata-WMF) By checking the links: - https://yarn.wikimedia.org/spark-history/api/v1/applications/... [12:24:15] FIRING: HdfsRpcQueueLength: RPC queue length on the analytics-hadoop cluster is too high. - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Hadoop/Alerts#HDFS_Namenode_RPC_length_queue/latency - https://grafana.wikimedia.org/d/000000585/hadoop?var-hadoop_cluster=analytics-hadoop&orgId=1&panelId=54&fullscreen - https://alerts.wikimedia.org/?q=alertname%3DHdfsRpcQueueLength [12:25:15] FIRING: HdfsRpcQueueLatency: RPC queue latency on the analytics-hadoop cluster is too high. - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Hadoop/Alerts#HDFS_Namenode_RPC_length_queue/latency - https://grafana.wikimedia.org/d/000000585/hadoop?var-hadoop_cluster=analytics-hadoop&orgId=1&panelId=56&fullscreen - https://alerts.wikimedia.org/?q=alertname%3DHdfsRpcQueueLatency [12:34:15] RESOLVED: HdfsRpcQueueLength: RPC queue length on the analytics-hadoop cluster is too high. - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Hadoop/Alerts#HDFS_Namenode_RPC_length_queue/latency - https://grafana.wikimedia.org/d/000000585/hadoop?var-hadoop_cluster=analytics-hadoop&orgId=1&panelId=54&fullscreen - https://alerts.wikimedia.org/?q=alertname%3DHdfsRpcQueueLength [12:35:45] RESOLVED: HdfsRpcQueueLatency: RPC queue latency on the analytics-hadoop cluster is too high. - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Hadoop/Alerts#HDFS_Namenode_RPC_length_queue/latency - https://grafana.wikimedia.org/d/000000585/hadoop?var-hadoop_cluster=analytics-hadoop&orgId=1&panelId=56&fullscreen - https://alerts.wikimedia.org/?q=alertname%3DHdfsRpcQueueLatency [14:21:51] 06Data-Engineering: Operationalize dbt models for monthly Moderators and UWERs metrics - https://phabricator.wikimedia.org/T429997#12050685 (10CMyrick-WMF) [15:31:03] 06Data-Engineering: Setup and populate initial version of user_agents_info table - https://phabricator.wikimedia.org/T430020#12050959 (10JAllemandou) Instead of a `map` as in `webrequest`, let's use a `struct` to store parsed user agent data. I'd also add some statistics in this table: how many rows seen for th... [15:39:09] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 06Traffic, 13Patch-For-Review: Surge in webrequest validation check - https://phabricator.wikimedia.org/T422030#12050997 (10Snwachukwu) We've been getting Data problem ERROR and Data problem WARNINGS alerts. The alerts could be as a result of bad request... [16:03:01] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 10DPE-MediaWiki-Incremental-History: Right-size Spark resource config using History Server data - https://phabricator.wikimedia.org/T428966#12051132 (10APizzata-WMF) By discussing with @JAllemandou we decided to test: - 20 GB memory with 0 overhead - 3 cor... [16:28:10] 06Data-Engineering: Operationalize dbt jobs: all moderator models - https://phabricator.wikimedia.org/T429997#12051189 (10CMyrick-WMF) [16:33:17] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st): dbt-jobs backfill: all base models for moderator actions - https://phabricator.wikimedia.org/T429995#12051230 (10Ahoelzl) p:05Triage→03High [16:33:28] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st): Operationalize dbt jobs: all moderator models - https://phabricator.wikimedia.org/T429997#12051232 (10Ahoelzl) p:05Triage→03High [16:47:48] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 10PageViewInfo, 06ServiceOps new, 10ServiceOps-SharedInfra, 05MW-1.47-notes (1.47.0-wmf.7; 2026-06-16): Migrate PageViewInfo calls away from rest-gateway - https://phabricator.wikimedia.org/T411771#12051290 (10Clement_Goubert) 05Stalled→03Reso... [16:58:47] !log Test Kitchen experiment (poll 44076) - adds: logged-out-retention-round17; removes: none; fields: none - TK tips at https://w.wiki/_cvdP [16:58:52] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [17:05:37] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 06Product-Analytics: dbt-jobs backfill: PP3 API hourly and known clients aggregate jobs - https://phabricator.wikimedia.org/T429341#12051409 (10amastilovic) Running the backfill for `wmf_traffic.responsible_traffic_pathways_daily` Feb 2026 and Mar 2026... [18:19:12] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 10MediaWiki-REST-API, 10Tool-wikimedia-attribution, 06MW-Interfaces-Team (MWI-Sprint-36 (2026-06-16 to 2026-06-30)): Check Editor Counts - https://phabricator.wikimedia.org/T427548#12051707 (10pmiazga) 05Open→03Resolved Ok, so I did some testin... [19:13:22] 06Data-Engineering, 06Data-Engineering-Radar, 06Data-Platform-SRE (2026-06-05 - 2026-06-26), 10Event-Platform: Delete some unused development topics on Kafka Jumbo - https://phabricator.wikimedia.org/T427951#12051854 (10RKemper) Update: @AKhatun_WMF and I paired today and suspended the v1 enrichment job, d... [20:31:09] 06Data-Engineering, 06Data-Engineering-Radar, 06Data-Platform-SRE (2026-06-05 - 2026-06-26), 10Event-Platform: Delete some unused development topics on Kafka Jumbo - https://phabricator.wikimedia.org/T427951#12051966 (10RKemper) 05Open→03Resolved >>! In T427951#12051853, @RKemper wrote: > Update: @...