[01:45:46] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st): Increase wait time of webrequest_actor_metrics_hourly sensor task before it fails - https://phabricator.wikimedia.org/T430247 (10Snwachukwu) 03NEW [01:52:50] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st): Ops Week: Increase wait time of webrequest_actor_metrics_hourly sensor task before it fails - https://phabricator.wikimedia.org/T430247#12057307 (10Snwachukwu) [01:57:39] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st): Move_to_archive task fails without logs - https://phabricator.wikimedia.org/T430248 (10Snwachukwu) 03NEW [08:14:47] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 06Product-Analytics: dbt-jobs backfill: PP3 API hourly and known clients aggregate jobs - https://phabricator.wikimedia.org/T429341#12057879 (10amastilovic) @Ahoelzl I think it will, the big and slow jobs are up to 2026-05-18 today so they should be done b... [08:28:36] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): Create an airflow-dags unit test to validate `datasets.yaml` - https://phabricator.wikimedia.org/T430271 (10amastilovic) 03NEW [08:36:23] (03PS1) 10Aqu: Add GSC site/url impression Hive tables [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1305857 (https://phabricator.wikimedia.org/T427457) [08:51:16] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 06Traffic: Add X-Provenance data to webrequest_sampled_live - https://phabricator.wikimedia.org/T427068#12058109 (10Fabfur) >>! In T427068#12034446, @JAllemandou wrote: > I have checked the kafka streams, the new field is present in both `webrequest_fronte... [08:56:37] 10Data-Engineering-Roadmap, 07Epic: [Epic] KAPOW: The next generation of bot detection in the Data Platform. - https://phabricator.wikimedia.org/T425661#12058134 (10GGoncalves-WMF) If I did it right, the more sensitive tickets are restricted to the [[ https://phabricator.wikimedia.org/tag/wmf-nda/ | WMF-NDA ]]... [09:18:57] 06Data-Engineering: Setup and populate initial version of user_agents_info table - https://phabricator.wikimedia.org/T430020#12058205 (10KCVelaga_WMF) > Are we going to store only bot-like User-Agents or all of them? Maybe, since we can not extract contact/agent/policy information from them and they are also not... [10:09:21] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 06MW-Interfaces-Team, 10Event-Platform: EventBus JobQueue: Invalid mediawiki signature error caused by meta.dt field - https://phabricator.wikimedia.org/T418573#12058422 (10daniel) >>! In T418573#12056018, @Ottomata wrote: > I see. Lots of context in {T1... [10:13:20] 06Data-Engineering, 10DPE-MediaWiki-Incremental-History, 06MW-Interfaces-Team: MediaWiki DomainEvents - Include LogEntry - https://phabricator.wikimedia.org/T427815#12058432 (10daniel) The big conceptual question is: is the log driven by events, or does logging emit events? I was originally trying to make it... [10:17:13] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 10Event-Platform, 13Patch-For-Review: Relative Trending - Milestone 3 - K8s recoures - https://phabricator.wikimedia.org/T430136#12058464 (10BTullis) [10:23:59] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 06Data-Platform-SRE (2026-06-05 - 2026-06-26), 13Patch-For-Review: Presto cluster improvements for concurrency and workload - https://phabricator.wikimedia.org/T424112#12058521 (10BTullis) This is now deployed and working as configured. We decided to pe... [10:52:00] (03PS7) 10Aqu: Add globalimagelinks table to sqoop [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1295064 (https://phabricator.wikimedia.org/T427532) (owner: 10Dr0ptp4kt) [10:52:43] (03CR) 10Aqu: [C:03+2] Add globalimagelinks table to sqoop [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1295064 (https://phabricator.wikimedia.org/T427532) (owner: 10Dr0ptp4kt) [10:52:46] (03CR) 10Aqu: [V:03+2 C:03+2] Add globalimagelinks table to sqoop [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1295064 (https://phabricator.wikimedia.org/T427532) (owner: 10Dr0ptp4kt) [10:55:53] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 10Event-Platform: Relative Trending - Milestone 3 - K8s recoures - https://phabricator.wikimedia.org/T430136#12058657 (10BTullis) [10:58:13] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 10Event-Platform: Relative Trending - Milestone 3 - K8s recoures - https://phabricator.wikimedia.org/T430136#12058668 (10BTullis) The first two of these have now been created and deployed, so we have k8s namespaces and credentials to access them. ` btullis... [11:17:57] 06Data-Engineering, 10Dumps-Generation, 10Wikidata, 06Data-Platform-SRE (2026-06-05 - 2026-06-26): Wikidata full .json.gz dumps not published since 20250625 - https://phabricator.wikimedia.org/T412428#12058733 (10BTullis) 05Open→03Resolved a:03BTullis I think that these dumps are still running, s... [12:03:17] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 06Data-Platform-SRE (2026-06-05 - 2026-06-26), 13Patch-For-Review: Presto cluster improvements for concurrency and workload - https://phabricator.wikimedia.org/T424112#12058903 (10BTullis) 05Open→03Resolved I added some information on our initial... [14:13:32] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 07Epic: EPIC: DYK Archive - https://phabricator.wikimedia.org/T430319 (10Snwachukwu) 03NEW [14:15:34] 06Data-Engineering, 10Data-Engineering-Dashiki, 10FR-Adyen, 10FR-payments-general, and 2 others: Move Native Google Pay & Apply Pay from Adyen to Gravy - https://phabricator.wikimedia.org/T430320 (10SBurnett-WMF) 03NEW [14:26:42] 06Data-Engineering, 10Test Kitchen, 10Event-Platform: [EventGate] Record metrics for instruments and experiments - https://phabricator.wikimedia.org/T430322 (10phuedx) 03NEW [14:30:01] !log Test Kitchen experiment (poll 60358) - adds: none; removes: logged-out-retention-round14; fields: none - TK tips at https://w.wiki/_cvdP [14:30:04] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [14:49:49] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 06Traffic: Tune refine webrequest data loss threshold to avoid noisy irrelevant alerts. - https://phabricator.wikimedia.org/T429809#12059550 (10Snwachukwu) [14:53:47] 06Data-Engineering, 06Data-Platform-SRE (2026-06-05 - 2026-06-26): Enable Ceph S3 locations for Hive Metastore tables - https://phabricator.wikimedia.org/T425673#12059582 (10BTullis) >>! In T425673#11936285, @fkaelin wrote: > Thanks for the update, can we link to the phab for the security model? That work is... [15:00:09] 06Data-Engineering, 06Data-Engineering-Radar, 07Essential-Work: Do performance testing of a big Hadoop Table hosted by Ceph - https://phabricator.wikimedia.org/T381416#12059636 (10BTullis) a:05BTullis→03None Moving back to the parent board and unassigning myself, since we now have two enabling tasks that... [15:00:42] 06Data-Engineering, 10Data-Engineering-Dashiki, 10FR-Adyen, 10FR-payments-general, and 2 others: Move Native Google Pay & Apply Pay from Adyen to Gravy - https://phabricator.wikimedia.org/T430320#12059645 (10Cstone) →14Duplicate dup:03T392259 [15:01:42] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st): dbt-jobs backfill: all base models for moderator actions - https://phabricator.wikimedia.org/T429995#12059653 (10amastilovic) I have started all backfills except for ` backfill 2020-07-01 through 2026-05-31 (inclusive) base_moderator_actions.sql ` I expect... [15:09:26] 06Data-Engineering, 06Data-Engineering-Radar, 06Data-Platform-SRE, 07Essential-Work: Do performance testing of a big Hadoop Table hosted by Ceph - https://phabricator.wikimedia.org/T381416#12059666 (10BTullis) [18:26:35] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st): dbt-jobs backfill: all base models for moderator actions - https://phabricator.wikimedia.org/T429995#12060393 (10amastilovic) Status update: [] backfill 2020-07-01 through 2026-05-31 (inclusive) ` base_moderator_actions_checkuser.sql base_moderator_actions_... [20:45:40] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 06MW-Interfaces-Team, 10Event-Platform: EventBus JobQueue: Invalid mediawiki signature error caused by meta.dt field - https://phabricator.wikimedia.org/T418573#12060674 (10Ottomata) > EventBodyValidator checks it if it's there... what would make it unus... [21:25:12] (03PS1) 10Dr0ptp4kt: Remove apiportal from allowlist post decom [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1305980 (https://phabricator.wikimedia.org/T430366) [21:34:11] (03CR) 10Ahoelzl: [C:03+1] Remove apiportal from allowlist post decom [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1305980 (https://phabricator.wikimedia.org/T430366) (owner: 10Dr0ptp4kt)