[03:22:30] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): Load Google Search Console data from BigQuery as soon as it's available and reload when data corrections occur - https://phabricator.wikimedia.org/T436193#12273525 (10nshahquinn-wmf) >>! In T436193#12273311, @Ahoelzl wrote: > @nshahquinn-wmf would it mak... [07:24:32] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 06Traffic: Turnilo: X-Is-Browser filter doesn't work (always HTTP 500) - https://phabricator.wikimedia.org/T435152#12274079 (10JAllemandou) Ok, applying the same new field to the main turnilo config. Thanks @CDanis . [07:53:29] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 06Traffic: Turnilo: X-Is-Browser filter doesn't work (always HTTP 500) - https://phabricator.wikimedia.org/T435152#12274164 (10JAllemandou) Actually I didn't realize but my patch changed the conf for both turnilo-next and turnilo. I just applied the he... [11:57:40] 06Data-Engineering, 06Data-Engineering-Radar, 06MediaWiki-API-Platform-Team (MediaWiki-Interfaces-Sprints), 07OKR-Work: REST API vNext: Create dedicated REST shared-schema repository - https://phabricator.wikimedia.org/T432799#12275126 (10AGhirelli-WMF) a:03AGhirelli-WMF [12:33:11] (03CR) 10A-pizzata: [C:03+1] "just a small bit, but LGTM! I like this approach" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1332814 (https://phabricator.wikimedia.org/T431872) (owner: 10Xcollazo) [13:18:01] (03CR) 10Joal: [V:03+2 C:03+2] "Merging for deploy" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1328608 (https://phabricator.wikimedia.org/T435634) (owner: 10Ladsgroup) [13:28:15] (03PS2) 10Xcollazo: File Export: HQL for point-in-time snapshot of mediawiki content [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1332814 (https://phabricator.wikimedia.org/T431872) [13:29:28] (03CR) 10Xcollazo: "@apizzata@wikimedia.org on latest patchset, I've also renamed the file to make it clear it is both create and compute in one file." [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1332814 (https://phabricator.wikimedia.org/T431872) (owner: 10Xcollazo) [13:29:43] (03CR) 10Xcollazo: File Export: HQL for point-in-time snapshot of mediawiki content (031 comment) [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1332814 (https://phabricator.wikimedia.org/T431872) (owner: 10Xcollazo) [13:34:26] (03CR) 10A-pizzata: [C:03+2] File Export: HQL for point-in-time snapshot of mediawiki content [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1332814 (https://phabricator.wikimedia.org/T431872) (owner: 10Xcollazo) [13:46:14] (03CR) 10Xcollazo: [V:03+2] File Export: HQL for point-in-time snapshot of mediawiki content [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1332814 (https://phabricator.wikimedia.org/T431872) (owner: 10Xcollazo) [13:52:30] 06Data-Engineering, 07Documentation: Create Article Feature Counts Wikitech page - https://phabricator.wikimedia.org/T436653#12275677 (10Aklapper) [14:29:01] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): Exclude %test% wikis from grouped_wikis.csv - https://phabricator.wikimedia.org/T436658 (10Milimetric) 03NEW [14:30:30] (03PS1) 10Milimetric: Remove %test% from sqoop list [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1333219 (https://phabricator.wikimedia.org/T436658) [14:54:01] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10Dumps-Generation, 13Patch-For-Review: mediawiki_content_current exports silently omit all pages edited between the snapshot cutoff and dump generation time - https://phabricator.wikimedia.org/T431872#12276007 (10xcollazo) Exports had just started s... [14:57:51] (03CR) 10Milimetric: "I manually removed all the %test% records from ingestion_wikis with an insert overwrite." [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1333219 (https://phabricator.wikimedia.org/T436658) (owner: 10Milimetric) [14:58:54] (03PS2) 10Milimetric: Remove %test% from sqoop list [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1333219 (https://phabricator.wikimedia.org/T436658) [15:19:00] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): ST6.3.2 page_change.v1 SLO - https://phabricator.wikimedia.org/T436664 (10APizzata-WMF) 03NEW [15:31:42] 06Data-Engineering, 10Dumps-Generation, 07Wikimedia-production-error: dumpBackup.php causes PHP warning: foreach() argument must be of type array|object, null given - https://phabricator.wikimedia.org/T436666 (10Dreamy_Jazz) 03NEW [15:32:15] 06Data-Engineering, 10Dumps-Generation, 07Wikimedia-production-error: dumpBackup.php causes PHP warning: foreach() argument must be of type array|object, null given - https://phabricator.wikimedia.org/T436666#12276240 (10Dreamy_Jazz) Causing 11,000 PHP warnings per 15 minutes [15:33:09] 06Data-Engineering, 10Dumps-Generation, 07Wikimedia-production-error: dumpBackup.php causes PHP warning: foreach() argument must be of type array|object, null given - https://phabricator.wikimedia.org/T436666#12276246 (10Dreamy_Jazz) →14Duplicate dup:03T436663 [15:37:56] (03PS1) 10Joal: Hotfix webrequest_sampled druid HQL [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1333241 (https://phabricator.wikimedia.org/T435634) [15:42:26] 06Data-Engineering, 06Data-Platform-SRE (2026-08-28 - 2026-09-18): dumps are generating 'PHP Warning: Undefined array key x4' errors - https://phabricator.wikimedia.org/T436663#12276335 (10Gehel) [15:49:37] (03PS2) 10Joal: Hotfix webrequest_sampled druid HQL [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1333241 (https://phabricator.wikimedia.org/T435634) [15:55:12] (03CR) 10Joal: [V:03+2 C:03+2] "Merging hotfix already deployed" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1333241 (https://phabricator.wikimedia.org/T435634) (owner: 10Joal) [16:11:06] 06Data-Engineering, 10Dumps-Generation, 06Data-Platform-SRE (2026-08-28 - 2026-09-18): dumps are generating 'PHP Warning: Undefined array key x4' errors - https://phabricator.wikimedia.org/T436663#12276531 (10Aklapper) [16:11:12] 06Data-Engineering, 10Dumps-Generation, 06Data-Platform-SRE (2026-08-28 - 2026-09-18), 07Wikimedia-production-error: dumps are generating 'PHP Warning: Undefined array key x4' errors - https://phabricator.wikimedia.org/T436663#12276532 (10Aklapper) [16:32:27] 06Data-Engineering, 10Dumps-Generation, 06Data-Platform-SRE (2026-08-28 - 2026-09-18), 07Wikimedia-production-error: dumps are generating 'PHP Warning: Undefined array key x4' errors - https://phabricator.wikimedia.org/T436663#12276683 (10dancy) I don't know if it's relevant or not but these errors are com... [16:36:57] 06Data-Engineering, 10Dumps-Generation, 06Data-Platform-SRE (2026-08-28 - 2026-09-18), 07Wikimedia-production-error: dumps are generating 'PHP Warning: Undefined array key x4' errors - https://phabricator.wikimedia.org/T436663#12276691 (10dancy) p:05High→03Unbreak! >>! In T436663#12276683, @dancy wrote... [16:52:29] 06Data-Engineering, 10Dumps-Generation, 06Data-Platform-SRE (2026-08-28 - 2026-09-18), 07Wikimedia-production-error: dumps are generating 'PHP Warning: Undefined array key x4' errors - https://phabricator.wikimedia.org/T436663#12276791 (10dancy) Just to clarify, this is currently impacting mediawiki deploy... [16:57:15] 06Data-Engineering, 10Dumps-Generation, 06Data-Platform-SRE (2026-08-28 - 2026-09-18), 07Wikimedia-production-error: dumps are generating 'PHP Warning: Undefined array key x4' errors - https://phabricator.wikimedia.org/T436663#12276803 (10dancy) [17:33:27] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10Dumps-Generation: mediawiki_content_current exports silently omit all pages edited between the snapshot cutoff and dump generation time - https://phabricator.wikimedia.org/T431872#12277048 (10xcollazo) Did the following in prod: 1) Paused both `medi... [17:36:22] 06Data-Engineering, 06Product-Analytics: Create a new database for WMF traffic related metrics - https://phabricator.wikimedia.org/T436678#12277060 (10KCVelaga_WMF) [18:21:35] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10Dumps-Generation: mediawiki_content_current exports silently omit all pages edited between the snapshot cutoff and dump generation time - https://phabricator.wikimedia.org/T431872#12277264 (10xcollazo) **Some details about the issue:** The `mediawiki... [18:28:25] 06Data-Engineering, 06Product-Analytics: Create a new database for WMF traffic related metrics - https://phabricator.wikimedia.org/T436678#12277276 (10KCVelaga_WMF) [18:29:00] 06Data-Engineering, 06Product-Analytics: Create a new database for WMF traffic related metrics - https://phabricator.wikimedia.org/T436678#12277283 (10KCVelaga_WMF) [18:44:02] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): Linked Artifact Cache - Automated MediaWiki JobQueue precompute - https://phabricator.wikimedia.org/T436695 (10Ottomata) 03NEW [18:46:26] 06Data-Engineering: Linked Artifact Cache - Automated MediaWiki JobQueue precompute - https://phabricator.wikimedia.org/T436695#12277364 (10Ottomata) [18:50:35] 14Analytics, 06Data-Engineering, 10Data-Engineering-Wikistats: Country per capita metrics in wikistats & Analytics API - https://phabricator.wikimedia.org/T424227#12277374 (10Kengkong1) a:03Kengkong1 [18:56:21] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): Move webrequest sequence statistics to a dashboard - https://phabricator.wikimedia.org/T436700 (10Milimetric) 03NEW [19:00:39] 06Data-Engineering: Requesting Kerberos access for kamila - https://phabricator.wikimedia.org/T436703 (10Raine) 03NEW [19:05:38] 06Data-Engineering: Requesting Kerberos access for kamila - https://phabricator.wikimedia.org/T436703#12277503 (10Raine) [19:06:08] 06Data-Engineering: Requesting Kerberos access for kamila - https://phabricator.wikimedia.org/T436703#12277506 (10Raine) @MLechvien-WMF as my manager, can you please approve this? [19:07:17] 06Data-Engineering, 10SRE-Access-Requests: Requesting Kerberos access for kamila - https://phabricator.wikimedia.org/T436703#12277508 (10Raine) Late-tagging this as an access request, as I realised also need group membership. [19:14:12] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 07Epic: DYK Archive: Write Design Doc - https://phabricator.wikimedia.org/T431102#12277523 (10Ottomata) [19:23:12] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 07Epic: data lake: server admin log (sal) - https://phabricator.wikimedia.org/T435417#12277565 (10Ottomata) > wikitext incremental parsing approach Sounds good. BTW, this is very similar to a recent request from Mobile Apps for a 'Did You Know Archive... [20:18:33] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 07Epic: Load Google Search Console social account impressions and clicks data into Data Lake - https://phabricator.wikimedia.org/T436710 (10Maryana) 03NEW [20:19:28] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): IR2.1.2d: Feature count data product [Attribution API] - https://phabricator.wikimedia.org/T432604#12277744 (10AKhatun_WMF) [20:52:16] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): dbt: Change YAML group configuration keyword to "scheduling_group" - https://phabricator.wikimedia.org/T436559#12277887 (10amastilovic) This is now done. [20:52:58] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): dbt: Change YAML group configuration keyword to "scheduling_group" - https://phabricator.wikimedia.org/T436559#12277891 (10amastilovic) [20:55:22] 06Data-Engineering, 10Dumps-Generation, 06Data-Platform-SRE (2026-08-28 - 2026-09-18), 07Wikimedia-production-error: dumps are generating 'PHP Warning: Undefined array key x4' errors - https://phabricator.wikimedia.org/T436663#12277903 (10thcipriani) It'd be great to get this running the latest image! The... [21:21:05] 06Data-Engineering, 07Documentation: Complete Documentation of Article Feature Counts - https://phabricator.wikimedia.org/T436717 (10AKhatun_WMF) 03NEW [21:24:03] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): Backfill Article Feature Counts - https://phabricator.wikimedia.org/T436718 (10AKhatun_WMF) 03NEW [21:24:16] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): IR2.1.2d: Feature count data product [Attribution API] - https://phabricator.wikimedia.org/T432604#12278045 (10AKhatun_WMF) [22:31:38] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): dbt: Change YAML group configuration keyword to "scheduling_group" - https://phabricator.wikimedia.org/T436559#12278259 (10amastilovic) Wikitech docs updated. [22:31:42] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): dbt: Change YAML group configuration keyword to "scheduling_group" - https://phabricator.wikimedia.org/T436559#12278260 (10amastilovic)