[04:37:58] (03PS6) 10Snwachukwu: Add wmf_content.mediawiki_html_content_current_v0 table and backfill [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1319873 (https://phabricator.wikimedia.org/T426347) [06:26:04] 06Data-Engineering, 06MediaWiki-API-Platform-Team, 10WMF-JobQueue, 10Event-Platform, 07Wikimedia-production-error: MediaWiki\JobQueue\Exceptions\JobQueueError: Could not enqueue jobs - https://phabricator.wikimedia.org/T434199#12194014 (10ArielGlenn) p:05Triage→03High [07:03:30] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10Event-Platform, 13Patch-For-Review: Backfill commonswiki and enwiki HTML for latest HTML when non-existent in event.mediawiki_page_html_content_change_v1 - https://phabricator.wikimedia.org/T426347#12194045 (10dcausse) >>! In T426347#12192870, @Snw... [08:49:58] (03CR) 10KCVelaga: "@joal@wikimedia.org @mforns@wikimedia.org can you review again please? The previous +1 is void as I added a new column. Thanks." [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1319913 (https://phabricator.wikimedia.org/T430673) (owner: 10KCVelaga) [09:12:45] 06Data-Engineering, 06Data-Engineering-Radar, 10Test Kitchen, 07Essential-Work, 10Event-Platform: [EventGate] Reject events from inactive instruments and experiments - https://phabricator.wikimedia.org/T430541#12194508 (10phuedx) [09:12:47] 06Data-Engineering, 06Data-Engineering-Radar, 07Essential-Work, 10Event-Platform, 10Test Kitchen (Experiment Platform Sprint 28): [EventGate] Record metrics for instruments and experiments - https://phabricator.wikimedia.org/T430322#12194509 (10phuedx) [09:12:48] 06Data-Engineering, 06Data-Engineering-Radar, 07Essential-Work, 10Event-Platform, 10Test Kitchen (Experiment Platform Sprint 28): [EventGate] Add configurable UA denylist - https://phabricator.wikimedia.org/T429898#12194510 (10phuedx) [09:12:49] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10Event-Platform: [EventGate] Sanitize stream name in all metrics - https://phabricator.wikimedia.org/T429799#12194511 (10phuedx) [10:27:20] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): data lake: git commit history - https://phabricator.wikimedia.org/T433696#12194777 (10Addshore) >>! In T433696#12192395, @Antoine_Quhen wrote: > @Ahoelzl how will this data be used? example queries? target dashboards / graphs? Primarily this will be tir... [10:27:59] 06Data-Engineering, 10MediaWiki-extensions-EventLogging, 10Test Kitchen, 07Essential-Work: Remove mw.eventLog.id - https://phabricator.wikimedia.org/T408179#12194779 (10phuedx) →14Duplicate dup:03T376464 [10:28:31] 06Data-Engineering, 06Data-Engineering-Radar, 10MediaWiki-extensions-EventLogging, 10Test Kitchen, and 2 others: [EPIC] Deprecate and remove mw.eventLog.id - https://phabricator.wikimedia.org/T408177#12194784 (10phuedx) [11:15:06] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 06Data-Platform-SRE, 10Event-Platform, 13Patch-For-Review: Create `webrequest-pageview` K8s application. - https://phabricator.wikimedia.org/T433962#12194933 (10JMonton-WMF) [11:20:26] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 06Data-Platform-SRE, 10Event-Platform, 13Patch-For-Review: Create `webrequest-pageview` K8s application. - https://phabricator.wikimedia.org/T433962#12194960 (10JMonton-WMF) [14:21:41] (03CR) 10Joal: [C:03+1] HQLs to create and import Cloudflare bot directory. [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1319913 (https://phabricator.wikimedia.org/T430673) (owner: 10KCVelaga) [14:46:42] 06Data-Engineering: dbt_daily DAG exceeds its SLA - https://phabricator.wikimedia.org/T434307 (10mforns) 03NEW [14:46:46] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10Event-Platform, 13Patch-For-Review: Backfill commonswiki and enwiki HTML for latest HTML when non-existent in event.mediawiki_page_html_content_change_v1 - https://phabricator.wikimedia.org/T426347#12195527 (10Snwachukwu) > perhaps you could simply... [15:44:38] 06Data-Engineering, 10Test Kitchen, 07Essential-Work, 10Event-Platform: [EventGate] Perform GeoIP lookup at event ingestion time - https://phabricator.wikimedia.org/T434312 (10phuedx) 03NEW [15:45:59] 06Data-Engineering, 10Test Kitchen, 07Essential-Work, 10Event-Platform: [EventGate] Perform GeoIP lookup at event ingestion time - https://phabricator.wikimedia.org/T434312#12195727 (10phuedx) [15:46:32] 06Data-Engineering, 10Test Kitchen, 07Essential-Work, 10Event-Platform: [EventGate] Perform GeoIP lookup at event ingestion time - https://phabricator.wikimedia.org/T434312#12195729 (10phuedx) [17:08:37] 06Data-Engineering, 10Test Kitchen, 07Essential-Work, 10Event-Platform: [EventGate] Perform GeoIP lookup at event ingestion time - https://phabricator.wikimedia.org/T434312#12196087 (10Ottomata) Hm...I wonder. I recall something about [[ https://gerrit.wikimedia.org/g/operations/puppet/+/466f90c2ab819fe5f... [17:15:10] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): dbt on Airflow: Automatically determine memory for Skein driver, based on spark.driver.memory - https://phabricator.wikimedia.org/T434323 (10amastilovic) 03NEW [17:52:56] 06Data-Engineering, 10Test Kitchen, 07Essential-Work, 10Event-Platform: [EventGate] Perform GeoIP lookup at event ingestion time - https://phabricator.wikimedia.org/T434312#12196216 (10phuedx) That is a really, really neat solution! I'll update the task description… [21:30:01] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th): Reinforce Blunderbuss to better respond to source server outages - https://phabricator.wikimedia.org/T434344 (10amastilovic) 03NEW [22:45:47] 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10DPE-MediaWiki-Incremental-History, 13Patch-For-Review: migrate dbt_jobs pipelines to use MWH incremental - https://phabricator.wikimedia.org/T429770#12196858 (10Mayakp.wiki) Reviewed `constructive_activations` Requested @APizzata-WMF for a logic c...