[03:32:53] 10Data-Engineering-Planning, 10MediaWiki-extensions-EventLogging, 10Metrics Platform Icebox, 10Notifications, and 3 others: [EPIC] Deprecate EventLogging::logEvent() - https://phabricator.wikimedia.org/T318263 (10Etonkovidova) 05Open→03Resolved a:03Etonkovidova [03:33:37] 10Data-Engineering-Planning, 10MediaWiki-extensions-EventLogging, 10Metrics Platform Icebox, 10Notifications, and 3 others: [EPIC] Deprecate EventLogging::logEvent() - https://phabricator.wikimedia.org/T318263 (10Etonkovidova) Checked https://stream-beta.wmflabs.org/v2/ui/#/?streams=eventlogging_EchoIntera... [06:35:26] 10Data-Engineering, 10CheckUser, 10MW-1.38-notes (1.38.0-wmf.26; 2022-03-14), 10MW-1.39-notes (1.39.0-wmf.23; 2022-08-01), and 4 others: Update CheckUser for actor and comment table - https://phabricator.wikimedia.org/T233004 (10Marostegui) [09:57:56] (03Abandoned) 10Hashar: Schemas for Gerrit [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/811302 (https://phabricator.wikimedia.org/T311615) (owner: 10Hashar) [09:59:19] 10Data-Engineering-Planning, 10Data³, 10Patch-For-Review: Audit JSON schemas for Gerrit events - https://phabricator.wikimedia.org/T311615 (10hashar) 05Open→03Declined The audit was done and schemas proposed by https://gerrit.wikimedia.org/r/c/schemas/event/secondary/+/811302 However sending Gerrit even... [12:04:18] 10Data-Engineering: Missconfigured proxies on data-engineering hosts - https://phabricator.wikimedia.org/T326302 (10ayounsi) [12:04:33] 10Data-Engineering: Missconfigured proxies on data-engineering hosts - https://phabricator.wikimedia.org/T326302 (10ayounsi) [12:04:45] 10Data-Engineering, 10Infrastructure-Foundations, 10Product-Analytics, 10Research, and 3 others: Maybe restrict domains accessible by webproxy - https://phabricator.wikimedia.org/T300977 (10ayounsi) [12:06:41] 10Data-Engineering-Radar, 10MW-on-K8s, 10serviceops, 10Patch-For-Review: IPInfo MediaWiki extension depends on presence of maxmind db in the container/host - https://phabricator.wikimedia.org/T288375 (10Clement_Goubert) Deployed on mw-debug and works. Should it be enabled for all mw-on-k8s deployments, or... [12:29:54] 10Data-Engineering, 10Infrastructure-Foundations, 10Product-Analytics, 10Research, and 3 others: Maybe restrict domains accessible by webproxy - https://phabricator.wikimedia.org/T300977 (10ayounsi) [12:30:41] 10Data-Engineering, 10Infrastructure-Foundations, 10Product-Analytics, 10Research, and 3 others: Maybe restrict domains accessible by webproxy - https://phabricator.wikimedia.org/T300977 (10ayounsi) [12:30:49] 10Data-Engineering: Missconfigured proxies on data-engineering hosts - https://phabricator.wikimedia.org/T326302 (10ayounsi) [12:31:00] 10Data-Engineering, 10Infrastructure-Foundations, 10Product-Analytics, 10Research, and 3 others: Maybe restrict domains accessible by webproxy - https://phabricator.wikimedia.org/T300977 (10ayounsi) [12:31:08] 10Data-Engineering: Missconfigured proxies on data-engineering hosts - https://phabricator.wikimedia.org/T326302 (10ayounsi) [12:31:47] 10Data-Engineering-Planning, 10MediaWiki-extensions-EventLogging, 10Metrics Platform Icebox, 10Notifications, and 3 others: [EPIC] Deprecate EventLogging::logEvent() - https://phabricator.wikimedia.org/T318263 (10phuedx) [12:32:58] 10Data-Engineering: Missconfigured proxies on data-engineering hosts - https://phabricator.wikimedia.org/T326302 (10ayounsi) [13:02:48] 10Data-Engineering-Radar, 10MW-on-K8s, 10serviceops, 10Patch-For-Review: IPInfo MediaWiki extension depends on presence of maxmind db in the container/host - https://phabricator.wikimedia.org/T288375 (10Joe) >>! In T288375#8501193, @Clement_Goubert wrote: > Deployed on mw-debug and works. > Should it be en... [14:15:46] 10Data-Engineering, 10Infrastructure-Foundations, 10Product-Analytics, 10Research, and 3 others: Maybe restrict domains accessible by webproxy - https://phabricator.wikimedia.org/T300977 (10ayounsi) [14:50:34] 10Quarry: it would be useful to run the same Quarry query conveniently in several database - https://phabricator.wikimedia.org/T95582 (10Milimetric) >>! In T95582#8500253, @bd808 wrote: >>>! In T95582#8500240, @Milimetric wrote: >> At this point, we are making significant progress on near-real-time dumps generat... [15:05:15] 10Data-Engineering, 10CheckUser, 10MW-1.38-notes (1.38.0-wmf.26; 2022-03-14), 10MW-1.39-notes (1.39.0-wmf.23; 2022-08-01), and 3 others: Update sqoop for CheckUser table - https://phabricator.wikimedia.org/T326330 (10Milimetric) [15:05:57] 10Data-Engineering: Update sqoop for CheckUser table - https://phabricator.wikimedia.org/T326330 (10Milimetric) [15:06:23] (03PS1) 10Milimetric: Get actor information from actor table [analytics/refinery] - 10https://gerrit.wikimedia.org/r/875951 (https://phabricator.wikimedia.org/T326330) [15:46:31] 10Data-Engineering, 10Data Pipelines (Sprint 05-06): Update Automated Traffic Detection Documentation - https://phabricator.wikimedia.org/T324777 (10Antoine_Quhen) [15:50:59] (03CR) 10Milimetric: [V: 03+2] "Testing wikidatawiki and a couple other small wikis, keeping an eye on https://grafana.wikimedia.org/d/000000273/mysql?orgId=1&var-server=" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/875951 (https://phabricator.wikimedia.org/T326330) (owner: 10Milimetric) [16:17:21] 10Data-Engineering-Radar, 10MW-on-K8s, 10serviceops, 10Patch-For-Review: IPInfo MediaWiki extension depends on presence of maxmind db in the container/host - https://phabricator.wikimedia.org/T288375 (10Clement_Goubert) 05Open→03Resolved geoip is now enabled by default in the mediawiki chart, and deplo... [16:54:45] 10Data-Engineering, 10Patch-For-Review: Update sqoop for CheckUser table - https://phabricator.wikimedia.org/T326330 (10Zabe) a:05Zabe→03None [16:58:36] 10Quarry: it would be useful to run the same Quarry query conveniently in several database - https://phabricator.wikimedia.org/T95582 (10bd808) >>! In T95582#8501818, @Milimetric wrote: > **March**: we are generating a proof of concept XML dump, similar to the current one, via a Kafka -> Spark -> Iceberg -> XML... [17:19:51] 10Quarry: it would be useful to run the same Quarry query conveniently in several database - https://phabricator.wikimedia.org/T95582 (10Milimetric) >>! In T95582#8502156, @bd808 wrote: >>>! In T95582#8501818, @Milimetric wrote: >> **March**: we are generating a proof of concept XML dump, similar to the current... [17:39:22] 10Data-Engineering, 10Data Pipelines (Sprint 05-06): Update Automated Traffic Detection Documentation - https://phabricator.wikimedia.org/T324777 (10Antoine_Quhen) 05Open→03Resolved 2 problems detected during my research: * https://phabricator.wikimedia.org/T326337 * https://phabricator.wikimedia.org/T326339 [17:39:40] 10Data-Engineering, 10Data Pipelines (Sprint 05-06): Update Automated Traffic Detection Documentation - https://phabricator.wikimedia.org/T324777 (10Antoine_Quhen) https://wikitech.wikimedia.org/wiki/Analytics/Data_Lake/Traffic/BotDetection#Current_state_of_the_automated_traffic_detection_in_our_pipeline [18:14:28] 10Data-Engineering, 10Equity-Landscape: Add country_meta_data - https://phabricator.wikimedia.org/T324681 (10Mayakp.wiki) @ntsako / @JAnstee_WMF : can you provide the database name and table name of the production version of this table? [21:38:32] 10Data-Engineering, 10Event-Platform Value Stream: [EPIC] Streaming and event driven Python services - https://phabricator.wikimedia.org/T324689 (10Ottomata) Okay, I think I have something working? We can already easily recursively convert Rows to dicts. [[ https://gitlab.wikimedia.org/repos/data-engineering... [22:52:07] 10Data-Engineering, 10Equity-Landscape: Grants output metrics - https://phabricator.wikimedia.org/T306620 (10JAnstee_WMF) @KCVelaga Looks good and I am signing off with the exception of some column headers that still need adjusting. **NM code label / KCV code label >> RECOMMENDATION** Inputs: grants... [22:53:39] 10Data-Engineering, 10Equity-Landscape: Grants output metrics - https://phabricator.wikimedia.org/T306620 (10JAnstee_WMF) a:05JAnstee_WMF→03KCVelaga_WMF