[01:59:39] (03CR) 10Sharvaniharan: Add a required variable to app analytics fragment (031 comment) [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/761452 (owner: 10Sharvaniharan) [05:49:54] 10Analytics, 10Analytics-Wikistats, 10Data-Engineering: Wikistats New Feature - https://phabricator.wikimedia.org/T301611 (10Roundnutz04) a:03RoundNutz78 [06:37:25] PROBLEM - Check unit status of mediawiki-history-drop-snapshot on an-launcher1002 is CRITICAL: CRITICAL: Status of the systemd unit mediawiki-history-drop-snapshot https://wikitech.wikimedia.org/wiki/Analytics/Systems/Managing_systemd_timers [07:37:42] 10Data-Engineering, 10Infrastructure-Foundations, 10Product-Analytics, 10Research, and 2 others: Maybe restrict domains accessible by webproxy - https://phabricator.wikimedia.org/T300977 (10Joe) >> **First**: How difficult & how much overhead would it be to make the proxy redirect requests made to internal... [10:21:38] (03PS26) 10Phuedx: Metrics Platform event schema [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/676392 (https://phabricator.wikimedia.org/T276379) (owner: 10Jason Linehan) [13:46:31] (03CR) 10Ottomata: Add a required variable to app analytics fragment (031 comment) [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/761452 (owner: 10Sharvaniharan) [13:46:37] (03CR) 10Phuedx: [C: 03+1] "This LGTM." [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/761452 (owner: 10Sharvaniharan) [13:48:38] 10Data-Engineering, 10Infrastructure-Foundations, 10Product-Analytics, 10Research, and 2 others: Maybe restrict domains accessible by webproxy - https://phabricator.wikimedia.org/T300977 (10Ottomata) @Joe I think most of the usages of webproxy that folks here are concerned with aren't by production service... [13:48:49] (03CR) 10Phuedx: [C: 04-1] "Sorry! Are the changes to package.json/package-lock.json intentional?" [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/761452 (owner: 10Sharvaniharan) [14:04:14] 10Data-Engineering, 10Infrastructure-Foundations, 10Product-Analytics, 10Research, and 2 others: Maybe restrict domains accessible by webproxy - https://phabricator.wikimedia.org/T300977 (10akosiaris) >>! In T300977#7710861, @Ottomata wrote: > @Joe I think most of the usages of webproxy that folks here are... [14:35:44] Hi milimetric - let me know when you come online, I'm interested for some exchange on the webrequest analysis please :) [14:36:07] I'm here joal, batcave? [14:37:09] sure milimetric, OMW! [14:54:25] actually milimetric, it's not fair from me asking you to dso the comm - I'll do it and ask you to proff read :) [15:03:11] milimetric: https://etherpad.wikimedia.org/p/webrequest-2021-Q4-loss [15:03:14] thanks a lot [15:11:25] 10Analytics, 10Data-Engineering, 10Pageviews-API: Track page views by page ID rather than title (handles moved pages) - https://phabricator.wikimedia.org/T159046 (10valerio.bozzolan) [15:18:46] added notes to the etherpad, Jo [15:19:57] Thanks a lot milimetric, will review after meeting :) [15:24:09] PROBLEM - Check unit status of produce_canary_events on an-launcher1002 is CRITICAL: CRITICAL: Status of the systemd unit produce_canary_events https://wikitech.wikimedia.org/wiki/Analytics/Systems/Managing_systemd_timers [15:31:43] 10Data-Engineering, 10Growth-Team, 10GrowthExperiments, 10MediaWiki-extensions-EventLogging, 10Browser-Tests: Create a test for end-to-end event logging data verification of happy path with Special:Homepage and suggested edits - https://phabricator.wikimedia.org/T301463 (10kostajh) [15:34:15] RECOVERY - Check unit status of produce_canary_events on an-launcher1002 is OK: OK: Status of the systemd unit produce_canary_events https://wikitech.wikimedia.org/wiki/Analytics/Systems/Managing_systemd_timers [17:02:35] 10Data-Engineering, 10Data-Engineering-Kanban: Some varnishkafka instances dropped traffic for a long time due to the wrong version of the package installed - https://phabricator.wikimedia.org/T300164 (10JAllemandou) a:03JAllemandou [17:15:34] 10Data-Engineering, 10Data-Engineering-Kanban: Some varnishkafka instances dropped traffic for a long time due to the wrong version of the package installed - https://phabricator.wikimedia.org/T300164 (10JAllemandou) For archives to be happy, here is the email I sent today about gathering data for analysis: H... [17:20:23] !log split anaconda-wmf into 2 packages: anaconda-wmf-base and anaconda-wmf. anaconda-wmf-base is installed on workers, anaconda-wmf on clients. The size of the package on workers is now much smaller. Installing throught the cluster. relevant: T292699 [17:20:26] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [17:20:26] T292699: Conda's CPPFLAGS may not be correct when pip installing a package that needs c/cpp compilation - https://phabricator.wikimedia.org/T292699 [18:02:47] 10Data-Engineering, 10Data-Engineering-Kanban: Some varnishkafka instances dropped traffic for a long time due to the wrong version of the package installed - https://phabricator.wikimedia.org/T300164 (10Mayakp.wiki) @JAllemandou : Thanks Joseph! These would be great for us to investigate. Additionally can we... [18:21:37] 10Data-Engineering, 10Product-Analytics (Kanban): wikidata unique devices per-project-family overcount offset - https://phabricator.wikimedia.org/T301403 (10ldelench_wmf) [18:26:34] 10Data-Engineering, 10Product-Analytics: Add Product-Analytics Announcements to the oozie job for notifications - https://phabricator.wikimedia.org/T301281 (10ldelench_wmf) p:05Triage→03Low [18:27:08] 10Data-Engineering, 10Product-Analytics: Add Product-Analytics Announcements to the oozie job for notifications - https://phabricator.wikimedia.org/T301281 (10ldelench_wmf) [18:41:38] (03PS1) 10MewOphaswongse: Structured task: add abandonedit_dialog active_interface and its actions [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/762898 (https://phabricator.wikimedia.org/T300582) [19:44:33] 10Analytics-Kanban, 10Data-Engineering, 10Data-Engineering-Kanban: Conda's CPPFLAGS may not be correct when pip installing a package that needs c/cpp compilation - https://phabricator.wikimedia.org/T292699 (10Ottomata) Okay, I just deployed a new version of anaconda-wmf. Let's see if this fixes it. [20:10:16] 10Data-Engineering, 10Data-Engineering-Kanban: Some varnishkafka instances dropped traffic for a long time due to the wrong version of the package installed - https://phabricator.wikimedia.org/T300164 (10AndyRussG) Hi! Thanks so so much @JAllemandou, @Mayakp.wiki, @JMando, @Milimetric! Hugely, hugely appreciat... [20:21:23] (03CR) 10Kosta Harlan: [C: 03+2] Structured task: add abandonedit_dialog active_interface and its actions [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/762898 (https://phabricator.wikimedia.org/T300582) (owner: 10MewOphaswongse) [20:22:01] (03Merged) 10jenkins-bot: Structured task: add abandonedit_dialog active_interface and its actions [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/762898 (https://phabricator.wikimedia.org/T300582) (owner: 10MewOphaswongse) [20:27:49] 10Analytics, 10Data-Engineering, 10Event-Platform, 10Patch-For-Review, 10Readers-Web-Backlog (Kanbanana-FY-2021-22): WikipediaPortal Event Platform Migration - https://phabricator.wikimedia.org/T282012 (10Jdrewniak) hi @Ottomata, I'm just in the process of scoping out this work this week (I anticipate we... [20:30:33] 10Analytics, 10Data-Engineering, 10Event-Platform, 10Patch-For-Review, 10Readers-Web-Backlog (Kanbanana-FY-2021-22): WikipediaPortal Event Platform Migration - https://phabricator.wikimedia.org/T282012 (10Ottomata) Ok great! FYI i'm out for the next 1.5 weeks. Probably @mforns can help you if you need... [21:13:01] 10Data-Engineering, 10Product-Analytics: conda-create-stacked breaks wmfdata.presto - https://phabricator.wikimedia.org/T301734 (10Ottomata) Okay, something is weird with the way I include the conda pkgs dir in anaconda-wmf. I include this so that we can create the stacked env without talking to the internet;... [21:48:41] (03PS1) 10Btullis: Add blubber files for deployment pipeline [analytics/datahub] (wmf) - 10https://gerrit.wikimedia.org/r/762950 (https://phabricator.wikimedia.org/T301453) [21:54:24] (03PS2) 10Btullis: Add blubber files for deployment pipeline [analytics/datahub] (wmf) - 10https://gerrit.wikimedia.org/r/762950 (https://phabricator.wikimedia.org/T301453) [22:08:58] 10Data-Engineering, 10Data-Engineering-Kanban: Some varnishkafka instances dropped traffic for a long time due to the wrong version of the package installed - https://phabricator.wikimedia.org/T300164 (10AndyRussG) Ah more still.... - Maybe, as well as `referer_class`, we could break down referrer by search en... [22:29:41] 10Data-Engineering, 10Data-Engineering-Kanban: Some varnishkafka instances dropped traffic for a long time due to the wrong version of the package installed - https://phabricator.wikimedia.org/T300164 (10AndyRussG) Ahhhh one more idea, hope it's useful... For a lot of countries, I see (for 2021-12-01, though...