[00:10:03] 10Analytics, 10Platform Engineering Roadmap, 10User-Eevans: Implement per-article endpoint of the pageviews API - https://phabricator.wikimedia.org/T289265 (10Eevans) p:05Triage→03Medium [03:26:56] (03Abandoned) 10Andrew Bogott: tox.ini: update to work with default buster tox version [analytics/quarry/web] (buster) - 10https://gerrit.wikimedia.org/r/711211 (owner: 10Andrew Bogott) [03:27:23] (03Abandoned) 10Andrew Bogott: tox.ini: update to work with default buster tox version [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/710357 (owner: 10Andrew Bogott) [07:39:33] 10Analytics, 10Platform Engineering Roadmap, 10User-Eevans: AQS 2.0: Implement wikistats 2 endpoints - https://phabricator.wikimedia.org/T288301 (10JAllemandou) Quick note on this one: the backend for these metrics is not cassandra but druid, making implementation somehow different. Happy to talk about this... [07:56:11] 10Analytics, 10 Data-Engineering, 10Data-Engineering-Kanban, 10Epic: Alluxio for Improved Superset Query Performance - https://phabricator.wikimedia.org/T288252 (10JAllemandou) Adding 2 things: - Alluxio is built using 3 different Leader-follower systems: core (caching), job (data movement), catalog (Hive... [08:11:10] 10Analytics, 10Analytics-Kanban: Delete HDFS raw *_camus directories 60 days after July 12 (after 2021-09-10) - https://phabricator.wikimedia.org/T287685 (10JAllemandou) 05Open→03Resolved [08:11:13] 10Analytics, 10Analytics-Kanban, 10Epic, 10Patch-For-Review: Replace Camus by Gobblin - https://phabricator.wikimedia.org/T271232 (10JAllemandou) [08:46:02] !log btullis@druid1001:~$ sudo systemctl stop druid-broker druid-coordinator druid-historical druid-middlemanager druid-overlord [08:46:05] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [08:47:26] 10Analytics-Clusters, 10Analytics-Kanban, 10Patch-For-Review: Refresh Druid nodes (druid100[1-3]) - https://phabricator.wikimedia.org/T255148 (10BTullis) I have shut down the druid services on druid1001 `btullis@druid1001:~$ sudo systemctl stop druid-broker druid-coordinator druid-historical druid-middlemana... [08:47:47] 10Quarry, 10Epic, 10cloud-services-team (Kanban): Productionize quarry a bit - https://phabricator.wikimedia.org/T288982 (10dcaro) When, where, who and how should we decide what goes here? (has that been done already? might have missed it.) [08:59:46] 10Analytics: Check home/HDFS leftovers of gsingers - https://phabricator.wikimedia.org/T287845 (10JAllemandou) 05Open→03Resolved a:03JAllemandou I checked using our usual script and got: ` ====== stat1004 ====== total 0 ====== stat1005 ====== total 0 ====== stat1006 ====== total 0 ====== stat1007 ======... [09:19:45] 10Analytics-Clusters, 10Analytics-Kanban, 10Patch-For-Review: Refresh Druid nodes (druid100[1-3]) - https://phabricator.wikimedia.org/T255148 (10BTullis) [09:34:26] 10Analytics-Clusters, 10Analytics-Kanban, 10Patch-For-Review: Refresh Druid nodes (druid100[1-3]) - https://phabricator.wikimedia.org/T255148 (10BTullis) Decommissioned druid1001. [09:38:19] PROBLEM - Check unit status of produce_canary_events on an-launcher1002 is CRITICAL: CRITICAL: Status of the systemd unit produce_canary_events https://wikitech.wikimedia.org/wiki/Analytics/Systems/Managing_systemd_timers [09:48:43] RECOVERY - Check unit status of produce_canary_events on an-launcher1002 is OK: OK: Status of the systemd unit produce_canary_events https://wikitech.wikimedia.org/wiki/Analytics/Systems/Managing_systemd_timers [10:26:00] btullis: Hello - Can I ask for a few minutes of help please? [10:26:23] Yes of course. Here or bc? [10:26:33] batcave would be easier if feasible for ou [10:26:43] Yup. See you there. [11:10:55] (03PS2) 10Andrew-WMDE: Aggregate the number of times template data was available in VE's template dialog [analytics/reportupdater-queries] - 10https://gerrit.wikimedia.org/r/713650 (https://phabricator.wikimedia.org/T272589) [11:17:51] (03CR) 10Andrew-WMDE: Aggregate the number of times template data was available in VE's template dialog (033 comments) [analytics/reportupdater-queries] - 10https://gerrit.wikimedia.org/r/713650 (https://phabricator.wikimedia.org/T272589) (owner: 10Andrew-WMDE) [11:43:51] (03CR) 10Awight: Aggregate the number of times template data was available in VE's template dialog (033 comments) [analytics/reportupdater-queries] - 10https://gerrit.wikimedia.org/r/713650 (https://phabricator.wikimedia.org/T272589) (owner: 10Andrew-WMDE) [11:52:59] (03CR) 10Awight: [C: 04-1] Add the total number of times a template had template data in TemplateWizard (031 comment) [analytics/reportupdater-queries] - 10https://gerrit.wikimedia.org/r/713647 (https://phabricator.wikimedia.org/T272589) (owner: 10Andrew-WMDE) [11:54:02] (03CR) 10Awight: Aggregate the number of times template data was available in VE's template dialog (031 comment) [analytics/reportupdater-queries] - 10https://gerrit.wikimedia.org/r/713650 (https://phabricator.wikimedia.org/T272589) (owner: 10Andrew-WMDE) [12:32:37] (03CR) 10Michael DiPietro: [C: 03+2] add stop query function [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/710067 (https://phabricator.wikimedia.org/T71037) (owner: 10Michael DiPietro) [12:34:46] (03Merged) 10jenkins-bot: add stop query function [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/710067 (https://phabricator.wikimedia.org/T71037) (owner: 10Michael DiPietro) [13:01:05] 10Quarry: have quarry stop button follow status - https://phabricator.wikimedia.org/T289348 (10mdipietro) [13:04:22] 10Quarry: add stop status to quarry - https://phabricator.wikimedia.org/T289349 (10mdipietro) [13:31:15] 10Analytics, 10Platform Engineering Roadmap, 10User-Eevans: AQS 2.0: Implement wikistats 2 endpoints - https://phabricator.wikimedia.org/T288301 (10Eevans) >>! In T288301#7297021, @JAllemandou wrote: > Quick note on this one: the backend for these metrics is not cassandra but druid, making implementation som... [13:31:56] 10Analytics, 10Platform Engineering Roadmap, 10User-Eevans: AQS 2.0: Implement wikistats 2 endpoints - https://phabricator.wikimedia.org/T288301 (10Eevans) [13:47:13] (03CR) 10Michael DiPietro: [C: 03+1] Add database autocompletion [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/713237 (https://phabricator.wikimedia.org/T287471) (owner: 10David Caro) [13:51:31] 10Analytics, 10Platform Engineering Roadmap, 10User-Eevans: AQS 2.0: Implement wikistats 2 endpoints - https://phabricator.wikimedia.org/T288301 (10JAllemandou) > Wikistats is the only one that uses Druid though, yes? Yes! [14:05:07] (03PS1) 10Michael DiPietro: quarry stop button to follow current status [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/714055 (https://phabricator.wikimedia.org/T289348) [14:05:48] 10Quarry, 10Patch-For-Review: have quarry stop button follow status - https://phabricator.wikimedia.org/T289348 (10mdipietro) p:05Triage→03Medium a:03mdipietro [14:07:10] (03PS2) 10Michael DiPietro: quarry stop button to follow current status [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/714055 (https://phabricator.wikimedia.org/T289348) [14:07:49] (03PS3) 10Michael DiPietro: quarry stop button to follow current status [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/714055 (https://phabricator.wikimedia.org/T289348) [14:18:25] (03PS3) 10Awight: Aggregate the number of times template data was available in VE's template dialog [analytics/reportupdater-queries] - 10https://gerrit.wikimedia.org/r/713650 (https://phabricator.wikimedia.org/T272589) (owner: 10Andrew-WMDE) [14:22:49] (03CR) 10Michael DiPietro: "At time of writing this is up on the dev instance https://quarry-dev.wmflabs.org/" [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/714055 (https://phabricator.wikimedia.org/T289348) (owner: 10Michael DiPietro) [14:51:02] (03CR) 10Nskaggs: [V: 03+2] "Tested on quarry-dev" [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/714055 (https://phabricator.wikimedia.org/T289348) (owner: 10Michael DiPietro) [14:51:39] (03CR) 10Nskaggs: [V: 03+2 C: 03+2] quarry stop button to follow current status [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/714055 (https://phabricator.wikimedia.org/T289348) (owner: 10Michael DiPietro) [14:51:47] (03CR) 10Michael DiPietro: [C: 03+2] quarry stop button to follow current status [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/714055 (https://phabricator.wikimedia.org/T289348) (owner: 10Michael DiPietro) [15:00:07] 10Analytics-Clusters, 10Analytics-Kanban, 10Patch-For-Review: Add 6 worker nodes to the HDFS Namenode config of the Analytics Hadoop cluster - https://phabricator.wikimedia.org/T275767 (10BTullis) Beginning work on this now. For my reference, the full names of the new hosts are: * `an-worker1129.eqiad.wmne... [15:20:06] (03PS4) 10Awight: Aggregate the number of times template data was available in VE's template dialog [analytics/reportupdater-queries] - 10https://gerrit.wikimedia.org/r/713650 (https://phabricator.wikimedia.org/T272589) (owner: 10Andrew-WMDE) [15:22:07] 10Analytics-Clusters, 10Analytics-Kanban, 10Patch-For-Review: Add 6 worker nodes to the HDFS Namenode config of the Analytics Hadoop cluster - https://phabricator.wikimedia.org/T275767 (10BTullis) I don't think that I need to add any command-line options to the cookbook, because the defaults work. We have 12... [15:43:45] (03PS3) 10Awight: Add the total number of times a template had template data in TemplateWizard [analytics/reportupdater-queries] - 10https://gerrit.wikimedia.org/r/713647 (https://phabricator.wikimedia.org/T272589) (owner: 10Andrew-WMDE) [15:51:05] (03CR) 10Awight: "This change is ready for review." [analytics/reportupdater-queries] - 10https://gerrit.wikimedia.org/r/714065 (https://phabricator.wikimedia.org/T272589) (owner: 10Awight) [16:44:34] So who should sre access reqeust addtions to analytics privatedata users be approved by these days? [16:44:45] I assigned 3 to director of analytics but that seems... too high up. [17:09:09] 10Analytics-Clusters, 10Analytics-Kanban, 10Patch-For-Review: Add 6 worker nodes to the HDFS Namenode config of the Analytics Hadoop cluster - https://phabricator.wikimedia.org/T275767 (10BTullis) I have completed the hard drive initialization on all 6 nodes. I'm just checking whether I should make the chang... [17:25:29] robh: Hi - Olja (director of Analytics) is the current approver for those :) [17:27:25] ok then i did put to correct person, cool! [17:27:32] joal: thank you for confirmation, it is appreciated! [17:27:43] You're welcome robh :) [17:58:18] 10Analytics, 10Analytics-Kanban, 10 Data-Engineering, 10Cassandra, and 2 others: Update cassandra oozie jobs to load cassandra3 using Spark job - https://phabricator.wikimedia.org/T289161 (10odimitrijevic) p:05Triage→03High [18:13:49] 10Analytics-Radar, 10Product-Analytics: How often do people try to edit on mobile devices, using the desktop site, at the English Wikipedia? - https://phabricator.wikimedia.org/T288972 (10odimitrijevic) [18:15:31] 10Analytics, 10 Data-Engineering, 10Better Use Of Data, 10Data-Engineering-Kanban, 10Product-Analytics: Upgrade Superset to 1.2 - https://phabricator.wikimedia.org/T288115 (10odimitrijevic) p:05Triage→03High [18:16:07] 10Analytics, 10 Data-Engineering, 10Data-Engineering-Kanban, 10Epic: Alluxio for Improved Superset Query Performance - https://phabricator.wikimedia.org/T288252 (10odimitrijevic) p:05Triage→03High [18:26:34] (03PS1) 10Urbanecm: Add analytics/mediawiki/mentor_dashboard/visit [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/714099 (https://phabricator.wikimedia.org/T289369) [20:17:17] 10Quarry: have quarry stop button follow status - https://phabricator.wikimedia.org/T289348 (10mdipietro) 05Open→03Resolved [20:29:36] (03PS9) 10Fdans: Adapt wiki selector to allow more than one wiki [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/700098 (https://phabricator.wikimedia.org/T285050) [20:29:38] (03PS4) 10Fdans: Refactor graphmodel to allow more than one project [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/712547 (https://phabricator.wikimedia.org/T283254) [20:29:40] (03PS1) 10Fdans: Enable multi-wiki comparision in Wikistats [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/714123 (https://phabricator.wikimedia.org/T283254) [21:35:58] PROBLEM - Check unit status of produce_canary_events on an-launcher1002 is CRITICAL: CRITICAL: Status of the systemd unit produce_canary_events https://wikitech.wikimedia.org/wiki/Analytics/Systems/Managing_systemd_timers [21:46:54] RECOVERY - Check unit status of produce_canary_events on an-launcher1002 is OK: OK: Status of the systemd unit produce_canary_events https://wikitech.wikimedia.org/wiki/Analytics/Systems/Managing_systemd_timers [21:55:06] 10Analytics-Radar, 10Dumps-Generation: xmldatadumps dumpstatus.json files only readable by root - https://phabricator.wikimedia.org/T287989 (10odimitrijevic) Adding Analytics-Radar tag since I don't think there is anything that the analytics/data engineer team has to do other than review. Let me know if otherw... [22:10:32] 10Analytics, 10 Data-Engineering, 10Code-Health-Objective, 10Platform Engineering Roadmap, 10User-Eevans: Dashboards for AQS 2.0 - https://phabricator.wikimedia.org/T288667 (10odimitrijevic) [22:10:36] 10Analytics, 10 Data-Engineering, 10Platform Engineering Roadmap, 10User-Eevans: Obtain a security review of AQS 2.0 - https://phabricator.wikimedia.org/T288663 (10odimitrijevic) [22:10:47] 10Analytics, 10 Data-Engineering, 10Platform Engineering Roadmap, 10User-Eevans: AQS 2.0: Implement geoeditors endpoints - https://phabricator.wikimedia.org/T288305 (10odimitrijevic) [22:10:49] 10Analytics, 10 Data-Engineering, 10Platform Engineering Roadmap, 10User-Eevans: AQS 2.0: Implement mediarequests endpoints - https://phabricator.wikimedia.org/T288303 (10odimitrijevic) [22:10:51] 10Analytics, 10 Data-Engineering, 10Platform Engineering Roadmap, 10User-Eevans: Create k8s deployment of AQS 2.0 - https://phabricator.wikimedia.org/T288661 (10odimitrijevic) [22:10:55] 10Analytics, 10 Data-Engineering, 10Platform Engineering Roadmap, 10User-Eevans: AQS 2.0: Implement pageviews endpoints - https://phabricator.wikimedia.org/T288296 (10odimitrijevic) [22:10:57] 10Analytics, 10 Data-Engineering, 10Platform Engineering Roadmap, 10User-Eevans: AQS 2.0: Implement wikistats 2 endpoints - https://phabricator.wikimedia.org/T288301 (10odimitrijevic) [22:10:59] 10Analytics, 10 Data-Engineering, 10Platform Engineering Roadmap, 10User-Eevans: AQS 2.0: Implement the unique devices endpoints - https://phabricator.wikimedia.org/T288298 (10odimitrijevic) [22:33:37] (03CR) 10Gergő Tisza: [C: 03+1] "Looks good, should probably be merged together with the corresponding GrowthExperiments patch." [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/714099 (https://phabricator.wikimedia.org/T289369) (owner: 10Urbanecm)