[00:10:09] (03CR) 10MNeisler: talk_page_event schema (031 comment) [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/731333 (https://phabricator.wikimedia.org/T286076) (owner: 10DLynch) [08:15:54] (03PS11) 10DCausse: Add fragment/mediawiki/revision/slot [schemas/event/primary] - 10https://gerrit.wikimedia.org/r/731006 (https://phabricator.wikimedia.org/T293195) [08:18:48] (03CR) 10DCausse: Add fragment/mediawiki/revision/slot (031 comment) [schemas/event/primary] - 10https://gerrit.wikimedia.org/r/731006 (https://phabricator.wikimedia.org/T293195) (owner: 10DCausse) [09:18:27] 10Analytics, 10Analytics-Kanban, 10Data-Engineering, 10Data-Engineering-Kanban, 10Patch-For-Review: Test Alluxio as cache layer for Presto - https://phabricator.wikimedia.org/T266641 (10BTullis) I have checked that puppet has run recently and successfully on all 102 servers that have the profile `bigtop:... [09:19:09] (03CR) 10DCausse: "I think we'll want this when exposing this stream publicly" [schemas/event/primary] - 10https://gerrit.wikimedia.org/r/594098 (owner: 10DCausse) [10:37:32] 10Analytics, 10Analytics-Kanban, 10Data-Engineering, 10Data-Engineering-Kanban, 10Patch-For-Review: Test Alluxio as cache layer for Presto - https://phabricator.wikimedia.org/T266641 (10BTullis) I've checked all ext4 file systems on all of these hosts for files owned by the uid/gid 914. There are still a... [11:35:49] 10Analytics, 10Analytics-Kanban, 10Data-Engineering, 10Data-Engineering-Kanban, 10Patch-For-Review: Test Alluxio as cache layer for Presto - https://phabricator.wikimedia.org/T266641 (10BTullis) I have discovered that the `bigtop::alluxio::user` account was never applied to presto servers, because it was... [12:03:20] 10Analytics, 10Analytics-Kanban, 10Data-Engineering, 10Data-Engineering-Kanban, 10Patch-For-Review: Test Alluxio as cache layer for Presto - https://phabricator.wikimedia.org/T266641 (10BTullis) I have deleted the kerberos principals: ` btullis@krb1001:~$ sudo manage_principals.py delete alluxio/an-test-... [12:38:18] Following on from our discussion about GitLab for Airflow, I have added a comment to this ticket: https://phabricator.wikimedia.org/T286958#7450771 [12:39:07] ...with the intention of starting the conversation with ServiceOps about the possibility of our using a private GitLab runner for deployment of Airflow DAGs. [13:34:11] 10Analytics, 10Data-Engineering, 10Event-Platform, 10Platform Engineering, 10tech-decision-forum: MediaWiki Events as Source of Truth - Decision Statement Overview - https://phabricator.wikimedia.org/T291120 (10Joe) It's not clear to me how this proposal differs from the current status-quo? Just in the... [13:55:13] 10Analytics-Kanban, 10Data-Engineering: Purge any Kerberos keytab files that are not managed by puppet - https://phabricator.wikimedia.org/T294124 (10BTullis) [13:58:17] (03CR) 10Ppchelko: [C: 03+2] Add fragment/mediawiki/revision/slot [schemas/event/primary] - 10https://gerrit.wikimedia.org/r/731006 (https://phabricator.wikimedia.org/T293195) (owner: 10DCausse) [14:46:33] 10Analytics: Create new table for 'referer' aggregated data - https://phabricator.wikimedia.org/T112284 (10Milimetric) p:05Medium→03Triage We were asked by Partnerships to re-evaluate the priority of this task. cc @odimitrijevic [14:49:46] 10Analytics-Kanban, 10Data-Engineering: Purge any Kerberos keytab files that are not managed by puppet - https://phabricator.wikimedia.org/T294124 (10BTullis) [14:52:48] 10Analytics, 10Analytics-Kanban, 10Data-Engineering, 10Patch-For-Review, and 2 others: Migrate analytics cluster alerts from Icinga to AlertManager - https://phabricator.wikimedia.org/T293399 (10BTullis) [14:54:34] 10Analytics-Radar, 10Anti-Harassment, 10CheckUser, 10Privacy Engineering, and 4 others: Deal with Google Chrome User-Agent deprecation - https://phabricator.wikimedia.org/T242825 (10CBogen) [15:47:28] 10Analytics, 10Analytics-Kanban, 10Data-Engineering: [Airflow] Create repository for Airflow DAGs - https://phabricator.wikimedia.org/T294026 (10mforns) Heya @razzi :] > My personal opinion is that it should be called airflow-config so that the file directory structure will look like airflow-config/dags/my_c... [15:54:28] 10Analytics, 10Platform Team Workboards (Image Suggestion API): Airflow collaborations - https://phabricator.wikimedia.org/T282033 (10mforns) [15:54:51] 10Analytics, 10Analytics-Kanban, 10Data-Engineering: SPIKE - Will Hadoop 3 container support help us for Airflow deployment pipelines? - https://phabricator.wikimedia.org/T288247 (10mforns) 05Resolved→03Open Reopening this as we discovered: https://docs.docker.com/engine/security/rootless/ [15:59:15] 10Analytics, 10Data-Services, 10Privacy Engineering, 10cloud-services-team (Kanban): Increased visibility in wiki-replicas for volunteers fighting vandals - https://phabricator.wikimedia.org/T284944 (10nskaggs) [16:34:48] (03CR) 10Mforns: "Oh, this CR has been sitting here for a long time." [analytics/refinery] - 10https://gerrit.wikimedia.org/r/715055 (https://phabricator.wikimedia.org/T274607) (owner: 10MNeisler) [16:57:37] 10Analytics, 10Data-Engineering: [Airflow] Automate sync'ing archiva packages to HDFS - https://phabricator.wikimedia.org/T294024 (10mforns) [16:59:32] 10Analytics, 10Analytics-Kanban, 10Data-Engineering: [Airflow] Create repository for Airflow DAGs - https://phabricator.wikimedia.org/T294026 (10mforns) [17:01:22] 10Analytics, 10Analytics-Kanban, 10Data-Engineering: [Airflow] Create repository for Airflow DAGs - https://phabricator.wikimedia.org/T294026 (10mforns) [17:01:42] 10Analytics: Agree on a repository structure for Airflow-related code - https://phabricator.wikimedia.org/T290664 (10mforns) [17:47:40] 10Analytics, 10Analytics-EventLogging, 10Data-Engineering, 10Data-Engineering-Kanban, and 5 others: Migrate WikibaseTermboxInteraction EventLogging Schema to new EventPlatform thingy - https://phabricator.wikimedia.org/T290303 (10mforns) [17:49:11] 10Analytics, 10Data-Engineering: [EventGate] Failures when getting stream config from MediaWiki API - https://phabricator.wikimedia.org/T286793 (10mforns) [17:49:25] 10Analytics, 10Analytics-Kanban, 10Data-Engineering, 10Patch-For-Review, 10Product-Analytics (Kanban): Add SearchSatisfaction to the allowlist - https://phabricator.wikimedia.org/T274607 (10mforns) [17:49:40] 10Analytics, 10Analytics-Kanban, 10Data-Engineering, 10Patch-For-Review: Add logic to purging scripts that requires admin action if it's about to delete a lot of data - https://phabricator.wikimedia.org/T270433 (10mforns) [17:49:52] 10Analytics, 10Analytics-Kanban, 10Data-Engineering: Switch off skipTrash for some data purging - https://phabricator.wikimedia.org/T270431 (10mforns) [18:38:38] 10Analytics, 10Data-Engineering: Results have expired error in Hue - https://phabricator.wikimedia.org/T294144 (10EYener) [19:56:16] 10Analytics: Create new table for 'referer' aggregated data - https://phabricator.wikimedia.org/T112284 (10Milimetric) I just realized I personally finished and merged some of this work with Isaac and Baha earlier this year: presto:wmf> desc referrer_daily; |Column | Type | Extra |... [20:17:25] (03PS6) 10Clare Ming: Add new schema for desktop UI scroll tracking. [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/731156 (https://phabricator.wikimedia.org/T292586) [20:43:08] (03CR) 10jerkins-bot: [V: 04-1] Add new schema for desktop UI scroll tracking. [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/731156 (https://phabricator.wikimedia.org/T292586) (owner: 10Clare Ming) [21:14:45] (03PS7) 10Clare Ming: Add new schema for desktop UI scroll tracking. [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/731156 (https://phabricator.wikimedia.org/T292586) [21:20:21] (03CR) 10Clare Ming: Add new schema for desktop UI scroll tracking. (033 comments) [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/731156 (https://phabricator.wikimedia.org/T292586) (owner: 10Clare Ming)