[00:04:05] PROBLEM - Checks that the local airflow scheduler for airflow @analytics is working properly on an-launcher1002 is CRITICAL: CRITICAL: /usr/bin/env AIRFLOW_HOME=/srv/airflow-analytics /usr/lib/airflow/bin/airflow jobs check --job-type SchedulerJob --hostname an-launcher1002.eqiad.wmnet did not succeed https://wikitech.wikimedia.org/wiki/Analytics/Systems/Airflow [00:05:11] RECOVERY - Checks that the local airflow scheduler for airflow @analytics is working properly on an-launcher1002 is OK: OK: /usr/bin/env AIRFLOW_HOME=/srv/airflow-analytics /usr/lib/airflow/bin/airflow jobs check --job-type SchedulerJob --hostname an-launcher1002.eqiad.wmnet succeeded https://wikitech.wikimedia.org/wiki/Analytics/Systems/Airflow [07:15:40] (03CR) 10Clare Ming: [C: 03+1] analytics/mediawiki/client/metrics_event: Handle custom_data[].data_type of "null" [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/855493 (https://phabricator.wikimedia.org/T322758) (owner: 10Phuedx) [09:03:40] (03CR) 10Clare Ming: [C: 03+2] analytics/mediawiki/client/metrics_event: Handle custom_data[].data_type of "null" [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/855493 (https://phabricator.wikimedia.org/T322758) (owner: 10Phuedx) [09:04:51] (03Merged) 10jenkins-bot: analytics/mediawiki/client/metrics_event: Handle custom_data[].data_type of "null" [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/855493 (https://phabricator.wikimedia.org/T322758) (owner: 10Phuedx) [11:42:16] (03PS9) 10Mazevedo: Add ios talk page interaction schema [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/857759 (https://phabricator.wikimedia.org/T321841) [11:43:16] (03CR) 10CI reject: [V: 04-1] Add ios talk page interaction schema [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/857759 (https://phabricator.wikimedia.org/T321841) (owner: 10Mazevedo) [11:45:40] (03CR) 10Mazevedo: Add ios talk page interaction schema (031 comment) [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/857759 (https://phabricator.wikimedia.org/T321841) (owner: 10Mazevedo) [11:47:33] (03PS10) 10Mazevedo: Add ios talk page interaction schema [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/857759 (https://phabricator.wikimedia.org/T321841) [11:48:03] (03CR) 10CI reject: [V: 04-1] Add ios talk page interaction schema [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/857759 (https://phabricator.wikimedia.org/T321841) (owner: 10Mazevedo) [12:07:39] RECOVERY - Check systemd state on an-presto1006 is OK: OK - running: The system is fully operational https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state [12:17:57] (03PS11) 10Mazevedo: Add ios talk page interaction schema [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/857759 (https://phabricator.wikimedia.org/T321841) [13:00:02] 10Data-Engineering-Planning, 10Shared-Data-Infrastructure (EQ2 Kanban (Sprints 04-05)): Add an-presto10[06-15] to the presto cluster - https://phabricator.wikimedia.org/T323783 (10Stevemunene) Installed package [[ https://packages.debian.org/bullseye/python-is-python3 | python-is-python3 ]] and the presto depe... [14:27:56] (03CR) 10Tsevener: Add ios talk page interaction schema (031 comment) [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/857759 (https://phabricator.wikimedia.org/T321841) (owner: 10Mazevedo) [14:40:10] 10Data-Engineering-Planning, 10Shared-Data-Infrastructure (EQ2 Kanban (Sprints 04-05)): Add an-presto10[06-15] to the presto cluster - https://phabricator.wikimedia.org/T323783 (10elukey) @Stevemunene nice job! One suggestion - if possible let's incorporate the fixes that you applied manually to puppet, so tha... [14:58:56] 10Data-Engineering-Planning, 10Shared-Data-Infrastructure (EQ2 Kanban (Sprints 04-05)): Add an-presto10[06-15] to the presto cluster - https://phabricator.wikimedia.org/T323783 (10Stevemunene) Thanks @elukey Working on that. [15:04:22] 10Data-Engineering-Planning, 10Shared-Data-Infrastructure (EQ2 Kanban (Sprints 04-05)): Add an-presto10[06-15] to the presto cluster - https://phabricator.wikimedia.org/T323783 (10Ottomata) > python-is-python3 a Oh, cool! I wonder if we can get away with installing this everywhere by default? [16:30:05] (03PS1) 10Mforns: Revert "Bump up MediawikiHistoryRunner jar versions to refinery-source 0.2.9" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/863351 [16:32:22] (03CR) 10Milimetric: [V: 03+2 C: 03+2] Revert "Bump up MediawikiHistoryRunner jar versions to refinery-source 0.2.9" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/863351 (owner: 10Mforns) [19:20:19] (03PS1) 10Kosta Harlan: homepagemodule: Add support for newimpact drawer/tour events [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/863385 (https://phabricator.wikimedia.org/T323619) [22:26:20] 10Quarry, 10Cloud-Services, 10cloud-services-team (Kanban): Consider moving Quarry to be an installation of Redash - https://phabricator.wikimedia.org/T169452 (10rook) Superset (https://github.com/apache/superset) is likely worth consideration. At this point it has greater activity than Redash. In a counter... [22:29:51] 10Data-Engineering-Planning, 10Data Pipelines, 10Product-Analytics: Improved edit summary data in mediawiki_history - https://phabricator.wikimedia.org/T318010 (10Isaac) I love this task as another user of hashtags and structured summaries. If adding these fields to mediawiki_history ends up being judged not... [23:10:20] 10Quarry, 10Cloud-Services, 10cloud-services-team (Kanban): Consider moving Quarry to be an installation of Redash - https://phabricator.wikimedia.org/T169452 (10Halfak) In my point of view, there's a couple high value reasons to store result sets for queries. Caching: If we don't store result sets in quarr...