[00:28:38] 10Data-Engineering, 10Event-Platform Value Stream (Sprint 05): We should provide utilities for local development and unit testing of Python streaming services - https://phabricator.wikimedia.org/T324951 (10Ottomata) https://github.com/apache/flink/blob/master/flink-python/pyflink/testing/test_case_utils.py [04:29:54] PROBLEM - Check systemd state on an-launcher1002 is CRITICAL: CRITICAL - degraded: The following units failed: monitor_refine_event_sanitized_analytics_immediate.service https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state [06:47:27] 10Data-Engineering-Planning, 10Event-Platform Value Stream (Sprint 05): Flink + Event Platform integration for writing into streams via Table API - https://phabricator.wikimedia.org/T324114 (10tchin) After experimenting a bit, I was able to get the catalog to override the schema option of specific tables using... [08:33:29] 10Data-Engineering-Planning, 10Shared-Data-Infrastructure: Upgrade db1108 to Bullseye - https://phabricator.wikimedia.org/T304492 (10Marostegui) Any ETA on when this host will be upgraded to Bullseye? [09:01:39] 10Data-Engineering-Radar, 10MW-on-K8s, 10serviceops: IPInfo MediaWiki extension depends on presence of maxmind db in the container/host - https://phabricator.wikimedia.org/T288375 (10Joe) Basically we set `wgIPInfoGeoIP2EnterprisePath` to `/usr/share/GeoIPInfo/`. That directory gets populated on the appserve... [09:37:47] 10Data-Engineering-Radar, 10MW-on-K8s, 10serviceops: IPInfo MediaWiki extension depends on presence of maxmind db in the container/host - https://phabricator.wikimedia.org/T288375 (10Clement_Goubert) a:03Clement_Goubert [09:48:42] 10Data-Engineering, 10Event-Platform Value Stream (Sprint 05): We should provide utilities for local development and unit testing of Python streaming services - https://phabricator.wikimedia.org/T324951 (10gmodena) >>! In T324951#8465394, @Ottomata wrote: > https://github.com/apache/flink/blob/master/flink-pyt... [12:41:05] 10Data-Engineering, 10Equity-Landscape: Grants input metric - https://phabricator.wikimedia.org/T309276 (10KCVelaga_WMF) @ntsako there is a small error that needs fixing. In this block: ` historical_grants AS ( SELECT country_code, sum(total_grants_calendar_year) AS total_historical_grants,... [13:06:45] 10Data-Engineering, 10Equity-Landscape: Grants input metric - https://phabricator.wikimedia.org/T309276 (10KCVelaga_WMF) @ntsako also unrelated to grants, but Jaime mentioned that the affiliate leadership calculation has been updated to use to historical weighted dollars, rather than raw USD. When calculating... [14:03:25] 10Data-Engineering, 10Event-Platform Value Stream (Sprint 05): Flink wrappers and helper libraries should be moved into a dedicated git repo with packaging and CI. - https://phabricator.wikimedia.org/T324746 (10JArguello-WMF) [14:04:14] 10Data-Engineering, 10Event-Platform Value Stream: [EPIC] Streaming and event driven Python services - https://phabricator.wikimedia.org/T324689 (10JArguello-WMF) [14:42:03] 10Data-Engineering-Planning, 10Event-Platform Value Stream (Sprint 05): Flink + Event Platform integration for writing into streams via Table API - https://phabricator.wikimedia.org/T324114 (10Ottomata) OOO very cool and very useful. Can we do that for all table properies? For kafka connector especially, ther... [14:58:25] 10Data-Engineering-Planning, 10LDAP-Access-Requests, 10SRE, 10SRE-Access-Requests, and 2 others: Grant Access to 'wmf' LDAP group for 'Sbenchagra' - https://phabricator.wikimedia.org/T324696 (10akosiaris) 05Open→03Resolved a:03akosiaris Thanks @jhathaway. user has been added to the WMF group. Resolvi... [15:10:41] (03PS1) 10Matthias Mullie: Add click-snippet to searchpreview's action enum [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/868095 (https://phabricator.wikimedia.org/T321069) [15:13:13] (03CR) 10Matthias Mullie: [C: 04-2] "DNM for now; checking whether more work remains to be done" [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/868095 (https://phabricator.wikimedia.org/T321069) (owner: 10Matthias Mullie) [16:06:24] 10Data-Engineering-Planning, 10Data Pipelines (Sprint 05-06): Include EU Registered Country in the canonical country database - https://phabricator.wikimedia.org/T324995 (10mforns) [16:08:54] 10Data-Engineering-Planning, 10Data Pipelines (Sprint 05-06): Include EU Registered Country in the canonical country database - https://phabricator.wikimedia.org/T324995 (10mforns) a:03mforns [16:48:44] 10Data-Engineering-Planning, 10Data Pipelines (Sprint 05-06): Verify DAG Compatibility with version V2.3.4 of Airflow - https://phabricator.wikimedia.org/T309552 (10Antoine_Quhen) [16:53:25] 10Data-Engineering-Planning, 10Data Pipelines (Sprint 05-06): Verify DAG Compatibility with version V2.3.4 of Airflow - https://phabricator.wikimedia.org/T309552 (10Antoine_Quhen) [16:54:44] 10Data-Engineering-Planning, 10Data Pipelines (Sprint 05-06): Verify DAG Compatibility with version V2.3.4 of Airflow - https://phabricator.wikimedia.org/T309552 (10Antoine_Quhen) [17:02:25] PROBLEM - Checks that the airflow database for airflow research is working properly on an-airflow1002 is CRITICAL: CRITICAL: /usr/bin/env AIRFLOW_HOME=/srv/airflow-research /usr/lib/airflow/bin/airflow db check did not succeed https://wikitech.wikimedia.org/wiki/Analytics/Systems/Airflow [17:05:14] MySQLdb._exceptions.OperationalError: (1040, 'Too many connections') [17:05:25] as far as I can see executing the check [17:05:37] RECOVERY - Checks that the airflow database for airflow research is working properly on an-airflow1002 is OK: OK: /usr/bin/env AIRFLOW_HOME=/srv/airflow-research /usr/lib/airflow/bin/airflow db check succeeded https://wikitech.wikimedia.org/wiki/Analytics/Systems/Airflow [17:06:08] mmmmm [17:10:37] 10Data-Engineering, 10Event-Platform Value Stream: [EPIC] Flink Applications on Kubernetes - https://phabricator.wikimedia.org/T324578 (10Ottomata) [19:46:45] 10Data-Engineering-Planning, 10Data Pipelines, 10Infrastructure-Foundations, 10Shared-Data-Infrastructure: Also intake Network Error Logging events into the Analytics Data Lake - https://phabricator.wikimedia.org/T304373 (10CDanis) Hi @Ottomata @odimitrijevic @EChetty @lmata @KOfori -- Apologies for the e... [20:28:48] (03PS1) 10Sergio Gimeno: Impact module: instrument open/close actions on the information tooltips [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/868162 (https://phabricator.wikimedia.org/T325041) [20:49:31] (03CR) 10Gergő Tisza: [C: 04-1] Impact module: instrument open/close actions on the information tooltips (031 comment) [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/868162 (https://phabricator.wikimedia.org/T325041) (owner: 10Sergio Gimeno) [21:09:00] (03PS2) 10Sergio Gimeno: Impact module: instrument open/close actions on the information tooltips [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/868162 (https://phabricator.wikimedia.org/T325041) [21:16:26] (03CR) 10Sergio Gimeno: Impact module: instrument open/close actions on the information tooltips (031 comment) [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/868162 (https://phabricator.wikimedia.org/T325041) (owner: 10Sergio Gimeno) [21:17:20] (03CR) 10Sergio Gimeno: Impact module: instrument open/close actions on the information tooltips (031 comment) [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/868162 (https://phabricator.wikimedia.org/T325041) (owner: 10Sergio Gimeno) [22:13:46] (03CR) 10Gergő Tisza: [C: 03+2] Impact module: instrument open/close actions on the information tooltips [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/868162 (https://phabricator.wikimedia.org/T325041) (owner: 10Sergio Gimeno) [22:14:35] (03Merged) 10jenkins-bot: Impact module: instrument open/close actions on the information tooltips [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/868162 (https://phabricator.wikimedia.org/T325041) (owner: 10Sergio Gimeno) [22:35:07] (03PS1) 10Simone Cuomo: Modify SearchPreview action to align with requirements [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/868187 (https://phabricator.wikimedia.org/T321069) [22:38:23] (03CR) 10Simone Cuomo: "I have applied and tested the changes locally. I was not able to test using 1.0.0 locally and had to change to 1.1.0 for it to work, but p" [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/868187 (https://phabricator.wikimedia.org/T321069) (owner: 10Simone Cuomo) [23:37:46] 10Data-Engineering-Radar, 10MW-on-K8s, 10serviceops, 10Patch-For-Review: IPInfo MediaWiki extension depends on presence of maxmind db in the container/host - https://phabricator.wikimedia.org/T288375 (10Dzahn) >>! In T288375#8465821, @Joe wrote: >...`/usr/share/GeoIPInfo/`. That directory gets populated on... [23:50:43] 10Data-Engineering-Planning, 10Data Pipelines: Document known data quality issues on Wikistats - https://phabricator.wikimedia.org/T325256 (10odimitrijevic)