[00:15:45] 10Analytics, 10Analytics-Wikistats, 10Data-Engineering-Radar, 10Product-Analytics, and 3 others: iOS Engineering: Include pageview=1 in x-analytics header for requests to commons.wikimedia.org - https://phabricator.wikimedia.org/T303567 (10SNowick_WMF) [00:21:56] 10Analytics, 10Analytics-Wikistats, 10Data-Engineering-Radar, 10Product-Analytics, and 4 others: Android Engineering: Include pageview=1 in x-analytics header for requests to commons.wikimedia.org. - https://phabricator.wikimedia.org/T303568 (10SNowick_WMF) [00:22:21] 10Analytics, 10Analytics-Wikistats, 10Data-Engineering-Radar, 10Product-Analytics, 10Wikipedia-Android-App-Backlog (Android Release FY2021-22): Android Engineering: Include pageview=1 in x-analytics header for requests to commons.wikimedia.org. - https://phabricator.wikimedia.org/T303568 (10SNowick_WMF) [01:16:23] 10Analytics, 10Analytics-Wikistats, 10Data-Engineering, 10Data-Engineering-Radar, and 2 others: Android Engineering: Include pageview=1 in x-analytics header for requests to commons.wikimedia.org. - https://phabricator.wikimedia.org/T303568 (10Dbrant) @SNowick_WMF Can we clarify what we mean by a "pagevie... [03:16:20] 10Data-Engineering, 10CheckUser, 10Patch-For-Review, 10Platform Team Workboards (Clinic Duty Team), 10Schema-change: Normalize CheckUser tables - https://phabricator.wikimedia.org/T233004 (10Zabe) 05Stalled→03Open [03:17:45] 10Data-Engineering, 10CheckUser, 10Patch-For-Review, 10Platform Team Workboards (Clinic Duty Team), 10Schema-change: Normalize CheckUser tables - https://phabricator.wikimedia.org/T233004 (10Zabe) Changed the task from being a weird mix of requesing an application of a schema change on production and a t... [03:20:39] 10Analytics, 10Analytics-Wikistats, 10Data-Engineering, 10Data-Engineering-Radar, and 4 others: iOS Engineering: Include pageview=1 in x-analytics header for requests to commons.wikimedia.org - https://phabricator.wikimedia.org/T303567 (10Wohyoun5) It was a reform of consciousness through. It had to give... [03:29:18] 10Data-Engineering, 10CheckUser, 10Patch-For-Review, 10Platform Team Workboards (Clinic Duty Team), 10Schema-change: Update CheckUser for actor and comment table - https://phabricator.wikimedia.org/T233004 (10Zabe) [08:09:34] 10Data-Engineering, 10Data-Engineering-Kanban, 10Airflow, 10Data-Catalog: Complete monitoring setup of datahubsearch nodes - https://phabricator.wikimedia.org/T302818 (10jcrespo) FYI, prometheus-elasticsearch-exporter-9200.service is failing at the moment due to a missconfiguration: ` ✔️ root@datahubsearch... [09:45:52] 10Data-Engineering, 10Data-Engineering-Kanban, 10Airflow, 10Data-Catalog: Complete monitoring setup of datahubsearch nodes - https://phabricator.wikimedia.org/T302818 (10BTullis) Thanks @jcrespo - The cause of it seems to be a difference in the version of the prometheus-elasticsearch-exporter between buste... [10:22:42] 10Data-Engineering, 10CheckUser, 10Patch-For-Review, 10Platform Team Workboards (Clinic Duty Team), 10Schema-change: Update CheckUser for actor and comment table - https://phabricator.wikimedia.org/T233004 (10Ladsgroup) Thank you for doing this! [10:35:01] 10Data-Engineering-Radar, 10ExternalGuidance, 10MediaWiki-extensions-WikimediaEvents: Decommission the ExternalGuidance instrument - https://phabricator.wikimedia.org/T303508 (10phuedx) >>! In T303508#7766820, @phuedx wrote: >> Remove the ExternalGuidance event sanitisation allowlist entry > > Should the en... [10:37:38] 10Data-Engineering-Radar, 10ExternalGuidance, 10MediaWiki-extensions-WikimediaEvents: Decommission the ExternalGuidance instrument - https://phabricator.wikimedia.org/T303508 (10phuedx) [10:57:11] 10Data-Engineering-Radar, 10ExternalGuidance, 10MediaWiki-extensions-WikimediaEvents, 10Patch-For-Review: Decommission the ExternalGuidance instrument - https://phabricator.wikimedia.org/T303508 (10phuedx) > Mark the schema as inactive by editing the SchemaDoc template on the schema's talk page Done in ht... [10:57:25] 10Data-Engineering-Radar, 10ExternalGuidance, 10MediaWiki-extensions-WikimediaEvents, 10Patch-For-Review: Decommission the ExternalGuidance instrument - https://phabricator.wikimedia.org/T303508 (10phuedx) [11:08:04] 10Data-Engineering, 10SRE, 10ops-eqiad: analytics10[63,67] mgmt interfaces seem flapping from time to time - https://phabricator.wikimedia.org/T303151 (10elukey) [11:09:14] 10Data-Engineering, 10SRE, 10ops-eqiad: analytics10[63,67] mgmt interfaces seem flapping from time to time - https://phabricator.wikimedia.org/T303151 (10BTullis) Yes, I'm happy to shut down these nodes whenever @Cmjohnson prefers. [11:10:02] (03PS1) 10Phuedx: Remove ExternalGuidance from allow list [analytics/refinery] - 10https://gerrit.wikimedia.org/r/769937 (https://phabricator.wikimedia.org/T303508) [11:28:42] 10Data-Engineering, 10Data-Catalog, 10SRE, 10serviceops, 10Service-deployment-requests: New Service Request: DataHub - https://phabricator.wikimedia.org/T303049 (10BTullis) I've updated the helm charts for datahub so that the secrets handling is compatible with our puppet based secret handling method. T... [11:42:15] 10Data-Engineering, 10Data-Catalog, 10SRE, 10serviceops, 10Service-deployment-requests: New Service Request: DataHub - https://phabricator.wikimedia.org/T303049 (10BTullis) [11:44:15] 10Data-Engineering, 10Data-Catalog, 10SRE, 10serviceops, 10Service-deployment-requests: New Service Request: DataHub - https://phabricator.wikimedia.org/T303049 (10BTullis) I've updated the diagram to clarify the way that traffic is intended to flow within the deployment - i.e. requests to the GMS do not... [12:08:48] 10Data-Engineering, 10Data-Engineering-Kanban, 10Airflow, 10Data-Catalog: Complete monitoring setup of datahubsearch nodes - https://phabricator.wikimedia.org/T302818 (10BTullis) [12:25:28] 10Data-Engineering-Kanban, 10SRE, 10SRE-Access-Requests: Requesting access to DataEngineering Team Resources for NOkafor - https://phabricator.wikimedia.org/T303516 (10BTullis) I'll carry out this work. I can also confirm that Njideka is WMF staff on the Data Engineering team and that she requires these pri... [12:27:23] 10Data-Engineering-Kanban, 10SRE, 10SRE-Access-Requests: Requesting access to DataEngineering Team Resources for NOkafor - https://phabricator.wikimedia.org/T303516 (10BTullis) [12:29:49] 10Data-Engineering-Kanban, 10LDAP-Access-Requests: Grant Access to LDAP wmf group for NOkafor - https://phabricator.wikimedia.org/T303512 (10BTullis) [12:31:13] 10Data-Engineering-Kanban, 10LDAP-Access-Requests: Grant Access to LDAP wmf group for NOkafor - https://phabricator.wikimedia.org/T303512 (10BTullis) p:05Triage→03Medium [12:31:22] 10Data-Engineering-Kanban, 10SRE, 10SRE-Access-Requests: Requesting access to DataEngineering Team Resources for NOkafor - https://phabricator.wikimedia.org/T303516 (10BTullis) p:05Triage→03Medium [12:42:31] 10Data-Engineering-Kanban, 10SRE, 10SRE-Access-Requests: Requesting access to DataEngineering Team Resources for NOkafor - https://phabricator.wikimedia.org/T303516 (10BTullis) [12:47:01] 10Data-Engineering-Kanban, 10SRE, 10SRE-Access-Requests: Requesting access to DataEngineering Team Resources for NOkafor - https://phabricator.wikimedia.org/T303516 (10BTullis) Technically, the procedure states that I'm also supposed to wait for @Ottomata to approve, although @Milimetric has also been approv... [13:11:16] 10Data-Engineering, 10MediaWiki-extensions-EventLogging: Generate $wgEventLoggingSchemas from $wgEventStreams - https://phabricator.wikimedia.org/T303602 (10phuedx) [13:16:11] 10Data-Engineering, 10MediaWiki-extensions-EventLogging: Generate $wgEventLoggingSchemas from $wgEventStreams - https://phabricator.wikimedia.org/T303602 (10phuedx) [13:18:46] 10Data-Engineering, 10MediaWiki-extensions-EventLogging: Generate $wgEventLoggingSchemas from $wgEventStreams - https://phabricator.wikimedia.org/T303602 (10phuedx) @Ottomata: I'd appreciate your thoughts on this, whenever you have a spare moment. [13:25:40] 10Data-Engineering-Kanban, 10SRE, 10SRE-Access-Requests: Requesting access to DataEngineering Team Resources for NOkafor - https://phabricator.wikimedia.org/T303516 (10BTullis) `cross-validate-accounts` exits without error. ` btullis@mwmaint1002:~$ cross-validate-accounts --username nokafor --uid 38462 --ema... [14:45:41] 10Data-Engineering-Kanban, 10SRE, 10SRE-Access-Requests, 10Patch-For-Review: Requesting access to DataEngineering Team Resources for NOkafor - https://phabricator.wikimedia.org/T303516 (10Milimetric) I think Andrew just delegated to me for when he's out of town, but I approve! [15:20:02] 10Data-Engineering, 10Data-Engineering-Kanban, 10Data-Catalog: Configure MariaDB database for DataHub on an-coord1001 - https://phabricator.wikimedia.org/T301459 (10BTullis) p:05Triage→03High a:03BTullis [15:26:33] 10Data-Engineering, 10Data-Engineering-Kanban, 10Data-Catalog, 10Patch-For-Review: Configure MariaDB database for DataHub on an-coord1001 - https://phabricator.wikimedia.org/T301459 (10BTullis) I have created a CR that allows the wikikube and staging Kubernetes clusters access to the MariaDB port running o... [15:32:10] 10Data-Engineering, 10Data-Engineering-Kanban, 10Data-Catalog, 10Patch-For-Review: Configure MariaDB database for DataHub on an-coord1001 - https://phabricator.wikimedia.org/T301459 (10BTullis) I will create the `datahub` database and its user account manually on an-coord1001. However I will try using the... [15:43:59] anyone around wanna help me troubleshoot a python environment confusion I'm having? [15:45:06] milimetric: Can do, although I might not be be the most qualified. :-) [15:45:23] btullis: worth a shot, let's do 5 min in the cave? [15:45:46] omw [16:23:19] 10Analytics-Kanban, 10Data-Engineering, 10Data-Engineering-Kanban, 10Event-Platform, and 4 others: Determine which remaining legacy EventLogging schemas need to be migrated or decommissioned - https://phabricator.wikimedia.org/T282131 (10phuedx) [16:33:14] 10Analytics, 10Data-Engineering, 10Event-Platform: Automate EventGate validation error reporting - https://phabricator.wikimedia.org/T268027 (10odimitrijevic) Let's take the time in Q4 to triage the Event-Platform Backlog and prioritize some of the improvements especially around data quality. [16:34:10] 10Data-Engineering: Modify Matamo to use GeoIP2 databases - https://phabricator.wikimedia.org/T303462 (10odimitrijevic) 05Open→03Declined Matomo is already using GeoIP2 databases [16:34:13] 10Data-Engineering: Migrate to MaxMind GeoIP2 - https://phabricator.wikimedia.org/T302989 (10odimitrijevic) [16:35:30] 10Data-Engineering, 10Data-Engineering-Kanban, 10Epic: Analytics Platform Future State Planing - https://phabricator.wikimedia.org/T302728 (10odimitrijevic) [16:45:27] 10Data-Engineering, 10Spike: Identify Opportunities in using the new GeoIP2 databases - https://phabricator.wikimedia.org/T303466 (10odimitrijevic) 05Open→03Declined The data engineering team is already on GeoIP2. There is still some merit to doing this however we can investigate once we have the data ca... [16:45:29] 10Data-Engineering: Migrate to MaxMind GeoIP2 - https://phabricator.wikimedia.org/T302989 (10odimitrijevic) [16:45:49] 10Data-Engineering: Migrate to MaxMind GeoIP2 - https://phabricator.wikimedia.org/T302989 (10odimitrijevic) [16:45:51] 10Data-Engineering: Modify Refine jobs to use GeoIP2 databases - https://phabricator.wikimedia.org/T303463 (10odimitrijevic) 05Open→03Declined [18:14:19] 10Quarry: some quarry fails silently with status 500 - https://phabricator.wikimedia.org/T269668 (10rook) The ticket query (https://quarry.wmflabs.org/query/50070) seems to have run. I forked it (https://quarry.wmcloud.org/query/63032) which also seemed to run. Can the described failure be recreated? [18:17:40] (03PS3) 10Vivian Rook: view.js: Show full run date in UTC [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/517145 (https://phabricator.wikimedia.org/T215831) (owner: 10Framawiki) [18:47:08] (03CR) 10Vivian Rook: [C: 03+1] "Seems to work fine in the dev env" [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/517145 (https://phabricator.wikimedia.org/T215831) (owner: 10Framawiki) [22:22:35] 10Data-Engineering, 10Airflow, 10Product-Analytics: Add Product-Analytics Announcements to Airflow job for notifications - https://phabricator.wikimedia.org/T301281 (10Mayakp.wiki) [22:23:47] 10Analytics, 10Analytics-Wikistats, 10Data-Engineering-Radar, 10Product-Analytics, and 4 others: Wikistats pageview data missing counts for Mobile App pageviews on Commons, going back to 2020-11 - https://phabricator.wikimedia.org/T299439 (10mpopov) Just because there //were// page views for Commons from t... [22:30:26] 10Analytics, 10Analytics-Wikistats, 10Data-Engineering, 10Data-Engineering-Radar, and 2 others: Android Engineering: Include pageview=1 in x-analytics header for requests to commons.wikimedia.org. - https://phabricator.wikimedia.org/T303568 (10mpopov) @SNowick_WMF: I agree with @Dbrant. I added this topic... [22:30:52] 10Analytics, 10Analytics-Wikistats, 10Data-Engineering, 10Data-Engineering-Radar, and 4 others: iOS Engineering: Include pageview=1 in x-analytics header for requests to commons.wikimedia.org - https://phabricator.wikimedia.org/T303567 (10mpopov) The Product Analytics team will consider how Commons conten... [23:14:17] 10Analytics, 10Analytics-Wikistats, 10Data-Engineering, 10Data-Engineering-Radar, and 4 others: iOS Engineering: Include pageview=1 in x-analytics header for requests to commons.wikimedia.org - https://phabricator.wikimedia.org/T303567 (10mpopov) [23:14:26] 10Analytics, 10Analytics-Wikistats, 10Data-Engineering, 10Data-Engineering-Radar, and 2 others: Android Engineering: Include pageview=1 in x-analytics header for requests to commons.wikimedia.org. - https://phabricator.wikimedia.org/T303568 (10mpopov) [23:40:04] 10Analytics, 10Analytics-Kanban, 10Data-Engineering-Kanban, 10wmfdata-python, 10Product-Analytics (Kanban): wmfdata-python's Hive query output includes logspam - https://phabricator.wikimedia.org/T275233 (10nshahquinn-wmf) 05Open→03Resolved @Milimetric released it in version 1.3.3!