[04:25:23] 10Data-Engineering-Radar, 10Data-Services, 10cloud-services-team (Kanban): Upgrade clouddb* hosts to Bullseye - https://phabricator.wikimedia.org/T299480 (10Marostegui) Yes, it is pretty much the same. Remember that there're two hosts per section, so you could depool at least half of them and let the others... [11:23:12] (VarnishkafkaNoMessages) firing: ... [11:23:12] varnishkafka for instance cp6009:9132 is not logging cache_text requests from eventlogging - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Varnishkafka - https://grafana.wikimedia.org/d/000000253/varnishkafka?orgId=1&var-datasource=drmrs%20prometheus/ops&var-source=eventlogging&var-cp_cluster=cache_text&var-instance=cp6009:9132&viewPanel=14 - https://alerts.wikimedia.org/?q=alertname%3DVarnishkafkaNoMessages [11:39:51] 10Data-Engineering, 10Airflow: [Airflow] Organize hackathon - https://phabricator.wikimedia.org/T295204 (10mforns) [12:39:04] 10Data-Engineering: Make HTML Dumps available in hadoop - https://phabricator.wikimedia.org/T305688 (10MGerlach) [13:04:06] 10Data-Engineering, 10Data-Engineering-Kanban, 10Airflow, 10Discovery-Search, and 4 others: Write an Airflow job converting commons structured data dump to Hive - https://phabricator.wikimedia.org/T299059 (10JAllemandou) 05Open→03Resolved [13:04:13] 10Data-Engineering, 10Data-Engineering-Kanban, 10Product-Analytics, 10Structured-Data-Backlog, and 3 others: Create a Commons equivalent of the wikidata_entity table in the Data Lake - https://phabricator.wikimedia.org/T258834 (10JAllemandou) [14:02:03] 10Data-Engineering, 10Data-Engineering-Kanban, 10Data-Catalog, 10Patch-For-Review: Configure LDAP authentication for the DataHub frontend - https://phabricator.wikimedia.org/T301462 (10Milimetric) Superset seems to be doing this through CAS, but maybe you can find how CAS is doing it? https://gerrit.wikim... [14:23:26] 10Data-Engineering, 10Data-Engineering-Kanban, 10Product-Analytics, 10Superset: Help with data that's not appearing on charts - https://phabricator.wikimedia.org/T301895 (10Milimetric) @odimitrijevic yes, this is an upstream bug on how they render this visualization. My guess is that they're using the loc... [14:38:02] 10Data-Engineering, 10Data-Engineering-Kanban, 10Patch-For-Review: Upgrade Turnilo - https://phabricator.wikimedia.org/T301990 (10Milimetric) >>! In T301990#7836751, @razzi wrote: > So we'll have to upgrade node from version 10.24 on an-tool1005 to at least 12 to upgrade turnilo (at least to the latest versi... [14:38:56] 10Data-Engineering, 10Code-Health-Objective, 10Epic, 10Platform Engineering Roadmap, and 2 others: Problem details for HTTP APIs (rfc7807) - https://phabricator.wikimedia.org/T302536 (10Milimetric) >> How about `instance_part`? > > If we're going to make something up, why not just stick with `uri`? +1 [14:40:09] 10Quarry: Explain command forces Quarry to keep running endlessly - https://phabricator.wikimedia.org/T155808 (10rook) 05Open→03Resolved [14:40:13] 10Quarry: Explain command forces Quarry to keep running endlessly - https://phabricator.wikimedia.org/T155808 (10rook) Running EXPLAIN at this point gives me: `ANALYZE/EXPLAIN/SHOW can not be issued; lacking privileges for underlying table` We could say that itself is a problem. But it would be reasonable to ope... [15:03:09] 10Data-Engineering, 10Data-Engineering-Kanban, 10Patch-For-Review: Pageview definition relies on X-Analytics to determine special pages - https://phabricator.wikimedia.org/T304362 (10Milimetric) I'm trying to figure out if this was deployed and could use a little help. So I see: https://gerrit.wikimedia.or... [15:09:59] 10Analytics, 10Analytics-Wikistats, 10Data-Engineering: Confusing filtering on "Active editors by country" topic - https://phabricator.wikimedia.org/T300365 (10Milimetric) p:05Triage→03Medium I kind of confused things by making that subtask. The stuff left on this task is lower priority and contingent o... [15:11:26] 10Data-Engineering, 10Data-Engineering-Kanban, 10Patch-For-Review: Data Quality: Airflow migration - https://phabricator.wikimedia.org/T304884 (10Milimetric) (deployed by Marcel) [15:20:23] 10Data-Engineering, 10Data-Engineering-Kanban, 10Product-Analytics, 10wmfdata-python, 10GitLab (Project Migration): Move Wmfdata-Python from Github to Gitlab - https://phabricator.wikimedia.org/T304544 (10Milimetric) a:03Milimetric [15:20:44] 10Data-Engineering, 10Product-Analytics, 10wmfdata-python: `spark.memory.driver` option does not get applied with "client" deployment mode. - https://phabricator.wikimedia.org/T284630 (10Milimetric) Prioritizing {T304544} now [15:21:26] (heh, sorry, but I'm at Phab 0, so rejoice with me :)) [15:58:56] (03CR) 10AGueyte: Add event_ipinfo_version to ipinfo_interaction schema (032 comments) [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/777816 (https://phabricator.wikimedia.org/T296417) (owner: 10Tchanders) [16:01:15] (03PS7) 10Joal: [WIP] Add flink job reporting webrequest patterns [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/763610 [16:22:14] 10Quarry: Quarry queries seem not to run for fawiki - https://phabricator.wikimedia.org/T291053 (10rook) This is probably related to T170464 try renaming your column, seemed to work in a fork: https://quarry.wmcloud.org/query/63675 The difference being: `SELECT p1.page_title, cl1.cl_to, cl2.cl_to ` became... [16:34:01] 10Data-Engineering: Add a new member to the airlfow-dags repository - https://phabricator.wikimedia.org/T305719 (10bmansurov) [16:34:21] (03PS1) 10NOkafor: Added browser_general and interlanguage hql files to /hql Bug: T300025, T302875 [analytics/refinery] - 10https://gerrit.wikimedia.org/r/778550 (https://phabricator.wikimedia.org/T300025) [16:36:14] 10Quarry: Quarry queries seem not to run for fawiki - https://phabricator.wikimedia.org/T291053 (10Huji) [16:36:52] 10Quarry: Quarry queries seem not to run for fawiki - https://phabricator.wikimedia.org/T291053 (10Huji) [16:36:57] 10Quarry: Quarry cannot store results with identical column names - https://phabricator.wikimedia.org/T170464 (10Huji) [16:42:19] 10Quarry: Query in quarry seems not to finish but same query runs fine in PAWS - https://phabricator.wikimedia.org/T299292 (10rook) This is probably related to T170464 try renaming your one of your same named columns, seemed to work in a fork: https://quarry.wmcloud.org/query/63679 `SELECT subcat.page_title,... [16:45:49] 10Data-Engineering, 10Data-Engineering-Kanban, 10Patch-For-Review: Pageview definition relies on X-Analytics to determine special pages - https://phabricator.wikimedia.org/T304362 (10awight) Are `ns` and `page_id` also set? If not, then maybe we're missing the new code because `MW_API` is true. I'm now get... [16:53:10] 10Data-Engineering, 10CheckUser, 10MW-1.38-notes (1.38.0-wmf.26; 2022-03-14), 10MW-1.39-notes (1.39.0-wmf.7; 2022-04-11), and 3 others: Update CheckUser for actor and comment table - https://phabricator.wikimedia.org/T233004 (10Zabe) a:03Zabe [17:02:37] 10Quarry: some quarry fails silently with status 500 - https://phabricator.wikimedia.org/T269668 (10rook) Closing. Please re-open if this can be reproduced. [17:02:41] 10Quarry: some quarry fails silently with status 500 - https://phabricator.wikimedia.org/T269668 (10rook) 05Open→03Declined [17:09:50] 10Quarry: Query in quarry seems not to finish but same query runs fine in PAWS - https://phabricator.wikimedia.org/T299292 (10Effeietsanders) @rook thanks, very helpful to be more aware of and silly that I didn't think of it! I think the ticket is still valid, because expected behavior would still be that an e... [23:13:02] (03PS1) 10Sharvaniharan: Android schemas migrated from legacy [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/778603 [23:13:30] (03CR) 10jerkins-bot: [V: 04-1] Android schemas migrated from legacy [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/778603 (owner: 10Sharvaniharan) [23:14:04] (03PS2) 10Sharvaniharan: Android schemas migrated from legacy [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/778603 [23:14:33] (03CR) 10jerkins-bot: [V: 04-1] Android schemas migrated from legacy [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/778603 (owner: 10Sharvaniharan) [23:17:50] (03PS3) 10Sharvaniharan: Android schemas migrated from legacy [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/778603