[15:50:51] 06Data-Engineering: Turnilo: invalid transforms on wmf_netflow dashboard - https://phabricator.wikimedia.org/T351731#9970126 (10elukey) Seems to be fixed again after a restart of turnilo. I am not aware of any big change in an-druid nodes, besides recent reboots for kernel updates. [15:55:25] 06Data-Engineering: Turnilo: invalid transforms on wmf_netflow dashboard - https://phabricator.wikimedia.org/T351731#9970135 (10BTullis) Thanks @ayounsi and @elukey for handling this. Not sure if it is related, but I did a full restart (not rolling) today of both druid clusters, because of a role-swap of an-mari... [16:04:52] hey folks, just wondering what else I might need to do for kerberos credentials (see https://phabricator.wikimedia.org/T368911) or if there's nothing, when I should check back again for an update, thanks a lot [16:07:26] 06Data-Engineering, 10SRE-Access-Requests: Request for Kerb credentials for Ariel Glenn - https://phabricator.wikimedia.org/T368911#9970172 (10CDanis) [16:07:45] apergos: afaik that's still done by SRE clinic duty, after approval from analytics; I added the right queue to the ticket [16:08:40] ok, so I need to wait for next week's Monday sre meeting then? [16:10:41] cdanis: [16:10:54] apergos: no, clinic duty person will handle it soon [16:11:04] oh! ok, tyvm for the info [16:11:22] 06Data-Engineering, 10Sustainability (Incident Followup): Site Issue: Delayed data in the `webrequest_sampled_live` Druid table - https://phabricator.wikimedia.org/T369737 (10Kappakayala) 03NEW [16:11:30] 07Analytics-Data-Problem, 06Data-Engineering, 10Data-Engineering-Dashiki, 10Data Products (Data Products Sprint 16), and 2 others: Investigate surprising "10% Other" portion of Analytics Browsers report - https://phabricator.wikimedia.org/T342267#9970215 (10Milimetric) Apologies for the week delay here, I... [16:22:02] 06Data-Engineering, 10Sustainability (Incident Followup): Site Issue: Delayed data in the `webrequest_sampled_live` Druid table - https://phabricator.wikimedia.org/T369737#9970299 (10BTullis) a:03BTullis Hi @Kappakayala - Is the data present now, or is it still absent? i.e. Is there an ongoing incident, or i... [16:28:34] 06Data-Engineering, 10Sustainability (Incident Followup): Site Issue: Delayed data in the `webrequest_sampled_live` Druid table - https://phabricator.wikimedia.org/T369737#9970326 (10Kappakayala) Ah! ok. let me look at the timeline when you carried out that task? the issue happened less than 2 hours ago. [17:16:15] 06Data-Engineering, 06SRE, 10SRE-Access-Requests: Request for Kerb credentials for Ariel Glenn - https://phabricator.wikimedia.org/T368911#9970616 (10Dzahn) Technically you should nudge the person listed as this week's clinic duty. (as of today that's godog). Ticket was just missing the tags for access reque... [17:22:20] 06Data-Engineering, 06SRE, 10SRE-Access-Requests, 13Patch-For-Review: Request for Kerb credentials for Ariel Glenn - https://phabricator.wikimedia.org/T368911#9970632 (10Dzahn) 05Open→03In progress p:05Triage→03High [18:01:11] (03CR) 10Btullis: Add wikilambda_zobject_join query to sqoop (031 comment) [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1041815 (https://phabricator.wikimedia.org/T363434) (owner: 10David Martin) [18:03:52] (03PS1) 10Btullis: Add missing commas to the sqoop query for wikilambda_zobject_join [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1053364 (https://phabricator.wikimedia.org/T363434) [18:11:05] (03CR) 10Jforrester: [C:03+1] Add missing commas to the sqoop query for wikilambda_zobject_join [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1053364 (https://phabricator.wikimedia.org/T363434) (owner: 10Btullis) [18:28:34] (03CR) 10David Martin: [C:03+1] "My bad. Apologies and thanks!" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1053364 (https://phabricator.wikimedia.org/T363434) (owner: 10Btullis) [19:28:36] 06Data-Engineering, 06Data Products: Public DataHub - https://phabricator.wikimedia.org/T366720#9971089 (10lbowmaker) [19:34:33] 06Data-Engineering: [SPIKE] Define process to build out lineage in DataHub - https://phabricator.wikimedia.org/T369758 (10lbowmaker) 03NEW [19:35:11] 06Data-Engineering: [SPIKE] Define process to build out lineage in DataHub - https://phabricator.wikimedia.org/T369758#9971121 (10lbowmaker) [19:41:34] 06Data-Engineering, 07Epic: All things DataHub - https://phabricator.wikimedia.org/T369756#9971158 (10Aklapper) Assuming "we" is #Data-Engineering. [20:14:58] 06Data-Engineering, 10Dumps 2.0 (Kanban Board), 10Event-Platform: [Dumps 2] Spike: Figure root causes of missing rows when doing reconciliation - https://phabricator.wikimedia.org/T368176#9971258 (10Milimetric) I am still trying to find an elegant way to change the queries and show all this, but I just wante... [20:36:40] 06Data-Engineering, 10Dumps 2.0 (Kanban Board), 10Event-Platform: [Dumps 2] Spike: Figure root causes of missing rows when doing reconciliation - https://phabricator.wikimedia.org/T368176#9971336 (10Ottomata) > we seem to just be missing all page deletes, not just the most recent ones ? really? in page_cont... [20:38:01] 06Data-Engineering, 10Dumps 2.0 (Kanban Board), 10Event-Platform: [Dumps 2] Spike: Figure root causes of missing rows when doing reconciliation - https://phabricator.wikimedia.org/T368176#9971350 (10Ottomata) > missing_from_target: probably mostly page restores that we missed Page restores? Hm, indeed, we w...