[05:23:47] 10Data-Engineering: Drop GettingStarted* data - https://phabricator.wikimedia.org/T307774 (10phuedx) >>! In T307774#7957152, @Ottomata wrote: > Should we also remove the tables and data from the event database? Yes. AFAICT they're both empty. [09:13:50] 10Data-Engineering, 10Data-Catalog: DataHub rights assignment is case-sensitive - https://phabricator.wikimedia.org/T309382 (10BTullis) [09:15:56] 10Data-Engineering, 10Data-Catalog: DataHub rights assignment is case-sensitive - https://phabricator.wikimedia.org/T309382 (10BTullis) [09:19:57] 10Data-Engineering, 10Data-Catalog: DataHub rights assignment is case-sensitive - https://phabricator.wikimedia.org/T309382 (10BTullis) This relates to {T307711} and {T305874} but the effects are quite specific, so I thought it worth creating a specific ticket about it. [09:33:06] 10Data-Engineering-Kanban, 10Data-Catalog: User Experience: Authentication - https://phabricator.wikimedia.org/T307711 (10BTullis) I have noticed a gotcha, if perhaps not strictly a bug. {T309382} I'm not yet sure how best to fix this. Perhaps we could downcase the username in the JAAS configuration, or perhap... [13:37:16] SandraEbele: hi! I just noticed we're on ops week this week. I'm finishing up my airflow job review comments and I'll look over ops tasks after that [13:37:56] Yes we are on Ops weeks. Going through some tickets on Ops column [14:30:48] 10Data-Engineering, 10Equity-Landscape: Programs input metric - https://phabricator.wikimedia.org/T309277 (10ntsako) Data loaded onto: ` SELECT * FROM ntsako.program_leadership WHERE year = 2021 ` [14:31:16] 10Data-Engineering, 10Equity-Landscape: Extract + Transformation Raw Data into Input Metrics - https://phabricator.wikimedia.org/T306625 (10ntsako) [14:31:18] 10Data-Engineering, 10Equity-Landscape: Population input metrics - https://phabricator.wikimedia.org/T309279 (10ntsako) 05Open→03In progress [14:53:55] 10Data-Engineering, 10Data-Engineering-Kanban, 10SRE, 10Traffic, 10User-zeljkofilipin: intake-analytics is responsible for up to a 85% of varnish backend fetch errors - https://phabricator.wikimedia.org/T306181 (10zeljkofilipin) [15:26:57] 10Data-Engineering, 10CheckUser, 10MW-1.38-notes (1.38.0-wmf.26; 2022-03-14), 10MW-1.39-notes (1.39.0-wmf.7; 2022-04-11), and 3 others: Update CheckUser for actor and comment table - https://phabricator.wikimedia.org/T233004 (10Zabe) [15:57:24] 10Data-Engineering, 10Event-Platform, 10Generated Data Platform, 10Patch-For-Review: [Shared Event Platform] Ability to use Event Platform streams in Flink without boilerplate - https://phabricator.wikimedia.org/T308356 (10Ottomata) Okay, I got a [[ https://gerrit.wikimedia.org/r/c/wikimedia-event-utilitie... [16:14:06] 10Quarry: Quarry exports integers as floats to wikitable - https://phabricator.wikimedia.org/T151106 (10Abstract09) https://github.com/wikimedia/analytics-quarry-web/blob/5686dc90a569ed4463f12fb58789e3ecb8b6f105/quarry/web/output.py#L157 https://github.com/wikimedia/analytics-quarry-web/blob/5686dc90a569ed4463f1... [17:09:03] 10Data-Engineering, 10Data-Engineering-Kanban, 10SRE, 10Traffic, 10User-zeljkofilipin: intake-analytics is responsible for up to a 85% of varnish backend fetch errors - https://phabricator.wikimedia.org/T306181 (10phuedx) >>! In T306181#7914450, @akosiaris wrote: > I notice that things that take like 1s... [17:48:54] 10Data-Engineering, 10SRE, 10Traffic-Icebox: Mobile redirects drop provenance parameters - https://phabricator.wikimedia.org/T252227 (10Milimetric) > I'm very intrigued @Milimetric about your comment about reinstrumenting pageviews in a declarative way (that sounds like it could help with some of our work ar... [17:51:57] 10Data-Engineering-Kanban, 10Data-Catalog: User Experience: Authentication - https://phabricator.wikimedia.org/T307711 (10Milimetric) >>! In T307711#7930925, @BTullis wrote: > Has anyone carried out any work on ascertaining who will be our data stewards? Not yet, and I don't want to hold this up on that work,... [17:53:08] 10Data-Engineering, 10Data-Catalog: DataHub rights assignment is case-sensitive - https://phabricator.wikimedia.org/T309382 (10Milimetric) seems like a bug to me. If this is a requirement of the system, it should just lowercase transparent to the user. [17:56:29] (03CR) 10Mforns: [C: 03+1] "LGTM overall!" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/791394 (https://phabricator.wikimedia.org/T300021) (owner: 10Snwachukwu) [17:58:51] (03CR) 10Mforns: "I think the api_metrics.hql file has already been moved by another change no?" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/793523 (owner: 10Snwachukwu) [18:14:21] 10Analytics, 10LDAP-Access-Requests, 10SRE: Grant Access to `wmf` for `Dmantena` - https://phabricator.wikimedia.org/T308294 (10Milimetric) @Tsevener is right, and that's the access that @RhinosF1 pointed to. @Dmantena: unfortunately, due to how authentication and authorization works more broadly at wmf, th... [18:14:35] 10Data-Engineering, 10LDAP-Access-Requests, 10SRE: Grant Access to `wmf` for `Dmantena` - https://phabricator.wikimedia.org/T308294 (10Milimetric) [18:25:27] 10Analytics, 10Data-Engineering, 10Data-Engineering-Kanban, 10Platform Engineering, 10Product-Analytics: AQS `edited-pages/new` metric does not make clear that the value is net of deletions - https://phabricator.wikimedia.org/T240860 (10Milimetric) @EChetty: how does this get prioritized though? Is this... [18:48:32] 10Data-Engineering, 10Cassandra: Ensure AQS Cassandra client connections are multi-datacenter - https://phabricator.wikimedia.org/T307799 (10Eevans) >>! In T307799#7925495, @JAllemandou wrote: > From what I have seen we can't specify neither a load-balancing policy nor the local datacenter. BUT, from the docs:... [18:48:49] 10Data-Engineering, 10Cassandra: Ensure AQS Cassandra client connections are multi-datacenter - https://phabricator.wikimedia.org/T307799 (10Eevans) [18:51:39] 10Data-Engineering, 10DC-Ops, 10SRE, 10ops-eqiad: Q4:(Need By: TBD) rack/setup/install an-presto10[06-15].eqiad.wmnet - https://phabricator.wikimedia.org/T306835 (10Jclark-ctr) name rack Unit Port CableID an-presto1006 e1 29 29 20220068 an-presto1007 e1 31 31 20220061 an-presto1008 e2 31 31 20220066 an-pre... [18:52:20] 10Data-Engineering, 10DC-Ops, 10SRE, 10ops-eqiad: Q4:(Need By: TBD) rack/setup/install an-presto10[06-15].eqiad.wmnet - https://phabricator.wikimedia.org/T306835 (10Jclark-ctr) [18:53:32] 10Data-Engineering, 10DC-Ops, 10SRE, 10ops-eqiad: Q4:(Need By: TBD) rack/setup/install an-presto10[06-15].eqiad.wmnet - https://phabricator.wikimedia.org/T306835 (10Jclark-ctr) a:05Jclark-ctr→03Cmjohnson [18:57:40] 10Data-Engineering, 10LDAP-Access-Requests, 10SRE: Grant Access to `wmf` for `Dmantena` - https://phabricator.wikimedia.org/T308294 (10Dzahn) thanks @Milimetric.that makes sense. it was just out of habit to still use that tag. gotcha for next time [19:12:18] 10Data-Engineering, 10Cassandra: Ensure AQS Cassandra client connections are multi-datacenter - https://phabricator.wikimedia.org/T307799 (10Eevans) It's been reported elsewhere that the bulk loader for Image Suggestions is using the same underlying code to interface Cassandra as AQS does, @mfossati, @Cparle i... [19:34:53] 10Analytics, 10API Platform: AQS 2.0 local tests fail when mwcli is running - https://phabricator.wikimedia.org/T304735 (10BPirkle) 05Open→03Resolved a:03BPirkle This was done [[ https://gitlab.wikimedia.org/frankie/aqs-docker-test-env/-/merge_requests/2 | here ]] [19:34:55] 10Data-Engineering, 10Cassandra: Ensure AQS Cassandra client connections are multi-datacenter - https://phabricator.wikimedia.org/T307799 (10Eevans) AQS supports multi-DC by virtue of RESTBase supporting it, and it has been configured for [[ https://gerrit.wikimedia.org/r/plugins/gitiles/operations/puppet/+/re... [19:35:12] 10Data-Engineering, 10Cassandra: Ensure AQS Cassandra client connections are multi-datacenter - https://phabricator.wikimedia.org/T307799 (10Eevans) [19:47:41] (03PS2) 10Mayakpwiki: movement_metrics: Migrate Content Interactions tables and ETL [analytics/wmf-product/jobs] - 10https://gerrit.wikimedia.org/r/799417 (https://phabricator.wikimedia.org/T308695)