[08:04:03] pfischer: are you around for our 1:1? [08:10:59] gehel: Not right now but I sent a new proposal [08:11:45] I'll counter-propose with 14:30 :) [09:34:52] errand + lunch [13:00:15] dcausse: pfischer curious about the eventutilities adaptation? I suppose it it just about the Kafka sink factory thing? [13:00:42] you could still use eventutilties functions to instantiate multiple different sinks with different schemas I think? [13:01:31] ottomata: here I want a single kafka sink writing to multiple streams that share the same scheme [13:02:37] can you have a single kafka sink writing to multiple topics? [13:05:29] ottomata: yes, you must specify a topic selector [13:08:38] dcausse: I just created T377211. I'm sure you have more context and ideas. Could you add them to the task? I'll ping Lydia to see if WMDE can help with implementation. [13:08:38] T377211: Estimate the number of queries needing to migrate away from the full WDQS graph - https://phabricator.wikimedia.org/T377211 [13:10:03] gehel: will do [13:10:42] ottomata: see `KafkaRecordSerializationSchemaBuilder.topicSelector` so if our `KafkaEventSerializationSchema` would could be constructed with such topicSelector function, topics can be assigned per `ProducerRecord` [13:11:31] should be easy to implement in a backwards-compatible fashion [13:13:17] ottomata: BTW: if you have time, maybe we could finalise the discussion around T374341? [13:13:18] T374341: [SPIKE] how can we support Spark producer/consumers in Event Platform - https://phabricator.wikimedia.org/T374341 [13:17:31] RhinosF1: myself and matthiasmullie are on the structured content team rather than the search team, so this channel is not a good place to find us :D You can just mail me cparle@wikimedia.org if you like? (Matthias is off until the end of the month) [13:41:48] cormacparle: thanks [15:01:00] \o [15:04:18] Trey314159: looks related to your recent work: https://www.mediawiki.org/wiki/Topic:Ye5k8shpyk6k4egx [15:04:41] i will take a look [15:09:51] gehel: inflatador: woke up with some kind of stomach bug, taking a sick day. Will update calendar in a bit [15:10:28] ryankemper: rest and get better! It seems that quite a few people are not feeling great today :( [15:23:21] and we can't even blame the shared air space [16:37:58] dinner [17:13:03] oh cool pfischer topicSelector! TIL! very cool [17:34:52] commented [19:06:13] * ebernhardson isn't sure what to do about plugin version numbers going backwards :S [19:27:27] haven't thought about that... :(, perhaps a different groupId ? [19:33:02] perhaps, i'm undecided [20:13:08] * ebernhardson is having no fun with stconvert and it's gradle :S too much magic involved [21:31:01] I think the problems at https://www.mediawiki.org/wiki/Topic:Ye5k8shpyk6k4egx might be related to exact prefix matching more than diacritic folding. I can get similar results for terms that differ by case, though not as extreme. dcausse, were there any relevant changes there that you can think would cause the changes being discussed? [21:57:45] ebernhardson: uuuuuuuuhhh.. digging into stconvert doesn't sound fun. My sympathies... [22:07:32] Trey314159: stconvert itself is probably fine, but they happen to use gradle instead of maven which has special elastic/opensearch logic simply doesn't want to play nice