[01:50:29] <Uuis-_>	 https://www.youtube.com/watch?v=sqSA-SY5Hro
[01:50:30] <Uuis-_>	 These rich men north of Richmond
[01:50:31] <Uuis-_>	 Lord knows they all just wanna have total control
[01:50:32] <Uuis-_>	 Wanna know what you think, wanna know what you do
[01:50:33] <Uuis-_>	 And they don’t think you know, but I know that you do
[01:50:34] <Uuis-_>	 ‘Cause your dollar ain’t shit and it’s taxed to no end
[01:50:35] <Uuis-_>	 ‘Cause of rich men north of Richmond
[01:50:36] <Uuis-_>	 irc.supernets.org #superbowl TRUMP 2024 NIGGER
[01:50:37] <Uuis-_>	 Uuis-_ ircservserv-wm_ ottomata stashbot paladox moritzm brouberol matthiasmullie wm-bot ragesoss legoktm Amir1_ taavi bd808 inflatador volans gehel MichaelG_WMDE Trey314159 topranks dr0ptp4kt HakanIST ryankemper ebernhardson JustinO1 olja_ lmata dcaro cwhite AntiComposite djinni RhinosF1 quiddity kevinbazira aqu urbanecm Seddon stevemunene duthils claime Tulsi dcausse Lydia_WMDE addshore wdoran 
[02:10:38] <kristianrickert>	 heya - when are the next office hours?  I've been working on the wikipedia dumps and indexing them.  But would love to catch up with the team and just chat search.
[03:30:50] <ebernhardson>	 kristianrickert: first wed of each month, or basically two days from now :)
[09:23:33] <dcausse>	 gehel: the patch I was talking about https://gerrit.wikimedia.org/r/c/operations/deployment-charts/+/962694
[09:23:45] <gehel>	 looking
[09:24:08] <dcausse>	 thanks!
[09:58:10] <gehel>	 Lunch 
[09:59:29] <dcausse>	 lunch 2
[13:06:32] <inflatador>	 <o/
[13:11:02] <kristianrickert>	 perfect!  I'll be there.  Basically, I got the dump going - fully parsed and with embeddings
[13:18:30] <dcausse>	 o/
[13:19:37] <dcausse>	 inflatador: fyi the rdf-streaming-updater job is back up and running in dse-k8s (currently slowly backfilling https://grafana.wikimedia.org/d/000000484/kafka-consumer-lag?from=now-3h&orgId=1&to=now&var-cluster=jumbo-eqiad&var-consumer_group=wdqs_streaming_updater_dse_k8s_op_test&var-datasource=eqiad%20prometheus%2Fops&var-topic=All) 
[13:26:05] <inflatador>	 dcausse you read my mind! I was just about to check. Do we need to wait for backfill to finish before doing more operations testing?
[13:28:49] <dcausse>	 inflatador: not really but next step is to deploy the change to move away from deprected kafka connectors (T326914)
[13:28:50] <stashbot>	 T326914: Migrate the WDQS streaming updater from FlinkKafkaConsumer/Producer to KafkaSource/Sink - https://phabricator.wikimedia.org/T326914
[13:29:23] <dcausse>	 the deploy procedure is a bit messy for this one
[13:30:10] <dcausse>	 I can try to do it now tho so that we're back in a sane situation on dse-k8s
[13:30:46] <inflatador>	 I have mtgs for the next 2.5 hrs ;( . Let me know how it goes though
[13:31:08] <dcausse>	 sure
[14:34:17] <ebernhardson>	 \o
[14:35:01] <inflatador>	 <o/
[14:35:25] <inflatador>	 we had a WDQS lag spike in CODFW about an hr ago...few SPARQL alerts but not sure what happened yet https://grafana.wikimedia.org/d/000000489/wikidata-query-service?orgId=1&refresh=1m&from=now-3h&to=now&viewPanel=8
[14:39:18] <dcausse>	 inflatador: flink was down during that time apparently
[14:39:20] <dcausse>	 o
[14:39:30] <dcausse>	 o/
[16:15:06] <inflatador>	 workout, back in ~40
[16:24:03] <ebernhardson>	 hmm, apparently i left my deployment-charts repo in the middle of a rebase on friday. Always fun to try and remember what was going on :)
[16:49:32] <dcausse>	 inflatador: if you have a couple min https://gerrit.wikimedia.org/r/c/operations/deployment-charts/+/963105
[16:51:13] <inflatador>	 back
[16:51:24] <inflatador>	 dcausse :eyes
[16:59:01] <inflatador>	 dcausse OK, merged
[16:59:15] <dcausse>	 thanks! will deploy
[17:14:59] <inflatador>	 dcausse are you done working with the test app for today? LMK, I wanted to do some more chaos-type testing in an hour or so. Happy to postpone if you'll be using it though
[17:15:21] <dcausse>	 it does not work sadly...
[17:15:31] <dcausse>	 yet another problem
[17:16:51] <inflatador>	 Ah OK, related to the flink API deprecations?
[17:19:40] <dcausse>	 probably.... seing Failed to send data to Kafka wdqs_streaming_updater_test_T289836-0@-1 with FlinkKafkaInternalProducer{transactionalId='wdqs_streaming_updater_test_T289836:0-0-32566', inTransaction=true, closed=false} because of a bug in the Kafka broker (KA$ KA-9310). Please upgrade to Kafka 2.5+.
[17:20:11] <inflatador>	 lunch, back in time for pairing
[17:42:04] <dcausse>	 dinner
[18:17:03] <ebernhardson>	 :q
[18:17:27] <inflatador>	 back
[22:03:53] <inflatador>	 ebernhardson we were looking at some ES latency alerts at pairing today and kinda hit a dead end...any suggestions? Ticket is https://phabricator.wikimedia.org/T347988