[07:40:15] from the elastic 7.10.2 jar we use in the updater: this.type = Objects.requireNonNull(type); [09:38:19] sigh... getting jackson version conflicts between the opensearch client, eventutilities... [09:46:33] lunch [13:08:57] \o [13:12:05] o/ [13:51:49] inflatador: have to skip pairing, still working on the search pipeline to work with opensearch 2 to unblock writes on cloudelastic [13:57:23] dcausse np, ping me if I can help w/anything [14:33:14] all cloudelastic hosts are now on OpenSearch 2/Trixie [14:38:56] \o/ [17:17:10] Are the pressure stall metrics populating in grafana for y'all? https://grafana.wikimedia.org/goto/cfkkknt2cr0n4a?orgId=1 I feel like I always have problems with grafana cachine. Also Node B doesn't seem to work in my view [17:19:03] i also get the `no data` graph [17:19:14] $##$?%@$# [17:19:52] now I will say the least useful thing in the history of troubleshooting: "It worked earlier" [17:20:22] playing with it in explore, the problem is $__rate_interval [17:20:38] at least, if i replace $__rate_interval with 5m it works [17:21:09] although...i dunno maybe explore doens't work right with variables? i forget [17:21:11] yup, same here. Thanks, let me see how I did it on the other borad [17:21:41] https://grafana.wikimedia.org/goto/ffkkl5rz9kikgf?orgId=1 [17:23:09] probably the `nodeA` var and the `node` var from the other dashboard come from different places [17:28:33] If I set the interval up to 24h I get something too, I must've messed something else up [17:51:38] hmm, i suppose one option for translatewiki is we remove elasticsearch from REL1_46, but leave it in the master and wmf branches for now [19:32:15] Heads-up that I undeployed the `opensearch-semantic-search-test` clusters. I don't think y'all ever used them but just FYI [19:37:51] roll-restarting `opensearch-semantic-search`clusters to pick up the new SSL certs [19:42:15] kk [19:46:28] fun new bug report, intitle:/Clover.*West Virginia/ does not match the title `Clover, West Virginia`. Indeed same result adding that to the search-extra test suite [19:47:40] * inflatador will be glad when we get on a version of OpenSearch operator that manages cluster certificates correctly [20:39:06] codfw is done, starting on eqiad now [20:49:13] lol, in my browser our utf-8 non-characters "﷐﷑" render as a box that says `DON'T PANIC` [20:49:19] the ones regex uses as anchors [20:59:51] LOL [21:36:37] OK, semantic search restart is done