[06:54:11] ryankemper: thanks! [10:52:33] lunch [12:43:37] o/ [12:45:18] o/ [13:01:25] dcausse: do you know how long did the data reload on wdqs2023 took? [13:06:59] gehel: it's still catching up on lag but the blazegraph import took 7days and 15hours (T241128) [13:07:00] T241128: EPIC: Reduce the time needed to do the initial WDQS import - https://phabricator.wikimedia.org/T241128 [13:07:32] and that was for how many triples? [13:07:39] 15.9B [13:08:35] for the catchup I think you can add ~1.5days [13:08:54] so roughly 9days to recover [13:10:33] so even in the worscase scenario where all future triples are added to the main graph we can recover within 10days after the graph split with 20B [13:12:42] cool! [13:18:11] dcausse I updated https://gerrit.wikimedia.org/r/c/operations/alerts/+/1043198 based on your feedback, LMK if it needs anything else [13:20:12] inflatador: lgtm [13:21:10] gehel: I think we should keep T367510 open til we actually create the topics [13:21:11] T367510: Request permission to create 4 kafka topics in kafka-main (WDQS graph split) - https://phabricator.wikimedia.org/T367510 [13:26:34] dcausse: re-opened! [13:26:59] thanks! [13:39:44] opening a dedicated port to handle internal federation sounds difficult... seems like it might need multiple tlsproxy running like what we do for elasticsearch [14:08:02] going offline, will be back later tonight [14:11:45] btullis dcausse Created a new patch based on David's solution to use puppet for the search platform alerts, see if this is better: https://gerrit.wikimedia.org/r/c/operations/puppet/+/1048467 [14:22:20] thanks! [14:32:16] headed to swim class, back in ~30 [15:13:21] going offline, have a nice week-end [15:16:05] .o/ [15:16:29] Does anyone else have trouble finding stuff on gitlab? I haven't had much luck with its search [15:20:32] yes. although try https://codesearch.wmcloud.org (assuming that hasn't been a problem, too). I think stuff is more indexed there as of recently. it seems like upstream is focused on search as a differentiated paid offering, although i know it's possible to put in your own search engine on a standalone floss install, too [15:24:41] (it seems like to have "nice" ElasticSearch advanced searching you gotta pay, although in theory anything _could_ be wired up manually on a floss install...all the usual caveats of maintaining non-supported community edition software and stuff...) [15:26:57] dr0ptp4kt excellent, thanks! I forgot all about codesearch ;( [15:50:09] \o [16:15:27] lunch, back in ~40 [18:14:47] back [20:00:23] errand, back in ~1h [21:03:00] back