[10:10:43] weekly status update published: https://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2024-01-26 [10:59:46] lunch [14:11:57] dcausse: any problem if I run more IGUANA today? didn't want to mess up any scripted runs of yours today if you had them enqueued. also, i realized i should ask if it's possible for the next query run of yours (on the large random sample of queries when they're ready) to pump to a different table or have some new column to distinguish them from what we've gotten so far? [14:14:19] dr0ptp4kt: please go ahead, I don't plan to run anything on these servers today, for the next sample sure, it'll probably be something like tool = "random" but can add more columns too, if you have ideas let me know [14:16:30] o/ [14:18:34] thx dcausse. nah, I think the columns and the normalization approach you've done otherwise are quite rad already! [14:40:54] dcausse: I moved your slide to https://docs.google.com/presentation/d/17WpVUrGft4yITIdMcIkE8MyLCkO1CQ2JJUcsWAajtPE/edit#slide=id.g276527708f1_0_733 [14:41:04] thx! [14:55:41] quick errand [14:58:56] dcausse: when you present, it's probably worth mentioning what we're learning about queries and use cases [15:08:49] sure [15:21:19] quick CR to start the cloudelastic migration process https://gerrit.wikimedia.org/r/c/operations/puppet/+/992547 (just moving the canary host to insetup) [15:22:23] the check experimental failure is expected as the hostname will change [15:39:03] dcausse good catch, let me get a patch up for that [15:44:32] https://gerrit.wikimedia.org/r/c/operations/puppet/+/993150 OK, I think it's cleaned up now [16:00:30] quick errand [16:01:10] \o [16:03:01] most of the new updater is getting nooped, but 630 / 34k rerenders turned into actual updates [16:03:24] thats like 2%, not a problem but a little surprising [16:03:43] doing a roll-restart of cloudelastic to pick up the new config (sans 1010) [16:15:43] o/ [17:18:25] so far so good with cloudelastic1010. Taking ~40m to work out while it reimages [17:39:35] i've been thinking to run an indexing server for intellij. a simple idea was to run that inside of the same vm where i run intellij itself, but i'm kind of wondering if we want to get something stood up for the team. the public indexing servers at jetbrains don't quite seem to have stuff in place and i have some apprehension with that anyway. this said, does someone already have an indexing server setup for wmf repos? [17:40:46] i've considered putting something in a public cloud or maybe a locked down machine with port-forwarding from the dmz at home (i have enough switches now where i can vlan it off, but still would want to ddns it and all that good stuff). [17:48:43] i suppose i haven't thought about it much, usually indexing takes a minute or so when i start intellij [18:04:38] dr0ptp4kt don't know much about that particular service, but if you wanna stand something up in our WDQS horizon project (openstack) I can add you as a project owner. Just need your shell or wikitech user name [18:29:07] ryankemper small PR to finish up puppet 7 on CE hosts (at least the ones that won't be retired) if you have time https://gerrit.wikimedia.org/r/c/operations/puppet/+/993175 [18:29:44] also lunch, back in ~40 [19:07:03] ebernhardson: maybe i need to accept that i should run it in the host os or give my vm all of the system's resources! with 2 cores and 8 GB RAM, maybe i'm getting dinged. inflatador i think it may need to reside outside our infrastructure. although the source code is plainly visible ( https://packages.jetbrains.team/maven/p/ij/intellij-shared-indexes/com/jetbrains/intellij/indexing/shared/ij-shared-indexes-tool-cli/0.9.9/ ), [19:09:37] dr0ptp4kt: ouch, that is a small instance. I'm running on 16gb and run out, i have to make sure i stop my mw env if i'm going to run any tests in intellij. [19:10:37] i can't quite tell what the licensing of that tool is. for the indexing plugin side, one only get a 1 month license for community intellij, and ultimate is required...but that's plugin side. it's the indexer itself that i wonder about - i don't see it immediately looking around in https://github.com/JetBrains/intellij-community/tree/master/ or looking for 'index' in the jetbrains list of repos [19:11:42] ebernhardson: yeah, unfortunately my old mbp flaked at the exactly wrong moment, so i am set at "only" 32g of ram...looking forward to the day of having 64g of ram on a laptop hopefully eventually [19:20:02] thx to all of the other stuff i'm running, even that 32gb doesn't quite cut it out without a ton of disk swapping. i end up with like 2 free gb at steady state [19:38:28] inflatador: lgtm minus the need for a trailing newline [19:38:42] ryankemper ACK, will fix [19:39:28] If you wanna work on a patch for a single wdqs-public host LMK, otherwise I'll do that next [19:57:51] appointment, back in ~90m [21:13:37] inflatador: sure, https://gerrit.wikimedia.org/r/c/operations/puppet/+/993193 [21:40:22] back [22:49:19] Migration plan for cloudelastic-public-to-private IPs...feel free to read over and add/edit/suggest once you get back on Mon! Happy weekend! https://etherpad.wikimedia.org/p/cloudelastic-T355617 [22:49:19] T355617: Migrate cloudelastic from public to private IPs - https://phabricator.wikimedia.org/T355617