[08:51:41] hare: if the munger does nothing it means it can't find any entities in the dump and is generally due to bad options (esp. --conceptUri/--commonsUri) [10:43:23] Lunch [12:08:42] lunch [12:26:39] ejoseph: in case you missed it, there is one last comment from dcausse on https://gerrit.wikimedia.org/r/c/search/extra-analysis/+/737026 [12:27:50] dcausse: about the plugin upgrade for 7.10.2, do we want to release the 6.8 upgrade first, before we merge the 7.10 work? So we don't have to create branches? Or did you imagine a different strategy? [12:28:17] Making a release would be a good way for ejoseph to ensure he has all the appropriate rights [12:34:21] ejoseph: to publish artifacts to Maven Central, you will need a Sonatype account (Sonatype is the organization which manages Maven Central - the standard public repository of all things Maven). There is some doc (https://central.sonatype.org/publish/publish-guide/#initial-setup). Create your Jira account and open a ticket asking to have rights to the org.wikimedia organization. Ping us when done, and we can add a comment to approve that request [12:34:55] we = anyone who already is a member of that organization, which should be David, Erik, Ryan, Zbyszko and myself (and maybe a few others in other teams) [13:03:04] we had issues again with wdqs1013 [13:03:24] which affected our SLO of course [13:03:31] hopefully jvmquake will help [13:03:47] if we want to test it somewhere, I vote that host [13:07:28] break [13:39:52] gehel: I saw it I’ll fix soon [13:40:01] ejoseph: thanks! [13:40:40] Ok [13:46:27] yes we should make a release of the 6.8 versions first [13:49:24] ejoseph: after creating your jira account on https://issues.sonatype.org/ you'll need to create a ticket like this one: https://issues.sonatype.org/browse/OSSRH-56516 [14:00:21] on it [14:12:27] mpham: on T291205, Aisha has some suggestions on further analysis. Do you want to review those (and possibly create additional tickets) before I close it? [14:12:28] T291205: Analysis: Property usage by items' P31 - https://phabricator.wikimedia.org/T291205 [14:14:33] i'll leave this tab open and check in with aisha about it. you can close the ticket [14:14:49] ack [14:21:44] gehel: the task is created [14:21:53] ejoseph: do you have the link? [14:22:18] https://issues.sonatype.org/browse/OSSRH-75104 [14:23:47] dcausse: should the munge script be used with specific options when running it on the WCQ dataset? [14:24:16] ejoseph: I've commented. Usually, those requests are handled in 2 working days. Let me know if you don't see any updates [14:24:23] hare - https://github.com/wikimedia/wikidata-query-rdf/blob/master/dist/src/script/wcqs-data-reload.sh#L22 [14:24:37] this is how we run it on wcqs-beta [14:24:45] Thank you! [14:24:46] Ok [14:27:10] hare: some parameters for the script itself are set by a script on a server, $DATA_DIR and $DEPLOY_DIR, former one can be whatever, as long as it's used consistently, latter should contain an unpack of the deploy package [14:28:27] that package is created in rdf/dist/target after the build (I do ./mvnw clean install) [14:28:47] (rdf is a cloned wikidata-query-rdf repo) [15:45:21] \o [15:47:11] o/ [15:47:33] o/ [17:09:13] Now that I can see it actually working I love the multithreaded munge, this will come way in handy if I ever have to re-import Wikidata from scratch again [17:13:20] it is awesome that the munger is running quicker these days, sadly we run into Amdahl's law and the actual import still takes days :( [18:19:23] dinner [19:03:39] ryankemper: https://gerrit.wikimedia.org/r/738979 is the patch to add swift plugin to elasticsearch, same .zip i used in relforge. will need to build the .deb and rolling-restart the clusters [19:03:56] Hey ryankemper, I forgot ask at the triage meeting this morning: are things in good shape for me to do some reindexing? Happy to wait if not. [19:13:19] Trey314159: I need to do rolling restarts of eqiad/codfw elasticsearch. Cluster should be ready for you to start reindexing on ~weds if that's not too late for ya [19:14:04] ebernhardson: cool will work on getting the .deb ready [19:14:12] ryankemper: No problem.. I knew there had been some stuff going on last week, that's why I asked. Plenty else to do!