[01:49:17] https://gerrit.wikimedia.org/r/c/operations/puppet/+/1009371 small CR to add wdqs1025 to the test role when y'all come in tomorrow [10:30:51] errand+lunch [13:37:52] dr0ptp4kt: I might not be able to attend our one on one, I have a buyer coming at home roughly at the same time to a test a garden shredden that I'm trying to sell [14:08:36] o/ [15:59:48] \o [16:04:47] dcausse: i'm hanging on another call for another 10 minutes potentially, and i'll hop onto ours, and if and when you make it, cool - and if you don't, i'll se you at the next meeting in 55 minutes [16:14:11] workout, back in ~40 [16:16:13] o/ [16:25:32] * ebernhardson isn't finding a great way to get max page id from the mediawiki api. Not terrible to query from elastic...but was hoping for simpler [16:26:22] closest is recent changes, but i have to expect some wikis wont have a page creation in the recent changes retention period [16:27:04] * ebernhardson should add a page_id sort to cirrus :P [16:29:19] hmm, maybe not. a match_all sorted by page_id takes 1800ms in commonswiki [16:59:44] back [17:02:43] dr0ptp4kt I'm setting up wdqs1025 now, will let you know when it's ready [17:03:25] inflatador thx [17:10:52] have to appease the Puppet gods before we can get started ;) [17:59:49] another quick CR for getting the wdqs test host online...the experimental build failure is expected, we are OK with a no-op https://gerrit.wikimedia.org/r/c/operations/puppet/+/1009574 [18:00:28] dinner [18:02:03] * ebernhardson will never get used to the terrible tab switching in intellij. Why cant ctrl-shift-tab just go left [18:30:56] whoa.. I just tried ctrl-(shift)-tab in chrome and a couple other places and it works. I always use command-shift-[ or -]. (Using ctrl is generally un-Mac-like—unless it's the third or fourth modifier key you are pressing—but it's cool that it works!) [18:42:14] Hi, forgive me if I'm in the wrong place, but I'm trying to install and configure wikidata using the docker instructions at https://www.mediawiki.org/wiki/Wikibase/Docker and have been trying for a couple of days to understand why the container wbdocker-wdqs-updater-1 restarts constantly. I see an error: ERROR org.wikidata.query.rdf.tool.Update - Error during initialization.RDF store reports the last update time is before the [18:42:14] minimum safe poll time. You will have to reload from scratch or you might have missing data. [18:42:39] Is this a place someone might be able to provide some guidance, please? [18:47:09] grapeNehi: this is a reasonable place to ask, although i don't know if anyone that knows is around. It sounds like perhaps it needs an initial data load? [18:47:27] david would know best, but he's in EU. Will be around tomorrow [18:48:32] Ok, thanks. We don't have any data to load and are trying to install for the first time. [18:50:46] based on a quick look over the related code, it has clauses to handle if the last-update doesn't exist in the database, so there must be a last-updated date in the rdf store. Maybe they pre-initialized that in the docker containers? It seems like the rdf database needs to be reset [18:51:33] Thanks for thinking through it. I can't find documentation that describes how to do any of that. Might you know if there is any, please? [18:53:01] hmm, the way we do reloads internally is a bit more complicated, it's done with https://github.com/wikimedia/operations-cookbooks/blob/master/cookbooks/sre/wdqs/data-reload.py. Poking through there, it seems like we basically simply stop the service, delete the data directory, and restart the service to start loading new data in [18:54:57] add-shore's blog has some guide from running wikidata query service on your own gear: https://addshore.com/2019/10/your-own-wikidata-query-service-with-no-limits/ [18:55:11] you don't have to do the data loading part of that process, based on this it suggests if there is existing state in the rdf database it can be reset by deleting...but seems a bit cowboy :) Probably also worth filling a phabricator ticket, someone from WMDE that maintains the env should probably look into fix [18:56:38] Thanks, I'll read through that. I appreciate the help. [18:58:04] np [19:13:11] late lunch, will be ~10-15m late to pairing [21:19:32] quick break, back in ~20 [21:36:53] back [23:08:53] dr0ptp4kt wdqs1025 is ready!