[00:14:50] <ryankemper>	 ebernhardson: so I'm taking a look at https://phabricator.wikimedia.org/T323066 and could use some help understanding the turnilo data
[00:15:30] <ryankemper>	 I'm guessing from the name `webrequest_sampled_128` that the turnilo data in the ticket is like a sampling of 1 out of every 128 web requests, but not sure
[00:15:59] <ryankemper>	 There is some decent documentation here that I'm looking thru: https://wikitech.wikimedia.org/wiki/Analytics/Data_Lake/Traffic/Webrequest#Pipeline
[08:21:47] <gehel>	 ryankemper: yes, `webrequest_sampled_128` is sampling 1 out of every 128 requests. So if you want the actual number of request, you need to multiply by 128
[08:56:46] <dcausse>	 inflatador: I think cloudelastic needs a rolling-restart after you merged https://gerrit.wikimedia.org/r/c/operations/puppet/+/859094
[08:58:42] <madbob_>	 hi all
[08:58:48] <madbob_>	 after the suggestions of dcausse about my issue with encoding, yesterday i downloaded again the latest available wikidata dump to start over from the munge process, but it seems that the issue is from the dump itself...
[08:58:57] <madbob_>	 zgrep � latest-all.ttl.gz
[08:59:04] <madbob_>	 	pr:P1476 "���s�{���v�l��"@ja .
[08:59:04] <dcausse>	 ouch
[08:59:04] <madbob_>	 	pq:P1810 "Fi� allo Scilliar" .
[08:59:04] <madbob_>	 	pr:P1476 "���s�{���v�l��"@ja .
[08:59:18] <dcausse>	 that's worse than I thought then...
[08:59:23] <dcausse>	 looking
[09:03:01] <dcausse>	 madbob_: dumps seem fine to me, do you have a link?
[09:03:28] <madbob_>	 https://dumps.wikimedia.org/wikidatawiki/entities/latest-all.ttl.gz
[09:05:09] <dcausse>	 "curl -s https://dumps.wikimedia.org/wikidatawiki/entities/latest-all.ttl.gz | zcat | grep pr:P1476 | head -n 100" shows proper strings to me (e.g. pr:P1476 "Nationale feestdagen in België"@nl)
[09:05:41] <dcausse>	 might be when displaying the strings to your terminal perhaps?
[09:05:58] <madbob_>	 zgrep pr:P1476 latest-all.ttl.gz  | grep Nationale
[09:06:06] <madbob_>	 pr:P1476 "Nationale feestdagen in België"@nl ;
[09:06:11] <madbob_>	 this is right for me also
[09:06:17] <madbob_>	 not all strings are broken
[09:06:32] <madbob_>	 try to grep "Scilliar"
[09:07:36] <dcausse>	 looking, but if it's deep inside the file it might take a while
[09:08:57] <madbob_>	 zgrep Scilliar latest-all.ttl.gz -n
[09:09:04] <madbob_>	 30359417:	pq:P1810 "Fi� allo Scilliar" .
[09:10:57] <dcausse>	 madbob_: it's broken in wikidata https://www.wikidata.org/wiki/Q381366 (Fi� allo Scilliar)
[09:11:09] <dcausse>	 data quality issue
[09:11:17] <dcausse>	 it's not a bug here
[09:13:08] <dcausse>	 actually the dataset it comes from has also the same data issue https://spelunker.whosonfirst.org/id/101792261/
[09:13:43] <dcausse>	 I guess the bot that replicated this data simply replicated the same mistake
[09:14:29] <dcausse>	 I think that grepping � will yield many false positives
[09:16:09] <madbob_>	 oops... ok, sorry for the wrong alert :-\
[09:16:26] <dcausse>	 no worries!
[09:17:04] <madbob_>	 i'm try to grep some string known to be broken on my latest import, both on dump and munged files, to double check them before loading data in blazegraph
[09:17:43] <dcausse>	 madbob_: this seems like a good approach
[12:11:50] <dcausse>	 lunch
[13:21:32] <addshore>	 Hi all! I'm looking at a 1.37 -> 1.38 change for a wiki, and seeing an error in jobs for elastic things `[CirrusSearch] Exception thrown while running DataSender::sendData in cluster default: No enabled connection`
[13:22:06] <addshore>	 any hints around what might be up / what I should be looking at? generally speaking I havn't changed any elastic config, same elastic version is running, just updated the extension etc
[13:24:16] <addshore>	 hmm, / hold that thought, maybe I spotted my issue....
[15:54:10] <inflatador>	 will not make Weds mtg, dealing with car issues
[15:59:29] <gehel>	 I'll be a bit late to Wednesday meeting. Current meeting will be running late and I need a quick break
[17:24:33] <dcausse>	 dinner
[17:55:42] <inflatador>	 ryankemper thanks for the cloudelastic restart. You might check relforge too if you haven't already
[17:56:56] <inflatador>	 my car's fixed, but I need to pack some stuff. Will see you after the break!
[18:02:53] <ryankemper>	 relforge is good
[18:03:04] <ryankemper>	 Looks like it was just 3 hosts in cloudelastic
[18:05:00] <ryankemper>	 (Scanned via `sudo -E cumin -b 6 A:cloudelastic 'ps auxf | grep -v grep | grep -q Xmx8G && echo needs restart || echo no restart needed'`)
[19:28:40] <gehel>	 ryankemper: I'll be 3' late
[19:28:46] <ryankemper>	 gehel: ack