[07:14:51] pfischer: o/ quick note on redirects & cirrus, a redirect can redirect to another redirect, so in case redir1 -> redir2 -> page3, cirrus wants to index page3 (this is what the Updater::traceRedirects function is doing) [08:38:23] Errand, back in 20' [10:18:10] lunch [12:18:13] How to mung? https://www.irccloud.com/pastebin/YgkHLx7E/munging2023-04-28.txt [12:25:32] seppl2023: bzcat dump-ttl.bz2 | munge.sh -f - -d MUNGER_OUTPUT -- --skolemize [12:26:23] seppl2023: MUNGER_OUTPUT is a folder that you need to create and will contain many ttl files (the output of the munger) [12:49:50] dcausse: is there anything left on the Flink 1.16 upgrade? T289836 [12:49:51] T289836: Upgrade the WDQS streaming updater to latest flink (1.16) - https://phabricator.wikimedia.org/T289836 [12:49:52] thx. I assume https://github.com/wikimedia/wikidata-query-deploy/blob/master/munge.sh is the munge.sh to use [12:50:36] gehel: yes, actual deployment to prod is yet to be done [12:50:44] ok [12:51:20] seppl2023: correct [13:17:22] is https://github.com/wikimedia/wikidata-query-rdf/blob/master/docs/getting-started.md still current? This is what i followed in 2018 and 2020 [13:26:50] seppl2023: it should be, nothing has fundamentally changed in how WDQS operates since then. [13:27:50] We do have a new update pipeline internally, based on a kafka stream, but that isn't exposed externally. So the updater based on RecentChanges is still the one to use externally. [13:28:36] If you find anything that isn't current, please send a change request! [13:29:07] Weekly status update is publised: https://wikitech.wikimedia.org/wiki/Search_Platform/Weekly_Updates/2023-04-28 (and on Asana https://app.asana.com/0/0/1204494898843332) [14:32:40] \o [14:40:57] Trey314159: cindy isn't going to pass until https://gerrit.wikimedia.org/r/c/mediawiki/extensions/CirrusSearch/+/911347 is merged, basically the runner is upgraded to node 14 / webdriver v7 but the repo is still on 10/5 [14:49:24] ebernhardson: Hope springs eternal! Thanks for the info [14:56:23] ebernhardson: is that patch ready to be merged? I looked through it and it looks reasonable, though I'm far from expert on all the details. [14:56:31] Trey314159: yea it should be ready [14:57:03] ok, we're off to the races! [15:25:09] I'm off to the weekend! Enjoy! [16:40:59] Evidence you are old.. when you remember something from "a few years ago" and it turns out to be 12 years ago. @inflatador it was the 2011 DC earthquake where twitter news of the quake arrived in NYC 30 seconds before the quake itself: https://www.hollywoodreporter.com/news/general-news/earthquake-twitter-users-learned-tremors-226481/ [18:28:50] lunch, back in ~45 [19:01:16] back