[07:47:34] articletopic problem is on me... I wrongly assumed that addlink was enabled on a few wikis and completely forgot that ores articletopic can be fed for wikis that do not have this model enabled using wikidata sitelinks... proof that having a non-uniform states of the various wiki mappings/settings is not working well :/ [07:50:27] it should be considered an anomaly to have a wiki whose actual mapping/settings is not in line with what the code generates [08:49:42] Another hospital check with Oscar. I'll be back after lunch [09:51:31] lunch [14:53:21] dcausse: that broken metric is only for the streaming updater, right? [14:53:42] gehel: no [14:53:50] the old one [14:54:07] icinga will complain for all wdqs machine at some point [14:54:18] except the streaming-updater [14:54:22] :/ [14:55:01] I don't remember that check, I thought we only checked the lag on the timestamp of the triples in blazegraph [14:56:00] sadly it's using only the events for one particular topic set at the updater startup, I don't know why it was made like that [14:56:23] instead of taking the avg of the events being processed like the new updater [14:56:45] probably not worth fixing in the current updater [14:56:57] yes probably not [14:58:36] gehel: thinking about it I think we should ship the patch, it's starting to block bots [15:10:18] dcausse: patch merged and updater restarted on all hosts [15:10:30] do you have a link to a dashboard to check? [15:10:34] lag is back to normal, thanks! [15:10:42] cool! [15:10:49] https://grafana-rw.wikimedia.org/d/000000489/wikidata-query-service?orgId=1&from=1624890884222&to=1624892947917 [15:44:05] for those without `security` access: we just need to get you added to https://phabricator.wikimedia.org/project/members/30/ [15:44:13] I forget who has perms to add but that should be all we need to do [16:03:21] ^ for security access: send an e-mail to `security-help@wikimedia.org`, cc guillaume for approval (not sure if this is required but that's what I did last time), link to your phab account and stick a boilerplate sentence or two about why you need access [16:12:41] the documented process is on https://www.mediawiki.org/wiki/Security/SOP/Access_to_Phabricator_Security_Issues [16:13:31] I'll take care of that for you all [16:26:11] fetched a bunch of thumbnails to hdfs, ran nsfw detector on them, Thresholds is going to be fun ... this comes in at 0.24 neutral, 0.60 hentai (it's a picture of shoes): https://commons.wikimedia.org/wiki/File:ReebokPrincesswhite2.jpg [16:31:09] to be fair, this is https://github.com/GantMan/nsfw_model which is trained from https://github.com/alex000kim/nsfw_data_scraper which seems to, among other things, use subreddits to automatically source labeled imaged [16:40:04] i guess....best bet would be to run it on all the same things we have machine vision predictions for and see how things correlate, try and find some set of thresholds that mostly agrees with what's been already determined for the other classifier [16:40:26] * ebernhardson is glad we only need a boolean yes/no [18:42:58] more_like config patches for dc switchover are deployed. There is some small risk of additional load prior to switchover since we are now running the increased pool counter limits but still running everything against eqiad elastic. Unlikely to be a problem in practice [19:10:44] thank you! [21:42:34] * ryankemper is regretting not getting the house's AC fixed last summer [21:42:49] it's 82 degrees inside right now [21:43:22] (27.8 C for any europeans who are on IRC at this time :P)