[09:41:16] <wikibugs>	 06Traffic, 10AutoWikiBrowser: 429 "too many requests" while requesting "what transcludes page" for many templates in AWB - https://phabricator.wikimedia.org/T414214#11509509 (10Stevietheman) Starting today, I've been getting the same error from    # Creating a list from a Category (recurse user defined) with a...
[11:27:10] <wikibugs>	 06Traffic, 06Commons: HTTP 429 error on original image requests on Commons (iOS app by default hiding the Referrer header) - https://phabricator.wikimedia.org/T413570#11509559 (10Nylki) @SuperHamster Btw. I noticed that since ~ yesterday it appears to now work on my setup again without setting a referrer.  It...
[11:30:28] <wikibugs>	 06Traffic, 10AutoWikiBrowser: 429 "too many requests" while requesting "what transcludes page" for many templates in AWB - https://phabricator.wikimedia.org/T414214#11509575 (10Joe) I guess there's some bug in AutoWikiBrowser so that those requests lack authentication cookies; otherwise you wouldn't get that e...
[11:58:42] <wikibugs>	 06Traffic, 10AutoWikiBrowser: 429 "too many requests" while requesting "what transcludes page" for many templates in AWB - https://phabricator.wikimedia.org/T414214#11509603 (10Joe) I have added an hotfix that should go live soon-ish (in the next hour or so).  If in two hours you still see the blocks, please l...
[13:54:57] <wikibugs>	 06Traffic, 06SRE: All github action tests of Pywikibot fails due to 429 status code (TOO MANY REQUESTS) - https://phabricator.wikimedia.org/T414173#11509648 (10Xqt) @Fabfur: I still have the 429 problem with my bot. Here the html content:  ` WARNING: Http response status 429 WARNING: Non-JSON response received...
[14:52:03] <wikibugs>	 06Traffic, 06SRE: All github action tests of Pywikibot fails due to 429 status code (TOO MANY REQUESTS) - https://phabricator.wikimedia.org/T414173#11509691 (10Joe) 05Open→03Resolved a:03Fabfur >>! In T414173#11509648, @Xqt wrote: > @Fabfur: I still have the 429 problem with my bot. Here the html con...
[15:14:29] <revi>	 _joe_: I guess it would be awesome if you could unblock some more possibly blocked opengraph server (like the stuff on discord/slack yesterday) — namely https://enwp.org/KakaoTalk (UA kakaotalk-scrap/1.0 and IP range 211.231.103.0/24 & 27.0.238.0/24) and https://enwp.org/Line_(software) (UA has https://lin.ee/4dwXkTH )
[15:15:06] <revi>	 At least some kowiki folk has noticed image previews not working on those two after he noticed the discord stuff :-p
[15:15:34] <revi>	 (kakaotalk IP/UA per https://devtalk.kakao.com/t/open-graph/145458/2 )
[15:16:22] <revi>	 disclaimer: not time sensitive of course :-p if you prefer task for weekday I can do that
[15:18:02] <_joe_>	 revi: yeah, the problem with those is they don't honor our UA policy
[15:18:08] <_joe_>	 while discord and slack do
[15:18:33] <_joe_>	 so yeah the ip/ua combo would work, but please open a task for that :)
[15:18:39] <revi>	 ohhhh
[15:18:49] <revi>	 I have kowiki folk who works for Kakao
[15:18:52] <revi>	 will poke him
[15:19:06] <_joe_>	 if they add a contact url/email they will be unblocked as well
[15:19:20] <_joe_>	 unless they make an absurd amount of requests, which I don't think is the case
[15:20:07] <_joe_>	 again, image hotlinking/preview is limited so that oncall SREs (me rn 😅) don't get paged all the time; we hope to be able to relax rules soon (by enforcing our rules on everyone)
[15:20:22] <revi>	 Kakaotalk seems to be in position that their url's devtalk.kakao.com's discourse is a contact method according to their responses on forum
[15:20:24] <revi>	 meh lol
[15:20:50] <revi>	 and then their discourse login is exclusively relying on Kakao Account :tm:
[15:20:54] * revi facepalms
[15:20:54] <_joe_>	 but please open a task
[15:20:57] <revi>	 yeah ofc
[15:21:00] <revi>	 writing one
[15:21:05] <_joe_>	 thanks <3
[15:21:23] <revi>	 which projects?
[15:21:33] <_joe_>	 #traffic is enough
[15:21:37] <revi>	 gotcha
[15:22:51] <revi>	 WhatsApp displays opengraph tags but doesn't display the image
[15:22:52] <_joe_>	 to give you some context: we've started enforcing (to some degree) our robot policy on the wikis; we should start doing the same on media files soon; when we do that, hopefully, we can somewhat relax some of the filters we've set up right now to stay afloat
[15:23:23] <revi>	 but given some OG tags displayed I am not sure which part to blame :-p
[15:23:28] <revi>	 (on WA)
[15:24:03] <revi>	 yeah AI traffic is shit — my personal sites' DB also got doomed with one doing too much reads :tm:
[15:24:11] <_joe_>	 heh
[15:24:35] <_joe_>	 even a stupid forum I volunteer to sysadmin in my free time gets regularly swamped by those bots
[15:25:07] <revi>	 I ended up fronting the site with Cloudflare and 'big 'GO AWAY' buttons :-p
[15:25:07] <_joe_>	 I hope to come to wikimania this year to give to the community a bit of context about this stuff, and the wonderful world of residential proxies 
[15:25:21] <revi>	 only if I could attend wikimania ;-;
[15:25:22] <_joe_>	 yeah not an option we have here :)
[15:25:50] <_joe_>	 I've not been there in 10 years now
[15:25:59] <revi>	 My count stopped at pre-COVID
[15:32:18] <wikibugs>	 06Traffic: KakaoTalk and LINE's opengraph instance is rate-limited - https://phabricator.wikimedia.org/T414263 (10revi) 03NEW
[15:32:25] <revi>	 There you go
[15:58:23] <_joe_>	 thanks, we'll look on monday
[17:31:23] <wikibugs>	 06Traffic, 10AutoWikiBrowser: 429 "too many requests" while requesting "what transcludes page" for many templates in AWB - https://phabricator.wikimedia.org/T414214#11509802 (10Joe) 05Open→03Resolved a:03Joe I'll tag the task as solved, please let us know if you still enocounter problems. Thanks to @...
[20:29:14] <wikibugs>	 06Traffic, 06SRE: All github action tests of Pywikibot fails due to 429 status code (TOO MANY REQUESTS) - https://phabricator.wikimedia.org/T414173#11509876 (10Benwing2) @Fabfur any idea why my pywikibot script is getting 429 errors every 200 pages it's pulling down? It pulls down about 7 pages a second, w...