[01:54:32] Can someone please approve my pull requests in https://github.com/miraheze/mw-config/pulls? [20:14:08] Robots.txt update seems to have done a lot of good work, I think. [20:14:51] servers are less loaded now? [20:16:03] Haven't checked in on load for certain, but I can see that there are a lot less requests per day by bot user agents [20:16:23] ah meant request, sorry [20:17:43] Thinking of denying access to `/thumb/` for image crawlers [20:19:58] I would allow google and bing still [20:20:34] yandex tho? [20:20:44] it's trash but still widely used [20:22:53] Yandex, google, and bing all still do stuff. [20:25:16] Bing is the worst of the ones in the past day (might want to ratelimit it in varnish rather than robots) [20:35:41] @orduin you can tweak when they crawl a bit in their portal [20:38:39] That too, will need to look more at the numbers in the future, but it's definitely better than it was [20:38:50] We're no longer like 50% bot traffic [20:39:58] Heh [20:41:26] Lol [20:41:27] I disagree with widely [20:42:02] in which point lol [20:42:16] Usage is primarily a single country [20:42:47] One subject to countless economic sanctions [20:43:02] a lot of folks outside of Russia use it for reverse image search (it manages to be better than Google's, espesially now) [20:43:47] but wathever