[10:36:37] 06serviceops, 06collaboration-services, 06Data-Persistence, 06DC-Ops, and 5 others: ☂️ Northward Datacentre Switchover (March 2024) - https://phabricator.wikimedia.org/T357547#9629465 (10Marostegui) [15:50:01] a user describes getting 429s when _creating accounts_ on a cluster wiki. that then "work again after a few hours". sounds like their IP got throttled, doesn't it? next ask them to provide their IP in private? [15:52:41] mutante: yeah, account creation is limited to six per 24h, that's intended: https://meta.wikimedia.org/wiki/Mass_account_creation [15:53:19] if they need an exemption because they have a legit reason to do that, they should request it onwiki as described there [15:53:31] rzl: ACK, thanks. so my next question is "why do you create many accounts" [15:53:41] but I think it's because it's the VRT wiki [15:53:50] and stewards creating users for others or so [15:54:22] thanks for the link. nod [15:55:01] (we're in a team meeting rn so if you need more we'll get back to you in a bit) [15:56:03] mutante: a mediawiki error page 429 or a cdn-level 429? [15:58:48] taavi: cdn-level afaict. "Our servers are currently under maintenance or experiencing a technical problem." with a cp host and varnish XID on it [16:03:45] that sounds like a false positive from a requestctl rule. the intentional mediawiki limit would give a different error page [16:06:06] in that case.. I would be back to asking for their IP [16:06:14] btw this is https://phabricator.wikimedia.org/T359901 [16:06:21] i had edited the tags a bit [16:06:38] we were tagged first because of the string "VRT" but it's VRT wiki, not VRTS system [21:52:33] 06serviceops, 06SRE, 07Wikimedia-production-error: VRT wiki fails to create account - https://phabricator.wikimedia.org/T359901#9632660 (10Dzahn) @Krd I hear that account creation is limited to 6 per 24 hours and that it's intentional per https://meta.wikimedia.org/wiki/Mass_account_creation If you need an... [22:06:53] 06serviceops, 06Data-Engineering, 06MediaWiki-Engineering, 10WMF-JobQueue, and 2 others: Could not enqueue jobs: "Unable to deliver all events: 503: Service Unavailable" - https://phabricator.wikimedia.org/T249745#9632680 (10Krinkle) @daniel What you describe exists and is exactly what `JobQueueGroup::push...