[06:42:19] <taavi>	 bd808: I think one of the main things in my area is that you need a good understanding of all the systems you're touching (and the systems those are talking to to have the full understanding). both to make any changes you've decided to make, but also just to be able to pick up tasks that you can do without some specific advanced access to the
[06:42:19] <taavi>	 clusters
[06:47:26] <taavi>	 so for me, my autism gives me a good memory for things i've read (and I read a lot of documentation, tasks and code patches), your mileage may vary
[07:15:08] <wurgl>	 Hmm … NFS-problems on bastion-23?
[07:17:04] <wurgl>	 bastion-13 … need more coffee, sorry
[07:23:06] <wurgl>	 https://www.wn.de/welt/vermischtes/rentner-osnabrueck-vier-tage-im-fahrstuhl-eingeschlossen-3388324
[08:40:33] <MagnusManske>	 Hi, is there an issue with toolforge ssh? I can connect to login.toolforge.org, but right before the prompt (at "Last login:"), the connection hangs. Ctrl-C doesn't do anything. Is that a known issue, or should I file on Phabricator?
[08:44:24] <godog>	 MagnusManske: hi, I don't think that's known, would you mind filing a task ?
[08:44:30] <godog>	 I'm also looking into it
[08:44:38] <MagnusManske>	 Thanks, will file one now
[08:44:56] <wurgl>	 MagnusManske use tools-bastion-12 that works, bastion-13 hangs
[08:50:27] <MagnusManske>	 Ah OK, just filed https://phabricator.wikimedia.org/T404047
[08:51:09] <godog>	 thank you, I'm taking a look at bastion-13 to see what's wrong then will reboot the vm
[08:56:10] <godog>	 dcaro: ^ would you mind checking in here before rebooting?
[08:56:28] <dcaro>	 sorry, rebooted already :/
[08:56:33] <godog>	 yeah I noticed :)
[08:56:45] <godog>	 will be for next time
[08:57:28] <godog>	 also I would have expected an alert for ssh logins failing to the bastion, is there one ?
[08:58:24] <dcaro>	 I think there's something like that, though it might not be using an NFS-based user
[08:58:32] <dcaro>	 (logging in as root works ok)
[08:59:19] <godog>	 hah! interesting, I went in via vm_console cookbook
[08:59:37] <godog>	 looking
[20:09:37] <wm-bb>	 <ederporto> Hello, everyone. I was trying to run my local Django application, but I'm receiving a `403 Client Error: Forbidden for url: https://meta.wikimedia.org/w/index.php?title=Special%3AOAuth%2Finitiate.
[20:09:37] <wm-bb>	 <ederporto> `
[20:09:39] <wm-bb>	 <ederporto> I tried creating a new set of consumer tokens, but it didn't work either. On toolforge is working fine. Can you provide some guidance? Cheers,
[20:15:20] <wm-bb>	 <lucaswerkmeister> is your code passing in a custom `User-Agent` header?
[20:16:44] <wm-bb>	 <lucaswerkmeister> see https://foundation.wikimedia.org/wiki/Policy:Wikimedia_Foundation_User-Agent_Policy and https://phabricator.wikimedia.org/T400119
[20:18:07] <bd808>	 @ederporto: If you have the text from the bottom of the 403 page I can use it to try and find which rule you are tripping. I would guess that @lucaswerkmeister has the right idea that you are getting caught in a broad ban on "generic" user-agents that has been added recently as part of blocking ai scrapers.
[20:24:01] <wm-bb>	 <ederporto> https://pastebin.com/jQ0vFR77 (re @wmtelegram_bot: <bd808> @ederporto: If you have the text from the bottom of the 403 page I can use it to try and find which rule you are trippin...)
[20:25:17] <wm-bb>	 <ederporto> I do not know for sure, because the login calling is done by the `python-social-auth.` (re @lucaswerkmeister: is your code passing in a custom User-Agent header?)
[20:25:43] <bd808>	 @ederporto: sorry for not being more explict. I would need to see the bottom of the HTTP 403 response page from MediaWiki, not the resulting error as rendered by django.
[20:26:39] <bd808>	 Let me look at python-social-auth, but I'd bet that it is using pythong-requests and that's your problem. "User-Agent: python-requests*" is one of the hard coded blocks today.
[20:27:35] <bd808>	 Toolforge and Cloud VPS hoisting gets to bypass those which would explain it working here, but not locally for you.
[20:27:43] <wm-bb>	 <lucaswerkmeister> apparently it *can* set a user agent https://github.com/python-social-auth/social-core/blob/e42d74bc368d14642a727d29f36e62a4a0ba5378/social_core/backends/base.py#L257
[20:27:45] <wm-bb>	 <ederporto> Do you mean what I see on the F12? https://pastebin.com/ZQGNBxbX (re @wmtelegram_bot: <bd808> @ederporto: sorry for not being more explict. I would need to see the bottom of the HTTP 403 response page from MediaWik...)
[20:27:56] <wm-bb>	 <lucaswerkmeister> but doesn’t do it by default
[20:28:47] <wm-bb>	 <lucaswerkmeister> presumably something just like this should be set in backends/mediawiki.py as well : https://tools-static.wmflabs.org/bridgebot/d4731471/file_73720.jpg
[20:29:38] <wm-bb>	 <lucaswerkmeister> 2 weeks ago https://github.com/python-social-auth/social-core/pull/1241
[20:32:26] <bd808>	 @ederporto: I mean the HTML payload returned by Special:OAuth/initiate, but I think @ucaswerkmeister has found your problem and potential fix.
[20:50:00] <lucaswerkmeister>	 !log tools.fireflytools add toolforge-standards-committee to maintainer tools so non-root members can process T403814
[20:50:04] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.fireflytools/SAL
[20:50:04] <stashbot>	 T403814: Adoption request for fireflytools - https://phabricator.wikimedia.org/T403814
[20:50:59] <wm-bb>	 <lucaswerkmeister> (I might look into ^ that adoption request later but definitely not tonight, I’m exhausted :D)
[21:07:21] <wm-bb>	 <ederporto> I manipulated the backends/mediawiki.py and it worked. Thank you so much!
[21:13:27] <wm-bb>	 <lucaswerkmeister> \o/
[22:11:29] <Tanvir>	 Hi, my .kube/config file is missing, so I can't run my script. Any suggestion on what to do?