[00:05:08] !help Hi, there are problems [again] in tools-sgebastion-10 (bash: fork: retry: Resource temporarily unavailable) [00:05:08] If you don't get a response in 15-30 minutes, please create a phabricator task -- https://phabricator.wikimedia.org/maniphest/task/edit/form/1/?projects=wmcs-kanban [00:06:02] * bd808 checks on login.toolforge.org [00:07:41] Thanks [00:08:26] jem: how many things are you trying to run in parallel? That instance is certainly under a bit of load, but I'm not having an trouble using the shell, etc. [00:09:51] bd808: I have only one connection currently active [00:09:51] I'm wondering if you are hitting the per-user limits that we have systemd enforce on thread and processes [00:10:12] Well... [00:10:27] I should get a more useful message then [00:10:30] `ps axuwww |grep ^jem|wc -l` says 66 [00:10:52] Well, I can't even do that [00:11:00] But that's a lot [00:11:10] you have a lot of active scp processes running [00:11:35] 31 of them! [00:11:55] Hmmm [00:12:01] Sorry then [00:12:37] Please kill them, I can't do it [00:15:57] they are all suck in uninterruptible sleep and unresponsive to `kill -9` by root [00:16:19] That's very strange [00:16:27] generally this means they are trapped by NFS [00:16:50] Could that be related to the NFS problem a few days ago? [00:17:09] they all show a start time of today [00:17:55] Then I don't know... if things and networks are ok, the scp's should end fast [00:18:45] The command for all of them looks a bit like nonsense to me: `scp -t /data/project/jembot/wiki/` [00:20:37] I do make copies of files to that directory, but the exact file should appear in the line [00:23:09] web search leads me to believe that `scp -t ` is a listener process that is waiting for a remote to send it data [00:23:11] And... I can't find any use of the -t parameter in my code... [00:23:19] Ah [00:24:00] But the scp's are started from outside Toolforge... [00:24:26] Unless that means that it started but never ended [00:25:36] yeah. each of these hung scp receivers is paired with an sshd process [00:25:50] let me see if I can kill those parents... [00:26:01] Ok, thanks [00:27:19] I can run things now [00:28:27] And now, connection closed [00:28:45] the scp processes are orphaned though :( [00:29:57] I think I will have to reboot the bastion to clear them, but I worry that they will come right back the next time you run whatever scp process on your end that started this [00:30:42] Yes, I understand, I would worry also [00:31:28] Let me check my processes in other servers [00:33:03] jem: here's what I see https://phabricator.wikimedia.org/P51423 [00:37:49] bd808: I'm cleaning the scp's in the source host [00:51:10] bd808: I'm almost sure that I've fixed the problem in the source host [00:51:47] Anyway I have disabled the scp line that caused the loop and will investigate further [00:52:32] And again, I'm sorry [00:53:02] jem: excellent. I need to step away for my dinner, but I will check in later and probably reboot the bastion then. [00:53:14] Ok then, thanks [00:53:23] I'm going to bed now, it's very late here (Spain) [00:53:40] stuff happens too, so don't feel too bad about triggering something werid [00:55:13] I hope so :) and it's not the first time and won't be the last, probably [00:56:00] The key is learning and improving things each time [01:51:51] !log tools Scheduled reboot of login.toolforge.org for 2023-08-25 01:56:08 UTC [01:51:53] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [02:00:32] !log tools Reboot of login.toolforge.org hung until a hard reboot was triggered via horizon [02:00:34] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [02:02:40] * bd808 runs away to play with his dog [02:02:53] hi [02:23:41] sorry for the silly question but: how do i get started with using toolforge and cloud vps? [02:24:20] is it fine to have a developer account even if its just for phabricator and checking out wmcloud? [02:25:39] and please ping me at telegram, its better [02:52:53] yes it's a perfectly good use, Juest [02:53:20] ssh access requires having a project on toolforge or cloud vps, correct? [02:53:47] can i sign up for the beta instance? [02:54:50] well, it depends what you want it for :P [02:55:29] exploring mediawiki and providing feedback from trying out things [02:55:58] i was referring to the access [02:56:13] thinking that perhaps bation was enough for you [02:56:51] Oh i see, just checking things out, is it more sensitive than mediawiki access? [02:57:16] im not really a programmer but i aspire to bridge the gap between developer and user [02:57:54] well, I thik I don't really know myself how these are granted nowadays [02:58:59] if you just want to explore mediawiki as a user, I would encourage you to do it from the web interface [02:59:11] or, for a more developey role, with a local install [02:59:22] I'd like to explore wmcloud as well [02:59:22] beta is more complicated server side [02:59:27] puppet roles and such [03:00:06] less beginner-friendly [03:00:50] i see [03:01:06] i do have a mediawiki test instance albeit on a older version [03:01:22] i'd like to contribute/help/test wmf as a whole [03:03:01] sorry for having confused you at some point [03:06:58] and thanks so far Platonides :) [15:26:25] I need one bot plz [15:26:41] taab [15:26:47] taavi [15:56:17] taavi can i get op plz [15:59:49] Eze14Mu: why [16:00:41] I want help taavi in this chanel [16:00:51] Eze14Mu: with what? [16:01:49] The people make sure people respect rules and don't says bad word why? [16:02:22] Eze14Mu: I don't think help is needed; what makes you think so? [16:02:50] Eze14Mu: could you point to these rules please? [16:03:14] idk if here are rules but there so many people here [16:03:57] that's not a very good start [16:03:59] Eze14Mu: if you do not know the rules, then you are not the right person to "make sure people respect rules", I'd say. [16:04:10] also, for the start, you probably want to get a cloak for verification first. See https://meta.wikimedia.org/wiki/IRC/Cloaks [16:09:31] Eze14Mu: also, ftr, most IRC channels tend to invite ops as needed from the long-term users of that channel, instead of entertaining requests from random people they've never talked with before [16:10:02] Whaaaaaaaaaaaaaaa [16:10:29] Eze14Mu: exactly. [16:27:17] and i forgot my developer account password again and i cant reset it because this happened under 24 hours [16:27:28] Eze14Mu: I'd also prefer if you did not PM me, especially without asking first [16:27:57] Ok [16:28:32] What mean +bd808 [16:31:27] Eze14Mu: Please stop pinging random people. Please read what has been written here in this channel before. Thank you. [16:32:08] im curious, what are my options for exploring wmcloud as a user? (not mediawiki per se) [16:33:59] what do you mean by exploring? [16:34:14] https://toolhub.wikimedia.org/is a good way to find tools, botth those hosted on WMCS and elsewhere [16:34:16] https://toolhub.wikimedia.org/ [16:34:17] testing, maybe giving feedback if possible [16:34:32] trying things out and gaining experience [16:35:01] how often do you guys get silly people like that person? [16:35:54] toolforge and cloud vps are for actual projects involving wmf services? [16:36:22] (I wouldn't call folks silly. It's more like a different mindset.) [16:36:23] Juest: https://wikitech.wikimedia.org/wiki/Help:Cloud_Services_introduction is a good place to start your research [16:36:23] https://wikitech.wikimedia.org/wiki/Help:Cloud_Services_introduction [16:37:26] I see, thank you. [16:37:53] well i meant the naive mindset like them [16:38:05] apologies for my wording [16:47:21] it's cool if people want to help. of course that first requires knowing what you're doing. :) When you don't know, then it might be naive or it might be "collecting hats". I don't think we get many of such requests but sure, sometimes [16:51:58] yeah i understand that. [16:52:18] i sort of know a thing or two about IT and development [16:53:40] is there a reason why gerrit is used over the gitlab instance? [16:53:50] why the gitlab exists? backup? [16:57:22] Juest: https://www.mediawiki.org/wiki/GitLab_consultation [16:58:41] it looks like the page is outdated, is it still valid, yes? [16:59:09] it's not outdated, it's obsolete. [16:59:32] (or "historical" as it was about the consultation itself which is over) [16:59:51] see the "Outcome" section on that page [17:00:11] yeah sorry, i didnt realize very well [17:01:16] np :) [17:03:05] currently gitlab is mid-deployment progress of the runners? [17:03:19] i've tried to login on gitlab and it says my account is blocked, i suppose its expected [17:08:01] Juest, uhm, what is the exact error message? [17:08:16] it just says my account is blocked [17:08:20] hold on let me grab it [17:08:22] Accounts need to be approved manually still [17:08:35] Ideally that message would point to https://phabricator.wikimedia.org/maniphest/task/edit/form/117/ somehow [17:08:56] my account is pending approval and i've been blocked [17:09:09] Your account is pending approval from your GitLab administrator and hence blocked. Please contact your GitLab administrator if you think this is an error. [17:09:14] It will be fine when approved [17:09:18] Hmmm [17:09:20] Use the form that andre linked [17:09:59] i dont need gitlab access anyways, i can wait until accounts are approved automatically [17:10:21] I'm not sure when that will be [17:10:26] GitLab accounts will never be automatically approved. This is a spam trap problem. [17:10:28] I'm honestly not sure if we do approve accounts automatically. Because spam. [17:11:04] I don't think we have a convincing concept, to be honest [17:11:53] is there a reason why phabricator branding hasnt changed to phorge since phorge is now deployed? or it could be called wikimedia phabricator on the title next to the logo on top left [17:12:33] Juest: do you have some questions that are on-topic for Wikimedia Cloud Services? [17:14:44] Juest: basically because rebranding takes efforts and only increases confusion after 9 years of calling Phabricator Phabricator. No gain [17:14:48] phabricator is not part of wikimedia cloud services? where can i direct general questions about wikimedia hosted services in chatroom form? [17:14:59] #wikimedia-tech might be better suited [17:15:09] thank you [17:15:13] Phabricator is not hosted on WMCS per its domain, no :) [17:19:51] !log tools.ifttt-dev Updated to 6566c3c [17:19:53] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.ifttt-dev/SAL [17:26:48] !log tools.ifttt Updated to 6566c3c (T343142) [17:26:51] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.ifttt/SAL [21:27:24] !log tools.ifttt-dev Updated to 3fc2077 [21:27:26] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.ifttt-dev/SAL [21:30:06] !log tools.ifttt Updated to 3fc2077 [21:30:07] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.ifttt/SAL