[12:44:49] anyone know what's up with cloudcephosd1039? it just alerted as being down [12:58:31] probably T394333, so not touching it unless ceph becomes unhappy [12:58:32] T394333: Q4:rack/setup/install cloudcephosd10[48-51] & relocate cloudcephosd1039 - https://phabricator.wikimedia.org/T394333 [13:21:58] As always I did my best to downtime it but probably messed something up [13:22:05] Sorry taavi [13:22:20] It's drained already so ceph won't care [14:30:27] What am I doing wrong here? https://usercontent.irccloud-cdn.com/file/EnxHNUNS/image.png [14:31:20] andrewbogott: the instance label selector does not seem to be in regex mode [14:31:34] ah! So cloudcephosd1039.* would've worked? [14:31:50] oh wait that's not what you're saying [14:31:59] I definitely selected 'regex' in the ui when I entered it... [16:50:42] Anyone around to help with reviews on this https://gitlab.wikimedia.org/repos/cloud/toolforge/alerts/-/merge_requests/31 ? It’s about setting up components-api alerts and runbook [21:23:45] hi if anyone familiar with Bitu and LDAP, we have a contractor who is unable to get his ssh key activated [21:23:48] we followed https://wikitech.wikimedia.org/wiki/Help:Accessing_Cloud_VPS_instances [21:24:13] the key got added via https://idm.wikimedia.org/keymanagement/ and it shows Active: No with a big blue button [ACTIVATE] [21:24:30] can you tell me what you mean when you say he can't get it activated? [21:24:35] upon pressing it, that shows a popup at the top stating the key got activated, but is still not active :) [21:24:47] and I don't see it in ldap [21:25:17] oh... that's definitely failing before it has much to do with me :( slyngs is the one to ping probably. [21:25:18] ldapsearch -LLL -x 'cn=corvus' # https://ldap.toolforge.org/user/corvus [21:25:39] that is James E. Blair, the author of Zuul and he is contracting for the zuul upgrade [21:25:57] so yeah that would be Bitu broken? Do we have a way to manually add the key to ldap? [21:28:55] It is remotely possible that we're running into phabricator.wikimedia.org/T355663 but that shouldn't strike for another few months. [21:30:06] Bitu is really the right way to do this. jhathaway do you have bitu debug skills? Or does anyone besides Simon? [21:30:18] hashar: is the account created but not the key, or are is their account not getting into ldap at all? [21:32:01] the account is in LDAP apparently [21:32:12] at least according to https://ldap.toolforge.org/user/corvus [21:32:15] andrewbogott: s.lyngs would be the best person to help, but if it is urgent I can take a look [21:32:37] for a start, I will file a task with relevant info :) [21:33:50] and corvus has `uidNumber: 3150` so I don't think it is T355663 [21:33:51] T355663: Allocate more available UNIX UIDs for human users - https://phabricator.wikimedia.org/T355663 [21:36:05] jhathaway: if you could look in the logs, that would be great :) [21:36:12] happy to [21:36:12] I don't know what kind of validation bitu does but it could be rejecting the key and not explaining itself. Like if it uses a deprecated algo, or the format they're entering it in is wrong. [21:36:15] corvus is on the US west coast :) [21:36:48] thank you jhathaway [21:39:52] jhathaway: I have filed it as https://phabricator.wikimedia.org/T395857 :) [21:40:04] and he can be reached here on irc as `corvus` [21:50:42] hashar & corvus, added a log to the phab task, looks like the idm could not parse the public key, not sure why [21:51:04] ah fun [21:51:15] thank you so much! [21:51:29] of course let me know if I can help more