[00:14:41] lucaswerkmeister: did you see https://lists.wikimedia.org/hyperkitty/list/cloud-announce@lists.wikimedia.org/thread/U42VYJXEENMOTVWJZ2DTV4PNZXT6M7PY/ ? [08:27:41] legoktm: yes I saw it, otherwise I wouldn’t have known I needed to delete the symlink [08:27:48] but that doesn’t mean I have to be happy with it… [09:13:53] !log admin Adding new OSDs ['cloudcephosd1019.eqiad.wmnet', 'cloudcephosd1020.eqiad.wmnet'] to the cluster (T285858) - cookbook ran by dcaro@vulcanus [09:13:57] !log admin Adding OSD cloudcephosd1019.eqiad.wmnet... (1/2) (T285858) - cookbook ran by dcaro@vulcanus [09:13:58] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL [09:14:03] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL [10:01:53] !log admin Adding new OSDs ['cloudcephosd1019.eqiad.wmnet', 'cloudcephosd1020.eqiad.wmnet'] to the cluster (T285858) - cookbook ran by dcaro@vulcanus [10:01:58] !log admin Adding OSD cloudcephosd1019.eqiad.wmnet... (1/2) (T285858) - cookbook ran by dcaro@vulcanus [10:01:59] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL [10:02:03] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL [10:02:26] !log admin Rebooting node cloudcephosd1019.eqiad.wmnet - cookbook ran by dcaro@vulcanus [10:02:30] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL [10:05:20] !log admin Finished rebooting node cloudcephosd1019.eqiad.wmnet - cookbook ran by dcaro@vulcanus [10:05:23] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL [10:07:01] !log admin Added OSD cloudcephosd1019.eqiad.wmnet... (1/2) (T285858) - cookbook ran by dcaro@vulcanus [10:07:02] !log admin Adding OSD cloudcephosd1020.eqiad.wmnet... (2/2) (T285858) - cookbook ran by dcaro@vulcanus [10:07:06] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL [10:07:20] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL [10:07:30] !log admin Rebooting node cloudcephosd1020.eqiad.wmnet - cookbook ran by dcaro@vulcanus [10:07:34] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL [10:10:30] !log admin Finished rebooting node cloudcephosd1020.eqiad.wmnet - cookbook ran by dcaro@vulcanus [10:10:33] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL [10:12:13] !log admin Added OSD cloudcephosd1020.eqiad.wmnet... (2/2) (T285858) - cookbook ran by dcaro@vulcanus [10:12:17] !log admin Added 2 new OSDs ['cloudcephosd1019.eqiad.wmnet', 'cloudcephosd1020.eqiad.wmnet'] (T285858) - cookbook ran by dcaro@vulcanus [10:12:20] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL [10:12:24] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL [10:12:34] !log admin The cluster is not rebalance after adding the new OSDs ['cloudcephosd1019.eqiad.wmnet', 'cloudcephosd1020.eqiad.wmnet'] (T285858) - cookbook ran by dcaro@vulcanus [10:12:39] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL [10:42:46] bstorm, bd808 what is the task again, sorry? [10:43:35] Stuff in /data/scratch/tmp can be just nuked [10:44:35] I don't recall anything else taking up much space but I may have forgotten something [10:44:46] Nemo_bis: https://phabricator.wikimedia.org/T183758#7191399 [10:45:18] thanks [10:54:25] most of it seems maps stuff [14:56:17] Nemo_bis: it makes sense that most of it would have been maps/geo coord related. Those dumps are the user created "public" tables that were on the wiki replica database servers directly (side by side with the wiki tables) prior to the the 2017 service redesign which fixed replica drift but removed the ability to create ad hoc tables on the replicas. [16:55:02] dev-buster.toolforge.org apparently has no tab completion for the `become` command, should I open a task for that? [17:09:49] lucaswerkmeister: Does it work on other bastions? if so then sure. [17:11:00] Hi, I'm a bit new to Toolforge. A bot I'm making needs credentials to login, so where would be a safe place to put them? [17:11:49] Caburum: in the tool's directory, but make sure they're only readable to you, not to others [17:11:56] chmod 600 [17:11:59] okay thanks! [17:12:33] I usually create an empty file, then chmod it, and then put the credentials in it [17:14:34] andrewbogott: thanks, created T286072 [17:14:35] T286072: No tab completion for `become` on dev-buster.toolforge.org - https://phabricator.wikimedia.org/T286072 [17:43:54] lucaswerkmeister: duplicates T280252, but i'm going to merge that to your since it has more information [17:43:55] T280252: Toolforge Buster bastion no longer tab completes become command - https://phabricator.wikimedia.org/T280252 [17:44:20] huh, I could swear I searched for duplicates [17:44:39] ah but I think I only looked for “dev-buster” which wasn’t mentioned there directly, I should’ve searched “buster” [17:44:41] thanks anyways! [18:46:13] !log tools cleared error state for tools-sgeexec-0940.tools.eqiad.wmflabs [18:46:17] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL