[10:03:32] Hey! Can somebody take a look at this deployment-prep patch for restbase ? https://gerrit.wikimedia.org/r/c/operations/puppet/+/865578 [10:16:16] nemo-yiannis: done [10:17:21] thanks hnowlan [15:50:13] Starting deployment of the netmon2002 instance in 10 minutes. [15:51:03] ack. gl;hf :) [16:02:15] !log Sync LibreNMS RRD in netmon2001 [16:02:16] Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log [16:08:58] !log sync librenms RRD in netmon2002 [16:08:59] Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log [16:09:49] !log sync rancid in netmon2001 and netmon2002 [16:09:50] Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log [21:04:58] Is there anyone around that understands https://wikitech.wikimedia.org/wiki/Server_Lifecycle#Rename_while_reimaging well enough to explain to me the 'Update Netbox' step? In particular, the part where it talks about deleting selected interfaces? [22:15:30] urandom: I can if you still need it [22:15:55] volans: oh my; is it quite late for you? [22:16:11] my plan B was to wait and ask you directly tomorrow :) [22:16:26] no prob I'm here now :) [22:16:43] Ok [22:16:46] what's the hostname [22:17:26] restbase-dev200[1-3], I want to change them to cassandra-dev200[1-3]... none of them has been put to use yet [22:17:42] ok [22:17:45] they have all the IPs they should have, so I'm just wanting to rename them [22:18:04] ah, I see the complexity here [22:18:15] that section seem to make sense until I get about half way down the 'Update Netbox' section [22:18:25] the rename procedure is for a decom + reimage [22:18:30] (and then it loses me) [22:18:32] there is no guarantee the same IPs will be used [22:18:45] is that ok for you? [22:19:30] Ok, that makes sense... but going up a couple of bullet points, it seems to suggest that you rename them before deleting them [22:19:49] "Rename the DNS Name of all its IPs (there should be only the management IP at this stage). In order to do so, search for them in the IpAddresses Netbox page (Search box on the right) using the current hostname (not FQDN in order to find the management IP too)." [22:20:23] I see the hosts active in netbox so I guess the decom was not run [22:20:33] I've done nothing yet, no [22:20:37] ah ok [22:20:51] I wanted some confidence that I knew what I should be doing, before potentially making a mess :) [22:20:52] the decom will delete all the assigned IPs and leave the interfaces empty, beside the mgmt one [22:21:00] eheheh makes sense [22:21:35] Oh, so why then the step I pasted above? [22:21:44] wouldn't they be deleted at this point? [22:22:53] yes, there should be only the mgmt one at that point, that has its dns name that needs to be renamed [22:23:18] I see [22:23:33] like for the first one https://netbox.wikimedia.org/ipam/ip-addresses/10185/ [22:23:43] edit + change DNS Name [22:23:46] + save [22:24:03] Ok, I see [22:24:26] the important bit is to save where the ifaces are attached [22:24:48] if in doubt make a screenshot of the interface tab before editing, like this one [22:24:51] https://netbox.wikimedia.org/dcim/devices/4093/interfaces/ [22:25:10] Ok [22:25:14] (can still be recovered from netbox changelog, but is a bit more convoluted) [22:25:34] the important bits being the cable ID, the switch name and the port [22:25:38] on the switch side [22:26:09] those will be put as input in https://netbox.wikimedia.org/extras/scripts/interface_automation.ProvisionServerNetwork/ [22:26:24] this is also the magic place where you have to specify "How many Cassandra instances" ;) [22:26:32] to get the additional IPs auto-assigend [22:26:37] *auto-assigned [22:26:52] * urandom backspaces away the question he was about to ask [22:27:09] :) [22:28:39] Ok, it's getting late enough in my day, I think I'm going to wait at this point until first thing tomorrow [22:29:08] that way if I do make a mess of it, there will be more people around to pepper with questions :) [22:29:25] volans: but thank you, this makes more sense now [22:29:48] there will, but not me ;) tomorrow is a public holiday here [22:30:15] and Fri. is my usual friday... but I can answer pings on IRC :) [22:31:04] and it's what....nearly midnight there now? [22:31:17] will be in ~30m [22:31:28] yikes! [22:32:01] no worries, I happened to look and read, you didn't even summon me :) [23:49:57] FYI, taking advantage of the lull in human operational activities to work on some etcd key transition stuff for the edge cache nodes. [23:50:16] if you're around and working on things that touch e.g. pybal and/or the edge caches, please speak up! [23:50:44] (as there may be some brief windows of time where normal operational practices/scripts don't work quite right for those things!)