[10:48:36] 10netops, 10Infrastructure-Foundations, 10SRE, 10serviceops: Optimize k8s same row traffic flows - https://phabricator.wikimedia.org/T328523 (10cmooney) > BGP is smart about it (see '"first party" NEXT_HOP' in section 5.1.3.2 of the RFC), so it should just work on the router side. TIL didn't realise EBGP... [11:32:23] 10Mail, 10DNS, 10Infrastructure-Foundations, 10serviceops-collab, 10GitLab (Infrastructure): Add SPF records for gitlab.wikimedia.org - https://phabricator.wikimedia.org/T328642 (10Reedy) [11:46:43] hi all (cc jobo) im going to take the rest of the day of, im feeling a bit ill (exhausted and brain fog), ill be around an checking email if needed but mostly staying away from production systems [12:44:53] take care and get well! [14:09:00] Get well John. [14:37:37] 10Mail, 10DNS, 10Infrastructure-Foundations, 10SRE, and 3 others: Add SPF records for gitlab.wikimedia.org - https://phabricator.wikimedia.org/T328642 (10eoghan) p:05Triage→03Medium a:03eoghan [14:43:54] 10netops, 10Cloud-VPS, 10Infrastructure-Foundations, 10SRE, and 2 others: Upgrade cloudsw1-c8-eqiad and cloudsw1-d5-eqiad to Junos 20+ - https://phabricator.wikimedia.org/T316544 (10cmooney) >>! In T316544#8575464, @Andrew wrote: > We have a ton of rebalancing to do for each of these switches. The C8 deadl... [16:40:05] Hello! Is there a way of seeing historical/decommissioned hosts in netbox (or some other tool)? Even if this is hidden in the UI and searchable by, for example, API/database query? Why I'm asking: Something came up in conversation about how to pick the "next" hostname for a service/type, would be nice to have a definitive record without having to search phabricator history for references. [16:42:37] eoghan: In Netbox you could filter for servers in status "offline" or "decommisioning" [16:42:40] For example: https://w.wiki/6Hsk [16:44:04] But I'm a little rusty on if they remain there forever, and certainly for systems from before we used Netbox you won't find them there. [16:44:11] So I don't believe this is "definitive" as you asked [16:44:58] eoghan: server gets removed from netbox once completely removed from the DC and we keep track of that in a google spreadsheet for other needs, but those that go are always the oldest so picking the latest number +1 on netbox is 99% of the time the correct one [16:45:57] netbox changelog is kept for "just" 730 days [16:47:33] the DNS repos (operations/dns for very old stuff before it was automated and the auto-generated repository [ see https://wikitech.wikimedia.org/wiki/Netbox#DNS ]) are also a good place where it's easy to grep in the git history [16:49:12] Thanks topranks and volans! [16:50:57] volans: re "always the oldest", I think that where this came up was the example of gerrit, where gerrit1001 is active, and gerrit1002 was created at one point as a temporary/testing vm, and has since been removed, so sequentially picking from the netbox list is usually, but not always, the right move and was why I was wondering! [16:56:23] eoghan: correct, for this specific case something like `git log -p | grep -Eo 'gerrit1[0-9]+ ' | sort | uniq` on the operations/dns repository works, but would not work in the general case and if running the same on the auto-generated repo would give you only gerrit1001 because that happened before the migration to netbox-driven DNS [16:57:06] but let me stress that this specific one is quite a corner case, you got pretty unlucky! [17:27:47] Oh absolutely, I'm not sure this is a *huge* problem, was just curious if there was a better way. Thanks for the details (: [19:20:00] volans: what would be the issue or re-using gerrit1002? [19:50:08] https://github.com/jasonyates/netbox-circuitmaintenance [19:52:14] 10netbox, 10Infrastructure-Foundations, 10SRE, 10Traffic-Icebox: Make Netbox Active/Active - https://phabricator.wikimedia.org/T234997 (10BCornwall) [19:52:18] 10netbox, 10Infrastructure-Foundations, 10Patch-For-Review: Upgrade Netbox to 3.2 - https://phabricator.wikimedia.org/T296452 (10BCornwall) [20:33:51] 10SRE-tools, 10Infrastructure-Foundations, 10Machine-Learning-Team: httpbb with HTTP POSTs and json payload - https://phabricator.wikimedia.org/T328280 (10RLazarus) 05Open→03Resolved This is deployed! Thanks again for the patch, let me know if you need anything else.