[06:39:14] <arturo>	 reminder, it is a local bank holiday for me today. I wont be online, unless emergency 
[06:52:19] <blancadesal>	 ack, enjoy your time off!
[11:08:45] <dhinus>	 I'm looking at the alert for "purge_vm_rbd_images.service"
[11:09:00] <dhinus>	  Command '['rbd', '--pool', 'eqiad1-compute', 'snap', 'purge', '60b0d72a-52f0-423c-af80-5e0ca6aa7fcb_disk']' returned non-zero exit status 2.
[11:18:00] <dhinus>	 "Starting purge_vm_rbd_images.service - Clean up ceph images for deleted VMs"
[11:18:03] <dhinus>	 "rbd: error opening image 60b0d72a-52f0-423c-af80-5e0ca6aa7fcb_disk: (2) No such file or directory"
[11:18:45] <dhinus>	 I think it could be a race condition, I'll try running the script again
[11:19:44] <dhinus>	 yep that completed successfully
[11:20:13] <dhinus>	 and the alerts have cleared
[11:30:56] <dhinus>	 while I'm at it, I'm also running "sudo wmcs-dnsleaks --delete" to clean up the DNS leaks
[11:31:21] <dhinus>	 I checked the logs and I believe they're all from recently-deleted buster instances
[12:03:21] <dhinus>	 we're down from 22 to 2 "stray dns records"
[12:04:28] <dhinus>	 the remaining 2 are related to T360711
[12:04:29] <stashbot>	 T360711: Replace or remove Debian Buster VMs in 'video' cloud-vps project - https://phabricator.wikimedia.org/T360711
[12:37:38] <dhinus>	 two instances were deleted and recreated with the same name, but DNS was still pointing to the old IPs
[12:38:00] <dhinus>	 I edited the A records manually in Horizon, and removed the 2 extra PTR records using the openstack command line
[12:59:36] <dhinus>	 and the CloudVPSDesignateLeaks alert is finally gone :)
[13:00:10] <blancadesal>	 \o/