@Steven Dravie Sorry for the painful experience. Perhaps I am missing something but based on given information and based on my understanding,
If this is an issue with deletion of resource group (RG), you may refer to this link - https://learn.microsoft.com/en-us/azure/azure-resource-manager/management/delete-resource-group?tabs=azure-powershell#delete-resource-group to delete a RG.
If this is an issue with deletion of recovery services vault (RSV), you can follow the instructions from this URL - https://learn.microsoft.com/en-us/azure/site-recovery/delete-vault
However, would be glad to help you resolve this issue provided if we have more details.
Could you please share the error details, a screenshot of the complete error message?
Looking forward to hear more from you!
------------------------------------------------------------------------------------------------------------------------------
Please do not forget to "Accept the answer" wherever the information provided helps you to help others in the community.