After removing soft delete I had to disassociate storage account from vault as well. A bit odd, since storage account had been successfully removed earlier, but I was able to get rid of Recovery Service Vault after that. Thank you all for your answers. Warm regards.
Deleting Recovery Service Valut
I have an Recovery Service Vault that was originally linked to a storage account that won't delete. It was used for testing proposes only and it's no loner needed.. All containers, locks, data and endpoints have been successfully deleted. Even the storage account has gone but when trying to delete vault , Azure errors out whit this message : "Recovery Services Vault cannot be deleted as there are existing resources within the vault. : appaccount. Please ensure all containers have been unregistered from the vault and all private endpoints associated with the vault have been deleted, and retry operation"