You should enable soft-delete and purge protection on your key vaults. This is such a "must have" that Microsoft will remove the ability to opt-out of soft delete in 2025.
If you don't have soft delete enabled and manage to delete the key vault, you will only be able to recover if you have an alternate backup of the encryption key contain in the key vault. Without this there will be no way to recover access to the encrypted disks.