@Julian Alexander Diaz Zavala Thank you for reaching out to the Microsoft Q&A platform.
Product team confirmed that there isn't an option to remove the modern appliance at the moment and they are working on enabling this option.
In cases like this, customers delete the vault and complete resource group itself.
Sorry for the inconvenience this must have caused!
Please accept as answer and do a Thumbs-up to upvote this response if you are satisfied with the community help.