Apologies for this experience @user.
Rest assured; you don't have to delete your entire MSA in order to remove Azure. However, I would suggest that you look into who may have had access to your MSA as an Azure account doesn't materially appear out of nowhere.
What you need to do is simply cancel the Azure subscription from your account:
- Go to the Azure portal.
- Navigate to Subscriptions.
- Choose the subscription you want to delete.
- Click on Cancel Subscription.