Hi,
You need to delete the Azure Bastion so that you will no longer be charged for it. Bastion can be used to connect to 1 or multiple VMs, and charges accrue regardless of whether or not you use it, for as long as the Bastion exists. You will also want to delete associated public ip if you no longer need it.
If the above is useful please click Accept Answer.
Thanks.
-TP