Hi,
If you are using Azure Bastion to connect, you would typically be aware since users would navigate to the VM in Azure portal -- Connect -- Azure Bastion when they want to connect. Are you or any of your users doing that? Or are they using Remote Desktop Connection (mstsc) to connect to your RD Session Host (aka Terminal Server)?
How can I stop it without deleting it in case there is an issue after deletion?
A: There is no option to stop Azure Bastion. The only option to eliminate hourly charges for it is to delete it, as you already mentioned. Charges accrue for Azure Bastion Basic/Standard/Premium simply by it existing, regardless of whether or not you use it.
Excerpt from Azure Bastion pricing page:
Azure Bastion is billed hourly from the moment the resource is deployed until the resource is deleted, regardless of outbound data usage. The hourly pricing will be based on the SKU selected, number of scale units configured, and data transfer rates.
An option for testing whether or not you are using Azure Bastion would be to set Network Security Group rule on AzureBastionSubnet that blocks RDP traffic to your server. If people attempted to use Bastion it would no longer work and you could quickly delete the NSG rule to unblock.
If you are still unsure whether or not you are using Azure Bastion to connect to your server, please describe in detail how users are connecting. From what you have written so far my sense is you have not been using it.
In regards to opening a ticket, they recently changed it so that if you have Developer level support you ask your question here on Q & A. With Standard or higher level support you create ticket via the Azure portal.
Priority community support (PCS) for Azure developer support plan customers
https://learn.microsoft.com/en-us/azure/azure-portal/supportability/priority-community-support
Please click Accept Answer and upvote if the above was helpful.
Thanks.
-TP