This is the same issue that I had and described in my post. If you remove the public IP address (or replace with a Basic SKU) on the existing VM then you should be OK.
If you need a static IP address for your hosts for MFA or whitelisting then the easiest option is to deploy a NAT gateway. This will NAT all outbound traffic on your subnet (or entire VNET if you want) through a single public IP address. I blogged about this also: https://azurealan.ie/2020/04/27/outbound-nat-for-azure-virtual-machines/
Here is the how to deploy guide: https://learn.microsoft.com/en-us/azure/virtual-network/nat-gateway/tutorial-create-nat-gateway-portal