@Ramesh Kasver , If you have not advertised default routes (0.0.0.0/0) or Internet route prefixes through the BGP session, you can connect to the Internet from a virtual network linked to an ExpressRoute circuit.
----------
Please do not forget to "Accept the answer" wherever the information provided helps you to help others in the community.