You can use a Private Endpoint with Azure SQL Server to resolve the IP to private IP instead of Public IP. Please follow the document link below for steps to setup the same.
https://learn.microsoft.com/en-us/azure/private-link/tutorial-private-endpoint-sql-portal