Good day,
I found a similar post to this
This is absolutely NOT a similar scenario and not even a similar product. According to your description you are using Azure SQL database service while the link your provided is about SQL Server.
Using Azure Database you do not have any control in the server instance level or the operating system which host the instance. You only use a service of a logical instance. What you can and you should do is to configure the Azure firewall.
Check the following for more information on how to configure the Azure Firewall
https://learn.microsoft.com/en-us/azure/azure-sql/database/firewall-configure