You cannot turn it off as an Azure VM, but you can use Azure SQL Serverless thar can be paused automatically (not manually) after one hour of inactivity. The rest of Azure SQL options cannot be paused.
You can also configure Azure SQL Database firewall to not allow SQL connections.
You can find more alternatives on this MSDN forum thread.