Please provide more info on what technology you are using for your website?
Create a database connector and make sure server IP has been added to Azure firewall so that you can query the DB.
Are you able to query your database from your local machine?