I will assume you are using Azure SQL Database. Azure SQL Database already has SSL enabled by default, so you don't need to set up SSL certificates manually. However, you need to ensure that your application is configured to use SSL when connecting to the database.
Modify the connection string to enforce SSL: a. In the connection string, append the following parameter: ;Encrypt=True. b. Optionally, you can also add ;TrustServerCertificate=False to require that the server has a valid SSL certificate.
For further clarification please provide more details