Generally yes, though you may need to update the firewalls on the public endpoint to allow access.
The connection string is available from the portal, and follows the pattern <workspace name>-ondemand.sql.azuresynapse.net
If you need to update the firewall, this is also readily available in the portal.