@ADITYA SINGH GODARA Thank you for reaching out.
Yes, you can leverage the Azure Synapse Dedicated SQL Pool Connector for Apache Spark to achieve the above. Are you using service principal or a different auth method.?
How to connect to a relational database like Azure SQL database and query data within a Synapse notebook. The authentication method used in the below link will be using service principal. You can check and change accordingly if you are using a different auth method.
Regards,
Oury