accessing Synapse Table from databricks using pyspark

Question

accessing Synapse Table from databricks using pyspark

Naveen Kumar 1

sql_pwd= dbutils.secrets.get("keys and scope")
2
urrl="jdbc:sqlserver://synapsewus2prod.sql.azuresynapse.net:1433;database=<db_name>;user=<user_name>;password="+sql_pwd+";encrypt=true;trustServerCertificate=false;hostNameInCertificate=*.sql.azuresynapse.net;loginTimeout=30;"
3
df=spark.read.format("com.databricks.spark.sqldw").option("useAzureMSI","true").option("url", urrl).option("dbtable", "table name").option("tempDir","wasbs://<container location>").load()

tried the provided solution but it didn't helped. Throwed an error saying, "
com.databricks.spark.sqldw.SqlDWSideException: Azure Synapse Analytics failed to execute the JDBC query produced by the connector."

could you please help, I am trying to Update a synapse table from the pyspark dataframe that I have in Databricks.
I am having a synapse table with columns A,B,C,D and I have a Dataframe that has the values for column D that I need to update in the Synapse Table.

PRADEEPCHEEKATLA 90,606 Reputation points

2022-03-22T09:58:00.737+00:00

Hello @Naveen Kumar ,

Thanks for the question and using MS Q&A platform.

Could you please the stack trace of the error message?
PRADEEPCHEEKATLA 90,606 Reputation points

2022-03-25T05:43:56.043+00:00

Hello @Naveen Kumar ,

Just checking in if you have had a chance to see the previous response. We need the following information to understand/investigate this issue further.
Vishwanath Jangam 1 Reputation point

2022-04-13T12:31:54.747+00:00

@Naveen Kumar did you get any solution for this ,
Updating a synapse table using databricks query.

Your answer

PRADEEPCHEEKATLA 90,606 Reputation points

2022-03-22T09:58:00.737+00:00

Hello @Naveen Kumar ,

Thanks for the question and using MS Q&A platform.

Could you please the stack trace of the error message?
PRADEEPCHEEKATLA 90,606 Reputation points

2022-03-25T05:43:56.043+00:00

Hello @Naveen Kumar ,

Just checking in if you have had a chance to see the previous response. We need the following information to understand/investigate this issue further.
Vishwanath Jangam 1 Reputation point

2022-04-13T12:31:54.747+00:00

@Naveen Kumar did you get any solution for this ,
Updating a synapse table using databricks query.

Share via

accessing Synapse Table from databricks using pyspark

Your answer