Serverless Pool

Rohit Kulkarni 686 Reputation points
2022-09-02T15:44:21.79+00:00

Hello Team,

I am trying to create a table in Serverless pool. With the below command mentioned :

%python

Read from Azure Synapse table via spark.read.load

df = spark.read \
.format("com.databricks.spark.sqldw") \
.option("sqlDwUrl", sqlDwUrl) \
.option("tempDir", tempDir)\
.option("forwardSparkAzureStorageCredentials", "true") \
.option("dbTable", tableName) \
.load()

All these are the parametes value we are passing in it :

sqlDwUrl,tempDir, tableName

I am getting error as :com.databricks.spark.sqldw.SqlDWConnectorException: Exception encountered in Azure Synapse Analytics connector code.

Screenshot attached for your reference :

237373-image.png

Please advise .

Thanks in advance
RK

Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
1,951 questions

1 answer

Sort by: Most helpful
Most helpful Newest Oldest
  1. PRADEEPCHEEKATLA-MSFT 78,576 Reputation points Microsoft Employee
    2022-09-05T08:17:48.213+00:00

    Hello @Rohit Kulkarni ,

    Thanks for the question and using MS Q&A platform.

    To resolve this issue - I would request to check the complete stacktrace to find the esact reason for the failure of the query.

    Note: If you scroll down the side bar - you will be able to find the exact reason for the failure similar to below screenshot:

    237753-image.png

    In case, if you are unable to find the resolution - you can share the complete stacktrace of the error message which you are experiencing?

    Reading the table data from Azure Synapse Analytics using Azure Databricks:

    237773-image.png

    For more details, refer to Azure Synapse Analytics.

    Hope this will help. Please let us know if any further queries.

    ------------------------------

    • Please don't forget to click on 130616-image.png or upvote 130671-image.png button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how
    • Want a reminder to come back and check responses? Here is how to subscribe to a notification
    • If you are interested in joining the VM program and help shape the future of Q&A: Here is jhow you can be part of Q&A Volunteer Moderators