Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,373 questions
How to connect to NetSuit database from Azure synapse spark notebook using pyspark ?
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(297.6, 52%, 38%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EHD%3C/text%3E%3C/svg%3E)
Heta Desai
357
Reputation points
I want to connect to the NetSuit database from Azure synapse spark notebook using pyspark. While using the below command it throws an error.
jdbcDF = spark.read.format("cdata.jdbc.netsuite.NetSuiteDriver") \
.option("url", url) \
.option("user", user) \
.option("password", password) \
.option("query",query) \
.load()
Error: Py4JJavaError: An error occurred while calling o649.load.
: java.lang.ClassNotFoundException: Failed to find data source: cdata.jdbc.netsuite.NetSuiteDriver. Please find packages at http://spark.apache.org/third-party-projects.html
Azure Synapse Analytics
{count} votes
-
PRADEEPCHEEKATLA 90,641 Reputation points Moderator2022-05-04T07:14:28.557+00:00 Hello @Anonymous ,
Thanks for the question and using MS Q&A platform.
From the error message - it clearly says the
cdata.jdbc.netsuite.NetSuiteDriverdoes not exists on the Spark Runtime?Make sure you have download the required jar file and upload the jar file to the workspace packages.
For more details, refer to Manage Scala and Java packages for Apache Spark in Azure Synapse Analytics and Process & Analyze NetSuite Data in Azure Databricks.
Hope this helps.
-
Heta Desai 357 Reputation points
2022-05-04T11:17:31.067+00:00 It asks for configuration file to install the package. How to create that configuration file to install the package into spark pool of Azure Synapse.
-
PRADEEPCHEEKATLA 90,641 Reputation points Moderator
2022-05-05T07:18:25.997+00:00 Hello @Anonymous ,
As I said above, you can download the required jar file and upload the jar file to the workspace packages.
Sign in to comment
Sign in to answer