How can I insert a pandas DataFrame into Azure SQL Database with JDBC?

Question

How can I insert a pandas DataFrame into Azure SQL Database with JDBC?

Jeff vG 96

What is the correct way to use the JDBC Spark modules to insert a 4k row pandas DataFrame into Azure SQL Server? I see many questions like this on StackOverflow, but the answers are generally "it can't be done" or are overly complicated. It's difficult to believe that this is not a core use case of Azure Databricks.

1 answer

Your answer

Answer 1

PRADEEPCHEEKATLA 90,641 Moderator

Hi @Jeff vG ,

Thanks for the question and using MS Q&A platform.

Looks like you cannot insert a pandas DataFrame into Azure SQL Database using JDBC.

When I tried using JDBC it returns - Query returned no results.

I would suggest try using the pyodbc package.

This article - Insert Python dataframe into SQL table describes how to insert a pandas dataframe into a SQL database using the pyodbc package in Python.

Hope this helps. Do let us know if you any further queries.

---------------------------------------------------------------------------

Please "Accept the answer" if the information helped you. This will help us and others in the community as well.

PRADEEPCHEEKATLA 90,641 Reputation points Moderator

2021-07-27T10:58:37.837+00:00

Hi @Jeff vG ,

Just checking in to see if the above answer helped. If this answers your query, do click Accept Answer and Up-Vote for the same. And, if you have any further query do let us know.
PRADEEPCHEEKATLA 90,641 Reputation points Moderator

2021-07-28T11:19:47.417+00:00

Hi @Jeff vG ,

Following up to see if the above suggestion was helpful. And, if you have any further query do let us know.
Nanavati, Sarang 1 Reputation point

2022-07-25T20:10:30.283+00:00

Is there a way to do a create table (w/o defining the table) and insert the pandas dataframe in one go to Azure SQL?

Within Azure SQL, you can do this as "Select * into table1 from table2". Feel there must be a way to do something similar within python where you execute a query such as "Select * into azureSQLtable1 from pandasdataframe " w/o the need of creating table and selecting each row item in a loop.

Share via

How can I insert a pandas DataFrame into Azure SQL Database with JDBC?

1 answer

Your answer