Effective method of loading to sqldb

Question

I have to transfer some 10 Mn rows of records to Azure sql db(not sql dw) from databricks , can you pls tell me the effective way of doing it using python or pyspark.
Is jdbc, an effective method of using for huge data like 10 mn rows.

Answer 1

Hi @vishwanath jangam , welcome to Microsoft Q&A forum.

I would suggest you to go through the below article where it presented the comparison based on connector for records close to 144 million.

Apache Spark connector: SQL Server & Azure SQL

It clearly says that spark-connector is faster compared to jdbc.

Please let me know if this helps or else we can discuss further.

----------

If answer helps, please mark it as 'Accept Answer'