how to load data from Azure SQL server to Delta lake tables using synapse pipeline

Question

I need to migrate tables from Azure SQL server to Delta lake table on spark in synapse using synapse pipeline. In copy activity there is no source available for delta table.

Tried to load tables from Azure sql server to Azure data lake storage in CSV format and then spark notebook read that csv and write data into Delta lake table using synapse pipeline. But performance of this approach is too slow.

Answer 1

Hi @Anonymous ,

Thank you for posting query in Microsoft Q&A Platform.

In Copy activity, Delta format is not available. But as part of dataflows, you can use delta format with inline datasets. So kindly consider using dataflows in your case. Click here to know more about it.

Hope this helps. Please let us know if any further queries.

--------------

Please consider hitting Accept Answer button. Accepted answers help community also.