Copy delta format data from one storage account to another in synapse

Question

Hi, Is there a way to copy delta format table data from one ADLS account to another? Ask is: We have a partner team who maintains data in delta format in their own storage account. They have it as day-wise partitioned. We need to daily copy only the modified partitions from their storage account and add it to a delta table in our ADLS account. My understanding is that we cannot simply copy parquet files, as they are tied to delta_log files. I see there is a Azure Databricks delta linked service, but that is not applicable in our case as our partner and us both use synapse. Is there any other linked service that can be used for this job?

Answer 1

Hi @- ,

Welcome to Microsoft Q&A forum and thanks for reaching out here.

You can utilize mapping data flows in Synapse Analytics and use Inline Dataset type as Delta in your source and sink transformation to copy the delta format table data from one ADLS to another.

Here is a document where detailed explanation about the functionality is provided: Delta format in Azure Data Factory & Synapse Analytics

Hope this helps.

---

Please don’t forget to Accept Answer and Yes for "was this answer helpful" wherever the information provided helps you, this can be beneficial to other community members.