Copy Delta File from one ADLS to another ADLS

Sharukh Kundagol 105 Reputation points
2023-03-16T11:51:35.0833333+00:00

Hi Team,

I have Delta file in one ADLS and need to copy to another, can I copy it using ADF ?

Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
1,910 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,481 questions
{count} votes

Accepted answer
  1. ShaikMaheer-MSFT 37,896 Reputation points Microsoft Employee
    2023-03-20T07:05:19.24+00:00

    Hi Sharukh Kundagol,

    Thank you for posting query in Microsoft Q&A Platform.

    If its Azure databricks Delta, then you can do by using Azure data bricks delta table connector dataset in Copy activity. But, If thats not the case, then you need to go with mapping dataflows only.
    In mapping dataflows, under source transformation, use inline dataset and select format as delta and select your delta tables. Use select transformation to take only desired columns and then finally use sink transformation.

    Hope this helps. Please let me know how it goes.


    Please consider hitting Accept Answer button. Accepted answers help community as well.

    0 comments No comments

2 additional answers

Sort by: Most helpful
  1. Nandan Hegde 29,886 Reputation points MVP
    2023-03-16T12:48:20.9466667+00:00

    As you want to copy files as is, my guess is you can do it leveraging binary dataset in ADF

    https://learn.microsoft.com/en-us/azure/data-factory/format-binary

    User's image


  2. LiJia Liu 170 Reputation points MVP
    2023-03-20T07:21:22.4833333+00:00

    Do you consider the Data Factory which is best suited for above use case?

    0 comments No comments