How to migrate datasets in ADF from Gen 1 to Gen2

Erika Gupta 0 Reputation points
2023-02-28T15:05:20.47+00:00

Hi ,

I need to migrate datasets in data factory to gen 2 , which are currently pointing to Gen1 datalake.

We have around 500 datasets pointing to Gen1 Datalake.

How can we make them point to Gen2 datalake?

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,933 questions
0 comments No comments
{count} votes

1 answer

Sort by: Most helpful
  1. Tech-Hyd-1989 5,761 Reputation points
    2023-02-28T17:06:29.5866667+00:00

    Hi Erika Gupta

    Good day!

    Azure Data Factory offers a scale-out, managed data movement solution. The article below shows you how to use the Data Factory copy data tool to copy data from Azure Data Lake Storage Gen1 into Azure Data Lake Storage Gen2. You can follow similar steps to copy data from other types of data stores.

    https://learn.microsoft.com/en-us/azure/data-factory/load-azure-data-lake-storage-gen2-from-gen1

    Because of the scale-out architecture of Data Factory, it can ingest data at a high throughput. For more information, you can see Copy activity performance.

    Please accept as answer and upvote if the above information is helpful for the benefit of the community.