ADF Pipeline - One to one table load

Vijay Sahu 1 Reputation point
2022-05-01T03:41:55.887+00:00

Hi All

We have requirement to load the Teradata tables data in Azure Synapse which is one to one mapping load. We have more than 200 tables in TeraData and we don't create 200 different pipeline. We are required to create one pipeline which will read 200 tables one by one and load in Synapse table... It is One to One mapping load.

Kindly please suggest how can we achieve this

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,346 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,487 questions

1 answer

Sort by: Most helpful
Most helpful Newest Oldest
  1. Nandan Hegde 29,886 Reputation points MVP
    2022-05-02T03:45:13.51+00:00

    Hey,
    You need to create a lookup table that would contain the list of all the tables that you want to copy and then iterate it over loop for copying the data sequentially.

    The below links would explain it in detail:
    https://analytics-blog.com/2019/09/24/copy-multiple-tables-in-azure-data-factory/
    https://key2consulting.com/how-to-copy-multiple-tables-from-on-premise-to-cloud-in-azure-data-factory/

    0 comments