Can I create a metadata driven copy data tool pipeline in ADF with same source and different connections.

Derik Roby 1 Reputation point
2023-11-16T12:05:13.45+00:00

My requirement is to copy data from 3 different SQL server connections. Is it possible tp do it in a go or should I create 3 separate metadata driven copy pipelines ?

User's image

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
8,506 questions
0 comments

1 answer

Sort by: Most helpful
Most helpful Newest Oldest
  1. Nandan Hegde 27,391 Reputation points MVP
    2023-11-16T12:09:23.4666667+00:00

    Hey,

    You can parameterize the linked services for the same type.

    So you can use the same meta data driven pipeline by passing the server details to the linked service at runtime.

    https://www.techbrothersit.com/2022/02/parameterize-linked-services-in-azure.html#:~:text=In%20the%20source%20tab%2C%20click,then%20provide%20the%20table%20name.