Can I create a metadata driven copy data tool pipeline in ADF with same source and different connections.

Derik Roby 16 Reputation points
2023-11-16T12:05:13.45+00:00

My requirement is to copy data from 3 different SQL server connections. Is it possible tp do it in a go or should I create 3 separate metadata driven copy pipelines ?

User's image

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,690 questions
0 comments No comments
{count} votes

1 answer

Sort by: Most helpful
  1. Nandan Hegde 32,336 Reputation points MVP
    2023-11-16T12:09:23.4666667+00:00

    Hey,

    You can parameterize the linked services for the same type.

    So you can use the same meta data driven pipeline by passing the server details to the linked service at runtime.

    https://www.techbrothersit.com/2022/02/parameterize-linked-services-in-azure.html#:~:text=In%20the%20source%20tab%2C%20click,then%20provide%20the%20table%20name.


Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.