How to add 100 plus source link in ADF pipeline to transfer data to single destintion.

Question

I need to transfer data from multiple source sql servers( almost 100 plus) to a single destination using ADF, Is there is any way to add these much servers to ADF as source

Answer 1

Hi，AGPUsing dataset parameterization on dynamic templates can facilitate the management of numerous data source configurations. The following link shows a simple example and operational details.

https://learn.microsoft.com/en-us/azure/data-factory/how-to-expression-language-functions

https://medium.com/@meetalpa/mastering-parameterization-in-azure-data-factory-azure-synapse-analytics-and-microsoft-fabric-for-131f7aa92ee3

Regards

Mikey Qiao

---

If you're satisfied with the answer, don't forget to "Accept it," as this will help others who have similar questions to yours.

Answer 2

You can have a meta data driven framework wherein you can follow the below process: Create a dynamic linked service and have a config table with list of all servers and database name and pass the details in for each activity which would hoat your copy activity