I have a scenaio to move data from ADLS Gen2 to SQL Server hosted in Azure VM and vice versa.Which ADF - Integration runtime to be used?

Question

How to choose Integration Runtime to load data from ADLSGEN2 to sql server (in Azure VM) and vice versa.
How to decide on number of nodes where IR should be installed?

Answer 1

Hi Srinivas,

Welcome to the community.

You can determine which type of IR via this guide:

https://learn.microsoft.com/en-us/azure/data-factory/concepts-integration-runtime#determining-which-ir-to-use

Sizing is not easy to come up with and I couldn't find any white paper that could help you out. (Note that I do not work for Microsoft so I do have access to only the same resources that you have.

I would personally recommend you perform performance tests with various configurations to better find what would represent an equilibrium between expense and performance for your organization.

Here's a "guide":

https://learn.microsoft.com/en-us/azure/data-factory/concepts-data-flow-performance

Answer 2

@Pierre-Luc Giguere : So can we summarize like this?
If my SQL Server is in public network hosted in Azure VM then I can use Azure IR for data movement.
If SQL Server is in private network hosted in Azure VM then need to use Self-Hosted IR for data movement?

Please suggest.