I have a scenaio to move data from ADLS Gen2 to SQL Server hosted in Azure VM and vice versa.Which ADF - Integration runtime to be used?

Srinivas 1 Reputation point
2021-09-13T12:48:59.497+00:00

How to choose Integration Runtime to load data from ADLSGEN2 to sql server (in Azure VM) and vice versa.
How to decide on number of nodes where IR should be installed?

Azure Virtual Machines
Azure Virtual Machines
An Azure service that is used to provision Windows and Linux virtual machines.
7,402 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,925 questions
0 comments No comments
{count} votes

2 answers

Sort by: Most helpful
  1. Pierre-Luc Giguere 1,076 Reputation points
    2021-09-13T17:40:46.377+00:00

    Hi Srinivas,

    Welcome to the community.

    You can determine which type of IR via this guide:

    https://learn.microsoft.com/en-us/azure/data-factory/concepts-integration-runtime#determining-which-ir-to-use

    Sizing is not easy to come up with and I couldn't find any white paper that could help you out. (Note that I do not work for Microsoft so I do have access to only the same resources that you have.

    I would personally recommend you perform performance tests with various configurations to better find what would represent an equilibrium between expense and performance for your organization.

    Here's a "guide":

    https://learn.microsoft.com/en-us/azure/data-factory/concepts-data-flow-performance


  2. Srinivas 1 Reputation point
    2021-09-15T04:09:11.917+00:00

    @Pierre-Luc Giguere : So can we summarize like this?
    If my SQL Server is in public network hosted in Azure VM then I can use Azure IR for data movement.
    If SQL Server is in private network hosted in Azure VM then need to use Self-Hosted IR for data movement?

    Please suggest.

    0 comments No comments