what is Self hosted integrated runtime and what are the use cases

Question

I want to setup an ADF but I am quite confused on the use of the Self hosted integrated runtime (IR) option

for context purposes, I am setting up a new ADF, SQL and Azure data lake all on Azure and while creating the data factory, I noticed the IR feature

my questions

1. do I need to enable IR if all my SQL server and DB are all on azure and I am not copying files from on-prem?
2. at what point do i need to use IR and the managed virtual network option
3. I want users from on-prem to access the SQL database, ADF and Data lake privately, i already have a working site-to-site connection, do i need a private endpoint for each paas resource?

Thank you

Answer 1

Hey,

Self hosted IR is like a bridge between ADF (Cloud service) and any offering which is within a VNET.

So to ans your queries:

1. In case if the Azure SQL databases are hosted within a VNet, you might need a self hosted IR (alternative would be to whitelist the IP range of ADF region in which it is hosted)

In case of normal Azure SQL databases, with Allow Azure service property enabled om Server, there is no need of Self IR. ADF can auto connect to Azure SQL DB.

1. As stated in the top definition, we would need Self IR in case if the source/sink is hosted within a Vnet and the Vnet doesnt allow whitelisting a range of public IPs (ADF region IPs)

https://www.madeiradata.com/post/azure-data-factory-self-hosted-integration-runtime-what-is-it-and-when-to-use-it#:~:text=The%20Azure%20data%20factory%20self,to%20use%20behind%20a%20firewall.