Sefl-hosted integration runtime uses internet connection instead of a private network

Question

Sefl-hosted integration runtime uses internet connection instead of a private network

Milko, Petr 1

Dear All.

I would like to ask a question relating to connection of self-hosted integration runtime (SHIR) and an Azure storage account (ASA).

We have a private network in which a private endpoint of the Azure storage account is created. Further, self-hosted integration runtime is hosted on a server in the private network and the server is not connected to the Internet.

There is a problem that data cannot be transferred using the SHIR because of blocked communication. SHIR requires Internet to transfer data to ASA.

Is there a setup of SHIR in that private network is used instead of the Internet?

Thank you.

Petr

Answer 1

Hi @Milko, Petr ,

Welcome to Microsoft Q&A Forum and thanks for reaching out.

When you use the Private link, then the communications to Azure Data Factory service go through Private Link and help provide secure private connectivity. The command communications between the self-hosted integration runtime and the Azure Data Factory service can be performed securely in a private network environment. The traffic between the self-hosted integration runtime and the Azure Data Factory service goes through Private Link.

For a demonstration please refer to this video by a community volunteer - How to Install Self-Hosted Integration Runtime on Azure VM by using Private EndPoint - ADF Tutorial

Ref doc - Azure Private Link for Azure Data Factory - Secure communication between customer networks and Azure Data Factory

Hope this info helps. Do let us know if you have further query.

----------

Please don't forget to click on and upvote button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how
Want a reminder to come back and check responses? Here is how to subscribe to a notification
If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators

Milko, Petr 1 Reputation point

2021-11-07T08:04:12.773+00:00

Dear @KranthiPakala-MSFT .

Let me add further details about my set-up.

I use ADF integrated in Azure Synapse to execute data ingestion activities. Further, I use an on-premise server (not on Azure VM) to host a self-hosted integration runtime. It is a different set-up compare the one described in the provided documentation.

Please, can you advise?

Thank you.

Sincerely,
Petr

Answer 2

Janne Kujanpää 106

You need to setup a private endpoint for the storage account and configure your on-premises SHIR to use a private endpoint over VPN.

refs:

other refs:

https://learn.microsoft.com/en-us/azure/data-factory/data-factory-private-link (Azure Data Factory control channel through VPN+private endpoint)

KranthiPakala-MSFT 33,146 Reputation points Microsoft Employee

2021-11-12T01:07:30.867+00:00

Thank you @Janne Kujanpää , for sharing your inputs and contributions towards helping the community.

Hi @Milko, Petr ,

Just checking in to see if the above suggestion from @Janne Kujanpää was helpful . If it answers your query, please do click “Accept Answer” and/or Up-Vote, as it might be beneficial to other community members reading this thread. And, if you have any further query do let us know.
Milko, Petr 1 Reputation point

2021-11-12T12:00:54.33+00:00

Dear @Janne Kujanpää .

Please, can you be more specific about the configuration of on-premise SHIR to use a private endpoint over VPN?

Thank you.

Sincerely,
Petr
Milko, Petr 1 Reputation point

2021-11-12T12:02:52.517+00:00

Dear @KranthiPakala-MSFT .

The provided answer was too vague. I kindly ask @Janne Kujanpää to provide more details.

Thank you.

Sincerely,
Petr
KranthiPakala-MSFT 33,146 Reputation points Microsoft Employee

2021-12-01T00:39:30.097+00:00

Hi MilkoPetr-6791,

Here is an excellent article by a community volunteer which explains how to configure SHIR with proxy for ADF and connect using Private endpoint - On-Premise Self Hosted Integration Runtime for Azure Data Factory: How to configure with Private Endpoints and a Proxy Server

Hope this helps.
KranthiPakala-MSFT 33,146 Reputation points Microsoft Employee

2021-12-02T00:18:12.86+00:00

Hi MilkoPetr-6791,

Just checking in to see if the above article was helpful. If it answers your query, please do click “Accept Answer” and/or Up-Vote, as it might be beneficial to other community members reading this thread. And, if you have any further query do let us know.
Milko, Petr 1 Reputation point

2021-12-03T05:35:33.833+00:00

Dear @KranthiPakala-MSFT .

Thank you for your answer. I am investigating.

Sincerely,
Petr
Grace A O'Halloran 1 Reputation point

2021-12-06T12:08:55.24+00:00

Hi @KranthiPakala-MSFT , thank you so much for recommending my article.

@Milko, Petr if there's anything I can help clarify for you do let me know!

Sefl-hosted integration runtime uses internet connection instead of a private network

2 answers

Activity