Can Self Hosted Integration Runtime (SHIR) on Azure cloud read data from on-premise API end points?

Murthy, Sridhara 20 Reputation points
2023-02-19T20:42:42.65+00:00

I am trying to connect to a JSON data source on-premise using its API endpoints. Can SelfHosted Integration Runtime be configured to on-prem data sources to ingest data in to Azure Blob storage?

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,985 questions
0 comments No comments
{count} votes

Accepted answer
  1. KranthiPakala-MSFT 46,437 Reputation points Microsoft Employee
    2023-02-20T20:10:53.23+00:00

    Hi @Murthy, Sridhara

    Welcome to Microsoft Q&A forum and thanks for reaching out here.

    Yes, you can use SHIR hosted installed on Azure VM to access/read data from On-prem API endpoints using private endpoint connection given your VM resides in a Private/Customer Managed Virtual Network and having Express route peering or VPN connection to your On Prem network as shown in below image.

    Ref documentation: Secure communication between customer networks and Data Factory Diagram that shows Private Link for Data Factory architecture.

    1. First you will have to create private endpoint in your Private virtual network for the communication between self-hosted IR hosted in an Azure VM in the same Private VNet and Data Factory.
    2. Then set up an Internet Protocol security VPN connection, which is a site-to-site connection. Or set up an Azure ExpressRoute connection, which is a private peering connection between your Azure Private VNet and On Premise Network.

    For implementation, you can refer to this demonstration video by a community volunteer. Though the demo focuses on On Prem SQL server, you can follow similar steps to read data from your API endpoints using Web activity or HTTP/REST connector in Copy activity as per your business need.

    Video demonstration: How to Install Self-Hosted Integration Runtime on Azure VM by using Private EndPoint - ADF Tutorial

    Hope this helps.


    Please don’t forget to Accept Answer and Yes for "was this answer helpful" wherever the information provided helps you, this can be beneficial to other community members.

    1 person found this answer helpful.

0 additional answers

Sort by: Most helpful