Use of ADF Linked service in Azure Syanpse

Sunil Bailwal 6 Reputation points
2022-01-27T12:32:37.277+00:00

I am having one self hosted runtime installed on our premises, which is used in Azure Data Factory with a Atlas Mongo db linked service. Now I want to use the same Linked Service in Azure synapse Pipeline.

For this reason I have to again installed a self-hosted runtime in another machine in the on-premises network(I do not want to do it)

There is another concept of Manage End Points, here I can create a New managed private endpoint but unfortunately endpoint for Atlas mongo db service is not available.

There is another option Private Link service is available but i do not its use. Also I do not know whether I can reuse my exiting ADF connection to Azure Synapse Connection.

Please let me know if I am going in the right direction.

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,442 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,687 questions
{count} votes

2 answers

Sort by: Most helpful
  1. Nandan Hegde 29,901 Reputation points MVP
    2022-01-27T13:13:20.73+00:00

    Hey,
    Based on my understanding, you cannot share IRs between synapse workspace and ADF.
    So installing 1 per ADF and synapse was the right thing to do for transferring data.
    May I ask the reason for creating an ADF and a synapse workspace separate? You can leverage ADF itself for all activities.


  2. KranthiPakala-MSFT 46,422 Reputation points Microsoft Employee
    2022-02-03T07:44:44.8+00:00

    Hello @Sunil Bailwal ,

    Thanks for the question and using MS Q&A platform.

    My understanding is that you have an Atlas Mongo db linked service with SHIR in your ADF instance and you would like to know if there is a way to reuse the same Linked Service in your Synapse Pipeline. Please correct if my understanding is incorrect.

    The answer is no as you cannot reshare the SHIR as called out by @Nandan Hegde . As of today, SHIR can only be shared across data factories but not between ADF and Synapse pipelines. For more info, please refer to this doc: Data integration in Azure Synapse Analytics versus Azure Data Factory

    Possible workaround: You will have to install a seperate IR for your Synapse instance and create a SHIR with same name as that of ADF SHIR and then export the linked service json template and use it to deploy it to your Synapse instance as described in this thread (After deploying the JSON files to Azure Synapse Analytics workspace, make sure to verify/modify the linked services configuration accordingly) - Azure Data Factory V2 Arm template to Synpase Data Integration without Git

    Hope this will help. Please let us know if any further queries.

    ------------------------------

    • Please don't forget to click on 130616-image.png or upvote 130671-image.png button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how
    • Want a reminder to come back and check responses? Here is how to subscribe to a notification
    • If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators
    0 comments No comments