Using Azure Synapse Analytics and Data Factory with a Managed Virtual Network

pmscorca 1,052 Reputation points
2023-10-06T07:56:04.1766667+00:00

Hi,

in order to implement an Azure data platform solution to get data from an Oracle source, I think to use ADF to take full advantage about his pipelines and Synapse to benefit about SQL pools (dedicated and serverless), putting both in a Managed Virtual Network.

Now, is it possible a such service combination in my data platform architecture? Could be any critical issues there to consider?

Many thanks

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
{count} votes

1 answer

Sort by: Most helpful
  1. KranthiPakala-MSFT 46,737 Reputation points Microsoft Employee Moderator
    2023-10-07T00:06:50.2933333+00:00

    @pmscorca Thanks for using Microsoft Q&A forum and posting your query.

    Yes, it is possible to use Azure Synapse Analytics and Azure Data Factory with Managed Virtual Network to implement an Azure data platform solution to get data from an Oracle source.

    The main challenge here will be to establish network connection between your ADF/Synapse Managed vNet to your Oracle data source.

    If you use ADF with Managed vNet enabled, then you will have to follow the similar approach explained in this document: How to access on-premises SQL Server from Data Factory Managed VNet using Private Endpoint

    You will have to create a connection between ADF Managed virtual network and Oracle network either using ExpressRoute or VPN similar to the one shown below.
    Screenshot that shows the access model of SQL server.

    For connection between ADF Managed Vnet to Synapse Vnet should be straight forward. You just have to go to your Managed Private endpoints and create connection to your Azure Synapse Analytics.

    User's image

    I would highly recommend going through this video by a community volunteer to get better understanding on Managed VNet in ADF/Azure Synapse Analytics: Managed Virtual Networks and Private Endpoints in Azure Synapse and Azure Data Factory

    Hope this info helps.


    Please don’t forget to Accept Answer and Yes for "was this answer helpful" wherever the information provided helps you, this can be beneficial to other community members.

    0 comments No comments

Your answer

Answers can be marked as 'Accepted' by the question author and 'Recommended' by moderators, which helps users know the answer solved the author's problem.