Consideration choosing between data factory vs Azure synapse studio

Question

Consideration choosing between data factory vs Azure synapse studio

sakuraime 2,346

what's the Consideration choosing between data factory vs Azure synapse studio (pipeline)
any official doc to tell the difference ? function ? performance etc...

2 answers

Your answer

Answer 1

KranthiPakala-MSFT 46,642 Microsoft Employee Moderator

Hi @sakuramie,

When you provision the Azure Integration Runtime in Managed Virtual Network and leverage Private Endpoints to securely connect to supported data stores. Your data traffic between Azure Managed Virtual Network and data stores goes through Azure Private Link which provides secured connectivity and eliminates your data exposure to the internet.

Hope this clarifies.

----------

Please don't forget to click on and upvote button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how
Want a reminder to come back and check responses? Here is how to subscribe to a notification
If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators

sakuraime 2,346 Reputation points

2021-11-19T10:30:19.077+00:00

thanks for your explanation , in this way the data still going to VM/server which is not managed by user , will it be a security concern ? And the ADF managed Virtual Network is in the same availability zone ?
KranthiPakala-MSFT 46,642 Reputation points Microsoft Employee Moderator

2021-12-01T00:28:10.077+00:00

Hi @sakuramie, Managed Virtual Network ensures that data integration process is isolated and secure. Hence getting started with secure ETL is much simplified for data engineers.
Currently, the managed Virtual Network is only supported in the same region as Azure Data Factory region.

The scope of your question is different compared to the original scope of the question asked. For further queries, I would recommend creating a new thread on the same forum with as much details as possible. That would make sure that your issue has better visibility in the community.

Thank you
sakuraime 2,346 Reputation points

2021-12-01T02:58:37.083+00:00

may I know why if having purview account in a Ingest private endpoint , the SHIR MUST be in the same VNET/SUBNET ???
KranthiPakala-MSFT 46,642 Reputation points Microsoft Employee Moderator

2021-12-02T18:36:42.067+00:00

Hi @sakuraime As the scope of the follow up question is different compared to that of the initial query, could you please open a new thread with more details so it would have better visibility in the community.

Thank you

Answer 2

MarkKromer-MSFT 5,226 Microsoft Employee Moderator

If you are building a big data analytics solution using Synapse (Spark or SQL), then I recommend using the built-in Synapse pipelines and data flows features. They are the same as in ADF. But if you have a hybrid architecture with other systems, ADF will likely be a better solution for you. Synapse pipelines and data flows is not yet full parity with ADF: https://learn.microsoft.com/en-us/azure/synapse-analytics/data-integration/concepts-data-factory-differences.

sakuraime 2,346 Reputation points

2021-11-13T04:07:03.527+00:00

the connector to external sources are the same ? data flow can support SHIR (I know the data flow in Data factory can't support) .

?
Mark Kromer MSFT 1,146 Reputation points

2021-11-13T04:29:03.61+00:00

Data flow does not support SHIR in either service. However, you can use the Azure IR w/managed VNet which serves the same purpose.
sakuraime 2,346 Reputation points

2021-11-14T14:47:27.08+00:00

if using Azure IR with managed VNET , the DATA still go through to azure managed VM , whicih some customer will still have concern in security .

Share via

Consideration choosing between data factory vs Azure synapse studio

2 answers

Your answer