question

ShivamRamola-8222 avatar image
0 Votes"
ShivamRamola-8222 asked MartinJaffer-MSFT commented

Difference between synapse and hdinsight

What are major difference between synapse and HD insight
and under what circumstances one should use synapse and vice versa

azure-synapse-analyticsazure-hdinsight
· 1
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

@ShivamRamola-8222 did my response help you? If it solved your issue, please mark as accepted answer. If not, let me know how I may better assist.

0 Votes 0 ·

1 Answer

MartinJaffer-MSFT avatar image
1 Vote"
MartinJaffer-MSFT answered

Hello @ShivamRamola-8222 and welcome to Microsoft Q&A.

While both HDInsight and Synapse can run Spark, they are very different products.

HDInsight is always on and requires a great deal of configuration. It is suitable for heavy compute where you have very detailed needs. The learning curve is very steep. Most of HDInsights features are Apache based. There are several cluster types to choose from depending upon your need. HDInsight has been around for a number of years.

Synapse can be 'paused' , is consumption-based, and has a much more gentle learning curve. Synapse incorporates many other Azure services and is becoming a one-stop hub for Analytics and Data Orchestration. New features are being added faster than I can update this conversation.

If all your intended users are very technically competent, HDInsight is worth considering. If some of your users are not as technically inclined, Synapse may appear more appealing.

There is a new (preview) feature which allows some Synapse-HDInsight integrations. share-hive-metastore-with-synapse


5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.