Share via

Hivemetastore in synapse analytics

Michael M 105 Reputation points
2024-03-28T15:58:00.74+00:00

Is there a way that we can connect Synapse to Hivemetastore with out a Database. I am looking for any documentation that would help here.

Azure Synapse Analytics
Azure Synapse Analytics

An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.

0 comments No comments

Answer accepted by question author

Bhargava-MSFT 31,361 Reputation points Microsoft Employee Moderator
2024-03-28T17:48:57.76+00:00

Hello Michael M,

As per the below documentation, Currently, Azure Synapse Analytics only supports Azure SQL Database and Azure Database for MySQL as an external Hive Metastore.

If you don’t have a database, you need to consider setting up "Azure SQL database" or "Azure Database for MySQL" to connect Azure Synapse Analytics with a Hive Metastore.

enter image description here

Reference document:
https://learn.microsoft.com/en-us/azure/synapse-analytics/spark/apache-spark-external-metastore#set-up-linked-service-to-hive-metastore

Known limitations

  • Synapse Studio object explorer will continue to show objects in managed Synapse metastore instead of the external HMS.
  • SQL <-> Spark synchronization doesn't work when using external HMS.
  • Only Azure SQL Database and Azure Database for MySQL are supported as external Hive Metastore database. Only SQL authorization is supported.
  • Currently Spark only works on external Hive tables and non-transactional/non-ACID managed Hive tables. It doesn't support Hive ACID/transactional tables.
  • Apache Ranger integration is not supported.

I hope this answers your quesiton.

If this answers your question, please consider accepting the answer by hitting the Accept answer and up-vote as it helps the community look for answers to similar questions.

Was this answer helpful?

1 person found this answer helpful.
0 comments No comments

0 additional answers

Sort by: Most helpful

Your answer

Answers can be marked as 'Accepted' by the question author and 'Recommended' by moderators, which helps users know the answer solved the author's problem.