Hivemetastore in synapse analytics

Michael M 40 Reputation points
2024-03-28T15:58:00.74+00:00

Is there a way that we can connect Synapse to Hivemetastore with out a Database. I am looking for any documentation that would help here.

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,372 questions
0 comments No comments
{count} votes

Accepted answer
  1. BhargavaGunnam-MSFT 26,136 Reputation points Microsoft Employee
    2024-03-28T17:48:57.76+00:00

    Hello Michael M,

    As per the below documentation, Currently, Azure Synapse Analytics only supports Azure SQL Database and Azure Database for MySQL as an external Hive Metastore.

    If you don’t have a database, you need to consider setting up "Azure SQL database" or "Azure Database for MySQL" to connect Azure Synapse Analytics with a Hive Metastore.

    enter image description here

    Reference document:
    https://learn.microsoft.com/en-us/azure/synapse-analytics/spark/apache-spark-external-metastore#set-up-linked-service-to-hive-metastore

    Known limitations

    • Synapse Studio object explorer will continue to show objects in managed Synapse metastore instead of the external HMS.
    • SQL <-> Spark synchronization doesn't work when using external HMS.
    • Only Azure SQL Database and Azure Database for MySQL are supported as external Hive Metastore database. Only SQL authorization is supported.
    • Currently Spark only works on external Hive tables and non-transactional/non-ACID managed Hive tables. It doesn't support Hive ACID/transactional tables.
    • Apache Ranger integration is not supported.

    I hope this answers your quesiton.

    If this answers your question, please consider accepting the answer by hitting the Accept answer and up-vote as it helps the community look for answers to similar questions.

    1 person found this answer helpful.
    0 comments No comments

0 additional answers

Sort by: Most helpful