hivemetasore db with Synapse

Shambhu Rai 1,411 Reputation points
2024-02-07T03:37:52.33+00:00

Hi Expert, How to set up connection of Azure Synapse Analytics with hivemetastore database where there is no sql db

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,696 questions
0 comments No comments
{count} votes

1 answer

Sort by: Most helpful
  1. Bhargava-MSFT 29,266 Reputation points Microsoft Employee
    2024-02-07T20:38:17.59+00:00

    Hello Shambhu Rai,

    As per the below documentation, Currently, Azure Synapse Analytics only supports Azure SQL Database and Azure Database for MySQL as an external Hive Metastore. If you don’t have a Azure SQL database, you need to consider setting up "Azure Database for MySQL" to connect Azure Synapse Analytics with a Hive Metastore.

    enter image description here

    https://learn.microsoft.com/en-us/azure/synapse-analytics/spark/apache-spark-external-metastore

    Known limitations

    • Synapse Studio object explorer will continue to show objects in managed Synapse metastore instead of the external HMS.
    • SQL <-> Spark synchronization doesn't work when using external HMS.
    • Only Azure SQL Database and Azure Database for MySQL are supported as external Hive Metastore database. Only SQL authorization is supported.
    • Currently Spark only works on external Hive tables and non-transactional/non-ACID managed Hive tables. It doesn't support Hive ACID/transactional tables.
    • Apache Ranger integration is not supported.

    I hope this answers your quesiton.

    If this answers your question, please consider accepting the answer by hitting the Accept answer and up-vote as it helps the community look for answers to similar questions.