Upgrade Hive external metastore above version 2.3.0

Question

Hi,
I would like to upgrade my external hive metastore (version 2.1.1) to version 2.3.0 and above, based on MSSQL.
What I am interested is problems that exist in the manual: https://github.com/apache/hive/tree/master/metastore/scripts/upgrade/mssql
Here inside upgrade scripts for external metastore, it is only possible to upgrade metastores for mssql up to the version 2.3.0. What's with other version above 2.3.0?
I'm also interested on how to upgrade from version 2.1.1 to 2.3.0? Would it be ok if I use upgrade script for 2.1.0-2.2.0 and then 2.2.0-2.3.0? How do we handle upgrade in case of meddle version like 2.1.1?
Thank you

Answer 1

Hello @TM ,

Welcome to the Microsoft Q&A platform.

This article describes how to set up Azure Databricks clusters to connect to existing external Apache Hive metastores. It provides information about recommended metastore setup and cluster configuration requirements, followed by instructions for configuring clusters to connect to an external metastore. The following table summarizes which Hive metastore versions are supported in each version of Databricks Runtime.

This notebook - external-metastore-setup-hive-2.1-sqlserver helps to upgrade the Hive metastore to the middle version like 2.1.1.

You may checkout the Databricks Hive upgradation - Q&A thread which addressing similar issue.

Hope this helps. Do let us know if you any further queries.

---------------------------------------------------------------------------

Please "Accept the answer" if the information helped you. This will help us and others in the community as well.