Should I create Azure storage & Metastore in the same region?

Mohammad Saber 591 Reputation points
2023-02-20T11:35:16.3066667+00:00

I am going to create a Metasore following the documentation.

 

Regarding the storage account, I don't understand if it should be in the same region as Metastore.

 

From documentation:

 

You can create no more than one metastore per region. It is recommended that you use the same region for your metastore and storage container.

Is it a recommendation or a must?

 

Another part of the documentation:

 

image

Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
1,975 questions
0 comments No comments
{count} votes

Accepted answer
  1. PRADEEPCHEEKATLA-MSFT 80,096 Reputation points Microsoft Employee
    2023-02-21T07:09:26.2+00:00

    @Mohammad Saber Thanks for the question and using MS Q&A platform.
    The summary of the both the statement are (Workspace, Metastore and storage account) account should be in same region.

    Example: If you Azure Databricks workspace created in "East US" , then the storage account should be in same region - so that you can configure the metastore using the storage account which you created earlier.
    Statement1: You can create no more than one metastore per region. It is recommended that you use the same region for your metastore and storage container. - This clearly says that you cannot create more than one metastore per region which mean you can only one metastore per region.

    Statement2: This must be in the same region as the workspaces you want to use to access the data. Make sure that this matches the region of the storage container you created earlier. - if your Workspace & Metastore in East US you should choose storage account be East US only.

    Example: If you create a metastore in with storage account in East US - you cannot create one more metastore in East US region - it's limited to one metastore & Storage account per region.
    Name: MetaStore-EastUS
    Region: East US
    ADLS Gen2 path: abfss://<container-name>@<storage-account-name>.dfs.core.windows.net/<metastore-name>
    Access Connector ID: /subscriptions/12f34567-8ace-9c10-111c-aea8eba12345c/resourceGroups/<resource_group>/providers/Microsoft.Databricks/accessConnectors/<connector-name>
    Hope this helps. Do let us know if you any further queries.


    If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.

    1 person found this answer helpful.
    0 comments No comments

0 additional answers

Sort by: Most helpful