Unity Catalog-Error Creating Table ErrorClass=INVALID_STATE] Failed to access cloud storage: AbfsRestOperationException

hardrock 35 Reputation points
2023-02-06T06:08:03.7066667+00:00

Unity Catalog-Error Creating Table ErrorClass=INVALID_STATE] Failed to access cloud storage: AbfsRestOperationException

I have managed to create my catalog and schema on unity catalog.

Added Storage Blob Contributor role to the unity catalog metastore in ADLS for the Access Connector for Azure Databricks.

 

 

image.png

image

however, when trying to create a table i received this error:

Error in SQL statement: UnityCatalogServiceException: [RequestId=db5e5795-bd62-4185-b97f-1d240ee5b73b ErrorClass=INVALID_STATE] Failed to access cloud storage: AbfsRestOperationException exceptionTraceId=094237f6-141c-44d7-85c7-104215baa913

 

image

-

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,466 questions
Azure Storage Accounts
Azure Storage Accounts
Globally unique resources that provide access to data management services and serve as the parent namespace for the services.
3,145 questions
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,175 questions
{count} votes

2 answers

Sort by: Most helpful
  1. Han Raaijmakers 0 Reputation points
    2023-02-13T10:35:52.7566667+00:00

    Hi @hardrock and the others,

    I had the exact same issue and managed to fix it by 'upgrading' the Unity Calalog metastore using these instructions:

    https://learn.microsoft.com/en-us/azure/databricks/data-governance/unity-catalog/azure-managed-identities#--upgrade-your-existing-unity-catalog-metastore-to-use-a-managed-identity-to-access-its-root-storage

    Good luck!


  2. Waleed Ahmed Shahid 0 Reputation points
    2023-10-16T09:28:43.3866667+00:00

    I was facing the same issue that I couldn't create a table after configuring the Unity catalog and I have done all the changes you have suggested above. The issue was because I hadn't enabled hierarchal namespace while making my storage. You have to enable the hierarchical namespace while making the storage and your issue will be resolved.

    It's mentioned in the documentation too that Unlock Data Lake Storage capabilities by selecting the enable hierarchical namespace setting in the Advanced tab of the Create storage account page.

    Hope so that i will resolve your error as it does mine's

    0 comments No comments

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.