Metastore table creation issue

Question

I am following the process mentioned in the below document but unable to create table in the metastore

https://learn.microsoft.com/en-us/azure/databricks/data-governance/unity-catalog/get-started 

what could be the root cause for this error.

Error in SQL statement: UnityCatalogServiceException: [RequestId=XXX-XXX ErrorClass=INVALID_STATE] Failed to access cloud storage: AbfsRestOperationException exceptionTraceId=e00354de-3968-4dd7-9bd1-9715e6d28264
com.databricks.backend.rpc.SparkDriverExceptions$SQLExecutionException: com.databricks.sql.managedcatalog: [RequestId=-a3ba70842f95 ErrorClass=INVALID_STATE] Failed to access cloud storage: AbfsRestOperationException exceptionTraceId=4dd7-9bd1-9715e6d28264
at com.databricks.managedcatalog.ErrorDetailsHandler.wrapServiceException(ErrorDetailsHandler.scala:33)
at com.databricks.managedcatalog.ErrorDetailsHandler.wrapServiceException$(ErrorDetailsHandler.scala:23)
at com.databricks.managedcatalog.ManagedCatalogClientImpl.wrapServiceException(ManagedCatalogClientImpl.scala:91)
at com.databricks.managedcatalog.ManagedCatalogClientImpl.recordAndWrapException(ManagedCatalogClientImpl.scala:3021)
at com.databricks.managedcatalog.ManagedCatalogClientImpl.createStagingTable(ManagedCatalogClientImpl.scala:511)
at com.databricks.sql.managedcatalog.ManagedCatalogCommon.defaultTablePath(ManagedCatalogCommon.scala:234)
at com.databricks.sql.managedcatalog.ManagedCatalogSessionCatalog.defaultTablePath(ManagedCatalogSessionCatalog.scala:934)
at com.databricks.sql.transaction.tahoe.catalog.DeltaCatalog.$anonfun$createDeltaTable$9(DeltaCatalog.scala:178)
at scala.Option.getOrElse(Option.scala:189)
at com.databricks.sql.transaction.tahoe.catalog.DeltaCatalog.$anonfun$createDeltaTable$1(DeltaCatalog.scala:178)
at com.databricks.spark.util.FrameProfiler$.record(FrameProfiler.scala:80)
at com.databricks.sql.transaction.tahoe.metering.DeltaLogging.recordFrameProfile(DeltaLogging.scala:265)
at com.databricks.sql.transaction.tahoe.metering.DeltaLogging.recordFrameProfile$(DeltaLogging.scala:263)
at com.databricks.sql.transaction.tahoe.catalog.DeltaCatalog.recordFrameProfile(DeltaCatalog.scala:85)
at com.databricks.sql.transaction.tahoe.catalog.DeltaCatalog.com$databricks$sql$transaction$tahoe$catalog$DeltaCatalog$$createDeltaTable(DeltaCatalog.scala:113)
at com.databricks.sql.transaction.tahoe.catalog.DeltaCatalog$StagedDeltaTableV2.$anonfun$commitStagedChanges$1(DeltaCatalog.scala:758)
at com.databricks.spark.util.FrameProfiler$.record(FrameProfiler.scala:80)
at com.databricks.sql.transaction.tahoe.metering.DeltaLogging.recordFrameProfile(DeltaLogging.scala:265)
at com.databricks.sql.transaction.tahoe.metering.DeltaLogging.recordFrameProfile$(DeltaLogging.scala:263)

Answer 1

Hello Kumari s,

Welcome to the MS Q&A platform.

A similar thread has been discussed here. Please follow the steps mentioned in this document and upgrade your existing unity catalog metastore to use a managed identity to access its root storage.

Once you upgrade the metastore it should fix the error.

In case if you still have any issues, please let us know.