Hi Gopinath Rajee,
Thank you for Posting query in Microsoft Q&A Platform.
In Azure Databricks, the error message indicates that the input path URL 'abfss://******@sa.dfs.core.windows.net/__unitystorage'
overlaps with managed storage. It suggests that the specified path conflicts with an existing managed storage location.
To address this error in Azure Databricks, you can follow these steps:
Verify the existing managed storage locations: Check your Databricks workspace configuration and ensure that there are no conflicting managed storage locations defined.
Choose a different path or container: To avoid the overlap error, you need to provide a different path or container name for the external location. Instead of using the containertables
container, try creating a new container specifically for your external storage and use that in your LIST
command.
Update the path in your code: Once you have a separate container or path for your external storage, modify your code to use the new path or container name. Make sure to remove the __unitystorage
suffix.
By addressing the overlap issue and using a distinct container or path, you should be able to resolve the error and successfully list the objects within your external storage in Azure Databricks.
Please let me know how it goes.