I am unable to mount containers using databricks and storage gen 2 ?

Question

what is the issue?

Answer 1

Hello smriti das,

Greetings! Welcome to Microsoft Q&A Platform.

As per the error message error. java.io.FileNotFoundException: Operation failed: "The specified filesystem does not exist.", 404, HEAD, https://datalakeprogen2.dfs.core.windows.net....getAccessControl&timeout=90 it clearly says that the specified filesystem name mount_Point doesn't exist.

Ensure your file system "Owfile" is present in correct storage account as in the error message it is projecting the storage account name as which you trying to mount.

Note: To resolve this issue, try giving the access path as below in Mount_point instead of calling and then you can mount the filesystem,

refer - https://techcommunity.microsoft.com/t5/azure-paas-blog/mount-adls-gen2-or-blob-storage-in-azure-databricks/ba-p/3802926 for detailed guidance.

Similar thread for reference - https://learn.microsoft.com/en-us/answers/questions/1510721/not-able-to-create-a-mount-point-using-spn-to-adls,https://learn.microsoft.com/en-us/answers/questions/1376442/mounting-azure-storage-adlsgen2-on-azure-databrick.

Hope this answer helps! Please let us know if you have any further queries. I’m happy to assist you further.

---

Please "Accept the answer” and “up-vote” wherever the information provided helps you, this can be beneficial to other community members.

Answer 2

Hi smriti das,

Your setup looks pretty for me , the issue could be on the network side. If it's a just test environment you can make your storage to public access.

After that you can test list the storage with below command and SAS token:

spark.conf.set(
    "fs.azure.account.key.{storage_account_name}.dfs.core.windows.net",
    "Add your sas token")

dbutils.fs.ls("abfss://{container_name}@{storage_account_name}.dfs.core.windows.net/")

Be sure that you storage is ADLS(herarchical namespace enable) to use abfss.

References:

• https://docs.databricks.com/en/connect/storage/azure-storage.html
• https://learn.microsoft.com/en-us/azure/databricks/dbfs/mounts
• https://learn.microsoft.com/en-us/azure/storage/common/storage-network-security?tabs=azure-portal

Cheers,

Luis