Py4JError: ('Method public com.databricks.backend.daemon.dbutils.DBUtilsCore$Result com.databricks.backend.daemon.dbutils.DBUtilsCore.mount() is not whitelisted on class class com.databricks.backend.daemon.dbutils.DBUtilsCore',)

Question

While mounting storage location i am getting below error

Py4JError: ('Method public com.databricks.backend.daemon.dbutils.DBUtilsCore$Result com.databricks.backend.daemon.dbutils.DBUtilsCore.mount() is not whitelisted on class class com.databricks.backend.daemon.dbutils.DBUtilsCore',)

Below is cluster configuration

I have selected Manual and dedicated Access mode single user and Unity Cat log

The script is:-

dbutils.fs.mount(
  source = f"abfss://{container_name}@{storage_account_name}.dfs.core.windows.net/",
  mount_point = f"/mnt/{mount_point}",
  extra_configs = configs)

Answer 1

Gokul Bondre - Thanks for the question and using MS Q&A platform.

This is an excepted behavior on the Databricks workspace with the unity catalog enabled by default.

Note: Unity Catalog-enabled clusters, setting dbutils.fs.mount is blocked for security and compliance. Instead, you must use Unity Catalog storage credentials and external locations.

Unity Catalog (UC) enforces strict access control policies, and traditional mounting techniques—such as using access keys or the dbutils.fs.mount command—are not recommended. Best practices for DBFS and Unity Catalog.

Databricks advises against using DBFS mounts for external data sources when working with Unity Catalog. Instead, it's recommended to use Unity Catalog's external locations/Volumes and storage credentials to manage data access, providing a more secure and governed approach.

For more details, refer to Create a storage credential for connecting to Azure Data Lake Storage

Hope this helps. Let me know if you have any further questions or need additional assistance. Also, if these answer your query, do click the "Upvote" and click "Accept the answer" of which might be beneficial to other community members reading this thread.

---

𝘛𝘰 𝘴𝘵𝘢𝘺 𝘪𝘯𝘧𝘰𝘳𝘮𝘦𝘥 𝘢𝘣𝘰𝘶𝘵 𝘵𝘩𝘦 𝘭𝘢𝘵𝘦𝘴𝘵 𝘶𝘱𝘥𝘢𝘵𝘦𝘴 𝘢𝘯𝘥 𝘪𝘯𝘴𝘪𝘨𝘩𝘵𝘴 𝘰𝘯 𝘈𝘻𝘶𝘳𝘦 𝘋𝘢𝘵𝘢𝘣𝘳𝘪𝘤𝘬𝘴, 𝘥𝘢𝘵𝘢 𝘦𝘯𝘨𝘪𝘯𝘦𝘦𝘳𝘪𝘯𝘨, 𝘢𝘯𝘥 Data & AI 𝘪𝘯𝘯𝘰𝘷𝘢𝘵𝘪𝘰𝘯𝘴, 𝘧𝘰𝘭𝘭𝘰𝘸 𝘮𝘦 𝘰𝘯 𝘓𝘪𝘯𝘬𝘦𝘥𝘐𝘯.

Answer 2

Hi Gokul Bondre,

The error is expected because your workspace and cluster have Unity Catalog enabled. Unity Catalog blocks dbutils.fs.mount() for security and governance reasons, so mounts cannot be created on any UC enabled cluster.

Instead of using mounts, Databricks requires you to use either:

1.Storage Credentials + External Locations (recommended) Create a storage credential using your service principal create an external location pointing to your ADLS container access data directly.

Example

CREATE STORAGE CREDENTIAL my_cred
USING (TYPE="SERVICE_PRINCIPAL",
       DIRECTORY_ID="<tenant_id>",
       APPLICATION_ID="<client_id>",
       CLIENT_SECRET="<client_secret>");

CREATE EXTERNAL LOCATION my_location
URL "abfss://******@gokulsaa.dfs.core.windows.net/"
WITH (CREDENTIAL my_cred);

Then read/write without mounting:

df = spark.read.parquet("abfss://******@gokulsaa.dfs.core.windows.net/path")

2.Unity Catalog Volumes A UC-managed folder-like storage:

CREATE VOLUME my_catalog.default.my_volume;

df.write.parquet("/Volumes/my_catalog/default/my_volume/data")

If you want to use dbutils.fs.mount(), it will only work on a non-UC cluster, not on your current setup.

Hope this helps, please let us know if you have any questions and concerns.