Share via


Access DBUtils Not Whitelisted Data Lake with DataBricks and Python

Question

Monday, January 21, 2019 5:22 PM

Trying to follow the Azure documentation.

configs = {"dfs.adls.oauth4.access.token.provider.type": "ClientCredential",
           "dfs.adls.oauth4.client.id": "<your-service-client-id>",
           "dfs.adls.oauth4.credential": dbutils.secrets.get(scope = "<scope-name>", key = "<key-name>"),
           "dfs.adls.oauth4.refresh.url": "https://login.microsoftonline.com/<your-directory-id>/oauth4/token"}

# Optionally, you can add <your-directory-name> to the source URI of your mount point.
dbutils.fs.mount(
  source = "adl://<your-data-lake-store-account-name>.azuredatalakestore.net/<your-directory-name>",
  mount_point = "/mnt/<mount-name>",
  extra_configs = configs)

But getting a whitelist error?

py4j.security.Py4JSecurityException: Method public com.databricks.backend.daemon.dbutils.DBUtilsCore$Result com.databricks.backend.daemon.dbutils.DBUtilsCore.mount(java.lang.String,java.lang.String,java.lang.String,java.lang.String,java.util.Map) is not whitelisted on class class com.databricks.backend.daemon.dbutils.DBUtilsCore

Thanx, Adam

All replies (3)

Tuesday, January 22, 2019 10:46 AM

Could you share the documentation link which you are following? In which step you are getting this error message?


Tuesday, January 22, 2019 4:30 PM

https://docs.azuredatabricks.net/spark/latest/data-sources/azure/azure-datalake.html#requirements

Thanx, Adam


Tuesday, January 29, 2019 2:27 PM

Hi Adam,

It is difficult to debug what went wrong here without more information, I suggest you contact technical support for deeper analysis of the issue. Refer How to create an Azure support request.