An error occurred while calling o361.sql. : com.databricks.backend.daemon.data.client.adl.AzureCredentialNotFoundException: Could not find ADLS Gen2 Token

Question

An error occurred while calling o361.sql. : com.databricks.backend.daemon.data.client.adl.AzureCredentialNotFoundException: Could not find ADLS Gen2 Token

PRAKASAM, SIVA 0

PRADEEPCHEEKATLA 91,866 Reputation points

2024-02-26T08:35:30.52+00:00

@PRAKASAM, SIVA - Just checking in to see if the below answer helped. If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.

1 answer

Your answer

PRADEEPCHEEKATLA 91,866 Reputation points

2024-02-26T08:35:30.52+00:00

@PRAKASAM, SIVA - Just checking in to see if the below answer helped. If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.

Answer 1

PRADEEPCHEEKATLA 91,866

@PRAKASAM, SIVA - Thanks for the question and using MS Q&A platform.

It looks like you are encountering an error related to Azure Databricks and ADLS Gen2 token. This error message indicates that the Azure Databricks backend daemon is unable to find the ADLS Gen2 token.

To resolve this issue, you can try the following steps:

Check if the ADLS Gen2 token is still valid. If it has expired, you will need to generate a new token.
Ensure that the ADLS Gen2 token is correctly configured in Azure Databricks. You can check the configuration "Secrets" and verifying that the correct ADLS Gen2 token.

For more details, refer to Connect to Azure Data Lake Storage Gen2 and Blob Storage.

If the issue persists, please share more details like (configuration script used, error message with complete stacktrace) for further assistance.

Hope this helps. Do let us know if you any further queries.

If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.

PRAKASAM, SIVA 0 Reputation points

2024-02-23T05:05:00.0366667+00:00

@PRADEEPCHEEKATLA Thanks for your reply. I got this error when I tried to run my workflow using job cluster. I didn't get the error when I executed the script manually using general purpose cluster. What is the difference? And, how do I generate ALDS Gen2 token and how do I configure it? Thanks
PRADEEPCHEEKATLA 91,866 Reputation points

2024-02-23T07:09:52.4333333+00:00

@PRAKASAM, SIVA - By design it is a limitation on that Job cluster access token will not be pass through the notebook activity. You need to use the credentials inside the notebook activity or keyvault store.

Reference: ADLS using AD credentials passthrough – limitations.

Hope this helps. Do let us know if you any further queries.

Share via

An error occurred while calling o361.sql. : com.databricks.backend.daemon.data.client.adl.AzureCredentialNotFoundException: Could not find ADLS Gen2 Token

1 answer

Your answer