Setup: Databricks Runtime 7.4, passthrough for a high-concurrency and 'Storage Blob Data Contributor' role on storage DatafactoryV2 Linked Service with MSI, has Contributor role on Databricks and 'Storage Blob Data Contributor' role on Gen2 store. StorageAccount: Gen2 with hierarchical namespace In Datafactory Databricks activity, triggering Notebook execution was successful but inside the Notebook (see the Notebook ) mounting the Gen2 store was failing with the below error... 'com.databricks.backend.daemon.data.client.adl.AzureCredentialNotFoundException: Could not find ADLS Gen2 Token'. Any help is really appreciated.

Hello @Porsche Me , By design it is a limitation on that ADF linked service access token will not be pass through the notebook activity. You need to use the credentials inside the notebook activity or keyvault store. Reference: ADLS using AD credentials passthrough – limitations . Hope this helps. Do let us know if you any further queries. ---------------------------------------------------------------------------------------- Do click on Accept Answer and Upvote on the post that helps you, this can be beneficial to other community members.

Databricks passthrough credentials error: AzureCredentialNotFoundException: Could not find ADLS Gen2 Token'

Porsche Me 131

Setup:

Databricks Runtime 7.4, passthrough for a high-concurrency and 'Storage Blob Data Contributor' role on storage
DatafactoryV2 Linked Service with MSI, has Contributor role on Databricks and 'Storage Blob Data Contributor' role on Gen2 store.
StorageAccount: Gen2 with hierarchical namespace

In Datafactory Databricks activity, triggering Notebook execution was successful but inside the Notebook (see the Notebook) mounting the Gen2 store was failing with the below error...

'com.databricks.backend.daemon.data.client.adl.AzureCredentialNotFoundException: Could not find ADLS Gen2 Token'.

Any help is really appreciated.

Accepted answer

PRADEEPCHEEKATLA-MSFT 88,876 Reputation points Microsoft Employee

2021-02-02T07:20:43.29+00:00

Hello @Porsche Me ,

By design it is a limitation on that ADF linked service access token will not be pass through the notebook activity. You need to use the credentials inside the notebook activity or keyvault store.

Reference: ADLS using AD credentials passthrough – limitations.

Hope this helps. Do let us know if you any further queries.

----------------------------------------------------------------------------------------

Do click on Accept Answer and Upvote on the post that helps you, this can be beneficial to other community members.
Please sign in to rate this answer.
PRADEEPCHEEKATLA-MSFT 88,876 Reputation points Microsoft Employee

2021-02-03T11:49:02.65+00:00

Hello @Porsche Me ,

Just checking in to see if the above answer helped. If this answers your query, do click Accept Answer and Up-Vote for the same. And, if you have any further query do let us know.

Sangra, Raman 1 Reputation point

2021-11-10T03:37:25.127+00:00

@PRADEEPCHEEKATLA-MSFT - I was attempting to run Auto Loader in Databricks and it gave same error when using pass through authentication approach.

Is it supported to run this ad-hoc from notebook?

Stacktrace:

com.databricks.backend.daemon.data.client.adl.AzureCredentialNotFoundException: Could not find ADLS Gen2 Token
at com.databricks.backend.daemon.data.client.adl.AdlGen2UpgradeCredentialContextTokenProvider.$anonfun$getToken$1(AdlGen2UpgradeCredentialContextTokenProvider.scala:33)

PRADEEPCHEEKATLA-MSFT 88,876 Reputation points Microsoft Employee

2021-11-12T09:00:40.377+00:00

Hello @Sangra, Raman ,

Since this thread is too old, I would recommend creating a new thread on the same forum with as much details about your issue as possible. That would make sure that your issue has better visibility in the community.
Sign in to comment

Use comments to ask for clarification, additional information, or improvements to the question.

Your answer

Share via

Databricks passthrough credentials error: AzureCredentialNotFoundException: Could not find ADLS Gen2 Token'

0 additional answers

Your answer