Calling Databricks activity with MSI resulting in Error Code 3207

Porsche Me 131

We are following this link1922818 for setting up Databricks activity in our Datafactory.
When pipeline is executed, we are getting below error

Any help to resolve this is much appreciated.

We confirm following things...
Datafactory V2
Datafactory LinkedService configuration 62238-databricks.txt
Datafactory assigned Contributor role on Databricks
Databricks workspace enabled for passthrough auth

1 answer

PRADEEPCHEEKATLA-MSFT 87,971 Reputation points Microsoft Employee

2021-02-01T10:21:09.38+00:00
Hello @Porsche Me ,

This could be an intermittent issue and can be resolved if you run it after some time.

OR

This error could occur when there is an outage from Azure Databricks service.

In case if you are facing this issue again please do share the below details:

General Details

Issue Start Time:

Data Factory name:

Data Factory Region:

Databricks name:

Databricks Region:

RunID:
Please sign in to rate this answer.
Porsche Me 131 Reputation points

2021-02-01T17:55:48.097+00:00

The Datafactory issue was gone with this attached 62625 definition of Databricks Linked Service.

However, with the fix in-place, the notebook execution is failing with the error 'com.databricks.backend.daemon.data.client.adl.AzureCredentialNotFoundException: Could not find ADLS Gen2 Token'.

Notebook attached 62626

PRADEEPCHEEKATLA-MSFT 87,971 Reputation points Microsoft Employee

2021-02-02T06:56:29.96+00:00

Hello @Porsche Me ,

By design it is a limitation on that ADF linked service access token will not be pass through the notebook activity. You need to use the credentials inside the notebook activity or keyvault store.

Reference: ADLS using AD credentials passthrough – limitations.

Hope this helps. Do let us know if you any further queries.

----------------------------------------------------------------------------------------

Do click on Accept Answer and Upvote on the post that helps you, this can be beneficial to other community members.

PRADEEPCHEEKATLA-MSFT 87,971 Reputation points Microsoft Employee

2021-02-03T11:47:36.61+00:00

Hello @Porsche Me ,

Just checking in to see if the above answer helped. If this answers your query, do click Accept Answer and Up-Vote for the same. And, if you have any further query do let us know.

PRADEEPCHEEKATLA-MSFT 87,971 Reputation points Microsoft Employee

2021-02-04T09:17:40.497+00:00

Hello @Porsche Me ,

Following up to see if the above suggestion was helpful. And, if you have any further query do let us know.

Take care & stay safe!
Sign in to comment

Use comments to ask for clarification, additional information, or improvements to the question.

Share via

Calling Databricks activity with MSI resulting in Error Code 3207

1 answer

Your answer