Operation on target Databricks_Transformation_Operation failed: Invalid access token.

Question

I encountered an error in my Azure Data Factory pipeline during the copy data activity completion. Subsequently, when transitioning to the transformation stage in a Databricks notebook, I encountered the following error:. Interestingly, the pipeline was previously functioning correctly with identical code. Upon manual execution, the issue was resolved, but it consistently fails during scheduled runs.

Error String:
Operation on target Databricks_Transformation_Operation failed: Invalid access token.

Answer 1

Hello Vaibhav Patil

The error message "Invalid access token" suggests that the access token being used in your Azure Data Factory pipeline for the Databricks transformation operation is either expired or incorrectly configured.

also, please check if you have any conditional access policy that could be causing this issue.

I hope this helps.