ADF: Job failed due to reason: at Sink 'finalSink': Error while reading file abfss:REDACTED_LOCAL_PART

Brand Johannes 1 Reputation point
2022-08-29T08:14:14.107+00:00

Hello,

I got an error every time, my data flow in Azure Data Factory is triggered writing:

Job failed due to reason: at Sink 'finalSink': Error while reading file abfss:REDACTED_LOCAL_PART@xyz .dfs.core.windows.net/CustomerInsights_xyzzyx/System_Profile/Customer/2022/08/24/1243/Customer_5.csv.

The data flow runs without any issues in the debug mode and also the file raising the error differs from time to time.

How can I fix this problem with this little information?

Best,
Johannes

Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
1,978 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,777 questions
{count} votes