Share via

azure data factory - data flow source file error

Bhanu_k 101 Reputation points
2021-04-22T20:42:14.373+00:00

I have a data flow within a foreach loop. It loops through pipe delimited txt files in azure storage, configured the storage as block blob and used identity management as a way for my data factory resource to connect to storage account, i made sure it had all necessary access to the storage account. The pipeline and files got processed/ran fine until last week. All of a sudden this week, i started getting the below error. The Data flow runs for about 15 minutes and throws this error. I made sure the latest file is of the same old format. Anyone faced this issue?

{"StatusCode":"DFExecutorUserError","Message":"Job failed due to reason: at Source 'sourcefiles': Status code: -1 error code: null error message: InvalidAbfsRestOperationExceptionjava.net.UnknownHostException: stroageaccountname.dfs.core.windows.net","Details":"at Source 'sourcefiles': Status code: -1 error code: null error message: InvalidAbfsRestOperationExceptionjava.net.UnknownHostException: stroageaccountname.dfs.core.windows.net"}

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.


Answer accepted by question author

Bhanu_k 101 Reputation points
2021-04-23T16:44:28.297+00:00

I reached out to microsoft support and they asked me to change the Azureblob storage authentication method from managedidentity to Accountkey method and it worked.

Was this answer helpful?


0 additional answers

Sort by: Most helpful

Your answer

Answers can be marked as 'Accepted' by the question author and 'Recommended' by moderators, which helps users know the answer solved the author's problem.