Azure DataFactory Synapse: Error while copying data from http source to ADLS Gen2

Question

......................................

Answer 1

Hello @Wafaa HAOURAJI ,

Thanks for the question and using MS Q&A platform.

Is the issue intermittent or are you getting the error all instances?

if the issue is intermittent :

Issue could be because of throttling that is happening at the sink end. Since it is not sequential, you have higher possibility of hitting the throttling as lot request at the same time

It is suggested to add a retry logic at activity level to secure pipelines against such intermittent errors.

You could modify and have Retry above 0.

Alternatively, you could save the files sequentially and see whether you re encountering the issue.

Hope this will help. Please let us know if any further queries.

------------------------------

• Please don't forget to click on or upvote button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how