ADF copy activity dyanamic-crm to sql server, fault tolerance not working

NANAWARE, Sagar 6 Reputation points
2022-10-28T10:31:42.347+00:00

We Add copy activity to copy data from CRM dynamic 365 entity to Sql server table
If there is no error then activity is successfully completed and copy data to destination but
We added fault tolerance (skip incompatible row) and provide folder path of blob storage for logging
255084-image.png

but if any error occur while copying data then it will create black file in blob storage and failed copy activity, no data is copy to destination
could you please give solution for this problem?

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,197 questions
0 comments No comments
{count} votes

1 answer

Sort by: Most helpful
  1. Bhargava-MSFT 29,266 Reputation points Microsoft Employee
    2022-10-31T20:57:21.093+00:00

    Hello @NANAWARE, Sagar ,

    I was able to reproduce the issue from my end. When you enable fault tolerance and select skip incompatible rows, it always captures the log file with header info even if there are no 'Incompatible rows' or pipeline activity failed.

    This is expected behavior as of now.

    I saw the below product feedback request to Prevent the Creation of Empty Log Files.

    https://feedback.azure.com/d365community/idea/76ae382e-70d0-ec11-a81b-6045bd7ac9f9

    Appreciate if you could upvote and comment on this feedback. All the feedback shared in this forum is actively monitored and reviewed by the product team which will prioritize them accordingly based on the number of requests.
    Hope this info helps.