Copy activity configuraion showing diffrent values

THIMMAIAH GARI,PRASHANTH,, 201 Reputation points
2021-01-07T06:30:23.307+00:00

Hi

Please find the screenshot where copy activity audit details, in that photo total time for 'reading from source' and 'write to sink' having less than one minute. But total duration showing 10min

54293-image.png

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,843 questions
0 comments No comments
{count} votes

Accepted answer
  1. HarithaMaddi-MSFT 10,136 Reputation points
    2021-01-07T11:20:53.433+00:00

    Hi @THIMMAIAH GARI,PRASHANTH,, ,

    Welcome to Microsoft Q&A Platform. Thanks for posting the query.

    This document clearly explains the details related to these statistics in copy activity. As per my understanding, data is loaded from on-premise to Azure in above scenario which has network delays and transport time that are not included in working duration but are considered for Total duration. Product team recently confirmed that they are enhancing this document and also log information in data factory further in future releases.

    As per the report id shared with us, product team mentioned that RCA is IR spent 10 minutes trying to reach to Source SqlServer to get the source schema for "autocreate" sink table. There were something wrong happened inside the SqlServer, to cause SqlClient READCOMMIT transaction failure. And such failure could both impact the "autocreate" and the main copy reading from source. Further analysis can be done from SQL DBA to investigate SqlServer transaction status and query session.

    ADF product team is working to expose the autocreate duration from the monitoring in future which will help customers to identify the issue sooner.

    Please let us know for further queries and we will be glad to assist.

    ---

    • Please accept an answer if correct. Original posters help the community find answers faster by identifying the correct answer. Here is how.
    • Want a reminder to come back and check responses? Here is how to subscribe to a notification.

0 additional answers

Sort by: Most helpful

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.