Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,596 questions
ADF Pipeline not working as it should be, records not tallying between source and destination
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(188.79999999999998, 85%, 28%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ERR%3C/text%3E%3C/svg%3E)
Rajnish Rajput
0
Reputation points
ADF Pipeline sometimes does not work as it should be, records not tallying between source and destination where pipeline record shows all records transferred.
enclosed is the snapshot of it. Kindly assist in figuring out why sometimes pipeline does not work as it should be.
Azure Data Factory
{count} votes
-
AnnuKumari-MSFT 34,551 Reputation points Microsoft Employee Moderator2023-07-03T14:24:49.6+00:00 Hi Rajnish Rajput ,
Welcome to Microsoft Q&A platform and thanks for posting your question here.
It looks like you are facing error in ADF pipeline , however the screenshot you are mentioning about is not visible. Kindly reshare the same as we require the error message and pipeline details to debug and guide what went wrong.
Looking forward to your response. Thankyou.
-
Rajnish Rajput 0 Reputation points
2023-07-03T14:37:25.2666667+00:00 -
AnnuKumari-MSFT 34,551 Reputation points Microsoft Employee Moderator
2023-07-03T15:45:35.8333333+00:00 Hi Rajnish Rajput ,
This is strange, I assume source actually has 234,369 records but how many records you see in sink after the dataload, copy activity monitor details shows the same number but as per your query, you see a different number in the sink table , kindly share how many records do you see?
Could you please share the copy activity configuration - source , sink , mapping and settings tab. Thankyou in advance.
Kindly make sure your sink dataset is pointing to the correct table, and not any staging table.
Looking forward to your response. Thankyou in advance for sharing additional information.
-
AnnuKumari-MSFT 34,551 Reputation points Microsoft Employee Moderator
2023-07-13T10:15:04.6633333+00:00 Hi Rajnish Rajput ,
Did you get a chance to view the previous response? Kindly share the updates regaring issue resolution. Thankyou
Sign in to comment
Sign in to answer