Tumbling window trigger in copy pipeline seems to be copying more data than present in the window.

Swetha Seelam 0 Reputation points Microsoft Employee
2024-03-26T02:40:14.8633333+00:00

I used the 'Ingest' option in Azure data factory to enable continuous ingestion from one table to another table using Tumbling window trigger. I set the interval in the Tumbling window trigger to 15 mins and the window start and end time for each trigger are as expected.
User's image

But the pipeline tries to copy a lot more data than what is present in this 15 min interval and it doesn't complete, it just keeps trying to copy.
Any thoughts on how to fix this?

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,676 questions
{count} votes

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.