Expiry Datetime incorrect for Tumbling Window Trigger Catchup Run?

Rasika Athavale 1 Reputation point Microsoft Employee
2020-11-06T19:26:33.123+00:00

I have a pipeline that primarily has 2 copy activities . The sink for the copy activities is ADLS Gen 1, so it also sets an expiry datetime for each of the files copied over. It uses a tumbling window trigger with a self-dependency. Recently, the pipeline failed, and in the catchup runs the expiry datetime that I'd set wasn't used and instead the default was used. Is there any reason why this would happen and how I could fix it?

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,833 questions
{count} votes

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.