Capture pipeline run date in Logic App.

Question

I am copying files from an SFTP and following this https://learn.microsoft.com/en-us/azure/data-factory/solution-template-copy-new-files-lastmodifieddate to pick the latest file. My files, however, are being added once a month, so instead of adding Tumbling Window trigger I want to set up Logic App that would trigger my pipeline upon the file drop to SFTP. The above mentioned tutorial specifies parameters LastModified_From = @Trigger ().outputs.windowStartTime and LastModified_To = @Trigger ().outputs.windowEndTime, which seems to only be possible to use with Tumbling Window trigger.

Is there a way I can combine copying new and changed files by LastModifiedDate and triggering pipeline with Logic app?

Answer 1

Hi! Thank you for your response.

Putting default values for the parameters gives the following error.

However putting same values directly into the "Filter by last modified" fields worked.

And I ended up adding regular monthly trigger and setting it to run on a specific day of the month.

Answer 2

Hello @Goutham Kannekanti ,
Thanks for the ask and using the Microsoft Q&A platform .

Just to clearfy first the template which you are following is passing a set of parameters to the pipeline , see the snapshot from the same article .
Since we are triggering the pipeline from a TWT we are passing the start and end time as the start time of the TWT and passing that to the pipeline .

In your case the things will change , since you mentioned that the file always arrives once in month , you can pass the start and end time as default as shown below or you can pass the same parameters when you call the pipeline from logic apps ( may the function names will be different , I am not very sure about that )

Thanks
Himanshu
Please do consider to click on "Accept Answer" and "Up-vote" on the post that helps you, as it can be beneficial to other community members