Have you checked the answer provided in the below question?
--please don't forget to upvote
and Accept as answer
if the reply is helpful--
This browser is no longer supported.
Upgrade to Microsoft Edge to take advantage of the latest features, security updates, and technical support.
Hi Team,
I have multiples CSV files in my Azure blob storage container and I want to extract only the files which are updated/uploaded in the last 15 minutes in my azure blob storage and load into Azure datalake storage. Could you please help me out if someone has implemented.
I am looking forward your response. Many thanks.!
Have you checked the answer provided in the below question?
--please don't forget to upvote
and Accept as answer
if the reply is helpful--
Hi
If your requirement is to just copy the files that were uploaded or modified in the last 15 minutes when your pipeline is being triggered, then the simplest solution would be to utilize *Filter by last modified*
feature in copy activity Source tab.
Please use below setting and it should help achieve your requirement. Please note I used *utcnow
* in below example and used addMinutes
function to look back for last 15 minutes. If you want to change the timezone or format, then you can update the dynamic expression as per your specific requirement. For more Date time functions please refer to this document: ADF Date functions for Dynamic expression.
Hope this helps. Do let us know if you have further questions.
Please don’t forget to *Accept Answer*
and *Up-Vote*
wherever the information provided helps you, this can be beneficial to other community members.