Copy last modified file in copy activity

Vineet S 1,390 Reputation points
2024-09-08T12:10:17.2133333+00:00

Hi how to copy last modified-2 hours copy from folder using copy activity from blob storage.. Pls share screenshot

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
0 comments No comments
{count} votes

Answer accepted by question author
  1. NIKHILA NETHIKUNTA 4,610 Reputation points Microsoft External Staff
    2024-09-09T08:50:51.08+00:00

    @Vineet S
    Thank you for the question and for using Microsoft Q&A platform.
    To copy files that were modified in the last 2 hours from a folder using the Copy Activity in Azure Data Factory, you can follow these steps:

    1. Create a pipeline in Azure Data Factory and add Copy Data to the canvas.
    2. Configure the source dataset to point to your Blob Storage container.
    3. Use a 'Wildcard folder path' to select files. You can use a dynamic content expression to filter files based on their last modified time.
      Set the start time as:
    @addhours(utcNow(),-2)
    

    User's image

    1. Configure the sink dataset to point to the destination Blob Storage container.

    User's image

    Hope this helps. Do let us know if you have any further queries.


    If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.

    0 comments No comments

0 additional answers

Sort by: Most helpful

Your answer

Answers can be marked as 'Accepted' by the question author and 'Recommended' by moderators, which helps users know the answer solved the author's problem.