Copy last modified file in copy activity

Vineet S 1,070 Reputation points
2024-09-08T12:10:17.2133333+00:00

Hi how to copy last modified-2 hours copy from folder using copy activity from blob storage.. Pls share screenshot

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,873 questions
0 comments No comments
{count} votes

Accepted answer
  1. NIKHILA NETHIKUNTA 3,270 Reputation points Microsoft Vendor
    2024-09-09T08:50:51.08+00:00

    @Vineet S
    Thank you for the question and for using Microsoft Q&A platform.
    To copy files that were modified in the last 2 hours from a folder using the Copy Activity in Azure Data Factory, you can follow these steps:

    1. Create a pipeline in Azure Data Factory and add Copy Data to the canvas.
    2. Configure the source dataset to point to your Blob Storage container.
    3. Use a 'Wildcard folder path' to select files. You can use a dynamic content expression to filter files based on their last modified time.
      Set the start time as:
    @addhours(utcNow(),-2)
    

    User's image

    1. Configure the sink dataset to point to the destination Blob Storage container.

    User's image

    Hope this helps. Do let us know if you have any further queries.


    If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.

    0 comments No comments

0 additional answers

Sort by: Most helpful

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.