Check the Files are updated in the Datalake within the last day using ADF

pankaj chaturvedi 86 Reputation points
2022-03-23T13:32:12.323+00:00

Hi Team,

How can I check in Azure Datalake my files have been updated in the last day using ADF.?

Check: 'File has been updated within the last day .'If not , do not run and pass an error. "File Name" has not been updated within last day and I need to make sure that "File Name" is updated and need to run "ADF" manually.

Please help me out if do you have any idea.

Many thanks,
Pankaj

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,330 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,458 questions
0 comments

2 answers

Sort by: Most helpful
Most helpful Newest Oldest
  1. Nandan Hegde 29,886 Reputation points MVP
    2022-03-23T13:42:21.6+00:00

    Hey,
    You can use GetMeta Data activity to get the file update details and work out your need

    2 people found this answer helpful.
  2. ShaikMaheer-MSFT 37,656 Reputation points Microsoft Employee
    2022-04-05T16:15:47.037+00:00

    Hi @pankaj chaturvedi ,

    Thanks for posting query in Microsoft Q&A Platform.

    You can consider using GetMetaData activity & If activity for achieving this.

    GetMetaData activity can help to get LastModified date of file and then take that date in to If activity and validate and proceed pipeline execution accordingly.

    This video will help to understand GetMetadata activity.
    This video will help to understand If activity.

    Hope this helps. Please let us know if any queries.

    -------------

    Please consider hitting Accept Answer button. Accepted answers help community as well.

    1 person found this answer helpful.