Check the Files are updated in the Datalake within the last day using ADF

pankaj chaturvedi 91 Reputation points
2022-03-23T13:32:12.323+00:00

Hi Team,

How can I check in Azure Datalake my files have been updated in the last day using ADF.?

Check: 'File has been updated within the last day .'If not , do not run and pass an error. "File Name" has not been updated within last day and I need to make sure that "File Name" is updated and need to run "ADF" manually.

Please help me out if do you have any idea.

Many thanks,
Pankaj

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,555 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,526 questions
0 comments No comments
{count} votes

2 answers

Sort by: Most helpful
  1. Nandan Hegde 35,346 Reputation points MVP Moderator
    2022-03-23T13:42:21.6+00:00

    Hey,
    You can use GetMeta Data activity to get the file update details and work out your need

    2 people found this answer helpful.

  2. ShaikMaheer-MSFT 38,536 Reputation points Microsoft Employee Moderator
    2022-04-05T16:15:47.037+00:00

    Hi @pankaj chaturvedi ,

    Thanks for posting query in Microsoft Q&A Platform.

    You can consider using GetMetaData activity & If activity for achieving this.

    GetMetaData activity can help to get LastModified date of file and then take that date in to If activity and validate and proceed pipeline execution accordingly.

    This video will help to understand GetMetadata activity.
    This video will help to understand If activity.

    Hope this helps. Please let us know if any queries.

    -------------

    Please consider hitting Accept Answer button. Accepted answers help community as well.

    1 person found this answer helpful.

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.