How to incrementally copy changed files from SharePoint to Blob using Azure Data Factory

Rakesh Kumar 45 Reputation points
2023-06-08T07:22:21.6233333+00:00

I want to copy the changed or last modified files from SharePoint to blob storage using azure data factory. I have done the normal copy part i.e. copy all the files from SharePoint to blob using web activity. Now stuck in how to copy the changed files from SharePoint to blob.

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,687 questions
Microsoft 365 and Office | SharePoint | For business | Windows
{count} votes

1 answer

Sort by: Most helpful
  1. QuantumCache 20,371 Reputation points Moderator
    2023-06-09T15:17:17.4466667+00:00

    Hello @Rakesh Kumar Did you try to use GetMetadata and run ForEach activity over the filtered Items for CopyActivity?

    Please refer to this similar post which talks about reading the latest ingested File.

    User's image

    0 comments No comments

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.