i have sharepoint site ,my files are inside so many nestedfolders subfolders and folders ,i have main folder as documents ,iam unable to copy files to adls because its having so many subfolders and nested folders, is there any way to copy files from so many nestedfolders and subfolders and folders or is there any way to copy entire main folder

Hello Chebolu Sai Manasa , Thank you for posting your query here! You may consider using Logic Apps to copy files from SharePoint to ADLSG2. Design: Then: Output: For further details please refer: logic app move from sharepoint to azure | Medium https://www.mssqltips.com/sqlservertip/5893/transfer-files-from-sharepoint-to-blob-storage-with-azure-logic-apps/ Do let us know if you have any further queries. I’m happy to assist you further. Please do not forget to "Accept the answer” and “up-vote” wherever the information provided helps you, this can be beneficial to other community members.

is there any way to copy the entire folder as it is with all nested folders and files from sharepoint to adls

Accepted answer

Anand Prakash Yadav 6,005 Reputation points Microsoft Vendor

2024-03-04T13:56:14.6233333+00:00

Hello Chebolu Sai Manasa,

Thank you for posting your query here!

You may consider using Logic Apps to copy files from SharePoint to ADLSG2.

Design:

Then:

Output:

For further details please refer:

logic app move from sharepoint to azure | Medium

https://www.mssqltips.com/sqlservertip/5893/transfer-files-from-sharepoint-to-blob-storage-with-azure-logic-apps/

Do let us know if you have any further queries. I’m happy to assist you further.

Please do not forget to "Accept the answer” and “up-vote” wherever the information provided helps you, this can be beneficial to other community members.
Please sign in to rate this answer.
Chebolu Sai Manasa 100 Reputation points

2024-03-05T04:56:19.1433333+00:00

without using any logic apps can it possible only by using getToken, getFileList and copyactivity's

Anand Prakash Yadav 6,005 Reputation points Microsoft Vendor

2024-03-05T11:27:31.8266667+00:00

Hello Chebolu Sai Manasa,

Thank you for the response.

You can copy file from SharePoint Online by using Web activity to authenticate and grab access token from SPO, then passing to subsequent Copy activity to copy data with HTTP connector as source.

https://learn.microsoft.com/en-us/answers/questions/53586/copy-files-from-sharepoint-into-azure-data-lake-st

Step by step using ADF :

If you haven't already, you need to create an Azure Data Factory instance in your Azure subscription. This can be done through the Azure Portal.

You need to create linked services in ADF for both SharePoint Online and Azure Data Lake Storage Gen2 :

For SharePoint Online: You'll need to create a linked service connecting to your SharePoint Online site. You would typically use the Office 365 authentication method, requiring your SharePoint URL, Authentication method (Office 365, Windows, or Anonymous), and your credentials

For Azure Data Lake Storage Gen2: Create a linked service for ADLS Gen2 using your storage account name, URL, and authentication method (such as account key, service principal, or managed identity)

After setting up the linked services, you need to create datasets that reference the linked services.

For SharePoint: Create a dataset for the SharePoint folder you wish to copy. You need to specify the site URL and the folder path within your SharePoint site

For ADLS Gen2: Create a dataset for your ADLS Gen2 filesystem where you want to copy the SharePoint files and folders

Next, you need to create a pipeline that defines the data movement and transformation activities.

Copy Activity: Add a Copy activity to your pipeline. This activity will be responsible for copying data from your source (SharePoint) to your destination (ADLS Gen2) In the source settings of the Copy activity, select your SharePoint dataset In the sink settings, select your ADLS Gen2 dataset Configure the Copy activity to recursively copy files if you want to include subfolders and nested files.

You may also refer to: https://www.syntera.ch/blog/2022/10/10/copy-files-from-sharepoint-to-blob-storage-using-azure-data-factory/
Sign in to comment

is there any way to copy the entire folder as it is with all nested folders and files from sharepoint to adls

0 additional answers