Azure Data Factory: Copy a file from SharePoint to Blob

Question

Azure Data Factory: Copy a file from SharePoint to Blob

Taariq Toffar 1

Hi,

I am trying this method (https://learn.microsoft.com/en-us/azure/data-factory/connector-sharepoint-online-list#copy-file-from-sharepoint-online) but I get the error below when trying to copy a excel file from SharePoint to Azure Blob:

Failure happened on 'Sink' side. ErrorCode=HttpFileFailedToRead,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=Failed to read data from http server. Check the error from http server：The remote server returned an error: (400) Bad Request.,Source=Microsoft.DataTransfer.ClientLibrary,''Type=System.Net.WebException,Message=The remote server returned an error: (400) Bad Request.,Source=System,'

The registered app has full control on all sites on SharePoint:

Saurabh Sharma 23,846 Reputation points Microsoft Employee Moderator

2021-03-25T15:07:13.433+00:00

@Taariq Toffar Thanks for using Microsoft Q&A !!

Have you granted SharePoint Online site permission to your registered application as mentioned in the prerequisites section of the documentation ?
You need to Open SharePoint Online site link e.g. https://[your_site_url]/_layouts/15/appinv.aspx , provide other necessary details. Then Create and Trust the application as shown in the below image -

Please let me know if you still face any issues.
Sahoo, Priyaranjan 1 Reputation point

2021-06-30T13:59:43.663+00:00

Hi @Saurabh Sharma

In my case I am using Anonymous as Authentication type as per the document but still getting the same error. Do you have any suggestions on it ?

Thanks
Priyaranjan

2 answers

Your answer

Saurabh Sharma 23,846 Reputation points Microsoft Employee Moderator

2021-03-25T15:07:13.433+00:00

@Taariq Toffar Thanks for using Microsoft Q&A !!

Have you granted SharePoint Online site permission to your registered application as mentioned in the prerequisites section of the documentation ?
You need to Open SharePoint Online site link e.g. https://[your_site_url]/_layouts/15/appinv.aspx , provide other necessary details. Then Create and Trust the application as shown in the below image -

Please let me know if you still face any issues.
Sahoo, Priyaranjan 1 Reputation point

2021-06-30T13:59:43.663+00:00

Hi @Saurabh Sharma

In my case I am using Anonymous as Authentication type as per the document but still getting the same error. Do you have any suggestions on it ?

Thanks
Priyaranjan

Answer 1

Nandan Hegde 36,146 MVP Volunteer Moderator

Hey @Taariq Toffar ,
Can you please check whether IRM property is enabled in the sharepoint.
Because :
Even if an Azure AD application has FullControl permissions on SharePoint Online, you can't copy files from document libraries with IRM enabled.

Answer 2

Taariq Toffar 1

IRM is disabled in SharePoint, so it's not that.

Nandan Hegde 36,146 Reputation points MVP Volunteer Moderator

2021-03-26T11:45:26.997+00:00

Can you check whether the Service principal has access on sharepoint.

To check, please hit the below URL with proper values:
https://<<>>.sharepoint.com/sites/<<sitenm>>/_layouts/15/appprincipals.aspx
Taariq Toffar 1 Reputation point

2021-03-29T05:54:42.677+00:00

Yes it does have access as per below:
Saurabh Sharma 23,846 Reputation points Microsoft Employee Moderator

2021-04-12T20:44:44.647+00:00

@Taariq Toffar How are you using the base url. Can you please try using the Base URL like below -
https://<<abc>>.sharepoint.com/_api/web/GetFileByServerRelativeUrl('/Shared Documents/Sample.xlsx')/$value

I have tried this and it worked fine for me with windows authentication -

Thanks
Saurabh
Sahoo, Priyaranjan 1 Reputation point

2021-06-30T13:54:09.39+00:00

Hi @Taariq Toffar ,

are you still facing the same issue or it got resolved ? If yes what is the change you made ?

I am also facing the same issue

Thanks
Priyaranjan

Share via

Azure Data Factory: Copy a file from SharePoint to Blob

2 answers

Your answer