Copy Sharepoint online csv to datalake using Azure Data Factory

Question

Hi

I am trying to copy CSV file from Sharepoint online to Data lake using Data Factory. I followed the below documentation.

https://learn.microsoft.com/en-us/azure/data-factory/connector-sharepoint-online-list?tabs=data-factory#copy-file-from-sharepoint-online

my pipeline looks below

I am getting errors in the copy data activity. My connection to Sharepoint is successful, and even I can download the CSV file using the base & relative URL.

Below is my error

My base URL: https://xxx.sharepoint.com/
Relative URL: sites/39421875/_api/web/GetFileByServerRelativeUrl('/sites/39421875/Shared Documents/Test.csv')/$value

Not sure why the above error is coming? I added "/" in the base URL.

I tried multiple times, and same error is happening. Even I tried to give complete URL in the base URL but no success

Any suggestions?

Answer 1

Hi @Dhilip Subramanian ,

Thank you for posting query in Microsoft Q&A Platform.

Are you using REST connector dataset inside Copy activity, Source Tab? Is your API call inside Copy activity, source tab downloads file? If yes, Kindly use HTTP connector type dataset as source dataset inside copy activity and see how it goes.

Please let me know how it goes. Please feel free to share screenshots of complete implementation that helps to repro and understand root cause better. Thank you.