How to ingest a binary file received via a rest api call in ADF

Question

I have a sharepoint rest api that return a file in the binary format.

It is uses step authentication:

1. call the on auth 2 token url by passing the client and secret and get the access token
2. Call the main url using the access token and receive the excel file as binary response.

I wanted to use the ADF Sharepoint connector but can not use that because that does not support 2 step auth.

I am trying to use the REST linked service and the connection is successful.

Now I want to use copy data and ingest the binary file.

In Copy data the source dataset is created as "Rest" type and sink dataset is created as binary dataset for ADLS.

When I run the pipeline, I get the below error:

"Source must be binary when sink is binary dataset."

I tried to create the sources dataset as binary but when we have a rest type of source, we do not get option to create a binary dataset.

So I am not sure how can I ingest the data from this sharepoint.

Answer 1

Sample source file -> it is an .xlsb file. I am able to upload in the comment as this type is not supported.

• Pipeline:

• Source dataset:
• 

Source linked service:

• Target dataset:

• Target Linked Service: