How to send a file for an upload operation to REST API using web activity [Post method]

Arun Augustine 0

I am new to ADF and Azure. I want to send a file (Json preferably) in Azure Blob Storage to a REST API for upload. I also need to retrieve the response of the upload operation. I understand that we can use Web Activity (POST method) for this, although I am not sure how to achieve the same. Looking for guidance

3 answers

Deleted

This answer has been deleted due to a violation of our Code of Conduct. The answer was manually reported or identified through automated detection before action was taken. Please refer to our Code of Conduct for more information.

Comments have been turned off. Learn more
Deleted

This answer has been deleted due to a violation of our Code of Conduct. The answer was manually reported or identified through automated detection before action was taken. Please refer to our Code of Conduct for more information.

Comments have been turned off. Learn more
ShaikMaheer-MSFT 38,441 Reputation points Microsoft Employee

2023-03-29T10:27:28.5766667+00:00

Hi Arun Augustine,

Thank you for posting query in Microsoft Q&A Platform.

Use Lookup activity to read json of your file. Lookup activity output json will have your file json in it. Now, use web activity for your POST API call, here in request body you can pass your json from lookup activity output json.

Please check below video for web activity to understand.

Web Activity in Azure Data Factory

Please check below video for lookup activity to understand.

Lookup Activity in Azure Data Factory

Please check below to understand how to pass values from one activity to another. This helps you to pass json from lookup activity to web activity.

How to read JSON output of one Activity in to another Activity in Azure Data Factory

Hope this helps. Please let me know how it goes or if any further queries.

Please consider hitting Accept Answer button. Accepted answers help community as well.
Please sign in to rate this answer.
Arun Augustine 0 Reputation points

2023-03-29T21:49:39.5633333+00:00

Thank you @ShaikMaheer-MSFT I will try this out. Please do note that my rest end point is expecting a file and not a Json body as input.

API Endpoint : https://sampleserver6.arcgisonline.com/arcgis/rest/services/DamageAssessment/FeatureServer/uploads/upload

Arun Augustine 0 Reputation points

2023-03-29T23:14:53.1433333+00:00

Hi @ShaikMaheer-MSFT

I tried the steps you mentioned (please find the pipeline screenshot below). The pipeline run succeeded, but the Output (attached to the post) of the Web1 activity has the error "Error performing upload operation" which tells me that the file was not uploaded even though the pipeline ran fine.

ShaikMaheer-MSFT 38,441 Reputation points Microsoft Employee

2023-04-10T10:53:43.6033333+00:00

Hi Arun Augustine, Your above link seems to be a web form not API. Web form upload operation you cannot perform using API call until there is an API available. Secondly, you are using directly entire output json of lookup activity. if you have API, you need to understand what kind of json you should pass to it and send only that json.

Arun Augustine 0 Reputation points

2023-04-12T11:31:10.5566667+00:00

Hi @ShaikMaheer-MSFT I have attached below the URL to the REST API documentation for the upload functionality. https://sampleserver6.arcgisonline.com/arcgis/sdk/rest/#/Upload/02ss0000000m000000/ If my understanding is correct, this is a REST API for an upload operation. It uploads files to the server. I was able to execute the Copy activity, where I provided the source as Azure Blob Storage (file to upload) and the sink as REST API (using the same URL - https://sampleserver6.arcgisonline.com/arcgis/rest/services/DamageAssessment/FeatureServer/uploads/upload)

The pipeline ran successfully, but I did not get the response from the POST operation. We need the response for the next activity in the pipeline.

This makes me believe that it is an API endpoint. Please advise
Sign in to comment

Use comments to ask for clarification, additional information, or improvements to the question.

Share via

How to send a file for an upload operation to REST API using web activity [Post method]

3 answers

Your answer