How to post json data (stored in a file in Azure Blob Storage) to Rest API in Azure Data factory

Question

Hi Team,

It has been quite a time now trying to write data to a service via an API. My requirement is to PUT the json data stored as files in .json format to web API.

I have seen many solutions on the internet of using web/lookup activity, but unfortunately unable to meet my requirements.
Using 2 web activities - This does not work because I need to perform some transformations on the json file before posting it back.
Using data flows - Not achieved because it does not support Self-Hosted IR
Logic App - Not too sure about the implementation, any reference in this regard would be helpful.

Reaching out to the community for help/guidance in pointing me to correct solution or reference materials.

Thanks,
Mustafa

Answer 1

Hi @MustafaKamal-0144 ,

Thank you for posting query in Microsoft Q&A Platform.

You mentioned in your ask that you need to read json file and then perform some kind of transformations and then post that to API. Since you need to perform transformations, you need to go with dataflows only. Other that data flows there is no other way in ADF to perform transformations.

You also mentioned because of selfhosted IR you were not able to go for it. Where exactly your self hosted IR is pitching in here? Is it while posting json to API? or Is it while reading data from json file?

Please Note, to overcome above situation try to take data in to cloud first and using data flows transform data and then try to have transformed json on cloud storage and then use lookup activity and web activity approach to post json to API.

Hope this helps. Please let us know if any further queries.

-----------

Please consider hitting Accept Answer and Up-vote buttons. Accepted answers help community as well.