Azure Synapse Dynamic URL in API Calls

Siddhant Lunawath 0

There is a data extraction process in place using the API GET request for which we get the response. But an issue with the process is that it contains dynamic URLs which means the query parameters are dynamic in place.

For example:

URL : https://api.example.com/rest/api/v2/search?user=USERNAME

We have the username changing and for each username there is a separate response we receive. What our intention is to combine all the data sets for different USERNAME and bring it under one call appending each URL data beneath the other.
Please help with this case.

KranthiPakala-MSFT 46,462 Reputation points Microsoft Employee

2023-02-14T22:46:26.3533333+00:00
Hi Siddhant Lunawath,

Welcome to Microsoft Q&A forum and thanks for posting your question.

Just trying to understand the requirement so that we can better assist in this ask.

Could you please confirm if your requirement is to Pass the Query parameter user dynamically for each username, loop through the list of usernames and save those individual responses in a location first and then combine all of the responses together to form a single Big Response?

OR

You want to pass the query parameter user for all usernames in a single call and save all of those responses in a single go? If this is the requirement will your REST API endpoint allow multiple query parameters condition at a single go and return the combined response back?

Does your REST API endpoint support pagination?

Thanks
Siddhant Lunawath 0 Reputation points

2023-02-15T12:26:57.0733333+00:00

Hi @KranthiPakala-MSFT

As per the request, I want to pass the USER dynamically and save all of them in a single go rather than saving each of them individually and then merging them into a single response. As my usernames can exceed may be 100+ or even 200+. What would be the best solution ahead for this? As saving each of them individually will make it more complex. Any heads up that you can provide with?
Siddhant Lunawath 0 Reputation points

2023-02-27T07:29:22.67+00:00

@KranthiPakala-MSFT - Can you help with the same? Any insights that can be provided?
KranthiPakala-MSFT 46,462 Reputation points Microsoft Employee

2023-03-20T22:22:58.87+00:00

@Siddhant Lunawath - Since your query parameters are dynamic what you can do is you can utilize External call transformation in Mapping dataflow and point to a source which contains the list of parameters and external call transformation should help achieve your requirement.

To explore more about external call transformation please refer to below:

Doc: External call transformation in mapping data flows

Video demonstration: ADF External Call Transformation

Hope this info helps.

Thank you

Share via

Azure Synapse Dynamic URL in API Calls

Your answer