ADF Rest API with enveloped response

Question

Anyone have example how to handle enveloped REST API response?

Here is example response I get. I need to pull users details from it

{
    "count": 2,
    "results": [
        {
            "key": "users",
            "id": "16363635"
        },
        {
            "key": "users",
            "id": "16657845"
        }
    ],
    "users": {
		"16363635": {
            "full_name": "First Last",
            "photo_path": "https://photo_blabla",
            "email_address": "******@domain.com",
            "headline": "title",
            "generic": false,
            "disabled": false,
            "update_whitelist": [
                "full_name",
                "headline",
                "email_address",
                "external_reference",
                "linkedin_url",
                "bio",
                "website",
                "company_name",
                "address1",
                "address2",
                "city",
                "state",
                "zip"
            ],
            "account_id": "6939935",
            "id": "16363635"
        },
		"16657845": {
            "full_name": "First 1 Last 1",
            "photo_path": "https://photo_blabla1",
            "email_address": "******@domain.com",
            "headline": "title1",
            "generic": false,
            "disabled": false,
            "update_whitelist": [
                "full_name",
                "headline",
                "email_address",
                "external_reference",
                "linkedin_url",
                "bio",
                "website",
                "company_name",
                "address1",
                "address2",
                "city",
                "state",
                "zip"
            ],
            "account_id": "16657845",
            "id": "16657845"
        }
		
	}
"meta": {
        "count": 2,
        "page_count": 1,
        "page_number": 1,
        "page_size": 5
    }
}

Answer 1

Hello Vojin Lekovic,

Welcome to the Microsoft Q&A and thank you for posting your questions here.

I understand that you would like to handle enveloped REST API response.

There are two options here:

1. Copy activity by Copy REST > Blob (or ADLS) > Mapping Data Flow. It has robust REST connector options (authentication, pagination, headers). Write the raw API response to blob, then use Data Flow to parse/flatten. This separates concerns and avoids Data Flow REST schema/import problems. https://learn.microsoft.com/en-us/azure/data-factory/connector-rest
2. Direct Mapping Data Flow REST Source if you have small responses, no complex pagination, and your Data Flow REST source successfully imports schema. https://techcommunity.microsoft.com/t5/azure-data-factory/rest-source-and-sink-now-available-for-data-flows/ba-p/2596484

Use the associated links for more detailed steps.

I hope this is helpful! Do not hesitate to let me know if you have any other questions or clarifications.

---

Please don't forget to close up the thread here by upvoting and accept it as an answer if it is helpful.