Get List of Collections Web activity in Azure Factory

kosmos 246

Objective: get a list of containers from a cosmos db in Azure Data Factory

Methodology: Using Web Activity

Problem: Not sure if I am inputing the correct data needed in the fields.

A picture with the fields below:

Under Resource I am not sure if I am imputing the correct format

AADSTS70011: The provided request must include a 'scope' input parameter. The provided value for the input parameter 'scope' is not valid. The scope xxx is not valid

Does someone know how can I get the list of collections correctly ?

AnnuKumari-MSFT 31,061 Reputation points Microsoft Employee

2022-11-28T15:29:48.397+00:00
Hi @kosmos ,

Thankyou for using Microsoft Q&A platform and thanks for posting your question here.

As I understand your query, you want to get the list of containers from a cosmos db using Azure Data Factory pipelines.

According to this post, In order to Get List of Collections using REST API call, AAD token is required for each execution of pipeline. As Web Activity template doesnot support AAD token generation, you can try making an HTTP call using Function App(FA) that you can call from ADF as a web activity. In this FA you would have code to fetch AAD token, get list of collections and return it.

Could you please try the following steps and check if it helps:

Make a Http Trigger function that can be called by a Web Activity.

Obtain AAD token inside that function

Call the REST Api to get list of cosmos collections

Return json-array as response

Add a For-each activity in ADF to loop over the list of collections.
kosmos 246 Reputation points

2022-11-28T16:11:42.01+00:00

Hi,
I tried but I am not familiar with the cosmos API so I was not able to retrieve the token. I am not sure which urls I need to enter