Create an ETL pipeline from CosmosDB (JSON structure) to blob storage creating partitions

Aristeides Douvaras 1 Reputation point
2021-12-03T08:54:27.063+00:00

Hi everyone,

I am trying to create an ETL in ADF.
Specifically, i try to ingest data on a recurrent basis (hourly jobs) from CosmosDB to blob storage.

Currently, I am using the "copy data" feature on ADF but i think that i need to use another feature of ADF cause i cannot find how i can create partitions using only the "copy data" feature.

The partitions should be created from the datetime column of the data.
The data on cosmosDB is of Json format.

Any ideas?

Azure Cosmos DB
Azure Cosmos DB
An Azure NoSQL database service for app development.
1,368 questions
{count} votes