CosmosDB API | How to get the logical data size for a given partition

Question

CosmosDB API | How to get the logical data size for a given partition

Olivier Moreau 0

Hi,

I need to get the logical size of a given partition using the CosmosDB API, but I did not find anything in the SDK or with a web search.

As there is a 20Gb limit on that logical size, it makes sense to have a way to get that size, so I probably missed it.

And yes, I've seen those many articles explaining how to set an alert, but I need the size at any moment, not an alert.

Thanks in advance

Sai Raghunadh M 3,070 Reputation points Microsoft External Staff

2024-10-03T20:49:36.9+00:00

Hi@ Olivier Moreau,

Thanks for the question and using MS Q&A platform.

I understand that you're having trouble finding a way to get the logical size of a specific partition using the Cosmos DB API. While you can use the Azure Cosmos DB SDK or the Azure Portal for general metrics, there isn't a direct method to query the size of an individual partition through the SDK.

To keep track of your data, it's a good idea to set up alerts for the total size of your container. This way, you'll know when you're getting close to the 20 GB limit for each partition. But you cannot get the accurate logical size of the partition.

You can estimate the size of a partition by counting how many items are in it and guessing the average size of those items. First, check the total storage used by the entire container, and then find out how many items are in the specific partition.

Also, check the Azure Cosmos DB documentation regularly, as they may add new features that could help you.

I hope this information helps, please do let us know if you have any Queries.
Olivier Moreau 0 Reputation points

2024-10-04T07:37:15.57+00:00

Thanks for the detailled reply.

From an computer engineer point of view, I think it's absurd so set a limit on the logical partition size, and provide no way to check that limit.

This metric must exist somewhere in your system, otherwise how would your systems check that a container has reached it ?

The workaround you provided adds extra work and increases the time-to-production and need extra testing every time your data structure evolves.

Dear frustrated reader : there is a poll to vote for this feature request, please consider upvoting !
Olivier Moreau 0 Reputation points

2024-10-04T07:45:18.5033333+00:00

..............
Sai Raghunadh M 3,070 Reputation points Microsoft External Staff

2024-10-07T17:50:28.3366667+00:00

Hi @Olivier Moreau,Thanks for posting your feedback in our feedback forum. This will be closely monitored by our product team.

Your answer

Sai Raghunadh M 3,070 Reputation points Microsoft External Staff

2024-10-03T20:49:36.9+00:00

Hi@ Olivier Moreau,

Thanks for the question and using MS Q&A platform.

I understand that you're having trouble finding a way to get the logical size of a specific partition using the Cosmos DB API. While you can use the Azure Cosmos DB SDK or the Azure Portal for general metrics, there isn't a direct method to query the size of an individual partition through the SDK.

To keep track of your data, it's a good idea to set up alerts for the total size of your container. This way, you'll know when you're getting close to the 20 GB limit for each partition. But you cannot get the accurate logical size of the partition.

You can estimate the size of a partition by counting how many items are in it and guessing the average size of those items. First, check the total storage used by the entire container, and then find out how many items are in the specific partition.

Also, check the Azure Cosmos DB documentation regularly, as they may add new features that could help you.

I hope this information helps, please do let us know if you have any Queries.
Olivier Moreau 0 Reputation points

2024-10-04T07:37:15.57+00:00

Thanks for the detailled reply.

From an computer engineer point of view, I think it's absurd so set a limit on the logical partition size, and provide no way to check that limit.

This metric must exist somewhere in your system, otherwise how would your systems check that a container has reached it ?

The workaround you provided adds extra work and increases the time-to-production and need extra testing every time your data structure evolves.

Dear frustrated reader : there is a poll to vote for this feature request, please consider upvoting !
Olivier Moreau 0 Reputation points

2024-10-04T07:45:18.5033333+00:00

..............
Sai Raghunadh M 3,070 Reputation points Microsoft External Staff

2024-10-07T17:50:28.3366667+00:00

Hi @Olivier Moreau,Thanks for posting your feedback in our feedback forum. This will be closely monitored by our product team.

Share via

CosmosDB API | How to get the logical data size for a given partition

Your answer