Azure table storage speed suggestion or alternative

Question

Hi All

I am saving IoT device data per min when I need to receive a large amount of data e.g. couple of months, it takes a very long time from Azure table storage.

As there a better storage option?

Answer 1

Hello @djoshi ,

Azure storage tables are great for storing and retrieving rows based on partition key and row key.

This is a limited solution for IoT data if you want to query other fields.

The perfect storage format you need is called Time Series or columnstore indexes.

This is offered by a wide variety of Azure services, like Sql Azure, CosmosDB, Time Series Insights, or Azure Data Explorer.

Because you want to work with raw data, a high-level database like Sql Azure or CosmosDB can become expensive based on the large amounts of data to be expected.

So, my first suggestion should have been Time Series Insights but that service will be replaced by its much more brother Azure Data Explorer.

Azure Data Explorer is a powerful yet affordable tool for retrieving data.

See also this series of blog posts about how to integrate Azure Data Explorer in your IoT solution in a smart way.

----------

If the response helped, do "Accept Answer". If it doesn't work, please let us know the progress. By doing so, all community members who have a similar issue will benefit. Your contribution is highly appreciated.