How to choose Azure IoT Hub storage end point

Question

For a typical IoT framework to store telemetry data, which database is preferred? Would be great to know the differences among Cosmos DB, ADLS and a plain storage blob. Which one to use when?

Answer 1

Hi @Sagar Epari Greetings! Thank you for posting the question on this forum.

• You would consider using Azure Storage blobs or Azure Data Lake Storage when dealing with File storage.
• You would want to go for Azure Cosmos DB when dealing with NoSQL databases. Azure Cosmos DB guarantees single-digit-millisecond latencies at the 99th percentile anywhere in the world, offers multiple well-defined consistency models to fine-tune performance, and guarantees high availability with multi-homing capabilities.

Here are a few additional details that will help you in choosing between Azure Blob Storage and Azure Data Lake Storage.

1. Azure Storage blobs allow you to store pictures, documents, HTML files, virtual hard disks (VHDs), big data such as logs, database backups—pretty much anything. Blobs are stored in containers, which are similar to folders. A container provides a grouping of a set of blobs. A storage account can contain an unlimited number of containers, and a container can store an unlimited number of blobs. Azure Storage is a good choice for big data and analytics solutions, because of its flexibility, high availability, and low cost. It provides Azure Blob Storage: Hot, cool, and archive storage tiers for different use cases that will help moderate the cost.
2. Azure Data Lake Storage Gen1 doesn't impose any limits on account sizes, file sizes, or the amount of data that can be stored in a data lake. Data is stored durably by making multiple copies and there's no limit on the duration of time that the data can be stored in the Data Lake. In addition to making multiple copies of files to guard against any unexpected failures, Data lake spreads parts of a file over a number of individual storage servers. This improves the read throughput when reading the file in parallel for performing data analytics.

In addition to the above information,

Please refer to the article Choose a big data storage technology in Azure for more details on how you can choose the storage end point that suits your needs. Let us know if you have any additional questions or need further assistance.

---

If the response helped, please do click Accept Answer and Yes . Doing so would help other community members with similar issue identify the solution. I highly appreciate your contribution to the community.