does Azure data explorer stores any data when cluster in OFF state

Question

Hi

I am using azure data explorer cluster for analytics purpose. Therefore, I am receiving data from IoT Hub to ADX cluster.

I would like to understand what if cluster is in OFF state and how will be the ingested data stored.

will received data store on database when ADX cluster becomes ON state or will it be discarded.

I would like to understand this more..

Answer 1

Data will not be discarded, however the same ingest sources may not be available when the cluster is started again. When a cluster is stopped it does not lose any of the already ingested data, since the storage resources are not released.

Read more about stopping ADX clusters:: https://techcommunity.microsoft.com/t5/azure-data-explorer-blog/automatically-stop-unused-azure-data-explorer-clusters/ba-p/3047042

Answer 2

Hello @Sangeetha Priya S ,

if you use the Azure Data Explorer database data connection, IoT Hub messages can be ingested.

This is done using the IoT Hub 'event-hub-compatible-endpoint'.

Although the IoT Hub is not a database, it can store incoming messages for up to 7 seven days:

This way, consuming resources like Azure Data Explorer can be halted for a certain time.

If messages are not picked up, the IoT Hub will forget them after the specific time span.

If your ADX is started again, all stored messages in the IoT Hub will be released.

Be aware this can produce a certain ingestion load on your cluster, based on the number of stored messages.

---

This answer is written by myself, not by some AI. If the response helped, do "Accept Answer". If it doesn't work, please let us know the progress. All community members with similar issues will benefit by doing so. Your contribution is highly appreciated.