does Azure data explorer stores any data when cluster in OFF state

Sangeetha Priya S 145 Reputation points


I am using azure data explorer cluster for analytics purpose. Therefore, I am receiving data from IoT Hub to ADX cluster.

I would like to understand what if cluster is in OFF state and how will be the ingested data stored.

will received data store on database when ADX cluster becomes ON state or will it be discarded.

I would like to understand this more..

Azure Data Explorer
Azure Data Explorer
An Azure data analytics service for real-time analysis on large volumes of data streaming from sources including applications, websites, and internet of things devices.
426 questions
0 comments No comments
{count} votes

Accepted answer
  1. AirGordon 6,775 Reputation points

    Data will not be discarded, however the same ingest sources may not be available when the cluster is started again. When a cluster is stopped it does not lose any of the already ingested data, since the storage resources are not released.

    Read more about stopping ADX clusters::

    Azure Data Explorer flow.

    0 comments No comments

1 additional answer

Sort by: Most helpful
  1. Sander van de Velde 25,416 Reputation points MVP

    Hello @Sangeetha Priya S ,

    if you use the Azure Data Explorer database data connection, IoT Hub messages can be ingested.

    This is done using the IoT Hub 'event-hub-compatible-endpoint'.

    Although the IoT Hub is not a database, it can store incoming messages for up to 7 seven days:

    User's image

    This way, consuming resources like Azure Data Explorer can be halted for a certain time.

    If messages are not picked up, the IoT Hub will forget them after the specific time span.

    If your ADX is started again, all stored messages in the IoT Hub will be released.

    Be aware this can produce a certain ingestion load on your cluster, based on the number of stored messages.

    This answer is written by myself, not by some AI. If the response helped, do "Accept Answer". If it doesn't work, please let us know the progress. All community members with similar issues will benefit by doing so. Your contribution is highly appreciated.