Missing record in table storage (from stream analytics)

BERNARD Thomas 166 Reputation points
2021-02-10T09:25:32.913+00:00

Hi everybody,

I have a problem of missing records in a table storage account.

I use a stream analytics job to send data from an IOTHub to a table storage. The stream analytics job seems working correctly (output event count seems correct).

I expect to see around 100 records every 10 minutes in the table, but I only see 1 record coming into the table. All other records seems to be lost. That's why I suppose my problem comes from the table storage write capability.

Is there any parameter in the table storage account which should be modified to accept all my write requests ? Or anything else that I misunderstood ?

Thanks in advance for your help !

Thomas

Azure Table Storage
Azure Table Storage
An Azure service that stores structured NoSQL data in the cloud.
156 questions
Azure IoT Hub
Azure IoT Hub
An Azure service that enables bidirectional communication between internet of things (IoT) devices and applications.
1,106 questions
Azure Stream Analytics
Azure Stream Analytics
An Azure real-time analytics service designed for mission-critical workloads.
330 questions
0 comments No comments
{count} votes

Accepted answer
  1. BERNARD Thomas 166 Reputation points
    2021-02-10T15:54:04.693+00:00

    Finally I found the problem. The ROWKEY value in the table should be unique (with the PARTITIONKEY).

    I cannot use EvendId value from the IOTHub as ROWKEY because this value is the same for all stream analytics output coming from the same input.

    I have created my own value with concatenation of DATETIME and IDENT as ROWKEY and DEVICE as PARTITIONKEY, and now everything is OK.

    Hope it can help other people facing problems.

    Regards,

    Thomas

    0 comments No comments

0 additional answers

Sort by: Most helpful