Share via

Missing record in table storage (from stream analytics)

BERNARD Thomas 166 Reputation points
2021-02-10T09:25:32.913+00:00

Hi everybody,

I have a problem of missing records in a table storage account.

I use a stream analytics job to send data from an IOTHub to a table storage. The stream analytics job seems working correctly (output event count seems correct).

I expect to see around 100 records every 10 minutes in the table, but I only see 1 record coming into the table. All other records seems to be lost. That's why I suppose my problem comes from the table storage write capability.

Is there any parameter in the table storage account which should be modified to accept all my write requests ? Or anything else that I misunderstood ?

Thanks in advance for your help !

Thomas

Azure Table Storage
Azure Table Storage

An Azure service that stores structured NoSQL data in the cloud.

Azure IoT Hub
Azure IoT Hub

An Azure service that enables bidirectional communication between internet of things (IoT) devices and applications.

Azure Stream Analytics
Azure Stream Analytics

An Azure real-time analytics service designed for mission-critical workloads.

0 comments No comments

Answer accepted by question author

BERNARD Thomas 166 Reputation points
2021-02-10T15:54:04.693+00:00

Finally I found the problem. The ROWKEY value in the table should be unique (with the PARTITIONKEY).

I cannot use EvendId value from the IOTHub as ROWKEY because this value is the same for all stream analytics output coming from the same input.

I have created my own value with concatenation of DATETIME and IDENT as ROWKEY and DEVICE as PARTITIONKEY, and now everything is OK.

Hope it can help other people facing problems.

Regards,

Thomas

Was this answer helpful?

0 comments No comments

0 additional answers

Sort by: Most helpful

Your answer

Answers can be marked as 'Accepted' by the question author and 'Recommended' by moderators, which helps users know the answer solved the author's problem.