Stream Analytics stops consuming messages from Event Hub

Question

Hi Community,
I'm currently building a solution which is to consume protobuf messages from Event Hub, deserialize them in Stream Analytics (with custom CLR), and write them to blob storage. I'm currently facing the problem that Stream Analytics will always stop consuming messages from Event Hub after 5-30 minutes. This happens without any errors in either the Stream Analytics Job Logs, or the Event Hub logs. Also, the memory/CPU utilization are not exceeding 20-30% in these cases. After a certain point the incoming messages will just drop to 0, and the watermark delay will just start steadily increasing. Can anybody advice which way to look to solve this problem? Locally I can run ASA project for as long as I like without any issues (live input, local output). Some charts from the Metrics:

Event hub incoming/outgoing:

Stream Analytics input Events dropping to 0.

Stream Analytics cpu/memory usage is low:

Answer 1

Hello @fhutten-3864 ,
Thanks for the question and using MS Q&A platform.
The metrics which you have shared , i see that the data are written in different partitions but you are reading that from one only 1 parition .
I think revisiting the output configuation should be a good idea .
https://learn.microsoft.com/en-us/azure/stream-analytics/event-hubs-output#output-configuration

Please do let me if you have any queries.
Thanks
Himanshu

---

• Please don't forget to click on or upvote button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how
• Want a reminder to come back and check responses? Here is how to subscribe to a notification
  • If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators