Stream Analytics: Why does state of reference data retrieval not leave "In progress"

Question

Hi,

I'm using a CSV file from Azure Blob Storage as a reference input source in a Stream Analytics resource. Right now this file is updated every twenty minutes, but this will change to longer periods as our testing progresses.

Within the activity logs of the Stream Analytics resource I can find entries labelled "Receive reference data snapshot" every twenty minutes, which is obvisously correct. But the status of those entries always stays at "In progress", though I would suspect it to be changed to "Successful" after the reference data has been updated within Stream Analytics.

Is this just a display issue within the Azure Portal? Or is there something wrong with our input source? There was one situation when I thought that the reference data might not have been refreshed in Stream Analytics, but I haven't been able to reproduce the issue as of now.

Thanks in advance for any ideas :)

Tobi

Answer 1

@Tobias Reinhardt - Thanks for the question and using MS Q&A platform.

It is normal for the status of the "Receive reference data snapshot" entries to stay at "In progress" even after the reference data has been updated within Stream Analytics. This is because the status reflects the state of the reference data retrieval process, not the state of the reference data itself.

Once the reference data has been successfully retrieved, it will be used in the Stream Analytics job as expected. So, there is no issue with your input source or the Stream Analytics resource.

I hope this helps! Let me know if you have any other questions