How do I get the most recent good value at a point in time from Time Series Insights?

Question

How do I get the most recent good value at a point in time from Time Series Insights?

Richard Bailey 21

I cannot find a reliable way to retrieve the most recent good value prior to a given timestamp via the TSI API without recursing the entire history of each point. It looks like the getEvents, getSeries, and getAggregateSeries only ever process data INSIDE the searchSpan, so if you need to find the value prior to a timestamp, you need to put a huge span in place. Since these methods only ever return the first 10k (or 250k) samples ordered from the beginning of the search span, there is no easy way to find the most recent value without progressively recursing back in history until you find a sample.

Is there a way to do this using the various aggregate, boundary, and take: 1 options which doesn't need me to search the entire history of the series?

AshokPeddakotla-MSFT 11,661 Reputation points

2021-09-29T13:16:22.813+00:00

@Richard Bailey Welcome to Microsoft Q&A forum!
Did you check this similar query already? Get Last Value of a Time Series with Azure TimeSeries Insights
I am also checking internally with our team if there is another way. Appreciate your time and patience.
Richard Bailey 21 Reputation points

2021-09-29T21:38:33.113+00:00

Yes, but if you don't know what Span to specify then you may not get the last value. A fundamental aspect of every other historian out there is the ability to interpolate start and end boundary values for a given time-range. Some data may not update for years while other data is updating every second. It looks like a large Span causes TSI to actually retrieve that whole span to find the start boundary value and so far this looks slow and potentially expensive if we're doing this type of query a lot (e.g. every minute for a lot of tags) against the cold store.
AshokPeddakotla-MSFT 11,661 Reputation points

2021-09-30T07:24:58.17+00:00

Thanks for the additional information. I will update you once I hear back from our team on this query.
AshokPeddakotla-MSFT 11,661 Reputation points

2021-10-07T08:55:26.82+00:00

@Richard Bailey Did you get a chance to see below response?
If an answer is helpful, please click on or upvote which might help other community members reading this thread.
Richard Bailey 21 Reputation points

2021-10-08T02:41:40.21+00:00

@AshokPeddakotla-MSFT Thanks for the feedback. This is disappointing. We are trying to use TSI for industrial process customers in lieu of a traditional on-premise historian. Is Microsoft targeting the industrial historian space with TSI? If so, they need to provide a minimum viable product and boundary interpolation is a big gap in that functionality. If Microsoft need input to understand how industrial historians are used and what is required from them, I'm happy to have a session with the product manager to show how they are used in the real world and what kinds of client tools and usages hang off them.

AshokPeddakotla-MSFT 11,661 Reputation points

2021-09-29T13:16:22.813+00:00

@Richard Bailey Welcome to Microsoft Q&A forum!
Did you check this similar query already? Get Last Value of a Time Series with Azure TimeSeries Insights
I am also checking internally with our team if there is another way. Appreciate your time and patience.
Richard Bailey 21 Reputation points

2021-09-29T21:38:33.113+00:00

Yes, but if you don't know what Span to specify then you may not get the last value. A fundamental aspect of every other historian out there is the ability to interpolate start and end boundary values for a given time-range. Some data may not update for years while other data is updating every second. It looks like a large Span causes TSI to actually retrieve that whole span to find the start boundary value and so far this looks slow and potentially expensive if we're doing this type of query a lot (e.g. every minute for a lot of tags) against the cold store.
AshokPeddakotla-MSFT 11,661 Reputation points

2021-09-30T07:24:58.17+00:00

Thanks for the additional information. I will update you once I hear back from our team on this query.
AshokPeddakotla-MSFT 11,661 Reputation points

2021-10-07T08:55:26.82+00:00

@Richard Bailey Did you get a chance to see below response?
If an answer is helpful, please click on or upvote which might help other community members reading this thread.
Richard Bailey 21 Reputation points

2021-10-08T02:41:40.21+00:00

@AshokPeddakotla-MSFT Thanks for the feedback. This is disappointing. We are trying to use TSI for industrial process customers in lieu of a traditional on-premise historian. Is Microsoft targeting the industrial historian space with TSI? If so, they need to provide a minimum viable product and boundary interpolation is a big gap in that functionality. If Microsoft need input to understand how industrial historians are used and what is required from them, I'm happy to have a session with the product manager to show how they are used in the real world and what kinds of client tools and usages hang off them.

Answer 1

@Richard Bailey Apologies for taking too long on this. Currently we don't support this feature.

Also, We would like to inform you that, We have shared this feedback with our Time Series Insights product team and it has been considered for feature request. Please let us know if you have any further queries.

------------------------------

Please don't forget to click on or upvote button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how

How do I get the most recent good value at a point in time from Time Series Insights?

0 additional answers

Activity