Application Insights says it queries "terabytes of data in just seconds" - how does it do this and how can I do the same with other data using Azure?

Patrick John Lee 0 Reputation points
2023-02-28T11:51:05.83+00:00

(Previously asked in 2018 on https://social.msdn.microsoft.com/Forums/en-US/5e867a4a-e99c-4187-be5a-8850c93c482b/application-insights-says-it-queries-terabytes-of-data-in-just-seconds-how-does-it-do-this-and?forum=ApplicationInsights but I never got an answer to how to query terabytes of data in seconds).

How is this done in App Insights?

Presumably the underlying data is just stored in the App Insights log files - are these stored in Azure blog storage?

Azure Monitor
Azure Monitor
An Azure service that is used to collect, analyze, and act on telemetry data from Azure and on-premises environments.
3,037 questions
0 comments No comments
{count} votes

1 answer

Sort by: Most helpful
  1. Clive Watson 5,951 Reputation points MVP
    2023-04-28T12:42:11.6+00:00

    App Insights and Log Analytics store data in Workspaces (sort of like a Database for Logs) https://learn.microsoft.com/en-us/azure/azure-monitor/logs/log-analytics-overview#relationship-to-azure-data-explorer
    This above run on ADX (so you need to understand that platform to answer your question, but you dont have to use ADX as App insights is managed as a solution for you on top of ADX) https://azure.microsoft.com/en-gb/products/data-explorer/?ocid=AID754288&wt.mc_id=CFID0414

    0 comments No comments