Get insights from Telemetry data

Rushank 1 Reputation point


I am trying to get all my telemetry data into PowerBI.

1) So i am using application insights to capture telemetry data and then storing this data into azure blob storage ( because application insights only allow for limited time storage).
Then i am using PowerBi azure storage connector to PowerBI.

2) The problem is data is way too big(eg 100 gb of data in last 2 weeks and increasing). PowerBi refresh cant handle this much data. I even tried to reduce the rows and columns applying all the best practices. But the data is too large.

Current data infrastructure

Application insight -> Azure storage -> PowerBI
What tool/method i should use

  1. Direct query
  2. Azure data explorer
  3. Any other tool/method

The final data insight/dashboard should be in PowerBI

Thank you and have a ncie day !

Rushank Patil

Azure Data Explorer
Azure Data Explorer
An Azure data analytics service for real-time analysis on large volumes of data streaming from sources including applications, websites, and internet of things devices.
507 questions
Azure Stream Analytics
Azure Stream Analytics
An Azure real-time analytics service designed for mission-critical workloads.
343 questions
0 comments No comments
{count} votes

1 answer

Sort by: Most helpful
  1. Maxim Sergeev 6,566 Reputation points Microsoft Employee

    Hi there,

    Application Insights integrated with Log Analytics could store data up to 730 days. In most cases it's more than enough, no?

    It's not a cheapest solution but most easily to maintain and configure for PowerBI

    0 comments No comments