Share via

API Data Extraction Limits

Jordan Simpson 20 Reputation points
2023-11-22T13:31:04.48+00:00

Is there a limit to the amount of data that can be extracted with APIs for pageViews and customEvents? I know that Application Insights has a 30K row limit when exporting to Excel. Are there any similar limitations for APIs? Also, what are the possible options to increase or remove this limit?

Azure Monitor
Azure Monitor
An Azure service that is used to collect, analyze, and act on telemetry data from Azure and on-premises environments.
3,645 questions
0 comments
Accepted answer
  1. Grmacjon-MSFT 19,151 Reputation points Moderator
    2023-12-05T19:25:51.42+00:00

    Hi @Jordan Simpson thanks for the question.

    Yes, there are certain limitations to the amount of data that can be extracted with APIs for pageViews

    and customEvents in Application Insights.

    Here are a few to consider:

    1. The maximum daily cap for an Application Insights resource is 1,000 GB/day. This limit can be increased if you have a high-traffic application
    2. Throttling limits the data rate to 32,000 events per second, averaged over 1 minute per instrumentation key
    3. There are also limits on the number of API calls per instance. For example, ‘Get Summary’ has a limit of 50 calls per minute per subscription
      • For analytics-focused read workloads, it is recommended to configure continuous export into Azure Data Explorer. This allows you to analyze data outside the 90-day retention window.
    5. The 30K Excel row limitation is only for direct export from the portal. The APIs have no row limits when extracting data programmatically. However, watch out for memory/performance issues when retrieving huge result sets all at once into analytics tools like Power BI.

    To increase or remove these limits, you can request a higher maximum for a high-traffic application. You can set or change the daily cap for a classic Application Insights resource in the Azure portal. Here are the steps:

    1. From the Monitor menu, select Applications, your application, and then Usage and estimated costs.
    2. Select Data Cap at the top of the page.
    3. Set the data volume limit in GB/day.
    4. If you want an email sent to the subscription administrator when the daily limit is reached, then select that option.
    5. Set the daily cap warning level in percentage of the data volume limit

    Hope that helps.

    -Grace

0 additional answers

Sort by: Most helpful
Most helpful Newest Oldest

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.