App Insights unexpectedly increased customMetrics count after addding customDimension

Steven Leng 5 Reputation points
2024-06-06T03:04:50.76+00:00

We are using App Insights to collect our custom metrics from our FastAPI backend app managed in AKS.

We observed that after adding customDimensions, the count of the customeMetric of that name has increased significatly. See this is the only change after I noticed the incorrect number and rolled back the changeUser's image

and compare the following two screenshots, the first one is where we have customDimensions added User's image

the next one is after we rolled back
User's image

our user traffic is pretty steady and we are certain that no other changes would affect this.

We deployed the change on May 25 and the billing has gone crazy for it User's image

and we just rolled back yesterday to mitigate the issue

Azure Kubernetes Service (AKS)
Azure Kubernetes Service (AKS)
An Azure service that provides serverless Kubernetes, an integrated continuous integration and continuous delivery experience, and enterprise-grade security and governance.
1,931 questions
{count} votes