App Insights unexpectedly increased customMetrics count after addding customDimension
We are using App Insights to collect our custom metrics from our FastAPI backend app managed in AKS.
We observed that after adding customDimensions, the count of the customeMetric of that name has increased significatly. See this is the only change after I noticed the incorrect number and rolled back the change
and compare the following two screenshots, the first one is where we have customDimensions added
the next one is after we rolled back
our user traffic is pretty steady and we are certain that no other changes would affect this.
We deployed the change on May 25 and the billing has gone crazy for it
and we just rolled back yesterday to mitigate the issue