How can I add my custom namespaces, pod names etc. to kubernetes related Azure alerts dimensions?

Question

I've been trying to create an Azure alert for one of our k8s managed clusters. The goal would be to send an alert whenever the persistent volume's usage hits the 80% threshold. I want to use the pvUsageExceededPercentage(preview) signal for this alert.

I know how to create an alert and set the necessary action group, threshold etc. but when I want to select a dimension, for example podName, under the dimension values I can't see all my pods. I'm not sure if I'm missing something and first have to bring in these values or if it's something else.

How can I make all my relevant k8s objects appear under the dimension values list?

Sorry if this has been asked before but I went through the Docs and still wasn't able to figure it out.

Answer 1

@Istvan Csaba Varga , Apologies for the delay in response.

In general, the dimension values are available only for resources which have submitted some value related to the metric. For example, if only 1 node out of 3 nodes have submitted value related to Azure Metric for pvUsageExceededPercentage only that gets listed. Therefore, the option to Include all future values is also available to consider the dimensions as they start reporting. For more details, please refer to Advanced multi-dimension features.

You can verify if the metric values have been reported for a dimension value by checking the "Metrics" page --> load the metric chart --> "Apply Splitting". For details on splitting, see Metric splitting

Hope this helps. Please let me know if you have any questions.