Azure managed prometheus remote_write

Question

Hi there,

I am currently using the Prometheus-stack on my AKS cluster and it is working great. For instance, I am able to use rabbitmq-exporter and view 10991 and 763 grafana dashboards (rabbitmq dashboards).

Now, I would like to work with Azure Managed Prometheus and Grafana. I have created a monitoring workspace and managed Grafana as needed, and it is working fine and showing me initial metrics about my cluster.

I would like to add my application data to this Prometheus and remote_write my Prometheus to Azure Managed Prometheus. To do this, I followed the step-by-step guide from this tutorial: https://learn.microsoft.com/en-us/azure/azure-monitor/essentials/prometheus-remote-write#verify-remote-write-is-working-correctly. I checked my sidecar container (prom-rermotewrite) and the logs look fine, as described here: https://learn.microsoft.com/en-us/azure/azure-monitor/essentials/prometheus-remote-write#verify-remote-write-is-working-correctly.

However, when I try to add 10991 and 763 dashboards to my Azure Managed Grafana, it does not show the rabbitmq data. What could be the problem? Do I need to configure Azure Managed Prometheus scraping configuration or something?

I don't know how to proceed from here, I would appreciate help

Thanks

Answer 1

Hi @yd7474 ,

Glad to know that it works and thank you for reporting it. This might help others experiencing the same. Since Microsoft Q&A community has a policy that "Author of the question cannot accept their own answer. They can only accept answers by others" so I will repost your response in case you would like to "Accept" the answer.

Issue:

• You are currently using the Prometheus-stack on AKS cluster and it is working. For instance, you were able to use rabbitmq-exporter and view 10991 and 763 grafana dashboards (rabbitmq dashboards).
• You wanted to work with Azure Managed Prometheus and Grafana and so created a monitoring workspace and managed Grafana as needed, it was working fine and showing initial metrics about cluster.
• The requirement was to add application data to this Prometheus and remote_write Prometheus to Azure Managed Prometheus. To do this, you have followed the step-by-step guide from this tutorial. On checking sidecar container (prom-rermotewrite), the logs look fine as described here.
• However, when tried to add 10991 and 763 dashboards to Azure Managed Grafana, it does not show the rabbitmq data!

Solution:

• Just had to wait for some time for it to show the rabbitmq data.

However, you have reported that you encounter indentation problems with the YAML file provided in this tutorial. Please elaborate and raise a document enhancement feedback by clicking on "This page" button under the Feedback section here so that a GitHub issue will be created and document would be enhanced appropriately. For illustration, adding a screenshot of the Feedback section below.