This browser is no longer supported.
Upgrade to Microsoft Edge to take advantage of the latest features, security updates, and technical support.
Hi there!
We run an application on AKS. Collecting k8s events to log analytics. We use Azure Managed Grafana with Azure Monitor as a source for alerting. Everyday we're getting DatasourceError alerts due to timeouts between Grafana and Azure monitor. Errors we're getting:
I don't think we cause too much load. We have about 20 alerts in total. Intervals between evaluations are 5-15 minutes. Is this expected that Azure Monitor returns timeouts/is unavailable everyday? Is there anything we can tune to make it more reliable? Thank you in advance
Hi @Heorhii Teriaiev did the provided post help resolve your issue?
Hi,
Seems like a config issue or timeout between the Grafana and Azure monitor, did you raise this query with Grafana? If not I will suggest you to put this same query with Grafana. However you can check the timeout settings for Azure Monitor APIs - https://learn.microsoft.com/en-us/azure/azure-monitor/logs/api/timeouts
Hope this helps
JS
===
Please Accept the answer if the information helped you. This will help us and others in the community as well.
Hi there,
Thank you for reply! I don't think it's a Grafana config issue though. It doesn't fail on every request, just a small part of them. And some of requests fail with 500s response codes which are error responses from server, not a timeout raised by client (Grafana in this case).
@Heorhii Teriaiev I've reached out to the team and we'll need to take this offline to better assist you. Can you please email your subscription id to AzCommunity[at]microsoft[dot]com ATTN: Ryan with a link to this post.