[Grafana-AzureMonitor] Query failed to execute because hinting request has failed

Rushikesh Gaidhani 161 Reputation points
2023-12-29T22:58:21.6466667+00:00

I am running Grafana OSS v10.0.0 (81d85ce802) with Azure Monitor data source. I am trying to visualize SQL databases metrics from a resource group but, the query is failing with the following error message,

errorMessage:"Query failed to execute because hinting request has failed. Requested Metric:MicrosoftSqlShoeboxsouthcentralus|MicrosoftSql|cpu_percent. Output Dimensions: microsoft.resourceid. Dimension Filters: microsoft.resourceGroupName,microsoft.resourceId,microsoft.resourceType,microsoft.subscriptionId,ResourceId. RequestedSamplingType: Sum. Start time: 11/20/2023 6:28:03 PM End time: 12/20/2023 6:27:03 PM. Resolution: 00:30:00, Last Value Mode: False. Context:MetricsMP, CustomerId:Unknown. TraceID:{aaa-bbbb-bbb-bbb};AzSubId=999-999-999-99;AzResType=microsoft.sql/servers/databases;AzRegion=southcentralus;, IsUserQuery:1, ClientTimeout:00:01:40, ClientName:GatewayService-API->QueryServiceCoordinator, ElapsedTime(ms):18, Exception:System.ServiceModel.FaultException`1[Microsoft.Online.Hinting.Contracts.HintsRetrievalFault]: Number of filter values for dimension exceeds max allowed value.Dimension:microsoft.resourceid,Filter count:5102,Max allowed value:4000 (Fault Detail is equal to Microsoft.Online.Hinting.Contracts.HintsRetrievalFault)…

How do I increase the 4000 limit?

Not Monitored
Not Monitored
Tag not monitored by Microsoft.
42,087 questions
0 comments No comments
{count} votes

2 answers

Sort by: Most helpful
  1. Konstantinos Passadis 19,386 Reputation points MVP
    2023-12-30T00:52:30.03+00:00

    Hello @Rushikesh Gaidhani !

    I understand your issue is hitting a Limit

    The limit cannot change

    But you can narrow down the resources . Since you are interested only in SQL Dbs

    In the "Resource Type" field, select the appropriate type for SQL databases only

    This way it wont iterate through ALL resources in the Resource Group but it will find only th type you seected in our case Microsoft SQL


    I hope this helps!

    Kindly mark the answer as Accepted and Upvote in case it helped!

    Regards


  2. Konstantinos Passadis 19,386 Reputation points MVP
    2024-01-02T20:17:06.95+00:00

    Hello @Rushikesh Gaidhani !

    Thats the limit ~ There is a comment there :

    Tip

    If you want the capability to view the metrics for multiple resources at the same time, or to view metrics across a subscription or resource group, select Upvote.

    So either you aggregate metrics at a higher level (like resource group or subscription level), or create multiple DashBoards :

    you can implement a strategy using multiple dashboards:

    • Segmentation by Resource Type or Group: Divide your resources into logical groups based on type, function, or criticality. For example, one dashboard could monitor all virtual machines, while another focuses on databases.
      
    • Use of Templating: Utilize Grafana's templating features to create dynamic dashboards. This way, a single dashboard can display data from different resources based on user selection or predefined criteria.
      
    • Balancing Load Across Dashboards: Distribute the resources evenly across these dashboards, ensuring each monitors a different subset and stays within the 50 resources limit.
      
    • Cross-Dashboard Navigation: Implement links or navigation between dashboards for easy access and holistic view.
      
    • Central Overview Dashboard: Consider creating an overview dashboard that provides high-level metrics from each group, with links to detailed dashboards for in-depth analysis.
      

    Contact also Azure Support and raise a ticket. No matter the outcome you will get a first hand view of things to come !!! :)


    I hope this helps!

    Kindly mark the answer as Accepted and Upvote in case it helped!

    Regards


Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.