Supported metrics for Microsoft.HDInsight/clusters

The following table lists the metrics available for the Microsoft.HDInsight/clusters resource type.

Table headings

Metric - The metric display name as it appears in the Azure portal.
Name in Rest API - Metric name as referred to in the REST API.
Unit - Unit of measure.
Aggregation - The default aggregation type. Valid values: Average, Minimum, Maximum, Total, Count.
Dimensions - Dimensions available for the metric.
Time Grains - Intervals at which the metric is sampled. For example, PT1M indicates that the metric is sampled every minute, PT30M every 30 minutes, PT1H every hour, and so on.
DS Export- Whether the metric is exportable to Azure Monitor Logs via Diagnostic Settings. For information on exporting metrics, see Create diagnostic settings in Azure Monitor.

For information on metric retention, see Azure Monitor Metrics overview.

Category Metric Name in REST API Unit Aggregation Dimensions Time Grains DS Export
Availability Categorized Gateway Requests

Number of gateway requests by categories (1xx/2xx/3xx/4xx/5xx)
CategorizedGatewayRequests Count Count, Total HttpStatus PT1M, PT1H, P1D Yes
Availability Gateway Requests

Number of gateway requests
GatewayRequests Count Count, Total HttpStatus PT1M, PT1H, P1D Yes
Availability REST proxy Consumer RequestThroughput

Number of consumer requests to Kafka REST proxy
KafkaRestProxy.ConsumerRequest.m1_delta CountPerSecond Total Machine, Topic PT1M, PT1H, P1D Yes
Availability REST proxy Consumer Unsuccessful Requests

Consumer request exceptions
KafkaRestProxy.ConsumerRequestFail.m1_delta CountPerSecond Total Machine, Topic PT1M, PT1H, P1D Yes
Availability REST proxy Consumer RequestLatency

Message latency in a consumer request through Kafka REST proxy
KafkaRestProxy.ConsumerRequestTime.p95 Milliseconds Average Machine, Topic PT1M, PT1H, P1D Yes
Availability REST proxy Consumer Request Backlog

Consumer REST proxy queue length
KafkaRestProxy.ConsumerRequestWaitingInQueueTime.p95 Milliseconds Average Machine, Topic PT1M, PT1H, P1D Yes
Availability REST proxy Producer MessageThroughput

Number of producer messages through Kafka REST proxy
KafkaRestProxy.MessagesIn.m1_delta CountPerSecond Total Machine, Topic PT1M, PT1H, P1D Yes
Availability REST proxy Consumer MessageThroughput

Number of consumer messages through Kafka REST proxy
KafkaRestProxy.MessagesOut.m1_delta CountPerSecond Total Machine, Topic PT1M, PT1H, P1D Yes
Availability REST proxy ConcurrentConnections

Number of concurrent connections through Kafka REST proxy
KafkaRestProxy.OpenConnections Count Total Machine, Topic PT1M, PT1H, P1D Yes
Availability REST proxy Producer RequestThroughput

Number of producer requests to Kafka REST proxy
KafkaRestProxy.ProducerRequest.m1_delta CountPerSecond Total Machine, Topic PT1M, PT1H, P1D Yes
Availability REST proxy Producer Unsuccessful Requests

Producer request exceptions
KafkaRestProxy.ProducerRequestFail.m1_delta CountPerSecond Total Machine, Topic PT1M, PT1H, P1D Yes
Availability REST proxy Producer RequestLatency

Message latency in a producer request through Kafka REST proxy
KafkaRestProxy.ProducerRequestTime.p95 Milliseconds Average Machine, Topic PT1M, PT1H, P1D Yes
Availability REST proxy Producer Request Backlog

Producer REST proxy queue length
KafkaRestProxy.ProducerRequestWaitingInQueueTime.p95 Milliseconds Average Machine, Topic PT1M, PT1H, P1D Yes
Availability Number of Active Workers

Number of Active Workers
NumActiveWorkers Count Average, Maximum, Minimum MetricName PT1M, PT1H, P1D Yes
Availability Pending CPU

Pending CPU Requests in YARN
PendingCPU Count Average, Maximum, Minimum <none> PT1M, PT1H, P1D Yes
Availability Pending Memory

Pending Memory Requests in YARN
PendingMemory Count Average, Maximum, Minimum <none> PT1M, PT1H, P1D Yes