Note
Access to this page requires authorization. You can try signing in or changing directories.
Access to this page requires authorization. You can try changing directories.
The following table lists the metrics available for the Microsoft.MachineLearningServices/workspaces/onlineEndpoints/deployments resource type.
Table headings
- Metric - The metric display name as it appears in the Azure portal.
- Name in Rest API - Metric name as referred to in the REST API.
- Advanced platform metrics - A premium, paid tier of platform metrics in Azure Monitor that provide more granular observability for Azure resources.
- Unit - Unit of measure.
- Aggregation - The default aggregation type. Valid values: Average, Minimum, Maximum, Total, Count.
- Dimensions - Dimensions available for the metric.
- Time Grains - Intervals at which the metric is sampled. For example,
PT1Mindicates that the metric is sampled every minute,PT30Mevery 30 minutes,PT1Hevery hour, and so on. - DS Export -S Whether the metric is exportable to Azure Monitor Logs via Diagnostic Settings.
For information on exporting metrics, see - Metrics export using data collection rules and Create diagnostic settings in Azure Monitor.
For information on metric retention, see Azure Monitor Metrics overview.
Category: Resource
| Metric | Name in REST API | Advanced platform metrics | Unit | Aggregation | Dimensions | Time Grains | DS Export |
|---|---|---|---|---|---|---|---|
| CPU Memory Utilization Percentage Percentage of memory utilization on an instance. Utilization is reported at one minute intervals. |
CpuMemoryUtilizationPercentage |
No | Percent | Minimum, Maximum, Average | instanceId |
PT1M | Yes |
| CPU Utilization Percentage Percentage of CPU utilization on an instance. Utilization is reported at one minute intervals. |
CpuUtilizationPercentage |
No | Percent | Minimum, Maximum, Average | instanceId |
PT1M | Yes |
| Data Collection Errors Per Minute The number of data collection events dropped per minute. |
DataCollectionErrorsPerMinute |
No | Count | Minimum, Maximum, Average | instanceId, reason, type |
PT1M | No |
| Data Collection Events Per Minute The number of data collection events processed per minute. |
DataCollectionEventsPerMinute |
No | Count | Minimum, Maximum, Average | instanceId, type |
PT1M | No |
| Deployment Capacity The number of instances in the deployment. |
DeploymentCapacity |
No | Count | Minimum, Maximum, Average | instanceId, State |
PT1M | No |
| Disk Utilization Percentage of disk utilization on an instance. Utilization is reported at one minute intervals. |
DiskUtilization |
No | Percent | Minimum, Maximum, Average | instanceId, disk |
PT1M | Yes |
| GPU Energy in Joules Interval energy in Joules on a GPU node. Energy is reported at one minute intervals. |
GpuEnergyJoules |
No | Count | Minimum, Maximum, Average | instanceId |
PT1M | No |
| GPU Memory Utilization Percentage Percentage of GPU memory utilization on an instance. Utilization is reported at one minute intervals. |
GpuMemoryUtilizationPercentage |
No | Percent | Minimum, Maximum, Average | instanceId |
PT1M | Yes |
| GPU Utilization Percentage Percentage of GPU utilization on an instance. Utilization is reported at one minute intervals. |
GpuUtilizationPercentage |
No | Percent | Minimum, Maximum, Average | instanceId |
PT1M | Yes |
Category: Traffic
| Metric | Name in REST API | Advanced platform metrics | Unit | Aggregation | Dimensions | Time Grains | DS Export |
|---|---|---|---|---|---|---|---|
| Request Latency P50 The average P50 request latency aggregated by all request latency values collected over the selected time period |
RequestLatency_P50 |
No | Milliseconds | Average | <none> | PT1M | Yes |
| Request Latency P90 The average P90 request latency aggregated by all request latency values collected over the selected time period |
RequestLatency_P90 |
No | Milliseconds | Average | <none> | PT1M | Yes |
| Request Latency P95 The average P95 request latency aggregated by all request latency values collected over the selected time period |
RequestLatency_P95 |
No | Milliseconds | Average | <none> | PT1M | Yes |
| Request Latency P99 The average P99 request latency aggregated by all request latency values collected over the selected time period |
RequestLatency_P99 |
No | Milliseconds | Average | <none> | PT1M | Yes |
| Requests Per Minute The number of requests sent to online deployment within a minute |
RequestsPerMinute |
No | Count | Average | envoy_response_code |
PT1M | No |