Edit

Supported metrics for Microsoft.MachineLearningServices/workspaces

The following table lists the metrics available for the Microsoft.MachineLearningServices/workspaces resource type.

Table headings

  • Metric - The metric display name as it appears in the Azure portal.
  • Name in Rest API - Metric name as referred to in the REST API.
  • Advanced platform metrics - A premium, paid tier of platform metrics in Azure Monitor that provide more granular observability for Azure resources.
  • Unit - Unit of measure.
  • Aggregation - The default aggregation type. Valid values: Average, Minimum, Maximum, Total, Count.
  • Dimensions - Dimensions available for the metric.
  • Time Grains - Intervals at which the metric is sampled. For example, PT1M indicates that the metric is sampled every minute, PT30M every 30 minutes, PT1H every hour, and so on.
  • DS Export -S Whether the metric is exportable to Azure Monitor Logs via Diagnostic Settings.

For information on exporting metrics, see - Metrics export using data collection rules and Create diagnostic settings in Azure Monitor.

For information on metric retention, see Azure Monitor Metrics overview.

For a list of supported logs, see Supported log categories - Microsoft.MachineLearningServices/workspaces

Category: Agents

Metric Name in REST API Advanced platform metrics Unit Aggregation Dimensions Time Grains DS Export
Agents

Number of events for AI Agents in this workspace
Agents No Count Average, Maximum, Minimum, Total (Sum) EventType PT1M No
IndexedFiles

Number of files indexed for file search in this workspace
IndexedFiles No Count Average, Maximum, Minimum, Total (Sum) ErrorCode, Status, VectorStoreId PT1M No
Messages

Number of events for AI Agent messages in this workspace
Messages No Count Average, Maximum, Minimum, Total (Sum) EventType, ThreadId PT1M No
Runs

Number of runs by AI Agents in this workspace
Runs No Count Average, Maximum, Minimum, Total (Sum) AgentId, RunStatus, StatusCode, StreamType PT1M No
Threads

Number of events for AI Agent threads in this workspace
Threads No Count Average, Maximum, Minimum, Total (Sum) EventType PT1M No
Tokens

Count of tokens by AI Agents in this workspace
Tokens No Count Average, Maximum, Minimum, Total (Sum) AgentId, TokenType PT1M No
ToolCalls

Tool calls made by AI Agents in this workspace
ToolCalls No Count Average, Maximum, Minimum, Total (Sum) AgentId, ToolName PT1M No

Category: Model

Metric Name in REST API Advanced platform metrics Unit Aggregation Dimensions Time Grains DS Export
Model Deploy Failed

Number of model deployments that failed in this workspace
Model Deploy Failed No Count Total (Sum), Average, Minimum, Maximum, Count Scenario, StatusCode PT1M Yes
Model Deploy Started

Number of model deployments started in this workspace
Model Deploy Started No Count Total (Sum), Average, Minimum, Maximum, Count Scenario PT1M Yes
Model Deploy Succeeded

Number of model deployments that succeeded in this workspace
Model Deploy Succeeded No Count Total (Sum), Average, Minimum, Maximum, Count Scenario PT1M Yes
Model Register Failed

Number of model registrations that failed in this workspace
Model Register Failed No Count Total (Sum), Average, Minimum, Maximum, Count Scenario, StatusCode PT1M Yes
Model Register Succeeded

Number of model registrations that succeeded in this workspace
Model Register Succeeded No Count Total (Sum), Average, Minimum, Maximum, Count Scenario PT1M Yes

Category: Quota

Metric Name in REST API Advanced platform metrics Unit Aggregation Dimensions Time Grains DS Export
Active Cores

Number of active cores
Active Cores No Count Average, Maximum, Minimum, Total (Sum) Scenario, ClusterName PT1M Yes
Active Nodes

Number of Acitve nodes. These are the nodes which are actively running a job.
Active Nodes No Count Average, Maximum, Minimum, Total (Sum) Scenario, ClusterName PT1M Yes
Idle Cores

Number of idle cores
Idle Cores No Count Average, Maximum, Minimum, Total (Sum) Scenario, ClusterName PT1M Yes
Idle Nodes

Number of idle nodes. Idle nodes are the nodes which are not running any jobs but can accept new job if available.
Idle Nodes No Count Average, Maximum, Minimum, Total (Sum) Scenario, ClusterName PT1M Yes
Leaving Cores

Number of leaving cores
Leaving Cores No Count Average, Maximum, Minimum, Total (Sum) Scenario, ClusterName PT1M Yes
Leaving Nodes

Number of leaving nodes. Leaving nodes are the nodes which just finished processing a job and will go to Idle state.
Leaving Nodes No Count Average, Maximum, Minimum, Total (Sum) Scenario, ClusterName PT1M Yes
Preempted Cores

Number of preempted cores
Preempted Cores No Count Average, Maximum, Minimum, Total (Sum) Scenario, ClusterName PT1M Yes
Preempted Nodes

Number of preempted nodes. These nodes are the low priority nodes which are taken away from the available node pool.
Preempted Nodes No Count Average, Maximum, Minimum, Total (Sum) Scenario, ClusterName PT1M Yes
Quota Utilization Percentage

Percent of quota utilized
Quota Utilization Percentage No Count Average, Maximum, Minimum, Total (Sum) Scenario, ClusterName, VmFamilyName, VmPriority PT1M Yes
Total Cores

Number of total cores
Total Cores No Count Average, Maximum, Minimum, Total (Sum) Scenario, ClusterName PT1M Yes
Total Nodes

Number of total nodes. This total includes some of Active Nodes, Idle Nodes, Unusable Nodes, Premepted Nodes, Leaving Nodes
Total Nodes No Count Average, Maximum, Minimum, Total (Sum) Scenario, ClusterName PT1M Yes
Unusable Cores

Number of unusable cores
Unusable Cores No Count Average, Maximum, Minimum, Total (Sum) Scenario, ClusterName PT1M Yes
Unusable Nodes

Number of unusable nodes. Unusable nodes are not functional due to some unresolvable issue. Azure will recycle these nodes.
Unusable Nodes No Count Average, Maximum, Minimum, Total (Sum) Scenario, ClusterName PT1M Yes

Category: Resource

Metric Name in REST API Advanced platform metrics Unit Aggregation Dimensions Time Grains DS Export
CpuCapacityMillicores

Maximum capacity of a CPU node in millicores. Capacity is aggregated in one minute intervals.
CpuCapacityMillicores No Count Average, Maximum, Minimum, Total (Sum) RunId, InstanceId, ComputeName PT1M Yes
CpuMemoryCapacityMegabytes

Maximum memory utilization of a CPU node in megabytes. Utilization is aggregated in one minute intervals.
CpuMemoryCapacityMegabytes No Count Average, Maximum, Minimum, Total (Sum) RunId, InstanceId, ComputeName PT1M Yes
CpuMemoryUtilizationMegabytes

Memory utilization of a CPU node in megabytes. Utilization is aggregated in one minute intervals.
CpuMemoryUtilizationMegabytes No Count Average, Maximum, Minimum, Total (Sum) RunId, InstanceId, ComputeName PT1M Yes
CpuMemoryUtilizationPercentage

Memory utilization percentage of a CPU node. Utilization is aggregated in one minute intervals.
CpuMemoryUtilizationPercentage No Count Average, Maximum, Minimum, Total (Sum) RunId, InstanceId, ComputeName PT1M Yes
CpuUtilization

Percentage of utilization on a CPU node. Utilization is reported at one minute intervals.
CpuUtilization No Count Average, Maximum, Minimum, Total (Sum) Scenario, runId, NodeId, ClusterName PT1M Yes
CpuUtilizationMillicores

Utilization of a CPU node in millicores. Utilization is aggregated in one minute intervals.
CpuUtilizationMillicores No Count Average, Maximum, Minimum, Total (Sum) RunId, InstanceId, ComputeName PT1M Yes
CpuUtilizationPercentage

Utilization percentage of a CPU node. Utilization is aggregated in one minute intervals.
CpuUtilizationPercentage No Count Average, Maximum, Minimum, Total (Sum) RunId, InstanceId, ComputeName PT1M Yes
DiskAvailMegabytes

Available disk space in megabytes. Metrics are aggregated in one minute intervals.
DiskAvailMegabytes No Count Average, Maximum, Minimum, Total (Sum) RunId, InstanceId, ComputeName PT1M Yes
DiskReadMegabytes

Data read from disk in megabytes. Metrics are aggregated in one minute intervals.
DiskReadMegabytes No Count Average, Maximum, Minimum, Total (Sum) RunId, InstanceId, ComputeName PT1M Yes
DiskUsedMegabytes

Used disk space in megabytes. Metrics are aggregated in one minute intervals.
DiskUsedMegabytes No Count Average, Maximum, Minimum, Total (Sum) RunId, InstanceId, ComputeName PT1M Yes
DiskWriteMegabytes

Data written into disk in megabytes. Metrics are aggregated in one minute intervals.
DiskWriteMegabytes No Count Average, Maximum, Minimum, Total (Sum) RunId, InstanceId, ComputeName PT1M Yes
GpuCapacityMilliGPUs

Maximum capacity of a GPU device in milli-GPUs. Capacity is aggregated in one minute intervals.
GpuCapacityMilliGPUs No Count Average, Maximum, Minimum, Total (Sum) RunId, InstanceId, DeviceId, ComputeName PT1M Yes
GpuEnergyJoules

Interval energy in Joules on a GPU node. Energy is reported at one minute intervals.
GpuEnergyJoules No Count Average, Maximum, Minimum, Total (Sum) Scenario, runId, rootRunId, InstanceId, DeviceId, ComputeName PT1M Yes
GpuMemoryCapacityMegabytes

Maximum memory capacity of a GPU device in megabytes. Capacity aggregated in at one minute intervals.
GpuMemoryCapacityMegabytes No Count Average, Maximum, Minimum, Total (Sum) RunId, InstanceId, DeviceId, ComputeName PT1M Yes
GpuMemoryUtilization

Percentage of memory utilization on a GPU node. Utilization is reported at one minute intervals.
GpuMemoryUtilization No Count Average, Maximum, Minimum, Total (Sum) Scenario, runId, NodeId, DeviceId, ClusterName PT1M Yes
GpuMemoryUtilizationMegabytes

Memory utilization of a GPU device in megabytes. Utilization aggregated in at one minute intervals.
GpuMemoryUtilizationMegabytes No Count Average, Maximum, Minimum, Total (Sum) RunId, InstanceId, DeviceId, ComputeName PT1M Yes
GpuMemoryUtilizationPercentage

Memory utilization percentage of a GPU device. Utilization aggregated in at one minute intervals.
GpuMemoryUtilizationPercentage No Count Average, Maximum, Minimum, Total (Sum) RunId, InstanceId, DeviceId, ComputeName PT1M Yes
GpuUtilization

Percentage of utilization on a GPU node. Utilization is reported at one minute intervals.
GpuUtilization No Count Average, Maximum, Minimum, Total (Sum) Scenario, runId, NodeId, DeviceId, ClusterName PT1M Yes
GpuUtilizationMilliGPUs

Utilization of a GPU device in milli-GPUs. Utilization is aggregated in one minute intervals.
GpuUtilizationMilliGPUs No Count Average, Maximum, Minimum, Total (Sum) RunId, InstanceId, DeviceId, ComputeName PT1M Yes
GpuUtilizationPercentage

Utilization percentage of a GPU device. Utilization is aggregated in one minute intervals.
GpuUtilizationPercentage No Count Average, Maximum, Minimum, Total (Sum) RunId, InstanceId, DeviceId, ComputeName PT1M Yes
IBReceiveMegabytes

Network data received over InfiniBand in megabytes. Metrics are aggregated in one minute intervals.
IBReceiveMegabytes No Count Average, Maximum, Minimum, Total (Sum) RunId, InstanceId, ComputeName, DeviceId PT1M Yes
IBTransmitMegabytes

Network data sent over InfiniBand in megabytes. Metrics are aggregated in one minute intervals.
IBTransmitMegabytes No Count Average, Maximum, Minimum, Total (Sum) RunId, InstanceId, ComputeName, DeviceId PT1M Yes
NetworkInputMegabytes

Network data received in megabytes. Metrics are aggregated in one minute intervals.
NetworkInputMegabytes No Count Average, Maximum, Minimum, Total (Sum) RunId, InstanceId, ComputeName, DeviceId PT1M Yes
NetworkOutputMegabytes

Network data sent in megabytes. Metrics are aggregated in one minute intervals.
NetworkOutputMegabytes No Count Average, Maximum, Minimum, Total (Sum) RunId, InstanceId, ComputeName, DeviceId PT1M Yes
StorageAPIFailureCount

Azure Blob Storage API calls failure count.
StorageAPIFailureCount No Count Average, Maximum, Minimum, Total (Sum) RunId, InstanceId, ComputeName PT1M Yes
StorageAPISuccessCount

Azure Blob Storage API calls success count.
StorageAPISuccessCount No Count Average, Maximum, Minimum, Total (Sum) RunId, InstanceId, ComputeName PT1M Yes

Category: Run

Metric Name in REST API Advanced platform metrics Unit Aggregation Dimensions Time Grains DS Export
Cancel Requested Runs

Number of runs where cancel was requested for this workspace. Count is updated when cancellation request has been received for a run.
Cancel Requested Runs No Count Total (Sum), Average, Minimum, Maximum, Count Scenario, RunType, PublishedPipelineId, ComputeType, PipelineStepType, ExperimentName PT1M Yes
Cancelled Runs

Number of runs cancelled for this workspace. Count is updated when a run is successfully cancelled.
Cancelled Runs No Count Total (Sum), Average, Minimum, Maximum, Count Scenario, RunType, PublishedPipelineId, ComputeType, PipelineStepType, ExperimentName PT1M Yes
Completed Runs

Number of runs completed successfully for this workspace. Count is updated when a run has completed and output has been collected.
Completed Runs No Count Total (Sum), Average, Minimum, Maximum, Count Scenario, RunType, PublishedPipelineId, ComputeType, PipelineStepType, ExperimentName PT1M Yes
Errors

Number of run errors in this workspace. Count is updated whenever run encounters an error.
Errors No Count Total (Sum), Average, Minimum, Maximum, Count Scenario PT1M Yes
Failed Runs

Number of runs failed for this workspace. Count is updated when a run fails.
Failed Runs No Count Total (Sum), Average, Minimum, Maximum, Count Scenario, RunType, PublishedPipelineId, ComputeType, PipelineStepType, ExperimentName PT1M Yes
Finalizing Runs

Number of runs entered finalizing state for this workspace. Count is updated when a run has completed but output collection still in progress.
Finalizing Runs No Count Total (Sum), Average, Minimum, Maximum, Count Scenario, RunType, PublishedPipelineId, ComputeType, PipelineStepType, ExperimentName PT1M Yes
Not Responding Runs

Number of runs not responding for this workspace. Count is updated when a run enters Not Responding state.
Not Responding Runs No Count Total (Sum), Average, Minimum, Maximum, Count Scenario, RunType, PublishedPipelineId, ComputeType, PipelineStepType, ExperimentName PT1M Yes
Not Started Runs

Number of runs in Not Started state for this workspace. Count is updated when a request is received to create a run but run information has not yet been populated.
Not Started Runs No Count Total (Sum), Average, Minimum, Maximum, Count Scenario, RunType, PublishedPipelineId, ComputeType, PipelineStepType, ExperimentName PT1M Yes
Preparing Runs

Number of runs that are preparing for this workspace. Count is updated when a run enters Preparing state while the run environment is being prepared.
Preparing Runs No Count Total (Sum), Average, Minimum, Maximum, Count Scenario, RunType, PublishedPipelineId, ComputeType, PipelineStepType, ExperimentName PT1M Yes
Provisioning Runs

Number of runs that are provisioning for this workspace. Count is updated when a run is waiting on compute target creation or provisioning.
Provisioning Runs No Count Total (Sum), Average, Minimum, Maximum, Count Scenario, RunType, PublishedPipelineId, ComputeType, PipelineStepType, ExperimentName PT1M Yes
Queued Runs

Number of runs that are queued for this workspace. Count is updated when a run is queued in compute target. Can occure when waiting for required compute nodes to be ready.
Queued Runs No Count Total (Sum), Average, Minimum, Maximum, Count Scenario, RunType, PublishedPipelineId, ComputeType, PipelineStepType, ExperimentName PT1M Yes
Started Runs

Number of runs running for this workspace. Count is updated when run starts running on required resources.
Started Runs No Count Total (Sum), Average, Minimum, Maximum, Count Scenario, RunType, PublishedPipelineId, ComputeType, PipelineStepType, ExperimentName PT1M Yes
Starting Runs

Number of runs started for this workspace. Count is updated after request to create run and run info, such as the Run Id, has been populated
Starting Runs No Count Total (Sum), Average, Minimum, Maximum, Count Scenario, RunType, PublishedPipelineId, ComputeType, PipelineStepType, ExperimentName PT1M Yes
Warnings

Number of run warnings in this workspace. Count is updated whenever a run encounters a warning.
Warnings No Count Total (Sum), Average, Minimum, Maximum, Count Scenario PT1M Yes

Next steps