ModelDeploymentPerformanceMode type

The runtime performance mode of a model deployment.
KnownModelDeploymentPerformanceMode can be used interchangeably with ModelDeploymentPerformanceMode, this enum contains the known values that the service supports.

Known values supported by the service

Balanced: A balanced trade-off between latency and throughput (default).
Latency: Optimize for low request latency.
Throughput: Optimize for high aggregate throughput.

type ModelDeploymentPerformanceMode = string