ModelDeploymentPerformanceMode type
The runtime performance mode of a model deployment.
KnownModelDeploymentPerformanceMode can be used interchangeably with ModelDeploymentPerformanceMode,
this enum contains the known values that the service supports.
Known values supported by the service
Balanced: A balanced trade-off between latency and throughput (default).
Latency: Optimize for low request latency.
Throughput: Optimize for high aggregate throughput.
type ModelDeploymentPerformanceMode = string