Share via

IOnlineRequestSettings Interface

  • Reference

Definition

Namespace:
Microsoft.Azure.PowerShell.Cmdlets.MachineLearningServices.Models.Api20240401
Assembly:
Az.MachineLearningServices.private.dll
[System.ComponentModel.TypeConverter(typeof(Microsoft.Azure.PowerShell.Cmdlets.MachineLearningServices.Models.Api20240401.OnlineRequestSettingsTypeConverter))]
public interface IOnlineRequestSettings : Microsoft.Azure.PowerShell.Cmdlets.MachineLearningServices.Runtime.IJsonSerializable
[<System.ComponentModel.TypeConverter(typeof(Microsoft.Azure.PowerShell.Cmdlets.MachineLearningServices.Models.Api20240401.OnlineRequestSettingsTypeConverter))>]
type IOnlineRequestSettings = interface
    interface IJsonSerializable
Public Interface IOnlineRequestSettings
Implements IJsonSerializable
Derived
Attributes
TypeConverterAttribute
Implements
IJsonSerializable

Properties

MaxConcurrentRequestsPerInstance

The number of maximum concurrent requests per node allowed per deployment. Defaults to 1.
MaxQueueWait

(Deprecated for Managed Online Endpoints) The maximum amount of time a request will stay in the queue in ISO 8601 format. Defaults to 500ms. (Now increase request_timeout_ms to account for any networking/queue delays)
RequestTimeout

The scoring timeout in ISO 8601 format. Defaults to 5000ms.

Methods

ToJson(JsonObject, SerializationMode) (Inherited from IJsonSerializable)

Applies to