Share via


IOnlineRequestSettings Interface

Definition

[System.ComponentModel.TypeConverter(typeof(Microsoft.Azure.PowerShell.Cmdlets.MachineLearningServices.Models.Api20240401.OnlineRequestSettingsTypeConverter))]
public interface IOnlineRequestSettings : Microsoft.Azure.PowerShell.Cmdlets.MachineLearningServices.Runtime.IJsonSerializable
Derived
Attributes
Implements

Properties

MaxConcurrentRequestsPerInstance

The number of maximum concurrent requests per node allowed per deployment. Defaults to 1.

MaxQueueWait

(Deprecated for Managed Online Endpoints) The maximum amount of time a request will stay in the queue in ISO 8601 format. Defaults to 500ms. (Now increase request_timeout_ms to account for any networking/queue delays)

RequestTimeout

The scoring timeout in ISO 8601 format. Defaults to 5000ms.

Methods

Applies to