Language

ArmMachineLearningModelFactory.MachineLearningOnlineRequestSettings Method

Definition

Online deployment scoring requests configuration.

public static Azure.ResourceManager.MachineLearning.Models.MachineLearningOnlineRequestSettings MachineLearningOnlineRequestSettings(int? maxConcurrentRequestsPerInstance = default, TimeSpan? maxQueueWait = default, TimeSpan? requestTimeout = default);
static member MachineLearningOnlineRequestSettings : Nullable<int> * Nullable<TimeSpan> * Nullable<TimeSpan> -> Azure.ResourceManager.MachineLearning.Models.MachineLearningOnlineRequestSettings
Public Shared Function MachineLearningOnlineRequestSettings (Optional maxConcurrentRequestsPerInstance As Nullable(Of Integer) = Nothing, Optional maxQueueWait As Nullable(Of TimeSpan) = Nothing, Optional requestTimeout As Nullable(Of TimeSpan) = Nothing) As MachineLearningOnlineRequestSettings

Parameters

maxConcurrentRequestsPerInstance
Nullable<Int32>

The number of maximum concurrent requests per node allowed per deployment. Defaults to 1.

maxQueueWait
Nullable<TimeSpan>

(Deprecated for Managed Online Endpoints) The maximum amount of time a request will stay in the queue in ISO 8601 format. Defaults to 500ms. (Now increase request_timeout_ms to account for any networking/queue delays)

requestTimeout
Nullable<TimeSpan>

The scoring timeout in ISO 8601 format. Defaults to 5000ms.

Returns

A new MachineLearningOnlineRequestSettings instance for mocking.

Applies to