OnlineRequestSettings interface

Package:

@azure/arm-machinelearning

Online deployment scoring requests configuration.

Properties

maxConcurrentRequestsPerInstance	The number of maximum concurrent requests per node allowed per deployment. Defaults to 1.
maxQueueWait	(Deprecated for Managed Online Endpoints) The maximum amount of time a request will stay in the queue in ISO 8601 format. Defaults to 500ms. (Now increase request_timeout_ms to account for any networking/queue delays)
requestTimeout	The scoring timeout in ISO 8601 format. Defaults to 5000ms.

Property Details

maxConcurrentRequestsPerInstance

The number of maximum concurrent requests per node allowed per deployment. Defaults to 1.

maxConcurrentRequestsPerInstance?: number

Property Value

number

maxQueueWait

(Deprecated for Managed Online Endpoints) The maximum amount of time a request will stay in the queue in ISO 8601 format. Defaults to 500ms. (Now increase request_timeout_ms to account for any networking/queue delays)

maxQueueWait?: string

Property Value

string

requestTimeout

The scoring timeout in ISO 8601 format. Defaults to 5000ms.

requestTimeout?: string

Property Value

string