BatchRetrySettings interface

Retry settings for a batch inference operation.

Properties

maxRetries

Maximum retry count for a mini-batch

timeout

Invocation timeout for a mini-batch, in ISO 8601 format.

Property Details

maxRetries

Maximum retry count for a mini-batch

maxRetries?: number

Property Value

number

timeout

Invocation timeout for a mini-batch, in ISO 8601 format.

timeout?: string

Property Value

string