InferenceContainerProperties interface

model interface InferenceContainerProperties

Properties

livenessRoute

The route to check the liveness of the inference server container.

readinessRoute

The route to check the readiness of the inference server container.

scoringRoute

The port to send the scoring requests to, within the inference server container.

startupRoute

The route to check the startup of the application in the container.

Property Details

livenessRoute

The route to check the liveness of the inference server container.

livenessRoute?: Route

Property Value

readinessRoute

The route to check the readiness of the inference server container.

readinessRoute?: Route

Property Value

scoringRoute

The port to send the scoring requests to, within the inference server container.

scoringRoute?: Route

Property Value

startupRoute

The route to check the startup of the application in the container.

startupRoute?: Route

Property Value