InferenceResponse interface

Package:

@microsoft/opentelemetry

Details for recording the response from an inference call.

Properties

content	The response content produced by the model.
finishReason	Reason the model stopped generating.
inputTokens	Number of input (prompt) tokens.
outputTokens	Number of output (completion) tokens.
responseId	Unique identifier of the response.

Property Details

content

The response content produced by the model.

content: string

Property Value

string

finishReason

Reason the model stopped generating.

finishReason?: string

Property Value

string

inputTokens

Number of input (prompt) tokens.

inputTokens?: number

Property Value

number

outputTokens

Number of output (completion) tokens.

outputTokens?: number

Property Value

number

responseId

Unique identifier of the response.

responseId?: string

Property Value

string