Share via


InferenceResponse interface

Details for recording the response from an inference call

Properties

content

The generated response content

finishReason

Finish reason (e.g., stop, length, content_filter)

inputTokens

Number of input tokens used

outputTokens

Number of output tokens generated

responseId

Response ID from the model provider

Property Details

content

The generated response content

content: string

Property Value

string

finishReason

Finish reason (e.g., stop, length, content_filter)

finishReason?: string

Property Value

string

inputTokens

Number of input tokens used

inputTokens?: number

Property Value

number

outputTokens

Number of output tokens generated

outputTokens?: number

Property Value

number

responseId

Response ID from the model provider

responseId?: string

Property Value

string