InferenceResponse interface

Details for recording the response from an inference call.

Property Details

content

content: string

Property Value

string

finishReason

finishReason?: string

Property Value

string

inputTokens

inputTokens?: number

Property Value

number

outputTokens

outputTokens?: number

Property Value

number

responseId

responseId?: string

Property Value

string