InferenceResponse interface
Details for recording the response from an inference call
Properties
| content | The generated response content |
| finish |
Finish reason (e.g., stop, length, content_filter) |
| input |
Number of input tokens used |
| output |
Number of output tokens generated |
| response |
Response ID from the model provider |
Property Details
content
The generated response content
content: string
Property Value
string
finishReason
Finish reason (e.g., stop, length, content_filter)
finishReason?: string
Property Value
string
inputTokens
Number of input tokens used
inputTokens?: number
Property Value
number
outputTokens
Number of output tokens generated
outputTokens?: number
Property Value
number
responseId
Response ID from the model provider
responseId?: string
Property Value
string