InferenceResponse interface
Details for recording the response from an inference call.
Properties
| content | |
| finish |
|
| input |
|
| output |
|
| response |
Property Details
content
content: string
Property Value
string
finishReason
finishReason?: string
Property Value
string
inputTokens
inputTokens?: number
Property Value
number
outputTokens
outputTokens?: number
Property Value
number
responseId
responseId?: string
Property Value
string