InferenceDetails interface

Package:

@microsoft/opentelemetry

Details for an inference call.

Properties

endpoint
finishReasons
inputTokens
model
operationName
outputTokens
providerName
thoughtProcess

Property Details

endpoint

endpoint?: ServiceEndpoint

Property Value

ServiceEndpoint

finishReasons

finishReasons?: string[]

Property Value

string[]

inputTokens

inputTokens?: number

Property Value

number

model

model: string

Property Value

string

operationName

operationName: InferenceOperationType

Property Value

InferenceOperationType

outputTokens

outputTokens?: number

Property Value

number

providerName

providerName?: string

Property Value

string

thoughtProcess

thoughtProcess?: string

Property Value

string