InferenceDetails interface

Package:

@microsoft/opentelemetry

Details for an inference call.

Properties

endpoint	Endpoint the model is hosted on.
finishReasons	Finish reasons returned by the model.
inputTokens	Number of input (prompt) tokens.
model	Name of the model used for inference.
operationName	The inference operation type (e.g. chat, text completion).
outputTokens	Number of output (completion) tokens.
providerName	Name of the provider serving the model.
thoughtProcess	The model's thought process / reasoning trace.

Property Details

endpoint

Endpoint the model is hosted on.

endpoint?: ServiceEndpoint

Property Value

ServiceEndpoint

finishReasons

Finish reasons returned by the model.

finishReasons?: string[]

Property Value

string[]

inputTokens

Number of input (prompt) tokens.

inputTokens?: number

Property Value

number

model

Name of the model used for inference.

model: string

Property Value

string

operationName

The inference operation type (e.g. chat, text completion).

operationName: InferenceOperationType

Property Value

InferenceOperationType

outputTokens

Number of output (completion) tokens.

outputTokens?: number

Property Value

number

providerName

Name of the provider serving the model.

providerName?: string

Property Value

string

thoughtProcess

The model's thought process / reasoning trace.

thoughtProcess?: string

Property Value

string