InferenceCallDetails Class

Details of an inference call for generative AI operations.

Constructor

InferenceCallDetails(operationName: InferenceOperationType, model: str, providerName: str, inputTokens: int | None = None, outputTokens: int | None = None, finishReasons: list[str] | None = None, thoughtProcess: str | None = None, endpoint: ServiceEndpoint | None = None)

Parameters

Name	Description
operationName Required
model Required
providerName Required
inputTokens	Default value: None
outputTokens	Default value: None
finishReasons	Default value: None
thoughtProcess	Default value: None
endpoint	Default value: None

Attributes

endpoint

endpoint: ServiceEndpoint | None = None

finishReasons

finishReasons: list[str] | None = None

inputTokens

inputTokens: int | None = None

model

model: str

operationName

operationName: InferenceOperationType

outputTokens

outputTokens: int | None = None

providerName

providerName: str

thoughtProcess

thoughtProcess: str | None = None