ChatTokenLogProbabilityInfo interface

A representation of the log probability information for a single message content token.

Properties

bytes

A list of integers representing the UTF-8 bytes representation of the token. Useful in instances where characters are represented by multiple tokens and their byte representations must be combined to generate the correct text representation. Can be null if there is no bytes representation for the token.

logprob

The log probability of the message content token.

token

The message content token.

Property Details

bytes

A list of integers representing the UTF-8 bytes representation of the token. Useful in instances where characters are represented by multiple tokens and their byte representations must be combined to generate the correct text representation. Can be null if there is no bytes representation for the token.

bytes: null | number[]

Property Value

null | number[]

logprob

The log probability of the message content token.

logprob: number

Property Value

number

token

The message content token.

token: string

Property Value

string