RealtimeServerEventConversationItemInputAudioTranscriptionCompleted interface

Package:

@azure/ai-projects

This event is the output of audio transcription for user audio written to the user audio buffer. Transcription begins when the input audio buffer is committed by the client or server (when VAD is enabled). Transcription runs asynchronously with Response creation, so this event may come before or after the Response events. Realtime API models accept audio natively, and thus input transcription is a separate process run on a separate ASR (Automatic Speech Recognition) model. The transcript may diverge somewhat from the model's interpretation, and should be treated as a rough guide.

Extends

RealtimeServerEvent

Properties

content_index	The index of the content part containing the audio.
event_id	The unique ID of the server event.
item_id	The ID of the item containing the audio that is being transcribed.
languages	The languages detected in the audio. Returned by gpt-transcribe. An empty array indicates that no language could be reliably detected.
logprobs	Token log probabilities for the completed input audio transcription, when available.
phrases	Phrase-level transcription timing and confidence details.
transcript	The transcribed text.
type	The event type, must be conversation.item.input_audio_transcription.completed.
usage	Usage statistics for the transcription, this is billed according to the ASR model's pricing rather than the realtime model's pricing.

Property Details

content_index

The index of the content part containing the audio.

content_index: number

Property Value

number

event_id

The unique ID of the server event.

event_id: string

Property Value

string

item_id

The ID of the item containing the audio that is being transcribed.

item_id: string

Property Value

string

languages

The languages detected in the audio. Returned by gpt-transcribe. An empty array indicates that no language could be reliably detected.

languages?: TranscriptionLanguage[]

Property Value

TranscriptionLanguage[]

logprobs

Token log probabilities for the completed input audio transcription, when available.

logprobs?: LogProbProperties[]

Property Value

LogProbProperties[]

phrases

Phrase-level transcription timing and confidence details.

phrases?: VoiceAgentTranscriptionPhrase[]

Property Value

VoiceAgentTranscriptionPhrase[]

transcript

The transcribed text.

transcript: string

Property Value

string

type

The event type, must be conversation.item.input_audio_transcription.completed.

type: "conversation.item.input_audio_transcription.completed"

Property Value

"conversation.item.input_audio_transcription.completed"

usage

Usage statistics for the transcription, this is billed according to the ASR model's pricing rather than the realtime model's pricing.

usage: TranscriptTextUsageTokens | TranscriptTextUsageDuration

Property Value

TranscriptTextUsageTokens | TranscriptTextUsageDuration