VoiceAgentInputTranscription interface

Package:

@azure/ai-projects

Asynchronous input-audio transcription configuration. Extends the OpenAI Realtime transcription options with the Azure and MAI transcription models, custom speech models, and phrase hints.

Properties

custom_speech	Optional customer custom speech deployment configuration, keyed by locale.
delay	Controls how long the model waits before emitting transcription text. Higher values can improve transcription accuracy at the cost of latency. Only supported with gpt-realtime-whisper in GA Realtime sessions.
keywords	Words or phrases to guide transcription of the input audio. Supported by gpt-transcribe and gpt-live-transcribe.
language	The language of the input audio. Supplying the input language in ISO-639-1 (e.g. en) format will improve accuracy and latency.
languages	Possible languages of the input audio, in ISO-639-1 format. Supported by gpt-transcribe and gpt-live-transcribe.
model	The transcription model identifier. Configure customer custom speech deployments in custom_speech.
phrase_list	Optional phrase hints that bias recognition toward domain terms.
prompt	An optional text to guide the model's style or continue a previous audio segment. For whisper-1, the prompt is a list of keywords. For gpt-4o-transcribe models (excluding gpt-4o-transcribe-diarize), the prompt is a free text string, for example "expect words related to technology". Prompt is not supported with gpt-realtime-whisper in GA Realtime sessions.

Property Details

custom_speech

Optional customer custom speech deployment configuration, keyed by locale.

custom_speech?: Record<string, string>

Property Value

Record<string, string>

delay

Controls how long the model waits before emitting transcription text. Higher values can improve transcription accuracy at the cost of latency. Only supported with gpt-realtime-whisper in GA Realtime sessions.

delay?: "low" | "medium" | "high" | "minimal" | "xhigh"

Property Value

"low" | "medium" | "high" | "minimal" | "xhigh"

keywords

Words or phrases to guide transcription of the input audio. Supported by gpt-transcribe and gpt-live-transcribe.

keywords?: string[]

Property Value

string[]

language

The language of the input audio. Supplying the input language in ISO-639-1 (e.g. en) format will improve accuracy and latency.

language?: string

Property Value

string

languages

Possible languages of the input audio, in ISO-639-1 format. Supported by gpt-transcribe and gpt-live-transcribe.

languages?: string[]

Property Value

string[]

model

The transcription model identifier. Configure customer custom speech deployments in custom_speech.

model: VoiceAgentInputTranscriptionModel

Property Value

VoiceAgentInputTranscriptionModel

phrase_list

Optional phrase hints that bias recognition toward domain terms.

phrase_list?: string[]

Property Value

string[]

prompt

An optional text to guide the model's style or continue a previous audio segment. For whisper-1, the prompt is a list of keywords. For gpt-4o-transcribe models (excluding gpt-4o-transcribe-diarize), the prompt is a free text string, for example "expect words related to technology". Prompt is not supported with gpt-realtime-whisper in GA Realtime sessions.

prompt?: string

Property Value

string