Transcription Denormalization.

Alex Cohen 0

Is there a way to "denormalize" Azure speech transcription, so it provides verbatim transcription (as close as possible, with word fillers, hesitations, repeats, etc)? I will also need word level timestamping and diarization.

I am hoping there is a simple function, like "normalize = False" for some Whisper packages.

Thanks

Amira Bedhiafi 19,946

I am not expert but I know that Azure Speech-to-Text service offers options to control the normalization of text. By default, the service may apply some normalization to improve readability. To get a more verbatim transcription, you can adjust the settings.

Azure Speech-to-Text supports word-level timestamps which you can enable to get the timing for each word in the transcription.

Diarization is the process of identifying and distinguishing between different speakers in the audio. Azure provides speaker diarization capabilities which you can enable. Here is an example, please try and tell us !

import azure.cognitiveservices.speech as speechsdk

# Initialize speech configuration
speech_key = "YourAzureSpeechKey"
service_region = "YourServiceRegion"
speech_config = speechsdk.SpeechConfig(subscription=speech_key, region=service_region)

# Set up audio configuration
audio_input = speechsdk.AudioConfig(filename="YourAudioFile.wav")

# Set up speech recognizer with desired settings
speech_recognizer = speechsdk.SpeechRecognizer(speech_config=speech_config, audio_config=audio_input)

# Enable detailed output format for word-level timestamps
speech_recognizer.recognition_format = speechsdk.SpeechRecognitionOutputFormat.Detailed

# Enable diarization
speech_recognizer.properties[speechsdk.PropertyId.SpeechServiceResponse_ProfanityOption] = "Masked"
speech_recognizer.properties[speechsdk.PropertyId.SpeechServiceResponse_ProfanityOption] = "Raw"

# Recognize speech from audio file
result = speech_recognizer.recognize_once()

# Process the result
if result.reason == speechsdk.ResultReason.RecognizedSpeech:
    detailed_result = speechsdk.SpeechRecognitionResult(result.json)
    for word in detailed_result['NBest'][0]['Words']:
        print(f"Word: {word['Word']}, Offset: {word['Offset']}, Duration: {word['Duration']}")
    print("Diarization results:", result.properties[speechsdk.PropertyId.SpeechServiceResponse_JsonResult])
else:
    print("No speech could be recognized")

Share via

Transcription Denormalization.